2024-04-25T15:39:46.983 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T15:39:46.983 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232 --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/orig.config.yaml 2024-04-25T15:39:47.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:39:47.130 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} email: pdonnell@redhat.com first_in_suite: false job_id: '7673232' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: client.0: cephfs_name: a client.1: cephfs_name: b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5fa+Bmz6w03NRQXvpArR19er833SFHLhoBoPbCoqYlZUSk6MrRqdG2mEyknCosKijAbUv8VuukVmzo9XCUw1s= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKMVMwQbw/DIKZiWS0SXIEK/Y26mdC3YsSKpbIqqlGZcc9S4znaCefXt6s3ay91mNrZB+B+FoCdazKmjB5ZhrxU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mds_thrash: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T15:39:47.130 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T15:39:47.131 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T15:39:47.131 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T15:39:47.132 INFO:teuthology.task.internal:Checking packages... 2024-04-25T15:39:47.158 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T15:39:47.158 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T15:39:47.158 INFO:teuthology.packaging:ref: None 2024-04-25T15:39:47.158 INFO:teuthology.packaging:tag: None 2024-04-25T15:39:47.158 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:39:47.158 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:39:47.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:39:47.303 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:39:47.304 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T15:39:47.313 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T15:39:47.313 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T15:39:47.349 INFO:teuthology.task.internal:Saving configuration 2024-04-25T15:39:47.367 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T15:39:47.375 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T15:39:47.399 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:33:48.727265', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF05VYGxVB6Xsrs6VRxS85MrYkWCI+0E4AtpO3A6/9dh'} 2024-04-25T15:39:47.421 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:33:48.725359', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKQW2kQOmYL1OSFxp7Z1hEwPc1pi4lLzQXQTjvD25f8N'} 2024-04-25T15:39:47.421 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T15:39:47.432 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T15:39:47.432 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-04-25T15:39:47.432 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T15:39:47.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd540845310>, signals=[15]) 2024-04-25T15:39:47.508 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T15:39:47.516 INFO:teuthology.task.internal:Opening connections... 2024-04-25T15:39:47.516 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T15:39:47.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:39:47.600 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:39:47.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:39:47.680 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T15:39:47.689 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-04-25T15:39:47.695 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-04-25T15:39:47.695 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-25T15:39:47.741 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T15:39:47.741 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T15:39:47.742 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2024-04-25T15:39:47.743 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-25T15:39:47.766 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-04-25T15:39:47.772 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-04-25T15:39:47.772 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2024-04-25T15:39:47.819 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T15:39:47.820 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T15:39:47.820 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T15:39:47.820 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T15:39:47.820 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2024-04-25T15:39:47.820 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-04-25T15:39:47.841 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T15:39:47.851 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T15:39:47.861 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T15:39:47.862 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:39:47.864 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:39:47.869 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T15:39:47.878 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T15:39:47.879 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:39:47.911 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:39:47.932 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T15:39:47.984 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T15:39:48.003 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T15:39:48.003 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T15:39:48.004 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:39:48.005 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:39:48.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:39:48.009 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-04-25T15:39:48.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:39:48.010 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-25T15:39:48.058 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-56-generic 2024-04-25T15:39:48.058 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.15.0-56-generic 2024-04-25T15:39:48.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-04-25T15:39:48.060 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-56-generic 2024-04-25T15:39:48.060 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.15.0-56-generic 2024-04-25T15:39:48.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2024-04-25T15:39:48.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-04-25T15:39:48.191 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-04-25T15:39:48.363 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T15:39:48.370 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T15:39:48.396 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T15:39:48.399 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T15:39:48.434 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T15:39:48.438 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T15:39:48.517 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T15:39:48.522 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T15:39:48.601 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T15:39:48.621 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-25T15:39:48.717 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T15:39:48.749 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T15:39:48.777 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T15:39:48.785 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T15:39:48.785 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T15:39:48.785 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T15:39:48.810 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T15:39:48.814 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T15:39:48.818 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T15:39:48.819 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T15:39:48.819 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T15:39:48.821 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T15:39:48.834 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T15:39:48.842 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T15:39:48.845 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T15:39:48.847 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T15:39:48.858 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T15:39:48.859 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T15:39:48.863 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T15:39:48.863 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T15:39:48.871 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T15:39:48.871 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T15:39:48.871 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T15:39:48.878 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T15:39:48.878 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T15:39:48.878 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T15:39:48.878 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T15:39:48.879 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T15:39:48.879 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T15:39:48.880 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T15:39:48.880 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T15:39:48.881 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T15:39:48.887 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T15:39:48.890 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T15:39:48.890 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T15:39:48.891 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T15:39:48.900 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T15:39:48.900 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T15:39:48.929 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T15:39:48.930 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T15:39:48.930 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T15:39:48.931 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T15:39:48.931 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T15:39:48.931 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T15:39:48.931 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T15:39:48.931 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T15:39:48.932 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T15:39:48.932 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T15:39:49.151 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T15:39:49.177 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T15:39:49.319 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T15:39:49.331 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T15:39:49.332 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T15:39:49.377 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T15:39:49.401 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T15:39:49.401 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T15:39:49.403 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T15:39:49.414 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T15:39:49.415 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T15:39:49.423 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T15:39:49.424 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T15:39:49.445 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T15:39:49.509 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T15:39:49.516 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T15:39:49.517 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T15:39:49.532 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T15:39:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T15:39:49.721 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T15:39:50.032 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T15:39:50.038 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T15:39:50.039 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T15:39:50.052 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T15:39:50.055 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T15:39:50.143 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T15:39:50.149 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T15:39:50.164 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T15:39:50.164 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T15:39:50.167 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T15:39:54.548 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 13.2 MB in 2s (6,807 kB/s) 2024-04-25T15:39:54.583 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 13.2 MB in 2s (6,886 kB/s) 2024-04-25T15:39:55.953 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:39:55.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T15:39:55.992 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:39:56.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T15:39:56.031 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:39:56.071 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:39:56.228 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-04-25T15:39:56.229 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-04-25T15:39:56.249 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-04-25T15:39:56.250 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-04-25T15:39:56.405 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:39:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:39:56.405 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:39:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:39:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T15:39:56.406 INFO:teuthology.orchestra.run.smithi087.stdout: python2.7-minimal 2024-04-25T15:39:56.406 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout: python2.7-minimal 2024-04-25T15:39:56.407 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:39:56.408 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-04-25T15:39:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T15:39:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T15:39:56.408 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi087.stdout: thermald 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T15:39:56.409 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T15:39:56.410 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T15:39:56.410 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-04-25T15:39:56.410 INFO:teuthology.orchestra.run.smithi155.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T15:39:56.410 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-04-25T15:39:56.410 INFO:teuthology.orchestra.run.smithi155.stdout: thermald 2024-04-25T15:39:56.458 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-04-25T15:39:56.458 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T15:39:56.458 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T15:39:56.458 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T15:39:56.459 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-04-25T15:39:56.460 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T15:39:56.460 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-04-25T15:39:56.460 INFO:teuthology.orchestra.run.smithi155.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T15:39:56.460 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T15:39:56.461 INFO:teuthology.orchestra.run.smithi155.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T15:39:56.462 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-04-25T15:39:56.463 INFO:teuthology.orchestra.run.smithi155.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T15:39:56.516 INFO:teuthology.orchestra.run.smithi087.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T15:39:56.516 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 113 MB of archives. 2024-04-25T15:39:56.517 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T15:39:56.517 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T15:39:56.520 INFO:teuthology.orchestra.run.smithi155.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T15:39:56.520 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 113 MB of archives. 2024-04-25T15:39:56.520 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T15:39:56.521 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T15:39:57.181 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T15:39:57.265 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T15:39:57.371 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T15:39:57.506 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T15:39:59.037 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T15:39:59.038 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T15:39:59.038 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T15:39:59.180 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T15:39:59.181 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T15:39:59.181 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T15:39:59.198 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T15:39:59.231 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T15:39:59.320 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T15:39:59.429 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T15:39:59.638 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 113 MB in 3s (41.0 MB/s) 2024-04-25T15:39:59.816 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T15:39:59.822 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 113 MB in 3s (38.3 MB/s) 2024-04-25T15:40:00.014 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T15:40:01.819 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T15:40:01.823 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:01.896 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:02.006 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T15:40:02.011 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:02.137 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:04.038 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T15:40:04.059 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:04.151 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:04.382 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T15:40:04.403 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:04.496 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:04.607 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T15:40:04.628 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:04.665 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:05.135 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T15:40:05.156 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:05.502 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:11.203 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T15:40:11.330 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T15:40:11.688 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T15:40:11.800 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T15:40:12.153 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T15:40:12.175 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T15:40:12.209 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T15:40:12.219 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T15:40:12.316 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T15:40:12.647 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T15:40:12.770 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T15:40:13.107 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T15:40:13.130 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T15:40:13.173 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T15:40:18.067 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T15:40:18.104 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:18.141 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:19.456 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T15:40:19.493 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T15:40:19.539 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:20.777 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T15:40:20.903 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T15:40:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T15:40:21.357 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:21.483 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T15:40:21.612 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:22.239 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T15:40:22.387 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T15:40:22.762 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T15:40:22.858 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:22.941 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T15:40:22.941 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T15:40:22.941 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T15:40:22.941 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:22.976 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T15:40:23.081 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:23.130 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:24.502 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T15:40:24.502 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T15:40:24.502 INFO:teuthology.orchestra.run.smithi155.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T15:40:24.502 INFO:teuthology.orchestra.run.smithi155.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:24.766 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:24.908 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:26.169 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:26.283 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T15:40:26.409 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T15:40:26.536 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:26.613 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T15:40:26.613 INFO:teuthology.orchestra.run.smithi087.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:27.569 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T15:40:27.695 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T15:40:27.847 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T15:40:27.915 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T15:40:27.915 INFO:teuthology.orchestra.run.smithi155.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:41.109 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T15:40:41.109 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub' 2024-04-25T15:40:41.129 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T15:40:41.148 INFO:teuthology.orchestra.run.smithi087.stdout:Generating grub configuration file ... 2024-04-25T15:40:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T15:40:41.431 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:41.735 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T15:40:41.741 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T15:40:41.807 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T15:40:41.813 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T15:40:41.939 INFO:teuthology.orchestra.run.smithi155.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T15:40:41.939 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub' 2024-04-25T15:40:41.969 INFO:teuthology.orchestra.run.smithi155.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T15:40:41.975 INFO:teuthology.orchestra.run.smithi087.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T15:40:41.975 INFO:teuthology.orchestra.run.smithi087.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T15:40:41.975 INFO:teuthology.orchestra.run.smithi087.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T15:40:41.989 INFO:teuthology.orchestra.run.smithi155.stdout:Generating grub configuration file ... 2024-04-25T15:40:42.016 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-04-25T15:40:42.284 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T15:40:42.302 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:42.441 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-04-25T15:40:42.461 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-04-25T15:40:42.461 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-04-25T15:40:42.461 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-04-25T15:40:42.461 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-04-25T15:40:42.461 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 21 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.15.0.105.102 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-04-25T15:40:42.462 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-04-25T15:40:42.463 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T15:40:42.463 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T15:40:42.463 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T15:40:42.463 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T15:40:42.464 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T15:40:42.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-04-25T15:40:42.637 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-04-25T15:40:42.643 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T15:40:42.649 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T15:40:42.718 INFO:teuthology.orchestra.run.smithi155.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T15:40:42.724 INFO:teuthology.orchestra.run.smithi155.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T15:40:42.762 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T15:40:42.774 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T15:40:42.795 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T15:40:42.881 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T15:40:42.906 INFO:teuthology.orchestra.run.smithi155.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T15:40:42.907 INFO:teuthology.orchestra.run.smithi155.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T15:40:42.907 INFO:teuthology.orchestra.run.smithi155.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T15:40:42.956 INFO:teuthology.orchestra.run.smithi155.stdout:done 2024-04-25T15:40:43.452 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2024-04-25T15:40:43.473 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2024-04-25T15:40:43.473 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2024-04-25T15:40:43.473 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2024-04-25T15:40:43.473 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2024-04-25T15:40:43.473 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 21 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.15.0.105.102 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2024-04-25T15:40:43.474 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2024-04-25T15:40:43.474 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T15:40:43.474 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T15:40:43.475 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T15:40:43.475 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-25T15:40:43.475 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T15:40:43.475 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get clean 2024-04-25T15:40:43.624 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T15:40:43.866 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T15:40:43.937 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T15:40:44.018 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:40:44.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T15:40:44.238 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:40:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-04-25T15:40:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-04-25T15:40:44.617 INFO:teuthology.orchestra.run.smithi087.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T15:40:44.617 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:40:44.618 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:40:44.618 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:40:44.618 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:40:44.618 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T15:40:44.618 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T15:40:44.618 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:40:44.659 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T15:40:44.661 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-04-25T15:40:44.676 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-04-25T15:40:44.676 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-04-25T15:40:44.676 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-04-25T15:40:44.676 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 21 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.15.0.105.102 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-04-25T15:40:44.677 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-04-25T15:40:44.677 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-04-25T15:40:44.725 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.TfUwtWKgLj 2024-04-25T15:40:44.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TfUwtWKgLj 2024-04-25T15:40:44.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.TfUwtWKgLj 2024-04-25T15:40:44.897 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.TfUwtWKgLj is 10KB 2024-04-25T15:40:44.910 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.TfUwtWKgLj 2024-04-25T15:40:44.915 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T15:40:44.969 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:40:44.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T15:40:44.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T15:40:45.036 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T15:40:45.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo update-grub 2024-04-25T15:40:45.135 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:40:45.154 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T15:40:45.214 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:40:45.423 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-04-25T15:40:45.423 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-04-25T15:40:45.604 INFO:teuthology.orchestra.run.smithi155.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T15:40:45.604 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:40:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:40:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:40:45.604 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:40:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T15:40:45.605 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T15:40:45.605 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:40:45.644 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T15:40:45.647 DEBUG:teuthology.orchestra.run.smithi155:> dpkg -s linux-image-generic 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Package: linux-image-generic 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Status: install ok installed 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Priority: optional 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Section: kernel 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Installed-Size: 21 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: amd64 2024-04-25T15:40:45.662 INFO:teuthology.orchestra.run.smithi155.stdout:Source: linux-meta 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout:Version: 5.15.0.105.102 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout:Recommends: thermald 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout:Description: Generic Linux kernel image 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: This package will always depend on the latest generic kernel image 2024-04-25T15:40:45.663 INFO:teuthology.orchestra.run.smithi155.stdout: available. 2024-04-25T15:40:45.663 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T15:40:45.710 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.SckcHrNa06 2024-04-25T15:40:45.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SckcHrNa06 2024-04-25T15:40:45.768 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.SckcHrNa06 2024-04-25T15:40:45.899 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.SckcHrNa06 is 10KB 2024-04-25T15:40:45.912 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.SckcHrNa06 2024-04-25T15:40:45.917 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T15:40:45.971 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:40:45.971 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T15:40:45.971 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T15:40:46.063 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T15:40:46.063 DEBUG:teuthology.orchestra.run.smithi155:> sudo update-grub 2024-04-25T15:40:46.209 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2024-04-25T15:40:46.210 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T15:40:46.212 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-04-25T15:40:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T15:40:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:46.632 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T15:40:46.637 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T15:40:46.678 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T15:40:46.683 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T15:40:46.816 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T15:40:46.816 INFO:teuthology.orchestra.run.smithi087.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T15:40:46.816 INFO:teuthology.orchestra.run.smithi087.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T15:40:46.833 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-04-25T15:40:46.850 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-04-25T15:40:47.365 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2024-04-25T15:40:47.367 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T15:40:47.368 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-04-25T15:40:47.564 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T15:40:47.570 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T15:40:47.789 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T15:40:47.794 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T15:40:47.837 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T15:40:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T15:40:47.968 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T15:40:47.968 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T15:40:47.968 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T15:40:47.996 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-04-25T15:40:48.014 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-04-25T15:41:16.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T15:41:16.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:41:16.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:41:18.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-25T15:41:18.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:41:18.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:41:35.391 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-25T15:41:44.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:41:44.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:41:47.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-25T15:41:52.542 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-04-25T15:41:59.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:41:59.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:42:01.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:42:01.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:42:17.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-25T15:42:32.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:42:32.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:42:33.276 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-25T15:42:34.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:42:34.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T15:42:34.510 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-04-25T15:42:34.556 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-105-generic 2024-04-25T15:42:34.556 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T15:42:34.556 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T15:42:34.556 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T15:42:35.557 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T15:42:35.558 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T15:42:35.824 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-04-25T15:42:35.849 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:01.548 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T15:43:13.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:43:13.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:43:13.865 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-25T15:43:14.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:43:14.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-25T15:43:14.464 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-25T15:43:14.509 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-105-generic 2024-04-25T15:43:14.509 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T15:43:14.509 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T15:43:14.509 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T15:43:15.510 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T15:43:15.510 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T15:43:15.581 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-04-25T15:43:15.599 DEBUG:teuthology.parallel:result is None 2024-04-25T15:43:15.599 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T15:43:15.607 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T15:43:15.607 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:43:15.610 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:43:15.615 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T15:43:15.625 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T15:43:15.635 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T15:43:15.635 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:43:15.656 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:43:15.675 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T15:43:15.682 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T15:43:15.682 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:43:15.712 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:43:15.734 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:43:15.735 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:43:15.742 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:43:15.743 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:43:15.745 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T15:43:15.751 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T15:43:15.752 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:43:15.788 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:43:15.802 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T15:43:15.811 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T15:43:15.811 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:43:15.844 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:43:15.849 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:43:15.895 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:43:15.943 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:43:15.943 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:43:16.025 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:43:16.031 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:43:16.077 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:43:16.077 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:43:16.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-04-25T15:43:16.145 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-04-25T15:43:16.214 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T15:43:16.222 INFO:teuthology.task.internal:Starting timer... 2024-04-25T15:43:16.222 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T15:43:16.232 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T15:43:16.239 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2024-04-25T15:43:16.240 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2024-04-25T15:43:16.240 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T15:43:16.240 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T15:43:16.240 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T15:43:16.240 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T15:43:16.249 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T15:43:16.255 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T15:43:16.403 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T15:43:16.417 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T15:43:16.418 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T15:50:20.494 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-04-25T15:50:20.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:50:20.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:50:20.585 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-25T15:50:20.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-25T15:50:20.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:50:20.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:50:20.751 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-25T15:50:20.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:50:20.831 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T15:50:20.843 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T15:50:20.843 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:50:20.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:50:20.846 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:50:20.846 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:50:20.871 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Command line: ntpd -gq 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: ---------------------------------------------------- 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: corporation. Support and training for ntp-4 are 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: available at https://www.nwtime.org/support 2024-04-25T15:50:20.872 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: ---------------------------------------------------- 2024-04-25T15:50:20.873 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: proto: precision = 0.058 usec (-24) 2024-04-25T15:50:20.873 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: basedate set to 2022-02-04 2024-04-25T15:50:20.873 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: gps base set to 2022-02-06 (week 2196) 2024-04-25T15:50:20.873 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T15:50:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T15:50:20.873 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T15:50:20.874 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T15:50:20.874 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T15:50:20.874 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T15:50:20.875 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T15:50:20.875 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2024-04-25T15:50:20.875 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listen normally on 4 lo [::1]:123 2024-04-25T15:50:20.875 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2024-04-25T15:50:20.875 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:20 ntpd[17238]: Listening on routing socket on fd #22 for interface updates 2024-04-25T15:50:20.904 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Command line: ntpd -gq 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: ---------------------------------------------------- 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: corporation. Support and training for ntp-4 are 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: available at https://www.nwtime.org/support 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: ---------------------------------------------------- 2024-04-25T15:50:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: proto: precision = 0.055 usec (-24) 2024-04-25T15:50:20.906 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: basedate set to 2022-02-04 2024-04-25T15:50:20.906 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: gps base set to 2022-02-06 (week 2196) 2024-04-25T15:50:20.906 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T15:50:20.906 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T15:50:20.906 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T15:50:20.907 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T15:50:20.907 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T15:50:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T15:50:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T15:50:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2024-04-25T15:50:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listen normally on 4 lo [::1]:123 2024-04-25T15:50:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2024-04-25T15:50:20.908 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:20 ntpd[17193]: Listening on routing socket on fd #22 for interface updates 2024-04-25T15:50:21.872 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:21 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:21.872 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:21 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:21.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:21 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:21.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:21 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:21.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:21 ntpd[17238]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:21.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:21 ntpd[17238]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:21.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:21 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:22.905 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:22 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:22.905 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:22 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:23.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:23 ntpd[17238]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:23.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:23 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:25.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:25 ntpd[17238]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:25.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:25 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:27.872 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stdout:25 Apr 15:50:27 ntpd[17238]: ntpd: time slew -0.000087 s 2024-04-25T15:50:27.873 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew -0.000087s 2024-04-25T15:50:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T15:50:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:25 Apr 15:50:27 ntpd[17238]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T15:50:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stdout:25 Apr 15:50:27 ntpd[17193]: ntpd: time slew -0.000888 s 2024-04-25T15:50:27.906 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time slew -0.000888s 2024-04-25T15:50:27.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T15:50:27.907 INFO:teuthology.orchestra.run.smithi155.stderr:25 Apr 15:50:27 ntpd[17193]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T15:50:27.923 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T15:50:27.923 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-04-25T15:50:27.923 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.923 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.923 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.923 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.964 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T15:50:27.964 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-04-25T15:50:27.964 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.964 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.964 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.965 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T15:50:27.966 INFO:teuthology.run_tasks:Running task install... 2024-04-25T15:50:27.978 DEBUG:teuthology.task.install:project ceph 2024-04-25T15:50:27.978 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T15:50:27.978 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T15:50:27.978 INFO:teuthology.task.install:Using flavor: default 2024-04-25T15:50:27.986 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T15:50:27.986 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T15:50:27.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2024-04-25T15:50:27.987 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2024-04-25T15:50:28.043 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T15:50:28.060 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T15:50:28.070 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T15:50:28.070 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T15:50:28.071 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T15:50:28.071 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T15:50:28.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:50:28.086 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T15:50:28.086 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T15:50:28.087 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T15:50:28.087 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T15:50:28.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:50:28.219 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T15:50:28.219 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:50:28.304 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T15:50:28.304 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:50:28.406 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:50:28.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T15:50:28.419 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-04-25T15:50:28.484 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:50:28.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T15:50:28.497 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-04-25T15:50:28.608 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T15:50:28.620 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T15:50:28.641 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T15:50:28.644 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T15:50:28.662 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T15:50:28.670 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T15:50:28.684 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T15:50:28.706 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T15:50:28.733 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T15:50:28.737 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T15:50:28.782 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T15:50:28.785 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T15:50:28.822 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T15:50:28.859 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T15:50:28.866 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T15:50:28.896 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T15:50:28.945 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T15:50:28.945 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T15:50:28.959 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 29.2 kB in 0s (80.4 kB/s) 2024-04-25T15:50:29.078 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 29.2 kB in 0s (71.8 kB/s) 2024-04-25T15:50:29.883 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:50:29.899 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:50:29.959 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:50:30.052 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:50:30.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:50:30.128 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:50:30.162 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-04-25T15:50:30.163 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-04-25T15:50:30.333 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-04-25T15:50:30.334 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-04-25T15:50:30.351 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:50:30.351 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:50:30.351 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:50:30.351 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:50:30.351 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T15:50:30.351 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T15:50:30.352 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:50:30.353 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-04-25T15:50:30.354 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T15:50:30.354 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T15:50:30.354 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T15:50:30.354 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T15:50:30.354 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T15:50:30.354 INFO:teuthology.orchestra.run.smithi087.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T15:50:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T15:50:30.356 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T15:50:30.356 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T15:50:30.356 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T15:50:30.356 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T15:50:30.356 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T15:50:30.356 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T15:50:30.357 INFO:teuthology.orchestra.run.smithi087.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T15:50:30.358 INFO:teuthology.orchestra.run.smithi087.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T15:50:30.358 INFO:teuthology.orchestra.run.smithi087.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T15:50:30.358 INFO:teuthology.orchestra.run.smithi087.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T15:50:30.358 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T15:50:30.358 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T15:50:30.359 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-04-25T15:50:30.359 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2024-04-25T15:50:30.462 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T15:50:30.463 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T15:50:30.464 INFO:teuthology.orchestra.run.smithi087.stdout: socat unzip xmlstarlet zip 2024-04-25T15:50:30.524 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:50:30.524 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:50:30.524 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:50:30.524 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:50:30.525 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T15:50:30.525 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T15:50:30.525 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:50:30.525 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-04-25T15:50:30.526 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T15:50:30.526 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T15:50:30.526 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T15:50:30.526 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T15:50:30.527 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T15:50:30.528 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-04-25T15:50:30.529 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2024-04-25T15:50:30.604 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T15:50:30.604 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 175 MB of archives. 2024-04-25T15:50:30.604 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T15:50:30.604 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T15:50:30.636 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-04-25T15:50:30.636 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T15:50:30.636 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T15:50:30.636 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T15:50:30.636 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T15:50:30.638 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T15:50:30.639 INFO:teuthology.orchestra.run.smithi155.stdout: socat unzip xmlstarlet zip 2024-04-25T15:50:30.651 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T15:50:30.734 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T15:50:30.773 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T15:50:30.773 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 175 MB of archives. 2024-04-25T15:50:30.773 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T15:50:30.774 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T15:50:30.780 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T15:50:30.826 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T15:50:30.880 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T15:50:30.906 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T15:50:30.952 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T15:50:30.982 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T15:50:31.051 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T15:50:31.077 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T15:50:31.087 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T15:50:31.090 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T15:50:31.105 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T15:50:31.106 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T15:50:31.112 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T15:50:31.114 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T15:50:31.121 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T15:50:31.139 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T15:50:31.142 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T15:50:31.154 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T15:50:31.249 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T15:50:31.263 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T15:50:31.315 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T15:50:31.316 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T15:50:31.325 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T15:50:31.352 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T15:50:31.360 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T15:50:31.381 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T15:50:31.434 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T15:50:31.477 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T15:50:31.478 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T15:50:31.484 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T15:50:31.486 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T15:50:31.488 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T15:50:31.497 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T15:50:31.525 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T15:50:31.526 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T15:50:31.527 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T15:50:31.529 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T15:50:31.530 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T15:50:31.534 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T15:50:31.563 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T15:50:31.700 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T15:50:32.098 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T15:50:32.113 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T15:50:32.128 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T15:50:32.137 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T15:50:32.137 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T15:50:32.154 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T15:50:32.169 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T15:50:32.172 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T15:50:32.181 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T15:50:32.192 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T15:50:32.205 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T15:50:32.209 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T15:50:32.210 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T15:50:32.275 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T15:50:32.290 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T15:50:32.306 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T15:50:32.314 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T15:50:32.315 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T15:50:32.331 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T15:50:32.369 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T15:50:32.380 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T15:50:32.383 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T15:50:32.386 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T15:50:32.387 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T15:50:32.463 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T15:50:32.487 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T15:50:32.545 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T15:50:32.557 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T15:50:32.588 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T15:50:32.609 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T15:50:32.637 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T15:50:32.641 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T15:50:32.662 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T15:50:32.723 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T15:50:32.760 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T15:50:32.782 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T15:50:32.809 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T15:50:32.822 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T15:50:32.838 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T15:50:32.845 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T15:50:32.850 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T15:50:32.993 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T15:50:33.009 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T15:50:33.016 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T15:50:33.021 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T15:50:33.035 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T15:50:33.081 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T15:50:33.163 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T15:50:33.177 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T15:50:33.206 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T15:50:33.238 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T15:50:33.244 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T15:50:33.248 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T15:50:33.290 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T15:50:33.306 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T15:50:33.351 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T15:50:33.352 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T15:50:33.397 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T15:50:33.410 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T15:50:33.492 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T15:50:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T15:50:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T15:50:33.570 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T15:50:33.571 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T15:50:33.575 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T15:50:33.580 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T15:50:33.594 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T15:50:33.665 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T15:50:33.717 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T15:50:33.718 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T15:50:33.723 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T15:50:33.727 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T15:50:33.742 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T15:50:33.781 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T15:50:33.926 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T15:50:34.045 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T15:50:34.159 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T15:50:34.190 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T15:50:34.204 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T15:50:34.287 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T15:50:34.299 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T15:50:34.312 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T15:50:34.329 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T15:50:34.331 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T15:50:34.349 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T15:50:34.352 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T15:50:34.432 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T15:50:34.444 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T15:50:34.457 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T15:50:34.497 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T15:50:34.616 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T15:50:34.618 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T15:50:34.621 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T15:50:34.642 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T15:50:34.689 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T15:50:34.693 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T15:50:34.762 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T15:50:34.764 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T15:50:34.766 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T15:50:34.785 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T15:50:34.791 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T15:50:34.931 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T15:50:34.977 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T15:50:34.977 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T15:50:34.994 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T15:50:35.097 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T15:50:35.122 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T15:50:35.122 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T15:50:35.155 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T15:50:35.265 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T15:50:35.268 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T15:50:35.294 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T15:50:35.518 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T15:50:35.526 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T15:50:35.527 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T15:50:35.596 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T15:50:35.597 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T15:50:35.598 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T15:50:35.600 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T15:50:35.602 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T15:50:35.604 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T15:50:35.668 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T15:50:35.678 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T15:50:35.679 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T15:50:35.736 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T15:50:35.737 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T15:50:35.747 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T15:50:35.748 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T15:50:35.750 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T15:50:35.751 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T15:50:35.752 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T15:50:35.768 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T15:50:35.918 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T15:50:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T15:50:36.012 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T15:50:36.110 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T15:50:36.296 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T15:50:36.340 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T15:50:36.357 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T15:50:36.367 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T15:50:36.376 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T15:50:36.400 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T15:50:36.422 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T15:50:36.424 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T15:50:36.436 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T15:50:36.447 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T15:50:36.450 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T15:50:36.456 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T15:50:36.459 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T15:50:36.479 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T15:50:36.504 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T15:50:36.506 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T15:50:36.514 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T15:50:36.656 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T15:50:36.683 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T15:50:36.915 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T15:50:37.052 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T15:50:37.053 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T15:50:37.070 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T15:50:37.154 INFO:teuthology.orchestra.run.smithi087.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T15:50:37.157 INFO:teuthology.orchestra.run.smithi087.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T15:50:37.175 INFO:teuthology.orchestra.run.smithi087.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T15:50:37.181 INFO:teuthology.orchestra.run.smithi087.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T15:50:37.210 INFO:teuthology.orchestra.run.smithi155.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T15:50:37.216 INFO:teuthology.orchestra.run.smithi155.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T15:50:37.216 INFO:teuthology.orchestra.run.smithi087.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T15:50:37.223 INFO:teuthology.orchestra.run.smithi155.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T15:50:37.229 INFO:teuthology.orchestra.run.smithi087.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T15:50:37.255 INFO:teuthology.orchestra.run.smithi155.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T15:50:37.256 INFO:teuthology.orchestra.run.smithi155.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T15:50:37.263 INFO:teuthology.orchestra.run.smithi155.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T15:50:37.265 INFO:teuthology.orchestra.run.smithi155.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T15:50:37.284 INFO:teuthology.orchestra.run.smithi155.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T15:50:37.289 INFO:teuthology.orchestra.run.smithi155.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T15:50:37.306 INFO:teuthology.orchestra.run.smithi155.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T15:50:37.315 INFO:teuthology.orchestra.run.smithi155.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T15:50:37.320 INFO:teuthology.orchestra.run.smithi087.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T15:50:37.322 INFO:teuthology.orchestra.run.smithi087.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T15:50:37.323 INFO:teuthology.orchestra.run.smithi087.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T15:50:37.387 INFO:teuthology.orchestra.run.smithi155.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T15:50:37.388 INFO:teuthology.orchestra.run.smithi155.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T15:50:37.445 INFO:teuthology.orchestra.run.smithi155.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T15:50:37.503 INFO:teuthology.orchestra.run.smithi087.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T15:50:37.553 INFO:teuthology.orchestra.run.smithi155.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T15:50:37.776 INFO:teuthology.orchestra.run.smithi087.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T15:50:37.995 INFO:teuthology.orchestra.run.smithi155.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T15:50:38.010 INFO:teuthology.orchestra.run.smithi155.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T15:50:38.049 INFO:teuthology.orchestra.run.smithi155.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T15:50:38.050 INFO:teuthology.orchestra.run.smithi155.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T15:50:38.694 INFO:teuthology.orchestra.run.smithi087.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T15:50:38.696 INFO:teuthology.orchestra.run.smithi087.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T15:50:38.701 INFO:teuthology.orchestra.run.smithi087.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T15:50:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T15:50:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T15:50:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T15:50:39.473 INFO:teuthology.orchestra.run.smithi087.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T15:50:40.088 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 175 MB in 9s (19.4 MB/s) 2024-04-25T15:50:40.221 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T15:50:40.317 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T15:50:40.323 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T15:50:40.370 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T15:50:40.443 INFO:teuthology.orchestra.run.smithi155.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T15:50:40.445 INFO:teuthology.orchestra.run.smithi155.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T15:50:40.450 INFO:teuthology.orchestra.run.smithi155.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T15:50:40.451 INFO:teuthology.orchestra.run.smithi155.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T15:50:40.451 INFO:teuthology.orchestra.run.smithi155.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T15:50:40.453 INFO:teuthology.orchestra.run.smithi155.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T15:50:40.631 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T15:50:40.658 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T15:50:40.689 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T15:50:40.812 INFO:teuthology.orchestra.run.smithi155.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T15:50:40.950 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T15:50:40.977 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T15:50:41.017 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T15:50:41.336 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T15:50:41.363 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T15:50:41.445 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T15:50:41.496 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 175 MB in 10s (17.1 MB/s) 2024-04-25T15:50:41.644 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T15:50:41.734 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T15:50:41.740 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T15:50:41.790 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T15:50:41.800 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T15:50:41.816 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T15:50:41.856 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T15:50:42.095 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T15:50:42.121 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T15:50:42.161 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T15:50:42.193 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T15:50:42.219 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T15:50:42.259 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T15:50:42.464 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T15:50:42.490 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T15:50:42.539 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T15:50:42.604 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T15:50:42.631 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T15:50:42.850 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T15:50:42.871 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:50:42.877 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T15:50:42.942 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T15:50:43.283 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T15:50:43.287 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T15:50:43.309 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T15:50:43.313 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T15:50:43.349 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:50:43.353 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T15:50:43.669 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T15:50:43.681 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T15:50:43.695 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T15:50:43.708 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T15:50:43.735 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:50:43.748 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T15:50:44.030 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T15:50:44.056 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T15:50:44.088 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T15:50:44.368 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T15:50:44.391 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librados2. 2024-04-25T15:50:44.395 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T15:50:44.417 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:44.442 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:50:44.458 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:44.862 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T15:50:44.889 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T15:50:44.927 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librbd1. 2024-04-25T15:50:44.929 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:50:44.953 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:44.994 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:45.274 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T15:50:45.300 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T15:50:45.365 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:50:45.446 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T15:50:45.461 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:45.504 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:45.676 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T15:50:45.703 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T15:50:45.743 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T15:50:45.749 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2024-04-25T15:50:45.764 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:45.807 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:46.029 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librados2. 2024-04-25T15:50:46.055 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:46.095 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:46.127 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T15:50:46.153 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:50:46.193 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:46.446 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T15:50:46.472 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:46.512 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:46.565 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librbd1. 2024-04-25T15:50:46.591 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:46.631 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:46.815 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T15:50:46.841 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:50:46.881 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:47.092 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T15:50:47.119 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:47.159 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:47.193 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T15:50:47.219 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T15:50:47.259 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T15:50:47.445 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2024-04-25T15:50:47.460 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:47.494 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:47.512 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T15:50:47.527 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:47.562 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:47.789 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T15:50:47.816 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:50:47.855 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:47.907 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T15:50:47.933 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T15:50:47.973 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T15:50:48.108 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T15:50:48.123 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:48.166 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:48.267 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T15:50:48.282 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T15:50:48.326 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T15:50:48.485 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T15:50:48.512 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:50:48.552 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:48.629 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T15:50:48.655 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T15:50:48.695 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T15:50:48.888 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T15:50:48.915 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T15:50:48.971 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T15:50:48.999 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua5.1. 2024-04-25T15:50:49.025 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T15:50:49.057 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T15:50:49.241 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T15:50:49.256 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:49.291 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:49.360 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-any. 2024-04-25T15:50:49.386 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T15:50:49.426 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T15:50:49.679 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package zip. 2024-04-25T15:50:49.694 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T15:50:49.737 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T15:50:49.744 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T15:50:49.770 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T15:50:49.810 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T15:50:50.057 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package unzip. 2024-04-25T15:50:50.084 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T15:50:50.088 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T15:50:50.114 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T15:50:50.124 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T15:50:50.154 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T15:50:50.457 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T15:50:50.469 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package luarocks. 2024-04-25T15:50:50.472 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T15:50:50.496 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T15:50:50.515 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T15:50:50.536 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T15:50:50.843 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua5.1. 2024-04-25T15:50:50.869 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T15:50:50.910 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T15:50:50.910 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2024-04-25T15:50:50.936 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:50.977 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:51.213 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-any. 2024-04-25T15:50:51.228 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T15:50:51.262 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T15:50:51.507 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package zip. 2024-04-25T15:50:51.522 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T15:50:51.565 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T15:50:51.604 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T15:50:51.619 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:51.662 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:51.885 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package unzip. 2024-04-25T15:50:51.911 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T15:50:51.951 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T15:50:51.982 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T15:50:52.008 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T15:50:52.040 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T15:50:52.326 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T15:50:52.353 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:52.355 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package luarocks. 2024-04-25T15:50:52.381 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T15:50:52.393 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:52.421 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T15:50:52.813 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2024-04-25T15:50:52.829 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2024-04-25T15:50:52.839 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:52.855 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:52.879 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:52.895 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:53.497 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T15:50:53.513 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:53.547 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:53.884 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T15:50:53.910 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T15:50:53.950 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T15:50:54.261 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T15:50:54.289 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:54.301 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2024-04-25T15:50:54.328 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:54.328 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:54.377 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:54.706 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2024-04-25T15:50:54.732 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:54.764 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:54.906 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T15:50:54.932 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T15:50:54.964 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T15:50:55.284 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T15:50:55.310 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T15:50:55.350 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T15:50:55.661 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T15:50:55.677 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T15:50:55.719 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T15:50:56.006 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T15:50:56.022 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T15:50:56.056 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T15:50:56.300 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T15:50:56.302 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2024-04-25T15:50:56.326 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T15:50:56.329 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:50:56.358 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T15:50:56.379 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:50:56.661 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T15:50:56.688 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T15:50:56.728 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T15:50:56.973 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T15:50:56.999 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T15:50:57.031 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-portend. 2024-04-25T15:50:57.040 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T15:50:57.057 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T15:50:57.097 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T15:50:57.309 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T15:50:57.335 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T15:50:57.359 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T15:50:57.367 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T15:50:57.385 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T15:50:57.417 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T15:50:57.662 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T15:50:57.688 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T15:50:57.695 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T15:50:57.720 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T15:50:57.721 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T15:50:57.761 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T15:50:58.023 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T15:50:58.049 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T15:50:58.089 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T15:50:58.115 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T15:50:58.130 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T15:50:58.165 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T15:50:58.417 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T15:50:58.435 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T15:50:58.443 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T15:50:58.461 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T15:50:58.483 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T15:50:58.501 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T15:50:58.745 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T15:50:58.771 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T15:50:58.804 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T15:50:58.811 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T15:50:58.831 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T15:50:58.870 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T15:50:59.114 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-portend. 2024-04-25T15:50:59.140 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T15:50:59.174 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2024-04-25T15:50:59.180 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T15:50:59.200 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T15:50:59.240 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T15:50:59.491 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T15:50:59.518 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T15:50:59.558 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T15:50:59.560 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T15:50:59.575 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T15:50:59.610 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T15:50:59.879 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T15:50:59.906 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T15:50:59.946 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T15:51:00.061 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T15:51:00.088 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T15:51:00.127 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T15:51:00.266 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2024-04-25T15:51:00.292 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T15:51:00.332 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T15:51:00.472 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T15:51:00.498 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T15:51:00.538 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T15:51:00.677 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T15:51:00.703 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T15:51:00.747 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T15:51:00.850 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T15:51:00.876 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T15:51:00.916 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T15:51:01.063 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T15:51:01.089 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T15:51:01.129 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T15:51:01.219 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T15:51:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T15:51:01.285 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T15:51:01.374 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2024-04-25T15:51:01.400 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T15:51:01.432 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T15:51:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2024-04-25T15:51:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T15:51:01.605 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T15:51:01.777 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T15:51:01.804 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T15:51:01.843 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T15:51:01.941 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T15:51:01.968 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T15:51:02.008 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T15:51:02.113 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T15:51:02.139 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T15:51:02.171 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T15:51:02.310 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T15:51:02.337 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T15:51:02.377 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T15:51:02.468 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T15:51:02.495 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T15:51:02.534 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T15:51:02.654 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2024-04-25T15:51:02.670 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T15:51:02.704 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T15:51:02.821 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T15:51:02.848 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T15:51:02.887 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T15:51:03.007 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T15:51:03.034 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T15:51:03.069 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T15:51:03.234 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T15:51:03.261 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T15:51:03.292 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T15:51:03.385 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T15:51:03.411 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T15:51:03.451 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T15:51:03.595 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-idna. 2024-04-25T15:51:03.622 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T15:51:03.661 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T15:51:03.754 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2024-04-25T15:51:03.781 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T15:51:04.154 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T15:51:04.698 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T15:51:04.726 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T15:51:04.789 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T15:51:04.857 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T15:51:04.873 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T15:51:04.916 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T15:51:05.118 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests. 2024-04-25T15:51:05.145 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T15:51:05.184 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T15:51:05.202 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T15:51:05.228 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T15:51:05.268 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T15:51:05.471 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T15:51:05.498 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T15:51:05.537 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T15:51:05.571 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T15:51:05.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T15:51:05.638 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T15:51:05.815 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T15:51:05.831 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:05.865 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:05.949 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T15:51:05.975 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T15:51:06.015 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T15:51:06.220 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T15:51:06.247 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:06.286 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:06.395 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T15:51:06.422 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T15:51:06.461 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T15:51:06.564 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T15:51:06.591 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T15:51:06.631 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T15:51:06.789 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-idna. 2024-04-25T15:51:06.816 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T15:51:06.872 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T15:51:06.909 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T15:51:06.936 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T15:51:06.975 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T15:51:07.159 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T15:51:07.185 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T15:51:07.225 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T15:51:07.320 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T15:51:07.347 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:07.386 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:07.528 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests. 2024-04-25T15:51:07.555 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T15:51:07.594 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T15:51:07.798 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T15:51:07.825 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:07.864 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:07.881 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T15:51:07.905 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T15:51:07.939 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T15:51:08.242 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T15:51:08.257 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:08.292 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:08.393 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T15:51:08.421 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:08.460 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:08.680 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T15:51:08.706 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:08.746 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:09.068 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T15:51:09.094 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T15:51:09.126 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T15:51:09.420 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T15:51:09.447 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T15:51:09.486 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T15:51:09.554 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2024-04-25T15:51:09.570 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:09.612 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:09.823 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T15:51:09.850 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:09.889 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:09.923 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T15:51:09.951 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:09.990 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:10.352 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T15:51:10.379 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:10.409 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:10.492 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T15:51:10.519 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:10.567 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:10.796 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2024-04-25T15:51:10.823 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:10.862 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:11.171 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T15:51:11.182 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T15:51:11.197 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:11.209 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T15:51:11.237 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:11.248 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T15:51:11.551 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T15:51:11.567 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T15:51:11.609 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:12.265 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2024-04-25T15:51:12.292 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:12.331 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:12.614 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-babel. 2024-04-25T15:51:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T15:51:12.650 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T15:51:12.677 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:12.717 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:12.958 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T15:51:12.974 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T15:51:13.008 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T15:51:13.062 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T15:51:13.088 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:13.119 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:13.328 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T15:51:13.343 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:13.378 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:13.531 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2024-04-25T15:51:13.558 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:13.597 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:13.681 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T15:51:13.708 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T15:51:13.747 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T15:51:13.916 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T15:51:13.943 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T15:51:13.983 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T15:51:14.001 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2024-04-25T15:51:14.027 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T15:51:14.067 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T15:51:14.319 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T15:51:14.335 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T15:51:14.345 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T15:51:14.372 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:14.377 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:14.403 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:15.365 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-babel. 2024-04-25T15:51:15.392 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T15:51:15.431 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:15.616 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T15:51:15.632 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T15:51:15.675 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T15:51:15.809 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T15:51:15.836 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T15:51:15.876 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T15:51:16.137 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T15:51:16.164 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T15:51:16.170 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T15:51:16.197 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:16.203 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T15:51:16.237 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:16.548 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T15:51:16.556 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T15:51:16.575 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T15:51:16.580 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T15:51:16.615 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T15:51:16.700 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T15:51:16.901 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2024-04-25T15:51:16.928 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T15:51:16.976 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T15:51:16.995 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T15:51:17.022 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T15:51:17.061 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T15:51:17.296 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T15:51:17.322 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:17.362 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:17.762 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T15:51:17.790 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:17.828 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:18.575 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T15:51:18.591 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T15:51:18.633 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T15:51:18.782 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T15:51:18.809 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T15:51:18.848 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T15:51:19.112 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T15:51:19.139 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T15:51:19.151 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T15:51:19.178 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T15:51:19.178 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T15:51:19.217 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T15:51:19.540 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T15:51:19.567 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T15:51:19.691 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T15:51:19.805 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T15:51:19.832 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T15:51:19.871 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T15:51:19.986 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T15:51:20.013 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T15:51:20.052 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T15:51:20.191 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T15:51:20.209 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T15:51:20.249 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T15:51:20.503 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T15:51:20.530 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T15:51:20.569 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T15:51:20.881 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T15:51:20.908 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T15:51:20.928 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T15:51:20.947 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T15:51:20.955 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:20.994 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T15:51:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T15:51:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T15:51:21.629 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T15:51:21.656 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T15:51:21.695 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T15:51:21.930 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T15:51:21.957 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T15:51:21.997 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T15:51:22.300 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T15:51:22.327 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T15:51:22.366 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T15:51:22.376 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T15:51:22.403 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:22.442 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:22.703 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T15:51:22.730 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T15:51:22.769 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T15:51:22.770 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T15:51:22.797 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T15:51:22.836 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T15:51:23.080 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T15:51:23.107 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T15:51:23.147 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T15:51:23.198 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T15:51:23.225 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T15:51:23.272 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T15:51:23.417 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T15:51:23.432 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T15:51:23.466 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T15:51:23.542 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2024-04-25T15:51:23.569 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T15:51:23.608 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T15:51:23.753 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T15:51:23.780 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T15:51:23.811 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T15:51:23.861 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2024-04-25T15:51:23.877 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T15:51:23.919 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T15:51:24.115 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T15:51:24.142 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T15:51:24.181 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T15:51:24.214 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T15:51:24.241 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T15:51:24.272 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T15:51:24.476 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T15:51:24.503 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T15:51:24.534 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T15:51:24.618 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2024-04-25T15:51:24.634 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:24.676 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:25.328 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T15:51:25.357 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:25.497 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:25.817 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T15:51:25.844 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T15:51:25.883 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T15:51:26.261 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T15:51:26.289 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T15:51:26.328 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T15:51:26.538 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2024-04-25T15:51:26.555 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T15:51:26.588 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T15:51:26.841 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2024-04-25T15:51:26.868 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T15:51:26.907 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T15:51:26.949 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T15:51:26.977 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:27.022 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:27.227 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T15:51:27.243 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T15:51:27.285 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T15:51:27.401 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T15:51:27.429 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:27.467 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:27.631 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2024-04-25T15:51:27.647 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:27.689 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:27.788 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T15:51:27.815 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T15:51:27.854 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T15:51:28.115 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T15:51:28.142 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:28.181 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:28.409 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T15:51:28.436 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:28.467 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:28.703 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T15:51:28.719 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:28.761 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:29.081 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T15:51:29.108 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T15:51:29.147 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T15:51:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T15:51:29.496 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T15:51:29.534 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T15:51:29.872 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T15:51:29.900 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T15:51:29.938 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T15:51:29.985 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T15:51:30.012 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:30.060 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:30.352 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pkg-config. 2024-04-25T15:51:30.380 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T15:51:30.418 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T15:51:30.430 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T15:51:30.458 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:30.496 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:30.680 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T15:51:30.695 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T15:51:30.738 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T15:51:30.816 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T15:51:30.844 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T15:51:30.883 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T15:51:31.149 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T15:51:31.175 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T15:51:31.177 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T15:51:31.203 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:31.215 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T15:51:31.418 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:31.493 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T15:51:31.521 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T15:51:31.576 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T15:51:31.679 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T15:51:31.695 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T15:51:31.737 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:31.847 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T15:51:31.874 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T15:51:31.913 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T15:51:31.990 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T15:51:32.006 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:32.039 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:32.266 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T15:51:32.294 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T15:51:32.332 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T15:51:32.342 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T15:51:32.370 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T15:51:32.408 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T15:51:32.661 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2024-04-25T15:51:32.688 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T15:51:32.727 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T15:51:32.763 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T15:51:32.791 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T15:51:32.829 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T15:51:33.047 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T15:51:33.075 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T15:51:33.113 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T15:51:33.191 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T15:51:33.219 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T15:51:33.283 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T15:51:33.543 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T15:51:33.571 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T15:51:33.609 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T15:51:33.713 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pkg-config. 2024-04-25T15:51:33.741 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T15:51:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T15:51:33.870 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-toml. 2024-04-25T15:51:33.886 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T15:51:33.920 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T15:51:34.040 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T15:51:34.065 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T15:51:34.106 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T15:51:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T15:51:34.242 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T15:51:34.281 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T15:51:34.526 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T15:51:34.554 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T15:51:34.601 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T15:51:34.609 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T15:51:34.637 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T15:51:34.675 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T15:51:34.904 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T15:51:34.931 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T15:51:34.945 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T15:51:34.970 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T15:51:34.973 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T15:51:35.012 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T15:51:35.298 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T15:51:35.326 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T15:51:35.365 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T15:51:35.659 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T15:51:35.687 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T15:51:35.717 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T15:51:35.924 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2024-04-25T15:51:35.952 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:35.990 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:36.054 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2024-04-25T15:51:36.081 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T15:51:36.120 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T15:51:36.407 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T15:51:36.435 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T15:51:36.464 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T15:51:36.893 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T15:51:36.909 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:36.935 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T15:51:36.951 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:36.964 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T15:51:37.002 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T15:51:37.256 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T15:51:37.313 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-toml. 2024-04-25T15:51:37.340 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T15:51:37.379 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T15:51:37.507 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T15:51:37.633 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T15:51:37.682 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T15:51:37.710 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T15:51:37.748 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T15:51:37.875 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T15:51:38.085 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T15:51:38.113 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T15:51:38.151 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T15:51:38.221 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T15:51:38.420 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T15:51:38.437 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T15:51:38.478 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T15:51:38.667 INFO:teuthology.orchestra.run.smithi087.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T15:51:38.743 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:39.191 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2024-04-25T15:51:39.219 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:39.248 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:39.267 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2024-04-25T15:51:39.407 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T15:51:39.658 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T15:51:39.901 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T15:51:40.027 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T15:51:40.185 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T15:51:40.213 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T15:51:40.251 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:40.295 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T15:51:40.555 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T15:51:40.556 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T15:51:40.681 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T15:51:40.806 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T15:51:40.932 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T15:51:40.999 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T15:51:41.194 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T15:51:41.343 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T15:51:41.549 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T15:51:41.586 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T15:51:41.845 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T15:51:41.984 INFO:teuthology.orchestra.run.smithi155.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T15:51:42.042 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:42.113 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T15:51:42.373 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T15:51:42.542 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2024-04-25T15:51:42.624 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T15:51:42.690 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T15:51:42.867 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T15:51:42.983 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T15:51:43.168 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:43.225 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T15:51:43.351 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T15:51:43.419 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T15:51:43.553 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T15:51:43.602 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T15:51:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T15:51:43.862 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T15:51:43.947 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T15:51:43.988 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T15:51:44.073 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T15:51:44.306 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T15:51:44.324 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T15:51:44.658 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T15:51:44.722 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T15:51:44.755 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T15:51:44.819 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T15:51:44.900 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T15:51:44.947 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T15:51:45.160 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T15:51:45.315 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:45.436 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T15:51:45.474 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T15:51:45.688 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T15:51:45.733 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T15:51:45.947 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T15:51:45.993 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T15:51:46.198 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T15:51:46.294 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T15:51:46.420 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T15:51:46.574 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:46.817 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T15:51:46.926 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T15:51:47.052 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T15:51:47.105 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T15:51:47.320 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T15:51:47.356 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T15:51:47.445 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T15:51:47.482 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T15:51:47.608 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T15:51:47.705 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T15:51:47.892 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T15:51:48.106 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T15:51:48.136 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T15:51:48.200 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T15:51:48.268 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T15:51:48.317 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T15:51:48.519 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T15:51:48.677 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:48.803 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T15:51:48.912 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T15:51:49.070 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T15:51:49.205 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T15:51:49.330 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T15:51:49.523 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T15:51:49.639 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T15:51:49.748 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T15:51:49.874 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T15:51:50.126 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T15:51:50.251 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:50.417 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T15:51:50.544 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T15:51:50.651 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T15:51:50.777 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T15:51:50.853 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T15:51:50.903 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T15:51:51.196 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T15:51:51.572 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T15:51:51.806 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T15:51:51.951 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T15:51:52.174 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T15:51:52.210 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:51:52.344 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T15:51:52.459 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T15:51:52.595 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T15:51:52.730 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T15:51:52.760 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T15:51:52.856 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T15:51:53.095 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T15:51:53.157 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T15:51:53.346 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T15:51:53.424 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T15:51:53.497 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:51:53.659 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:51:53.777 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T15:51:53.798 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T15:51:54.078 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T15:51:54.115 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T15:51:54.321 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T15:51:54.572 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T15:51:54.848 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T15:51:55.115 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T15:51:55.290 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T15:51:55.375 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T15:51:55.476 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T15:51:55.499 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:51:55.634 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T15:51:55.744 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T15:51:55.869 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T15:51:55.893 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T15:51:56.019 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T15:51:56.137 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T15:51:56.154 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T15:51:56.413 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T15:51:56.447 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T15:51:56.672 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T15:51:56.698 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T15:51:56.799 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T15:51:56.925 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T15:51:56.932 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:51:57.014 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T15:51:57.092 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T15:51:57.234 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T15:51:57.360 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T15:51:57.401 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T15:51:57.669 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T15:51:57.753 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T15:51:57.937 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T15:51:57.996 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T15:51:58.122 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T15:51:58.196 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T15:51:58.381 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:51:58.447 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T15:51:58.507 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T15:51:58.706 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T15:51:58.807 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T15:51:58.825 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T15:51:59.092 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T15:51:59.101 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T15:51:59.193 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T15:51:59.402 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T15:51:59.486 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T15:51:59.613 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T15:51:59.787 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T15:51:59.898 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T15:52:00.038 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T15:52:00.156 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T15:52:00.166 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T15:52:00.273 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T15:52:00.345 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T15:52:00.417 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T15:52:00.633 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T15:52:00.734 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T15:52:00.777 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T15:52:01.062 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T15:52:01.111 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T15:52:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T15:52:01.389 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T15:52:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T15:52:01.515 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:01.641 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:01.764 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T15:52:01.767 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T15:52:01.890 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T15:52:02.103 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:02.199 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T15:52:02.220 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:02.321 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T15:52:02.492 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T15:52:02.598 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:02.716 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T15:52:02.833 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:02.963 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T15:52:03.035 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T15:52:03.035 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T15:52:03.239 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T15:52:03.498 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T15:52:03.534 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:03.660 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:03.733 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T15:52:03.786 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:03.945 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:04.071 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T15:52:04.118 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T15:52:04.428 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T15:52:04.780 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T15:52:04.898 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:04.999 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.117 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T15:52:05.266 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.392 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.453 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.518 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.587 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.644 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.713 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T15:52:05.753 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:05.871 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:06.007 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:06.116 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:06.225 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:06.446 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T15:52:06.446 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T15:52:06.635 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2024-04-25T15:52:06.943 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:07.024 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2024-04-25T15:52:07.069 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:07.175 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2024-04-25T15:52:07.189 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T15:52:07.195 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:07.323 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T15:52:07.338 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:07.464 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T15:52:07.626 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T15:52:08.072 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:08.258 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:52:08.258 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:52:08.609 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:08.715 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:08.735 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:08.849 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:08.861 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:08.995 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:09.122 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:09.247 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:09.292 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:52:09.292 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:52:09.781 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2024-04-25T15:52:09.795 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:10.174 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2024-04-25T15:52:10.231 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T15:52:10.343 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2024-04-25T15:52:10.356 INFO:teuthology.orchestra.run.smithi155.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T15:52:10.494 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T15:52:10.686 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:10.860 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T15:52:10.902 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T15:52:10.902 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T15:52:11.315 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:11.363 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:11.542 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:52:11.542 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:52:11.574 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T15:52:11.575 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T15:52:12.067 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:12.075 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:12.184 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:12.336 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T15:52:12.336 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T15:52:12.663 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:52:12.663 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:52:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:12.911 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:13.071 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:13.129 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:13.286 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T15:52:13.286 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T15:52:13.473 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T15:52:13.780 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:13.923 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:13.930 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:14.049 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:14.154 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T15:52:14.154 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T15:52:14.200 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:14.561 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T15:52:14.648 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:14.661 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T15:52:14.814 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T15:52:14.845 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T15:52:14.845 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T15:52:15.308 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:15.538 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T15:52:15.584 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T15:52:15.584 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T15:52:16.068 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:16.164 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T15:52:16.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T15:52:16.194 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:16.227 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-04-25T15:52:16.353 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:16.427 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-04-25T15:52:16.427 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-04-25T15:52:16.568 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T15:52:16.569 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T15:52:16.621 INFO:teuthology.orchestra.run.smithi087.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T15:52:16.621 INFO:teuthology.orchestra.run.smithi087.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T15:52:16.622 INFO:teuthology.orchestra.run.smithi087.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T15:52:16.622 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:52:16.622 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:52:16.622 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:52:16.622 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:52:16.622 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T15:52:16.623 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T15:52:16.623 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:52:16.623 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-04-25T15:52:16.623 INFO:teuthology.orchestra.run.smithi087.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T15:52:16.623 INFO:teuthology.orchestra.run.smithi087.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T15:52:16.624 INFO:teuthology.orchestra.run.smithi087.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T15:52:16.624 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T15:52:16.624 INFO:teuthology.orchestra.run.smithi087.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T15:52:16.625 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-04-25T15:52:16.625 INFO:teuthology.orchestra.run.smithi087.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T15:52:16.625 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T15:52:16.626 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T15:52:16.666 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-04-25T15:52:16.667 INFO:teuthology.orchestra.run.smithi087.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T15:52:16.667 INFO:teuthology.orchestra.run.smithi087.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T15:52:16.667 INFO:teuthology.orchestra.run.smithi087.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T15:52:16.668 INFO:teuthology.orchestra.run.smithi087.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T15:52:16.668 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T15:52:16.668 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T15:52:16.668 INFO:teuthology.orchestra.run.smithi087.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T15:52:16.669 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-04-25T15:52:16.669 INFO:teuthology.orchestra.run.smithi087.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T15:52:16.872 INFO:teuthology.orchestra.run.smithi087.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T15:52:16.872 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 55.7 MB of archives. 2024-04-25T15:52:16.872 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T15:52:16.872 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T15:52:17.179 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:17.389 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:17.541 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:17.644 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T15:52:17.667 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T15:52:17.683 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T15:52:17.821 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T15:52:17.823 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T15:52:17.824 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T15:52:17.853 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T15:52:17.855 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T15:52:17.860 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T15:52:17.864 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T15:52:17.865 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T15:52:18.032 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T15:52:18.053 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T15:52:18.153 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T15:52:18.314 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T15:52:18.316 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T15:52:18.328 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T15:52:18.333 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T15:52:18.417 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T15:52:19.398 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T15:52:19.610 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T15:52:19.615 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T15:52:19.615 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T15:52:19.622 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T15:52:19.622 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T15:52:19.633 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T15:52:19.801 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T15:52:20.034 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T15:52:20.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T15:52:20.091 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-04-25T15:52:20.275 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-04-25T15:52:20.275 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T15:52:20.448 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T15:52:20.449 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-04-25T15:52:20.449 INFO:teuthology.orchestra.run.smithi155.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T15:52:20.449 INFO:teuthology.orchestra.run.smithi155.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T15:52:20.449 INFO:teuthology.orchestra.run.smithi155.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T15:52:20.450 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T15:52:20.450 INFO:teuthology.orchestra.run.smithi155.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T15:52:20.450 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-04-25T15:52:20.450 INFO:teuthology.orchestra.run.smithi155.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T15:52:20.450 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T15:52:20.450 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T15:52:20.458 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T15:52:20.459 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T15:52:20.489 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-04-25T15:52:20.490 INFO:teuthology.orchestra.run.smithi155.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T15:52:20.490 INFO:teuthology.orchestra.run.smithi155.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T15:52:20.490 INFO:teuthology.orchestra.run.smithi155.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T15:52:20.490 INFO:teuthology.orchestra.run.smithi155.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T15:52:20.490 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T15:52:20.491 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T15:52:20.491 INFO:teuthology.orchestra.run.smithi155.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T15:52:20.491 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-04-25T15:52:20.492 INFO:teuthology.orchestra.run.smithi155.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T15:52:20.555 INFO:teuthology.orchestra.run.smithi155.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T15:52:20.555 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 55.7 MB of archives. 2024-04-25T15:52:20.555 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T15:52:20.556 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T15:52:20.701 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T15:52:20.702 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T15:52:20.717 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T15:52:20.724 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T15:52:20.759 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T15:52:20.763 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T15:52:20.764 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T15:52:20.765 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T15:52:20.776 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T15:52:20.776 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T15:52:20.779 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T15:52:20.780 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T15:52:20.780 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T15:52:20.782 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T15:52:20.785 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T15:52:20.804 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T15:52:20.804 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T15:52:20.806 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T15:52:20.819 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T15:52:20.827 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T15:52:20.828 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T15:52:20.829 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T15:52:20.834 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T15:52:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T15:52:21.132 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T15:52:21.134 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T15:52:21.134 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T15:52:21.137 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T15:52:21.137 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T15:52:21.141 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T15:52:21.143 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T15:52:21.149 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T15:52:21.150 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T15:52:21.169 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T15:52:21.172 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T15:52:21.185 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T15:52:21.208 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T15:52:21.211 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T15:52:21.212 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T15:52:21.212 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T15:52:21.213 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T15:52:21.224 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T15:52:21.226 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T15:52:21.440 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T15:52:21.440 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T15:52:21.440 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T15:52:21.441 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T15:52:21.441 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T15:52:21.441 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T15:52:21.453 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T15:52:21.453 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T15:52:21.464 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T15:52:21.852 INFO:teuthology.orchestra.run.smithi155.stdout:Preconfiguring packages ... 2024-04-25T15:52:22.015 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 55.7 MB in 1s (58.4 MB/s) 2024-04-25T15:52:22.316 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T15:52:22.317 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T15:52:22.317 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T15:52:22.317 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T15:52:22.318 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T15:52:22.319 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T15:52:22.347 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T15:52:22.348 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T15:52:22.360 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T15:52:22.366 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T15:52:22.537 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T15:52:22.756 INFO:teuthology.orchestra.run.smithi087.stdout:Preconfiguring packages ... 2024-04-25T15:52:22.913 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 55.7 MB in 6s (9,824 kB/s) 2024-04-25T15:52:23.192 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T15:52:23.198 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T15:52:23.234 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T15:52:23.319 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T15:52:23.948 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T15:52:24.247 INFO:teuthology.orchestra.run.smithi155.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T15:52:24.501 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package flex. 2024-04-25T15:52:24.597 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T15:52:24.603 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T15:52:24.641 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T15:52:24.931 INFO:teuthology.orchestra.run.smithi087.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T15:52:25.157 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T15:52:25.206 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package flex. 2024-04-25T15:52:25.299 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-25T15:52:25.305 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T15:52:25.330 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T15:52:25.347 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T15:52:25.782 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T15:52:25.888 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T15:52:26.061 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T15:52:26.309 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T15:52:26.315 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T15:52:26.437 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T15:52:26.454 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T15:52:26.921 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T15:52:27.015 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T15:52:27.021 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T15:52:27.077 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T15:52:27.143 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T15:52:27.438 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T15:52:27.560 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T15:52:27.691 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T15:52:28.001 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T15:52:28.021 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package bison. 2024-04-25T15:52:28.127 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T15:52:28.133 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T15:52:28.181 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T15:52:28.383 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package bison. 2024-04-25T15:52:28.487 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-25T15:52:28.493 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T15:52:28.552 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T15:52:28.615 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T15:52:28.643 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T15:52:28.682 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T15:52:28.985 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T15:52:29.002 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2024-04-25T15:52:29.013 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T15:52:29.029 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T15:52:29.052 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T15:52:29.068 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T15:52:29.346 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package dump. 2024-04-25T15:52:29.374 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T15:52:29.404 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T15:52:29.405 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2024-04-25T15:52:29.421 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:29.472 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T15:52:29.783 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T15:52:29.791 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package indent. 2024-04-25T15:52:29.810 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T15:52:29.820 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:29.858 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T15:52:29.858 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T15:52:30.127 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T15:52:30.143 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T15:52:30.185 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T15:52:30.195 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T15:52:30.223 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T15:52:30.262 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T15:52:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T15:52:30.525 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T15:52:30.548 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T15:52:30.564 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T15:52:30.576 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T15:52:30.623 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T15:52:30.791 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T15:52:30.808 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T15:52:30.850 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T15:52:31.026 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T15:52:31.053 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T15:52:31.101 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:31.186 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T15:52:31.214 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T15:52:31.253 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:31.353 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T15:52:31.369 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T15:52:31.411 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:31.530 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T15:52:31.558 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T15:52:31.597 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:31.664 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T15:52:31.692 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T15:52:31.731 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T15:52:31.833 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T15:52:31.861 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T15:52:31.891 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T15:52:32.109 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T15:52:32.137 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T15:52:32.178 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T15:52:32.184 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T15:52:32.206 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T15:52:32.244 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T15:52:33.947 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T15:52:33.975 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T15:52:34.014 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:34.021 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T15:52:34.049 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T15:52:34.096 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:34.283 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T15:52:34.310 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T15:52:34.350 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:34.382 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T15:52:34.398 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T15:52:34.440 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:34.686 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T15:52:34.713 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T15:52:34.752 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:52:34.776 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T15:52:34.804 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T15:52:34.843 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:52:35.063 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T15:52:35.091 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T15:52:35.121 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T15:52:35.254 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T15:52:35.282 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T15:52:35.329 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T15:52:35.443 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T15:52:35.470 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T15:52:35.509 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T15:52:35.723 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T15:52:35.751 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T15:52:35.790 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T15:52:35.862 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T15:52:35.890 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:35.929 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:36.151 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T15:52:36.179 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:36.218 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:36.240 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T15:52:36.268 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:36.298 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:52:36.601 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T15:52:36.604 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T15:52:36.617 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:36.632 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:36.659 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:52:36.671 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:52:36.886 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T15:52:36.902 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T15:52:36.936 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T15:52:36.965 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T15:52:36.993 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:37.032 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:52:37.284 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T15:52:37.312 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T15:52:37.351 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T15:52:37.473 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T15:52:37.501 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T15:52:37.540 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T15:52:37.821 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T15:52:37.850 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T15:52:37.851 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package modemmanager. 2024-04-25T15:52:37.879 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T15:52:37.888 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T15:52:37.917 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:52:38.376 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package modemmanager. 2024-04-25T15:52:38.404 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T15:52:38.442 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:52:38.549 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager. 2024-04-25T15:52:38.577 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T15:52:38.624 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T15:52:39.058 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager. 2024-04-25T15:52:39.085 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T15:52:39.133 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T15:52:39.272 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ppp. 2024-04-25T15:52:39.300 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T15:52:39.563 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T15:52:39.756 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ppp. 2024-04-25T15:52:39.784 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T15:52:39.852 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T15:52:39.880 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T15:52:39.910 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T15:52:40.065 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T15:52:40.113 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T15:52:40.126 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T15:52:40.163 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T15:52:40.394 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T15:52:40.411 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T15:52:40.452 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T15:52:40.465 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T15:52:40.493 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T15:52:40.532 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T15:52:40.707 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T15:52:40.724 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T15:52:40.765 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T15:52:40.861 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T15:52:40.888 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:40.927 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:41.069 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T15:52:41.097 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T15:52:41.135 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T15:52:41.448 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T15:52:41.476 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T15:52:41.489 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T15:52:41.517 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:41.525 INFO:teuthology.orchestra.run.smithi087.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T15:52:41.547 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-common (238) ... 2024-04-25T15:52:41.564 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:42.013 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T15:52:42.041 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:42.085 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:42.178 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T15:52:42.206 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T15:52:42.263 INFO:teuthology.orchestra.run.smithi155.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T15:52:42.293 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-common (238) ... 2024-04-25T15:52:42.744 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T15:52:42.772 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T15:52:42.814 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:43.466 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql. 2024-04-25T15:52:43.495 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T15:52:43.532 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql (14+238) ... 2024-04-25T15:52:43.751 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T15:52:43.767 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T15:52:43.801 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T15:52:44.053 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T15:52:44.081 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T15:52:44.120 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T15:52:44.456 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T15:52:44.484 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T15:52:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T15:52:44.590 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql. 2024-04-25T15:52:44.606 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T15:52:44.657 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql (14+238) ... 2024-04-25T15:52:44.799 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package tcl. 2024-04-25T15:52:44.827 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T15:52:44.871 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T15:52:44.951 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T15:52:44.979 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T15:52:45.026 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T15:52:45.169 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T15:52:45.197 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T15:52:45.235 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T15:52:45.278 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T15:52:45.294 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T15:52:45.336 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T15:52:45.632 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T15:52:45.648 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T15:52:45.672 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T15:52:45.689 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T15:52:45.700 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T15:52:45.739 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T15:52:46.067 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T15:52:46.084 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl. 2024-04-25T15:52:46.096 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T15:52:46.112 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T15:52:46.151 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T15:52:46.177 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T15:52:46.430 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T15:52:46.578 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T15:52:46.606 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T15:52:46.607 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T15:52:46.645 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T15:52:46.707 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T15:52:46.833 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:46.968 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T15:52:47.042 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T15:52:47.058 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T15:52:47.094 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T15:52:47.100 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T15:52:47.220 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:47.570 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T15:52:47.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T15:52:47.653 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T15:52:47.745 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T15:52:47.958 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T15:52:47.983 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T15:52:48.185 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T15:52:48.311 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T15:52:48.322 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T15:52:48.322 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T15:52:48.437 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:48.563 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T15:52:48.689 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T15:52:48.803 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T15:52:48.816 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:48.929 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T15:52:49.055 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T15:52:49.180 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T15:52:49.254 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T15:52:49.306 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T15:52:49.330 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T15:52:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:49.650 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T15:52:49.697 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T15:52:49.697 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T15:52:49.759 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T15:52:50.192 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T15:52:50.318 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T15:52:50.414 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T15:52:50.444 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T15:52:50.540 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T15:52:50.570 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T15:52:50.634 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T15:52:50.696 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T15:52:50.700 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:52:50.810 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T15:52:50.847 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:50.927 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T15:52:50.973 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T15:52:51.053 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T15:52:51.099 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T15:52:51.179 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T15:52:51.269 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T15:52:51.338 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T15:52:51.464 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T15:52:51.640 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T15:52:51.721 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T15:52:51.766 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T15:52:51.892 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T15:52:51.941 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T15:52:51.991 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:52:52.061 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T15:52:52.092 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T15:52:52.162 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T15:52:52.210 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T15:52:52.336 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T15:52:52.462 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T15:52:52.552 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout:which means they are currently configured by ifupdown: 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout:- enp3s0f1 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T15:52:52.584 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:52:52.622 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T15:52:52.708 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T15:52:52.748 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T15:52:52.925 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T15:52:53.025 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T15:52:53.034 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:53.151 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T15:52:53.319 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T15:52:53.408 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T15:52:53.445 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T15:52:53.889 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:54.032 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout:which means they are currently configured by ifupdown: 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout:- enp3s0f1 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T15:52:54.094 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:52:54.141 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T15:52:54.230 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T15:52:54.250 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-common (238) ... 2024-04-25T15:52:54.556 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T15:52:54.898 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T15:52:55.127 INFO:teuthology.orchestra.run.smithi087.stdout:Adding user postgres to group ssl-cert 2024-04-25T15:52:55.357 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:52:55.357 INFO:teuthology.orchestra.run.smithi087.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T15:52:55.449 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T15:52:55.555 INFO:teuthology.orchestra.run.smithi087.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T15:52:55.556 INFO:teuthology.orchestra.run.smithi087.stdout:Removing obsolete dictionary files: 2024-04-25T15:52:55.577 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T15:52:55.685 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T15:52:55.811 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-common (238) ... 2024-04-25T15:52:56.133 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T15:52:56.510 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:56.692 INFO:teuthology.orchestra.run.smithi155.stdout:Adding user postgres to group ssl-cert 2024-04-25T15:52:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T15:52:56.854 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T15:52:56.907 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:52:56.907 INFO:teuthology.orchestra.run.smithi155.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:This user must also own the server process. 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:The default text search configuration will be set to "english". 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:Data page checksums are disabled. 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:52:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T15:52:56.912 INFO:teuthology.orchestra.run.smithi087.stdout:creating subdirectories ... ok 2024-04-25T15:52:56.912 INFO:teuthology.orchestra.run.smithi087.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T15:52:56.924 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default max_connections ... 100 2024-04-25T15:52:56.945 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default shared_buffers ... 128MB 2024-04-25T15:52:56.955 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default time zone ... Etc/UTC 2024-04-25T15:52:56.956 INFO:teuthology.orchestra.run.smithi087.stdout:creating configuration files ... ok 2024-04-25T15:52:57.071 INFO:teuthology.orchestra.run.smithi087.stdout:running bootstrap script ... ok 2024-04-25T15:52:57.081 INFO:teuthology.orchestra.run.smithi155.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T15:52:57.081 INFO:teuthology.orchestra.run.smithi155.stdout:Removing obsolete dictionary files: 2024-04-25T15:52:57.629 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T15:52:57.714 INFO:teuthology.orchestra.run.smithi087.stdout:performing post-bootstrap initialization ... ok 2024-04-25T15:52:58.021 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T15:52:58.329 INFO:teuthology.orchestra.run.smithi087.stdout:syncing data to disk ... ok 2024-04-25T15:52:58.346 INFO:teuthology.orchestra.run.smithi155.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T15:52:58.363 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:This user must also own the server process. 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:The default text search configuration will be set to "english". 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:Data page checksums are disabled. 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:52:58.400 INFO:teuthology.orchestra.run.smithi155.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T15:52:58.401 INFO:teuthology.orchestra.run.smithi155.stdout:creating subdirectories ... ok 2024-04-25T15:52:58.401 INFO:teuthology.orchestra.run.smithi155.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T15:52:58.415 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default max_connections ... 100 2024-04-25T15:52:58.433 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default shared_buffers ... 128MB 2024-04-25T15:52:58.441 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default time zone ... Etc/UTC 2024-04-25T15:52:58.442 INFO:teuthology.orchestra.run.smithi155.stdout:creating configuration files ... ok 2024-04-25T15:52:58.551 INFO:teuthology.orchestra.run.smithi155.stdout:running bootstrap script ... ok 2024-04-25T15:52:58.734 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T15:52:59.170 INFO:teuthology.orchestra.run.smithi155.stdout:performing post-bootstrap initialization ... ok 2024-04-25T15:52:59.817 INFO:teuthology.orchestra.run.smithi155.stdout:syncing data to disk ... ok 2024-04-25T15:53:00.192 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T15:53:01.491 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:53:01.617 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T15:53:01.743 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql (14+238) ... 2024-04-25T15:53:01.852 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:53:01.953 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:53:02.182 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T15:53:02.183 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T15:53:02.722 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T15:53:02.814 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T15:53:02.928 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:53:03.037 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T15:53:03.141 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T15:53:03.163 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql (14+238) ... 2024-04-25T15:53:03.285 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T15:53:03.289 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T15:53:03.424 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T15:53:03.679 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T15:53:03.679 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T15:53:04.244 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T15:53:04.336 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T15:53:04.638 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T15:53:04.654 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T15:53:04.737 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T15:53:04.782 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T15:53:05.176 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T15:53:05.181 DEBUG:teuthology.parallel:result is None 2024-04-25T15:53:06.127 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T15:53:06.227 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T15:53:06.733 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T15:53:06.738 DEBUG:teuthology.parallel:result is None 2024-04-25T15:53:06.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:53:06.888 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2024-04-25T15:53:06.907 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:53:06.907 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:53:06.907 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T15:53:06.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:53:07.140 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2024-04-25T15:53:07.160 INFO:teuthology.orchestra.run.smithi155.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:53:07.160 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T15:53:07.160 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T15:53:07.162 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T15:53:07.162 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:07.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:53:07.177 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:07.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:53:07.215 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T15:53:07.215 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:07.215 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:53:07.231 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:53:07.286 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:07.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:53:07.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:53:07.354 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T15:53:07.354 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:07.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:53:07.367 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:53:07.421 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:07.421 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:53:07.434 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:53:07.490 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T15:53:07.490 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:07.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:53:07.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:53:07.558 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:07.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:53:07.571 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:53:07.626 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T15:53:07.710 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T15:53:07.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-04-25T15:53:07.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-04-25T15:53:07.725 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T15:53:07.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:53:07.765 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:53:07.777 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T15:53:07.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:53:07.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:53:07.840 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T15:53:07.840 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T15:53:07.840 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T15:53:07.840 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:07.840 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:53:07.876 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:07.952 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:07.952 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:53:07.957 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:08.037 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T15:53:08.037 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T15:53:08.037 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673232', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5fa+Bmz6w03NRQXvpArR19er833SFHLhoBoPbCoqYlZUSk6MrRqdG2mEyknCosKijAbUv8VuukVmzo9XCUw1s=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKMVMwQbw/DIKZiWS0SXIEK/Y26mdC3YsSKpbIqqlGZcc9S4znaCefXt6s3ay91mNrZB+B+FoCdazKmjB5ZhrxU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T15:53:08.038 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:53:08.040 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:53:08.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:53:08.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:53:08.135 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:08.135 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:53:08.148 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:53:08.148 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-25 15:47:00.839050157 +0000 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-25 15:47:00.555052695 +0000 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-25 15:47:00.555052695 +0000 2024-04-25T15:53:08.198 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-25T15:53:08.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:53:08.251 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-25T15:53:08.251 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-25T15:53:08.251 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000438869 s, 1.2 MB/s 2024-04-25T15:53:08.252 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:53:08.302 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-25 15:47:01.335045727 +0000 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-25 15:47:01.075048049 +0000 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-25 15:47:01.075048049 +0000 2024-04-25T15:53:08.348 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-25T15:53:08.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:53:08.402 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-25T15:53:08.402 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-25T15:53:08.402 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00041634 s, 1.2 MB/s 2024-04-25T15:53:08.403 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:53:08.453 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-25 15:47:01.811041476 +0000 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-25 15:47:01.559043728 +0000 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-25 15:47:01.559043728 +0000 2024-04-25T15:53:08.500 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-25T15:53:08.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:53:08.553 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-25T15:53:08.553 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-25T15:53:08.553 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000315318 s, 1.6 MB/s 2024-04-25T15:53:08.555 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:53:08.601 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-04-25T15:53:08.647 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 942 Links: 1 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-25 15:47:02.283037260 +0000 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-25 15:47:02.035039475 +0000 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-25 15:47:02.035039475 +0000 2024-04-25T15:53:08.648 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-25T15:53:08.648 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:53:08.702 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-25T15:53:08.702 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-25T15:53:08.702 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000387136 s, 1.3 MB/s 2024-04-25T15:53:08.703 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:53:08.753 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:08.753 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:08.753 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:53:08.759 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:53:08.759 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:47:07.209383714 +0000 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:47:06.949386036 +0000 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:47:06.949386036 +0000 2024-04-25T15:53:08.807 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-25T15:53:08.808 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:53:08.861 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:53:08.861 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:53:08.861 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000451093 s, 1.1 MB/s 2024-04-25T15:53:08.863 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:53:08.912 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-04-25T15:53:08.958 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:53:08.958 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:08.958 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-04-25T15:53:08.958 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:08.959 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:47:07.713379211 +0000 2024-04-25T15:53:08.959 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:47:07.457381499 +0000 2024-04-25T15:53:08.959 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:47:07.457381499 +0000 2024-04-25T15:53:08.959 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-25T15:53:08.959 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:53:09.013 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:53:09.013 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:53:09.013 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.00037088 s, 1.4 MB/s 2024-04-25T15:53:09.014 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:53:09.065 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-04-25T15:53:09.110 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:53:09.110 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:09.110 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-25T15:53:09.111 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:09.111 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:47:08.217374710 +0000 2024-04-25T15:53:09.111 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:47:07.949377103 +0000 2024-04-25T15:53:09.111 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:47:07.949377103 +0000 2024-04-25T15:53:09.111 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-25T15:53:09.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:53:09.165 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:53:09.165 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:53:09.165 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000411667 s, 1.2 MB/s 2024-04-25T15:53:09.166 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:53:09.216 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-04-25T15:53:09.262 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:53:09.262 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:53:09.262 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 942 Links: 1 2024-04-25T15:53:09.262 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:53:09.262 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:47:08.693370457 +0000 2024-04-25T15:53:09.263 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:47:08.429372816 +0000 2024-04-25T15:53:09.263 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:47:08.429372816 +0000 2024-04-25T15:53:09.263 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-25T15:53:09.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:53:09.318 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:53:09.318 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:53:09.318 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000380861 s, 1.3 MB/s 2024-04-25T15:53:09.319 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:53:09.368 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:09.368 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:53:09.368 INFO:tasks.ceph:Generating config... 2024-04-25T15:53:09.370 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T15:53:09.370 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T15:53:09.370 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T15:53:09.370 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T15:53:09.370 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T15:53:09.370 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T15:53:09.370 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T15:53:09.370 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T15:53:09.371 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T15:53:09.372 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T15:53:09.372 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T15:53:09.372 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T15:53:09.372 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T15:53:09.372 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T15:53:09.372 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T15:53:09.372 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T15:53:09.373 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T15:53:09.374 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T15:53:09.374 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T15:53:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T15:53:09.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T15:53:09.521 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:53:09.530 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2024-04-25T15:53:09.531 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T15:53:09.532 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:09.532 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:53:09.575 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:09.688 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:09.688 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 527c0db7-6346-492d-a157-2cd52d90e62b 2024-04-25T15:53:09.688 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = quincy 2024-04-25T15:53:09.688 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2024-04-25T15:53:09.688 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 527c0db7-6346-492d-a157-2cd52d90e62b 2024-04-25T15:53:09.688 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2024-04-25T15:53:09.691305+0000 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-04-25T15:53:09.691305+0000 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 17 (quincy) 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2024-04-25T15:53:09.689 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T15:53:09.694 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:53:09.699 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 527c0db7-6346-492d-a157-2cd52d90e62b... 2024-04-25T15:53:09.700 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:53:09.745 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.769 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-04-25T15:53:09.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-04-25T15:53:09.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.87,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 527c0db7-6346-492d-a157-2cd52d90e62b 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-04-25T15:53:09.772 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.773 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-04-25T15:53:09.774 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: osd blocked scrub grace period = 3600 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: osd max markdown count = 1000 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.775 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-04-25T15:53:09.776 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:53:09.777 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: mon down mkfs grace = 300 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-04-25T15:53:09.778 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: client_shutdown_timeout = 120 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-04-25T15:53:09.779 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal fragment size max = 10000 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal merge size = 5 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split bits = 3 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split size = 100 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-04-25T15:53:09.780 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-04-25T15:53:09.781 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-04-25T15:53:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-04-25T15:53:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:53:09.781 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:53:09.782 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-04-25T15:53:09.783 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.87,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-04-25T15:53:09.784 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 527c0db7-6346-492d-a157-2cd52d90e62b 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-04-25T15:53:09.785 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-04-25T15:53:09.786 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-04-25T15:53:09.787 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: osd blocked scrub grace period = 3600 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: osd max markdown count = 1000 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:53:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-04-25T15:53:09.789 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.790 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: client_shutdown_timeout = 120 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-25T15:53:09.791 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-04-25T15:53:09.792 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-04-25T15:53:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-04-25T15:53:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-04-25T15:53:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-25T15:53:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-25T15:53:09.793 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-25T15:53:09.794 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T15:53:09.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T15:53:09.912 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T15:53:09.912 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:09.912 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T15:53:09.917 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:09.917 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T15:53:09.963 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T15:53:09.964 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:09.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:53:09.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:53:10.028 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:10.028 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:10.076 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:53:10.076 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:10.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:53:10.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:53:10.099 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:10.099 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:10.146 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T15:53:10.147 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T15:53:10.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:53:10.221 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:53:10.228 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:53:10.301 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:53:10.324 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T15:53:10.324 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:53:10.399 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:53:10.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T15:53:10.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:53:10.530 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:53:10.536 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T15:53:10.547 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:53:10.622 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:53:10.629 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T15:53:10.641 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:53:10.754 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:53:10.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T15:53:10.772 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T15:53:10.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T15:53:10.835 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T15:53:10.849 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T15:53:10.914 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T15:53:10.927 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T15:53:10.928 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:53:10.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T15:53:10.940 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:10.940 INFO:tasks.ceph:role: osd.0 2024-04-25T15:53:10.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T15:53:10.941 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:11.004 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:11.005 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:11.005 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:11.005 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:11.460 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-25T15:53:11.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-25T15:53:11.462 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T15:53:11.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T15:53:11.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:11.600 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:11.601 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T15:53:11.653 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:11.653 INFO:tasks.ceph:role: osd.1 2024-04-25T15:53:11.654 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T15:53:11.654 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:53:11.716 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:11.716 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:11.717 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:11.717 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:11.717 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:11.717 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:11.717 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:12.190 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-25T15:53:12.193 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-25T15:53:12.193 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T15:53:12.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T15:53:12.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:12.342 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:12.342 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T15:53:12.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:12.395 INFO:tasks.ceph:role: osd.2 2024-04-25T15:53:12.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T15:53:12.396 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:53:12.459 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:12.459 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:12.459 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:12.459 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:12.459 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:12.460 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:12.460 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:12.460 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:12.460 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:12.460 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:12.958 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-25T15:53:12.960 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-25T15:53:12.960 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T15:53:13.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T15:53:13.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:13.113 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:13.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T15:53:13.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:13.168 INFO:tasks.ceph:role: osd.3 2024-04-25T15:53:13.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T15:53:13.168 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:13.232 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:13.233 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:13.233 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:13.233 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:13.659 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-25T15:53:13.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-25T15:53:13.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T15:53:13.753 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T15:53:13.763 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:13.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:13.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:13.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:13.919+0000 7fc7013ba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T15:53:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:13.923+0000 7fc7013ba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T15:53:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:13.923+0000 7fc7013ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:53:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:13.923+0000 7fc7013ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:53:13.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:13.923+0000 7fc7013ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:53:13.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:13.927+0000 7fc7013ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T15:53:16.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T15:53:16.927 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:17.043+0000 7f94b0dae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T15:53:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:17.043+0000 7f94b0dae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T15:53:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:17.043+0000 7f94b0dae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:53:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:17.043+0000 7f94b0dae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:53:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:17.043+0000 7f94b0dae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:53:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:17.043+0000 7f94b0dae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T15:53:20.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T15:53:20.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:20.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:20.143+0000 7faf69b797c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T15:53:20.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:20.143+0000 7faf69b797c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T15:53:20.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:20.143+0000 7faf69b797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:53:20.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:20.143+0000 7faf69b797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:53:20.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:20.143+0000 7faf69b797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:53:20.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:20.147+0000 7faf69b797c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T15:53:23.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T15:53:23.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:23.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:23.255+0000 7f5d3800a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T15:53:23.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:23.255+0000 7f5d3800a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T15:53:23.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:23.255+0000 7f5d3800a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:53:23.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:23.255+0000 7f5d3800a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:53:23.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:23.255+0000 7f5d3800a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:53:23.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:23.255+0000 7f5d3800a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T15:53:26.249 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T15:53:26.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T15:53:26.276 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:26.276 INFO:tasks.ceph:role: osd.4 2024-04-25T15:53:26.276 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:53:26.276 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:53:26.338 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:26.338 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:26.338 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:26.338 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:26.338 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:26.338 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:26.339 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:26.339 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:26.339 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:26.339 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:26.790 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:53:26.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:53:26.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T15:53:26.889 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T15:53:26.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:26.898 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:26.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T15:53:26.952 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:26.952 INFO:tasks.ceph:role: osd.5 2024-04-25T15:53:26.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:53:26.952 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:27.013 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:27.014 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:27.480 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:53:27.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:53:27.482 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T15:53:27.606 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T15:53:27.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:27.619 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:27.619 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T15:53:27.674 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:27.674 INFO:tasks.ceph:role: osd.6 2024-04-25T15:53:27.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:53:27.674 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:53:27.741 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:27.741 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:27.741 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:27.741 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:27.742 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:27.742 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:27.742 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:27.742 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:27.742 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:27.742 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:28.227 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:53:28.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:53:28.230 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T15:53:28.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T15:53:28.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:28.389 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:28.389 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T15:53:28.445 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:53:28.445 INFO:tasks.ceph:role: osd.7 2024-04-25T15:53:28.445 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:53:28.446 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T15:53:28.510 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:53:28.511 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:53:28.943 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:53:28.945 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:53:28.945 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T15:53:29.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T15:53:29.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:53:29.045 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T15:53:29.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:29.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:29.190+0000 7fbc273627c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T15:53:29.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:29.194+0000 7fbc273627c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T15:53:29.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:29.194+0000 7fbc273627c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:53:29.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:29.194+0000 7fbc273627c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:53:29.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:29.194+0000 7fbc273627c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:53:29.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:29.194+0000 7fbc273627c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T15:53:32.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T15:53:32.193 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:32.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:32.302+0000 7f222f3f87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T15:53:32.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:32.302+0000 7f222f3f87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T15:53:32.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:32.302+0000 7f222f3f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:53:32.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:32.302+0000 7f222f3f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:53:32.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:32.302+0000 7f222f3f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:53:32.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:32.306+0000 7f222f3f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T15:53:35.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T15:53:35.295 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:35.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:35.402+0000 7f70bba2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T15:53:35.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:35.402+0000 7f70bba2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T15:53:35.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:35.402+0000 7f70bba2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:53:35.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:35.402+0000 7f70bba2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:53:35.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:35.402+0000 7f70bba2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:53:35.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:35.402+0000 7f70bba2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T15:53:38.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:38.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:38.386 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T15:53:38.399 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:38.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:38.510+0000 7fded72d47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T15:53:38.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:38.510+0000 7fded72d47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T15:53:38.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:38.510+0000 7fded72d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:53:38.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:38.510+0000 7fded72d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:53:38.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:38.510+0000 7fded72d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:53:38.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:38.510+0000 7fded72d47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T15:53:41.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T15:53:41.518 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T15:53:41.518 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T15:53:41.533 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T15:53:41.587 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T15:53:41.643 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.643 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T15:53:41.698 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T15:53:41.750 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T15:53:41.807 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:41.807 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T15:53:41.863 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:41.863 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T15:53:41.877 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:41.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T15:53:41.929 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:41.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T15:53:41.981 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:41.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T15:53:42.037 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:42.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T15:53:42.089 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:42.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T15:53:42.145 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:42.146 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T15:53:42.201 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:42.202 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T15:53:42.207 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:42.207 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T15:53:42.254 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T15:53:42.254 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:53:42.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmExleDRAAt4c4RMNvy2ZwVwpePux3QQ== 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmnHL7FxAADSDv/wix0CDZuJanIzxFkA== 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmECDFHxAARpccnSiC5E4IuagJkQP/tg== 2024-04-25T15:53:42.300 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBpfCpm+ZgnNxAAo0WPfwV6m7W2ljm6vbS2HQ== 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBtfCpmNjrbAhAAfmIKiEEICM9y4mHtTeIXHQ== 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBwfCpmtJTrCBAA9SA1FpA40XCjiia5qvGOnw== 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBzfCpmpYh2DxAAlG8w+2X3NR7pONUY/x3COw== 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmSkcgEhAA8vZE7Y7s2l4WOEYONutr+g== 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmMo8+JRAAVIqHLUnqwJ1axP6+jC6GJA== 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-04-25T15:53:42.301 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpm5HYhLRAAtE+wAtedvxLs55ZMRyJq1Q== 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB5fCpmeCCKCxAAe+GQa3wpAJFVNhISRW+wsw== 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB8fCpmAflZEhAAbI15wtyaShDHFu+4RqTGZA== 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQB/fCpmyNQjGBAAUt5lj91DLoZLxISjXoNbKg== 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCCfCpmAl+lHhAAABTLXa0WJGC9/DCQHmb6Gg== 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmCpH3MRAABqeXIkG2uWHUsBko5vRVAA== 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2024-04-25T15:53:42.302 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBmfCpmYlSgNhAAbV5bb3d9y+kWvA4zVUmwZw== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmExleDRAAt4c4RMNvy2ZwVwpePux3QQ== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmnHL7FxAADSDv/wix0CDZuJanIzxFkA== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmECDFHxAARpccnSiC5E4IuagJkQP/tg== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBpfCpm+ZgnNxAAo0WPfwV6m7W2ljm6vbS2HQ== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBtfCpmNjrbAhAAfmIKiEEICM9y4mHtTeIXHQ== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBwfCpmtJTrCBAA9SA1FpA40XCjiia5qvGOnw== 2024-04-25T15:53:42.308 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBzfCpmpYh2DxAAlG8w+2X3NR7pONUY/x3COw== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmSkcgEhAA8vZE7Y7s2l4WOEYONutr+g== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmMo8+JRAAVIqHLUnqwJ1axP6+jC6GJA== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpm5HYhLRAAtE+wAtedvxLs55ZMRyJq1Q== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB5fCpmeCCKCxAAe+GQa3wpAJFVNhISRW+wsw== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB8fCpmAflZEhAAbI15wtyaShDHFu+4RqTGZA== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB/fCpmyNQjGBAAUt5lj91DLoZLxISjXoNbKg== 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-04-25T15:53:42.309 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCCfCpmAl+lHhAAABTLXa0WJGC9/DCQHmb6Gg== 2024-04-25T15:53:42.310 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-04-25T15:53:42.310 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmCpH3MRAABqeXIkG2uWHUsBko5vRVAA== 2024-04-25T15:53:42.310 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-04-25T15:53:42.310 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmfCpmYlSgNhAAbV5bb3d9y+kWvA4zVUmwZw== 2024-04-25T15:53:42.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:53:42.349 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:53:42.432 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:42.434 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:42.509 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:42.511 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:42.586 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.660 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.797 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.799 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:42.873 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:53:42.875 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:53:42.950 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:42.952 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:43.028 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:43.030 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:53:43.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.103 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.175 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.176 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.249 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.251 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.320 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:53:43.387 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:53:43.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:53:43.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:53:43.467 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:53:43.543 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T15:53:43.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T15:53:43.553 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:53:43.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T15:53:43.679 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T15:53:43.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:53:43.816 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T15:53:43.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T15:53:43.878 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:53:43.999 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T15:53:44.010 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:44.012 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:53:44.058 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T15:53:44.058 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T15:53:44.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T15:53:44.061 INFO:tasks.ceph.mon.a:Started 2024-04-25T15:53:44.061 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T15:53:44.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T15:53:44.103 INFO:tasks.ceph.mon.b:Started 2024-04-25T15:53:44.103 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T15:53:44.103 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T15:53:44.105 INFO:tasks.ceph.mon.c:Started 2024-04-25T15:53:44.105 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T15:53:44.106 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T15:53:44.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T15:53:44.108 INFO:tasks.ceph.mgr.y:Started 2024-04-25T15:53:44.108 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T15:53:44.108 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T15:53:44.111 INFO:tasks.ceph.mgr.x:Started 2024-04-25T15:53:44.111 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T15:53:44.111 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T15:53:44.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 Processor -- start 2024-04-25T15:53:44.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 -- start start 2024-04-25T15:53:44.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee1c0c5120 con 0x7fee1c0c4250 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fee1c0c3b20 con 0x7fee1c15ac30 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee2397c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c070e20 con 0x7fee1c15b580 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57708/0 (socket says 172.21.15.87:57708) 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 -- 172.21.15.87:0/1738344529 learned_addr learned my addr 172.21.15.87:0/1738344529 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee21718640 1 --1- 172.21.15.87:0/1738344529 >> v1:172.21.15.87:6789/0 conn(0x7fee1c0c4250 0x7fee1c06ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53412/0 (socket says 172.21.15.87:53412) 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 -- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 msgr2=0x7fee1c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 -- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 msgr2=0x7fee1c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 --2- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee20f17640 1 --2- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 msgr2=0x7fee1c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:53:44.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 msgr2=0x7fee1c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:53:44.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:53:44.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.251+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee20f17640 1 --2- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee20f17640 1 -- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 msgr2=0x7fee1c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee20f17640 1 -- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 msgr2=0x7fee1c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee20f17640 1 --2- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee20f17640 1 --2- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 msgr2=0x7fee1c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:53:44.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 msgr2=0x7fee1c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:53:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:53:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.455+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:53:44.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.479+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116976072 0 0) 0x7fee0c001120 con 0x7fee1c0c4250 2024-04-25T15:53:44.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.479+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee08003530 con 0x7fee1c0c4250 2024-04-25T15:53:44.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1779463210 0 0) 0x7fee08003530 con 0x7fee1c0c4250 2024-04-25T15:53:44.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 msgr2=0x7fee1c161e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:53:44.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee1c161e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 msgr2=0x7fee1c15b040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:53:44.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 --2- 172.21.15.87:0/1738344529 >> v2:172.21.15.87:3300/0 conn(0x7fee1c15ac30 0x7fee1c15b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c0c4b60 con 0x7fee1c0c4250 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fee0c001850 con 0x7fee1c0c4250 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 >> v1:172.21.15.87:6789/0 conn(0x7fee1c0c4250 legacy=0x7fee1c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee080039c0 0x7fee08003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee08005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c070e20 con 0x7fee08004d50 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee0800bb60 con 0x7fee080039c0 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee0800bd60 con 0x7fee1c15b580 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee08005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21718640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee080039c0 0x7fee08003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee20f17640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 msgr2=0x7fee08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c15b580 0x7fee08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee080039c0 msgr2=0x7fee08003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee080039c0 0x7fee08003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.483+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee08003530 con 0x7fee08004d50 2024-04-25T15:53:44.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.487+0000 7fee21f19640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee08005160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee1400e8d0 tx=0x7fee1401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb1c325a04250ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:44.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee140ae020 con 0x7fee08004d50 2024-04-25T15:53:44.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee140a6690 con 0x7fee08004d50 2024-04-25T15:53:44.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee13fff640 1 -- 172.21.15.87:0/1738344529 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1400f040 con 0x7fee08004d50 2024-04-25T15:53:44.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee2397c640 1 -- 172.21.15.87:0/1738344529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 msgr2=0x7fee08005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:44.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee2397c640 1 --2- 172.21.15.87:0/1738344529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee08005160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee1400e8d0 tx=0x7fee1401c890 comp rx=0 tx=0).stop 2024-04-25T15:53:44.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee21f19640 1 -- 172.21.15.87:0/1738344529 reap_dead start 2024-04-25T15:53:44.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee2397c640 1 -- 172.21.15.87:0/1738344529 shutdown_connections 2024-04-25T15:53:44.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee2397c640 1 -- 172.21.15.87:0/1738344529 >> 172.21.15.87:0/1738344529 conn(0x7fee1c06d780 msgr2=0x7fee1c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:44.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee2397c640 1 -- 172.21.15.87:0/1738344529 shutdown_connections 2024-04-25T15:53:44.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.491+0000 7fee2397c640 1 -- 172.21.15.87:0/1738344529 wait complete. 2024-04-25T15:53:44.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 Processor -- start 2024-04-25T15:53:44.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 -- start start 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee1c1e4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c14f1b0 0x7fee1c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee1c14e750 0x7fee1c1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c070660 con 0x7fee08004d50 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c070ab0 con 0x7fee1c14e750 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c0707e0 con 0x7fee1c14f1b0 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee1c1e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee1c1e4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57754/0 (socket says 172.21.15.87:57754) 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 -- 172.21.15.87:0/2358257230 learned_addr learned my addr 172.21.15.87:0/2358257230 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21f19640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee1c14e750 0x7fee1c1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee20f17640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c14f1b0 0x7fee1c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:44.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 -- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c14f1b0 msgr2=0x7fee1c14e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c14f1b0 0x7fee1c14e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 -- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee1c14e750 msgr2=0x7fee1c1f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee1c14e750 0x7fee1c1f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 -- 172.21.15.87:0/2358257230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c1ee0e0 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee21718640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee1c1e4740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0056e0 tx=0x7fee0c012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c01c070 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0c014750 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c014b20 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c1577a0 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1c1e4c80 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee0c01f070 con 0x7fee08004d50 2024-04-25T15:53:44.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.495+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fee0c016780 con 0x7fee08004d50 2024-04-25T15:53:44.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.499+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1c1edf10 con 0x7fee08004d50 2024-04-25T15:53:44.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.511+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fee1c0c5120 con 0x7fee08004d50 2024-04-25T15:53:44.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.575+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fee1c1f1940 con 0x7fee08004d50 2024-04-25T15:53:44.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee11ffb640 1 -- 172.21.15.87:0/2358257230 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fee0c014d80 con 0x7fee08004d50 2024-04-25T15:53:44.582 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-04-25T15:53:44.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 msgr2=0x7fee1c1e4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:44.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee1c1e4740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0056e0 tx=0x7fee0c012630 comp rx=0 tx=0).stop 2024-04-25T15:53:44.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 shutdown_connections 2024-04-25T15:53:44.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee1c14e750 0x7fee1c1f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee1c14f1b0 0x7fee1c14e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 --2- 172.21.15.87:0/2358257230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee08004d50 0x7fee1c1e4740 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:44.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 >> 172.21.15.87:0/2358257230 conn(0x7fee1c06d780 msgr2=0x7fee1c154470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:44.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 shutdown_connections 2024-04-25T15:53:44.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:44.579+0000 7fee2397c640 1 -- 172.21.15.87:0/2358257230 wait complete. 2024-04-25T15:53:44.603 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T15:53:44.603 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T15:53:44.603 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:44.603 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T15:53:44.614 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:44.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T15:53:44.666 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:44.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T15:53:44.705 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:44.703+0000 7f2139d80180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:53:44.713 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:44.710+0000 7f0278e04180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:53:44.716 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:53:44.716 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T15:53:44.770 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:44.770 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T15:53:44.783 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:44.783 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T15:53:44.837 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:44.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T15:53:44.894 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:53:44.894 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T15:53:44.949 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new d62d732e-6d30-42a2-bff8-2f2cd8bff0dd 0 2024-04-25T15:53:45.138 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:45.135+0000 7f2139d80180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:53:45.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c555a6640 1 Processor -- start 2024-04-25T15:53:45.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c555a6640 1 -- start start 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c555a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5c500aeca0 0x7f5c50074930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c555a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5006dbd0 con 0x7f5c50151700 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c555a6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c50154870 con 0x7f5c5006f8a0 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c555a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5c50070440 con 0x7f5c500aeca0 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4f7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5c5006f8a0 0x7f5c5015eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:37522/0 (socket says 172.21.15.155:37522) 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4f7fe640 1 -- 172.21.15.155:0/1880095048 learned_addr learned my addr 172.21.15.155:0/1880095048 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T15:53:45.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 --2- 172.21.15.155:0/1880095048 >> v2:172.21.15.87:3300/0 conn(0x7f5c500aeca0 0x7f5c50074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234849468 0 0) 0x7f5c50154870 con 0x7f5c5006f8a0 2024-04-25T15:53:45.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c3c003530 con 0x7f5c5006f8a0 2024-04-25T15:53:45.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132737067 0 0) 0x7f5c3c003530 con 0x7f5c5006f8a0 2024-04-25T15:53:45.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 >> v2:172.21.15.87:3300/0 conn(0x7f5c500aeca0 msgr2=0x7f5c50074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 --2- 172.21.15.155:0/1880095048 >> v2:172.21.15.87:3300/0 conn(0x7f5c500aeca0 0x7f5c50074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 >> v1:172.21.15.87:6789/0 conn(0x7f5c50151700 legacy=0x7f5c50154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c50070690 con 0x7f5c5006f8a0 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f5c40001680 con 0x7f5c5006f8a0 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 >> v1:172.21.15.155:6789/0 conn(0x7f5c5006f8a0 legacy=0x7f5c5015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c3c005360 0x7f5c3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c50070440 con 0x7f5c3c004810 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c00c290 con 0x7f5c3c0039c0 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c00c490 con 0x7f5c3c005360 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4f7fe640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c3c005360 0x7f5c3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4e7fc640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 -- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c3c005360 msgr2=0x7f5c3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c3c005360 0x7f5c3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 -- 172.21.15.155:0/1880095048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c3c004810 msgr2=0x7f5c3c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4effd640 1 -- 172.21.15.155:0/1880095048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c003530 con 0x7f5c3c0039c0 2024-04-25T15:53:45.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4e7fc640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c3c004810 0x7f5c3c004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:45.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.142+0000 7f5c4f7fe640 1 -- 172.21.15.155:0/1880095048 reap_dead start 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c4effd640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009fc0 tx=0x7f5c4801cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64a210420555f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480b2070 con 0x7f5c3c0039c0 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c480a5a70 con 0x7f5c3c0039c0 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c4dffb640 1 -- 172.21.15.155:0/1880095048 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48009c10 con 0x7f5c3c0039c0 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 -- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 msgr2=0x7f5c3c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009fc0 tx=0x7f5c4801cc80 comp rx=0 tx=0).stop 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 -- 172.21.15.155:0/1880095048 shutdown_connections 2024-04-25T15:53:45.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 --2- 172.21.15.155:0/1880095048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c3c003e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 -- 172.21.15.155:0/1880095048 >> 172.21.15.155:0/1880095048 conn(0x7f5c5006d650 msgr2=0x7f5c500c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 -- 172.21.15.155:0/1880095048 shutdown_connections 2024-04-25T15:53:45.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.146+0000 7f5c555a6640 1 -- 172.21.15.155:0/1880095048 wait complete. 2024-04-25T15:53:45.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 Processor -- start 2024-04-25T15:53:45.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 -- start start 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c500c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c500c8330 0x7f5c501f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c5014b3f0 0x7f5c501f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c50154160 con 0x7f5c5014b3f0 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5c50151b10 con 0x7f5c3c0039c0 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c501542e0 con 0x7f5c500c8330 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c500c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c500c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36154/0 (socket says 172.21.15.155:36154) 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 -- 172.21.15.155:0/2506643055 learned_addr learned my addr 172.21.15.155:0/2506643055 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4e7fc640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c500c8330 0x7f5c501f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4f7fe640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c5014b3f0 0x7f5c501f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 -- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c500c8330 msgr2=0x7f5c501f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c500c8330 0x7f5c501f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 -- 172.21.15.155:0/2506643055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c5014b3f0 msgr2=0x7f5c501f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c5014b3f0 0x7f5c501f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 -- 172.21.15.155:0/2506643055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5014c2a0 con 0x7f5c3c0039c0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c4effd640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c500c7df0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5c48098590 tx=0x7f5c48009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480bd030 con 0x7f5c3c0039c0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c480a5870 con 0x7f5c3c0039c0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480b2040 con 0x7f5c3c0039c0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5014a2c0 con 0x7f5c3c0039c0 2024-04-25T15:53:45.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5014a880 con 0x7f5c3c0039c0 2024-04-25T15:53:45.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c480c0070 con 0x7f5c3c0039c0 2024-04-25T15:53:45.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.150+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5c48004360 con 0x7f5c3c0039c0 2024-04-25T15:53:45.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.154+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c50069bb0 con 0x7f5c3c0039c0 2024-04-25T15:53:45.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.154+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5c480c8020 con 0x7f5c3c0039c0 2024-04-25T15:53:45.203 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:45.202+0000 7f0278e04180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:53:45.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.226+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d62d732e-6d30-42a2-bff8-2f2cd8bff0dd", "id": 0} v 0) -- 0x7f5c50063090 con 0x7f5c3c0039c0 2024-04-25T15:53:45.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c477fe640 1 -- 172.21.15.155:0/2506643055 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d62d732e-6d30-42a2-bff8-2f2cd8bff0dd", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5c48016990 con 0x7f5c3c0039c0 2024-04-25T15:53:45.235 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 msgr2=0x7f5c500c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c500c7df0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5c48098590 tx=0x7f5c48009750 comp rx=0 tx=0).stop 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 shutdown_connections 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c5014b3f0 0x7f5c501f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c500c8330 0x7f5c501f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 --2- 172.21.15.155:0/2506643055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c3c0039c0 0x7f5c500c7df0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 >> 172.21.15.155:0/2506643055 conn(0x7f5c5006d650 msgr2=0x7f5c501e34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 shutdown_connections 2024-04-25T15:53:45.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.234+0000 7f5c555a6640 1 -- 172.21.15.155:0/2506643055 wait complete. 2024-04-25T15:53:45.254 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 48ff8cea-5c0a-46e4-88a2-564defab6489 1 2024-04-25T15:53:45.334 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:45.331+0000 7f2139d80180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:53:45.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.398+0000 7f57eae7f640 1 Processor -- start 2024-04-25T15:53:45.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.398+0000 7f57eae7f640 1 -- start start 2024-04-25T15:53:45.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57eae7f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57e40740d0 0x7f57e40c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57eae7f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f57e4154c90 0x7f57e4161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57eae7f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e4063220 con 0x7f57e40744e0 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57eae7f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f57e40c5570 con 0x7f57e40740d0 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57eae7f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f57e4074a90 con 0x7f57e4154c90 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f57e4154c90 0x7f57e4161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f57e4154c90 0x7f57e4161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36170/0 (socket says 172.21.15.155:36170) 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 -- 172.21.15.155:0/1070392045 learned_addr learned my addr 172.21.15.155:0/1070392045 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e8c1b640 1 --2- 172.21.15.155:0/1070392045 >> v2:172.21.15.87:3300/0 conn(0x7f57e40740d0 0x7f57e40c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 -- 172.21.15.155:0/1070392045 >> v2:172.21.15.87:3300/0 conn(0x7f57e40740d0 msgr2=0x7f57e40c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 --2- 172.21.15.155:0/1070392045 >> v2:172.21.15.87:3300/0 conn(0x7f57e40740d0 0x7f57e40c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 -- 172.21.15.155:0/1070392045 >> v1:172.21.15.87:6789/0 conn(0x7f57e40744e0 legacy=0x7f57e4154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.402+0000 7f57e941c640 1 -- 172.21.15.155:0/1070392045 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e40634c0 con 0x7f57e4154c90 2024-04-25T15:53:45.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57e941c640 1 --2- 172.21.15.155:0/1070392045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4161e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57e40c3550 tx=0x7f57d401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=261e70a1186f9bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57e37fe640 1 -- 172.21.15.155:0/1070392045 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d40a56f0 con 0x7f57e4154c90 2024-04-25T15:53:45.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57e37fe640 1 -- 172.21.15.155:0/1070392045 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d40a5890 con 0x7f57e4154c90 2024-04-25T15:53:45.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57e37fe640 1 -- 172.21.15.155:0/1070392045 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d40a5c60 con 0x7f57e4154c90 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 -- 172.21.15.155:0/1070392045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 msgr2=0x7f57e4161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 --2- 172.21.15.155:0/1070392045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4161e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57e40c3550 tx=0x7f57d401c920 comp rx=0 tx=0).stop 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 -- 172.21.15.155:0/1070392045 shutdown_connections 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 --2- 172.21.15.155:0/1070392045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4161e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 --2- 172.21.15.155:0/1070392045 >> v2:172.21.15.87:3300/0 conn(0x7f57e40740d0 0x7f57e40c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 -- 172.21.15.155:0/1070392045 >> 172.21.15.155:0/1070392045 conn(0x7f57e406d650 msgr2=0x7f57e40c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 -- 172.21.15.155:0/1070392045 shutdown_connections 2024-04-25T15:53:45.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 -- 172.21.15.155:0/1070392045 wait complete. 2024-04-25T15:53:45.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 Processor -- start 2024-04-25T15:53:45.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.406+0000 7f57eae7f640 1 -- start start 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 0x7f57e4148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e40744e0 0x7f57e41f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57e40c51e0 con 0x7f57e40744e0 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57e40c5060 con 0x7f57e4154c90 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57e4164bd0 con 0x7f57e40740d0 2024-04-25T15:53:45.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 0x7f57e4148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e941c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 0x7f57e4148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56902/0 (socket says 172.21.15.155:56902) 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 -- 172.21.15.155:0/2704109043 learned_addr learned my addr 172.21.15.155:0/2704109043 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e3fff640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e40744e0 0x7f57e41f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 -- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 msgr2=0x7f57e4143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 -- 172.21.15.155:0/2704109043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e40744e0 msgr2=0x7f57e41f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e40744e0 0x7f57e41f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 -- 172.21.15.155:0/2704109043 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e41f4ce0 con 0x7f57e40740d0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e941c640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e8c1b640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 0x7f57e4148a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00d620 tx=0x7f57dc00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00b620 con 0x7f57e40740d0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57dc019070 con 0x7f57e40740d0 2024-04-25T15:53:45.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e40706a0 con 0x7f57e40740d0 2024-04-25T15:53:45.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00ba20 con 0x7f57e40740d0 2024-04-25T15:53:45.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e414ac00 con 0x7f57e40740d0 2024-04-25T15:53:45.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57dc00bbc0 con 0x7f57e40740d0 2024-04-25T15:53:45.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f57dc014950 con 0x7f57e40740d0 2024-04-25T15:53:45.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.410+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e4069bb0 con 0x7f57e40740d0 2024-04-25T15:53:45.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.414+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f57dc014ba0 con 0x7f57e40740d0 2024-04-25T15:53:45.417 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:45.414+0000 7f0278e04180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:53:45.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.486+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48ff8cea-5c0a-46e4-88a2-564defab6489", "id": 1} v 0) -- 0x7f57e41561b0 con 0x7f57e40740d0 2024-04-25T15:53:45.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57e17fa640 1 -- 172.21.15.155:0/2704109043 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48ff8cea-5c0a-46e4-88a2-564defab6489", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f57dc01e500 con 0x7f57e40740d0 2024-04-25T15:53:45.494 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 msgr2=0x7f57e4148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 0x7f57e4148a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00d620 tx=0x7f57dc00dae0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 shutdown_connections 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57e4154c90 0x7f57e4143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e40744e0 0x7f57e41f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 --2- 172.21.15.155:0/2704109043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57e40740d0 0x7f57e4148a20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 >> 172.21.15.155:0/2704109043 conn(0x7f57e406d650 msgr2=0x7f57e4155360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 shutdown_connections 2024-04-25T15:53:45.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.494+0000 7f57eae7f640 1 -- 172.21.15.155:0/2704109043 wait complete. 2024-04-25T15:53:45.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new eafabe27-bee6-4b9f-a187-4e02d999eae7 2 2024-04-25T15:53:45.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.662+0000 7f55d0f21640 1 Processor -- start 2024-04-25T15:53:45.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.662+0000 7f55d0f21640 1 -- start start 2024-04-25T15:53:45.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55d0f21640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55cc072eb0 0x7f55cc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55d0f21640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55cc06f240 con 0x7f55cc13ccb0 2024-04-25T15:53:45.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55d0f21640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55cc06f520 con 0x7f55cc157410 2024-04-25T15:53:45.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55d0f21640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55cc06fb70 con 0x7f55cc072eb0 2024-04-25T15:53:45.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f55cc157410 0x7f55cc15e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:37530/0 (socket says 172.21.15.155:37530) 2024-04-25T15:53:45.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 -- 172.21.15.155:0/1110661281 learned_addr learned my addr 172.21.15.155:0/1110661281 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T15:53:45.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c9d9b640 1 --2- 172.21.15.155:0/1110661281 >> v2:172.21.15.87:3300/0 conn(0x7f55cc072eb0 0x7f55cc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689282750 0 0) 0x7f55cc06f520 con 0x7f55cc157410 2024-04-25T15:53:45.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55b4003530 con 0x7f55cc157410 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1541696110 0 0) 0x7f55b4003530 con 0x7f55cc157410 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 >> v2:172.21.15.87:3300/0 conn(0x7f55cc072eb0 msgr2=0x7f55cc156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 --2- 172.21.15.155:0/1110661281 >> v2:172.21.15.87:3300/0 conn(0x7f55cc072eb0 0x7f55cc156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 >> v1:172.21.15.87:6789/0 conn(0x7f55cc13ccb0 legacy=0x7f55cc0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55cc06f800 con 0x7f55cc157410 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f55c4001a00 con 0x7f55cc157410 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 >> v1:172.21.15.155:6789/0 conn(0x7f55cc157410 legacy=0x7f55cc15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55b40039c0 0x7f55b4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4004810 0x7f55b4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55b4005260 0x7f55b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc06fb70 con 0x7f55b40039c0 2024-04-25T15:53:45.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55b400c1f0 con 0x7f55b4005260 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f55b400c3f0 con 0x7f55b4004810 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55b4005260 0x7f55b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55c9d9b640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4004810 0x7f55b4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55ca59c640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55b40039c0 0x7f55b4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 -- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4004810 msgr2=0x7f55b4004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4004810 0x7f55b4004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 -- 172.21.15.155:0/1110661281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55b40039c0 msgr2=0x7f55b4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55b40039c0 0x7f55b4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55cad9d640 1 -- 172.21.15.155:0/1110661281 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b4003530 con 0x7f55b4005260 2024-04-25T15:53:45.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.666+0000 7f55ca59c640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55b40039c0 0x7f55b4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:45.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55cad9d640 1 -- 172.21.15.155:0/1110661281 reap_dead start 2024-04-25T15:53:45.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55cad9d640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55b4005260 0x7f55b400b9d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55c400a810 tx=0x7f55c401d340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba09988cafdeb01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c400a460 con 0x7f55b4005260 2024-04-25T15:53:45.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c40ac640 con 0x7f55b4005260 2024-04-25T15:53:45.672 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55c959a640 1 -- 172.21.15.155:0/1110661281 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c40aca30 con 0x7f55b4005260 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 -- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55b4005260 msgr2=0x7f55b400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55b4005260 0x7f55b400b9d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f55c400a810 tx=0x7f55c401d340 comp rx=0 tx=0).stop 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 -- 172.21.15.155:0/1110661281 shutdown_connections 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 --2- 172.21.15.155:0/1110661281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55b4005260 0x7f55b400b9d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 -- 172.21.15.155:0/1110661281 >> 172.21.15.155:0/1110661281 conn(0x7f55cc06d650 msgr2=0x7f55cc0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 -- 172.21.15.155:0/1110661281 shutdown_connections 2024-04-25T15:53:45.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.670+0000 7f55d0f21640 1 -- 172.21.15.155:0/1110661281 wait complete. 2024-04-25T15:53:45.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 Processor -- start 2024-04-25T15:53:45.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 -- start start 2024-04-25T15:53:45.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 0x7f55cc151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55cc136c10 0x7f55cc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55cc0ae450 0x7f55cc1efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc156ed0 con 0x7f55cc136c10 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55cc13d0c0 con 0x7f55cc0ae450 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f55cc157050 con 0x7f55b4005260 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 0x7f55cc151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55cad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55cc0ae450 0x7f55cc1efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 0x7f55cc151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56930/0 (socket says 172.21.15.155:56930) 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 -- 172.21.15.155:0/3824087022 learned_addr learned my addr 172.21.15.155:0/3824087022 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:45.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55c9d9b640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55cc136c10 0x7f55cc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 -- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55cc0ae450 msgr2=0x7f55cc1efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55cc0ae450 0x7f55cc1efd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 -- 172.21.15.155:0/3824087022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55cc136c10 msgr2=0x7f55cc0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55cc136c10 0x7f55cc0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 -- 172.21.15.155:0/3824087022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55cc0ac170 con 0x7f55b4005260 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55cad9d640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55cc0ae450 0x7f55cc1efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55c9d9b640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55cc136c10 0x7f55cc0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55ca59c640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 0x7f55cc151380 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55bc001ec0 tx=0x7f55bc00d9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc005480 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc017070 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55cc0ac410 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc003860 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55cc1546b0 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55bc003a00 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.674+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f55bc012830 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.678+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55cc069bb0 con 0x7f55b4005260 2024-04-25T15:53:45.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.678+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f55cc0ac170 con 0x7f55b4005260 2024-04-25T15:53:45.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.746+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eafabe27-bee6-4b9f-a187-4e02d999eae7", "id": 2} v 0) -- 0x7f55cc0705a0 con 0x7f55b4005260 2024-04-25T15:53:45.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55baffd640 1 -- 172.21.15.155:0/3824087022 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eafabe27-bee6-4b9f-a187-4e02d999eae7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f55bc012520 con 0x7f55b4005260 2024-04-25T15:53:45.756 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-04-25T15:53:45.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 msgr2=0x7f55cc151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 0x7f55cc151380 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55bc001ec0 tx=0x7f55bc00d9d0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 shutdown_connections 2024-04-25T15:53:45.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55cc0ae450 0x7f55cc1efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55cc136c10 0x7f55cc0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 --2- 172.21.15.155:0/3824087022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55b4005260 0x7f55cc151380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.754+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 >> 172.21.15.155:0/3824087022 conn(0x7f55cc06d650 msgr2=0x7f55cc0744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.758+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 shutdown_connections 2024-04-25T15:53:45.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.758+0000 7f55d0f21640 1 -- 172.21.15.155:0/3824087022 wait complete. 2024-04-25T15:53:45.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new f418667b-e474-4756-8607-35d44b0dd905 3 2024-04-25T15:53:45.882 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:45.879+0000 7f2139d80180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:53:45.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 Processor -- start 2024-04-25T15:53:45.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 -- start start 2024-04-25T15:53:45.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff218155510 0x7ff218155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2180a9130 con 0x7ff218155e60 2024-04-25T15:53:45.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff2180713f0 con 0x7ff218155510 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21ce8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff2180716d0 con 0x7ff21806d680 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56934/0 (socket says 172.21.15.155:56934) 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 -- 172.21.15.155:0/3038502661 learned_addr learned my addr 172.21.15.155:0/3038502661 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff215d9b640 1 --2- 172.21.15.155:0/3038502661 >> v2:172.21.15.87:3300/0 conn(0x7ff218155510 0x7ff218155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 -- 172.21.15.155:0/3038502661 >> v2:172.21.15.87:3300/0 conn(0x7ff218155510 msgr2=0x7ff218155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 --2- 172.21.15.155:0/3038502661 >> v2:172.21.15.87:3300/0 conn(0x7ff218155510 0x7ff218155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 -- 172.21.15.155:0/3038502661 >> v1:172.21.15.155:6789/0 conn(0x7ff218155e60 legacy=0x7ff2181589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21659c640 1 -- 172.21.15.155:0/3038502661 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21814f8a0 con 0x7ff21806d680 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff21559a640 1 -- 172.21.15.155:0/3038502661 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521089821 0 0) 0x7ff2180a9130 con 0x7ff218155e60 2024-04-25T15:53:45.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.922+0000 7ff215d9b640 1 --2- 172.21.15.155:0/3038502661 >> v2:172.21.15.87:3300/0 conn(0x7ff218155510 0x7ff218155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:45.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21659c640 1 --2- 172.21.15.155:0/3038502661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21806da90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff208009870 tx=0x7ff20801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b10db85d33618af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21559a640 1 -- 172.21.15.155:0/3038502661 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080ab430 con 0x7ff21806d680 2024-04-25T15:53:45.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21559a640 1 -- 172.21.15.155:0/3038502661 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080b0070 con 0x7ff21806d680 2024-04-25T15:53:45.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21559a640 1 -- 172.21.15.155:0/3038502661 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080ab7f0 con 0x7ff21806d680 2024-04-25T15:53:45.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 -- 172.21.15.155:0/3038502661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 msgr2=0x7ff21806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/3038502661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21806da90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff208009870 tx=0x7ff20801c4d0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 -- 172.21.15.155:0/3038502661 shutdown_connections 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/3038502661 >> v2:172.21.15.87:3300/0 conn(0x7ff218155510 0x7ff218155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/3038502661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21806da90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 -- 172.21.15.155:0/3038502661 >> 172.21.15.155:0/3038502661 conn(0x7ff2180c6300 msgr2=0x7ff2180c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 -- 172.21.15.155:0/3038502661 shutdown_connections 2024-04-25T15:53:45.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.926+0000 7ff21ce8a640 1 -- 172.21.15.155:0/3038502661 wait complete. 2024-04-25T15:53:45.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 Processor -- start 2024-04-25T15:53:45.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- start start 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff218155510 0x7ff218148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218155e60 0x7ff2180acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff2180c3eb0 con 0x7ff218155510 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff2180c3d30 con 0x7ff218155e60 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff2181594f0 con 0x7ff21806d680 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff216d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218155e60 0x7ff2180acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21814d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56950/0 (socket says 172.21.15.155:56950) 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 -- 172.21.15.155:0/285506961 learned_addr learned my addr 172.21.15.155:0/285506961 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff215d9b640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff218155510 0x7ff218148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 -- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218155e60 msgr2=0x7ff2180acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218155e60 0x7ff2180acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 -- 172.21.15.155:0/285506961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff218155510 msgr2=0x7ff218148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff218155510 0x7ff218148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 -- 172.21.15.155:0/285506961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff218075120 con 0x7ff21806d680 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff216d9d640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218155e60 0x7ff2180acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21659c640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21814d2b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff2080ad040 tx=0x7ff218071bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080ba070 con 0x7ff21806d680 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080b4420 con 0x7ff21806d680 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080b4830 con 0x7ff21806d680 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff218148f60 con 0x7ff21806d680 2024-04-25T15:53:45.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21814db70 con 0x7ff21806d680 2024-04-25T15:53:45.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2080bd070 con 0x7ff21806d680 2024-04-25T15:53:45.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff2080bfd90 con 0x7ff21806d680 2024-04-25T15:53:45.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.930+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff218069b10 con 0x7ff21806d680 2024-04-25T15:53:45.935 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:45.935+0000 7f2139d80180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:53:45.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:45.934+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff208016150 con 0x7ff21806d680 2024-04-25T15:53:45.987 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:45.987+0000 7f2139d80180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:53:46.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.002+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f418667b-e474-4756-8607-35d44b0dd905", "id": 3} v 0) -- 0x7ff218071050 con 0x7ff21806d680 2024-04-25T15:53:46.008 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.006+0000 7f0278e04180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:53:46.012 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.010+0000 7ff206ffd640 1 -- 172.21.15.155:0/285506961 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f418667b-e474-4756-8607-35d44b0dd905", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff2080bf900 con 0x7ff21806d680 2024-04-25T15:53:46.012 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 msgr2=0x7ff21814d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21814d2b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff2080ad040 tx=0x7ff218071bc0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 shutdown_connections 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218155e60 0x7ff2180acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff218155510 0x7ff218148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 --2- 172.21.15.155:0/285506961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff21806d680 0x7ff21814d2b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 >> 172.21.15.155:0/285506961 conn(0x7ff2180c6300 msgr2=0x7ff2180c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 shutdown_connections 2024-04-25T15:53:46.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.014+0000 7ff21ce8a640 1 -- 172.21.15.155:0/285506961 wait complete. 2024-04-25T15:53:46.031 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 26425cd7-eef6-4b0b-9979-944b18ec8f2c 4 2024-04-25T15:53:46.064 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:46.063+0000 7f2139d80180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:53:46.066 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.066+0000 7f0278e04180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:53:46.116 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:46.115+0000 7f2139d80180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:53:46.121 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.118+0000 7f0278e04180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:53:46.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.170+0000 7f8cbe885640 1 Processor -- start 2024-04-25T15:53:46.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.170+0000 7f8cbe885640 1 -- start start 2024-04-25T15:53:46.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cbe885640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cb80a8cc0 0x7f8cb81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cbe885640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8cb806c670 0x7f8cb806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cbe885640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb8152c80 con 0x7f8cb8152870 2024-04-25T15:53:46.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cbe885640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb80aebc0 con 0x7f8cb806c670 2024-04-25T15:53:46.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cbe885640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb8158f20 con 0x7f8cb80a8cc0 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cb80a8cc0 0x7f8cb81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cb80a8cc0 0x7f8cb81593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36228/0 (socket says 172.21.15.155:36228) 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 -- 172.21.15.155:0/322529733 learned_addr learned my addr 172.21.15.155:0/322529733 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cbce22640 1 --2- 172.21.15.155:0/322529733 >> v2:172.21.15.87:3300/0 conn(0x7f8cb806c670 0x7f8cb806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 -- 172.21.15.155:0/322529733 >> v2:172.21.15.87:3300/0 conn(0x7f8cb806c670 msgr2=0x7f8cb806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 --2- 172.21.15.155:0/322529733 >> v2:172.21.15.87:3300/0 conn(0x7f8cb806c670 0x7f8cb806ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 -- 172.21.15.155:0/322529733 >> v1:172.21.15.87:6789/0 conn(0x7f8cb8152870 legacy=0x7f8cb8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:46.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 -- 172.21.15.155:0/322529733 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb80ae8e0 con 0x7f8cb80a8cc0 2024-04-25T15:53:46.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb7fff640 1 --2- 172.21.15.155:0/322529733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb80a8cc0 0x7f8cb81593b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cb806d6e0 tx=0x7f8ca801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0aa15b91a4bbb79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:46.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb6ffd640 1 -- 172.21.15.155:0/322529733 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80b2070 con 0x7f8cb80a8cc0 2024-04-25T15:53:46.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb6ffd640 1 -- 172.21.15.155:0/322529733 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca80ad640 con 0x7f8cb80a8cc0 2024-04-25T15:53:46.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.174+0000 7f8cb6ffd640 1 -- 172.21.15.155:0/322529733 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80ada10 con 0x7f8cb80a8cc0 2024-04-25T15:53:46.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- 172.21.15.155:0/322529733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb80a8cc0 msgr2=0x7f8cb81593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 --2- 172.21.15.155:0/322529733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb80a8cc0 0x7f8cb81593b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8cb806d6e0 tx=0x7f8ca801c390 comp rx=0 tx=0).stop 2024-04-25T15:53:46.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- 172.21.15.155:0/322529733 shutdown_connections 2024-04-25T15:53:46.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 --2- 172.21.15.155:0/322529733 >> v2:172.21.15.87:3300/0 conn(0x7f8cb806c670 0x7f8cb806ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 --2- 172.21.15.155:0/322529733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb80a8cc0 0x7f8cb81593b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- 172.21.15.155:0/322529733 >> 172.21.15.155:0/322529733 conn(0x7f8cb806d780 msgr2=0x7f8cb806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- 172.21.15.155:0/322529733 shutdown_connections 2024-04-25T15:53:46.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- 172.21.15.155:0/322529733 wait complete. 2024-04-25T15:53:46.179 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 Processor -- start 2024-04-25T15:53:46.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- start start 2024-04-25T15:53:46.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cb806c670 0x7f8cb8074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 0x7f8cb8154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 0x7f8cb814d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb80ac870 con 0x7f8cb806c670 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb80ac6f0 con 0x7f8cb8152870 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbe885640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb81623e0 con 0x7f8cb80a8cc0 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 0x7f8cb8154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 0x7f8cb814d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 0x7f8cb8154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56964/0 (socket says 172.21.15.155:56964) 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 0x7f8cb814d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36238/0 (socket says 172.21.15.155:36238) 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cb77fe640 1 -- 172.21.15.155:0/520697204 learned_addr learned my addr 172.21.15.155:0/520697204 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cb7fff640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cb806c670 0x7f8cb8074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 -- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 msgr2=0x7f8cb8154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 0x7f8cb8154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 -- 172.21.15.155:0/520697204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cb806c670 msgr2=0x7f8cb8074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cb806c670 0x7f8cb8074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cbce22640 1 -- 172.21.15.155:0/520697204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb80c3970 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.178+0000 7f8cb77fe640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 0x7f8cb8154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cbce22640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 0x7f8cb814d8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0007cc0 tx=0x7f8cb000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000edd0 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb00039a0 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0003d90 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb81f38e0 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb80c9c60 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8cb001b020 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8cb001d410 con 0x7f8cb8152870 2024-04-25T15:53:46.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.182+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb81f3ab0 con 0x7f8cb8152870 2024-04-25T15:53:46.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.186+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8cb80c3970 con 0x7f8cb8152870 2024-04-25T15:53:46.192 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:46.191+0000 7f2139d80180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:53:46.202 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.202+0000 7f0278e04180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:53:46.245 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:46.243+0000 7f2139d80180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:53:46.255 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.254+0000 7f0278e04180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:53:46.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.254+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26425cd7-eef6-4b0b-9979-944b18ec8f2c", "id": 4} v 0) -- 0x7f8cb80c7f10 con 0x7f8cb8152870 2024-04-25T15:53:46.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cb4ff9640 1 -- 172.21.15.155:0/520697204 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26425cd7-eef6-4b0b-9979-944b18ec8f2c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8cb0014420 con 0x7f8cb8152870 2024-04-25T15:53:46.263 INFO:teuthology.orchestra.run.smithi155.stdout:4 2024-04-25T15:53:46.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 msgr2=0x7f8cb814d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 0x7f8cb814d8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0007cc0 tx=0x7f8cb000e4b0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 shutdown_connections 2024-04-25T15:53:46.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cb8152870 0x7f8cb814d8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cb80a8cc0 0x7f8cb8154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 --2- 172.21.15.155:0/520697204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cb806c670 0x7f8cb8074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 >> 172.21.15.155:0/520697204 conn(0x7f8cb806d780 msgr2=0x7f8cb80c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 shutdown_connections 2024-04-25T15:53:46.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.262+0000 7f8cbe885640 1 -- 172.21.15.155:0/520697204 wait complete. 2024-04-25T15:53:46.282 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new fd4792d4-2b3b-42d2-a17d-b423741b7f4f 5 2024-04-25T15:53:46.335 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.334+0000 7f0278e04180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:53:46.390 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.390+0000 7f0278e04180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:53:46.393 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:46.391+0000 7f2139d80180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:53:46.455 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:46.451+0000 7f2139d80180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:53:46.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 Processor -- start 2024-04-25T15:53:46.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 -- start start 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 0x7f2984159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29840c9fe0 0x7f29841551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f298406c670 0x7f298406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2984152c80 con 0x7f298406c670 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2984070cb0 con 0x7f29840c9fe0 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f298a753640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2984070f90 con 0x7f2984152870 2024-04-25T15:53:46.468 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29840c9fe0 0x7f29841551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f2983fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 0x7f2984159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29840c9fe0 0x7f29841551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36244/0 (socket says 172.21.15.155:36244) 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f2983fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 0x7f2984159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56970/0 (socket says 172.21.15.155:56970) 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 -- 172.21.15.155:0/3484835760 learned_addr learned my addr 172.21.15.155:0/3484835760 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f2988cf0640 1 --2- 172.21.15.155:0/3484835760 >> v2:172.21.15.87:3300/0 conn(0x7f298406c670 0x7f298406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 -- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 msgr2=0x7f2984159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 --2- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 0x7f2984159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 -- 172.21.15.155:0/3484835760 >> v2:172.21.15.87:3300/0 conn(0x7f298406c670 msgr2=0x7f298406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 --2- 172.21.15.155:0/3484835760 >> v2:172.21.15.87:3300/0 conn(0x7f298406c670 0x7f298406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f29837fe640 1 -- 172.21.15.155:0/3484835760 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29841587b0 con 0x7f29840c9fe0 2024-04-25T15:53:46.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.466+0000 7f2983fff640 1 --2- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 0x7f2984159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:46.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f29837fe640 1 --2- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840c9fe0 0x7f29841551c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29840ca6b0 tx=0x7f297801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e4307418c3c2d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:46.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f2982ffd640 1 -- 172.21.15.155:0/3484835760 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29780b0070 con 0x7f29840c9fe0 2024-04-25T15:53:46.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f2982ffd640 1 -- 172.21.15.155:0/3484835760 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29780ab600 con 0x7f29840c9fe0 2024-04-25T15:53:46.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f2982ffd640 1 -- 172.21.15.155:0/3484835760 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29780ab9d0 con 0x7f29840c9fe0 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 -- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840c9fe0 msgr2=0x7f29841551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 --2- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840c9fe0 0x7f29841551c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29840ca6b0 tx=0x7f297801c490 comp rx=0 tx=0).stop 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 -- 172.21.15.155:0/3484835760 shutdown_connections 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 --2- 172.21.15.155:0/3484835760 >> v2:172.21.15.87:3300/0 conn(0x7f298406c670 0x7f298406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 --2- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840c9fe0 0x7f29841551c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 --2- 172.21.15.155:0/3484835760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984152870 0x7f2984159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 -- 172.21.15.155:0/3484835760 >> 172.21.15.155:0/3484835760 conn(0x7f298406d780 msgr2=0x7f298406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 -- 172.21.15.155:0/3484835760 shutdown_connections 2024-04-25T15:53:46.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 -- 172.21.15.155:0/3484835760 wait complete. 2024-04-25T15:53:46.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 Processor -- start 2024-04-25T15:53:46.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.470+0000 7f298a753640 1 -- start start 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f298406c670 0x7f29840be830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29840c9fe0 0x7f29840c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 0x7f298414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2984155880 con 0x7f298406c670 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2984155700 con 0x7f2984152870 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29840ae540 con 0x7f29840c9fe0 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2988cf0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 0x7f298414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2988cf0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 0x7f298414d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36248/0 (socket says 172.21.15.155:36248) 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29840c9fe0 0x7f29840c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2988cf0640 1 -- 172.21.15.155:0/1341753556 learned_addr learned my addr 172.21.15.155:0/1341753556 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:46.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2983fff640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f298406c670 0x7f29840be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 -- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 msgr2=0x7f298414d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 0x7f298414d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 -- 172.21.15.155:0/1341753556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f298406c670 msgr2=0x7f29840be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f298406c670 0x7f29840be830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 -- 172.21.15.155:0/1341753556 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29840abcf0 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2988cf0640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 0x7f298414d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2983fff640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f298406c670 0x7f29840be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f29837fe640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29840c9fe0 0x7f29840c7ca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2984070e30 tx=0x7f2978019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29780b0040 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29780b4420 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29840abfd0 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29780b47f0 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29840bf100 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29780b4990 con 0x7f29840c9fe0 2024-04-25T15:53:46.477 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f29780b33c0 con 0x7f29840c9fe0 2024-04-25T15:53:46.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.474+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984069bb0 con 0x7f29840c9fe0 2024-04-25T15:53:46.478 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.478+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2978016110 con 0x7f29840c9fe0 2024-04-25T15:53:46.545 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.542+0000 7f0278e04180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:53:46.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.546+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd4792d4-2b3b-42d2-a17d-b423741b7f4f", "id": 5} v 0) -- 0x7f29840c4c70 con 0x7f29840c9fe0 2024-04-25T15:53:46.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.554+0000 7f2980ff9640 1 -- 172.21.15.155:0/1341753556 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd4792d4-2b3b-42d2-a17d-b423741b7f4f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f29780b4d20 con 0x7f29840c9fe0 2024-04-25T15:53:46.557 INFO:teuthology.orchestra.run.smithi155.stdout:5 2024-04-25T15:53:46.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29840c9fe0 msgr2=0x7f29840c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29840c9fe0 0x7f29840c7ca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2984070e30 tx=0x7f2978019230 comp rx=0 tx=0).stop 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 shutdown_connections 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2984152870 0x7f298414d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29840c9fe0 0x7f29840c7ca0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 --2- 172.21.15.155:0/1341753556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f298406c670 0x7f29840be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 >> 172.21.15.155:0/1341753556 conn(0x7f298406d780 msgr2=0x7f2984157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 shutdown_connections 2024-04-25T15:53:46.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.558+0000 7f298a753640 1 -- 172.21.15.155:0/1341753556 wait complete. 2024-04-25T15:53:46.576 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f 6 2024-04-25T15:53:46.609 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:46.606+0000 7f0278e04180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:53:46.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.746+0000 7fd102cd1640 1 Processor -- start 2024-04-25T15:53:46.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.746+0000 7fd102cd1640 1 -- start start 2024-04-25T15:53:46.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd102cd1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd102cd1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc152d90 con 0x7fd0fc152980 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd102cd1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc0a9cd0 con 0x7fd0fc074160 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd102cd1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc0aa290 con 0x7fd0fc155320 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd0fbfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd10126e640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd0fc074160 0x7fd0fc15fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:37538/0 (socket says 172.21.15.155:37538) 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd10126e640 1 -- 172.21.15.155:0/1216682343 learned_addr learned my addr 172.21.15.155:0/1216682343 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd0fb7fe640 1 -- 172.21.15.155:0/1216682343 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122029409 0 0) 0x7fd0fc0a9cd0 con 0x7fd0fc074160 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd0fbfff640 1 -- 172.21.15.155:0/1216682343 >> v1:172.21.15.155:6789/0 conn(0x7fd0fc074160 legacy=0x7fd0fc15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd0fbfff640 1 -- 172.21.15.155:0/1216682343 >> v1:172.21.15.87:6789/0 conn(0x7fd0fc152980 legacy=0x7fd0fc0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:46.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd0fbfff640 1 -- 172.21.15.155:0/1216682343 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc0a9fb0 con 0x7fd0fc155320 2024-04-25T15:53:46.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.750+0000 7fd0fbfff640 1 --2- 172.21.15.155:0/1216682343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc155730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097f0 tx=0x7fd0f001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4459542477e24cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:46.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd0fb7fe640 1 -- 172.21.15.155:0/1216682343 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00b0070 con 0x7fd0fc155320 2024-04-25T15:53:46.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd0fb7fe640 1 -- 172.21.15.155:0/1216682343 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f00ab600 con 0x7fd0fc155320 2024-04-25T15:53:46.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd0fb7fe640 1 -- 172.21.15.155:0/1216682343 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00ab9d0 con 0x7fd0fc155320 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- 172.21.15.155:0/1216682343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 msgr2=0x7fd0fc155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 --2- 172.21.15.155:0/1216682343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc155730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00097f0 tx=0x7fd0f001c410 comp rx=0 tx=0).stop 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- 172.21.15.155:0/1216682343 shutdown_connections 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 --2- 172.21.15.155:0/1216682343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc155730 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- 172.21.15.155:0/1216682343 >> 172.21.15.155:0/1216682343 conn(0x7fd0fc0ac550 msgr2=0x7fd0fc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- 172.21.15.155:0/1216682343 shutdown_connections 2024-04-25T15:53:46.755 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- 172.21.15.155:0/1216682343 wait complete. 2024-04-25T15:53:46.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 Processor -- start 2024-04-25T15:53:46.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- start start 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc074160 0x7fd0fc144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0fc152980 0x7fd0fc0ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0729c0 con 0x7fd0fc152980 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc074980 con 0x7fd0fc074160 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd102cd1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc072b40 con 0x7fd0fc155320 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd100a6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc074160 0x7fd0fc144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd10126e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:46.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd100a6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc074160 0x7fd0fc144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36264/0 (socket says 172.21.15.155:36264) 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.754+0000 7fd100a6d640 1 -- 172.21.15.155:0/1637029406 learned_addr learned my addr 172.21.15.155:0/1637029406 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd10126e640 1 -- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc074160 msgr2=0x7fd0fc144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd10126e640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc074160 0x7fd0fc144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd10126e640 1 -- 172.21.15.155:0/1637029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0fc152980 msgr2=0x7fd0fc0ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd10126e640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0fc152980 0x7fd0fc0ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd10126e640 1 -- 172.21.15.155:0/1637029406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc14ce60 con 0x7fd0fc155320 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd10126e640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc147fe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c750 tx=0x7fd0f400cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4018070 con 0x7fd0fc155320 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4004d80 con 0x7fd0fc155320 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc1efbb0 con 0x7fd0fc155320 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400a820 con 0x7fd0fc155320 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc1efe90 con 0x7fd0fc155320 2024-04-25T15:53:46.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0f401b070 con 0x7fd0fc155320 2024-04-25T15:53:46.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd0f4007710 con 0x7fd0fc155320 2024-04-25T15:53:46.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc069bb0 con 0x7fd0fc155320 2024-04-25T15:53:46.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.758+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd0f40079c0 con 0x7fd0fc155320 2024-04-25T15:53:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.826+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f", "id": 6} v 0) -- 0x7fd0fc0c9b90 con 0x7fd0fc155320 2024-04-25T15:53:46.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.834+0000 7fd0f97fa640 1 -- 172.21.15.155:0/1637029406 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd0f4007220 con 0x7fd0fc155320 2024-04-25T15:53:46.838 INFO:teuthology.orchestra.run.smithi155.stdout:6 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 msgr2=0x7fd0fc147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc147fe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c750 tx=0x7fd0f400cc10 comp rx=0 tx=0).stop 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 shutdown_connections 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc155320 0x7fd0fc147fe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0fc152980 0x7fd0fc0ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 --2- 172.21.15.155:0/1637029406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc074160 0x7fd0fc144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 >> 172.21.15.155:0/1637029406 conn(0x7fd0fc0ac550 msgr2=0x7fd0fc1543b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:46.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 shutdown_connections 2024-04-25T15:53:46.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:46.838+0000 7fd102cd1640 1 -- 172.21.15.155:0/1637029406 wait complete. 2024-04-25T15:53:46.856 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 46a9e756-5ed4-48e3-8fdd-b0a2af99bb49 7 2024-04-25T15:53:47.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.022+0000 7f24c049d640 1 Processor -- start 2024-04-25T15:53:47.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.022+0000 7f24c049d640 1 -- start start 2024-04-25T15:53:47.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 0x7f24b80c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24b8157fc0 0x7f24b815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b80c5290 con 0x7f24b80c9ae0 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f24b80c5e80 con 0x7f24b8157fc0 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24b8154fd0 con 0x7f24b81517d0 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 0x7f24b80c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 0x7f24b80c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:56996/0 (socket says 172.21.15.155:56996) 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 -- 172.21.15.155:0/3972861884 learned_addr learned my addr 172.21.15.155:0/3972861884 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24bea3a640 1 --2- 172.21.15.155:0/3972861884 >> v2:172.21.15.87:3300/0 conn(0x7f24b8157fc0 0x7f24b815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 -- 172.21.15.155:0/3972861884 >> v2:172.21.15.87:3300/0 conn(0x7f24b8157fc0 msgr2=0x7f24b815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 --2- 172.21.15.155:0/3972861884 >> v2:172.21.15.87:3300/0 conn(0x7f24b8157fc0 0x7f24b815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 -- 172.21.15.155:0/3972861884 >> v1:172.21.15.87:6789/0 conn(0x7f24b80c9ae0 legacy=0x7f24b81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 -- 172.21.15.155:0/3972861884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b80c5550 con 0x7f24b81517d0 2024-04-25T15:53:47.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24bea3a640 1 --2- 172.21.15.155:0/3972861884 >> v2:172.21.15.87:3300/0 conn(0x7f24b8157fc0 0x7f24b815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:47.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24be239640 1 --2- 172.21.15.155:0/3972861884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 0x7f24b80c95a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009870 tx=0x7f24ac01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e4a9ebad0f56e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:47.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24bd237640 1 -- 172.21.15.155:0/3972861884 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0b1070 con 0x7f24b81517d0 2024-04-25T15:53:47.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24bd237640 1 -- 172.21.15.155:0/3972861884 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac0ac630 con 0x7f24b81517d0 2024-04-25T15:53:47.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24bd237640 1 -- 172.21.15.155:0/3972861884 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0a8050 con 0x7f24b81517d0 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 -- 172.21.15.155:0/3972861884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 msgr2=0x7f24b80c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.026+0000 7f24c049d640 1 --2- 172.21.15.155:0/3972861884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 0x7f24b80c95a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009870 tx=0x7f24ac01c520 comp rx=0 tx=0).stop 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- 172.21.15.155:0/3972861884 shutdown_connections 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 --2- 172.21.15.155:0/3972861884 >> v2:172.21.15.87:3300/0 conn(0x7f24b8157fc0 0x7f24b815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 --2- 172.21.15.155:0/3972861884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b81517d0 0x7f24b80c95a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- 172.21.15.155:0/3972861884 >> 172.21.15.155:0/3972861884 conn(0x7f24b806d780 msgr2=0x7f24b806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- 172.21.15.155:0/3972861884 shutdown_connections 2024-04-25T15:53:47.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- 172.21.15.155:0/3972861884 wait complete. 2024-04-25T15:53:47.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 Processor -- start 2024-04-25T15:53:47.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- start start 2024-04-25T15:53:47.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b80c9ae0 0x7f24b8155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 0x7f24b8073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 0x7f24b81457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8158550 con 0x7f24b80c9ae0 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24b81583d0 con 0x7f24b81517d0 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24b80a8f70 con 0x7f24b8157fc0 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bda38640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 0x7f24b8073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 0x7f24b81457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bda38640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 0x7f24b8073840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:36278/0 (socket says 172.21.15.155:36278) 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 0x7f24b81457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:57004/0 (socket says 172.21.15.155:57004) 2024-04-25T15:53:47.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bda38640 1 -- 172.21.15.155:0/3975731288 learned_addr learned my addr 172.21.15.155:0/3975731288 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24be239640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b80c9ae0 0x7f24b8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 -- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 msgr2=0x7f24b8073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 0x7f24b8073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 -- 172.21.15.155:0/3975731288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b80c9ae0 msgr2=0x7f24b8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b80c9ae0 0x7f24b8155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 -- 172.21.15.155:0/3975731288 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b80c2eb0 con 0x7f24b8157fc0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bda38640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 0x7f24b8073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24bea3a640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 0x7f24b81457f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24b000ccc0 tx=0x7f24b000a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000f680 con 0x7f24b8157fc0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b000f840 con 0x7f24b8157fc0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b8153940 con 0x7f24b8157fc0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b000fc30 con 0x7f24b8157fc0 2024-04-25T15:53:47.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.030+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81f4380 con 0x7f24b8157fc0 2024-04-25T15:53:47.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.034+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24b0018400 con 0x7f24b8157fc0 2024-04-25T15:53:47.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.034+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f24b0021aa0 con 0x7f24b8157fc0 2024-04-25T15:53:47.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.034+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8069bb0 con 0x7f24b8157fc0 2024-04-25T15:53:47.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.034+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f24b0026080 con 0x7f24b8157fc0 2024-04-25T15:53:47.100 INFO:tasks.ceph.mgr.y.smithi087.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T15:53:47.100 INFO:tasks.ceph.mgr.y.smithi087.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T15:53:47.100 INFO:tasks.ceph.mgr.y.smithi087.stderr: from numpy import show_config as show_numpy_config 2024-04-25T15:53:47.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.118+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46a9e756-5ed4-48e3-8fdd-b0a2af99bb49", "id": 7} v 0) -- 0x7f24b80c4910 con 0x7f24b8157fc0 2024-04-25T15:53:47.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24aaffd640 1 -- 172.21.15.155:0/3975731288 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46a9e756-5ed4-48e3-8fdd-b0a2af99bb49", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f24b0014030 con 0x7f24b8157fc0 2024-04-25T15:53:47.128 INFO:teuthology.orchestra.run.smithi155.stdout:7 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 msgr2=0x7f24b81457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 0x7f24b81457f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24b000ccc0 tx=0x7f24b000a650 comp rx=0 tx=0).stop 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 shutdown_connections 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b8157fc0 0x7f24b81457f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b81517d0 0x7f24b8073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 --2- 172.21.15.155:0/3975731288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b80c9ae0 0x7f24b8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 >> 172.21.15.155:0/3975731288 conn(0x7f24b806d780 msgr2=0x7f24b8148fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:47.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 shutdown_connections 2024-04-25T15:53:47.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:53:47.126+0000 7f24c049d640 1 -- 172.21.15.155:0/3975731288 wait complete. 2024-04-25T15:53:47.146 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T15:53:47.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T15:53:47.149 INFO:tasks.ceph.osd.0:Started 2024-04-25T15:53:47.149 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T15:53:47.149 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T15:53:47.152 INFO:tasks.ceph.osd.1:Started 2024-04-25T15:53:47.152 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T15:53:47.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T15:53:47.154 INFO:tasks.ceph.osd.2:Started 2024-04-25T15:53:47.154 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T15:53:47.154 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T15:53:47.157 INFO:tasks.ceph.osd.3:Started 2024-04-25T15:53:47.157 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T15:53:47.157 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T15:53:47.160 INFO:tasks.ceph.osd.4:Started 2024-04-25T15:53:47.160 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T15:53:47.160 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T15:53:47.162 INFO:tasks.ceph.osd.5:Started 2024-04-25T15:53:47.162 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T15:53:47.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T15:53:47.164 INFO:tasks.ceph.osd.6:Started 2024-04-25T15:53:47.164 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T15:53:47.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T15:53:47.167 INFO:tasks.ceph.osd.7:Started 2024-04-25T15:53:47.167 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:53:47.175 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:47.170+0000 7f2139d80180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:53:47.244 INFO:tasks.ceph.mgr.x.smithi155.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T15:53:47.244 INFO:tasks.ceph.mgr.x.smithi155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T15:53:47.244 INFO:tasks.ceph.mgr.x.smithi155.stderr: from numpy import show_config as show_numpy_config 2024-04-25T15:53:47.303 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:47.302+0000 7f0278e04180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:53:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 Processor -- start 2024-04-25T15:53:47.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 -- start start 2024-04-25T15:53:47.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a60155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a60074160 0x7f6a60074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a60152d90 con 0x7f6a60152980 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6a600aa290 con 0x7f6a60074160 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a66dac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a601598b0 con 0x7f6a60155320 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a64b48640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6a60152980 0x7f6a600c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53442/0 (socket says 172.21.15.87:53442) 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a64b48640 1 -- 172.21.15.87:0/2823243429 learned_addr learned my addr 172.21.15.87:0/2823243429 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a60155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a65349640 1 --2- 172.21.15.87:0/2823243429 >> v2:172.21.15.155:3300/0 conn(0x7f6a60074160 0x7f6a60074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475793621 0 0) 0x7f6a60152d90 con 0x7f6a60152980 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.322+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a48003530 con 0x7f6a60152980 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3920519951 0 0) 0x7f6a48003530 con 0x7f6a60152980 2024-04-25T15:53:47.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 msgr2=0x7f6a60155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a60155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 >> v2:172.21.15.155:3300/0 conn(0x7f6a60074160 msgr2=0x7f6a60074570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 --2- 172.21.15.87:0/2823243429 >> v2:172.21.15.155:3300/0 conn(0x7f6a60074160 0x7f6a60074570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a600a9cd0 con 0x7f6a60152980 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f6a58001680 con 0x7f6a60152980 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 >> v1:172.21.15.87:6789/0 conn(0x7f6a60152980 legacy=0x7f6a600c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a480039c0 0x7f6a48003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a48004810 0x7f6a48004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a48005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600aa290 con 0x7f6a48004810 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a601598b0 con 0x7f6a480039c0 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4800ba80 con 0x7f6a60155320 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a48004810 0x7f6a48004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a64b48640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a480039c0 0x7f6a48003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a65349640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a48005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 -- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 msgr2=0x7f6a48005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a48005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 -- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a480039c0 msgr2=0x7f6a48003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a480039c0 0x7f6a48003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 -- 172.21.15.87:0/2823243429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a48003530 con 0x7f6a48004810 2024-04-25T15:53:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a65349640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a60155320 0x7f6a48005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a48004810 0x7f6a48004c20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009ae0 tx=0x7f6a5401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5775fca2a863d06e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540096b0 con 0x7f6a48004810 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a540a6470 con 0x7f6a48004810 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a5f7fe640 1 -- 172.21.15.87:0/2823243429 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540a6860 con 0x7f6a48004810 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a66dac640 1 -- 172.21.15.87:0/2823243429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a48004810 msgr2=0x7f6a48004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a66dac640 1 --2- 172.21.15.87:0/2823243429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a48004810 0x7f6a48004c20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009ae0 tx=0x7f6a5401ca90 comp rx=0 tx=0).stop 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a65349640 1 -- 172.21.15.87:0/2823243429 reap_dead start 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a66dac640 1 -- 172.21.15.87:0/2823243429 shutdown_connections 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a66dac640 1 -- 172.21.15.87:0/2823243429 >> 172.21.15.87:0/2823243429 conn(0x7f6a600ac550 msgr2=0x7f6a600ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a66dac640 1 -- 172.21.15.87:0/2823243429 shutdown_connections 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.326+0000 7f6a66dac640 1 -- 172.21.15.87:0/2823243429 wait complete. 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 Processor -- start 2024-04-25T15:53:47.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 -- start start 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a48004810 0x7f6a600aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600c1350 0x7f6a60143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 0x7f6a6015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600729c0 con 0x7f6a6015b0c0 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a60158f70 con 0x7f6a600c1350 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a60072b40 con 0x7f6a48004810 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 0x7f6a6015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 0x7f6a6015b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57814/0 (socket says 172.21.15.87:57814) 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 -- 172.21.15.87:0/581803749 learned_addr learned my addr 172.21.15.87:0/581803749 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a64b48640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a48004810 0x7f6a600aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600c1350 0x7f6a60143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 -- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a48004810 msgr2=0x7f6a600aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a48004810 0x7f6a600aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 -- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600c1350 msgr2=0x7f6a60143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600c1350 0x7f6a60143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 -- 172.21.15.87:0/581803749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a60151610 con 0x7f6a6015b0c0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5ffff640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600c1350 0x7f6a60143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a65349640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 0x7f6a6015b4d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a60050c90 tx=0x7f6a5000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5001c070 con 0x7f6a6015b0c0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a50017400 con 0x7f6a6015b0c0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a600abf70 con 0x7f6a6015b0c0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a500177d0 con 0x7f6a6015b0c0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a600ac210 con 0x7f6a6015b0c0 2024-04-25T15:53:47.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6a5001f070 con 0x7f6a6015b0c0 2024-04-25T15:53:47.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.330+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6a50020a80 con 0x7f6a6015b0c0 2024-04-25T15:53:47.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.334+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a60069bb0 con 0x7f6a6015b0c0 2024-04-25T15:53:47.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.338+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6a50012070 con 0x7f6a6015b0c0 2024-04-25T15:53:47.355 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:47.354+0000 7f2139d80180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:53:47.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.390+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a601523b0 con 0x7f6a6015b0c0 2024-04-25T15:53:47.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.390+0000 7f6a5d7fa640 1 -- 172.21.15.87:0/581803749 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6a50020da0 con 0x7f6a6015b0c0 2024-04-25T15:53:47.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:53:47.394 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:53:47.123521+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 msgr2=0x7f6a6015b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 0x7f6a6015b4d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a60050c90 tx=0x7f6a5000f4a0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 shutdown_connections 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a6015b0c0 0x7f6a6015b4d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600c1350 0x7f6a60143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 --2- 172.21.15.87:0/581803749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a48004810 0x7f6a600aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 >> 172.21.15.87:0/581803749 conn(0x7f6a600ac550 msgr2=0x7f6a60071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 shutdown_connections 2024-04-25T15:53:47.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:53:47.394+0000 7f6a66dac640 1 -- 172.21.15.87:0/581803749 wait complete. 2024-04-25T15:53:47.412 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T15:53:47.413 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T15:53:47.446 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:47.445+0000 7f0278e04180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:53:47.522 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:47.518+0000 7f2139d80180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:53:47.585 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:47.582+0000 7f2139d80180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:53:47.605 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:47.601+0000 7f0278e04180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:53:47.680 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:47.677+0000 7f0278e04180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:53:47.719 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:47.718+0000 7f2139d80180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:53:47.795 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:53:47.793+0000 7f498e8ae7c0 -1 Falling back to public interface 2024-04-25T15:53:47.807 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:53:47.805+0000 7f5b55f657c0 -1 Falling back to public interface 2024-04-25T15:53:47.812 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-04-25T15:53:47.810+0000 7faaf37677c0 -1 Falling back to public interface 2024-04-25T15:53:47.814 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:53:47.813+0000 7f87d93717c0 -1 Falling back to public interface 2024-04-25T15:53:47.816 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:47.813+0000 7f0278e04180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:53:47.818 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:53:47.817+0000 7fc7e0a567c0 -1 Falling back to public interface 2024-04-25T15:53:47.820 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-04-25T15:53:47.818+0000 7f3f2c7727c0 -1 Falling back to public interface 2024-04-25T15:53:47.836 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-04-25T15:53:47.834+0000 7fb66cc937c0 -1 Falling back to public interface 2024-04-25T15:53:47.836 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-25T15:53:47.834+0000 7f91399bd7c0 -1 Falling back to public interface 2024-04-25T15:53:47.837 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-25T15:53:47.834+0000 7f913897d640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6819/0: (98) Address already in use 2024-04-25T15:53:48.219 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:53:48.359 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.354+0000 7ff3bbc3d640 1 Processor -- start 2024-04-25T15:53:48.359 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.354+0000 7ff3bbc3d640 1 -- start start 2024-04-25T15:53:48.361 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3bbc3d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3b406fb60 0x7ff3b406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:48.361 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3bbc3d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b415fce0 0x7ff3b4162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3bbc3d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b4157a80 con 0x7ff3b415b4e0 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3bbc3d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b406d970 con 0x7ff3b406fb60 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3bbc3d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b415b8f0 con 0x7ff3b415fce0 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3b406fb60 0x7ff3b406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3b406fb60 0x7ff3b406ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57828/0 (socket says 172.21.15.87:57828) 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 -- 172.21.15.87:0/3039775436 learned_addr learned my addr 172.21.15.87:0/3039775436 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b99d9640 1 --1- 172.21.15.87:0/3039775436 >> v1:172.21.15.87:6789/0 conn(0x7ff3b415b4e0 0x7ff3b4157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53450/0 (socket says 172.21.15.87:53450) 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3ba1da640 1 --2- 172.21.15.87:0/3039775436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b415fce0 0x7ff3b4162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 -- 172.21.15.87:0/3039775436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b415fce0 msgr2=0x7ff3b4162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 --2- 172.21.15.87:0/3039775436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b415fce0 0x7ff3b4162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.362 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 -- 172.21.15.87:0/3039775436 >> v1:172.21.15.87:6789/0 conn(0x7ff3b415b4e0 legacy=0x7ff3b4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:48.363 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b89d7640 1 -- 172.21.15.87:0/3039775436 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849052425 0 0) 0x7ff3b4157a80 con 0x7ff3b415b4e0 2024-04-25T15:53:48.363 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.358+0000 7ff3b91d8640 1 -- 172.21.15.87:0/3039775436 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b406dbc0 con 0x7ff3b406fb60 2024-04-25T15:53:48.365 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3b91d8640 1 --2- 172.21.15.87:0/3039775436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b406fb60 0x7ff3b406ff70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009870 tx=0x7ff3a801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defc9ed13a4e9247 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:48.365 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3b89d7640 1 -- 172.21.15.87:0/3039775436 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80b0070 con 0x7ff3b406fb60 2024-04-25T15:53:48.365 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3b89d7640 1 -- 172.21.15.87:0/3039775436 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a80ab600 con 0x7ff3b406fb60 2024-04-25T15:53:48.365 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3b89d7640 1 -- 172.21.15.87:0/3039775436 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80ab9d0 con 0x7ff3b406fb60 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/3039775436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b406fb60 msgr2=0x7ff3b406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/3039775436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b406fb60 0x7ff3b406ff70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009870 tx=0x7ff3a801c440 comp rx=0 tx=0).stop 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/3039775436 shutdown_connections 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/3039775436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b406fb60 0x7ff3b406ff70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/3039775436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b415fce0 0x7ff3b4162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/3039775436 >> 172.21.15.87:0/3039775436 conn(0x7ff3b406c670 msgr2=0x7ff3b406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:48.366 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/3039775436 shutdown_connections 2024-04-25T15:53:48.367 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.362+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/3039775436 wait complete. 2024-04-25T15:53:48.367 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 Processor -- start 2024-04-25T15:53:48.367 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- start start 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b406fb60 0x7ff3b414c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 0x7ff3b41f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3b415fce0 0x7ff3b4144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40747f0 con 0x7ff3b415b4e0 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b406d4f0 con 0x7ff3b415fce0 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b4074970 con 0x7ff3b406fb60 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 0x7ff3b41f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:48.371 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 0x7ff3b41f0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:57844/0 (socket says 172.21.15.87:57844) 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 -- 172.21.15.87:0/858099345 learned_addr learned my addr 172.21.15.87:0/858099345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b99d9640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b406fb60 0x7ff3b414c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3ba1da640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3b415fce0 0x7ff3b4144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 -- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b406fb60 msgr2=0x7ff3b414c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b406fb60 0x7ff3b414c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 -- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3b415fce0 msgr2=0x7ff3b4144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3b415fce0 0x7ff3b4144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 -- 172.21.15.87:0/858099345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b414a090 con 0x7ff3b415b4e0 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3ba1da640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3b415fce0 0x7ff3b4144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3b91d8640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 0x7ff3b41f0be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80ae040 tx=0x7ff3a801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:48.372 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80ba020 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a80b6640 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b4147ed0 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80b0040 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b41f15a0 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff3a80bd020 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff3a80b43f0 con 0x7ff3b415b4e0 2024-04-25T15:53:48.373 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.366+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b406a8a0 con 0x7ff3b415b4e0 2024-04-25T15:53:48.374 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:48.370+0000 7f2139d80180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:53:48.374 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.370+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff3a80c4030 con 0x7ff3b415b4e0 2024-04-25T15:53:48.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.426+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3b40aea40 con 0x7ff3b415b4e0 2024-04-25T15:53:48.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3a67fc640 1 -- 172.21.15.87:0/858099345 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff3b414a090 con 0x7ff3b415b4e0 2024-04-25T15:53:48.431 INFO:teuthology.misc.health.smithi087.stdout: 2024-04-25T15:53:48.432 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":10,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:53:47.123521+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 msgr2=0x7ff3b41f0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 0x7ff3b41f0be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80ae040 tx=0x7ff3a801ac80 comp rx=0 tx=0).stop 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 shutdown_connections 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3b415fce0 0x7ff3b4144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415b4e0 0x7ff3b41f0be0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 --2- 172.21.15.87:0/858099345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3b406fb60 0x7ff3b414c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 >> 172.21.15.87:0/858099345 conn(0x7ff3b406c670 msgr2=0x7ff3b415f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 shutdown_connections 2024-04-25T15:53:48.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:48.430+0000 7ff3bbc3d640 1 -- 172.21.15.87:0/858099345 wait complete. 2024-04-25T15:53:48.436 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:48.433+0000 7f0278e04180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:53:48.455 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:53:48.458 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:48.454+0000 7f2139d80180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:53:48.512 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:48.509+0000 7f0278e04180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:53:48.640 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:48.638+0000 7f2139d80180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:53:48.692 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:48.689+0000 7f0278e04180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:53:48.713 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:48.710+0000 7f2139d80180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:53:48.765 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:48.761+0000 7f0278e04180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:53:49.001 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:48.998+0000 7f2139d80180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:53:49.053 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:49.049+0000 7f0278e04180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:53:49.063 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:49.062+0000 7f2139d80180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:53:49.116 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:53:49.113+0000 7f0278e04180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:53:50.112 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:50.110+0000 7f20e0830640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T15:53:50.113 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-04-25T15:53:50.110+0000 7f20e0830640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T15:53:51.514 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:53:51.513+0000 7f498e8ae7c0 -1 osd.5 0 log_to_monitors true 2024-04-25T15:53:51.616 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-04-25T15:53:51.614+0000 7faaf37677c0 -1 osd.3 0 log_to_monitors true 2024-04-25T15:53:51.627 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:53:51.625+0000 7fc7e0a567c0 -1 osd.4 0 log_to_monitors true 2024-04-25T15:53:51.634 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:53:51.633+0000 7f5b55f657c0 -1 osd.7 0 log_to_monitors true 2024-04-25T15:53:51.700 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-04-25T15:53:51.698+0000 7fb66cc937c0 -1 osd.0 0 log_to_monitors true 2024-04-25T15:53:51.707 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-04-25T15:53:51.702+0000 7f3f2c7727c0 -1 osd.2 0 log_to_monitors true 2024-04-25T15:53:51.709 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:53:51.705+0000 7f87d93717c0 -1 osd.6 0 log_to_monitors true 2024-04-25T15:53:51.718 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-25T15:53:51.714+0000 7f91399bd7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T15:53:55.203 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-04-25T15:53:55.202+0000 7fb668c3a640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T15:53:55.224 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-04-25T15:53:55.226+0000 7fb660a3b640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.261 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-04-25T15:53:55.262+0000 7faaef70e640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T15:53:55.262 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:53:55.288 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-04-25T15:53:55.290+0000 7faae750f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.290 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:53:55.285+0000 7f87d5318640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T15:53:55.294 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:53:55.293+0000 7fc7dc9fd640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T15:53:55.297 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-04-25T15:53:55.298+0000 7f3f28719640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T15:53:55.307 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:53:55.305+0000 7f498a855640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T15:53:55.319 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:53:55.317+0000 7f87cd119640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.327 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:53:55.325+0000 7fc7d47fe640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.336 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-04-25T15:53:55.338+0000 7f3f2051a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.347 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:53:55.345+0000 7f4982656640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.359 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:53:55.357+0000 7f5b52720640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T15:53:55.366 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-25T15:53:55.366+0000 7f9135964640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T15:53:55.388 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-25T15:53:55.390+0000 7f912d765640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.395 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:53:55.393+0000 7f5b49d0d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:53:55.426 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.426+0000 7f0d738c9640 1 Processor -- start 2024-04-25T15:53:55.426 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.426+0000 7f0d738c9640 1 -- start start 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d738c9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d6c070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d738c9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6c158680 con 0x7f0d6c154ee0 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d738c9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6c06edc0 con 0x7f0d6c0c61b0 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d738c9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6c070320 con 0x7f0d6c151a90 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0d6c154ee0 0x7f0d6c15eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38534/0 (socket says 172.21.15.87:38534) 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 -- 172.21.15.87:0/1960254174 learned_addr learned my addr 172.21.15.87:0/1960254174 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:53:55.430 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71665640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d6c070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205797770 0 0) 0x7f0d6c158680 con 0x7f0d6c154ee0 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d58005740 con 0x7f0d6c154ee0 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 432714128 0 0) 0x7f0d58005740 con 0x7f0d6c154ee0 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 msgr2=0x7f0d6c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d6c070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 >> v1:172.21.15.155:6789/0 conn(0x7f0d6c0c61b0 legacy=0x7f0d6c1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c06f0a0 con 0x7f0d6c154ee0 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f0d64001a00 con 0x7f0d6c154ee0 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 >> v1:172.21.15.87:6789/0 conn(0x7f0d6c154ee0 legacy=0x7f0d6c15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.431 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d58005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d58006180 0x7f0d58006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d58006f60 0x7f0d58007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c070320 con 0x7f0d58006f60 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5800dd70 con 0x7f0d58006180 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5800df70 con 0x7f0d6c151a90 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d58006f60 0x7f0d58007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71665640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d58005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d70e64640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d58006180 0x7f0d58006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.432 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 -- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 msgr2=0x7f0d58005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:55.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d58005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 -- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d58006180 msgr2=0x7f0d58006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:53:55.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d58006180 0x7f0d58006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71e66640 1 -- 172.21.15.87:0/1960254174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d58005740 con 0x7f0d58006f60 2024-04-25T15:53:55.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d70e64640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d58006180 0x7f0d58006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:53:55.433 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.430+0000 7f0d71665640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c151a90 0x7f0d58005c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:53:55.434 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d71e66640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d58006f60 0x7f0d58007370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400a860 tx=0x7f0d6401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72a59abfe24aef9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:55.434 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400a480 con 0x7f0d58006f60 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d640ad630 con 0x7f0d58006f60 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d63fff640 1 -- 172.21.15.87:0/1960254174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d640ada60 con 0x7f0d58006f60 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- 172.21.15.87:0/1960254174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d58006f60 msgr2=0x7f0d58007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 --2- 172.21.15.87:0/1960254174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d58006f60 0x7f0d58007370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400a860 tx=0x7f0d6401d380 comp rx=0 tx=0).stop 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d71e66640 1 -- 172.21.15.87:0/1960254174 reap_dead start 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- 172.21.15.87:0/1960254174 shutdown_connections 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- 172.21.15.87:0/1960254174 >> 172.21.15.87:0/1960254174 conn(0x7f0d6c06d950 msgr2=0x7f0d6c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- 172.21.15.87:0/1960254174 shutdown_connections 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- 172.21.15.87:0/1960254174 wait complete. 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 Processor -- start 2024-04-25T15:53:55.435 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- start start 2024-04-25T15:53:55.437 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d6c0c3300 0x7f0d6c1ea150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 0x7f0d6c0ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c150b00 0x7f0d6c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c070570 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c154340 con 0x7f0d6c0c3300 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.434+0000 7f0d738c9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6c0c4120 con 0x7f0d6c150b00 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 0x7f0d6c0ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 0x7f0d6c0ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53340/0 (socket says 172.21.15.87:53340) 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 -- 172.21.15.87:0/897154639 learned_addr learned my addr 172.21.15.87:0/897154639 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 -- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c150b00 msgr2=0x7f0d6c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c150b00 0x7f0d6c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.438 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 -- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d6c0c3300 msgr2=0x7f0d6c1ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d71665640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d6c0c3300 0x7f0d6c1ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d6c0c3300 0x7f0d6c1ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 -- 172.21.15.87:0/897154639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c1ea690 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d71665640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d6c0c3300 0x7f0d6c1ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d70e64640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 0x7f0d6c0ad9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e3c0 tx=0x7f0d6800e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68019070 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680052e0 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6c1deaf0 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68003840 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d6c0beba0 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6c06a8a0 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.439 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f0d6801c070 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.440 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d61ffb640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d5006f370 0x7f0d50071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:53:55.440 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d71665640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d5006f370 0x7f0d50071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:53:55.440 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f0d6808d870 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.440 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.438+0000 7f0d71665640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d5006f370 0x7f0d50071880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009aa0 tx=0x7f0d5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:53:55.443 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.442+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d6805b000 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.604 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.606+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d6c0c83b0 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.605 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.606+0000 7f0d61ffb640 1 -- 172.21.15.87:0/897154639 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f0d6805f300 con 0x7f0d6c1ecc70 2024-04-25T15:53:55.606 INFO:teuthology.misc.health.smithi087.stdout: 2024-04-25T15:53:55.606 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":12,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:53:53.112458+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:53:55.608 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d5006f370 msgr2=0x7f0d50071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.608 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d5006f370 0x7f0d50071880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009aa0 tx=0x7f0d5c008040 comp rx=0 tx=0).stop 2024-04-25T15:53:55.608 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 msgr2=0x7f0d6c0ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:53:55.608 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 0x7f0d6c0ad9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e3c0 tx=0x7f0d6800e880 comp rx=0 tx=0).stop 2024-04-25T15:53:55.608 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 shutdown_connections 2024-04-25T15:53:55.608 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d5006f370 0x7f0d50071880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.609 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6c150b00 0x7f0d6c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.609 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d6c1ecc70 0x7f0d6c0ad9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.609 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 --2- 172.21.15.87:0/897154639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d6c0c3300 0x7f0d6c1ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:53:55.609 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 >> 172.21.15.87:0/897154639 conn(0x7f0d6c06d950 msgr2=0x7f0d6c0c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:53:55.609 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 shutdown_connections 2024-04-25T15:53:55.609 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:53:55.610+0000 7f0d738c9640 1 -- 172.21.15.87:0/897154639 wait complete. 2024-04-25T15:53:55.626 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:54:02.432 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:02.584 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 Processor -- start 2024-04-25T15:54:02.585 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 -- start start 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f75501529e0 0x7f7550155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75500c75e0 0x7f75500c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75500c9090 con 0x7f7550158cf0 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7550152df0 con 0x7f75501529e0 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f755480c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7550070500 con 0x7f75500c75e0 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f75501529e0 0x7f7550155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f75501529e0 0x7f7550155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48814/0 (socket says 172.21.15.87:48814) 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 -- 172.21.15.87:0/4072346714 learned_addr learned my addr 172.21.15.87:0/4072346714 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 -- 172.21.15.87:0/4072346714 >> v2:172.21.15.155:3300/0 conn(0x7f75500c75e0 msgr2=0x7f75500c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754dd9b640 1 --2- 172.21.15.87:0/4072346714 >> v2:172.21.15.155:3300/0 conn(0x7f75500c75e0 0x7f75500c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.587 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 --2- 172.21.15.87:0/4072346714 >> v2:172.21.15.155:3300/0 conn(0x7f75500c75e0 0x7f75500c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.588 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 -- 172.21.15.87:0/4072346714 >> v1:172.21.15.155:6789/0 conn(0x7f7550158cf0 legacy=0x7f7550159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:02.588 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.586+0000 7f754e59c640 1 -- 172.21.15.87:0/4072346714 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75500c51a0 con 0x7f75501529e0 2024-04-25T15:54:02.589 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f754e59c640 1 --2- 172.21.15.87:0/4072346714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75501529e0 0x7f7550155cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7540009870 tx=0x7f754001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad227b2eb11c88f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:02.589 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f754d59a640 1 -- 172.21.15.87:0/4072346714 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400b0070 con 0x7f75501529e0 2024-04-25T15:54:02.589 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f754d59a640 1 -- 172.21.15.87:0/4072346714 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75400a4e50 con 0x7f75501529e0 2024-04-25T15:54:02.589 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f754d59a640 1 -- 172.21.15.87:0/4072346714 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400ab820 con 0x7f75501529e0 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 -- 172.21.15.87:0/4072346714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75501529e0 msgr2=0x7f7550155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 --2- 172.21.15.87:0/4072346714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75501529e0 0x7f7550155cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7540009870 tx=0x7f754001c3c0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 -- 172.21.15.87:0/4072346714 shutdown_connections 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 --2- 172.21.15.87:0/4072346714 >> v2:172.21.15.155:3300/0 conn(0x7f75500c75e0 0x7f75500c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 --2- 172.21.15.87:0/4072346714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75501529e0 0x7f7550155cb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 -- 172.21.15.87:0/4072346714 >> 172.21.15.87:0/4072346714 conn(0x7f75500caba0 msgr2=0x7f75500cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 -- 172.21.15.87:0/4072346714 shutdown_connections 2024-04-25T15:54:02.590 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.590+0000 7f755480c640 1 -- 172.21.15.87:0/4072346714 wait complete. 2024-04-25T15:54:02.591 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 Processor -- start 2024-04-25T15:54:02.592 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- start start 2024-04-25T15:54:02.594 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 0x7f75500ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.594 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75501529e0 0x7f75500aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.594 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550158cf0 0x7f7550149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.594 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f75501625b0 con 0x7f75500c75e0 2024-04-25T15:54:02.594 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7550162430 con 0x7f75501529e0 2024-04-25T15:54:02.594 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7550162730 con 0x7f7550158cf0 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 0x7f75500ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 0x7f75500ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48830/0 (socket says 172.21.15.87:48830) 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 -- 172.21.15.87:0/3506019559 learned_addr learned my addr 172.21.15.87:0/3506019559 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754dd9b640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75501529e0 0x7f75500aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754ed9d640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550158cf0 0x7f7550149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 -- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550158cf0 msgr2=0x7f7550149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550158cf0 0x7f7550149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 -- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75501529e0 msgr2=0x7f75500aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75501529e0 0x7f75500aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 -- 172.21.15.87:0/3506019559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75500aa900 con 0x7f75500c75e0 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754dd9b640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75501529e0 0x7f75500aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754ed9d640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550158cf0 0x7f7550149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:02.595 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f754e59c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 0x7f75500ab520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7540019ff0 tx=0x7f7540019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:02.596 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400b0040 con 0x7f75500c75e0 2024-04-25T15:54:02.596 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755014aad0 con 0x7f75500c75e0 2024-04-25T15:54:02.596 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75501ef3f0 con 0x7f75500c75e0 2024-04-25T15:54:02.596 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75400b9070 con 0x7f75500c75e0 2024-04-25T15:54:02.596 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400aa860 con 0x7f75500c75e0 2024-04-25T15:54:02.597 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.594+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75340052a0 con 0x7f75500c75e0 2024-04-25T15:54:02.597 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.598+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f75400aaa00 con 0x7f75500c75e0 2024-04-25T15:54:02.597 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.598+0000 7f753effd640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f753006f430 0x7f7530071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.597 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.598+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7540128df0 con 0x7f75500c75e0 2024-04-25T15:54:02.597 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.598+0000 7f754dd9b640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f753006f430 0x7f7530071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.597 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.598+0000 7f754dd9b640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f753006f430 0x7f7530071940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7544006fd0 tx=0x7f7544008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:02.601 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.602+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75400160d0 con 0x7f75500c75e0 2024-04-25T15:54:02.765 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.766+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7534005860 con 0x7f75500c75e0 2024-04-25T15:54:02.767 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.766+0000 7f753effd640 1 -- 172.21.15.87:0/3506019559 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f75400f6150 con 0x7f75500c75e0 2024-04-25T15:54:02.767 INFO:teuthology.misc.health.smithi087.stdout: 2024-04-25T15:54:02.768 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":16,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:53:59.402404+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f753006f430 msgr2=0x7f7530071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f753006f430 0x7f7530071940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7544006fd0 tx=0x7f7544008040 comp rx=0 tx=0).stop 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 msgr2=0x7f75500ab520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 0x7f75500ab520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7540019ff0 tx=0x7f7540019160 comp rx=0 tx=0).stop 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 shutdown_connections 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f753006f430 0x7f7530071940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7550158cf0 0x7f7550149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.770 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75501529e0 0x7f75500aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.771 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 --2- 172.21.15.87:0/3506019559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75500c75e0 0x7f75500ab520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.771 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 >> 172.21.15.87:0/3506019559 conn(0x7f75500caba0 msgr2=0x7f75500c5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:02.771 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 shutdown_connections 2024-04-25T15:54:02.771 INFO:teuthology.misc.health.smithi087.stderr:2024-04-25T15:54:02.770+0000 7f755480c640 1 -- 172.21.15.87:0/3506019559 wait complete. 2024-04-25T15:54:02.788 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T15:54:02.788 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T15:54:02.788 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:54:02.789 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:54:02.791 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:54:02.791 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:54:02.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:54:02.793 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:54:02.794 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:54:02.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:54:02.796 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:54:02.797 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:54:02.797 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:54:02.799 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:54:02.799 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T15:54:02.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:02.893 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-04-25T15:54:02.893 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-04-25T15:54:02.911 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-04-25T15:54:02.921 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-25T15:54:02.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.946+0000 7f8d2b350640 1 Processor -- start 2024-04-25T15:54:02.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.946+0000 7f8d2b350640 1 -- start start 2024-04-25T15:54:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d24160eb0 0x7f8d241632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d240c53b0 con 0x7f8d24157530 2024-04-25T15:54:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d24157b60 con 0x7f8d240c8bc0 2024-04-25T15:54:02.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8d24157940 con 0x7f8d24160eb0 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d298ed640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d24160eb0 0x7f8d241632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d290ec640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8d24157530 0x7f8d24074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60600/0 (socket says 172.21.15.87:60600) 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d290ec640 1 -- 172.21.15.87:0/1638038836 learned_addr learned my addr 172.21.15.87:0/1638038836 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d298ed640 1 -- 172.21.15.87:0/1638038836 >> v1:172.21.15.155:6789/0 conn(0x7f8d240c8bc0 legacy=0x7f8d240c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d298ed640 1 -- 172.21.15.87:0/1638038836 >> v1:172.21.15.87:6789/0 conn(0x7f8d24157530 legacy=0x7f8d24074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d298ed640 1 -- 172.21.15.87:0/1638038836 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d24157e40 con 0x7f8d24160eb0 2024-04-25T15:54:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d1bfff640 1 -- 172.21.15.87:0/1638038836 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576280192 0 0) 0x7f8d14001120 con 0x7f8d24157530 2024-04-25T15:54:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d298ed640 1 --2- 172.21.15.87:0/1638038836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24160eb0 0x7f8d241632d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009d90 tx=0x7f8d1c01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1830026e0f1f5842 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d1bfff640 1 -- 172.21.15.87:0/1638038836 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0b2070 con 0x7f8d24160eb0 2024-04-25T15:54:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d1bfff640 1 -- 172.21.15.87:0/1638038836 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0a57c0 con 0x7f8d24160eb0 2024-04-25T15:54:02.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d1bfff640 1 -- 172.21.15.87:0/1638038836 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0a5b90 con 0x7f8d24160eb0 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- 172.21.15.87:0/1638038836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24160eb0 msgr2=0x7f8d241632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 --2- 172.21.15.87:0/1638038836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24160eb0 0x7f8d241632d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c009d90 tx=0x7f8d1c01c810 comp rx=0 tx=0).stop 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- 172.21.15.87:0/1638038836 shutdown_connections 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 --2- 172.21.15.87:0/1638038836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24160eb0 0x7f8d241632d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- 172.21.15.87:0/1638038836 >> 172.21.15.87:0/1638038836 conn(0x7f8d240ac550 msgr2=0x7f8d240ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- 172.21.15.87:0/1638038836 shutdown_connections 2024-04-25T15:54:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.950+0000 7f8d2b350640 1 -- 172.21.15.87:0/1638038836 wait complete. 2024-04-25T15:54:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 Processor -- start 2024-04-25T15:54:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 -- start start 2024-04-25T15:54:02.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d240c8bc0 0x7f8d24152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 0x7f8d2414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24160eb0 0x7f8d2414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d24074870 con 0x7f8d24157530 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240aa230 con 0x7f8d24160eb0 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d240749f0 con 0x7f8d240c8bc0 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 0x7f8d2414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 0x7f8d2414fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48886/0 (socket says 172.21.15.87:48886) 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 -- 172.21.15.87:0/2479312691 learned_addr learned my addr 172.21.15.87:0/2479312691 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d290ec640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d240c8bc0 0x7f8d24152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d298ed640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24160eb0 0x7f8d2414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 -- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d240c8bc0 msgr2=0x7f8d24152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d240c8bc0 0x7f8d24152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 -- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24160eb0 msgr2=0x7f8d2414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24160eb0 0x7f8d2414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 -- 172.21.15.87:0/2479312691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2414da00 con 0x7f8d24157530 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d288eb640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 0x7f8d2414fbb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b440 tx=0x7f8d2000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20015020 con 0x7f8d24157530 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d20011830 con 0x7f8d24157530 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d24153e20 con 0x7f8d24157530 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011c20 con 0x7f8d24157530 2024-04-25T15:54:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.954+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d24161cd0 con 0x7f8d24157530 2024-04-25T15:54:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.958+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d24069bb0 con 0x7f8d24157530 2024-04-25T15:54:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.958+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d20018020 con 0x7f8d24157530 2024-04-25T15:54:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.958+0000 7f8d19ffb640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d0806f400 0x7f8d08071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.958+0000 7f8d290ec640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d0806f400 0x7f8d08071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.958+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8d2008e9c0 con 0x7f8d24157530 2024-04-25T15:54:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.958+0000 7f8d290ec640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d0806f400 0x7f8d08071910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d14000f70 tx=0x7f8d14007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:02.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:02.962+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d20090e20 con 0x7f8d24157530 2024-04-25T15:54:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.122+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d240c9b30 con 0x7f8d24157530 2024-04-25T15:54:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d19ffb640 1 -- 172.21.15.87:0/2479312691 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f8d2001f030 con 0x7f8d24157530 2024-04-25T15:54:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:03.126 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":16,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:53:59.402404+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d0806f400 msgr2=0x7f8d08071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d0806f400 0x7f8d08071910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8d14000f70 tx=0x7f8d14007df0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 msgr2=0x7f8d2414fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 0x7f8d2414fbb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b440 tx=0x7f8d2000b900 comp rx=0 tx=0).stop 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 shutdown_connections 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d0806f400 0x7f8d08071910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24160eb0 0x7f8d2414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d24157530 0x7f8d2414fbb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 --2- 172.21.15.87:0/2479312691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d240c8bc0 0x7f8d24152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.126+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 >> 172.21.15.87:0/2479312691 conn(0x7f8d240ac550 msgr2=0x7f8d24155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:03.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.130+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 shutdown_connections 2024-04-25T15:54:03.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.130+0000 7f8d2b350640 1 -- 172.21.15.87:0/2479312691 wait complete. 2024-04-25T15:54:03.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:03.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:03.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc818ff1640 1 Processor -- start 2024-04-25T15:54:03.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc818ff1640 1 -- start start 2024-04-25T15:54:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc818ff1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc814157530 0x7fc814074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc818ff1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8140c53b0 con 0x7fc8140c92d0 2024-04-25T15:54:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc818ff1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc814157b60 con 0x7fc8140746a0 2024-04-25T15:54:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc818ff1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc814157940 con 0x7fc814157530 2024-04-25T15:54:03.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc814157530 0x7fc814074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc814157530 0x7fc814074160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48894/0 (socket says 172.21.15.87:48894) 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81259c640 1 -- 172.21.15.87:0/2592690517 learned_addr learned my addr 172.21.15.87:0/2592690517 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc812d9d640 1 --1- 172.21.15.87:0/2592690517 >> v1:172.21.15.87:6789/0 conn(0x7fc8140c92d0 0x7fc814161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60610/0 (socket says 172.21.15.87:60610) 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81259c640 1 -- 172.21.15.87:0/2592690517 >> v1:172.21.15.155:6789/0 conn(0x7fc8140746a0 legacy=0x7fc8140c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81259c640 1 -- 172.21.15.87:0/2592690517 >> v1:172.21.15.87:6789/0 conn(0x7fc8140c92d0 legacy=0x7fc814161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81159a640 1 -- 172.21.15.87:0/2592690517 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891021138 0 0) 0x7fc804001120 con 0x7fc8140c92d0 2024-04-25T15:54:03.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.302+0000 7fc81259c640 1 -- 172.21.15.87:0/2592690517 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc814157e40 con 0x7fc814157530 2024-04-25T15:54:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc81259c640 1 --2- 172.21.15.87:0/2592690517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc814157530 0x7fc814074160 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009e50 tx=0x7fc80c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6059ea81dd01c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:03.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc81159a640 1 -- 172.21.15.87:0/2592690517 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0a5680 con 0x7fc814157530 2024-04-25T15:54:03.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc81159a640 1 -- 172.21.15.87:0/2592690517 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c0a5820 con 0x7fc814157530 2024-04-25T15:54:03.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc81159a640 1 -- 172.21.15.87:0/2592690517 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0a5bf0 con 0x7fc814157530 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 -- 172.21.15.87:0/2592690517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc814157530 msgr2=0x7fc814074160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 --2- 172.21.15.87:0/2592690517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc814157530 0x7fc814074160 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009e50 tx=0x7fc80c01c8d0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 -- 172.21.15.87:0/2592690517 shutdown_connections 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 --2- 172.21.15.87:0/2592690517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc814157530 0x7fc814074160 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 -- 172.21.15.87:0/2592690517 >> 172.21.15.87:0/2592690517 conn(0x7fc8140ac550 msgr2=0x7fc8140ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 -- 172.21.15.87:0/2592690517 shutdown_connections 2024-04-25T15:54:03.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 -- 172.21.15.87:0/2592690517 wait complete. 2024-04-25T15:54:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 Processor -- start 2024-04-25T15:54:03.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.306+0000 7fc818ff1640 1 -- start start 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 0x7fc8140ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8140c92d0 0x7fc81414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc814157530 0x7fc8141f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc814154df0 con 0x7fc8140746a0 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140aa230 con 0x7fc8140c92d0 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc814154f70 con 0x7fc814157530 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 0x7fc8140ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 0x7fc8140ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48904/0 (socket says 172.21.15.87:48904) 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 -- 172.21.15.87:0/1871140659 learned_addr learned my addr 172.21.15.87:0/1871140659 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc811d9b640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8140c92d0 0x7fc81414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc812d9d640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc814157530 0x7fc8141f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 -- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc814157530 msgr2=0x7fc8141f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc814157530 0x7fc8141f0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 -- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8140c92d0 msgr2=0x7fc81414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8140c92d0 0x7fc81414e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 -- 172.21.15.87:0/1871140659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81414ec30 con 0x7fc8140746a0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc811d9b640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8140c92d0 0x7fc81414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc81259c640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 0x7fc8140ae8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0194e0 tx=0x7fc80c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0bc020 con 0x7fc8140746a0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c0b8670 con 0x7fc8140746a0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0b8a20 con 0x7fc8140746a0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8140affc0 con 0x7fc8140746a0 2024-04-25T15:54:03.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8140ad6a0 con 0x7fc8140746a0 2024-04-25T15:54:03.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc814069bb0 con 0x7fc8140746a0 2024-04-25T15:54:03.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.310+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc80c0bf020 con 0x7fc8140746a0 2024-04-25T15:54:03.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.314+0000 7fc802ffd640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc7f406f400 0x7fc7f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.314+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc80c12a420 con 0x7fc8140746a0 2024-04-25T15:54:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.314+0000 7fc811d9b640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc7f406f400 0x7fc7f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.314+0000 7fc811d9b640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc7f406f400 0x7fc7f4071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc81415bc00 tx=0x7fc808008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:03.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.318+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc80c0c6030 con 0x7fc8140746a0 2024-04-25T15:54:03.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8140c9b30 con 0x7fc8140746a0 2024-04-25T15:54:03.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc802ffd640 1 -- 172.21.15.87:0/1871140659 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fc80c0165e0 con 0x7fc8140746a0 2024-04-25T15:54:03.477 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc7f406f400 msgr2=0x7fc7f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc7f406f400 0x7fc7f4071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc81415bc00 tx=0x7fc808008040 comp rx=0 tx=0).stop 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 msgr2=0x7fc8140ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 0x7fc8140ae8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0194e0 tx=0x7fc80c019670 comp rx=0 tx=0).stop 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 shutdown_connections 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc7f406f400 0x7fc7f4071910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc814157530 0x7fc8141f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8140c92d0 0x7fc81414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.478+0000 7fc818ff1640 1 --2- 172.21.15.87:0/1871140659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8140746a0 0x7fc8140ae8b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.482+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 >> 172.21.15.87:0/1871140659 conn(0x7fc8140ac550 msgr2=0x7fc81414cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.482+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 shutdown_connections 2024-04-25T15:54:03.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.482+0000 7fc818ff1640 1 -- 172.21.15.87:0/1871140659 wait complete. 2024-04-25T15:54:03.498 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:03.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.638+0000 7f4c88bda640 1 Processor -- start 2024-04-25T15:54:03.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.638+0000 7f4c88bda640 1 -- start start 2024-04-25T15:54:03.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c88bda640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8414d810 0x7f4c84157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c88bda640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c8406f790 0x7f4c8406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c88bda640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c84157d50 con 0x7f4c84154d00 2024-04-25T15:54:03.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c88bda640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4c840add10 con 0x7f4c8406f790 2024-04-25T15:54:03.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c88bda640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c840adff0 con 0x7f4c8414d810 2024-04-25T15:54:03.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4c84154d00 0x7f4c84154200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60614/0 (socket says 172.21.15.87:60614) 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 -- 172.21.15.87:0/2356718528 learned_addr learned my addr 172.21.15.87:0/2356718528 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c82d9d640 1 --2- 172.21.15.87:0/2356718528 >> v2:172.21.15.155:3300/0 conn(0x7f4c8406f790 0x7f4c8406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301782411 0 0) 0x7f4c84157d50 con 0x7f4c84154d00 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c70003530 con 0x7f4c84154d00 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8259c640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8414d810 0x7f4c84157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1272194060 0 0) 0x7f4c70003530 con 0x7f4c84154d00 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8414d810 msgr2=0x7f4c84157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8414d810 0x7f4c84157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 >> v2:172.21.15.155:3300/0 conn(0x7f4c8406f790 msgr2=0x7f4c8406fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 --2- 172.21.15.87:0/2356718528 >> v2:172.21.15.155:3300/0 conn(0x7f4c8406f790 0x7f4c8406fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c84157010 con 0x7f4c84154d00 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f4c7c001680 con 0x7f4c84154d00 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 >> v1:172.21.15.87:6789/0 conn(0x7f4c84154d00 legacy=0x7f4c84154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c700039c0 0x7f4c70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c70004810 0x7f4c70004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c700051d0 0x7f4c7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4c840add10 con 0x7f4c70004810 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c840adff0 con 0x7f4c700039c0 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7000c180 con 0x7f4c700051d0 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c8259c640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8414d810 0x7f4c84157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c70004810 0x7f4c70004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c82d9d640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c700051d0 0x7f4c7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 -- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c700051d0 msgr2=0x7f4c7000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c700051d0 0x7f4c7000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 -- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c700039c0 msgr2=0x7f4c70003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:03.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c700039c0 0x7f4c70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.642+0000 7f4c81d9b640 1 -- 172.21.15.87:0/2356718528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70003530 con 0x7f4c70004810 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c70004810 0x7f4c70004c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c290 tx=0x7f4c7c01cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3959da8e8ed0d6d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c007d60 con 0x7f4c70004810 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c0a9020 con 0x7f4c70004810 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c8159a640 1 -- 172.21.15.87:0/2356718528 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c005b00 con 0x7f4c70004810 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c88bda640 1 -- 172.21.15.87:0/2356718528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c70004810 msgr2=0x7f4c70004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c88bda640 1 --2- 172.21.15.87:0/2356718528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c70004810 0x7f4c70004c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c290 tx=0x7f4c7c01cd20 comp rx=0 tx=0).stop 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c82d9d640 1 -- 172.21.15.87:0/2356718528 reap_dead start 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c88bda640 1 -- 172.21.15.87:0/2356718528 shutdown_connections 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c88bda640 1 -- 172.21.15.87:0/2356718528 >> 172.21.15.87:0/2356718528 conn(0x7f4c840c8770 msgr2=0x7f4c840c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c88bda640 1 -- 172.21.15.87:0/2356718528 shutdown_connections 2024-04-25T15:54:03.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.646+0000 7f4c88bda640 1 -- 172.21.15.87:0/2356718528 wait complete. 2024-04-25T15:54:03.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 Processor -- start 2024-04-25T15:54:03.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- start start 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8415a170 0x7f4c84150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 0x7f4c840c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8415aae0 0x7f4c8415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8415e310 con 0x7f4c8415ca70 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8415e190 con 0x7f4c8415a170 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8415e490 con 0x7f4c8415aae0 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 0x7f4c840c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 0x7f4c840c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48926/0 (socket says 172.21.15.87:48926) 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 -- 172.21.15.87:0/298097590 learned_addr learned my addr 172.21.15.87:0/298097590 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c8259c640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8415a170 0x7f4c84150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c82d9d640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8415aae0 0x7f4c8415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 -- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8415aae0 msgr2=0x7f4c8415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8415aae0 0x7f4c8415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 -- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8415a170 msgr2=0x7f4c84150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8415a170 0x7f4c84150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 -- 172.21.15.87:0/298097590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c84151100 con 0x7f4c8415ca70 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c8259c640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8415a170 0x7f4c84150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c81d9b640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 0x7f4c840c7aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0ab040 tx=0x7f4c70005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c001c90 con 0x7f4c8415ca70 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c004ab0 con 0x7f4c8415ca70 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c84150920 con 0x7f4c8415ca70 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0070d0 con 0x7f4c8415ca70 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c840749b0 con 0x7f4c8415ca70 2024-04-25T15:54:03.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.650+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8415a580 con 0x7f4c8415ca70 2024-04-25T15:54:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.654+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4c7c007270 con 0x7f4c8415ca70 2024-04-25T15:54:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.654+0000 7f4c7affd640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c6406f430 0x7f4c64071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.654+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4c7c12ad40 con 0x7f4c8415ca70 2024-04-25T15:54:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.654+0000 7f4c8259c640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c6406f430 0x7f4c64071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:03.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.654+0000 7f4c8259c640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c6406f430 0x7f4c64071940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c84068e20 tx=0x7f4c6c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:03.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.658+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c7c0c6070 con 0x7f4c8415ca70 2024-04-25T15:54:03.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.838+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c84069bb0 con 0x7f4c8415ca70 2024-04-25T15:54:03.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.838+0000 7f4c7affd640 1 -- 172.21.15.87:0/298097590 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f4c84151100 con 0x7f4c8415ca70 2024-04-25T15:54:03.839 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:03.839 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T15:54:03.839 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c6406f430 msgr2=0x7f4c64071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c6406f430 0x7f4c64071940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c84068e20 tx=0x7f4c6c00b040 comp rx=0 tx=0).stop 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 msgr2=0x7f4c840c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 0x7f4c840c7aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0ab040 tx=0x7f4c70005840 comp rx=0 tx=0).stop 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 shutdown_connections 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c6406f430 0x7f4c64071940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c8415aae0 0x7f4c8415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c8415ca70 0x7f4c840c7aa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 --2- 172.21.15.87:0/298097590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c8415a170 0x7f4c84150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 >> 172.21.15.87:0/298097590 conn(0x7f4c840c8770 msgr2=0x7f4c84151880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 shutdown_connections 2024-04-25T15:54:03.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:03.842+0000 7f4c88bda640 1 -- 172.21.15.87:0/298097590 wait complete. 2024-04-25T15:54:05.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 Processor -- start 2024-04-25T15:54:06.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 -- start start 2024-04-25T15:54:06.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feeac155320 0x7feeac155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeac152d90 con 0x7feeac152980 2024-04-25T15:54:06.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7feeac0aa290 con 0x7feeac155320 2024-04-25T15:54:06.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeb0894640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feeac1598b0 con 0x7feeac074160 2024-04-25T15:54:06.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feea9d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feeac155320 0x7feeac155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feea9d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feeac155320 0x7feeac155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:43202/0 (socket says 172.21.15.87:43202) 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feea9d9b640 1 -- 172.21.15.87:0/1098077298 learned_addr learned my addr 172.21.15.87:0/1098077298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.013+0000 7feeaad9d640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea9d9b640 1 -- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 msgr2=0x7feeac074570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea9d9b640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac074570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea9d9b640 1 -- 172.21.15.87:0/1098077298 >> v1:172.21.15.155:6789/0 conn(0x7feeac152980 legacy=0x7feeac0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea9d9b640 1 -- 172.21.15.87:0/1098077298 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac0a9cd0 con 0x7feeac155320 2024-04-25T15:54:06.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeaad9d640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:06.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea9d9b640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac155320 0x7feeac155730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee94009870 tx=0x7fee9401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50746902d397037 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea959a640 1 -- 172.21.15.87:0/1098077298 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee940b1070 con 0x7feeac155320 2024-04-25T15:54:06.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea959a640 1 -- 172.21.15.87:0/1098077298 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee940ac620 con 0x7feeac155320 2024-04-25T15:54:06.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feea959a640 1 -- 172.21.15.87:0/1098077298 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee940ac9f0 con 0x7feeac155320 2024-04-25T15:54:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 -- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac155320 msgr2=0x7feeac155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac155320 0x7feeac155730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee94009870 tx=0x7fee9401c4d0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 -- 172.21.15.87:0/1098077298 shutdown_connections 2024-04-25T15:54:06.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 --2- 172.21.15.87:0/1098077298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac155320 0x7feeac155730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 -- 172.21.15.87:0/1098077298 >> 172.21.15.87:0/1098077298 conn(0x7feeac0ac550 msgr2=0x7feeac0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 -- 172.21.15.87:0/1098077298 shutdown_connections 2024-04-25T15:54:06.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.017+0000 7feeb0894640 1 -- 172.21.15.87:0/1098077298 wait complete. 2024-04-25T15:54:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 Processor -- start 2024-04-25T15:54:06.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 -- start start 2024-04-25T15:54:06.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac0c0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac152980 0x7feeac0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 0x7feeac1f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feeac0729c0 con 0x7feeac155320 2024-04-25T15:54:06.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feeac158f70 con 0x7feeac152980 2024-04-25T15:54:06.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeb0894640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feeac072b40 con 0x7feeac074160 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 0x7feeac1f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 0x7feeac1f1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48938/0 (socket says 172.21.15.87:48938) 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 -- 172.21.15.87:0/3813892782 learned_addr learned my addr 172.21.15.87:0/3813892782 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feea9d9b640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac152980 0x7feeac0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaa59c640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac0c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 -- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 msgr2=0x7feeac0c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac0c0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 -- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac152980 msgr2=0x7feeac0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac152980 0x7feeac0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaad9d640 1 -- 172.21.15.87:0/3813892782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac0abef0 con 0x7feeac155320 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.021+0000 7feeaa59c640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac0c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feeaad9d640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 0x7feeac1f1a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e8a0 tx=0x7fee9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c017070 con 0x7feeac155320 2024-04-25T15:54:06.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c004020 con 0x7feeac155320 2024-04-25T15:54:06.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac0ac1d0 con 0x7feeac155320 2024-04-25T15:54:06.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c004430 con 0x7feeac155320 2024-04-25T15:54:06.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac1eef00 con 0x7feeac155320 2024-04-25T15:54:06.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac069bb0 con 0x7feeac155320 2024-04-25T15:54:06.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee9c00c8e0 con 0x7feeac155320 2024-04-25T15:54:06.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feea2ffd640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fee8c06f430 0x7fee8c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feeaa59c640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fee8c06f430 0x7fee8c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fee9c08eeb0 con 0x7feeac155320 2024-04-25T15:54:06.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.025+0000 7feeaa59c640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fee8c06f430 0x7fee8c071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feea4007fd0 tx=0x7feea4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.029+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee9c05c210 con 0x7feeac155320 2024-04-25T15:54:06.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.221+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feeac144480 con 0x7feeac155320 2024-04-25T15:54:06.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.221+0000 7feea2ffd640 1 -- 172.21.15.87:0/3813892782 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7fee9c064030 con 0x7feeac155320 2024-04-25T15:54:06.224 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:06.224 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T15:54:06.224 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fee8c06f430 msgr2=0x7fee8c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fee8c06f430 0x7fee8c071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feea4007fd0 tx=0x7feea4009040 comp rx=0 tx=0).stop 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 msgr2=0x7feeac1f1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 0x7feeac1f1a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00e8a0 tx=0x7fee9c00ed60 comp rx=0 tx=0).stop 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 shutdown_connections 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fee8c06f430 0x7fee8c071940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feeac155320 0x7feeac1f1a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeac152980 0x7feeac0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 --2- 172.21.15.87:0/3813892782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feeac074160 0x7feeac0c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 >> 172.21.15.87:0/3813892782 conn(0x7feeac0ac550 msgr2=0x7feeac155730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 shutdown_connections 2024-04-25T15:54:06.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.225+0000 7feeb0894640 1 -- 172.21.15.87:0/3813892782 wait complete. 2024-04-25T15:54:06.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.389+0000 7fc9631bf640 1 Processor -- start 2024-04-25T15:54:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.389+0000 7fc9631bf640 1 -- start start 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc9631bf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc95c071e50 0x7fc95c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc9631bf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c072430 con 0x7fc95c0c4720 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc9631bf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c074730 con 0x7fc95c1529a0 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc9631bf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc95c074a10 con 0x7fc95c071e50 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc95bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc95c071e50 0x7fc95c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc96175c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc95c0c4720 0x7fc95c15fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60620/0 (socket says 172.21.15.87:60620) 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc95bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc95c071e50 0x7fc95c0c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48954/0 (socket says 172.21.15.87:48954) 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc96175c640 1 -- 172.21.15.87:0/2917420246 learned_addr learned my addr 172.21.15.87:0/2917420246 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc95bfff640 1 -- 172.21.15.87:0/2917420246 >> v1:172.21.15.155:6789/0 conn(0x7fc95c1529a0 legacy=0x7fc95c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc95bfff640 1 -- 172.21.15.87:0/2917420246 >> v1:172.21.15.87:6789/0 conn(0x7fc95c0c4720 legacy=0x7fc95c15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.393+0000 7fc95bfff640 1 -- 172.21.15.87:0/2917420246 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c074cf0 con 0x7fc95c071e50 2024-04-25T15:54:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc95bfff640 1 --2- 172.21.15.87:0/2917420246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c071e50 0x7fc95c0c41e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc944009d90 tx=0x7fc94401c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4394f5d3c2db958e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc95b7fe640 1 -- 172.21.15.87:0/2917420246 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9440b2070 con 0x7fc95c071e50 2024-04-25T15:54:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc95b7fe640 1 -- 172.21.15.87:0/2917420246 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9440a57d0 con 0x7fc95c071e50 2024-04-25T15:54:06.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc95b7fe640 1 -- 172.21.15.87:0/2917420246 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9440a5ba0 con 0x7fc95c071e50 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 -- 172.21.15.87:0/2917420246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c071e50 msgr2=0x7fc95c0c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 --2- 172.21.15.87:0/2917420246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c071e50 0x7fc95c0c41e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc944009d90 tx=0x7fc94401c770 comp rx=0 tx=0).stop 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 -- 172.21.15.87:0/2917420246 shutdown_connections 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 --2- 172.21.15.87:0/2917420246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c071e50 0x7fc95c0c41e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 -- 172.21.15.87:0/2917420246 >> 172.21.15.87:0/2917420246 conn(0x7fc95c0c8770 msgr2=0x7fc95c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 -- 172.21.15.87:0/2917420246 shutdown_connections 2024-04-25T15:54:06.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 -- 172.21.15.87:0/2917420246 wait complete. 2024-04-25T15:54:06.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 Processor -- start 2024-04-25T15:54:06.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.397+0000 7fc9631bf640 1 -- start start 2024-04-25T15:54:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95c071e50 0x7fc95c1eb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc95c0c4720 0x7fc95c1e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 0x7fc95c155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c0ae0a0 con 0x7fc95c1529a0 2024-04-25T15:54:06.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c0ab1a0 con 0x7fc95c071e50 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc95c0ae220 con 0x7fc95c0c4720 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 0x7fc95c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 0x7fc95c155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48966/0 (socket says 172.21.15.87:48966) 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 -- 172.21.15.87:0/1959150451 learned_addr learned my addr 172.21.15.87:0/1959150451 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc960f5b640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95c071e50 0x7fc95c1eb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 -- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc95c0c4720 msgr2=0x7fc95c1e07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc95bfff640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc95c0c4720 0x7fc95c1e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc95c0c4720 0x7fc95c1e07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 -- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95c071e50 msgr2=0x7fc95c1eb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95c071e50 0x7fc95c1eb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 -- 172.21.15.87:0/1959150451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c1ec3a0 con 0x7fc95c1529a0 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc960f5b640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95c071e50 0x7fc95c1eb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:06.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc96175c640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 0x7fc95c155830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc954009da0 tx=0x7fc95400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954019070 con 0x7fc95c1529a0 2024-04-25T15:54:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9540078f0 con 0x7fc95c1529a0 2024-04-25T15:54:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c153c40 con 0x7fc95c1529a0 2024-04-25T15:54:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954007d20 con 0x7fc95c1529a0 2024-04-25T15:54:06.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1e02b0 con 0x7fc95c1529a0 2024-04-25T15:54:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c153a30 con 0x7fc95c1529a0 2024-04-25T15:54:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc95401c070 con 0x7fc95c1529a0 2024-04-25T15:54:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9597fa640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc93c06f400 0x7fc93c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc960f5b640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc93c06f400 0x7fc93c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.401+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc954090b20 con 0x7fc95c1529a0 2024-04-25T15:54:06.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.405+0000 7fc960f5b640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc93c06f400 0x7fc93c071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc94c000f70 tx=0x7fc94c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.409+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc95405de80 con 0x7fc95c1529a0 2024-04-25T15:54:06.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.569+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc95c0c3760 con 0x7fc95c1529a0 2024-04-25T15:54:06.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.569+0000 7fc9597fa640 1 -- 172.21.15.87:0/1959150451 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fc954064e20 con 0x7fc95c1529a0 2024-04-25T15:54:06.572 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:06.572 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":16,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:53:59.402404+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc93c06f400 msgr2=0x7fc93c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc93c06f400 0x7fc93c071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc94c000f70 tx=0x7fc94c009040 comp rx=0 tx=0).stop 2024-04-25T15:54:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 msgr2=0x7fc95c155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 0x7fc95c155830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc954009da0 tx=0x7fc95400c430 comp rx=0 tx=0).stop 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 shutdown_connections 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc93c06f400 0x7fc93c071910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc95c1529a0 0x7fc95c155830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc95c0c4720 0x7fc95c1e07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 --2- 172.21.15.87:0/1959150451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc95c071e50 0x7fc95c1eb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 >> 172.21.15.87:0/1959150451 conn(0x7fc95c0c8770 msgr2=0x7fc95c150260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 shutdown_connections 2024-04-25T15:54:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.573+0000 7fc9631bf640 1 -- 172.21.15.87:0/1959150451 wait complete. 2024-04-25T15:54:06.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:06.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:06.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 Processor -- start 2024-04-25T15:54:06.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 -- start start 2024-04-25T15:54:06.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2200c4250 0x7fa22006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa220070490 0x7fa22015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2200c5120 con 0x7fa22015b170 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa2200c3b20 con 0x7fa2200c4250 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa225223640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa220070e20 con 0x7fa220070490 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2200c4250 0x7fa22006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2200c4250 0x7fa22006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48978/0 (socket says 172.21.15.87:48978) 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 -- 172.21.15.87:0/4236822185 learned_addr learned my addr 172.21.15.87:0/4236822185 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa217fff640 1 --2- 172.21.15.87:0/4236822185 >> v2:172.21.15.155:3300/0 conn(0x7fa220070490 0x7fa22015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 -- 172.21.15.87:0/4236822185 >> v2:172.21.15.155:3300/0 conn(0x7fa220070490 msgr2=0x7fa22015ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 --2- 172.21.15.87:0/4236822185 >> v2:172.21.15.155:3300/0 conn(0x7fa220070490 0x7fa22015ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 -- 172.21.15.87:0/4236822185 >> v1:172.21.15.155:6789/0 conn(0x7fa22015b170 legacy=0x7fa2200c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:06.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.745+0000 7fa21ed9d640 1 -- 172.21.15.87:0/4236822185 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2200c4b60 con 0x7fa2200c4250 2024-04-25T15:54:06.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa21ed9d640 1 --2- 172.21.15.87:0/4236822185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2200c4250 0x7fa22006ff50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2200c5d30 tx=0x7fa21001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa421db90c54fe4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa21e59c640 1 -- 172.21.15.87:0/4236822185 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b0070 con 0x7fa2200c4250 2024-04-25T15:54:06.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa21e59c640 1 -- 172.21.15.87:0/4236822185 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2100ab600 con 0x7fa2200c4250 2024-04-25T15:54:06.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa21e59c640 1 -- 172.21.15.87:0/4236822185 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100ab9d0 con 0x7fa2200c4250 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 -- 172.21.15.87:0/4236822185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2200c4250 msgr2=0x7fa22006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 --2- 172.21.15.87:0/4236822185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2200c4250 0x7fa22006ff50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2200c5d30 tx=0x7fa21001c240 comp rx=0 tx=0).stop 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 -- 172.21.15.87:0/4236822185 shutdown_connections 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 --2- 172.21.15.87:0/4236822185 >> v2:172.21.15.155:3300/0 conn(0x7fa220070490 0x7fa22015ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 --2- 172.21.15.87:0/4236822185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2200c4250 0x7fa22006ff50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 -- 172.21.15.87:0/4236822185 >> 172.21.15.87:0/4236822185 conn(0x7fa22006d780 msgr2=0x7fa22006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 -- 172.21.15.87:0/4236822185 shutdown_connections 2024-04-25T15:54:06.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 -- 172.21.15.87:0/4236822185 wait complete. 2024-04-25T15:54:06.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 Processor -- start 2024-04-25T15:54:06.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.749+0000 7fa225223640 1 -- start start 2024-04-25T15:54:06.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 0x7fa2200c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200c4250 0x7fa2201f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22015b170 0x7fa22014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa220155280 con 0x7fa220070490 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa220155100 con 0x7fa22015b170 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa220164e80 con 0x7fa2200c4250 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 0x7fa2200c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 0x7fa2200c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48984/0 (socket says 172.21.15.87:48984) 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 -- 172.21.15.87:0/2437709837 learned_addr learned my addr 172.21.15.87:0/2437709837 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21f59e640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22015b170 0x7fa22014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa217fff640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200c4250 0x7fa2201f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 -- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200c4250 msgr2=0x7fa2201f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200c4250 0x7fa2201f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 -- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22015b170 msgr2=0x7fa22014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22015b170 0x7fa22014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 -- 172.21.15.87:0/2437709837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22015c590 con 0x7fa220070490 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa21ed9d640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 0x7fa2200c9130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa2100ae040 tx=0x7fa21001aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100ba020 con 0x7fa220070490 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2100b6640 con 0x7fa220070490 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2201574b0 con 0x7fa220070490 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b0040 con 0x7fa220070490 2024-04-25T15:54:06.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa220157770 con 0x7fa220070490 2024-04-25T15:54:06.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa220069bb0 con 0x7fa220070490 2024-04-25T15:54:06.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa2100bd020 con 0x7fa220070490 2024-04-25T15:54:06.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa2177fe640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa20006f430 0x7fa200071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:06.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa210128ea0 con 0x7fa220070490 2024-04-25T15:54:06.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.753+0000 7fa217fff640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa20006f430 0x7fa200071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:06.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.757+0000 7fa217fff640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa20006f430 0x7fa200071940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa220152fc0 tx=0x7fa208008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:06.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.761+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2100c4030 con 0x7fa220070490 2024-04-25T15:54:06.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.917+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2201f1100 con 0x7fa220070490 2024-04-25T15:54:06.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.917+0000 7fa2177fe640 1 -- 172.21.15.87:0/2437709837 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa2200c5120 con 0x7fa220070490 2024-04-25T15:54:06.918 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa20006f430 msgr2=0x7fa200071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa20006f430 0x7fa200071940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa220152fc0 tx=0x7fa208008040 comp rx=0 tx=0).stop 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 msgr2=0x7fa2200c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 0x7fa2200c9130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa2100ae040 tx=0x7fa21001aa80 comp rx=0 tx=0).stop 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 shutdown_connections 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa20006f430 0x7fa200071940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22015b170 0x7fa22014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2200c4250 0x7fa2201f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 --2- 172.21.15.87:0/2437709837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa220070490 0x7fa2200c9130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:06.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 >> 172.21.15.87:0/2437709837 conn(0x7fa22006d780 msgr2=0x7fa220153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:06.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 shutdown_connections 2024-04-25T15:54:06.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:06.921+0000 7fa225223640 1 -- 172.21.15.87:0/2437709837 wait complete. 2024-04-25T15:54:06.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:54:07.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ce69e640 1 Processor -- start 2024-04-25T15:54:07.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ce69e640 1 -- start start 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ce69e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6c80ac1c0 0x7fb6c815f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ce69e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c8154fc0 con 0x7fb6c80ad160 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ce69e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c80acb20 con 0x7fb6c81518b0 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ce69e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c806ed60 con 0x7fb6c80ac1c0 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ccc3b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6c80ac1c0 0x7fb6c815f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6c77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb6c80ad160 0x7fb6c80c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60624/0 (socket says 172.21.15.87:60624) 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6c77fe640 1 -- 172.21.15.87:0/717886307 learned_addr learned my addr 172.21.15.87:0/717886307 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ccc3b640 1 -- 172.21.15.87:0/717886307 >> v1:172.21.15.155:6789/0 conn(0x7fb6c81518b0 legacy=0x7fb6c806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ccc3b640 1 -- 172.21.15.87:0/717886307 >> v1:172.21.15.87:6789/0 conn(0x7fb6c80ad160 legacy=0x7fb6c80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.073+0000 7fb6ccc3b640 1 -- 172.21.15.87:0/717886307 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c80ace00 con 0x7fb6c80ac1c0 2024-04-25T15:54:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ccc3b640 1 --2- 172.21.15.87:0/717886307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c815f9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb6c806eee0 tx=0x7fb6b801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd17a85dc42ba2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6c6ffd640 1 -- 172.21.15.87:0/717886307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80b4070 con 0x7fb6c80ac1c0 2024-04-25T15:54:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6c6ffd640 1 -- 172.21.15.87:0/717886307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b80a7a60 con 0x7fb6c80ac1c0 2024-04-25T15:54:07.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6c6ffd640 1 -- 172.21.15.87:0/717886307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80a7e30 con 0x7fb6c80ac1c0 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 -- 172.21.15.87:0/717886307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ac1c0 msgr2=0x7fb6c815f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/717886307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c815f9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb6c806eee0 tx=0x7fb6b801eb60 comp rx=0 tx=0).stop 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 -- 172.21.15.87:0/717886307 shutdown_connections 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/717886307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c815f9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 -- 172.21.15.87:0/717886307 >> 172.21.15.87:0/717886307 conn(0x7fb6c80c8770 msgr2=0x7fb6c80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 -- 172.21.15.87:0/717886307 shutdown_connections 2024-04-25T15:54:07.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.077+0000 7fb6ce69e640 1 -- 172.21.15.87:0/717886307 wait complete. 2024-04-25T15:54:07.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 Processor -- start 2024-04-25T15:54:07.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- start start 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c814ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 0x7fb6c8142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c81518b0 0x7fb6c81f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8071fd0 con 0x7fb6c80ad160 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8071e50 con 0x7fb6c80ac1c0 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c80c37b0 con 0x7fb6c81518b0 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 0x7fb6c8142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 0x7fb6c8142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49008/0 (socket says 172.21.15.87:49008) 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 -- 172.21.15.87:0/3841691260 learned_addr learned my addr 172.21.15.87:0/3841691260 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c7fff640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c814ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ccc3b640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c81518b0 0x7fb6c81f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 -- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c81518b0 msgr2=0x7fb6c81f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c81518b0 0x7fb6c81f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 -- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c80ac1c0 msgr2=0x7fb6c814ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c814ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 -- 172.21.15.87:0/3841691260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c814a2a0 con 0x7fb6c80ad160 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ccc3b640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c81518b0 0x7fb6c81f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c77fe640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 0x7fb6c8142780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c430 tx=0x7fb6b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0017070 con 0x7fb6c80ad160 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b0005cf0 con 0x7fb6c80ad160 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c8143710 con 0x7fb6c80ad160 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00072d0 con 0x7fb6c80ad160 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c814a820 con 0x7fb6c80ad160 2024-04-25T15:54:07.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c8069bb0 con 0x7fb6c80ad160 2024-04-25T15:54:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.081+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb6b001a070 con 0x7fb6c80ad160 2024-04-25T15:54:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.085+0000 7fb6c4ff9640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb6a806f430 0x7fb6a8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.085+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb6b008e240 con 0x7fb6c80ad160 2024-04-25T15:54:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.085+0000 7fb6c7fff640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb6a806f430 0x7fb6a8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.085+0000 7fb6c7fff640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb6a806f430 0x7fb6a8071940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0000f70 tx=0x7fb6c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:07.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.089+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6b005ae30 con 0x7fb6c80ad160 2024-04-25T15:54:07.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.241+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb6c80abfa0 con 0x7fb6c80ad160 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.241+0000 7fb6c4ff9640 1 -- 172.21.15.87:0/3841691260 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fb6b005f130 con 0x7fb6c80ad160 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-04-25T15:54:07.243 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-25T15:54:07.244 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-04-25T15:54:07.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb6a806f430 msgr2=0x7fb6a8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb6a806f430 0x7fb6a8071940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0000f70 tx=0x7fb6c0009040 comp rx=0 tx=0).stop 2024-04-25T15:54:07.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 msgr2=0x7fb6c8142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 0x7fb6c8142780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c430 tx=0x7fb6b000c8f0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 shutdown_connections 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb6a806f430 0x7fb6a8071940 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c81518b0 0x7fb6c81f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6c80ad160 0x7fb6c8142780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 --2- 172.21.15.87:0/3841691260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c80ac1c0 0x7fb6c814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 >> 172.21.15.87:0/3841691260 conn(0x7fb6c80c8770 msgr2=0x7fb6c806f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 shutdown_connections 2024-04-25T15:54:07.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.245+0000 7fb6ce69e640 1 -- 172.21.15.87:0/3841691260 wait complete. 2024-04-25T15:54:07.262 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-04-25T15:54:07.263 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-04-25T15:54:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.413+0000 7f9f40f2d640 1 Processor -- start 2024-04-25T15:54:07.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.413+0000 7f9f40f2d640 1 -- start start 2024-04-25T15:54:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f40f2d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9f3c0c48f0 0x7f9f3c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f40f2d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c072430 con 0x7f9f3c1529a0 2024-04-25T15:54:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f40f2d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c074730 con 0x7f9f3c071e50 2024-04-25T15:54:07.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f40f2d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9f3c074a10 con 0x7f9f3c0c48f0 2024-04-25T15:54:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3a59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9f3c1529a0 0x7f9f3c0ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60638/0 (socket says 172.21.15.87:60638) 2024-04-25T15:54:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9f3c0c48f0 0x7f9f3c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3a59c640 1 -- 172.21.15.87:0/1950634901 learned_addr learned my addr 172.21.15.87:0/1950634901 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1950634901 >> v1:172.21.15.155:6789/0 conn(0x7f9f3c071e50 legacy=0x7f9f3c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1950634901 >> v1:172.21.15.87:6789/0 conn(0x7f9f3c1529a0 legacy=0x7f9f3c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1950634901 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c074cf0 con 0x7f9f3c0c48f0 2024-04-25T15:54:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3ad9d640 1 --2- 172.21.15.87:0/1950634901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c160ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009d90 tx=0x7f9f3401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d4d694ad5761e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3959a640 1 -- 172.21.15.87:0/1950634901 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340b2070 con 0x7f9f3c0c48f0 2024-04-25T15:54:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3959a640 1 -- 172.21.15.87:0/1950634901 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f340a5760 con 0x7f9f3c0c48f0 2024-04-25T15:54:07.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.417+0000 7f9f3959a640 1 -- 172.21.15.87:0/1950634901 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340a5b30 con 0x7f9f3c0c48f0 2024-04-25T15:54:07.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1950634901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c0c48f0 msgr2=0x7f9f3c160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1950634901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c160ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009d90 tx=0x7f9f3401c8a0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1950634901 shutdown_connections 2024-04-25T15:54:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1950634901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c160ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1950634901 >> 172.21.15.87:0/1950634901 conn(0x7f9f3c0c8770 msgr2=0x7f9f3c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1950634901 shutdown_connections 2024-04-25T15:54:07.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1950634901 wait complete. 2024-04-25T15:54:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 Processor -- start 2024-04-25T15:54:07.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- start start 2024-04-25T15:54:07.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f3c071e50 0x7f9f3c1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c1efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 0x7f9f3c145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0c4d00 con 0x7f9f3c1529a0 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c163840 con 0x7f9f3c0c48f0 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f40f2d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c1f0870 con 0x7f9f3c071e50 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 0x7f9f3c145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f3ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 0x7f9f3c145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49024/0 (socket says 172.21.15.87:49024) 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1360436295 learned_addr learned my addr 172.21.15.87:0/1360436295 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f39d9b640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c1efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.421+0000 7f9f3a59c640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f3c071e50 0x7f9f3c1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f3c071e50 msgr2=0x7f9f3c1f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3ad9d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f3c071e50 0x7f9f3c1f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c0c48f0 msgr2=0x7f9f3c1efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3ad9d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c1efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3ad9d640 1 -- 172.21.15.87:0/1360436295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c0c7720 con 0x7f9f3c1529a0 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3ad9d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 0x7f9f3c145b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f3401a4d0 tx=0x7f9f34019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340bd020 con 0x7f9f3c1529a0 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f340b8470 con 0x7f9f3c1529a0 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c142cb0 con 0x7f9f3c1529a0 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340b2040 con 0x7f9f3c1529a0 2024-04-25T15:54:07.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c0c79e0 con 0x7f9f3c1529a0 2024-04-25T15:54:07.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c069bb0 con 0x7f9f3c1529a0 2024-04-25T15:54:07.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f340c0020 con 0x7f9f3c1529a0 2024-04-25T15:54:07.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f2affd640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f1c06f430 0x7f9f1c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:07.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9f3412a140 con 0x7f9f3c1529a0 2024-04-25T15:54:07.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3a59c640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f1c06f430 0x7f9f1c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:07.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.425+0000 7f9f3a59c640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f1c06f430 0x7f9f1c071940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c000f70 tx=0x7f9f2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:07.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.429+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f340c8020 con 0x7f9f3c1529a0 2024-04-25T15:54:07.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:07.577+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7f9f3c0c3760 con 0x7f9f3c1529a0 2024-04-25T15:54:08.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:08.117 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:08.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.169+0000 7f9f2affd640 1 -- 172.21.15.87:0/1360436295 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v17) ==== 128+0+0 (secure 0 0 0) 0x7f9f34016520 con 0x7f9f3c1529a0 2024-04-25T15:54:08.170 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'a_metadata' created 2024-04-25T15:54:08.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f1c06f430 msgr2=0x7f9f1c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f1c06f430 0x7f9f1c071940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c000f70 tx=0x7f9f2c009040 comp rx=0 tx=0).stop 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 msgr2=0x7f9f3c145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 0x7f9f3c145b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f3401a4d0 tx=0x7f9f34019640 comp rx=0 tx=0).stop 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 shutdown_connections 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f1c06f430 0x7f9f1c071940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f3c1529a0 0x7f9f3c145b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c0c48f0 0x7f9f3c1efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 --2- 172.21.15.87:0/1360436295 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f3c071e50 0x7f9f3c1f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 >> 172.21.15.87:0/1360436295 conn(0x7f9f3c0c8770 msgr2=0x7f9f3c0c2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 shutdown_connections 2024-04-25T15:54:08.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.173+0000 7f9f40f2d640 1 -- 172.21.15.87:0/1360436295 wait complete. 2024-04-25T15:54:08.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:54:08.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 Processor -- start 2024-04-25T15:54:08.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 -- start start 2024-04-25T15:54:08.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb63414adf0 0x7fb6340c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb63406d780 0x7fb63406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6341548f0 0x7fb634154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb634154460 con 0x7fb63414adf0 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb634155240 con 0x7fb63406d780 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.385+0000 7fb63c275640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340c44f0 con 0x7fb6341548f0 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb63414adf0 0x7fb6340c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb63414adf0 0x7fb6340c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49032/0 (socket says 172.21.15.87:49032) 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 -- 172.21.15.87:0/1694161111 learned_addr learned my addr 172.21.15.87:0/1694161111 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a812640 1 --2- 172.21.15.87:0/1694161111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6341548f0 0x7fb634154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb639810640 1 --2- 172.21.15.87:0/1694161111 >> v2:172.21.15.155:3300/0 conn(0x7fb63406d780 0x7fb63406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 -- 172.21.15.87:0/1694161111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6341548f0 msgr2=0x7fb634154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 --2- 172.21.15.87:0/1694161111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6341548f0 0x7fb634154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 -- 172.21.15.87:0/1694161111 >> v2:172.21.15.155:3300/0 conn(0x7fb63406d780 msgr2=0x7fb63406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 --2- 172.21.15.87:0/1694161111 >> v2:172.21.15.155:3300/0 conn(0x7fb63406d780 0x7fb63406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 -- 172.21.15.87:0/1694161111 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6340bead0 con 0x7fb63414adf0 2024-04-25T15:54:08.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63a011640 1 --2- 172.21.15.87:0/1694161111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6340c3fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb634071680 tx=0x7fb63001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cd14512cafa213 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:08.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63900f640 1 -- 172.21.15.87:0/1694161111 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300a5670 con 0x7fb63414adf0 2024-04-25T15:54:08.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63900f640 1 -- 172.21.15.87:0/1694161111 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6300a5810 con 0x7fb63414adf0 2024-04-25T15:54:08.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63900f640 1 -- 172.21.15.87:0/1694161111 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6300a5be0 con 0x7fb63414adf0 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 -- 172.21.15.87:0/1694161111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 msgr2=0x7fb6340c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 --2- 172.21.15.87:0/1694161111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6340c3fb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb634071680 tx=0x7fb63001c9f0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 -- 172.21.15.87:0/1694161111 shutdown_connections 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 --2- 172.21.15.87:0/1694161111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6341548f0 0x7fb634154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 --2- 172.21.15.87:0/1694161111 >> v2:172.21.15.155:3300/0 conn(0x7fb63406d780 0x7fb63406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 --2- 172.21.15.87:0/1694161111 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6340c3fb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.389+0000 7fb63c275640 1 -- 172.21.15.87:0/1694161111 >> 172.21.15.87:0/1694161111 conn(0x7fb6340abf80 msgr2=0x7fb6340c60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 -- 172.21.15.87:0/1694161111 shutdown_connections 2024-04-25T15:54:08.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 -- 172.21.15.87:0/1694161111 wait complete. 2024-04-25T15:54:08.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 Processor -- start 2024-04-25T15:54:08.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 -- start start 2024-04-25T15:54:08.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb63406d780 0x7fb6340ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6341567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6341548f0 0x7fb6340c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb63406fff0 con 0x7fb63414adf0 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb63406fe70 con 0x7fb6341548f0 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb63c275640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6341580c0 con 0x7fb63406d780 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb639810640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6341567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb639810640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6341567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49036/0 (socket says 172.21.15.87:49036) 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.393+0000 7fb639810640 1 -- 172.21.15.87:0/1848198495 learned_addr learned my addr 172.21.15.87:0/1848198495 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63a011640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb63406d780 0x7fb6340ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63a812640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6341548f0 0x7fb6340c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb639810640 1 -- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb63406d780 msgr2=0x7fb6340ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:08.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb639810640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb63406d780 0x7fb6340ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb639810640 1 -- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6341548f0 msgr2=0x7fb6340c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb639810640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6341548f0 0x7fb6340c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb639810640 1 -- 172.21.15.87:0/1848198495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6341ed3a0 con 0x7fb63414adf0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63a011640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb63406d780 0x7fb6340ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63a812640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6341548f0 0x7fb6340c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb639810640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6341567f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb62400d800 tx=0x7fb62400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624018030 con 0x7fb63414adf0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6240096a0 con 0x7fb63414adf0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624009870 con 0x7fb63414adf0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6341ed680 con 0x7fb63414adf0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6341edc40 con 0x7fb63414adf0 2024-04-25T15:54:08.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb63406a8a0 con 0x7fb63414adf0 2024-04-25T15:54:08.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb62401b070 con 0x7fb63414adf0 2024-04-25T15:54:08.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb62affd640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb61806f430 0x7fb618071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:08.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63a011640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb61806f430 0x7fb618071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:08.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5222+0+0 (secure 0 0 0) 0x7fb62408f3a0 con 0x7fb63414adf0 2024-04-25T15:54:08.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.397+0000 7fb63a011640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb61806f430 0x7fb618071940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6300ae000 tx=0x7fb6300a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:08.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.401+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb62405c470 con 0x7fb63414adf0 2024-04-25T15:54:08.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:08.565+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb6340716b0 con 0x7fb63414adf0 2024-04-25T15:54:09.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.173+0000 7fb62affd640 1 -- 172.21.15.87:0/1848198495 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v18) ==== 160+0+0 (secure 0 0 0) 0x7fb62405bd70 con 0x7fb63414adf0 2024-04-25T15:54:09.175 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'a_data' created 2024-04-25T15:54:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb61806f430 msgr2=0x7fb618071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb61806f430 0x7fb618071940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6300ae000 tx=0x7fb6300a7070 comp rx=0 tx=0).stop 2024-04-25T15:54:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 msgr2=0x7fb6341567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6341567f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb62400d800 tx=0x7fb62400dcc0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 shutdown_connections 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb61806f430 0x7fb618071940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6341548f0 0x7fb6340c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb63414adf0 0x7fb6341567f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 --2- 172.21.15.87:0/1848198495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb63406d780 0x7fb6340ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 >> 172.21.15.87:0/1848198495 conn(0x7fb6340abf80 msgr2=0x7fb63415e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 shutdown_connections 2024-04-25T15:54:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.177+0000 7fb63c275640 1 -- 172.21.15.87:0/1848198495 wait complete. 2024-04-25T15:54:09.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-04-25T15:54:09.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.361+0000 7fe2af1dd640 1 Processor -- start 2024-04-25T15:54:09.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2af1dd640 1 -- start start 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2af1dd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 0x7fe2a8160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2af1dd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a8072430 con 0x7fe2a81529a0 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2af1dd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a8074730 con 0x7fe2a8071e50 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2af1dd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a8074a10 con 0x7fe2a80c48f0 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe2a81529a0 0x7fe2a80ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60652/0 (socket says 172.21.15.87:60652) 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 -- 172.21.15.87:0/954482101 learned_addr learned my addr 172.21.15.87:0/954482101 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2ad77a640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 0x7fe2a8160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061533726 0 0) 0x7fe2a8072430 con 0x7fe2a81529a0 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe290003530 con 0x7fe2a81529a0 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2064725990 0 0) 0x7fe290003530 con 0x7fe2a81529a0 2024-04-25T15:54:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 msgr2=0x7fe2a8160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 0x7fe2a8160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 >> v1:172.21.15.155:6789/0 conn(0x7fe2a8071e50 legacy=0x7fe2a80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a8074cf0 con 0x7fe2a81529a0 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fe2a4001680 con 0x7fe2a81529a0 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 >> v1:172.21.15.87:6789/0 conn(0x7fe2a81529a0 legacy=0x7fe2a80ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2900039f0 0x7fe290003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe290004810 0x7fe290004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 0x7fe29000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8074a10 con 0x7fe2900039f0 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe290005490 con 0x7fe290004810 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe290005690 con 0x7fe2a80c48f0 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2900039f0 0x7fe290003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29ffff640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe290004810 0x7fe290004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 -- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 msgr2=0x7fe29000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a80c48f0 0x7fe29000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 -- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe290004810 msgr2=0x7fe290004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe290004810 0x7fe290004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe2acf79640 1 -- 172.21.15.87:0/954482101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe290003530 con 0x7fe2900039f0 2024-04-25T15:54:09.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.365+0000 7fe29ffff640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe290004810 0x7fe290004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:09.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2acf79640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2900039f0 0x7fe290003e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c190 tx=0x7fe2a401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99075de101577b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:09.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4007d00 con 0x7fe2900039f0 2024-04-25T15:54:09.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a40a9020 con 0x7fe2900039f0 2024-04-25T15:54:09.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe29f7fe640 1 -- 172.21.15.87:0/954482101 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4005b00 con 0x7fe2900039f0 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2af1dd640 1 -- 172.21.15.87:0/954482101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2900039f0 msgr2=0x7fe290003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/954482101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2900039f0 0x7fe290003e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c190 tx=0x7fe2a401cc40 comp rx=0 tx=0).stop 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2ad77a640 1 -- 172.21.15.87:0/954482101 reap_dead start 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2af1dd640 1 -- 172.21.15.87:0/954482101 shutdown_connections 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2af1dd640 1 -- 172.21.15.87:0/954482101 >> 172.21.15.87:0/954482101 conn(0x7fe2a80c8770 msgr2=0x7fe2a80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2af1dd640 1 -- 172.21.15.87:0/954482101 shutdown_connections 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.369+0000 7fe2af1dd640 1 -- 172.21.15.87:0/954482101 wait complete. 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 Processor -- start 2024-04-25T15:54:09.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 -- start start 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8159aa0 0x7fe2a81f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 0x7fe2a815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a815b980 0x7fe2a814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80c4d00 con 0x7fe2a81f2190 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81612f0 con 0x7fe2a8159aa0 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a81f29c0 con 0x7fe2a815b980 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 0x7fe2a815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 0x7fe2a815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49056/0 (socket says 172.21.15.87:49056) 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 -- 172.21.15.87:0/2456374912 learned_addr learned my addr 172.21.15.87:0/2456374912 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2ad77a640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a815b980 0x7fe2a814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2acf79640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8159aa0 0x7fe2a81f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 -- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a815b980 msgr2=0x7fe2a814b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a815b980 0x7fe2a814b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 -- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8159aa0 msgr2=0x7fe2a81f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8159aa0 0x7fe2a81f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 -- 172.21.15.87:0/2456374912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a81f26e0 con 0x7fe2a81f2190 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29ffff640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 0x7fe2a815cd90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe29800d4d0 tx=0x7fe29800d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298005480 con 0x7fe2a81f2190 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe298017070 con 0x7fe2a81f2190 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298003840 con 0x7fe2a81f2190 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a8158fe0 con 0x7fe2a81f2190 2024-04-25T15:54:09.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.373+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a815d7f0 con 0x7fe2a81f2190 2024-04-25T15:54:09.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.377+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a8069bb0 con 0x7fe2a81f2190 2024-04-25T15:54:09.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.377+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe2980039e0 con 0x7fe2a81f2190 2024-04-25T15:54:09.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.377+0000 7fe29d7fa640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe29406f400 0x7fe294071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:09.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.377+0000 7fe2acf79640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe29406f400 0x7fe294071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:09.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.377+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5599+0+0 (secure 0 0 0) 0x7fe29808f020 con 0x7fe2a81f2190 2024-04-25T15:54:09.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.377+0000 7fe2acf79640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe29406f400 0x7fe294071910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40aa000 tx=0x7fe2a8072600 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:09.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.381+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe29805bf80 con 0x7fe2a81f2190 2024-04-25T15:54:09.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:09.581+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7fe2a80c3760 con 0x7fe2a81f2190 2024-04-25T15:54:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.217+0000 7fe29d7fa640 1 -- 172.21.15.87:0/2456374912 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7fe29805b880 con 0x7fe2a81f2190 2024-04-25T15:54:10.217 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T15:54:10.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.221+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe29406f400 msgr2=0x7fe294071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.221+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe29406f400 0x7fe294071910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40aa000 tx=0x7fe2a8072600 comp rx=0 tx=0).stop 2024-04-25T15:54:10.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.221+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 msgr2=0x7fe2a815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.221+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 0x7fe2a815cd90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe29800d4d0 tx=0x7fe29800d990 comp rx=0 tx=0).stop 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 shutdown_connections 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe29406f400 0x7fe294071910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2a815b980 0x7fe2a814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2a81f2190 0x7fe2a815cd90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 --2- 172.21.15.87:0/2456374912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2a8159aa0 0x7fe2a81f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 >> 172.21.15.87:0/2456374912 conn(0x7fe2a80c8770 msgr2=0x7fe2a8150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 shutdown_connections 2024-04-25T15:54:10.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.225+0000 7fe2af1dd640 1 -- 172.21.15.87:0/2456374912 wait complete. 2024-04-25T15:54:10.272 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:10.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 Processor -- start 2024-04-25T15:54:10.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 -- start start 2024-04-25T15:54:10.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 0x7fbad806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbad8070490 0x7fbad815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad80c5120 con 0x7fbad815b170 2024-04-25T15:54:10.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbad80c3b20 con 0x7fbad8070490 2024-04-25T15:54:10.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbade642640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbad8070e20 con 0x7fbad80c4250 2024-04-25T15:54:10.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 0x7fbad806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbad77fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbad8070490 0x7fbad815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 0x7fbad806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:33130/0 (socket says 172.21.15.87:33130) 2024-04-25T15:54:10.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbad77fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbad8070490 0x7fbad815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:43294/0 (socket says 172.21.15.87:43294) 2024-04-25T15:54:10.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.417+0000 7fbad7fff640 1 -- 172.21.15.87:0/990811911 learned_addr learned my addr 172.21.15.87:0/990811911 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:10.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad77fe640 1 -- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 msgr2=0x7fbad806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:10.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad77fe640 1 --2- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 0x7fbad806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad77fe640 1 -- 172.21.15.87:0/990811911 >> v1:172.21.15.155:6789/0 conn(0x7fbad815b170 legacy=0x7fbad80c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad77fe640 1 -- 172.21.15.87:0/990811911 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80c4b60 con 0x7fbad8070490 2024-04-25T15:54:10.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad7fff640 1 --2- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 0x7fbad806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:10.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad77fe640 1 --2- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad8070490 0x7fbad815ac30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955ead5e20179bee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:10.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad6ffd640 1 -- 172.21.15.87:0/990811911 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80b0070 con 0x7fbad8070490 2024-04-25T15:54:10.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad6ffd640 1 -- 172.21.15.87:0/990811911 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac80ab600 con 0x7fbad8070490 2024-04-25T15:54:10.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbad6ffd640 1 -- 172.21.15.87:0/990811911 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ab9d0 con 0x7fbad8070490 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 -- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad8070490 msgr2=0x7fbad815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 --2- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad8070490 0x7fbad815ac30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac801c3e0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 -- 172.21.15.87:0/990811911 shutdown_connections 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 --2- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad8070490 0x7fbad815ac30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 --2- 172.21.15.87:0/990811911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad80c4250 0x7fbad806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 -- 172.21.15.87:0/990811911 >> 172.21.15.87:0/990811911 conn(0x7fbad806d780 msgr2=0x7fbad806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:10.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 -- 172.21.15.87:0/990811911 shutdown_connections 2024-04-25T15:54:10.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.421+0000 7fbade642640 1 -- 172.21.15.87:0/990811911 wait complete. 2024-04-25T15:54:10.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 Processor -- start 2024-04-25T15:54:10.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 -- start start 2024-04-25T15:54:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 0x7fbad81f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad80c4250 0x7fbad80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad815b170 0x7fbad80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8155280 con 0x7fbad8070490 2024-04-25T15:54:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8155100 con 0x7fbad80c4250 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbade642640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbad8164e80 con 0x7fbad815b170 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 0x7fbad81f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 0x7fbad81f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49068/0 (socket says 172.21.15.87:49068) 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 -- 172.21.15.87:0/4249903688 learned_addr learned my addr 172.21.15.87:0/4249903688 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 -- 172.21.15.87:0/4249903688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad815b170 msgr2=0x7fbad80c9270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad815b170 0x7fbad80c9270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 -- 172.21.15.87:0/4249903688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad80c4250 msgr2=0x7fbad80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad80c4250 0x7fbad80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 -- 172.21.15.87:0/4249903688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad814f8a0 con 0x7fbad8070490 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.425+0000 7fbad7fff640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 0x7fbad81f15c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbac000e9b0 tx=0x7fbac000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0017070 con 0x7fbad8070490 2024-04-25T15:54:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad814edb0 con 0x7fbad8070490 2024-04-25T15:54:10.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac000c9a0 con 0x7fbad8070490 2024-04-25T15:54:10.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac000cd90 con 0x7fbad8070490 2024-04-25T15:54:10.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad81f5040 con 0x7fbad8070490 2024-04-25T15:54:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad8069bb0 con 0x7fbad8070490 2024-04-25T15:54:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbac001a070 con 0x7fbad8070490 2024-04-25T15:54:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad4ff9640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbab806f400 0x7fbab8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7fbac008f8c0 con 0x7fbad8070490 2024-04-25T15:54:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad77fe640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbab806f400 0x7fbab8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.429+0000 7fbad77fe640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbab806f400 0x7fbab8071910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbac80ad000 tx=0x7fbac8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.433+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbac005c8e0 con 0x7fbad8070490 2024-04-25T15:54:10.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.593+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbad80c3540 con 0x7fbad8070490 2024-04-25T15:54:10.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.597+0000 7fbad4ff9640 1 -- 172.21.15.87:0/4249903688 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16598 (secure 0 0 0) 0x7fbac005c1e0 con 0x7fbad8070490 2024-04-25T15:54:10.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:10.598 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:09.584382+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:10.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.597+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbab806f400 msgr2=0x7fbab8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.597+0000 7fbade642640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbab806f400 0x7fbab8071910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbac80ad000 tx=0x7fbac8004740 comp rx=0 tx=0).stop 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 msgr2=0x7fbad81f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 0x7fbad81f15c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbac000e9b0 tx=0x7fbac000ee70 comp rx=0 tx=0).stop 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 shutdown_connections 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbab806f400 0x7fbab8071910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbad815b170 0x7fbad80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbad80c4250 0x7fbad80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 --2- 172.21.15.87:0/4249903688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbad8070490 0x7fbad81f15c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 >> 172.21.15.87:0/4249903688 conn(0x7fbad806d780 msgr2=0x7fbad81575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 shutdown_connections 2024-04-25T15:54:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.601+0000 7fbade642640 1 -- 172.21.15.87:0/4249903688 wait complete. 2024-04-25T15:54:10.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:10.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 Processor -- start 2024-04-25T15:54:10.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 -- start start 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7ac0c9b60 0x7ff7ac155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 0x7ff7ac0744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ac0a9e00 con 0x7ff7ac152820 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ac155900 con 0x7ff7ac0c9b60 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7b1ef5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0c8e20 con 0x7ff7ac0740a0 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aaffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff7ac152820 0x7ff7ac0c8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60660/0 (socket says 172.21.15.87:60660) 2024-04-25T15:54:10.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aaffd640 1 -- 172.21.15.87:0/2052533649 learned_addr learned my addr 172.21.15.87:0/2052533649 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/2052533649 >> v2:172.21.15.155:3300/0 conn(0x7ff7ac0c9b60 0x7ff7ac155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7abfff640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 0x7ff7ac0744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779543281 0 0) 0x7ff7ac0a9e00 con 0x7ff7ac152820 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff794003530 con 0x7ff7ac152820 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4227814483 0 0) 0x7ff794003530 con 0x7ff7ac152820 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 msgr2=0x7ff7ac0744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 0x7ff7ac0744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 >> v2:172.21.15.155:3300/0 conn(0x7ff7ac0c9b60 msgr2=0x7ff7ac155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.769+0000 7ff7aa7fc640 1 --2- 172.21.15.87:0/2052533649 >> v2:172.21.15.155:3300/0 conn(0x7ff7ac0c9b60 0x7ff7ac155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac1552b0 con 0x7ff7ac152820 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ff7a0001680 con 0x7ff7ac152820 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 >> v1:172.21.15.87:6789/0 conn(0x7ff7ac152820 legacy=0x7ff7ac0c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940039c0 0x7ff794003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 0x7ff794004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff794004d50 0x7ff794005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac155900 con 0x7ff7940039c0 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0c8e20 con 0x7ff794004d50 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff79400bb30 con 0x7ff7ac0740a0 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940039c0 0x7ff794003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aaffd640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 0x7ff794004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 msgr2=0x7ff794004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0740a0 0x7ff794004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7abfff640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff794004d50 0x7ff794005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff794004d50 msgr2=0x7ff794005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff794004d50 0x7ff794005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/2052533649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff794003530 con 0x7ff7940039c0 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940039c0 0x7ff794003e30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac071420 tx=0x7ff79c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73395e27a9c52c5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0096b0 con 0x7ff7940039c0 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c0a6430 con 0x7ff7940039c0 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7aa7fc640 1 -- 172.21.15.87:0/2052533649 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0a67e0 con 0x7ff7940039c0 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/2052533649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940039c0 msgr2=0x7ff794003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/2052533649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940039c0 0x7ff794003e30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac071420 tx=0x7ff79c01ca50 comp rx=0 tx=0).stop 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7abfff640 1 -- 172.21.15.87:0/2052533649 reap_dead start 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/2052533649 shutdown_connections 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/2052533649 >> 172.21.15.87:0/2052533649 conn(0x7ff7ac0ac5c0 msgr2=0x7ff7ac0ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/2052533649 shutdown_connections 2024-04-25T15:54:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.773+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/2052533649 wait complete. 2024-04-25T15:54:10.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 Processor -- start 2024-04-25T15:54:10.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 -- start start 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 0x7ff7ac151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0b0880 0x7ff7ac15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac15bea0 0x7ff7ac1f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1604b0 con 0x7ff7ac14c370 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac160330 con 0x7ff7ac15bea0 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac160630 con 0x7ff7ac0b0880 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 0x7ff7ac151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 0x7ff7ac151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49088/0 (socket says 172.21.15.87:49088) 2024-04-25T15:54:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/1412145723 learned_addr learned my addr 172.21.15.87:0/1412145723 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/1412145723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0b0880 msgr2=0x7ff7ac15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0b0880 0x7ff7ac15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/1412145723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac15bea0 msgr2=0x7ff7ac1f1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac15bea0 0x7ff7ac1f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 -- 172.21.15.87:0/1412145723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac0aede0 con 0x7ff7ac14c370 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7ab7fe640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 0x7ff7ac151590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff79c000c10 tx=0x7ff79c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0a6be0 con 0x7ff7ac14c370 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c0a6d80 con 0x7ff7ac14c370 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac0af0c0 con 0x7ff7ac14c370 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0b9680 con 0x7ff7ac14c370 2024-04-25T15:54:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.777+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac158fe0 con 0x7ff7ac14c370 2024-04-25T15:54:10.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.781+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ac069bb0 con 0x7ff7ac14c370 2024-04-25T15:54:10.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.781+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff79c0c2440 con 0x7ff7ac14c370 2024-04-25T15:54:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.781+0000 7ff793fff640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff79806f400 0x7ff798071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.781+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7ff79c1293f0 con 0x7ff7ac14c370 2024-04-25T15:54:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.781+0000 7ff7aaffd640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff79806f400 0x7ff798071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.781+0000 7ff7aaffd640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff79806f400 0x7ff798071910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0001930 tx=0x7ff7a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:10.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.785+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff79c0ac020 con 0x7ff7ac14c370 2024-04-25T15:54:10.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.953+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7ac0af290 con 0x7ff7ac14c370 2024-04-25T15:54:10.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.957+0000 7ff793fff640 1 -- 172.21.15.87:0/1412145723 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16598 (secure 0 0 0) 0x7ff79c016760 con 0x7ff7ac14c370 2024-04-25T15:54:10.958 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:10.958 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:09.584382+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff79806f400 msgr2=0x7ff798071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff79806f400 0x7ff798071910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0001930 tx=0x7ff7a0009040 comp rx=0 tx=0).stop 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 msgr2=0x7ff7ac151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 0x7ff7ac151590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff79c000c10 tx=0x7ff79c0197f0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 shutdown_connections 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff79806f400 0x7ff798071910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac15bea0 0x7ff7ac1f1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7ac0b0880 0x7ff7ac15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 --2- 172.21.15.87:0/1412145723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ac14c370 0x7ff7ac151590 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 >> 172.21.15.87:0/1412145723 conn(0x7ff7ac0ac5c0 msgr2=0x7ff7ac0c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 shutdown_connections 2024-04-25T15:54:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:10.961+0000 7ff7b1ef5640 1 -- 172.21.15.87:0/1412145723 wait complete. 2024-04-25T15:54:10.980 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-04-25T15:54:11.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 Processor -- start 2024-04-25T15:54:11.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 -- start start 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc58071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc580adda0 0x7efc580c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc580c4e30 con 0x7efc580ad990 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efc580ae1b0 con 0x7efc580adda0 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc6079a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc58072430 con 0x7efc581529a0 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc5ed37640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc580adda0 0x7efc580c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc5dd35640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efc580ad990 0x7efc580c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36816/0 (socket says 172.21.15.87:36816) 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc5dd35640 1 -- 172.21.15.87:0/86807043 learned_addr learned my addr 172.21.15.87:0/86807043 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc5e536640 1 --2- 172.21.15.87:0/86807043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc58071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:11.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.133+0000 7efc5ed37640 1 -- 172.21.15.87:0/86807043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 msgr2=0x7efc58071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:11.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5ed37640 1 --2- 172.21.15.87:0/86807043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc58071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:11.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5ed37640 1 -- 172.21.15.87:0/86807043 >> v1:172.21.15.87:6789/0 conn(0x7efc580ad990 legacy=0x7efc580c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:11.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5ed37640 1 -- 172.21.15.87:0/86807043 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc58074730 con 0x7efc580adda0 2024-04-25T15:54:11.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5d534640 1 -- 172.21.15.87:0/86807043 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649134498 0 0) 0x7efc48001120 con 0x7efc580ad990 2024-04-25T15:54:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5ed37640 1 --2- 172.21.15.87:0/86807043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580adda0 0x7efc580c48f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc50009d90 tx=0x7efc5001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e15cfbf7b9ec505 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5d534640 1 -- 172.21.15.87:0/86807043 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc500b2070 con 0x7efc580adda0 2024-04-25T15:54:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5d534640 1 -- 172.21.15.87:0/86807043 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc500a57a0 con 0x7efc580adda0 2024-04-25T15:54:11.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc5d534640 1 -- 172.21.15.87:0/86807043 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc500a5b70 con 0x7efc580adda0 2024-04-25T15:54:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 -- 172.21.15.87:0/86807043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580adda0 msgr2=0x7efc580c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:11.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 --2- 172.21.15.87:0/86807043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580adda0 0x7efc580c48f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc50009d90 tx=0x7efc5001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:54:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 -- 172.21.15.87:0/86807043 shutdown_connections 2024-04-25T15:54:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 --2- 172.21.15.87:0/86807043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580adda0 0x7efc580c48f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 --2- 172.21.15.87:0/86807043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc58071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 -- 172.21.15.87:0/86807043 >> 172.21.15.87:0/86807043 conn(0x7efc580c8770 msgr2=0x7efc580c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 -- 172.21.15.87:0/86807043 shutdown_connections 2024-04-25T15:54:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.137+0000 7efc6079a640 1 -- 172.21.15.87:0/86807043 wait complete. 2024-04-25T15:54:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 Processor -- start 2024-04-25T15:54:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 -- start start 2024-04-25T15:54:11.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 0x7efc580ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc580adda0 0x7efc5815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc5814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efc581622f0 con 0x7efc580ad990 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc580ab1a0 con 0x7efc580adda0 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc58162470 con 0x7efc581529a0 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 0x7efc580ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 0x7efc580ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60244/0 (socket says 172.21.15.87:60244) 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 -- 172.21.15.87:0/1994067773 learned_addr learned my addr 172.21.15.87:0/1994067773 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5ed37640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc5814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5dd35640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc580adda0 0x7efc5815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 -- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 msgr2=0x7efc5814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc5814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 -- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc580adda0 msgr2=0x7efc5815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc580adda0 0x7efc5815e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 -- 172.21.15.87:0/1994067773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc581595e0 con 0x7efc580ad990 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc5e536640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 0x7efc580ad2e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc5400d600 tx=0x7efc5400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54004240 con 0x7efc580ad990 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc540043e0 con 0x7efc580ad990 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc581f4920 con 0x7efc580ad990 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54003840 con 0x7efc580ad990 2024-04-25T15:54:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.141+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc580acae0 con 0x7efc580ad990 2024-04-25T15:54:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.145+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc58069bb0 con 0x7efc580ad990 2024-04-25T15:54:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.145+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc540039e0 con 0x7efc580ad990 2024-04-25T15:54:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.145+0000 7efc4effd640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efc3c06f400 0x7efc3c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.145+0000 7efc5dd35640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efc3c06f400 0x7efc3c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.145+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7efc5408f560 con 0x7efc580ad990 2024-04-25T15:54:11.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.145+0000 7efc5dd35640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efc3c06f400 0x7efc3c071910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc580c8da0 tx=0x7efc48007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:11.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.149+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc5405c4f0 con 0x7efc580ad990 2024-04-25T15:54:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:11.345+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efc580c3760 con 0x7efc580ad990 2024-04-25T15:54:12.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.273+0000 7efc4effd640 1 -- 172.21.15.87:0/1994067773 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 113+0+0 (secure 0 0 0) 0x7efc5405bdf0 con 0x7efc580ad990 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efc3c06f400 msgr2=0x7efc3c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efc3c06f400 0x7efc3c071910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc580c8da0 tx=0x7efc48007c10 comp rx=0 tx=0).stop 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 msgr2=0x7efc580ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 0x7efc580ad2e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc5400d600 tx=0x7efc5400dac0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 shutdown_connections 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efc3c06f400 0x7efc3c071910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc581529a0 0x7efc5814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc580adda0 0x7efc5815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 --2- 172.21.15.87:0/1994067773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc580ad990 0x7efc580ad2e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 >> 172.21.15.87:0/1994067773 conn(0x7efc580c8770 msgr2=0x7efc580c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:12.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 shutdown_connections 2024-04-25T15:54:12.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.277+0000 7efc6079a640 1 -- 172.21.15.87:0/1994067773 wait complete. 2024-04-25T15:54:12.301 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-25T15:54:12.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-04-25T15:54:12.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 Processor -- start 2024-04-25T15:54:12.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 -- start start 2024-04-25T15:54:12.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 0x7f5c940ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5c940cb270 0x7f5c94157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c940c7570 con 0x7f5c940cae60 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5c9415b8b0 con 0x7f5c940cb270 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c9b2f9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9415b5d0 con 0x7f5c9415ad90 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c98894640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5c940cae60 0x7f5c94157380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36830/0 (socket says 172.21.15.87:36830) 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c98894640 1 -- 172.21.15.87:0/3735111277 learned_addr learned my addr 172.21.15.87:0/3735111277 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c99896640 1 --2- 172.21.15.87:0/3735111277 >> v2:172.21.15.155:3300/0 conn(0x7f5c940cb270 0x7f5c94157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c99095640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 0x7f5c940ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002491147 0 0) 0x7f5c940c7570 con 0x7f5c940cae60 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c7c003530 con 0x7f5c940cae60 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1383378666 0 0) 0x7f5c7c003530 con 0x7f5c940cae60 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 msgr2=0x7f5c940ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 0x7f5c940ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 >> v2:172.21.15.155:3300/0 conn(0x7f5c940cb270 msgr2=0x7f5c94157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 --2- 172.21.15.87:0/3735111277 >> v2:172.21.15.155:3300/0 conn(0x7f5c940cb270 0x7f5c94157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c940c2290 con 0x7f5c940cae60 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f5c88001680 con 0x7f5c940cae60 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 >> v1:172.21.15.87:6789/0 conn(0x7f5c940cae60 legacy=0x7f5c94157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 0x7f5c7c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c7c003f40 0x7f5c7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c7c004d50 0x7f5c7c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9415b8b0 con 0x7f5c7c003f40 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9415b5d0 con 0x7f5c7c004d50 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7c00bb60 con 0x7f5c9415ad90 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c98894640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c7c003f40 0x7f5c7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c99095640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 0x7f5c7c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.453+0000 7f5c99896640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c7c004d50 0x7f5c7c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.457+0000 7f5c98894640 1 -- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 msgr2=0x7f5c7c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.457+0000 7f5c98894640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c9415ad90 0x7f5c7c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.457+0000 7f5c98894640 1 -- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c7c004d50 msgr2=0x7f5c7c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:12.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.457+0000 7f5c98894640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c7c004d50 0x7f5c7c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.457+0000 7f5c98894640 1 -- 172.21.15.87:0/3735111277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c003530 con 0x7f5c7c003f40 2024-04-25T15:54:12.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.457+0000 7f5c98894640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c7c003f40 0x7f5c7c004810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5c940cc410 tx=0x7f5c8801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67246759716a5e6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:12.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88007d40 con 0x7f5c7c003f40 2024-04-25T15:54:12.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c880a9020 con 0x7f5c7c003f40 2024-04-25T15:54:12.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c93fff640 1 -- 172.21.15.87:0/3735111277 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88005b00 con 0x7f5c7c003f40 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3735111277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c7c003f40 msgr2=0x7f5c7c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3735111277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c7c003f40 0x7f5c7c004810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5c940cc410 tx=0x7f5c8801cc40 comp rx=0 tx=0).stop 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c99896640 1 -- 172.21.15.87:0/3735111277 reap_dead start 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3735111277 shutdown_connections 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3735111277 >> 172.21.15.87:0/3735111277 conn(0x7f5c940c9330 msgr2=0x7f5c940c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3735111277 shutdown_connections 2024-04-25T15:54:12.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3735111277 wait complete. 2024-04-25T15:54:12.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 Processor -- start 2024-04-25T15:54:12.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- start start 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c7c003f40 0x7f5c940c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c940b1520 0x7f5c940b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 0x7f5c9414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940ca2e0 con 0x7f5c9414e260 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940ca160 con 0x7f5c940b1520 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c9b2f9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9415b1a0 con 0x7f5c7c003f40 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c99896640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 0x7f5c9414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.461+0000 7f5c99896640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 0x7f5c9414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60266/0 (socket says 172.21.15.87:60266) 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 -- 172.21.15.87:0/3184333834 learned_addr learned my addr 172.21.15.87:0/3184333834 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c98894640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c940b1520 0x7f5c940b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99095640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c7c003f40 0x7f5c940c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 -- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c7c003f40 msgr2=0x7f5c940c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c7c003f40 0x7f5c940c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 -- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c940b1520 msgr2=0x7f5c940b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c940b1520 0x7f5c940b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 -- 172.21.15.87:0/3184333834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9414ebb0 con 0x7f5c9414e260 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99095640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c7c003f40 0x7f5c940c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99896640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 0x7f5c9414e670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5c940cc380 tx=0x7f5c84011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:12.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84004240 con 0x7f5c9414e260 2024-04-25T15:54:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8401b070 con 0x7f5c9414e260 2024-04-25T15:54:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9415df30 con 0x7f5c9414e260 2024-04-25T15:54:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400f7a0 con 0x7f5c9414e260 2024-04-25T15:54:12.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c940b0d20 con 0x7f5c9414e260 2024-04-25T15:54:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c94069bb0 con 0x7f5c9414e260 2024-04-25T15:54:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5c84012040 con 0x7f5c9414e260 2024-04-25T15:54:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c91ffb640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5c8006f400 0x7f5c80071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f5c8408f190 con 0x7f5c9414e260 2024-04-25T15:54:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99095640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5c8006f400 0x7f5c80071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:12.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.465+0000 7f5c99095640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5c8006f400 0x7f5c80071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009670 tx=0x7f5c8c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:12.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.469+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c9414ebb0 con 0x7f5c9414e260 2024-04-25T15:54:12.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:12.657+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5c940ad810 con 0x7f5c9414e260 2024-04-25T15:54:13.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.289+0000 7f5c91ffb640 1 -- 172.21.15.87:0/3184333834 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f5c8405c090 con 0x7f5c9414e260 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5c8006f400 msgr2=0x7f5c80071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5c8006f400 0x7f5c80071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c009670 tx=0x7f5c8c00b040 comp rx=0 tx=0).stop 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 msgr2=0x7f5c9414e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 0x7f5c9414e670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5c940cc380 tx=0x7f5c84011cf0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 shutdown_connections 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5c8006f400 0x7f5c80071910 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c9414e260 0x7f5c9414e670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c940b1520 0x7f5c940b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 --2- 172.21.15.87:0/3184333834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c7c003f40 0x7f5c940c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 >> 172.21.15.87:0/3184333834 conn(0x7f5c940c9330 msgr2=0x7f5c94159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 shutdown_connections 2024-04-25T15:54:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.293+0000 7f5c9b2f9640 1 -- 172.21.15.87:0/3184333834 wait complete. 2024-04-25T15:54:13.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-04-25T15:54:13.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.473+0000 7efccc534640 1 Processor -- start 2024-04-25T15:54:13.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.473+0000 7efccc534640 1 -- start start 2024-04-25T15:54:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccc534640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efcc4155730 0x7efcc4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccc534640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc4152d90 con 0x7efcc4152980 2024-04-25T15:54:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccc534640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc40a9cd0 con 0x7efcc4155320 2024-04-25T15:54:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccc534640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efcc40aa290 con 0x7efcc4155730 2024-04-25T15:54:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efcc4152980 0x7efcc40c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36844/0 (socket says 172.21.15.87:36844) 2024-04-25T15:54:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 -- 172.21.15.87:0/206550228 learned_addr learned my addr 172.21.15.87:0/206550228 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939377252 0 0) 0x7efcc4152d90 con 0x7efcc4152980 2024-04-25T15:54:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccaad1640 1 --2- 172.21.15.87:0/206550228 >> v2:172.21.15.155:3300/0 conn(0x7efcc4155730 0x7efcc4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb0003530 con 0x7efcc4152980 2024-04-25T15:54:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4055191702 0 0) 0x7efcb0003530 con 0x7efcc4152980 2024-04-25T15:54:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 >> v2:172.21.15.155:3300/0 conn(0x7efcc4155730 msgr2=0x7efcc4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 --2- 172.21.15.87:0/206550228 >> v2:172.21.15.155:3300/0 conn(0x7efcc4155730 0x7efcc4160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 >> v1:172.21.15.155:6789/0 conn(0x7efcc4155320 legacy=0x7efcc4074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40a9fb0 con 0x7efcc4152980 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7efcc0001680 con 0x7efcc4152980 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccaad1640 1 --2- 172.21.15.87:0/206550228 >> v2:172.21.15.155:3300/0 conn(0x7efcc4155730 0x7efcc4160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 >> v1:172.21.15.87:6789/0 conn(0x7efcc4152980 legacy=0x7efcc40c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcb00039c0 0x7efcb0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb0004810 0x7efcb0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb0005310 0x7efcb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40aa290 con 0x7efcb00039c0 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efcb000c2b0 con 0x7efcb0005310 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efcb000c4b0 con 0x7efcb0004810 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcb00039c0 0x7efcb0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc9acf640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb0004810 0x7efcb0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 -- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb0004810 msgr2=0x7efcb0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:13.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb0004810 0x7efcb0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccaad1640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb0005310 0x7efcb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 -- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb0005310 msgr2=0x7efcb000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb0005310 0x7efcb000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcca2d0640 1 -- 172.21.15.87:0/206550228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb0003530 con 0x7efcb00039c0 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efcc9acf640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb0004810 0x7efcb0004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccaad1640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb0005310 0x7efcb000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:13.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.477+0000 7efccaad1640 1 -- 172.21.15.87:0/206550228 reap_dead start 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efcca2d0640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcb00039c0 0x7efcb0003e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c210 tx=0x7efcc001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dd690c06c2401f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0007d40 con 0x7efcb00039c0 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc00a9070 con 0x7efcb00039c0 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efcc92ce640 1 -- 172.21.15.87:0/206550228 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0005ae0 con 0x7efcb00039c0 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 -- 172.21.15.87:0/206550228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcb00039c0 msgr2=0x7efcb0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcb00039c0 0x7efcb0003e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c210 tx=0x7efcc001cca0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 -- 172.21.15.87:0/206550228 shutdown_connections 2024-04-25T15:54:13.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 --2- 172.21.15.87:0/206550228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcb00039c0 0x7efcb0003e30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 -- 172.21.15.87:0/206550228 >> 172.21.15.87:0/206550228 conn(0x7efcc40ac550 msgr2=0x7efcc40ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:13.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 -- 172.21.15.87:0/206550228 shutdown_connections 2024-04-25T15:54:13.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 -- 172.21.15.87:0/206550228 wait complete. 2024-04-25T15:54:13.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 Processor -- start 2024-04-25T15:54:13.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.481+0000 7efccc534640 1 -- start start 2024-04-25T15:54:13.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb00039c0 0x7efcc414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 0x7efcc41576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcc4151aa0 0x7efcc41ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40ca1c0 con 0x7efcc40afc60 2024-04-25T15:54:13.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41598b0 con 0x7efcb00039c0 2024-04-25T15:54:13.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efcc40ca340 con 0x7efcc4151aa0 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 0x7efcc41576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 0x7efcc41576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60278/0 (socket says 172.21.15.87:60278) 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 -- 172.21.15.87:0/1773062250 learned_addr learned my addr 172.21.15.87:0/1773062250 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccaad1640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcc4151aa0 0x7efcc41ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 -- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcc4151aa0 msgr2=0x7efcc41ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcc4151aa0 0x7efcc41ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 -- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb00039c0 msgr2=0x7efcc414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb00039c0 0x7efcc414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 -- 172.21.15.87:0/1773062250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40ad620 con 0x7efcc40afc60 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcc9acf640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 0x7efcc41576e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcb400d7a0 tx=0x7efcb400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4005270 con 0x7efcc40afc60 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4017070 con 0x7efcc40afc60 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc4150d40 con 0x7efcc40afc60 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb400b6b0 con 0x7efcc40afc60 2024-04-25T15:54:13.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc4151300 con 0x7efcc40afc60 2024-04-25T15:54:13.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc4069bb0 con 0x7efcc40afc60 2024-04-25T15:54:13.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efcb400b870 con 0x7efcc40afc60 2024-04-25T15:54:13.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcbaffd640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efca806f400 0x7efca8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:13.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcca2d0640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efca806f400 0x7efca8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:13.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.485+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7efcb408f190 con 0x7efcc40afc60 2024-04-25T15:54:13.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.489+0000 7efcca2d0640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efca806f400 0x7efca8071910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efcc00ab000 tx=0x7efcc0001a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:13.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.493+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efcb405c090 con 0x7efcc40afc60 2024-04-25T15:54:13.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:13.693+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7efcc414db80 con 0x7efcc40afc60 2024-04-25T15:54:13.931 INFO:tasks.ceph.mds.c.smithi087.stderr:2024-04-25T15:54:13.929+0000 7f800ce62640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:54:14.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.293+0000 7efcbaffd640 1 -- 172.21.15.87:0/1773062250 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v9) ==== 110+0+0 (secure 0 0 0) 0x7efcb4001240 con 0x7efcc40afc60 2024-04-25T15:54:14.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efca806f400 msgr2=0x7efca8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efca806f400 0x7efca8071910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efcc00ab000 tx=0x7efcc0001a50 comp rx=0 tx=0).stop 2024-04-25T15:54:14.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 msgr2=0x7efcc41576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 0x7efcc41576e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcb400d7a0 tx=0x7efcb400dc60 comp rx=0 tx=0).stop 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 shutdown_connections 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efca806f400 0x7efca8071910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcc4151aa0 0x7efcc41ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcc40afc60 0x7efcc41576e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 --2- 172.21.15.87:0/1773062250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb00039c0 0x7efcc414d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 >> 172.21.15.87:0/1773062250 conn(0x7efcc40ac550 msgr2=0x7efcc40ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 shutdown_connections 2024-04-25T15:54:14.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.297+0000 7efccc534640 1 -- 172.21.15.87:0/1773062250 wait complete. 2024-04-25T15:54:14.322 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-04-25T15:54:14.322 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:14.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e4af63640 1 Processor -- start 2024-04-25T15:54:14.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e4af63640 1 -- start start 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e4af63640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e4415eb60 0x7f1e44160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e4af63640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e44063660 con 0x7f1e44158a00 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e4af63640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e440ab670 con 0x7f1e44158e10 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e4af63640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1e440c5470 con 0x7f1e4415eb60 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e49500640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e4415eb60 0x7f1e44160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e48cff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1e44158a00 0x7f1e440ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36860/0 (socket says 172.21.15.87:36860) 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e48cff640 1 -- 172.21.15.87:0/1634376509 learned_addr learned my addr 172.21.15.87:0/1634376509 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:14.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e49500640 1 -- 172.21.15.87:0/1634376509 >> v1:172.21.15.155:6789/0 conn(0x7f1e44158e10 legacy=0x7f1e44152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e49500640 1 -- 172.21.15.87:0/1634376509 >> v1:172.21.15.87:6789/0 conn(0x7f1e44158a00 legacy=0x7f1e440ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e49500640 1 -- 172.21.15.87:0/1634376509 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e440ab930 con 0x7f1e4415eb60 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.469+0000 7f1e437fe640 1 -- 172.21.15.87:0/1634376509 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180458345 0 0) 0x7f1e44063660 con 0x7f1e44158a00 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e49500640 1 --2- 172.21.15.87:0/1634376509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44160f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097c0 tx=0x7f1e3401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de580a6552e2d03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e437fe640 1 -- 172.21.15.87:0/1634376509 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340ab5f0 con 0x7f1e4415eb60 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e437fe640 1 -- 172.21.15.87:0/1634376509 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e340b0070 con 0x7f1e4415eb60 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e437fe640 1 -- 172.21.15.87:0/1634376509 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340ab9b0 con 0x7f1e4415eb60 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 -- 172.21.15.87:0/1634376509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 msgr2=0x7f1e44160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 --2- 172.21.15.87:0/1634376509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44160f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097c0 tx=0x7f1e3401c430 comp rx=0 tx=0).stop 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 -- 172.21.15.87:0/1634376509 shutdown_connections 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 --2- 172.21.15.87:0/1634376509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44160f80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 -- 172.21.15.87:0/1634376509 >> 172.21.15.87:0/1634376509 conn(0x7f1e4406d650 msgr2=0x7f1e440c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:14.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 -- 172.21.15.87:0/1634376509 shutdown_connections 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.473+0000 7f1e4af63640 1 -- 172.21.15.87:0/1634376509 wait complete. 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 Processor -- start 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- start start 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44158a00 0x7f1e44149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e44158e10 0x7f1e441f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1e440aef70 con 0x7f1e4415eb60 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e440ae180 con 0x7f1e44158a00 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e440af0f0 con 0x7f1e44158e10 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60294/0 (socket says 172.21.15.87:60294) 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 -- 172.21.15.87:0/2870882397 learned_addr learned my addr 172.21.15.87:0/2870882397 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 -- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e44158e10 msgr2=0x7f1e441f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e44158e10 0x7f1e441f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e48cff640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44158a00 0x7f1e44149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 -- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44158a00 msgr2=0x7f1e44149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44158a00 0x7f1e44149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 -- 172.21.15.87:0/2870882397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e44074080 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e49500640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44147990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097c0 tx=0x7f1e3401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340bf410 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e340bf5b0 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4415fc90 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340bf960 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e44072b90 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.477+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e44069bb0 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.481+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1e340bd020 con 0x7f1e4415eb60 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.481+0000 7f1e417fa640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1e2406f430 0x7f1e24071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.481+0000 7f1e48cff640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1e2406f430 0x7f1e24071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.481+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f1e341296b0 con 0x7f1e4415eb60 2024-04-25T15:54:14.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.481+0000 7f1e48cff640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1e2406f430 0x7f1e24071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0012f0 tx=0x7f1e3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:14.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.485+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1e34016050 con 0x7f1e4415eb60 2024-04-25T15:54:14.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.665+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e440704e0 con 0x7f1e4415eb60 2024-04-25T15:54:14.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.665+0000 7f1e417fa640 1 -- 172.21.15.87:0/2870882397 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f1e340f6640 con 0x7f1e4415eb60 2024-04-25T15:54:14.666 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:14.667 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-25T15:54:14.667 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1e2406f430 msgr2=0x7f1e24071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1e2406f430 0x7f1e24071940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0012f0 tx=0x7f1e3c009040 comp rx=0 tx=0).stop 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 msgr2=0x7f1e44147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44147990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097c0 tx=0x7f1e3401ac70 comp rx=0 tx=0).stop 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 shutdown_connections 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1e2406f430 0x7f1e24071940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e4415eb60 0x7f1e44147990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e44158e10 0x7f1e441f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 --2- 172.21.15.87:0/2870882397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e44158a00 0x7f1e44149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 >> 172.21.15.87:0/2870882397 conn(0x7f1e4406d650 msgr2=0x7f1e44157600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:14.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 shutdown_connections 2024-04-25T15:54:14.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.669+0000 7f1e4af63640 1 -- 172.21.15.87:0/2870882397 wait complete. 2024-04-25T15:54:14.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:14.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.833+0000 7ff463979640 1 Processor -- start 2024-04-25T15:54:14.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.833+0000 7ff463979640 1 -- start start 2024-04-25T15:54:14.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff463979640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff45c0ae100 0x7ff45c159120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff463979640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff45c155be0 0x7ff45c0acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff463979640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c14f670 con 0x7ff45c06d3c0 2024-04-25T15:54:14.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff463979640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c158c90 con 0x7ff45c155be0 2024-04-25T15:54:14.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff463979640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c159660 con 0x7ff45c0ae100 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff45c155be0 0x7ff45c0acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff45c155be0 0x7ff45c0acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60306/0 (socket says 172.21.15.87:60306) 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 -- 172.21.15.87:0/2356877744 learned_addr learned my addr 172.21.15.87:0/2356877744 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff461715640 1 --2- 172.21.15.87:0/2356877744 >> v2:172.21.15.155:3300/0 conn(0x7ff45c0ae100 0x7ff45c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 -- 172.21.15.87:0/2356877744 >> v2:172.21.15.155:3300/0 conn(0x7ff45c0ae100 msgr2=0x7ff45c159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 --2- 172.21.15.87:0/2356877744 >> v2:172.21.15.155:3300/0 conn(0x7ff45c0ae100 0x7ff45c159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 -- 172.21.15.87:0/2356877744 >> v1:172.21.15.155:6789/0 conn(0x7ff45c06d3c0 legacy=0x7ff45c0c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:14.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.837+0000 7ff460f14640 1 -- 172.21.15.87:0/2356877744 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c0727e0 con 0x7ff45c155be0 2024-04-25T15:54:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff460f14640 1 --2- 172.21.15.87:0/2356877744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c155be0 0x7ff45c0acf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff45c071ea0 tx=0x7ff44c01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c080937f70c19a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff453fff640 1 -- 172.21.15.87:0/2356877744 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0b0070 con 0x7ff45c155be0 2024-04-25T15:54:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff453fff640 1 -- 172.21.15.87:0/2356877744 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c0ab600 con 0x7ff45c155be0 2024-04-25T15:54:14.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff453fff640 1 -- 172.21.15.87:0/2356877744 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0ab9d0 con 0x7ff45c155be0 2024-04-25T15:54:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 -- 172.21.15.87:0/2356877744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c155be0 msgr2=0x7ff45c0acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 --2- 172.21.15.87:0/2356877744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c155be0 0x7ff45c0acf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff45c071ea0 tx=0x7ff44c01c300 comp rx=0 tx=0).stop 2024-04-25T15:54:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 -- 172.21.15.87:0/2356877744 shutdown_connections 2024-04-25T15:54:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 --2- 172.21.15.87:0/2356877744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c155be0 0x7ff45c0acf80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 --2- 172.21.15.87:0/2356877744 >> v2:172.21.15.155:3300/0 conn(0x7ff45c0ae100 0x7ff45c159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 -- 172.21.15.87:0/2356877744 >> 172.21.15.87:0/2356877744 conn(0x7ff45c06c670 msgr2=0x7ff45c06ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 -- 172.21.15.87:0/2356877744 shutdown_connections 2024-04-25T15:54:14.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.841+0000 7ff463979640 1 -- 172.21.15.87:0/2356877744 wait complete. 2024-04-25T15:54:14.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 Processor -- start 2024-04-25T15:54:14.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- start start 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45c06d3c0 0x7ff45c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 0x7ff45c1ef070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c155be0 0x7ff45c146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c156170 con 0x7ff45c0ae100 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c155ff0 con 0x7ff45c155be0 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c162b30 con 0x7ff45c06d3c0 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 0x7ff45c1ef070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 0x7ff45c1ef070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60310/0 (socket says 172.21.15.87:60310) 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 -- 172.21.15.87:0/3855470187 learned_addr learned my addr 172.21.15.87:0/3855470187 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:14.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff461f16640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c155be0 0x7ff45c146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff461715640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45c06d3c0 0x7ff45c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 -- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45c06d3c0 msgr2=0x7ff45c074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45c06d3c0 0x7ff45c074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 -- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c155be0 msgr2=0x7ff45c146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c155be0 0x7ff45c146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 -- 172.21.15.87:0/3855470187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c14fb70 con 0x7ff45c0ae100 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff460f14640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 0x7ff45c1ef070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff44c01a9b0 tx=0x7ff44c0190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0b0040 con 0x7ff45c0ae100 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c0ba070 con 0x7ff45c0ae100 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c151110 con 0x7ff45c0ae100 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0b4650 con 0x7ff45c0ae100 2024-04-25T15:54:14.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c1f3190 con 0x7ff45c0ae100 2024-04-25T15:54:14.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.845+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c069bb0 con 0x7ff45c0ae100 2024-04-25T15:54:14.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.849+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff44c0b47f0 con 0x7ff45c0ae100 2024-04-25T15:54:14.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.849+0000 7ff451ffb640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff44006f430 0x7ff440071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:14.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.849+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ff44c128e80 con 0x7ff45c0ae100 2024-04-25T15:54:14.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.849+0000 7ff461715640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff44006f430 0x7ff440071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:14.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.849+0000 7ff461715640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff44006f430 0x7ff440071940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0632d0 tx=0x7ff458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:14.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:14.853+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff45c14f670 con 0x7ff45c0ae100 2024-04-25T15:54:15.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.013+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff45c071050 con 0x7ff45c0ae100 2024-04-25T15:54:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.017+0000 7ff451ffb640 1 -- 172.21.15.87:0/3855470187 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16585 (secure 0 0 0) 0x7ff44c0f5f20 con 0x7ff45c0ae100 2024-04-25T15:54:15.018 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:15.018 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:11.219239+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:15.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff44006f430 msgr2=0x7ff440071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff44006f430 0x7ff440071940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0632d0 tx=0x7ff458008040 comp rx=0 tx=0).stop 2024-04-25T15:54:15.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 msgr2=0x7ff45c1ef070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 0x7ff45c1ef070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff44c01a9b0 tx=0x7ff44c0190a0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 shutdown_connections 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff44006f430 0x7ff440071940 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c155be0 0x7ff45c146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff45c0ae100 0x7ff45c1ef070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 --2- 172.21.15.87:0/3855470187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff45c06d3c0 0x7ff45c074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 >> 172.21.15.87:0/3855470187 conn(0x7ff45c06c670 msgr2=0x7ff45c06ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 shutdown_connections 2024-04-25T15:54:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.021+0000 7ff463979640 1 -- 172.21.15.87:0/3855470187 wait complete. 2024-04-25T15:54:15.039 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:54:15.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:15.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 Processor -- start 2024-04-25T15:54:15.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 -- start start 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3eb81518b0 0x7f3eb806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 0x7f3eb80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb8154fc0 con 0x7f3eb80c4620 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb806ed60 con 0x7f3eb81518b0 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3ebd2f0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb80acb20 con 0x7f3eb80ad160 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 0x7f3eb80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 0x7f3eb80c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:55278/0 (socket says 172.21.15.87:55278) 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 -- 172.21.15.87:0/1156466057 learned_addr learned my addr 172.21.15.87:0/1156466057 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:15.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb6ffd640 1 --2- 172.21.15.87:0/1156466057 >> v2:172.21.15.155:3300/0 conn(0x7f3eb81518b0 0x7f3eb806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 -- 172.21.15.87:0/1156466057 >> v2:172.21.15.155:3300/0 conn(0x7f3eb81518b0 msgr2=0x7f3eb806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:15.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 --2- 172.21.15.87:0/1156466057 >> v2:172.21.15.155:3300/0 conn(0x7f3eb81518b0 0x7f3eb806f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 -- 172.21.15.87:0/1156466057 >> v1:172.21.15.155:6789/0 conn(0x7f3eb80c4620 legacy=0x7f3eb8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.177+0000 7f3eb67fc640 1 -- 172.21.15.87:0/1156466057 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb80ace00 con 0x7f3eb80ad160 2024-04-25T15:54:15.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3eb67fc640 1 --2- 172.21.15.87:0/1156466057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 0x7f3eb80c40e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009870 tx=0x7f3ea801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dfb733bd6a970f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3eb5ffb640 1 -- 172.21.15.87:0/1156466057 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80a9640 con 0x7f3eb80ad160 2024-04-25T15:54:15.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3eb5ffb640 1 -- 172.21.15.87:0/1156466057 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea80a97e0 con 0x7f3eb80ad160 2024-04-25T15:54:15.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3eb5ffb640 1 -- 172.21.15.87:0/1156466057 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80a9bb0 con 0x7f3eb80ad160 2024-04-25T15:54:15.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/1156466057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 msgr2=0x7f3eb80c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/1156466057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 0x7f3eb80c40e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009870 tx=0x7f3ea801c560 comp rx=0 tx=0).stop 2024-04-25T15:54:15.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/1156466057 shutdown_connections 2024-04-25T15:54:15.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/1156466057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb80ad160 0x7f3eb80c40e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/1156466057 >> v2:172.21.15.155:3300/0 conn(0x7f3eb81518b0 0x7f3eb806f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/1156466057 >> 172.21.15.87:0/1156466057 conn(0x7f3eb80c8770 msgr2=0x7f3eb80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:15.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/1156466057 shutdown_connections 2024-04-25T15:54:15.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.181+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/1156466057 wait complete. 2024-04-25T15:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 Processor -- start 2024-04-25T15:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 -- start start 2024-04-25T15:54:15.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 0x7f3eb81f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb80c4620 0x7f3eb815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb81518b0 0x7f3eb8150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb8161d60 con 0x7f3eb80ad160 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb8161be0 con 0x7f3eb80c4620 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb8161ee0 con 0x7f3eb81518b0 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 0x7f3eb81f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 0x7f3eb81f2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60322/0 (socket says 172.21.15.87:60322) 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 -- 172.21.15.87:0/3927915206 learned_addr learned my addr 172.21.15.87:0/3927915206 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 -- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb81518b0 msgr2=0x7f3eb8150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb81518b0 0x7f3eb8150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb67fc640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb80c4620 0x7f3eb815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 -- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb80c4620 msgr2=0x7f3eb815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb80c4620 0x7f3eb815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 -- 172.21.15.87:0/3927915206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb81f31b0 con 0x7f3eb80ad160 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3eb6ffd640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 0x7f3eb81f2840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e840 tx=0x7f3eac00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac017070 con 0x7f3eb80ad160 2024-04-25T15:54:15.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac00ee90 con 0x7f3eb80ad160 2024-04-25T15:54:15.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb81f3490 con 0x7f3eb80ad160 2024-04-25T15:54:15.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00cb60 con 0x7f3eb80ad160 2024-04-25T15:54:15.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.185+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb8159aa0 con 0x7f3eb80ad160 2024-04-25T15:54:15.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.189+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb8069bb0 con 0x7f3eb80ad160 2024-04-25T15:54:15.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.189+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3eac01a070 con 0x7f3eb80ad160 2024-04-25T15:54:15.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.189+0000 7f3e9f7fe640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3ea406f400 0x7f3ea4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.189+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f3eac08f400 con 0x7f3eb80ad160 2024-04-25T15:54:15.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.189+0000 7f3eb67fc640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3ea406f400 0x7f3ea4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.189+0000 7f3eb67fc640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3ea406f400 0x7f3ea4071910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80ae000 tx=0x7f3ea80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.193+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3eac05c420 con 0x7f3eb80ad160 2024-04-25T15:54:15.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.349+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3eb80c7230 con 0x7f3ea406f400 2024-04-25T15:54:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.369+0000 7f3e9f7fe640 1 -- 172.21.15.87:0/3927915206 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251900 (secure 0 0 0) 0x7f3eb80c7230 con 0x7f3ea406f400 2024-04-25T15:54:15.372 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:15.374 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3ea406f400 msgr2=0x7f3ea4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3ea406f400 0x7f3ea4071910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80ae000 tx=0x7f3ea80a7000 comp rx=0 tx=0).stop 2024-04-25T15:54:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 msgr2=0x7f3eb81f2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 0x7f3eb81f2840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e840 tx=0x7f3eac00ec40 comp rx=0 tx=0).stop 2024-04-25T15:54:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 shutdown_connections 2024-04-25T15:54:15.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3ea406f400 0x7f3ea4071910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3eb81518b0 0x7f3eb8150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3eb80c4620 0x7f3eb815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 --2- 172.21.15.87:0/3927915206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eb80ad160 0x7f3eb81f2840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 >> 172.21.15.87:0/3927915206 conn(0x7f3eb80c8770 msgr2=0x7f3eb80c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 shutdown_connections 2024-04-25T15:54:15.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.373+0000 7f3ebd2f0640 1 -- 172.21.15.87:0/3927915206 wait complete. 2024-04-25T15:54:15.390 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T15:54:15.102302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218964,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755756,"statfs":{"total":773094113280,"available":772869894144,"internally_reserved":0,"allocated":2830336,"data_stored":1721013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002536"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299774+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:10.299774+0000","last_peered":"2024-04-25T15:54:10.299774+0000","last_clean":"2024-04-25T15:54:10.299774+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:10.299774+0000","last_undegraded":"2024-04-25T15:54:10.299774+0000","last_fullsized":"2024-04-25T15:54:10.299774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226929+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:11.226929+0000","last_peered":"2024-04-25T15:54:11.226929+0000","last_clean":"2024-04-25T15:54:11.226929+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:11.226929+0000","last_undegraded":"2024-04-25T15:54:11.226929+0000","last_fullsized":"2024-04-25T15:54:11.226929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243733+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:10.243733+0000","last_peered":"2024-04-25T15:54:10.243733+0000","last_clean":"2024-04-25T15:54:10.243733+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:10.243733+0000","last_undegraded":"2024-04-25T15:54:10.243733+0000","last_fullsized":"2024-04-25T15:54:10.243733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.807724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.289757+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:10.289757+0000","last_peered":"2024-04-25T15:54:10.289757+0000","last_clean":"2024-04-25T15:54:10.289757+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:10.289757+0000","last_undegraded":"2024-04-25T15:54:10.289757+0000","last_fullsized":"2024-04-25T15:54:10.289757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.294710+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:10.294710+0000","last_peered":"2024-04-25T15:54:10.294710+0000","last_clean":"2024-04-25T15:54:10.294710+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:10.294710+0000","last_undegraded":"2024-04-25T15:54:10.294710+0000","last_fullsized":"2024-04-25T15:54:10.294710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290494+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:10.290494+0000","last_peered":"2024-04-25T15:54:10.290494+0000","last_clean":"2024-04-25T15:54:10.290494+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:10.290494+0000","last_undegraded":"2024-04-25T15:54:10.290494+0000","last_fullsized":"2024-04-25T15:54:10.290494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.292506+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:10.292506+0000","last_peered":"2024-04-25T15:54:10.292506+0000","last_clean":"2024-04-25T15:54:10.292506+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:10.292506+0000","last_undegraded":"2024-04-25T15:54:10.292506+0000","last_fullsized":"2024-04-25T15:54:10.292506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:01.578701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.929581+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:11.929581+0000","last_peered":"2024-04-25T15:54:11.929581+0000","last_clean":"2024-04-25T15:54:11.929581+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:11.929581+0000","last_undegraded":"2024-04-25T15:54:11.929581+0000","last_fullsized":"2024-04-25T15:54:11.929581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299812+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:10.299812+0000","last_peered":"2024-04-25T15:54:10.299812+0000","last_clean":"2024-04-25T15:54:10.299812+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:10.299812+0000","last_undegraded":"2024-04-25T15:54:10.299812+0000","last_fullsized":"2024-04-25T15:54:10.299812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228348+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:11.228348+0000","last_peered":"2024-04-25T15:54:11.228348+0000","last_clean":"2024-04-25T15:54:11.228348+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:11.228348+0000","last_undegraded":"2024-04-25T15:54:11.228348+0000","last_fullsized":"2024-04-25T15:54:11.228348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.227061+0000","last_change":"2024-04-25T15:54:10.256856+0000","last_active":"2024-04-25T15:54:11.227061+0000","last_peered":"2024-04-25T15:54:11.227061+0000","last_clean":"2024-04-25T15:54:11.227061+0000","last_became_active":"2024-04-25T15:54:10.256024+0000","last_became_peered":"2024-04-25T15:54:10.256024+0000","last_unstale":"2024-04-25T15:54:11.227061+0000","last_undegraded":"2024-04-25T15:54:11.227061+0000","last_fullsized":"2024-04-25T15:54:11.227061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230005+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:11.230005+0000","last_peered":"2024-04-25T15:54:11.230005+0000","last_clean":"2024-04-25T15:54:11.230005+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:11.230005+0000","last_undegraded":"2024-04-25T15:54:11.230005+0000","last_fullsized":"2024-04-25T15:54:11.230005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930032+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:11.930032+0000","last_peered":"2024-04-25T15:54:11.930032+0000","last_clean":"2024-04-25T15:54:11.930032+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:11.930032+0000","last_undegraded":"2024-04-25T15:54:11.930032+0000","last_fullsized":"2024-04-25T15:54:11.930032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243424+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:10.243424+0000","last_peered":"2024-04-25T15:54:10.243424+0000","last_clean":"2024-04-25T15:54:10.243424+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:10.243424+0000","last_undegraded":"2024-04-25T15:54:10.243424+0000","last_fullsized":"2024-04-25T15:54:10.243424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:51.303833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226247+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:11.226247+0000","last_peered":"2024-04-25T15:54:11.226247+0000","last_clean":"2024-04-25T15:54:11.226247+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:11.226247+0000","last_undegraded":"2024-04-25T15:54:11.226247+0000","last_fullsized":"2024-04-25T15:54:11.226247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.282061+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:10.282061+0000","last_peered":"2024-04-25T15:54:10.282061+0000","last_clean":"2024-04-25T15:54:10.282061+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:10.282061+0000","last_undegraded":"2024-04-25T15:54:10.282061+0000","last_fullsized":"2024-04-25T15:54:10.282061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.278073+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:10.278073+0000","last_peered":"2024-04-25T15:54:10.278073+0000","last_clean":"2024-04-25T15:54:10.278073+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:10.278073+0000","last_undegraded":"2024-04-25T15:54:10.278073+0000","last_fullsized":"2024-04-25T15:54:10.278073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.262965+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:10.262965+0000","last_peered":"2024-04-25T15:54:10.262965+0000","last_clean":"2024-04-25T15:54:10.262965+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:10.262965+0000","last_undegraded":"2024-04-25T15:54:10.262965+0000","last_fullsized":"2024-04-25T15:54:10.262965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299467+0000","last_change":"2024-04-25T15:54:10.295088+0000","last_active":"2024-04-25T15:54:10.299467+0000","last_peered":"2024-04-25T15:54:10.299467+0000","last_clean":"2024-04-25T15:54:10.299467+0000","last_became_active":"2024-04-25T15:54:10.292412+0000","last_became_peered":"2024-04-25T15:54:10.292412+0000","last_unstale":"2024-04-25T15:54:10.299467+0000","last_undegraded":"2024-04-25T15:54:10.299467+0000","last_fullsized":"2024-04-25T15:54:10.299467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226662+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:11.226662+0000","last_peered":"2024-04-25T15:54:11.226662+0000","last_clean":"2024-04-25T15:54:11.226662+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:11.226662+0000","last_undegraded":"2024-04-25T15:54:11.226662+0000","last_fullsized":"2024-04-25T15:54:11.226662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.269247+0000","last_change":"2024-04-25T15:54:10.267602+0000","last_active":"2024-04-25T15:54:10.269247+0000","last_peered":"2024-04-25T15:54:10.269247+0000","last_clean":"2024-04-25T15:54:10.269247+0000","last_became_active":"2024-04-25T15:54:10.267276+0000","last_became_peered":"2024-04-25T15:54:10.267276+0000","last_unstale":"2024-04-25T15:54:10.269247+0000","last_undegraded":"2024-04-25T15:54:10.269247+0000","last_fullsized":"2024-04-25T15:54:10.269247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.295913+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:10.295913+0000","last_peered":"2024-04-25T15:54:10.295913+0000","last_clean":"2024-04-25T15:54:10.295913+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:10.295913+0000","last_undegraded":"2024-04-25T15:54:10.295913+0000","last_fullsized":"2024-04-25T15:54:10.295913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.929655+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:11.929655+0000","last_peered":"2024-04-25T15:54:11.929655+0000","last_clean":"2024-04-25T15:54:11.929655+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:11.929655+0000","last_undegraded":"2024-04-25T15:54:11.929655+0000","last_fullsized":"2024-04-25T15:54:11.929655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290472+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:10.290472+0000","last_peered":"2024-04-25T15:54:10.290472+0000","last_clean":"2024-04-25T15:54:10.290472+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:10.290472+0000","last_undegraded":"2024-04-25T15:54:10.290472+0000","last_fullsized":"2024-04-25T15:54:10.290472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.931029+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:11.931029+0000","last_peered":"2024-04-25T15:54:11.931029+0000","last_clean":"2024-04-25T15:54:11.931029+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:11.931029+0000","last_undegraded":"2024-04-25T15:54:11.931029+0000","last_fullsized":"2024-04-25T15:54:11.931029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228391+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:11.228391+0000","last_peered":"2024-04-25T15:54:11.228391+0000","last_clean":"2024-04-25T15:54:11.228391+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:11.228391+0000","last_undegraded":"2024-04-25T15:54:11.228391+0000","last_fullsized":"2024-04-25T15:54:11.228391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226634+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:11.226634+0000","last_peered":"2024-04-25T15:54:11.226634+0000","last_clean":"2024-04-25T15:54:11.226634+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:11.226634+0000","last_undegraded":"2024-04-25T15:54:11.226634+0000","last_fullsized":"2024-04-25T15:54:11.226634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930498+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:11.930498+0000","last_peered":"2024-04-25T15:54:11.930498+0000","last_clean":"2024-04-25T15:54:11.930498+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:11.930498+0000","last_undegraded":"2024-04-25T15:54:11.930498+0000","last_fullsized":"2024-04-25T15:54:11.930498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243348+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:10.243348+0000","last_peered":"2024-04-25T15:54:10.243348+0000","last_clean":"2024-04-25T15:54:10.243348+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:10.243348+0000","last_undegraded":"2024-04-25T15:54:10.243348+0000","last_fullsized":"2024-04-25T15:54:10.243348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:34.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290571+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:10.290571+0000","last_peered":"2024-04-25T15:54:10.290571+0000","last_clean":"2024-04-25T15:54:10.290571+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:10.290571+0000","last_undegraded":"2024-04-25T15:54:10.290571+0000","last_fullsized":"2024-04-25T15:54:10.290571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.263021+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:10.263021+0000","last_peered":"2024-04-25T15:54:10.263021+0000","last_clean":"2024-04-25T15:54:10.263021+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:10.263021+0000","last_undegraded":"2024-04-25T15:54:10.263021+0000","last_fullsized":"2024-04-25T15:54:10.263021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226709+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:11.226709+0000","last_peered":"2024-04-25T15:54:11.226709+0000","last_clean":"2024-04-25T15:54:11.226709+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:11.226709+0000","last_undegraded":"2024-04-25T15:54:11.226709+0000","last_fullsized":"2024-04-25T15:54:11.226709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228821+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:11.228821+0000","last_peered":"2024-04-25T15:54:11.228821+0000","last_clean":"2024-04-25T15:54:11.228821+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:11.228821+0000","last_undegraded":"2024-04-25T15:54:11.228821+0000","last_fullsized":"2024-04-25T15:54:11.228821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930369+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:11.930369+0000","last_peered":"2024-04-25T15:54:11.930369+0000","last_clean":"2024-04-25T15:54:11.930369+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:11.930369+0000","last_undegraded":"2024-04-25T15:54:11.930369+0000","last_fullsized":"2024-04-25T15:54:11.930369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.260996+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:10.260996+0000","last_peered":"2024-04-25T15:54:10.260996+0000","last_clean":"2024-04-25T15:54:10.260996+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:10.260996+0000","last_undegraded":"2024-04-25T15:54:10.260996+0000","last_fullsized":"2024-04-25T15:54:10.260996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226218+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:11.226218+0000","last_peered":"2024-04-25T15:54:11.226218+0000","last_clean":"2024-04-25T15:54:11.226218+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:11.226218+0000","last_undegraded":"2024-04-25T15:54:11.226218+0000","last_fullsized":"2024-04-25T15:54:11.226218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930168+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:11.930168+0000","last_peered":"2024-04-25T15:54:11.930168+0000","last_clean":"2024-04-25T15:54:11.930168+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:11.930168+0000","last_undegraded":"2024-04-25T15:54:11.930168+0000","last_fullsized":"2024-04-25T15:54:11.930168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930987+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:11.930987+0000","last_peered":"2024-04-25T15:54:11.930987+0000","last_clean":"2024-04-25T15:54:11.930987+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:11.930987+0000","last_undegraded":"2024-04-25T15:54:11.930987+0000","last_fullsized":"2024-04-25T15:54:11.930987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.251432+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:10.251432+0000","last_peered":"2024-04-25T15:54:10.251432+0000","last_clean":"2024-04-25T15:54:10.251432+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:10.251432+0000","last_undegraded":"2024-04-25T15:54:10.251432+0000","last_fullsized":"2024-04-25T15:54:10.251432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.225971+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:11.225971+0000","last_peered":"2024-04-25T15:54:11.225971+0000","last_clean":"2024-04-25T15:54:11.225971+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:11.225971+0000","last_undegraded":"2024-04-25T15:54:11.225971+0000","last_fullsized":"2024-04-25T15:54:11.225971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230091+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:11.230091+0000","last_peered":"2024-04-25T15:54:11.230091+0000","last_clean":"2024-04-25T15:54:11.230091+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:11.230091+0000","last_undegraded":"2024-04-25T15:54:11.230091+0000","last_fullsized":"2024-04-25T15:54:11.230091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.291737+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:10.291737+0000","last_peered":"2024-04-25T15:54:10.291737+0000","last_clean":"2024-04-25T15:54:10.291737+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:10.291737+0000","last_undegraded":"2024-04-25T15:54:10.291737+0000","last_fullsized":"2024-04-25T15:54:10.291737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.249968+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:10.249968+0000","last_peered":"2024-04-25T15:54:10.249968+0000","last_clean":"2024-04-25T15:54:10.249968+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:10.249968+0000","last_undegraded":"2024-04-25T15:54:10.249968+0000","last_fullsized":"2024-04-25T15:54:10.249968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.269748+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:10.269748+0000","last_peered":"2024-04-25T15:54:10.269748+0000","last_clean":"2024-04-25T15:54:10.269748+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:10.269748+0000","last_undegraded":"2024-04-25T15:54:10.269748+0000","last_fullsized":"2024-04-25T15:54:10.269748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226802+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:11.226802+0000","last_peered":"2024-04-25T15:54:11.226802+0000","last_clean":"2024-04-25T15:54:11.226802+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:11.226802+0000","last_undegraded":"2024-04-25T15:54:11.226802+0000","last_fullsized":"2024-04-25T15:54:11.226802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230088+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:11.230088+0000","last_peered":"2024-04-25T15:54:11.230088+0000","last_clean":"2024-04-25T15:54:11.230088+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:11.230088+0000","last_undegraded":"2024-04-25T15:54:11.230088+0000","last_fullsized":"2024-04-25T15:54:11.230088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.227280+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:11.227280+0000","last_peered":"2024-04-25T15:54:11.227280+0000","last_clean":"2024-04-25T15:54:11.227280+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:11.227280+0000","last_undegraded":"2024-04-25T15:54:11.227280+0000","last_fullsized":"2024-04-25T15:54:11.227280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299298+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:10.299298+0000","last_peered":"2024-04-25T15:54:10.299298+0000","last_clean":"2024-04-25T15:54:10.299298+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:10.299298+0000","last_undegraded":"2024-04-25T15:54:10.299298+0000","last_fullsized":"2024-04-25T15:54:10.299298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.273122+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:10.273122+0000","last_peered":"2024-04-25T15:54:10.273122+0000","last_clean":"2024-04-25T15:54:10.273122+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:10.273122+0000","last_undegraded":"2024-04-25T15:54:10.273122+0000","last_fullsized":"2024-04-25T15:54:10.273122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.262739+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:10.262739+0000","last_peered":"2024-04-25T15:54:10.262739+0000","last_clean":"2024-04-25T15:54:10.262739+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:10.262739+0000","last_undegraded":"2024-04-25T15:54:10.262739+0000","last_fullsized":"2024-04-25T15:54:10.262739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.259423+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:10.259423+0000","last_peered":"2024-04-25T15:54:10.259423+0000","last_clean":"2024-04-25T15:54:10.259423+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:10.259423+0000","last_undegraded":"2024-04-25T15:54:10.259423+0000","last_fullsized":"2024-04-25T15:54:10.259423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.297340+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:10.297340+0000","last_peered":"2024-04-25T15:54:10.297340+0000","last_clean":"2024-04-25T15:54:10.297340+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:10.297340+0000","last_undegraded":"2024-04-25T15:54:10.297340+0000","last_fullsized":"2024-04-25T15:54:10.297340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226853+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:11.226853+0000","last_peered":"2024-04-25T15:54:11.226853+0000","last_clean":"2024-04-25T15:54:11.226853+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:11.226853+0000","last_undegraded":"2024-04-25T15:54:11.226853+0000","last_fullsized":"2024-04-25T15:54:11.226853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226910+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:11.226910+0000","last_peered":"2024-04-25T15:54:11.226910+0000","last_clean":"2024-04-25T15:54:11.226910+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:11.226910+0000","last_undegraded":"2024-04-25T15:54:11.226910+0000","last_fullsized":"2024-04-25T15:54:11.226910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.268987+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:10.268987+0000","last_peered":"2024-04-25T15:54:10.268987+0000","last_clean":"2024-04-25T15:54:10.268987+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:10.268987+0000","last_undegraded":"2024-04-25T15:54:10.268987+0000","last_fullsized":"2024-04-25T15:54:10.268987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299196+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:10.299196+0000","last_peered":"2024-04-25T15:54:10.299196+0000","last_clean":"2024-04-25T15:54:10.299196+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:10.299196+0000","last_undegraded":"2024-04-25T15:54:10.299196+0000","last_fullsized":"2024-04-25T15:54:10.299196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230278+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:11.230278+0000","last_peered":"2024-04-25T15:54:11.230278+0000","last_clean":"2024-04-25T15:54:11.230278+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:11.230278+0000","last_undegraded":"2024-04-25T15:54:11.230278+0000","last_fullsized":"2024-04-25T15:54:11.230278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.297383+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:10.297383+0000","last_peered":"2024-04-25T15:54:10.297383+0000","last_clean":"2024-04-25T15:54:10.297383+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:10.297383+0000","last_undegraded":"2024-04-25T15:54:10.297383+0000","last_fullsized":"2024-04-25T15:54:10.297383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.264539+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:10.264539+0000","last_peered":"2024-04-25T15:54:10.264539+0000","last_clean":"2024-04-25T15:54:10.264539+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:10.264539+0000","last_undegraded":"2024-04-25T15:54:10.264539+0000","last_fullsized":"2024-04-25T15:54:10.264539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.300609+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:10.300609+0000","last_peered":"2024-04-25T15:54:10.300609+0000","last_clean":"2024-04-25T15:54:10.300609+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:10.300609+0000","last_undegraded":"2024-04-25T15:54:10.300609+0000","last_fullsized":"2024-04-25T15:54:10.300609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226799+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:11.226799+0000","last_peered":"2024-04-25T15:54:11.226799+0000","last_clean":"2024-04-25T15:54:11.226799+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:11.226799+0000","last_undegraded":"2024-04-25T15:54:11.226799+0000","last_fullsized":"2024-04-25T15:54:11.226799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.280129+0000","last_change":"2024-04-25T15:54:10.271652+0000","last_active":"2024-04-25T15:54:10.280129+0000","last_peered":"2024-04-25T15:54:10.280129+0000","last_clean":"2024-04-25T15:54:10.280129+0000","last_became_active":"2024-04-25T15:54:10.270697+0000","last_became_peered":"2024-04-25T15:54:10.270697+0000","last_unstale":"2024-04-25T15:54:10.280129+0000","last_undegraded":"2024-04-25T15:54:10.280129+0000","last_fullsized":"2024-04-25T15:54:10.280129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:01.578701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.234398+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:10.234398+0000","last_peered":"2024-04-25T15:54:10.234398+0000","last_clean":"2024-04-25T15:54:10.234398+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:10.234398+0000","last_undegraded":"2024-04-25T15:54:10.234398+0000","last_fullsized":"2024-04-25T15:54:10.234398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299368+0000","last_change":"2024-04-25T15:54:10.294873+0000","last_active":"2024-04-25T15:54:10.299368+0000","last_peered":"2024-04-25T15:54:10.299368+0000","last_clean":"2024-04-25T15:54:10.299368+0000","last_became_active":"2024-04-25T15:54:10.291885+0000","last_became_peered":"2024-04-25T15:54:10.291885+0000","last_unstale":"2024-04-25T15:54:10.299368+0000","last_undegraded":"2024-04-25T15:54:10.299368+0000","last_fullsized":"2024-04-25T15:54:10.299368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":108,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.247191+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:10.247191+0000","last_peered":"2024-04-25T15:54:10.247191+0000","last_clean":"2024-04-25T15:54:10.247191+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:10.247191+0000","last_undegraded":"2024-04-25T15:54:10.247191+0000","last_fullsized":"2024-04-25T15:54:10.247191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.240400+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:10.240400+0000","last_peered":"2024-04-25T15:54:10.240400+0000","last_clean":"2024-04-25T15:54:10.240400+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:10.240400+0000","last_undegraded":"2024-04-25T15:54:10.240400+0000","last_fullsized":"2024-04-25T15:54:10.240400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930211+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:11.930211+0000","last_peered":"2024-04-25T15:54:11.930211+0000","last_clean":"2024-04-25T15:54:11.930211+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:11.930211+0000","last_undegraded":"2024-04-25T15:54:11.930211+0000","last_fullsized":"2024-04-25T15:54:11.930211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.247088+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:10.247088+0000","last_peered":"2024-04-25T15:54:10.247088+0000","last_clean":"2024-04-25T15:54:10.247088+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:10.247088+0000","last_undegraded":"2024-04-25T15:54:10.247088+0000","last_fullsized":"2024-04-25T15:54:10.247088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243190+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:10.243190+0000","last_peered":"2024-04-25T15:54:10.243190+0000","last_clean":"2024-04-25T15:54:10.243190+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:10.243190+0000","last_undegraded":"2024-04-25T15:54:10.243190+0000","last_fullsized":"2024-04-25T15:54:10.243190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:37.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.236116+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:10.236116+0000","last_peered":"2024-04-25T15:54:10.236116+0000","last_clean":"2024-04-25T15:54:10.236116+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:10.236116+0000","last_undegraded":"2024-04-25T15:54:10.236116+0000","last_fullsized":"2024-04-25T15:54:10.236116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226000+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:11.226000+0000","last_peered":"2024-04-25T15:54:11.226000+0000","last_clean":"2024-04-25T15:54:11.226000+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:11.226000+0000","last_undegraded":"2024-04-25T15:54:11.226000+0000","last_fullsized":"2024-04-25T15:54:11.226000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.259879+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:10.259879+0000","last_peered":"2024-04-25T15:54:10.259879+0000","last_clean":"2024-04-25T15:54:10.259879+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:10.259879+0000","last_undegraded":"2024-04-25T15:54:10.259879+0000","last_fullsized":"2024-04-25T15:54:10.259879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.229704+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:11.229704+0000","last_peered":"2024-04-25T15:54:11.229704+0000","last_clean":"2024-04-25T15:54:11.229704+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:11.229704+0000","last_undegraded":"2024-04-25T15:54:11.229704+0000","last_fullsized":"2024-04-25T15:54:11.229704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226900+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:11.226900+0000","last_peered":"2024-04-25T15:54:11.226900+0000","last_clean":"2024-04-25T15:54:11.226900+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:11.226900+0000","last_undegraded":"2024-04-25T15:54:11.226900+0000","last_fullsized":"2024-04-25T15:54:11.226900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290770+0000","last_change":"2024-04-25T15:54:10.285534+0000","last_active":"2024-04-25T15:54:10.290770+0000","last_peered":"2024-04-25T15:54:10.290770+0000","last_clean":"2024-04-25T15:54:10.290770+0000","last_became_active":"2024-04-25T15:54:10.279471+0000","last_became_peered":"2024-04-25T15:54:10.279471+0000","last_unstale":"2024-04-25T15:54:10.290770+0000","last_undegraded":"2024-04-25T15:54:10.290770+0000","last_fullsized":"2024-04-25T15:54:10.290770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.265364+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:10.265364+0000","last_peered":"2024-04-25T15:54:10.265364+0000","last_clean":"2024-04-25T15:54:10.265364+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:10.265364+0000","last_undegraded":"2024-04-25T15:54:10.265364+0000","last_fullsized":"2024-04-25T15:54:10.265364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226948+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:11.226948+0000","last_peered":"2024-04-25T15:54:11.226948+0000","last_clean":"2024-04-25T15:54:11.226948+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:11.226948+0000","last_undegraded":"2024-04-25T15:54:11.226948+0000","last_fullsized":"2024-04-25T15:54:11.226948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.227016+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:11.227016+0000","last_peered":"2024-04-25T15:54:11.227016+0000","last_clean":"2024-04-25T15:54:11.227016+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:11.227016+0000","last_undegraded":"2024-04-25T15:54:11.227016+0000","last_fullsized":"2024-04-25T15:54:11.227016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930940+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:11.930940+0000","last_peered":"2024-04-25T15:54:11.930940+0000","last_clean":"2024-04-25T15:54:11.930940+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:11.930940+0000","last_undegraded":"2024-04-25T15:54:11.930940+0000","last_fullsized":"2024-04-25T15:54:11.930940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230265+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:11.230265+0000","last_peered":"2024-04-25T15:54:11.230265+0000","last_clean":"2024-04-25T15:54:11.230265+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:11.230265+0000","last_undegraded":"2024-04-25T15:54:11.230265+0000","last_fullsized":"2024-04-25T15:54:11.230265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243473+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:10.243473+0000","last_peered":"2024-04-25T15:54:10.243473+0000","last_clean":"2024-04-25T15:54:10.243473+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:10.243473+0000","last_undegraded":"2024-04-25T15:54:10.243473+0000","last_fullsized":"2024-04-25T15:54:10.243473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:34.930900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.247006+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:10.247006+0000","last_peered":"2024-04-25T15:54:10.247006+0000","last_clean":"2024-04-25T15:54:10.247006+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:10.247006+0000","last_undegraded":"2024-04-25T15:54:10.247006+0000","last_fullsized":"2024-04-25T15:54:10.247006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228703+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:11.228703+0000","last_peered":"2024-04-25T15:54:11.228703+0000","last_clean":"2024-04-25T15:54:11.228703+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:11.228703+0000","last_undegraded":"2024-04-25T15:54:11.228703+0000","last_fullsized":"2024-04-25T15:54:11.228703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226099+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:11.226099+0000","last_peered":"2024-04-25T15:54:11.226099+0000","last_clean":"2024-04-25T15:54:11.226099+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:11.226099+0000","last_undegraded":"2024-04-25T15:54:11.226099+0000","last_fullsized":"2024-04-25T15:54:11.226099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930162+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:11.930162+0000","last_peered":"2024-04-25T15:54:11.930162+0000","last_clean":"2024-04-25T15:54:11.930162+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:11.930162+0000","last_undegraded":"2024-04-25T15:54:11.930162+0000","last_fullsized":"2024-04-25T15:54:11.930162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226457+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:11.226457+0000","last_peered":"2024-04-25T15:54:11.226457+0000","last_clean":"2024-04-25T15:54:11.226457+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:11.226457+0000","last_undegraded":"2024-04-25T15:54:11.226457+0000","last_fullsized":"2024-04-25T15:54:11.226457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930188+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:11.930188+0000","last_peered":"2024-04-25T15:54:11.930188+0000","last_clean":"2024-04-25T15:54:11.930188+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:11.930188+0000","last_undegraded":"2024-04-25T15:54:11.930188+0000","last_fullsized":"2024-04-25T15:54:11.930188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.295578+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:10.295578+0000","last_peered":"2024-04-25T15:54:10.295578+0000","last_clean":"2024-04-25T15:54:10.295578+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:10.295578+0000","last_undegraded":"2024-04-25T15:54:10.295578+0000","last_fullsized":"2024-04-25T15:54:10.295578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226328+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:11.226328+0000","last_peered":"2024-04-25T15:54:11.226328+0000","last_clean":"2024-04-25T15:54:11.226328+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:11.226328+0000","last_undegraded":"2024-04-25T15:54:11.226328+0000","last_fullsized":"2024-04-25T15:54:11.226328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290652+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:10.290652+0000","last_peered":"2024-04-25T15:54:10.290652+0000","last_clean":"2024-04-25T15:54:10.290652+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:10.290652+0000","last_undegraded":"2024-04-25T15:54:10.290652+0000","last_fullsized":"2024-04-25T15:54:10.290652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.295541+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:10.295541+0000","last_peered":"2024-04-25T15:54:10.295541+0000","last_clean":"2024-04-25T15:54:10.295541+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:10.295541+0000","last_undegraded":"2024-04-25T15:54:10.295541+0000","last_fullsized":"2024-04-25T15:54:10.295541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.280069+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:10.280069+0000","last_peered":"2024-04-25T15:54:10.280069+0000","last_clean":"2024-04-25T15:54:10.280069+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:10.280069+0000","last_undegraded":"2024-04-25T15:54:10.280069+0000","last_fullsized":"2024-04-25T15:54:10.280069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.297287+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:10.297287+0000","last_peered":"2024-04-25T15:54:10.297287+0000","last_clean":"2024-04-25T15:54:10.297287+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:10.297287+0000","last_undegraded":"2024-04-25T15:54:10.297287+0000","last_fullsized":"2024-04-25T15:54:10.297287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.263353+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:10.263353+0000","last_peered":"2024-04-25T15:54:10.263353+0000","last_clean":"2024-04-25T15:54:10.263353+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:10.263353+0000","last_undegraded":"2024-04-25T15:54:10.263353+0000","last_fullsized":"2024-04-25T15:54:10.263353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930926+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:11.930926+0000","last_peered":"2024-04-25T15:54:11.930926+0000","last_clean":"2024-04-25T15:54:11.930926+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:11.930926+0000","last_undegraded":"2024-04-25T15:54:11.930926+0000","last_fullsized":"2024-04-25T15:54:11.930926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930757+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:11.930757+0000","last_peered":"2024-04-25T15:54:11.930757+0000","last_clean":"2024-04-25T15:54:11.930757+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:11.930757+0000","last_undegraded":"2024-04-25T15:54:11.930757+0000","last_fullsized":"2024-04-25T15:54:11.930757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.298478+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:10.298478+0000","last_peered":"2024-04-25T15:54:10.298478+0000","last_clean":"2024-04-25T15:54:10.298478+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:10.298478+0000","last_undegraded":"2024-04-25T15:54:10.298478+0000","last_fullsized":"2024-04-25T15:54:10.298478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":70980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:15.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:15.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.565+0000 7fb69a803640 1 Processor -- start 2024-04-25T15:54:15.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.565+0000 7fb69a803640 1 -- start start 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb69a803640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb694157530 0x7fb694074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb69a803640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6940c92d0 0x7fb694161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb69a803640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6940c53b0 con 0x7fb6940746a0 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb69a803640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb694157940 con 0x7fb6940c92d0 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb69a803640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb6940c96e0 con 0x7fb694157530 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb698da0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6940c92d0 0x7fb694161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb6937fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb6940746a0 0x7fb6940c8bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36866/0 (socket says 172.21.15.87:36866) 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb6937fe640 1 -- 172.21.15.87:0/1266973213 learned_addr learned my addr 172.21.15.87:0/1266973213 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb698da0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb6940c92d0 0x7fb694161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60338/0 (socket says 172.21.15.87:60338) 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb693fff640 1 --2- 172.21.15.87:0/1266973213 >> v2:172.21.15.155:3300/0 conn(0x7fb694157530 0x7fb694074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb698da0640 1 -- 172.21.15.87:0/1266973213 >> v2:172.21.15.155:3300/0 conn(0x7fb694157530 msgr2=0x7fb694074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:15.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb698da0640 1 --2- 172.21.15.87:0/1266973213 >> v2:172.21.15.155:3300/0 conn(0x7fb694157530 0x7fb694074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb698da0640 1 -- 172.21.15.87:0/1266973213 >> v1:172.21.15.87:6789/0 conn(0x7fb6940746a0 legacy=0x7fb6940c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb692ffd640 1 -- 172.21.15.87:0/1266973213 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831112229 0 0) 0x7fb67c001120 con 0x7fb6940746a0 2024-04-25T15:54:15.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.569+0000 7fb698da0640 1 -- 172.21.15.87:0/1266973213 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb694157b60 con 0x7fb6940c92d0 2024-04-25T15:54:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb698da0640 1 --2- 172.21.15.87:0/1266973213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940c92d0 0x7fb694161eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb69406bb90 tx=0x7fb68401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcd435546ccb509 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb692ffd640 1 -- 172.21.15.87:0/1266973213 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6840b0070 con 0x7fb6940c92d0 2024-04-25T15:54:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb692ffd640 1 -- 172.21.15.87:0/1266973213 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6840ab600 con 0x7fb6940c92d0 2024-04-25T15:54:15.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb692ffd640 1 -- 172.21.15.87:0/1266973213 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6840ab9d0 con 0x7fb6940c92d0 2024-04-25T15:54:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 -- 172.21.15.87:0/1266973213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940c92d0 msgr2=0x7fb694161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 --2- 172.21.15.87:0/1266973213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940c92d0 0x7fb694161eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb69406bb90 tx=0x7fb68401c330 comp rx=0 tx=0).stop 2024-04-25T15:54:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 -- 172.21.15.87:0/1266973213 shutdown_connections 2024-04-25T15:54:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 --2- 172.21.15.87:0/1266973213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940c92d0 0x7fb694161eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 --2- 172.21.15.87:0/1266973213 >> v2:172.21.15.155:3300/0 conn(0x7fb694157530 0x7fb694074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 -- 172.21.15.87:0/1266973213 >> 172.21.15.87:0/1266973213 conn(0x7fb6940ac550 msgr2=0x7fb6940ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:15.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 -- 172.21.15.87:0/1266973213 shutdown_connections 2024-04-25T15:54:15.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 -- 172.21.15.87:0/1266973213 wait complete. 2024-04-25T15:54:15.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 Processor -- start 2024-04-25T15:54:15.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.573+0000 7fb69a803640 1 -- start start 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 0x7fb6940abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6940c92d0 0x7fb694145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb694157530 0x7fb694144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940aa230 con 0x7fb6940746a0 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940c86a0 con 0x7fb694157530 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb694154df0 con 0x7fb6940c92d0 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 0x7fb6940abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 0x7fb6940abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60342/0 (socket says 172.21.15.87:60342) 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 -- 172.21.15.87:0/2765335160 learned_addr learned my addr 172.21.15.87:0/2765335160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb698da0640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb694157530 0x7fb694144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 -- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6940c92d0 msgr2=0x7fb694145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6940c92d0 0x7fb694145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 -- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb694157530 msgr2=0x7fb694144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb694157530 0x7fb694144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 -- 172.21.15.87:0/2765335160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69414ffd0 con 0x7fb6940746a0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb693fff640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 0x7fb6940abb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb68c007e90 tx=0x7fb68c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c01a070 con 0x7fb6940746a0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c003ba0 con 0x7fb6940746a0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69414eef0 con 0x7fb6940746a0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00ee70 con 0x7fb6940746a0 2024-04-25T15:54:15.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941461a0 con 0x7fb6940746a0 2024-04-25T15:54:15.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb694069bb0 con 0x7fb6940746a0 2024-04-25T15:54:15.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb68c01d070 con 0x7fb6940746a0 2024-04-25T15:54:15.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb690ff9640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb67406f430 0x7fb674071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb6937fe640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb67406f430 0x7fb674071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fb68c08f3d0 con 0x7fb6940746a0 2024-04-25T15:54:15.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.577+0000 7fb6937fe640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb67406f430 0x7fb674071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb694147030 tx=0x7fb67c007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.581+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb68c05bc90 con 0x7fb6940746a0 2024-04-25T15:54:15.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.725+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb694146440 con 0x7fb67406f430 2024-04-25T15:54:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.745+0000 7fb690ff9640 1 -- 172.21.15.87:0/2765335160 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251900 (secure 0 0 0) 0x7fb694146440 con 0x7fb67406f430 2024-04-25T15:54:15.748 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:15.750 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:15.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb67406f430 msgr2=0x7fb674071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb67406f430 0x7fb674071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb694147030 tx=0x7fb67c007970 comp rx=0 tx=0).stop 2024-04-25T15:54:15.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 msgr2=0x7fb6940abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 0x7fb6940abb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb68c007e90 tx=0x7fb68c00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 shutdown_connections 2024-04-25T15:54:15.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb67406f430 0x7fb674071940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb694157530 0x7fb694144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6940c92d0 0x7fb694145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 --2- 172.21.15.87:0/2765335160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6940746a0 0x7fb6940abb70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 >> 172.21.15.87:0/2765335160 conn(0x7fb6940ac550 msgr2=0x7fb694070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 shutdown_connections 2024-04-25T15:54:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.749+0000 7fb69a803640 1 -- 172.21.15.87:0/2765335160 wait complete. 2024-04-25T15:54:15.768 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T15:54:15.102302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218964,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755756,"statfs":{"total":773094113280,"available":772869894144,"internally_reserved":0,"allocated":2830336,"data_stored":1721013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002536"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299774+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:10.299774+0000","last_peered":"2024-04-25T15:54:10.299774+0000","last_clean":"2024-04-25T15:54:10.299774+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:10.299774+0000","last_undegraded":"2024-04-25T15:54:10.299774+0000","last_fullsized":"2024-04-25T15:54:10.299774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226929+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:11.226929+0000","last_peered":"2024-04-25T15:54:11.226929+0000","last_clean":"2024-04-25T15:54:11.226929+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:11.226929+0000","last_undegraded":"2024-04-25T15:54:11.226929+0000","last_fullsized":"2024-04-25T15:54:11.226929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243733+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:10.243733+0000","last_peered":"2024-04-25T15:54:10.243733+0000","last_clean":"2024-04-25T15:54:10.243733+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:10.243733+0000","last_undegraded":"2024-04-25T15:54:10.243733+0000","last_fullsized":"2024-04-25T15:54:10.243733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:21.807724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.289757+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:10.289757+0000","last_peered":"2024-04-25T15:54:10.289757+0000","last_clean":"2024-04-25T15:54:10.289757+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:10.289757+0000","last_undegraded":"2024-04-25T15:54:10.289757+0000","last_fullsized":"2024-04-25T15:54:10.289757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.294710+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:10.294710+0000","last_peered":"2024-04-25T15:54:10.294710+0000","last_clean":"2024-04-25T15:54:10.294710+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:10.294710+0000","last_undegraded":"2024-04-25T15:54:10.294710+0000","last_fullsized":"2024-04-25T15:54:10.294710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290494+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:10.290494+0000","last_peered":"2024-04-25T15:54:10.290494+0000","last_clean":"2024-04-25T15:54:10.290494+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:10.290494+0000","last_undegraded":"2024-04-25T15:54:10.290494+0000","last_fullsized":"2024-04-25T15:54:10.290494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.292506+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:10.292506+0000","last_peered":"2024-04-25T15:54:10.292506+0000","last_clean":"2024-04-25T15:54:10.292506+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:10.292506+0000","last_undegraded":"2024-04-25T15:54:10.292506+0000","last_fullsized":"2024-04-25T15:54:10.292506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:01.578701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.929581+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:11.929581+0000","last_peered":"2024-04-25T15:54:11.929581+0000","last_clean":"2024-04-25T15:54:11.929581+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:11.929581+0000","last_undegraded":"2024-04-25T15:54:11.929581+0000","last_fullsized":"2024-04-25T15:54:11.929581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299812+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:10.299812+0000","last_peered":"2024-04-25T15:54:10.299812+0000","last_clean":"2024-04-25T15:54:10.299812+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:10.299812+0000","last_undegraded":"2024-04-25T15:54:10.299812+0000","last_fullsized":"2024-04-25T15:54:10.299812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228348+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:11.228348+0000","last_peered":"2024-04-25T15:54:11.228348+0000","last_clean":"2024-04-25T15:54:11.228348+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:11.228348+0000","last_undegraded":"2024-04-25T15:54:11.228348+0000","last_fullsized":"2024-04-25T15:54:11.228348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.227061+0000","last_change":"2024-04-25T15:54:10.256856+0000","last_active":"2024-04-25T15:54:11.227061+0000","last_peered":"2024-04-25T15:54:11.227061+0000","last_clean":"2024-04-25T15:54:11.227061+0000","last_became_active":"2024-04-25T15:54:10.256024+0000","last_became_peered":"2024-04-25T15:54:10.256024+0000","last_unstale":"2024-04-25T15:54:11.227061+0000","last_undegraded":"2024-04-25T15:54:11.227061+0000","last_fullsized":"2024-04-25T15:54:11.227061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230005+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:11.230005+0000","last_peered":"2024-04-25T15:54:11.230005+0000","last_clean":"2024-04-25T15:54:11.230005+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:11.230005+0000","last_undegraded":"2024-04-25T15:54:11.230005+0000","last_fullsized":"2024-04-25T15:54:11.230005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930032+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:11.930032+0000","last_peered":"2024-04-25T15:54:11.930032+0000","last_clean":"2024-04-25T15:54:11.930032+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:11.930032+0000","last_undegraded":"2024-04-25T15:54:11.930032+0000","last_fullsized":"2024-04-25T15:54:11.930032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243424+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:10.243424+0000","last_peered":"2024-04-25T15:54:10.243424+0000","last_clean":"2024-04-25T15:54:10.243424+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:10.243424+0000","last_undegraded":"2024-04-25T15:54:10.243424+0000","last_fullsized":"2024-04-25T15:54:10.243424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:51.303833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226247+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:11.226247+0000","last_peered":"2024-04-25T15:54:11.226247+0000","last_clean":"2024-04-25T15:54:11.226247+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:11.226247+0000","last_undegraded":"2024-04-25T15:54:11.226247+0000","last_fullsized":"2024-04-25T15:54:11.226247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.282061+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:10.282061+0000","last_peered":"2024-04-25T15:54:10.282061+0000","last_clean":"2024-04-25T15:54:10.282061+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:10.282061+0000","last_undegraded":"2024-04-25T15:54:10.282061+0000","last_fullsized":"2024-04-25T15:54:10.282061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.278073+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:10.278073+0000","last_peered":"2024-04-25T15:54:10.278073+0000","last_clean":"2024-04-25T15:54:10.278073+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:10.278073+0000","last_undegraded":"2024-04-25T15:54:10.278073+0000","last_fullsized":"2024-04-25T15:54:10.278073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.262965+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:10.262965+0000","last_peered":"2024-04-25T15:54:10.262965+0000","last_clean":"2024-04-25T15:54:10.262965+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:10.262965+0000","last_undegraded":"2024-04-25T15:54:10.262965+0000","last_fullsized":"2024-04-25T15:54:10.262965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299467+0000","last_change":"2024-04-25T15:54:10.295088+0000","last_active":"2024-04-25T15:54:10.299467+0000","last_peered":"2024-04-25T15:54:10.299467+0000","last_clean":"2024-04-25T15:54:10.299467+0000","last_became_active":"2024-04-25T15:54:10.292412+0000","last_became_peered":"2024-04-25T15:54:10.292412+0000","last_unstale":"2024-04-25T15:54:10.299467+0000","last_undegraded":"2024-04-25T15:54:10.299467+0000","last_fullsized":"2024-04-25T15:54:10.299467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226662+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:11.226662+0000","last_peered":"2024-04-25T15:54:11.226662+0000","last_clean":"2024-04-25T15:54:11.226662+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:11.226662+0000","last_undegraded":"2024-04-25T15:54:11.226662+0000","last_fullsized":"2024-04-25T15:54:11.226662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.269247+0000","last_change":"2024-04-25T15:54:10.267602+0000","last_active":"2024-04-25T15:54:10.269247+0000","last_peered":"2024-04-25T15:54:10.269247+0000","last_clean":"2024-04-25T15:54:10.269247+0000","last_became_active":"2024-04-25T15:54:10.267276+0000","last_became_peered":"2024-04-25T15:54:10.267276+0000","last_unstale":"2024-04-25T15:54:10.269247+0000","last_undegraded":"2024-04-25T15:54:10.269247+0000","last_fullsized":"2024-04-25T15:54:10.269247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.295913+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:10.295913+0000","last_peered":"2024-04-25T15:54:10.295913+0000","last_clean":"2024-04-25T15:54:10.295913+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:10.295913+0000","last_undegraded":"2024-04-25T15:54:10.295913+0000","last_fullsized":"2024-04-25T15:54:10.295913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.929655+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:11.929655+0000","last_peered":"2024-04-25T15:54:11.929655+0000","last_clean":"2024-04-25T15:54:11.929655+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:11.929655+0000","last_undegraded":"2024-04-25T15:54:11.929655+0000","last_fullsized":"2024-04-25T15:54:11.929655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290472+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:10.290472+0000","last_peered":"2024-04-25T15:54:10.290472+0000","last_clean":"2024-04-25T15:54:10.290472+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:10.290472+0000","last_undegraded":"2024-04-25T15:54:10.290472+0000","last_fullsized":"2024-04-25T15:54:10.290472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.931029+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:11.931029+0000","last_peered":"2024-04-25T15:54:11.931029+0000","last_clean":"2024-04-25T15:54:11.931029+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:11.931029+0000","last_undegraded":"2024-04-25T15:54:11.931029+0000","last_fullsized":"2024-04-25T15:54:11.931029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228391+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:11.228391+0000","last_peered":"2024-04-25T15:54:11.228391+0000","last_clean":"2024-04-25T15:54:11.228391+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:11.228391+0000","last_undegraded":"2024-04-25T15:54:11.228391+0000","last_fullsized":"2024-04-25T15:54:11.228391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226634+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:11.226634+0000","last_peered":"2024-04-25T15:54:11.226634+0000","last_clean":"2024-04-25T15:54:11.226634+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:11.226634+0000","last_undegraded":"2024-04-25T15:54:11.226634+0000","last_fullsized":"2024-04-25T15:54:11.226634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930498+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:11.930498+0000","last_peered":"2024-04-25T15:54:11.930498+0000","last_clean":"2024-04-25T15:54:11.930498+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:11.930498+0000","last_undegraded":"2024-04-25T15:54:11.930498+0000","last_fullsized":"2024-04-25T15:54:11.930498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243348+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:10.243348+0000","last_peered":"2024-04-25T15:54:10.243348+0000","last_clean":"2024-04-25T15:54:10.243348+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:10.243348+0000","last_undegraded":"2024-04-25T15:54:10.243348+0000","last_fullsized":"2024-04-25T15:54:10.243348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:34.686872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290571+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:10.290571+0000","last_peered":"2024-04-25T15:54:10.290571+0000","last_clean":"2024-04-25T15:54:10.290571+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:10.290571+0000","last_undegraded":"2024-04-25T15:54:10.290571+0000","last_fullsized":"2024-04-25T15:54:10.290571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.263021+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:10.263021+0000","last_peered":"2024-04-25T15:54:10.263021+0000","last_clean":"2024-04-25T15:54:10.263021+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:10.263021+0000","last_undegraded":"2024-04-25T15:54:10.263021+0000","last_fullsized":"2024-04-25T15:54:10.263021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226709+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:11.226709+0000","last_peered":"2024-04-25T15:54:11.226709+0000","last_clean":"2024-04-25T15:54:11.226709+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:11.226709+0000","last_undegraded":"2024-04-25T15:54:11.226709+0000","last_fullsized":"2024-04-25T15:54:11.226709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228821+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:11.228821+0000","last_peered":"2024-04-25T15:54:11.228821+0000","last_clean":"2024-04-25T15:54:11.228821+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:11.228821+0000","last_undegraded":"2024-04-25T15:54:11.228821+0000","last_fullsized":"2024-04-25T15:54:11.228821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930369+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:11.930369+0000","last_peered":"2024-04-25T15:54:11.930369+0000","last_clean":"2024-04-25T15:54:11.930369+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:11.930369+0000","last_undegraded":"2024-04-25T15:54:11.930369+0000","last_fullsized":"2024-04-25T15:54:11.930369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.260996+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:10.260996+0000","last_peered":"2024-04-25T15:54:10.260996+0000","last_clean":"2024-04-25T15:54:10.260996+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:10.260996+0000","last_undegraded":"2024-04-25T15:54:10.260996+0000","last_fullsized":"2024-04-25T15:54:10.260996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226218+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:11.226218+0000","last_peered":"2024-04-25T15:54:11.226218+0000","last_clean":"2024-04-25T15:54:11.226218+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:11.226218+0000","last_undegraded":"2024-04-25T15:54:11.226218+0000","last_fullsized":"2024-04-25T15:54:11.226218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930168+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:11.930168+0000","last_peered":"2024-04-25T15:54:11.930168+0000","last_clean":"2024-04-25T15:54:11.930168+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:11.930168+0000","last_undegraded":"2024-04-25T15:54:11.930168+0000","last_fullsized":"2024-04-25T15:54:11.930168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930987+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:11.930987+0000","last_peered":"2024-04-25T15:54:11.930987+0000","last_clean":"2024-04-25T15:54:11.930987+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:11.930987+0000","last_undegraded":"2024-04-25T15:54:11.930987+0000","last_fullsized":"2024-04-25T15:54:11.930987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.251432+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:10.251432+0000","last_peered":"2024-04-25T15:54:10.251432+0000","last_clean":"2024-04-25T15:54:10.251432+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:10.251432+0000","last_undegraded":"2024-04-25T15:54:10.251432+0000","last_fullsized":"2024-04-25T15:54:10.251432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.225971+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:11.225971+0000","last_peered":"2024-04-25T15:54:11.225971+0000","last_clean":"2024-04-25T15:54:11.225971+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:11.225971+0000","last_undegraded":"2024-04-25T15:54:11.225971+0000","last_fullsized":"2024-04-25T15:54:11.225971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230091+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:11.230091+0000","last_peered":"2024-04-25T15:54:11.230091+0000","last_clean":"2024-04-25T15:54:11.230091+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:11.230091+0000","last_undegraded":"2024-04-25T15:54:11.230091+0000","last_fullsized":"2024-04-25T15:54:11.230091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.291737+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:10.291737+0000","last_peered":"2024-04-25T15:54:10.291737+0000","last_clean":"2024-04-25T15:54:10.291737+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:10.291737+0000","last_undegraded":"2024-04-25T15:54:10.291737+0000","last_fullsized":"2024-04-25T15:54:10.291737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.249968+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:10.249968+0000","last_peered":"2024-04-25T15:54:10.249968+0000","last_clean":"2024-04-25T15:54:10.249968+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:10.249968+0000","last_undegraded":"2024-04-25T15:54:10.249968+0000","last_fullsized":"2024-04-25T15:54:10.249968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.269748+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:10.269748+0000","last_peered":"2024-04-25T15:54:10.269748+0000","last_clean":"2024-04-25T15:54:10.269748+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:10.269748+0000","last_undegraded":"2024-04-25T15:54:10.269748+0000","last_fullsized":"2024-04-25T15:54:10.269748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226802+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:11.226802+0000","last_peered":"2024-04-25T15:54:11.226802+0000","last_clean":"2024-04-25T15:54:11.226802+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:11.226802+0000","last_undegraded":"2024-04-25T15:54:11.226802+0000","last_fullsized":"2024-04-25T15:54:11.226802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230088+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:11.230088+0000","last_peered":"2024-04-25T15:54:11.230088+0000","last_clean":"2024-04-25T15:54:11.230088+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:11.230088+0000","last_undegraded":"2024-04-25T15:54:11.230088+0000","last_fullsized":"2024-04-25T15:54:11.230088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.227280+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:11.227280+0000","last_peered":"2024-04-25T15:54:11.227280+0000","last_clean":"2024-04-25T15:54:11.227280+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:11.227280+0000","last_undegraded":"2024-04-25T15:54:11.227280+0000","last_fullsized":"2024-04-25T15:54:11.227280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299298+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:10.299298+0000","last_peered":"2024-04-25T15:54:10.299298+0000","last_clean":"2024-04-25T15:54:10.299298+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:10.299298+0000","last_undegraded":"2024-04-25T15:54:10.299298+0000","last_fullsized":"2024-04-25T15:54:10.299298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.273122+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:10.273122+0000","last_peered":"2024-04-25T15:54:10.273122+0000","last_clean":"2024-04-25T15:54:10.273122+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:10.273122+0000","last_undegraded":"2024-04-25T15:54:10.273122+0000","last_fullsized":"2024-04-25T15:54:10.273122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.262739+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:10.262739+0000","last_peered":"2024-04-25T15:54:10.262739+0000","last_clean":"2024-04-25T15:54:10.262739+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:10.262739+0000","last_undegraded":"2024-04-25T15:54:10.262739+0000","last_fullsized":"2024-04-25T15:54:10.262739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.259423+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:10.259423+0000","last_peered":"2024-04-25T15:54:10.259423+0000","last_clean":"2024-04-25T15:54:10.259423+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:10.259423+0000","last_undegraded":"2024-04-25T15:54:10.259423+0000","last_fullsized":"2024-04-25T15:54:10.259423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.297340+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:10.297340+0000","last_peered":"2024-04-25T15:54:10.297340+0000","last_clean":"2024-04-25T15:54:10.297340+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:10.297340+0000","last_undegraded":"2024-04-25T15:54:10.297340+0000","last_fullsized":"2024-04-25T15:54:10.297340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226853+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:11.226853+0000","last_peered":"2024-04-25T15:54:11.226853+0000","last_clean":"2024-04-25T15:54:11.226853+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:11.226853+0000","last_undegraded":"2024-04-25T15:54:11.226853+0000","last_fullsized":"2024-04-25T15:54:11.226853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226910+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:11.226910+0000","last_peered":"2024-04-25T15:54:11.226910+0000","last_clean":"2024-04-25T15:54:11.226910+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:11.226910+0000","last_undegraded":"2024-04-25T15:54:11.226910+0000","last_fullsized":"2024-04-25T15:54:11.226910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.268987+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:10.268987+0000","last_peered":"2024-04-25T15:54:10.268987+0000","last_clean":"2024-04-25T15:54:10.268987+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:10.268987+0000","last_undegraded":"2024-04-25T15:54:10.268987+0000","last_fullsized":"2024-04-25T15:54:10.268987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299196+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:10.299196+0000","last_peered":"2024-04-25T15:54:10.299196+0000","last_clean":"2024-04-25T15:54:10.299196+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:10.299196+0000","last_undegraded":"2024-04-25T15:54:10.299196+0000","last_fullsized":"2024-04-25T15:54:10.299196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230278+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:11.230278+0000","last_peered":"2024-04-25T15:54:11.230278+0000","last_clean":"2024-04-25T15:54:11.230278+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:11.230278+0000","last_undegraded":"2024-04-25T15:54:11.230278+0000","last_fullsized":"2024-04-25T15:54:11.230278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.297383+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:10.297383+0000","last_peered":"2024-04-25T15:54:10.297383+0000","last_clean":"2024-04-25T15:54:10.297383+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:10.297383+0000","last_undegraded":"2024-04-25T15:54:10.297383+0000","last_fullsized":"2024-04-25T15:54:10.297383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.264539+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:10.264539+0000","last_peered":"2024-04-25T15:54:10.264539+0000","last_clean":"2024-04-25T15:54:10.264539+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:10.264539+0000","last_undegraded":"2024-04-25T15:54:10.264539+0000","last_fullsized":"2024-04-25T15:54:10.264539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.300609+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:10.300609+0000","last_peered":"2024-04-25T15:54:10.300609+0000","last_clean":"2024-04-25T15:54:10.300609+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:10.300609+0000","last_undegraded":"2024-04-25T15:54:10.300609+0000","last_fullsized":"2024-04-25T15:54:10.300609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226799+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:11.226799+0000","last_peered":"2024-04-25T15:54:11.226799+0000","last_clean":"2024-04-25T15:54:11.226799+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:11.226799+0000","last_undegraded":"2024-04-25T15:54:11.226799+0000","last_fullsized":"2024-04-25T15:54:11.226799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.280129+0000","last_change":"2024-04-25T15:54:10.271652+0000","last_active":"2024-04-25T15:54:10.280129+0000","last_peered":"2024-04-25T15:54:10.280129+0000","last_clean":"2024-04-25T15:54:10.280129+0000","last_became_active":"2024-04-25T15:54:10.270697+0000","last_became_peered":"2024-04-25T15:54:10.270697+0000","last_unstale":"2024-04-25T15:54:10.280129+0000","last_undegraded":"2024-04-25T15:54:10.280129+0000","last_fullsized":"2024-04-25T15:54:10.280129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:01.578701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.234398+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:10.234398+0000","last_peered":"2024-04-25T15:54:10.234398+0000","last_clean":"2024-04-25T15:54:10.234398+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:10.234398+0000","last_undegraded":"2024-04-25T15:54:10.234398+0000","last_fullsized":"2024-04-25T15:54:10.234398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.299368+0000","last_change":"2024-04-25T15:54:10.294873+0000","last_active":"2024-04-25T15:54:10.299368+0000","last_peered":"2024-04-25T15:54:10.299368+0000","last_clean":"2024-04-25T15:54:10.299368+0000","last_became_active":"2024-04-25T15:54:10.291885+0000","last_became_peered":"2024-04-25T15:54:10.291885+0000","last_unstale":"2024-04-25T15:54:10.299368+0000","last_undegraded":"2024-04-25T15:54:10.299368+0000","last_fullsized":"2024-04-25T15:54:10.299368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":108,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.247191+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:10.247191+0000","last_peered":"2024-04-25T15:54:10.247191+0000","last_clean":"2024-04-25T15:54:10.247191+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:10.247191+0000","last_undegraded":"2024-04-25T15:54:10.247191+0000","last_fullsized":"2024-04-25T15:54:10.247191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.240400+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:10.240400+0000","last_peered":"2024-04-25T15:54:10.240400+0000","last_clean":"2024-04-25T15:54:10.240400+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:10.240400+0000","last_undegraded":"2024-04-25T15:54:10.240400+0000","last_fullsized":"2024-04-25T15:54:10.240400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930211+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:11.930211+0000","last_peered":"2024-04-25T15:54:11.930211+0000","last_clean":"2024-04-25T15:54:11.930211+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:11.930211+0000","last_undegraded":"2024-04-25T15:54:11.930211+0000","last_fullsized":"2024-04-25T15:54:11.930211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.247088+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:10.247088+0000","last_peered":"2024-04-25T15:54:10.247088+0000","last_clean":"2024-04-25T15:54:10.247088+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:10.247088+0000","last_undegraded":"2024-04-25T15:54:10.247088+0000","last_fullsized":"2024-04-25T15:54:10.247088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243190+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:10.243190+0000","last_peered":"2024-04-25T15:54:10.243190+0000","last_clean":"2024-04-25T15:54:10.243190+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:10.243190+0000","last_undegraded":"2024-04-25T15:54:10.243190+0000","last_fullsized":"2024-04-25T15:54:10.243190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:37.654615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.236116+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:10.236116+0000","last_peered":"2024-04-25T15:54:10.236116+0000","last_clean":"2024-04-25T15:54:10.236116+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:10.236116+0000","last_undegraded":"2024-04-25T15:54:10.236116+0000","last_fullsized":"2024-04-25T15:54:10.236116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226000+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:11.226000+0000","last_peered":"2024-04-25T15:54:11.226000+0000","last_clean":"2024-04-25T15:54:11.226000+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:11.226000+0000","last_undegraded":"2024-04-25T15:54:11.226000+0000","last_fullsized":"2024-04-25T15:54:11.226000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.259879+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:10.259879+0000","last_peered":"2024-04-25T15:54:10.259879+0000","last_clean":"2024-04-25T15:54:10.259879+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:10.259879+0000","last_undegraded":"2024-04-25T15:54:10.259879+0000","last_fullsized":"2024-04-25T15:54:10.259879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.229704+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:11.229704+0000","last_peered":"2024-04-25T15:54:11.229704+0000","last_clean":"2024-04-25T15:54:11.229704+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:11.229704+0000","last_undegraded":"2024-04-25T15:54:11.229704+0000","last_fullsized":"2024-04-25T15:54:11.229704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226900+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:11.226900+0000","last_peered":"2024-04-25T15:54:11.226900+0000","last_clean":"2024-04-25T15:54:11.226900+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:11.226900+0000","last_undegraded":"2024-04-25T15:54:11.226900+0000","last_fullsized":"2024-04-25T15:54:11.226900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290770+0000","last_change":"2024-04-25T15:54:10.285534+0000","last_active":"2024-04-25T15:54:10.290770+0000","last_peered":"2024-04-25T15:54:10.290770+0000","last_clean":"2024-04-25T15:54:10.290770+0000","last_became_active":"2024-04-25T15:54:10.279471+0000","last_became_peered":"2024-04-25T15:54:10.279471+0000","last_unstale":"2024-04-25T15:54:10.290770+0000","last_undegraded":"2024-04-25T15:54:10.290770+0000","last_fullsized":"2024-04-25T15:54:10.290770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.265364+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:10.265364+0000","last_peered":"2024-04-25T15:54:10.265364+0000","last_clean":"2024-04-25T15:54:10.265364+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:10.265364+0000","last_undegraded":"2024-04-25T15:54:10.265364+0000","last_fullsized":"2024-04-25T15:54:10.265364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226948+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:11.226948+0000","last_peered":"2024-04-25T15:54:11.226948+0000","last_clean":"2024-04-25T15:54:11.226948+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:11.226948+0000","last_undegraded":"2024-04-25T15:54:11.226948+0000","last_fullsized":"2024-04-25T15:54:11.226948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.227016+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:11.227016+0000","last_peered":"2024-04-25T15:54:11.227016+0000","last_clean":"2024-04-25T15:54:11.227016+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:11.227016+0000","last_undegraded":"2024-04-25T15:54:11.227016+0000","last_fullsized":"2024-04-25T15:54:11.227016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930940+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:11.930940+0000","last_peered":"2024-04-25T15:54:11.930940+0000","last_clean":"2024-04-25T15:54:11.930940+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:11.930940+0000","last_undegraded":"2024-04-25T15:54:11.930940+0000","last_fullsized":"2024-04-25T15:54:11.930940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.230265+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:11.230265+0000","last_peered":"2024-04-25T15:54:11.230265+0000","last_clean":"2024-04-25T15:54:11.230265+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:11.230265+0000","last_undegraded":"2024-04-25T15:54:11.230265+0000","last_fullsized":"2024-04-25T15:54:11.230265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.243473+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:10.243473+0000","last_peered":"2024-04-25T15:54:10.243473+0000","last_clean":"2024-04-25T15:54:10.243473+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:10.243473+0000","last_undegraded":"2024-04-25T15:54:10.243473+0000","last_fullsized":"2024-04-25T15:54:10.243473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:34.930900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.247006+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:10.247006+0000","last_peered":"2024-04-25T15:54:10.247006+0000","last_clean":"2024-04-25T15:54:10.247006+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:10.247006+0000","last_undegraded":"2024-04-25T15:54:10.247006+0000","last_fullsized":"2024-04-25T15:54:10.247006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.228703+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:11.228703+0000","last_peered":"2024-04-25T15:54:11.228703+0000","last_clean":"2024-04-25T15:54:11.228703+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:11.228703+0000","last_undegraded":"2024-04-25T15:54:11.228703+0000","last_fullsized":"2024-04-25T15:54:11.228703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226099+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:11.226099+0000","last_peered":"2024-04-25T15:54:11.226099+0000","last_clean":"2024-04-25T15:54:11.226099+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:11.226099+0000","last_undegraded":"2024-04-25T15:54:11.226099+0000","last_fullsized":"2024-04-25T15:54:11.226099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930162+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:11.930162+0000","last_peered":"2024-04-25T15:54:11.930162+0000","last_clean":"2024-04-25T15:54:11.930162+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:11.930162+0000","last_undegraded":"2024-04-25T15:54:11.930162+0000","last_fullsized":"2024-04-25T15:54:11.930162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226457+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:11.226457+0000","last_peered":"2024-04-25T15:54:11.226457+0000","last_clean":"2024-04-25T15:54:11.226457+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:11.226457+0000","last_undegraded":"2024-04-25T15:54:11.226457+0000","last_fullsized":"2024-04-25T15:54:11.226457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930188+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:11.930188+0000","last_peered":"2024-04-25T15:54:11.930188+0000","last_clean":"2024-04-25T15:54:11.930188+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:11.930188+0000","last_undegraded":"2024-04-25T15:54:11.930188+0000","last_fullsized":"2024-04-25T15:54:11.930188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.295578+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:10.295578+0000","last_peered":"2024-04-25T15:54:10.295578+0000","last_clean":"2024-04-25T15:54:10.295578+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:10.295578+0000","last_undegraded":"2024-04-25T15:54:10.295578+0000","last_fullsized":"2024-04-25T15:54:10.295578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.226328+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:11.226328+0000","last_peered":"2024-04-25T15:54:11.226328+0000","last_clean":"2024-04-25T15:54:11.226328+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:11.226328+0000","last_undegraded":"2024-04-25T15:54:11.226328+0000","last_fullsized":"2024-04-25T15:54:11.226328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.290652+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:10.290652+0000","last_peered":"2024-04-25T15:54:10.290652+0000","last_clean":"2024-04-25T15:54:10.290652+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:10.290652+0000","last_undegraded":"2024-04-25T15:54:10.290652+0000","last_fullsized":"2024-04-25T15:54:10.290652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.295541+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:10.295541+0000","last_peered":"2024-04-25T15:54:10.295541+0000","last_clean":"2024-04-25T15:54:10.295541+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:10.295541+0000","last_undegraded":"2024-04-25T15:54:10.295541+0000","last_fullsized":"2024-04-25T15:54:10.295541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.280069+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:10.280069+0000","last_peered":"2024-04-25T15:54:10.280069+0000","last_clean":"2024-04-25T15:54:10.280069+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:10.280069+0000","last_undegraded":"2024-04-25T15:54:10.280069+0000","last_fullsized":"2024-04-25T15:54:10.280069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.297287+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:10.297287+0000","last_peered":"2024-04-25T15:54:10.297287+0000","last_clean":"2024-04-25T15:54:10.297287+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:10.297287+0000","last_undegraded":"2024-04-25T15:54:10.297287+0000","last_fullsized":"2024-04-25T15:54:10.297287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.263353+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:10.263353+0000","last_peered":"2024-04-25T15:54:10.263353+0000","last_clean":"2024-04-25T15:54:10.263353+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:10.263353+0000","last_undegraded":"2024-04-25T15:54:10.263353+0000","last_fullsized":"2024-04-25T15:54:10.263353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930926+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:11.930926+0000","last_peered":"2024-04-25T15:54:11.930926+0000","last_clean":"2024-04-25T15:54:11.930926+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:11.930926+0000","last_undegraded":"2024-04-25T15:54:11.930926+0000","last_fullsized":"2024-04-25T15:54:11.930926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:54:11.930757+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:11.930757+0000","last_peered":"2024-04-25T15:54:11.930757+0000","last_clean":"2024-04-25T15:54:11.930757+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:11.930757+0000","last_undegraded":"2024-04-25T15:54:11.930757+0000","last_fullsized":"2024-04-25T15:54:11.930757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T15:54:10.298478+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:10.298478+0000","last_peered":"2024-04-25T15:54:10.298478+0000","last_clean":"2024-04-25T15:54:10.298478+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:10.298478+0000","last_undegraded":"2024-04-25T15:54:10.298478+0000","last_fullsized":"2024-04-25T15:54:10.298478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":70980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:15.772 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:54:15.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8350f64640 1 Processor -- start 2024-04-25T15:54:15.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8350f64640 1 -- start start 2024-04-25T15:54:15.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8350f64640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 0x7f834c0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8350f64640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834c154fc0 con 0x7f834c0c4620 2024-04-25T15:54:15.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8350f64640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834c0acb20 con 0x7f834c1518b0 2024-04-25T15:54:15.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8350f64640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f834c06ed60 con 0x7f834c0ad160 2024-04-25T15:54:15.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f834c0c4620 0x7f834c15e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36882/0 (socket says 172.21.15.87:36882) 2024-04-25T15:54:15.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 -- 172.21.15.87:0/2492703112 learned_addr learned my addr 172.21.15.87:0/2492703112 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8349d9b640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 0x7f834c0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244875625 0 0) 0x7f834c154fc0 con 0x7f834c0c4620 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8334003530 con 0x7f834c0c4620 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 774055172 0 0) 0x7f8334003530 con 0x7f834c0c4620 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 msgr2=0x7f834c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 0x7f834c0c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 >> v1:172.21.15.155:6789/0 conn(0x7f834c1518b0 legacy=0x7f834c06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c0ace00 con 0x7f834c0c4620 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f8344001a00 con 0x7f834c0c4620 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 >> v1:172.21.15.87:6789/0 conn(0x7f834c0c4620 legacy=0x7f834c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 0x7f8334003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8334003f90 0x7f8334004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f8334005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f834c06ed60 con 0x7f8334004d50 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f833400bb90 con 0x7f8334003f90 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f833400dfa0 con 0x7f834c0ad160 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f8334005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f8349d9b640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8334003f90 0x7f8334004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834a59c640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 0x7f8334003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 -- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 msgr2=0x7f8334003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c0ad160 0x7f8334003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 -- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8334003f90 msgr2=0x7f8334004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8334003f90 0x7f8334004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.961+0000 7f834ad9d640 1 -- 172.21.15.87:0/2492703112 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8334003530 con 0x7f8334004d50 2024-04-25T15:54:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f834ad9d640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f8334005180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f834400a830 tx=0x7f834401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2429b3b3cb0374c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834400a480 con 0x7f8334004d50 2024-04-25T15:54:15.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83440ad630 con 0x7f8334004d50 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f834959a640 1 -- 172.21.15.87:0/2492703112 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83440ada80 con 0x7f8334004d50 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f8350f64640 1 -- 172.21.15.87:0/2492703112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 msgr2=0x7f8334005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f8350f64640 1 --2- 172.21.15.87:0/2492703112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f8334005180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f834400a830 tx=0x7f834401d360 comp rx=0 tx=0).stop 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f834ad9d640 1 -- 172.21.15.87:0/2492703112 reap_dead start 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f8350f64640 1 -- 172.21.15.87:0/2492703112 shutdown_connections 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f8350f64640 1 -- 172.21.15.87:0/2492703112 >> 172.21.15.87:0/2492703112 conn(0x7f834c0c8770 msgr2=0x7f834c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f8350f64640 1 -- 172.21.15.87:0/2492703112 shutdown_connections 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.965+0000 7f8350f64640 1 -- 172.21.15.87:0/2492703112 wait complete. 2024-04-25T15:54:15.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 Processor -- start 2024-04-25T15:54:15.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- start start 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f834c1ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834c146ea0 0x7f834c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c146250 0x7f834c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f834c06fd60 con 0x7f8334004d50 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f834c06fbe0 con 0x7f834c146ea0 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f834c071e50 con 0x7f834c146250 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f834c1ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f834c1ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60362/0 (socket says 172.21.15.87:60362) 2024-04-25T15:54:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 -- 172.21.15.87:0/1744843427 learned_addr learned my addr 172.21.15.87:0/1744843427 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8349d9b640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834c146ea0 0x7f834c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 -- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c146250 msgr2=0x7f834c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834ad9d640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c146250 0x7f834c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c146250 0x7f834c146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 -- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834c146ea0 msgr2=0x7f834c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834c146ea0 0x7f834c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 -- 172.21.15.87:0/1744843427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c0c2cb0 con 0x7f8334004d50 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f834a59c640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f834c1ea680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f833c00d4f0 tx=0x7f833c00d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c005480 con 0x7f8334004d50 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833c017070 con 0x7f8334004d50 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c1ed650 con 0x7f8334004d50 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c003820 con 0x7f8334004d50 2024-04-25T15:54:15.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c1ecb70 con 0x7f8334004d50 2024-04-25T15:54:15.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.969+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834c069bb0 con 0x7f8334004d50 2024-04-25T15:54:15.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.973+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f833c0039c0 con 0x7f8334004d50 2024-04-25T15:54:15.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.973+0000 7f833affd640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f832c06f400 0x7f832c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:15.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.973+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f833c08f990 con 0x7f8334004d50 2024-04-25T15:54:15.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.973+0000 7f8349d9b640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f832c06f400 0x7f832c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:15.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.973+0000 7f8349d9b640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f832c06f400 0x7f832c071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f834c154680 tx=0x7f8340008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:15.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:15.977+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f833c05ca90 con 0x7f8334004d50 2024-04-25T15:54:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.137+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f834c0abfa0 con 0x7f8334004d50 2024-04-25T15:54:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.141+0000 7f833affd640 1 -- 172.21.15.87:0/1744843427 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16585 (secure 0 0 0) 0x7f833c05c390 con 0x7f8334004d50 2024-04-25T15:54:16.142 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:11.219239+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f832c06f400 msgr2=0x7f832c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f832c06f400 0x7f832c071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f834c154680 tx=0x7f8340008040 comp rx=0 tx=0).stop 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 msgr2=0x7f834c1ea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f834c1ea680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f833c00d4f0 tx=0x7f833c00d9b0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 shutdown_connections 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f832c06f400 0x7f832c071910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834c146250 0x7f834c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834c146ea0 0x7f834c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 --2- 172.21.15.87:0/1744843427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8334004d50 0x7f834c1ea680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 >> 172.21.15.87:0/1744843427 conn(0x7f834c0c8770 msgr2=0x7f834c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 shutdown_connections 2024-04-25T15:54:16.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.145+0000 7f8350f64640 1 -- 172.21.15.87:0/1744843427 wait complete. 2024-04-25T15:54:16.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:16.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 Processor -- start 2024-04-25T15:54:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 -- start start 2024-04-25T15:54:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45b81518b0 0x7f45b806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45b80ad160 0x7f45b80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b8154fc0 con 0x7f45b80c4620 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f45b806ed60 con 0x7f45b81518b0 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45bde64640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f45b80acb20 con 0x7f45b80ad160 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b77fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45b81518b0 0x7f45b806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b7fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f45b80c4620 0x7f45b8157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36892/0 (socket says 172.21.15.87:36892) 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b7fff640 1 -- 172.21.15.87:0/89567071 learned_addr learned my addr 172.21.15.87:0/89567071 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b6ffd640 1 --2- 172.21.15.87:0/89567071 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ad160 0x7f45b80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b77fe640 1 -- 172.21.15.87:0/89567071 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ad160 msgr2=0x7f45b80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b77fe640 1 --2- 172.21.15.87:0/89567071 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ad160 0x7f45b80c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b77fe640 1 -- 172.21.15.87:0/89567071 >> v1:172.21.15.87:6789/0 conn(0x7f45b80c4620 legacy=0x7f45b8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b67fc640 1 -- 172.21.15.87:0/89567071 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412395530 0 0) 0x7f45b8154fc0 con 0x7f45b80c4620 2024-04-25T15:54:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.317+0000 7f45b77fe640 1 -- 172.21.15.87:0/89567071 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b80ace00 con 0x7f45b81518b0 2024-04-25T15:54:16.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45b77fe640 1 --2- 172.21.15.87:0/89567071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b81518b0 0x7f45b806f4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45b8070d80 tx=0x7f45b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7375dd2b3040ae1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45b67fc640 1 -- 172.21.15.87:0/89567071 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00aa600 con 0x7f45b81518b0 2024-04-25T15:54:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45b67fc640 1 -- 172.21.15.87:0/89567071 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b00af070 con 0x7f45b81518b0 2024-04-25T15:54:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45b67fc640 1 -- 172.21.15.87:0/89567071 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00aa9c0 con 0x7f45b81518b0 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 -- 172.21.15.87:0/89567071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b81518b0 msgr2=0x7f45b806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 --2- 172.21.15.87:0/89567071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b81518b0 0x7f45b806f4d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45b8070d80 tx=0x7f45b001c480 comp rx=0 tx=0).stop 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 -- 172.21.15.87:0/89567071 shutdown_connections 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 --2- 172.21.15.87:0/89567071 >> v2:172.21.15.155:3300/0 conn(0x7f45b80ad160 0x7f45b80c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 --2- 172.21.15.87:0/89567071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b81518b0 0x7f45b806f4d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 -- 172.21.15.87:0/89567071 >> 172.21.15.87:0/89567071 conn(0x7f45b80c8770 msgr2=0x7f45b80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 -- 172.21.15.87:0/89567071 shutdown_connections 2024-04-25T15:54:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.321+0000 7f45bde64640 1 -- 172.21.15.87:0/89567071 wait complete. 2024-04-25T15:54:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 Processor -- start 2024-04-25T15:54:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 -- start start 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ad160 0x7f45b80c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 0x7f45b81f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b81518b0 0x7f45b814a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8161d60 con 0x7f45b80c4620 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8161be0 con 0x7f45b81518b0 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f45b8161ee0 con 0x7f45b80ad160 2024-04-25T15:54:16.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 0x7f45b81f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 0x7f45b81f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60376/0 (socket says 172.21.15.87:60376) 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 -- 172.21.15.87:0/3689701670 learned_addr learned my addr 172.21.15.87:0/3689701670 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b7fff640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b81518b0 0x7f45b814a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b77fe640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ad160 0x7f45b80c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 -- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ad160 msgr2=0x7f45b80c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ad160 0x7f45b80c2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 -- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b81518b0 msgr2=0x7f45b814a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b81518b0 0x7f45b814a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 -- 172.21.15.87:0/3689701670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81f5440 con 0x7f45b80c4620 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b7fff640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b81518b0 0x7f45b814a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45b6ffd640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 0x7f45b81f1370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45a000d620 tx=0x7f45a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a000b620 con 0x7f45b80c4620 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0019070 con 0x7f45b80c4620 2024-04-25T15:54:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b8155c90 con 0x7f45b80c4620 2024-04-25T15:54:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a000b9e0 con 0x7f45b80c4620 2024-04-25T15:54:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.325+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b81f1dd0 con 0x7f45b80c4620 2024-04-25T15:54:16.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.329+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b81f51a0 con 0x7f45b80c4620 2024-04-25T15:54:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.329+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f45a000bb80 con 0x7f45b80c4620 2024-04-25T15:54:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.329+0000 7f45affff640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f459806f430 0x7f4598071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.329+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f45a008f700 con 0x7f45b80c4620 2024-04-25T15:54:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.329+0000 7f45b77fe640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f459806f430 0x7f4598071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.329+0000 7f45b77fe640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f459806f430 0x7f4598071940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45b00ae000 tx=0x7f45b00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:16.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.333+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45b81f51a0 con 0x7f45b80c4620 2024-04-25T15:54:16.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.493+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f45b8155a80 con 0x7f45b80c4620 2024-04-25T15:54:16.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45affff640 1 -- 172.21.15.87:0/3689701670 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f45a005c610 con 0x7f45b80c4620 2024-04-25T15:54:16.496 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:16.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f459806f430 msgr2=0x7f4598071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f459806f430 0x7f4598071940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45b00ae000 tx=0x7f45b00a7000 comp rx=0 tx=0).stop 2024-04-25T15:54:16.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 msgr2=0x7f45b81f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 0x7f45b81f1370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45a000d620 tx=0x7f45a000dae0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 shutdown_connections 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f459806f430 0x7f4598071940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b81518b0 0x7f45b814a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45b80c4620 0x7f45b81f1370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 --2- 172.21.15.87:0/3689701670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45b80ad160 0x7f45b80c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 >> 172.21.15.87:0/3689701670 conn(0x7f45b80c8770 msgr2=0x7f45b8153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 shutdown_connections 2024-04-25T15:54:16.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.497+0000 7f45bde64640 1 -- 172.21.15.87:0/3689701670 wait complete. 2024-04-25T15:54:16.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 Processor -- start 2024-04-25T15:54:16.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 -- start start 2024-04-25T15:54:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 0x7f796815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7968160230 0x7f7968162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79680c7570 con 0x7f796815ad90 2024-04-25T15:54:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f796815b8b0 con 0x7f7968160230 2024-04-25T15:54:16.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796fd7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f796815b5d0 con 0x7f79680cb030 2024-04-25T15:54:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796d316640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 0x7f796815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796e318640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7968160230 0x7f7968162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796d316640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 0x7f796815fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:55348/0 (socket says 172.21.15.87:55348) 2024-04-25T15:54:16.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.665+0000 7f796d316640 1 -- 172.21.15.87:0/221024587 learned_addr learned my addr 172.21.15.87:0/221024587 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796e318640 1 -- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 msgr2=0x7f796815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796e318640 1 --2- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 0x7f796815fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796e318640 1 -- 172.21.15.87:0/221024587 >> v1:172.21.15.155:6789/0 conn(0x7f796815ad90 legacy=0x7f79680ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796e318640 1 -- 172.21.15.87:0/221024587 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79680c2290 con 0x7f7968160230 2024-04-25T15:54:16.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796d316640 1 --2- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 0x7f796815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:16.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796e318640 1 --2- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7968160230 0x7f7968162650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c194f86d304d990 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:16.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796cb15640 1 -- 172.21.15.87:0/221024587 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600b2070 con 0x7f7968160230 2024-04-25T15:54:16.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796cb15640 1 -- 172.21.15.87:0/221024587 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600a5710 con 0x7f7968160230 2024-04-25T15:54:16.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796cb15640 1 -- 172.21.15.87:0/221024587 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600a5ae0 con 0x7f7968160230 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 -- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7968160230 msgr2=0x7f7968162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 --2- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7968160230 0x7f7968162650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796001c850 comp rx=0 tx=0).stop 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 -- 172.21.15.87:0/221024587 shutdown_connections 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 --2- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7968160230 0x7f7968162650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 --2- 172.21.15.87:0/221024587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79680cb030 0x7f796815fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 -- 172.21.15.87:0/221024587 >> 172.21.15.87:0/221024587 conn(0x7f79680c9330 msgr2=0x7f79680c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 -- 172.21.15.87:0/221024587 shutdown_connections 2024-04-25T15:54:16.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.669+0000 7f796fd7b640 1 -- 172.21.15.87:0/221024587 wait complete. 2024-04-25T15:54:16.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 Processor -- start 2024-04-25T15:54:16.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 -- start start 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 0x7f79681f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796815ad90 0x7f79681511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7968160230 0x7f79681450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f796815b1a0 con 0x7f79680cb030 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79680ca190 con 0x7f796815ad90 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f796815b320 con 0x7f7968160230 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 0x7f79681f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 0x7f79681f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60388/0 (socket says 172.21.15.87:60388) 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 -- 172.21.15.87:0/1015139694 learned_addr learned my addr 172.21.15.87:0/1015139694 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:16.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796d316640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796815ad90 0x7f79681511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796e318640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7968160230 0x7f79681450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 -- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7968160230 msgr2=0x7f79681450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7968160230 0x7f79681450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 -- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796815ad90 msgr2=0x7f79681511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796815ad90 0x7f79681511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 -- 172.21.15.87:0/1015139694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796814fc40 con 0x7f79680cb030 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796e318640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7968160230 0x7f79681450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796d316640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796815ad90 0x7f79681511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796db17640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 0x7f79681f3e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f796400c3a0 tx=0x7f796400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640052d0 con 0x7f79680cb030 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7964005470 con 0x7f79680cb030 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7968152be0 con 0x7f79680cb030 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964007260 con 0x7f79680cb030 2024-04-25T15:54:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.673+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7968150430 con 0x7f79680cb030 2024-04-25T15:54:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.677+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79680c1f90 con 0x7f79680cb030 2024-04-25T15:54:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.677+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7964007400 con 0x7f79680cb030 2024-04-25T15:54:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.677+0000 7f795e7fc640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f794c06f430 0x7f794c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.677+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f796408ea70 con 0x7f79680cb030 2024-04-25T15:54:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.677+0000 7f796d316640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f794c06f430 0x7f794c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.677+0000 7f796d316640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f794c06f430 0x7f794c071940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f79680c9840 tx=0x7f7958008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.681+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f796405bb70 con 0x7f79680cb030 2024-04-25T15:54:16.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.841+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f79680c7760 con 0x7f79680cb030 2024-04-25T15:54:16.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f795e7fc640 1 -- 172.21.15.87:0/1015139694 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v20) ==== 99+0+11 (secure 0 0 0) 0x7f796405b470 con 0x7f79680cb030 2024-04-25T15:54:16.844 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f794c06f430 msgr2=0x7f794c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f794c06f430 0x7f794c071940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f79680c9840 tx=0x7f7958008040 comp rx=0 tx=0).stop 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 msgr2=0x7f79681f3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 0x7f79681f3e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f796400c3a0 tx=0x7f796400c860 comp rx=0 tx=0).stop 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 shutdown_connections 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f794c06f430 0x7f794c071940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7968160230 0x7f79681450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f796815ad90 0x7f79681511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 --2- 172.21.15.87:0/1015139694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79680cb030 0x7f79681f3e30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 >> 172.21.15.87:0/1015139694 conn(0x7f79680c9330 msgr2=0x7f79680c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 shutdown_connections 2024-04-25T15:54:16.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:16.845+0000 7f796fd7b640 1 -- 172.21.15.87:0/1015139694 wait complete. 2024-04-25T15:54:16.865 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 Processor -- start 2024-04-25T15:54:17.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 -- start start 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff9b81518b0 0x7ff9b806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b80ad160 0x7ff9b80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b8154fc0 con 0x7ff9b80c4620 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b806ed60 con 0x7ff9b81518b0 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9bc921640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b80acb20 con 0x7ff9b80ad160 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9b659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff9b81518b0 0x7ff9b806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9b6d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff9b80c4620 0x7ff9b8157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36896/0 (socket says 172.21.15.87:36896) 2024-04-25T15:54:17.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9b6d9d640 1 -- 172.21.15.87:0/2120366790 learned_addr learned my addr 172.21.15.87:0/2120366790 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9b659c640 1 --2- 172.21.15.87:0/2120366790 >> v2:172.21.15.87:3300/0 conn(0x7ff9b81518b0 0x7ff9b806f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60392/0 (socket says 172.21.15.87:60392) 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.013+0000 7ff9b5d9b640 1 --2- 172.21.15.87:0/2120366790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b80ad160 0x7ff9b80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b659c640 1 -- 172.21.15.87:0/2120366790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b80ad160 msgr2=0x7ff9b80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b659c640 1 --2- 172.21.15.87:0/2120366790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b80ad160 0x7ff9b80c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b659c640 1 -- 172.21.15.87:0/2120366790 >> v1:172.21.15.87:6789/0 conn(0x7ff9b80c4620 legacy=0x7ff9b8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b559a640 1 -- 172.21.15.87:0/2120366790 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091700474 0 0) 0x7ff9b8154fc0 con 0x7ff9b80c4620 2024-04-25T15:54:17.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b659c640 1 -- 172.21.15.87:0/2120366790 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b80ace00 con 0x7ff9b81518b0 2024-04-25T15:54:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b659c640 1 --2- 172.21.15.87:0/2120366790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b81518b0 0x7ff9b806f4d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000bfa0 tx=0x7ff9b001eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae62957adb16fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b559a640 1 -- 172.21.15.87:0/2120366790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000b2d0 con 0x7ff9b81518b0 2024-04-25T15:54:17.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b559a640 1 -- 172.21.15.87:0/2120366790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00a7a60 con 0x7ff9b81518b0 2024-04-25T15:54:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9b559a640 1 -- 172.21.15.87:0/2120366790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00a7e30 con 0x7ff9b81518b0 2024-04-25T15:54:17.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 -- 172.21.15.87:0/2120366790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b81518b0 msgr2=0x7ff9b806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 --2- 172.21.15.87:0/2120366790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b81518b0 0x7ff9b806f4d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000bfa0 tx=0x7ff9b001eb70 comp rx=0 tx=0).stop 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 -- 172.21.15.87:0/2120366790 shutdown_connections 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 --2- 172.21.15.87:0/2120366790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b80ad160 0x7ff9b80c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 --2- 172.21.15.87:0/2120366790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b81518b0 0x7ff9b806f4d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 -- 172.21.15.87:0/2120366790 >> 172.21.15.87:0/2120366790 conn(0x7ff9b80c8770 msgr2=0x7ff9b80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 -- 172.21.15.87:0/2120366790 shutdown_connections 2024-04-25T15:54:17.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.017+0000 7ff9bc921640 1 -- 172.21.15.87:0/2120366790 wait complete. 2024-04-25T15:54:17.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 Processor -- start 2024-04-25T15:54:17.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 -- start start 2024-04-25T15:54:17.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 0x7ff9b80aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b80c4620 0x7ff9b814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b81518b0 0x7ff9b814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80c3330 con 0x7ff9b80ad160 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80c31b0 con 0x7ff9b80c4620 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b80c34b0 con 0x7ff9b81518b0 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 0x7ff9b80aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 0x7ff9b80aa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60398/0 (socket says 172.21.15.87:60398) 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 -- 172.21.15.87:0/3029041676 learned_addr learned my addr 172.21.15.87:0/3029041676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b6d9d640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b81518b0 0x7ff9b814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b5d9b640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b80c4620 0x7ff9b814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 -- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b81518b0 msgr2=0x7ff9b814a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b81518b0 0x7ff9b814a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 -- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b80c4620 msgr2=0x7ff9b814f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b80c4620 0x7ff9b814f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 -- 172.21.15.87:0/3029041676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b81ec7b0 con 0x7ff9b80ad160 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b5d9b640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b80c4620 0x7ff9b814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9b659c640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 0x7ff9b80aa380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00b1040 tx=0x7ff9b001b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0009c10 con 0x7ff9b80ad160 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b00c0070 con 0x7ff9b80ad160 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b81eca70 con 0x7ff9b80ad160 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00ba470 con 0x7ff9b80ad160 2024-04-25T15:54:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.021+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b81ed030 con 0x7ff9b80ad160 2024-04-25T15:54:17.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.025+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b8069bb0 con 0x7ff9b80ad160 2024-04-25T15:54:17.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.025+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9b00ba610 con 0x7ff9b80ad160 2024-04-25T15:54:17.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.025+0000 7ff9aeffd640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff99806f400 0x7ff998071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.025+0000 7ff9b5d9b640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff99806f400 0x7ff998071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.025+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ff9b012d4e0 con 0x7ff9b80ad160 2024-04-25T15:54:17.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.025+0000 7ff9b5d9b640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff99806f400 0x7ff998071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8148130 tx=0x7ff9a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.029+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9b0018760 con 0x7ff9b80ad160 2024-04-25T15:54:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.181+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7ff9b80abfa0 con 0x7ff9b80ad160 2024-04-25T15:54:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9aeffd640 1 -- 172.21.15.87:0/3029041676 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v20) ==== 95+0+11 (secure 0 0 0) 0x7ff9b00fa550 con 0x7ff9b80ad160 2024-04-25T15:54:17.184 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff99806f400 msgr2=0x7ff998071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff99806f400 0x7ff998071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8148130 tx=0x7ff9a0008040 comp rx=0 tx=0).stop 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 msgr2=0x7ff9b80aa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 0x7ff9b80aa380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00b1040 tx=0x7ff9b001b910 comp rx=0 tx=0).stop 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 shutdown_connections 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff99806f400 0x7ff998071910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9b81518b0 0x7ff9b814a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9b80c4620 0x7ff9b814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 --2- 172.21.15.87:0/3029041676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9b80ad160 0x7ff9b80aa380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 >> 172.21.15.87:0/3029041676 conn(0x7ff9b80c8770 msgr2=0x7ff9b815f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 shutdown_connections 2024-04-25T15:54:17.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.185+0000 7ff9bc921640 1 -- 172.21.15.87:0/3029041676 wait complete. 2024-04-25T15:54:17.204 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:54:17.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.345+0000 7ff3571f6640 1 Processor -- start 2024-04-25T15:54:17.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.345+0000 7ff3571f6640 1 -- start start 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff3571f6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3501518b0 0x7ff35006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff3571f6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3500c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff3571f6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff350154fc0 con 0x7ff3500c4620 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff3571f6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff35006ed60 con 0x7ff3501518b0 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff3571f6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3500acb20 con 0x7ff3500ad160 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3501518b0 0x7ff35006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3501518b0 0x7ff35006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60406/0 (socket says 172.21.15.87:60406) 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 -- 172.21.15.87:0/2369382328 learned_addr learned my addr 172.21.15.87:0/2369382328 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff34ffff640 1 --2- 172.21.15.87:0/2369382328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3500c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 -- 172.21.15.87:0/2369382328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 msgr2=0x7ff3500c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:17.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 --2- 172.21.15.87:0/2369382328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3500c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 -- 172.21.15.87:0/2369382328 >> v1:172.21.15.155:6789/0 conn(0x7ff3500c4620 legacy=0x7ff350157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.349+0000 7ff354f92640 1 -- 172.21.15.87:0/2369382328 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3500ace00 con 0x7ff3501518b0 2024-04-25T15:54:17.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff354f92640 1 --2- 172.21.15.87:0/2369382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff35006f4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff344009870 tx=0x7ff34401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bf92088f1dee5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff34f7fe640 1 -- 172.21.15.87:0/2369382328 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3440a9640 con 0x7ff3501518b0 2024-04-25T15:54:17.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff34f7fe640 1 -- 172.21.15.87:0/2369382328 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3440a97e0 con 0x7ff3501518b0 2024-04-25T15:54:17.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff34f7fe640 1 -- 172.21.15.87:0/2369382328 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3440a9bb0 con 0x7ff3501518b0 2024-04-25T15:54:17.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 -- 172.21.15.87:0/2369382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 msgr2=0x7ff35006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 --2- 172.21.15.87:0/2369382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff35006f4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff344009870 tx=0x7ff34401c560 comp rx=0 tx=0).stop 2024-04-25T15:54:17.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 -- 172.21.15.87:0/2369382328 shutdown_connections 2024-04-25T15:54:17.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 --2- 172.21.15.87:0/2369382328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3500c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 --2- 172.21.15.87:0/2369382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff35006f4d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 -- 172.21.15.87:0/2369382328 >> 172.21.15.87:0/2369382328 conn(0x7ff3500c8770 msgr2=0x7ff3500c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:17.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 -- 172.21.15.87:0/2369382328 shutdown_connections 2024-04-25T15:54:17.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 -- 172.21.15.87:0/2369382328 wait complete. 2024-04-25T15:54:17.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 Processor -- start 2024-04-25T15:54:17.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.353+0000 7ff3571f6640 1 -- start start 2024-04-25T15:54:17.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3501f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500c4620 0x7ff3501f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff350146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff350161d60 con 0x7ff3501518b0 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff350161be0 con 0x7ff3500c4620 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff350161ee0 con 0x7ff3500ad160 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff350146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff350146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60418/0 (socket says 172.21.15.87:60418) 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 -- 172.21.15.87:0/3952330384 learned_addr learned my addr 172.21.15.87:0/3952330384 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff354f92640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3501f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34ffff640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500c4620 0x7ff3501f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 -- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 msgr2=0x7ff3501f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3501f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 -- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500c4620 msgr2=0x7ff3501f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500c4620 0x7ff3501f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 -- 172.21.15.87:0/3952330384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35014a940 con 0x7ff3501518b0 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34ffff640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500c4620 0x7ff3501f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff355793640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff350146a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c730 tx=0x7ff34800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348016020 con 0x7ff3501518b0 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff348006d80 con 0x7ff3501518b0 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff350148880 con 0x7ff3501518b0 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348003bc0 con 0x7ff3501518b0 2024-04-25T15:54:17.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff350148e40 con 0x7ff3501518b0 2024-04-25T15:54:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff350069bb0 con 0x7ff3501518b0 2024-04-25T15:54:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3480050d0 con 0x7ff3501518b0 2024-04-25T15:54:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34d7fa640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f400 0x7ff334071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff354f92640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f400 0x7ff334071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.357+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ff34808f010 con 0x7ff3501518b0 2024-04-25T15:54:17.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.361+0000 7ff354f92640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f400 0x7ff334071910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3440ae000 tx=0x7ff344009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.365+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff348020020 con 0x7ff3501518b0 2024-04-25T15:54:17.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.513+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff3500abfa0 con 0x7ff3501518b0 2024-04-25T15:54:17.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.513+0000 7ff34d7fa640 1 -- 172.21.15.87:0/3952330384 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) ==== 84+0+197 (secure 0 0 0) 0x7ff34805c030 con 0x7ff3501518b0 2024-04-25T15:54:17.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:17.514 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-04-25T15:54:17.514 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-25T15:54:17.514 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 2, 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": "a_metadata" 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 3, 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": "a_data" 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-25T15:54:17.515 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f400 msgr2=0x7ff334071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f400 0x7ff334071910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3440ae000 tx=0x7ff344009040 comp rx=0 tx=0).stop 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 msgr2=0x7ff350146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff350146a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c730 tx=0x7ff34800cbf0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 shutdown_connections 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f400 0x7ff334071910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3501518b0 0x7ff350146a80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500c4620 0x7ff3501f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 --2- 172.21.15.87:0/3952330384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500ad160 0x7ff3501f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 >> 172.21.15.87:0/3952330384 conn(0x7ff3500c8770 msgr2=0x7ff3500c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 shutdown_connections 2024-04-25T15:54:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.517+0000 7ff3571f6640 1 -- 172.21.15.87:0/3952330384 wait complete. 2024-04-25T15:54:17.533 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-04-25T15:54:17.534 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-04-25T15:54:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 Processor -- start 2024-04-25T15:54:17.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 -- start start 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b341529a0 0x7f9b34071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b340ad990 0x7f9b340adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340c41e0 0x7f9b340c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9b34072430 con 0x7f9b341529a0 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9b34074730 con 0x7f9b340ad990 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b3a602640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b34074a10 con 0x7f9b340c41e0 2024-04-25T15:54:17.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b33fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b341529a0 0x7f9b34071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b33fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b341529a0 0x7f9b34071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60426/0 (socket says 172.21.15.87:60426) 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b33fff640 1 -- 172.21.15.87:0/187214835 learned_addr learned my addr 172.21.15.87:0/187214835 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b337fe640 1 --2- 172.21.15.87:0/187214835 >> v2:172.21.15.155:3300/0 conn(0x7f9b340ad990 0x7f9b340adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.689+0000 7f9b38b9f640 1 --2- 172.21.15.87:0/187214835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340c41e0 0x7f9b340c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b33fff640 1 -- 172.21.15.87:0/187214835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340c41e0 msgr2=0x7f9b340c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b33fff640 1 --2- 172.21.15.87:0/187214835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340c41e0 0x7f9b340c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b33fff640 1 -- 172.21.15.87:0/187214835 >> v2:172.21.15.155:3300/0 conn(0x7f9b340ad990 msgr2=0x7f9b340adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b33fff640 1 --2- 172.21.15.87:0/187214835 >> v2:172.21.15.155:3300/0 conn(0x7f9b340ad990 0x7f9b340adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b33fff640 1 -- 172.21.15.87:0/187214835 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b34074cf0 con 0x7f9b341529a0 2024-04-25T15:54:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b33fff640 1 --2- 172.21.15.87:0/187214835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34071e50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b340ae690 tx=0x7f9b2401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b3279ac10f7fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b32ffd640 1 -- 172.21.15.87:0/187214835 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240b0070 con 0x7f9b341529a0 2024-04-25T15:54:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b32ffd640 1 -- 172.21.15.87:0/187214835 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b240ab600 con 0x7f9b341529a0 2024-04-25T15:54:17.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b32ffd640 1 -- 172.21.15.87:0/187214835 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240ab9d0 con 0x7f9b341529a0 2024-04-25T15:54:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 -- 172.21.15.87:0/187214835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 msgr2=0x7f9b34071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 --2- 172.21.15.87:0/187214835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34071e50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b340ae690 tx=0x7f9b2401c490 comp rx=0 tx=0).stop 2024-04-25T15:54:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 -- 172.21.15.87:0/187214835 shutdown_connections 2024-04-25T15:54:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 --2- 172.21.15.87:0/187214835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340c41e0 0x7f9b340c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 --2- 172.21.15.87:0/187214835 >> v2:172.21.15.155:3300/0 conn(0x7f9b340ad990 0x7f9b340adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 --2- 172.21.15.87:0/187214835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34071e50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 -- 172.21.15.87:0/187214835 >> 172.21.15.87:0/187214835 conn(0x7f9b340c8770 msgr2=0x7f9b340c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:17.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 -- 172.21.15.87:0/187214835 shutdown_connections 2024-04-25T15:54:17.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.693+0000 7f9b3a602640 1 -- 172.21.15.87:0/187214835 wait complete. 2024-04-25T15:54:17.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 Processor -- start 2024-04-25T15:54:17.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 -- start start 2024-04-25T15:54:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340ad990 0x7f9b3414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b340c41e0 0x7f9b34146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9b34159340 con 0x7f9b341529a0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b341591c0 con 0x7f9b340c41e0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b341594c0 con 0x7f9b340ad990 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60428/0 (socket says 172.21.15.87:60428) 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 -- 172.21.15.87:0/1926283804 learned_addr learned my addr 172.21.15.87:0/1926283804 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 -- 172.21.15.87:0/1926283804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340ad990 msgr2=0x7f9b3414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340ad990 0x7f9b3414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 -- 172.21.15.87:0/1926283804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b340c41e0 msgr2=0x7f9b34146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b340c41e0 0x7f9b34146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 -- 172.21.15.87:0/1926283804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3414df30 con 0x7f9b341529a0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b38b9f640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34144bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c007d80 tx=0x7f9b2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c014420 con 0x7f9b341529a0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c019070 con 0x7f9b341529a0 2024-04-25T15:54:17.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3414e1d0 con 0x7f9b341529a0 2024-04-25T15:54:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c014800 con 0x7f9b341529a0 2024-04-25T15:54:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.697+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b34145de0 con 0x7f9b341529a0 2024-04-25T15:54:17.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.701+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b34069bb0 con 0x7f9b341529a0 2024-04-25T15:54:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.701+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9b2c0149a0 con 0x7f9b341529a0 2024-04-25T15:54:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.701+0000 7f9b30ff9640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9b2006f430 0x7f9b20071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.701+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f9b2c08f960 con 0x7f9b341529a0 2024-04-25T15:54:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.701+0000 7f9b33fff640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9b2006f430 0x7f9b20071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:17.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.701+0000 7f9b33fff640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9b2006f430 0x7f9b20071940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b240ad000 tx=0x7f9b24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:17.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.705+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b2c05c980 con 0x7f9b341529a0 2024-04-25T15:54:17.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:17.853+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7f9b340c3760 con 0x7f9b341529a0 2024-04-25T15:54:18.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.329+0000 7f9b30ff9640 1 -- 172.21.15.87:0/1926283804 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v21) ==== 128+0+0 (secure 0 0 0) 0x7f9b2c05c280 con 0x7f9b341529a0 2024-04-25T15:54:18.332 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'b_metadata' created 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9b2006f430 msgr2=0x7f9b20071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9b2006f430 0x7f9b20071940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b240ad000 tx=0x7f9b24008040 comp rx=0 tx=0).stop 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 msgr2=0x7f9b34144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34144bd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c007d80 tx=0x7f9b2c00e4b0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 shutdown_connections 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9b2006f430 0x7f9b20071940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b341529a0 0x7f9b34144bd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b340c41e0 0x7f9b34146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 --2- 172.21.15.87:0/1926283804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b340ad990 0x7f9b3414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 >> 172.21.15.87:0/1926283804 conn(0x7f9b340c8770 msgr2=0x7f9b340c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:18.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 shutdown_connections 2024-04-25T15:54:18.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.337+0000 7f9b3a602640 1 -- 172.21.15.87:0/1926283804 wait complete. 2024-04-25T15:54:18.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:54:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 Processor -- start 2024-04-25T15:54:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 -- start start 2024-04-25T15:54:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07e00c46a0 0x7f07e00c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07e00c8e40 0x7f07e0072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e0074610 con 0x7f07e00726d0 2024-04-25T15:54:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f07e00743e0 con 0x7f07e00c46a0 2024-04-25T15:54:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e7069640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f07e00748f0 con 0x7f07e00c8e40 2024-04-25T15:54:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e4e05640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07e00c46a0 0x7f07e00c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e4e05640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07e00c46a0 0x7f07e00c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60430/0 (socket says 172.21.15.87:60430) 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07e4e05640 1 -- 172.21.15.87:0/239367985 learned_addr learned my addr 172.21.15.87:0/239367985 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.529+0000 7f07dffff640 1 --2- 172.21.15.87:0/239367985 >> v2:172.21.15.155:3300/0 conn(0x7f07e00c8e40 0x7f07e0072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e4e05640 1 -- 172.21.15.87:0/239367985 >> v2:172.21.15.155:3300/0 conn(0x7f07e00c8e40 msgr2=0x7f07e0072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e4e05640 1 --2- 172.21.15.87:0/239367985 >> v2:172.21.15.155:3300/0 conn(0x7f07e00c8e40 0x7f07e0072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e4e05640 1 -- 172.21.15.87:0/239367985 >> v1:172.21.15.155:6789/0 conn(0x7f07e00726d0 legacy=0x7f07e0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e4e05640 1 -- 172.21.15.87:0/239367985 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e0074bd0 con 0x7f07e00c46a0 2024-04-25T15:54:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07dffff640 1 --2- 172.21.15.87:0/239367985 >> v2:172.21.15.155:3300/0 conn(0x7f07e00c8e40 0x7f07e0072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e4e05640 1 --2- 172.21.15.87:0/239367985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00c46a0 0x7f07e00c8900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07e006ff30 tx=0x7f07d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360578e46a729a43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07df7fe640 1 -- 172.21.15.87:0/239367985 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40b0070 con 0x7f07e00c46a0 2024-04-25T15:54:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07df7fe640 1 -- 172.21.15.87:0/239367985 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d40ab600 con 0x7f07e00c46a0 2024-04-25T15:54:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07df7fe640 1 -- 172.21.15.87:0/239367985 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ab9d0 con 0x7f07e00c46a0 2024-04-25T15:54:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 -- 172.21.15.87:0/239367985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00c46a0 msgr2=0x7f07e00c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 --2- 172.21.15.87:0/239367985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00c46a0 0x7f07e00c8900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07e006ff30 tx=0x7f07d401c450 comp rx=0 tx=0).stop 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 -- 172.21.15.87:0/239367985 shutdown_connections 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 --2- 172.21.15.87:0/239367985 >> v2:172.21.15.155:3300/0 conn(0x7f07e00c8e40 0x7f07e0072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 --2- 172.21.15.87:0/239367985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00c46a0 0x7f07e00c8900 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 -- 172.21.15.87:0/239367985 >> 172.21.15.87:0/239367985 conn(0x7f07e006ca70 msgr2=0x7f07e006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 -- 172.21.15.87:0/239367985 shutdown_connections 2024-04-25T15:54:18.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.533+0000 7f07e7069640 1 -- 172.21.15.87:0/239367985 wait complete. 2024-04-25T15:54:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 Processor -- start 2024-04-25T15:54:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 -- start start 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 0x7f07e01f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e00c46a0 0x7f07e00c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07e00c8e40 0x7f07e013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f07e00c4250 con 0x7f07e00726d0 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07e00c40d0 con 0x7f07e00c46a0 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07e0162cf0 con 0x7f07e00c8e40 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 0x7f07e01f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 0x7f07e01f1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60444/0 (socket says 172.21.15.87:60444) 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 -- 172.21.15.87:0/1923004927 learned_addr learned my addr 172.21.15.87:0/1923004927 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07dffff640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e00c46a0 0x7f07e00c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 -- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07e00c8e40 msgr2=0x7f07e013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e5606640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07e00c8e40 0x7f07e013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07e00c8e40 0x7f07e013fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 -- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e00c46a0 msgr2=0x7f07e00c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e00c46a0 0x7f07e00c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 -- 172.21.15.87:0/1923004927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e01f15b0 con 0x7f07e00726d0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07dffff640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e00c46a0 0x7f07e00c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e5606640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07e00c8e40 0x7f07e013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e4e05640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 0x7f07e01f1070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07d401ab00 tx=0x7f07d401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ba020 con 0x7f07e00726d0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d40b6640 con 0x7f07e00726d0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d40b0040 con 0x7f07e00726d0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e00c2560 con 0x7f07e00726d0 2024-04-25T15:54:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.537+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e0144710 con 0x7f07e00726d0 2024-04-25T15:54:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.541+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e0069aa0 con 0x7f07e00726d0 2024-04-25T15:54:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.541+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f07d40bd020 con 0x7f07e00726d0 2024-04-25T15:54:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.541+0000 7f07dd7fa640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f07cc06f430 0x7f07cc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.541+0000 7f07dffff640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f07cc06f430 0x7f07cc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.541+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6054+0+0 (secure 0 0 0) 0x7f07d4129a80 con 0x7f07e00726d0 2024-04-25T15:54:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.541+0000 7f07dffff640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f07cc06f430 0x7f07cc071940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e0147e60 tx=0x7f07d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:18.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.545+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07d40c4070 con 0x7f07e00726d0 2024-04-25T15:54:18.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:18.705+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f07e00c4480 con 0x7f07e00726d0 2024-04-25T15:54:19.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07dd7fa640 1 -- 172.21.15.87:0/1923004927 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v22) ==== 160+0+0 (secure 0 0 0) 0x7f07d40160d0 con 0x7f07e00726d0 2024-04-25T15:54:19.337 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'b_data' created 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f07cc06f430 msgr2=0x7f07cc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f07cc06f430 0x7f07cc071940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07e0147e60 tx=0x7f07d0008040 comp rx=0 tx=0).stop 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 msgr2=0x7f07e01f1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 0x7f07e01f1070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07d401ab00 tx=0x7f07d401ac90 comp rx=0 tx=0).stop 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 shutdown_connections 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f07cc06f430 0x7f07cc071940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07e00c8e40 0x7f07e013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07e00c46a0 0x7f07e00c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 --2- 172.21.15.87:0/1923004927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07e00726d0 0x7f07e01f1070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.337+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 >> 172.21.15.87:0/1923004927 conn(0x7f07e006ca70 msgr2=0x7f07e006f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.341+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 shutdown_connections 2024-04-25T15:54:19.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.341+0000 7f07e7069640 1 -- 172.21.15.87:0/1923004927 wait complete. 2024-04-25T15:54:19.377 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-04-25T15:54:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 Processor -- start 2024-04-25T15:54:19.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 -- start start 2024-04-25T15:54:19.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20c415ad90 0x7f20c40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20c4157380 0x7f20c4157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f20c40c7570 con 0x7f20c4157380 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f20c415b8b0 con 0x7f20c415ad90 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20cb12d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f20c415b5d0 con 0x7f20c40cae60 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20c4157380 0x7f20c4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20c4157380 0x7f20c4157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60458/0 (socket says 172.21.15.87:60458) 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 -- 172.21.15.87:0/1283309114 learned_addr learned my addr 172.21.15.87:0/1283309114 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c8ec9640 1 --2- 172.21.15.87:0/1283309114 >> v2:172.21.15.155:3300/0 conn(0x7f20c415ad90 0x7f20c40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20bbfff640 1 --2- 172.21.15.87:0/1283309114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 -- 172.21.15.87:0/1283309114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 msgr2=0x7f20c40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 --2- 172.21.15.87:0/1283309114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c40cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 -- 172.21.15.87:0/1283309114 >> v2:172.21.15.155:3300/0 conn(0x7f20c415ad90 msgr2=0x7f20c40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 --2- 172.21.15.87:0/1283309114 >> v2:172.21.15.155:3300/0 conn(0x7f20c415ad90 0x7f20c40ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.529+0000 7f20c96ca640 1 -- 172.21.15.87:0/1283309114 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c40c2290 con 0x7f20c4157380 2024-04-25T15:54:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20c96ca640 1 --2- 172.21.15.87:0/1283309114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c4157380 0x7f20c4157790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20c408e5a0 tx=0x7f20bc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0f2e53a11a27c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20bb7fe640 1 -- 172.21.15.87:0/1283309114 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a5550 con 0x7f20c4157380 2024-04-25T15:54:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20bb7fe640 1 -- 172.21.15.87:0/1283309114 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20bc0a56f0 con 0x7f20c4157380 2024-04-25T15:54:19.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20bb7fe640 1 -- 172.21.15.87:0/1283309114 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a5ac0 con 0x7f20c4157380 2024-04-25T15:54:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 -- 172.21.15.87:0/1283309114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c4157380 msgr2=0x7f20c4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 --2- 172.21.15.87:0/1283309114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c4157380 0x7f20c4157790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20c408e5a0 tx=0x7f20bc01c8d0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 -- 172.21.15.87:0/1283309114 shutdown_connections 2024-04-25T15:54:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 --2- 172.21.15.87:0/1283309114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c4157380 0x7f20c4157790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 --2- 172.21.15.87:0/1283309114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 --2- 172.21.15.87:0/1283309114 >> v2:172.21.15.155:3300/0 conn(0x7f20c415ad90 0x7f20c40ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 -- 172.21.15.87:0/1283309114 >> 172.21.15.87:0/1283309114 conn(0x7f20c40c9330 msgr2=0x7f20c40c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 -- 172.21.15.87:0/1283309114 shutdown_connections 2024-04-25T15:54:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.533+0000 7f20cb12d640 1 -- 172.21.15.87:0/1283309114 wait complete. 2024-04-25T15:54:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 Processor -- start 2024-04-25T15:54:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 -- start start 2024-04-25T15:54:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c4159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c4157380 0x7f20c414b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 0x7f20c4145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f20c41580e0 con 0x7f20c415ad90 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20c40ca190 con 0x7f20c4157380 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f20c4158260 con 0x7f20c40cae60 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 0x7f20c4145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 0x7f20c4145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60474/0 (socket says 172.21.15.87:60474) 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 -- 172.21.15.87:0/3190440120 learned_addr learned my addr 172.21.15.87:0/3190440120 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c8ec9640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c4159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20bbfff640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c4157380 0x7f20c414b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 -- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 msgr2=0x7f20c4159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c4159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 -- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c4157380 msgr2=0x7f20c414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c4157380 0x7f20c414b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 -- 172.21.15.87:0/3190440120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c415a1c0 con 0x7f20c415ad90 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c8ec9640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c4159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20c96ca640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 0x7f20c4145f50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20bc01af80 tx=0x7f20bc019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:19.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0bc020 con 0x7f20c415ad90 2024-04-25T15:54:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20bc0b8670 con 0x7f20c415ad90 2024-04-25T15:54:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c4148fa0 con 0x7f20c415ad90 2024-04-25T15:54:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc009510 con 0x7f20c415ad90 2024-04-25T15:54:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.537+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c4149560 con 0x7f20c415ad90 2024-04-25T15:54:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.541+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c40c1f90 con 0x7f20c415ad90 2024-04-25T15:54:19.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.541+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f20bc0bf020 con 0x7f20c415ad90 2024-04-25T15:54:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.541+0000 7f20b97fa640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.541+0000 7f20c8ec9640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:19.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.541+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6431+0+0 (secure 0 0 0) 0x7f20bc12af00 con 0x7f20c415ad90 2024-04-25T15:54:19.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.541+0000 7f20c8ec9640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b9f0 tx=0x7f20c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:19.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.545+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20bc0165e0 con 0x7f20c415ad90 2024-04-25T15:54:19.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:19.741+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f20c414b050 con 0x7f20c415ad90 2024-04-25T15:54:20.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.425+0000 7f20b97fa640 1 -- 172.21.15.87:0/3190440120 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) ==== 157+0+0 (secure 0 0 0) 0x7f20bc0f7c20 con 0x7f20c415ad90 2024-04-25T15:54:20.426 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T15:54:20.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 msgr2=0x7f20b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b9f0 tx=0x7f20c0008040 comp rx=0 tx=0).stop 2024-04-25T15:54:20.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 msgr2=0x7f20c4145f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 0x7f20c4145f50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20bc01af80 tx=0x7f20bc019670 comp rx=0 tx=0).stop 2024-04-25T15:54:20.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 shutdown_connections 2024-04-25T15:54:20.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20c415ad90 0x7f20c4145f50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c4157380 0x7f20c414b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 --2- 172.21.15.87:0/3190440120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c40cae60 0x7f20c4159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.429+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 >> 172.21.15.87:0/3190440120 conn(0x7f20c40c9330 msgr2=0x7f20c414e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:20.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.433+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 shutdown_connections 2024-04-25T15:54:20.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.433+0000 7f20cb12d640 1 -- 172.21.15.87:0/3190440120 wait complete. 2024-04-25T15:54:20.463 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:20.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 Processor -- start 2024-04-25T15:54:20.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 -- start start 2024-04-25T15:54:20.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 0x7fd19c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd19c06c670 0x7fd19c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd19c152c80 con 0x7fd19c152870 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd19c0aebc0 con 0x7fd19c06c670 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a22bf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd19c158f20 con 0x7fd19c0a8cc0 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd19bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 0x7fd19c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a085c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd19c06c670 0x7fd19c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd19bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 0x7fd19c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:55468/0 (socket says 172.21.15.87:55468) 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd19bfff640 1 -- 172.21.15.87:0/3457027891 learned_addr learned my addr 172.21.15.87:0/3457027891 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd1a085c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd19c06c670 0x7fd19c06ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:35828/0 (socket says 172.21.15.87:35828) 2024-04-25T15:54:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.605+0000 7fd19b7fe640 1 --1- 172.21.15.87:0/3457027891 >> v1:172.21.15.155:6789/0 conn(0x7fd19c152870 0x7fd19c155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:44434/0 (socket says 172.21.15.87:44434) 2024-04-25T15:54:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19bfff640 1 -- 172.21.15.87:0/3457027891 >> v2:172.21.15.155:3300/0 conn(0x7fd19c06c670 msgr2=0x7fd19c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19bfff640 1 --2- 172.21.15.87:0/3457027891 >> v2:172.21.15.155:3300/0 conn(0x7fd19c06c670 0x7fd19c06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19bfff640 1 -- 172.21.15.87:0/3457027891 >> v1:172.21.15.155:6789/0 conn(0x7fd19c152870 legacy=0x7fd19c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19bfff640 1 -- 172.21.15.87:0/3457027891 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c0ae8e0 con 0x7fd19c0a8cc0 2024-04-25T15:54:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19bfff640 1 --2- 172.21.15.87:0/3457027891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 0x7fd19c1593b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0aed40 tx=0x7fd19401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdafd105cccc5417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19affd640 1 -- 172.21.15.87:0/3457027891 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940a5780 con 0x7fd19c0a8cc0 2024-04-25T15:54:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19affd640 1 -- 172.21.15.87:0/3457027891 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1940a5920 con 0x7fd19c0a8cc0 2024-04-25T15:54:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd19affd640 1 -- 172.21.15.87:0/3457027891 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940a5cf0 con 0x7fd19c0a8cc0 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd1a22bf640 1 -- 172.21.15.87:0/3457027891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 msgr2=0x7fd19c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/3457027891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 0x7fd19c1593b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0aed40 tx=0x7fd19401c8c0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd1a22bf640 1 -- 172.21.15.87:0/3457027891 shutdown_connections 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/3457027891 >> v2:172.21.15.155:3300/0 conn(0x7fd19c06c670 0x7fd19c06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.609+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/3457027891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c0a8cc0 0x7fd19c1593b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- 172.21.15.87:0/3457027891 >> 172.21.15.87:0/3457027891 conn(0x7fd19c06d780 msgr2=0x7fd19c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- 172.21.15.87:0/3457027891 shutdown_connections 2024-04-25T15:54:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- 172.21.15.87:0/3457027891 wait complete. 2024-04-25T15:54:20.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 Processor -- start 2024-04-25T15:54:20.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- start start 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c06c670 0x7fd19c073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd19c0a8cc0 0x7fd19c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 0x7fd19c15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c0ac870 con 0x7fd19c152870 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c0ac6f0 con 0x7fd19c0a8cc0 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a22bf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd19c1623e0 con 0x7fd19c06c670 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 0x7fd19c15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 0x7fd19c15e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60484/0 (socket says 172.21.15.87:60484) 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 -- 172.21.15.87:0/2848821862 learned_addr learned my addr 172.21.15.87:0/2848821862 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd19b7fe640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd19c0a8cc0 0x7fd19c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd19bfff640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c06c670 0x7fd19c073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 -- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c06c670 msgr2=0x7fd19c073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c06c670 0x7fd19c073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 -- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd19c0a8cc0 msgr2=0x7fd19c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd19c0a8cc0 0x7fd19c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd1a085c640 1 -- 172.21.15.87:0/2848821862 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c0c82b0 con 0x7fd19c152870 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.613+0000 7fd19b7fe640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd19c0a8cc0 0x7fd19c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd1a085c640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 0x7fd19c15e170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00e7f0 tx=0x7fd18c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c017070 con 0x7fd19c152870 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18c00c8e0 con 0x7fd19c152870 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c073d30 con 0x7fd19c152870 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00eea0 con 0x7fd19c152870 2024-04-25T15:54:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c1f0f30 con 0x7fd19c152870 2024-04-25T15:54:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd19c069bb0 con 0x7fd19c152870 2024-04-25T15:54:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd18c01a070 con 0x7fd19c152870 2024-04-25T15:54:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd198ff9640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd17c06f430 0x7fd17c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7fd18c08fa40 con 0x7fd19c152870 2024-04-25T15:54:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd19bfff640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd17c06f430 0x7fd17c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.617+0000 7fd19bfff640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd17c06f430 0x7fd17c071940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1940ae000 tx=0x7fd1940a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:20.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.621+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd18c05c800 con 0x7fd19c152870 2024-04-25T15:54:20.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.785+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd19c1592b0 con 0x7fd19c152870 2024-04-25T15:54:20.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.785+0000 7fd198ff9640 1 -- 172.21.15.87:0/2848821862 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+20356 (secure 0 0 0) 0x7fd18c05c100 con 0x7fd19c152870 2024-04-25T15:54:20.788 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:20.788 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:19.744797+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:20.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd17c06f430 msgr2=0x7fd17c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd17c06f430 0x7fd17c071940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1940ae000 tx=0x7fd1940a7070 comp rx=0 tx=0).stop 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 msgr2=0x7fd19c15e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 0x7fd19c15e170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00e7f0 tx=0x7fd18c00ecb0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 shutdown_connections 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd17c06f430 0x7fd17c071940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd19c152870 0x7fd19c15e170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd19c0a8cc0 0x7fd19c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 --2- 172.21.15.87:0/2848821862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd19c06c670 0x7fd19c073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 >> 172.21.15.87:0/2848821862 conn(0x7fd19c06d780 msgr2=0x7fd19c14fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 shutdown_connections 2024-04-25T15:54:20.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.789+0000 7fd1a22bf640 1 -- 172.21.15.87:0/2848821862 wait complete. 2024-04-25T15:54:20.810 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:20.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 Processor -- start 2024-04-25T15:54:20.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 -- start start 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f44780c4250 0x7f447806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4478070490 0x7f447815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44780c5120 con 0x7f447815b170 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f44780c3b20 con 0x7f44780c4250 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f447deed640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4478070e20 con 0x7f4478070490 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f44780c4250 0x7f447806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f44780c4250 0x7f447806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60492/0 (socket says 172.21.15.87:60492) 2024-04-25T15:54:20.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 -- 172.21.15.87:0/2002520365 learned_addr learned my addr 172.21.15.87:0/2002520365 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:20.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f4476ffd640 1 --2- 172.21.15.87:0/2002520365 >> v2:172.21.15.155:3300/0 conn(0x7f4478070490 0x7f447815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 -- 172.21.15.87:0/2002520365 >> v2:172.21.15.155:3300/0 conn(0x7f4478070490 msgr2=0x7f447815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:20.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 --2- 172.21.15.87:0/2002520365 >> v2:172.21.15.155:3300/0 conn(0x7f4478070490 0x7f447815ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 -- 172.21.15.87:0/2002520365 >> v1:172.21.15.155:6789/0 conn(0x7f447815b170 legacy=0x7f44780c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:20.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.957+0000 7f44777fe640 1 -- 172.21.15.87:0/2002520365 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44780c4b60 con 0x7f44780c4250 2024-04-25T15:54:20.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f44777fe640 1 --2- 172.21.15.87:0/2002520365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f447806ff50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44780c5d30 tx=0x7f446001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cab7c1baa14a391 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:20.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f44767fc640 1 -- 172.21.15.87:0/2002520365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44600b0070 con 0x7f44780c4250 2024-04-25T15:54:20.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f44767fc640 1 -- 172.21.15.87:0/2002520365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44600ab600 con 0x7f44780c4250 2024-04-25T15:54:20.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f44767fc640 1 -- 172.21.15.87:0/2002520365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44600ab9d0 con 0x7f44780c4250 2024-04-25T15:54:20.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 -- 172.21.15.87:0/2002520365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 msgr2=0x7f447806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 --2- 172.21.15.87:0/2002520365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f447806ff50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44780c5d30 tx=0x7f446001c240 comp rx=0 tx=0).stop 2024-04-25T15:54:20.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 -- 172.21.15.87:0/2002520365 shutdown_connections 2024-04-25T15:54:20.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 --2- 172.21.15.87:0/2002520365 >> v2:172.21.15.155:3300/0 conn(0x7f4478070490 0x7f447815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 --2- 172.21.15.87:0/2002520365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f447806ff50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 -- 172.21.15.87:0/2002520365 >> 172.21.15.87:0/2002520365 conn(0x7f447806d780 msgr2=0x7f447806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:20.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 -- 172.21.15.87:0/2002520365 shutdown_connections 2024-04-25T15:54:20.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.961+0000 7f447deed640 1 -- 172.21.15.87:0/2002520365 wait complete. 2024-04-25T15:54:20.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 Processor -- start 2024-04-25T15:54:20.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- start start 2024-04-25T15:54:20.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4478070490 0x7f44780c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f44781f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f447815b170 0x7f447814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4478155280 con 0x7f44780c4250 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4478155100 con 0x7f447815b170 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4478164e80 con 0x7f4478070490 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f44781f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f44781f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60300/0 (socket says 172.21.15.87:60300) 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 -- 172.21.15.87:0/138101690 learned_addr learned my addr 172.21.15.87:0/138101690 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4477fff640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f447815b170 0x7f447814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f44777fe640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4478070490 0x7f44780c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 -- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4478070490 msgr2=0x7f44780c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4478070490 0x7f44780c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 -- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f447815b170 msgr2=0x7f447814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f447815b170 0x7f447814cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:20.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 -- 172.21.15.87:0/138101690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447815c590 con 0x7f44780c4250 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4477fff640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f447815b170 0x7f447814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f4476ffd640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f44781f17c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f446800d620 tx=0x7f446800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446800b620 con 0x7f44780c4250 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4468019070 con 0x7f44780c4250 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44781574b0 con 0x7f44780c4250 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446800b9e0 con 0x7f44780c4250 2024-04-25T15:54:20.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4478157770 con 0x7f44780c4250 2024-04-25T15:54:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.965+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4478069bb0 con 0x7f44780c4250 2024-04-25T15:54:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.969+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f446800bb80 con 0x7f44780c4250 2024-04-25T15:54:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.969+0000 7f446ffff640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f445806f430 0x7f4458071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.969+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7f4468090340 con 0x7f44780c4250 2024-04-25T15:54:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.969+0000 7f44777fe640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f445806f430 0x7f4458071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:20.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.969+0000 7f44777fe640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f445806f430 0x7f4458071940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44600ad000 tx=0x7f4460008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:20.973+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f446805d070 con 0x7f44780c4250 2024-04-25T15:54:21.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.133+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4478074420 con 0x7f44780c4250 2024-04-25T15:54:21.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.137+0000 7f446ffff640 1 -- 172.21.15.87:0/138101690 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+20356 (secure 0 0 0) 0x7f446805c970 con 0x7f44780c4250 2024-04-25T15:54:21.139 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:21.139 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:19.744797+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f445806f430 msgr2=0x7f4458071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f445806f430 0x7f4458071940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44600ad000 tx=0x7f4460008040 comp rx=0 tx=0).stop 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 msgr2=0x7f44781f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f44781f17c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f446800d620 tx=0x7f446800dae0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 shutdown_connections 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f445806f430 0x7f4458071940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f447815b170 0x7f447814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44780c4250 0x7f44781f17c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 --2- 172.21.15.87:0/138101690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4478070490 0x7f44780c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 >> 172.21.15.87:0/138101690 conn(0x7f447806d780 msgr2=0x7f4478153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:21.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 shutdown_connections 2024-04-25T15:54:21.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.141+0000 7f447deed640 1 -- 172.21.15.87:0/138101690 wait complete. 2024-04-25T15:54:21.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-04-25T15:54:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb5479a9640 1 Processor -- start 2024-04-25T15:54:21.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb5479a9640 1 -- start start 2024-04-25T15:54:21.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb5479a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 0x7fb54015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb5479a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5400c7570 con 0x7fb54015ad90 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb5479a9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54015b8b0 con 0x7fb540160230 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb5479a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb54015b5d0 con 0x7fb5400cb030 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb545745640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb54015ad90 0x7fb5400ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59360/0 (socket says 172.21.15.87:59360) 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb545745640 1 -- 172.21.15.87:0/918473836 learned_addr learned my addr 172.21.15.87:0/918473836 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb544f44640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 0x7fb54015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699379374 0 0) 0x7fb5400c7570 con 0x7fb54015ad90 2024-04-25T15:54:21.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.313+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52c003530 con 0x7fb54015ad90 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2210535201 0 0) 0x7fb52c003530 con 0x7fb54015ad90 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 msgr2=0x7fb54015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 0x7fb54015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 >> v1:172.21.15.155:6789/0 conn(0x7fb540160230 legacy=0x7fb540162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5400c2290 con 0x7fb54015ad90 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb53c001680 con 0x7fb54015ad90 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 >> v1:172.21.15.87:6789/0 conn(0x7fb54015ad90 legacy=0x7fb5400ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 0x7fb52c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c003f50 0x7fb52c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c004d50 0x7fb52c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb54015b5d0 con 0x7fb52c004d50 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c00bc30 con 0x7fb52c003f50 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb52c00be30 con 0x7fb5400cb030 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c004d50 0x7fb52c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb544f44640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c003f50 0x7fb52c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545745640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 0x7fb52c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 -- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 msgr2=0x7fb52c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400cb030 0x7fb52c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 -- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c003f50 msgr2=0x7fb52c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c003f50 0x7fb52c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 -- 172.21.15.87:0/918473836 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c003530 con 0x7fb52c004d50 2024-04-25T15:54:21.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb544f44640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c003f50 0x7fb52c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c004d50 0x7fb52c0051a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5400c7490 tx=0x7fb53801efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48661a1c2ce130f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380b5070 con 0x7fb52c004d50 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5380a8bd0 con 0x7fb52c004d50 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb537fff640 1 -- 172.21.15.87:0/918473836 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538001b60 con 0x7fb52c004d50 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb5479a9640 1 -- 172.21.15.87:0/918473836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c004d50 msgr2=0x7fb52c0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb5479a9640 1 --2- 172.21.15.87:0/918473836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb52c004d50 0x7fb52c0051a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb5400c7490 tx=0x7fb53801efb0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb545f46640 1 -- 172.21.15.87:0/918473836 reap_dead start 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb5479a9640 1 -- 172.21.15.87:0/918473836 shutdown_connections 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb5479a9640 1 -- 172.21.15.87:0/918473836 >> 172.21.15.87:0/918473836 conn(0x7fb5400c9330 msgr2=0x7fb5400c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb5479a9640 1 -- 172.21.15.87:0/918473836 shutdown_connections 2024-04-25T15:54:21.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.317+0000 7fb5479a9640 1 -- 172.21.15.87:0/918473836 wait complete. 2024-04-25T15:54:21.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 Processor -- start 2024-04-25T15:54:21.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 -- start start 2024-04-25T15:54:21.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400b1c00 0x7fb540151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 0x7fb540149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54014bfc0 0x7fb5401495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb540154d30 con 0x7fb54014bbb0 2024-04-25T15:54:21.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5400c8c90 con 0x7fb54014bfc0 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb5400ca190 con 0x7fb5400b1c00 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 0x7fb540149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 0x7fb540149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60312/0 (socket says 172.21.15.87:60312) 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 -- 172.21.15.87:0/1098882676 learned_addr learned my addr 172.21.15.87:0/1098882676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb545f46640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54014bfc0 0x7fb5401495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb545745640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400b1c00 0x7fb540151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 -- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400b1c00 msgr2=0x7fb540151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400b1c00 0x7fb540151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 -- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54014bfc0 msgr2=0x7fb5401495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54014bfc0 0x7fb5401495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 -- 172.21.15.87:0/1098882676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5401ed760 con 0x7fb54014bbb0 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb545745640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400b1c00 0x7fb540151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb544f44640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 0x7fb540149080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb5300115f0 tx=0x7fb530011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:21.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530004220 con 0x7fb54014bbb0 2024-04-25T15:54:21.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5300043c0 con 0x7fb54014bbb0 2024-04-25T15:54:21.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.321+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5401ed9d0 con 0x7fb54014bbb0 2024-04-25T15:54:21.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53000f8f0 con 0x7fb54014bbb0 2024-04-25T15:54:21.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5401edf90 con 0x7fb54014bbb0 2024-04-25T15:54:21.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb540069bb0 con 0x7fb54014bbb0 2024-04-25T15:54:21.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb53000fa90 con 0x7fb54014bbb0 2024-04-25T15:54:21.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb535ffb640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:21.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7fb53008f890 con 0x7fb54014bbb0 2024-04-25T15:54:21.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb545745640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:21.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.325+0000 7fb545745640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb53c004850 tx=0x7fb53c000ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:21.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.329+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb530019030 con 0x7fb54014bbb0 2024-04-25T15:54:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:21.537+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb5400c7760 con 0x7fb54014bbb0 2024-04-25T15:54:22.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.437+0000 7fb535ffb640 1 -- 172.21.15.87:0/1098882676 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 113+0+0 (secure 0 0 0) 0x7fb53005c4e0 con 0x7fb54014bbb0 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 msgr2=0x7fb524071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb53c004850 tx=0x7fb53c000ee0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 msgr2=0x7fb540149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 0x7fb540149080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb5300115f0 tx=0x7fb530011ab0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 shutdown_connections 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54014bfc0 0x7fb5401495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54014bbb0 0x7fb540149080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 --2- 172.21.15.87:0/1098882676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5400b1c00 0x7fb540151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 >> 172.21.15.87:0/1098882676 conn(0x7fb5400c9330 msgr2=0x7fb5400c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:22.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 shutdown_connections 2024-04-25T15:54:22.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.441+0000 7fb5479a9640 1 -- 172.21.15.87:0/1098882676 wait complete. 2024-04-25T15:54:22.464 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-25T15:54:22.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-04-25T15:54:22.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 Processor -- start 2024-04-25T15:54:22.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 -- start start 2024-04-25T15:54:22.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 0x7fbfa015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbfa015c320 0x7fbfa01661d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa015f400 con 0x7fbfa00c4940 2024-04-25T15:54:22.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa015f6e0 con 0x7fbfa015c320 2024-04-25T15:54:22.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbfa5cc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa015f9c0 con 0x7fbfa015edf0 2024-04-25T15:54:22.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9f7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbfa00c4940 0x7fbfa006ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59372/0 (socket says 172.21.15.87:59372) 2024-04-25T15:54:22.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9f7fe640 1 -- 172.21.15.87:0/2108883202 learned_addr learned my addr 172.21.15.87:0/2108883202 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:22.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 0x7fbfa015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9ffff640 1 --2- 172.21.15.87:0/2108883202 >> v2:172.21.15.155:3300/0 conn(0x7fbfa015c320 0x7fbfa01661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602831941 0 0) 0x7fbfa015f400 con 0x7fbfa00c4940 2024-04-25T15:54:22.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf88003530 con 0x7fbfa00c4940 2024-04-25T15:54:22.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1217801226 0 0) 0x7fbf88003530 con 0x7fbfa00c4940 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 msgr2=0x7fbfa015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 0x7fbfa015bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 >> v2:172.21.15.155:3300/0 conn(0x7fbfa015c320 msgr2=0x7fbfa01661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 --2- 172.21.15.87:0/2108883202 >> v2:172.21.15.155:3300/0 conn(0x7fbfa015c320 0x7fbfa01661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa015fca0 con 0x7fbfa00c4940 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fbf94001680 con 0x7fbfa00c4940 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 >> v1:172.21.15.87:6789/0 conn(0x7fbfa00c4940 legacy=0x7fbfa006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf880039c0 0x7fbf88003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf88004810 0x7fbf88004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 0x7fbf88005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa015f6e0 con 0x7fbf88004810 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa015f9c0 con 0x7fbf880039c0 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8800ba80 con 0x7fbfa015edf0 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf88004810 0x7fbf88004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9ffff640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 0x7fbf88005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 -- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 msgr2=0x7fbf88005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfa015edf0 0x7fbf88005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 -- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf880039c0 msgr2=0x7fbf88003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf880039c0 0x7fbf88003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.621+0000 7fbf9effd640 1 -- 172.21.15.87:0/2108883202 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf88003530 con 0x7fbf88004810 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbf9effd640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf88004810 0x7fbf88004c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0071e00 tx=0x7fbf9001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790147aaa20cfccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900096b0 con 0x7fbf88004810 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf900a6410 con 0x7fbf88004810 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbf9e7fc640 1 -- 172.21.15.87:0/2108883202 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900a67c0 con 0x7fbf88004810 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/2108883202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf88004810 msgr2=0x7fbf88004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/2108883202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf88004810 0x7fbf88004c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0071e00 tx=0x7fbf9001ca30 comp rx=0 tx=0).stop 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbf9ffff640 1 -- 172.21.15.87:0/2108883202 reap_dead start 2024-04-25T15:54:22.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/2108883202 shutdown_connections 2024-04-25T15:54:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/2108883202 >> 172.21.15.87:0/2108883202 conn(0x7fbfa00c8770 msgr2=0x7fbfa00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/2108883202 shutdown_connections 2024-04-25T15:54:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.625+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/2108883202 wait complete. 2024-04-25T15:54:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 Processor -- start 2024-04-25T15:54:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- start start 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf88004810 0x7fbfa01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 0x7fbfa013f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa01641c0 0x7fbfa01573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa006f610 con 0x7fbfa015e610 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa015c730 con 0x7fbfa01641c0 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa006f790 con 0x7fbf88004810 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 0x7fbfa013f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 0x7fbfa013f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60320/0 (socket says 172.21.15.87:60320) 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 -- 172.21.15.87:0/3785691813 learned_addr learned my addr 172.21.15.87:0/3785691813 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9f7fe640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf88004810 0x7fbfa01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9ffff640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa01641c0 0x7fbfa01573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 -- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf88004810 msgr2=0x7fbfa01f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf88004810 0x7fbfa01f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 -- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa01641c0 msgr2=0x7fbfa01573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa01641c0 0x7fbfa01573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 -- 172.21.15.87:0/3785691813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa0157f00 con 0x7fbfa015e610 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf9effd640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 0x7fbfa013f840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf9001c860 tx=0x7fbf88005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900a6bc0 con 0x7fbfa015e610 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf900a6d60 con 0x7fbfa015e610 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900ba640 con 0x7fbfa015e610 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa015cd70 con 0x7fbfa015e610 2024-04-25T15:54:22.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa01585d0 con 0x7fbfa015e610 2024-04-25T15:54:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.629+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa0069bb0 con 0x7fbfa015e610 2024-04-25T15:54:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.633+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbf900c5480 con 0x7fbfa015e610 2024-04-25T15:54:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.633+0000 7fbf87fff640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbf8c06f400 0x7fbf8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.633+0000 7fbf9f7fe640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbf8c06f400 0x7fbf8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:22.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.633+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fbf90129710 con 0x7fbfa015e610 2024-04-25T15:54:22.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.633+0000 7fbf9f7fe640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbf8c06f400 0x7fbf8c071910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf94001850 tx=0x7fbf94001600 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:22.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.637+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf900ac020 con 0x7fbfa015e610 2024-04-25T15:54:22.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:22.829+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbfa00743c0 con 0x7fbfa015e610 2024-04-25T15:54:22.925 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-04-25T15:54:22.925+0000 7f9b6440c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:54:23.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.449+0000 7fbf87fff640 1 -- 172.21.15.87:0/3785691813 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7fbf90016740 con 0x7fbfa015e610 2024-04-25T15:54:23.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbf8c06f400 msgr2=0x7fbf8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbf8c06f400 0x7fbf8c071910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf94001850 tx=0x7fbf94001600 comp rx=0 tx=0).stop 2024-04-25T15:54:23.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 msgr2=0x7fbfa013f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 0x7fbfa013f840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf9001c860 tx=0x7fbf88005840 comp rx=0 tx=0).stop 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 shutdown_connections 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbf8c06f400 0x7fbf8c071910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa01641c0 0x7fbfa01573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfa015e610 0x7fbfa013f840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 --2- 172.21.15.87:0/3785691813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf88004810 0x7fbfa01f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 >> 172.21.15.87:0/3785691813 conn(0x7fbfa00c8770 msgr2=0x7fbfa0160a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 shutdown_connections 2024-04-25T15:54:23.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.453+0000 7fbfa5cc5640 1 -- 172.21.15.87:0/3785691813 wait complete. 2024-04-25T15:54:23.476 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-04-25T15:54:23.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32c649640 1 Processor -- start 2024-04-25T15:54:23.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32c649640 1 -- start start 2024-04-25T15:54:23.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32c649640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc3241518b0 0x7fc32406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32c649640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc324154fc0 con 0x7fc3240ad160 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32c649640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3240acb20 con 0x7fc32406fa10 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32c649640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc32406ed60 con 0x7fc3241518b0 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc329be4640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc3240ad160 0x7fc3240c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59374/0 (socket says 172.21.15.87:59374) 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc329be4640 1 -- 172.21.15.87:0/2190435416 learned_addr learned my addr 172.21.15.87:0/2190435416 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.629+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/2190435416 >> v2:172.21.15.155:3300/0 conn(0x7fc3241518b0 0x7fc32406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554339020 0 0) 0x7fc324154fc0 con 0x7fc3240ad160 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc30c003530 con 0x7fc3240ad160 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1134889613 0 0) 0x7fc30c003530 con 0x7fc3240ad160 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 >> v2:172.21.15.155:3300/0 conn(0x7fc3241518b0 msgr2=0x7fc32406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 --2- 172.21.15.87:0/2190435416 >> v2:172.21.15.155:3300/0 conn(0x7fc3241518b0 0x7fc32406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 >> v1:172.21.15.155:6789/0 conn(0x7fc32406fa10 legacy=0x7fc32415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3240ace00 con 0x7fc3240ad160 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fc318001a00 con 0x7fc3240ad160 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 >> v1:172.21.15.87:6789/0 conn(0x7fc3240ad160 legacy=0x7fc3240c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc30c0039c0 0x7fc30c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c004810 0x7fc30c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c005280 0x7fc30c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc32406ed60 con 0x7fc30c0039c0 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c00c1a0 con 0x7fc30c005280 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c00c3a0 con 0x7fc30c004810 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc30c0039c0 0x7fc30c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 -- 172.21.15.87:0/2190435416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c004810 msgr2=0x7fc30c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc30c004810 0x7fc30c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 -- 172.21.15.87:0/2190435416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c005280 msgr2=0x7fc30c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:23.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c005280 0x7fc30c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 -- 172.21.15.87:0/2190435416 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c003530 con 0x7fc30c0039c0 2024-04-25T15:54:23.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32abe6640 1 -- 172.21.15.87:0/2190435416 reap_dead start 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc30c0039c0 0x7fc30c003e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009ab0 tx=0x7fc31c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb109a0e91a5c75b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0b2070 con 0x7fc30c0039c0 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0a5680 con 0x7fc30c0039c0 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc3293e3640 1 -- 172.21.15.87:0/2190435416 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0096b0 con 0x7fc30c0039c0 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32c649640 1 -- 172.21.15.87:0/2190435416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc30c0039c0 msgr2=0x7fc30c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.633+0000 7fc32c649640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc30c0039c0 0x7fc30c003e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009ab0 tx=0x7fc31c01ca90 comp rx=0 tx=0).stop 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- 172.21.15.87:0/2190435416 shutdown_connections 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 --2- 172.21.15.87:0/2190435416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc30c0039c0 0x7fc30c003e50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- 172.21.15.87:0/2190435416 >> 172.21.15.87:0/2190435416 conn(0x7fc3240c8770 msgr2=0x7fc3240c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:23.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- 172.21.15.87:0/2190435416 shutdown_connections 2024-04-25T15:54:23.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- 172.21.15.87:0/2190435416 wait complete. 2024-04-25T15:54:23.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 Processor -- start 2024-04-25T15:54:23.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- start start 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0039c0 0x7fc3241f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 0x7fc32414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3240c18f0 0x7fc3240c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc3241579d0 con 0x7fc3240bec10 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc324157850 con 0x7fc30c0039c0 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc324157b50 con 0x7fc3240c18f0 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 0x7fc32414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:23.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 0x7fc32414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60340/0 (socket says 172.21.15.87:60340) 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 -- 172.21.15.87:0/1450876739 learned_addr learned my addr 172.21.15.87:0/1450876739 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0039c0 0x7fc3241f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 -- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3240c18f0 msgr2=0x7fc3240c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3240c18f0 0x7fc3240c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 -- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0039c0 msgr2=0x7fc3241f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0039c0 0x7fc3241f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 -- 172.21.15.87:0/1450876739 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3241f0fd0 con 0x7fc3240bec10 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0039c0 0x7fc3241f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc329be4640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 0x7fc32414ebd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc31800cad0 tx=0x7fc31800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318018070 con 0x7fc3240bec10 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31800a760 con 0x7fc3240bec10 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3241e2380 con 0x7fc3240bec10 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31800ab50 con 0x7fc3240bec10 2024-04-25T15:54:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.637+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3241e1b10 con 0x7fc3240bec10 2024-04-25T15:54:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.641+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc324069bb0 con 0x7fc3240bec10 2024-04-25T15:54:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.641+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc31801b070 con 0x7fc3240bec10 2024-04-25T15:54:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.641+0000 7fc322ffd640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc31006f400 0x7fc310071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.641+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc31006f400 0x7fc310071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.641+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc31808edb0 con 0x7fc3240bec10 2024-04-25T15:54:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.641+0000 7fc32a3e5640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc31006f400 0x7fc310071910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0af000 tx=0x7fc31c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:23.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.645+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc31805ba00 con 0x7fc3240bec10 2024-04-25T15:54:23.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:23.845+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc3240c8f00 con 0x7fc3240bec10 2024-04-25T15:54:24.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.461+0000 7fc322ffd640 1 -- 172.21.15.87:0/1450876739 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v15) ==== 110+0+0 (secure 0 0 0) 0x7fc31805b300 con 0x7fc3240bec10 2024-04-25T15:54:24.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc31006f400 msgr2=0x7fc310071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc31006f400 0x7fc310071910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0af000 tx=0x7fc31c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 msgr2=0x7fc32414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 0x7fc32414ebd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc31800cad0 tx=0x7fc31800cf90 comp rx=0 tx=0).stop 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 shutdown_connections 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc31006f400 0x7fc310071910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3240c18f0 0x7fc3240c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3240bec10 0x7fc32414ebd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 --2- 172.21.15.87:0/1450876739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc30c0039c0 0x7fc3241f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 >> 172.21.15.87:0/1450876739 conn(0x7fc3240c8770 msgr2=0x7fc324150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 shutdown_connections 2024-04-25T15:54:24.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.465+0000 7fc32c649640 1 -- 172.21.15.87:0/1450876739 wait complete. 2024-04-25T15:54:24.489 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-04-25T15:54:24.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:24.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a68c65640 1 Processor -- start 2024-04-25T15:54:24.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a68c65640 1 -- start start 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a68c65640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 0x7f7a6415f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a68c65640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6406f240 con 0x7f7a6413ccb0 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a68c65640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6406f520 con 0x7f7a64072eb0 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a68c65640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6406fb70 con 0x7f7a641575e0 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6259c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7a6413ccb0 0x7f7a640727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59376/0 (socket says 172.21.15.87:59376) 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6259c640 1 -- 172.21.15.87:0/3181522058 learned_addr learned my addr 172.21.15.87:0/3181522058 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a62d9d640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 0x7f7a6415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230799031 0 0) 0x7f7a6406f240 con 0x7f7a6413ccb0 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a50003530 con 0x7f7a6413ccb0 2024-04-25T15:54:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2124851136 0 0) 0x7f7a50003530 con 0x7f7a6413ccb0 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 msgr2=0x7f7a6415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 0x7f7a6415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 >> v1:172.21.15.155:6789/0 conn(0x7f7a64072eb0 legacy=0x7f7a64156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6406f800 con 0x7f7a6413ccb0 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f7a5c001a00 con 0x7f7a6413ccb0 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 >> v1:172.21.15.87:6789/0 conn(0x7f7a6413ccb0 legacy=0x7f7a640727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a500039f0 0x7f7a50003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a50004810 0x7f7a50004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 0x7f7a50005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6406fb70 con 0x7f7a50004810 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5000bb60 con 0x7f7a500039f0 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5000bd30 con 0x7f7a641575e0 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a61d9b640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a50004810 0x7f7a50004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6259c640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a500039f0 0x7f7a50003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a62d9d640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 0x7f7a50005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a61d9b640 1 -- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 msgr2=0x7f7a50005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a61d9b640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a641575e0 0x7f7a50005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a61d9b640 1 -- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a500039f0 msgr2=0x7f7a50003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a61d9b640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a500039f0 0x7f7a50003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a61d9b640 1 -- 172.21.15.87:0/3181522058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50003530 con 0x7f7a50004810 2024-04-25T15:54:24.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.645+0000 7f7a6259c640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a500039f0 0x7f7a50003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a61d9b640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a50004810 0x7f7a50004c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c001890 tx=0x7f7a4c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65926e3d4afb8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0b0070 con 0x7f7a50004810 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0ab600 con 0x7f7a50004810 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a6159a640 1 -- 172.21.15.87:0/3181522058 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c001460 con 0x7f7a50004810 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a68c65640 1 -- 172.21.15.87:0/3181522058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a50004810 msgr2=0x7f7a50004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a68c65640 1 --2- 172.21.15.87:0/3181522058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a50004810 0x7f7a50004c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c001890 tx=0x7f7a4c01c4e0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a62d9d640 1 -- 172.21.15.87:0/3181522058 reap_dead start 2024-04-25T15:54:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a68c65640 1 -- 172.21.15.87:0/3181522058 shutdown_connections 2024-04-25T15:54:24.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a68c65640 1 -- 172.21.15.87:0/3181522058 >> 172.21.15.87:0/3181522058 conn(0x7f7a6406d650 msgr2=0x7f7a640c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:24.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a68c65640 1 -- 172.21.15.87:0/3181522058 shutdown_connections 2024-04-25T15:54:24.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.649+0000 7f7a68c65640 1 -- 172.21.15.87:0/3181522058 wait complete. 2024-04-25T15:54:24.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 Processor -- start 2024-04-25T15:54:24.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- start start 2024-04-25T15:54:24.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a50004810 0x7f7a640ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a64135800 0x7f7a6413a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 0x7f7a641312f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a64157b70 con 0x7f7a64130ee0 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a641579f0 con 0x7f7a50004810 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6415fa20 con 0x7f7a64135800 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 0x7f7a641312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 0x7f7a641312f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60352/0 (socket says 172.21.15.87:60352) 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 -- 172.21.15.87:0/273204331 learned_addr learned my addr 172.21.15.87:0/273204331 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a6259c640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a50004810 0x7f7a640ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a61d9b640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a64135800 0x7f7a6413a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 -- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a64135800 msgr2=0x7f7a6413a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a64135800 0x7f7a6413a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 -- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a50004810 msgr2=0x7f7a640ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a50004810 0x7f7a640ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 -- 172.21.15.87:0/273204331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a641f16c0 con 0x7f7a64130ee0 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a61d9b640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a64135800 0x7f7a6413a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a62d9d640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 0x7f7a641312f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a640ab500 tx=0x7f7a54011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54019020 con 0x7f7a64130ee0 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a54003620 con 0x7f7a64130ee0 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a64134d60 con 0x7f7a64130ee0 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54003a10 con 0x7f7a64130ee0 2024-04-25T15:54:24.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a641309c0 con 0x7f7a64130ee0 2024-04-25T15:54:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.653+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a64069bb0 con 0x7f7a64130ee0 2024-04-25T15:54:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.657+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7a5401c020 con 0x7f7a64130ee0 2024-04-25T15:54:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.657+0000 7f7a5affd640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7a4406f430 0x7f7a44071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.657+0000 7f7a6259c640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7a4406f430 0x7f7a44071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.657+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7a5408fc20 con 0x7f7a64130ee0 2024-04-25T15:54:24.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.657+0000 7f7a6259c640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7a4406f430 0x7f7a44071940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c000f90 tx=0x7f7a5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:24.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.661+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a54023020 con 0x7f7a64130ee0 2024-04-25T15:54:24.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.857+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a640aeee0 con 0x7f7a64130ee0 2024-04-25T15:54:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.857+0000 7f7a5affd640 1 -- 172.21.15.87:0/273204331 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f7a5405c860 con 0x7f7a64130ee0 2024-04-25T15:54:24.860 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:24.860 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:24.860 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:24.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7a4406f430 msgr2=0x7f7a44071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7a4406f430 0x7f7a44071940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c000f90 tx=0x7f7a5c009040 comp rx=0 tx=0).stop 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 msgr2=0x7f7a641312f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 0x7f7a641312f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a640ab500 tx=0x7f7a54011920 comp rx=0 tx=0).stop 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 shutdown_connections 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7a4406f430 0x7f7a44071940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a64130ee0 0x7f7a641312f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a64135800 0x7f7a6413a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 --2- 172.21.15.87:0/273204331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a50004810 0x7f7a640ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 >> 172.21.15.87:0/273204331 conn(0x7f7a6406d650 msgr2=0x7f7a64156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 shutdown_connections 2024-04-25T15:54:24.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:24.861+0000 7f7a68c65640 1 -- 172.21.15.87:0/273204331 wait complete. 2024-04-25T15:54:24.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:25.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f5a9b5640 1 Processor -- start 2024-04-25T15:54:25.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f5a9b5640 1 -- start start 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f5a9b5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f541529a0 0x7f0f54071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f5a9b5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540ae1b0 con 0x7f0f540ad990 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f5a9b5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f54072430 con 0x7f0f540adda0 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f5a9b5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0f54074730 con 0x7f0f541529a0 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f537fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0f540ad990 0x7f0f540c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59378/0 (socket says 172.21.15.87:59378) 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f537fe640 1 -- 172.21.15.87:0/2993032121 learned_addr learned my addr 172.21.15.87:0/2993032121 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:25.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f53fff640 1 --2- 172.21.15.87:0/2993032121 >> v2:172.21.15.155:3300/0 conn(0x7f0f541529a0 0x7f0f54071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426628090 0 0) 0x7f0f540ae1b0 con 0x7f0f540ad990 2024-04-25T15:54:25.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3c003530 con 0x7f0f540ad990 2024-04-25T15:54:25.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 297567888 0 0) 0x7f0f3c003530 con 0x7f0f540ad990 2024-04-25T15:54:25.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 >> v2:172.21.15.155:3300/0 conn(0x7f0f541529a0 msgr2=0x7f0f54071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 --2- 172.21.15.87:0/2993032121 >> v2:172.21.15.155:3300/0 conn(0x7f0f541529a0 0x7f0f54071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 >> v1:172.21.15.155:6789/0 conn(0x7f0f540adda0 legacy=0x7f0f540c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f54074a10 con 0x7f0f540ad990 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f0f44001680 con 0x7f0f540ad990 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 >> v1:172.21.15.87:6789/0 conn(0x7f0f540ad990 legacy=0x7f0f540c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c0039c0 0x7f0f3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c004810 0x7f0f3c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f3c005260 0x7f0f3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0f54074730 con 0x7f0f3c005260 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c010600 con 0x7f0f3c0039c0 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c010800 con 0x7f0f3c004810 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f58f52640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f3c005260 0x7f0f3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f537fe640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c004810 0x7f0f3c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f53fff640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c0039c0 0x7f0f3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f58f52640 1 -- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c004810 msgr2=0x7f0f3c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f58f52640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c004810 0x7f0f3c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f58f52640 1 -- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c0039c0 msgr2=0x7f0f3c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f58f52640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c0039c0 0x7f0f3c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.025+0000 7f0f58f52640 1 -- 172.21.15.87:0/2993032121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c003530 con 0x7f0f3c005260 2024-04-25T15:54:25.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f58f52640 1 -- 172.21.15.87:0/2993032121 reap_dead start 2024-04-25T15:54:25.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f58f52640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f3c005260 0x7f0f3c00b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f540c2ce0 tx=0x7f0f4c01c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdc8fa76b47aeee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c001a90 con 0x7f0f3c005260 2024-04-25T15:54:25.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c003b80 con 0x7f0f3c005260 2024-04-25T15:54:25.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f52ffd640 1 -- 172.21.15.87:0/2993032121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0050d0 con 0x7f0f3c005260 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/2993032121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f3c005260 msgr2=0x7f0f3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f3c005260 0x7f0f3c00b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f540c2ce0 tx=0x7f0f4c01c720 comp rx=0 tx=0).stop 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/2993032121 shutdown_connections 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/2993032121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f3c005260 0x7f0f3c00b9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/2993032121 >> 172.21.15.87:0/2993032121 conn(0x7f0f540c8770 msgr2=0x7f0f540c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/2993032121 shutdown_connections 2024-04-25T15:54:25.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.029+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/2993032121 wait complete. 2024-04-25T15:54:25.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 Processor -- start 2024-04-25T15:54:25.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 -- start start 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c005260 0x7f0f54158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f54153230 0x7f0f541ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 0x7f0f54149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540ab1a0 con 0x7f0f541ea410 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f54074fd0 con 0x7f0f54153230 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f54071e50 con 0x7f0f3c005260 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 0x7f0f54149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 0x7f0f54149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60380/0 (socket says 172.21.15.87:60380) 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 -- 172.21.15.87:0/3997482209 learned_addr learned my addr 172.21.15.87:0/3997482209 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f537fe640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f54153230 0x7f0f541ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f53fff640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c005260 0x7f0f54158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 -- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c005260 msgr2=0x7f0f54158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c005260 0x7f0f54158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 -- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f54153230 msgr2=0x7f0f541ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f54153230 0x7f0f541ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 -- 172.21.15.87:0/3997482209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f54157f70 con 0x7f0f541ea410 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f58f52640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 0x7f0f54149810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c01cfc0 tx=0x7f0f3c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c007dc0 con 0x7f0f541ea410 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c006b60 con 0x7f0f541ea410 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c001a90 con 0x7f0f541ea410 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f541ed0c0 con 0x7f0f541ea410 2024-04-25T15:54:25.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.033+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f541ed3a0 con 0x7f0f541ea410 2024-04-25T15:54:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.037+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f54069bb0 con 0x7f0f541ea410 2024-04-25T15:54:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.037+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0f4c007030 con 0x7f0f541ea410 2024-04-25T15:54:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.037+0000 7f0f50ff9640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0f4006f400 0x7f0f40071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.037+0000 7f0f53fff640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0f4006f400 0x7f0f40071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.037+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0f4c128e40 con 0x7f0f541ea410 2024-04-25T15:54:25.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.037+0000 7f0f53fff640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0f4006f400 0x7f0f40071910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f54073d40 tx=0x7f0f48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.041+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f4c0ba060 con 0x7f0f541ea410 2024-04-25T15:54:25.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.197+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f540c8dd0 con 0x7f0f541ea410 2024-04-25T15:54:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f50ff9640 1 -- 172.21.15.87:0/3997482209 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f0f4c016430 con 0x7f0f541ea410 2024-04-25T15:54:25.201 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:25.201 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0f4006f400 msgr2=0x7f0f40071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0f4006f400 0x7f0f40071910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f54073d40 tx=0x7f0f48008040 comp rx=0 tx=0).stop 2024-04-25T15:54:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 msgr2=0x7f0f54149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 0x7f0f54149810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c01cfc0 tx=0x7f0f3c005840 comp rx=0 tx=0).stop 2024-04-25T15:54:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 shutdown_connections 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0f4006f400 0x7f0f40071910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f541ea410 0x7f0f54149810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f54153230 0x7f0f541ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 --2- 172.21.15.87:0/3997482209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c005260 0x7f0f54158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 >> 172.21.15.87:0/3997482209 conn(0x7f0f540c8770 msgr2=0x7f0f541509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 shutdown_connections 2024-04-25T15:54:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.201+0000 7f0f5a9b5640 1 -- 172.21.15.87:0/3997482209 wait complete. 2024-04-25T15:54:25.222 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:54:25.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:25.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 Processor -- start 2024-04-25T15:54:25.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 -- start start 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa464071e50 0x7fa4640c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4640c4720 0x7fa46415fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa464072430 con 0x7fa4641529a0 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa464074730 con 0x7fa464071e50 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa46a1b5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa464074a10 con 0x7fa4640c4720 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa4637fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa4641529a0 0x7fa4640ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59392/0 (socket says 172.21.15.87:59392) 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa4637fe640 1 -- 172.21.15.87:0/651127802 learned_addr learned my addr 172.21.15.87:0/651127802 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa45bfff640 1 --2- 172.21.15.87:0/651127802 >> v2:172.21.15.87:3300/0 conn(0x7fa464071e50 0x7fa4640c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa463fff640 1 --2- 172.21.15.87:0/651127802 >> v2:172.21.15.155:3300/0 conn(0x7fa4640c4720 0x7fa46415fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa462ffd640 1 -- 172.21.15.87:0/651127802 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678785980 0 0) 0x7fa464072430 con 0x7fa4641529a0 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa462ffd640 1 -- 172.21.15.87:0/651127802 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa450003530 con 0x7fa4641529a0 2024-04-25T15:54:25.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa45bfff640 1 -- 172.21.15.87:0/651127802 >> v2:172.21.15.155:3300/0 conn(0x7fa4640c4720 msgr2=0x7fa46415fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa45bfff640 1 --2- 172.21.15.87:0/651127802 >> v2:172.21.15.155:3300/0 conn(0x7fa4640c4720 0x7fa46415fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa45bfff640 1 -- 172.21.15.87:0/651127802 >> v1:172.21.15.87:6789/0 conn(0x7fa4641529a0 legacy=0x7fa4640ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.373+0000 7fa45bfff640 1 -- 172.21.15.87:0/651127802 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa464074cf0 con 0x7fa464071e50 2024-04-25T15:54:25.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa45bfff640 1 --2- 172.21.15.87:0/651127802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464071e50 0x7fa4640c41e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ae750 tx=0x7fa44c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbee6829523b2d0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa462ffd640 1 -- 172.21.15.87:0/651127802 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0b0070 con 0x7fa464071e50 2024-04-25T15:54:25.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa462ffd640 1 -- 172.21.15.87:0/651127802 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44c0ab600 con 0x7fa464071e50 2024-04-25T15:54:25.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa462ffd640 1 -- 172.21.15.87:0/651127802 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0ab9d0 con 0x7fa464071e50 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 -- 172.21.15.87:0/651127802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464071e50 msgr2=0x7fa4640c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/651127802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464071e50 0x7fa4640c41e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ae750 tx=0x7fa44c01c3f0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 -- 172.21.15.87:0/651127802 shutdown_connections 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/651127802 >> v2:172.21.15.155:3300/0 conn(0x7fa4640c4720 0x7fa46415fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/651127802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464071e50 0x7fa4640c41e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 -- 172.21.15.87:0/651127802 >> 172.21.15.87:0/651127802 conn(0x7fa4640c8770 msgr2=0x7fa4640c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 -- 172.21.15.87:0/651127802 shutdown_connections 2024-04-25T15:54:25.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 -- 172.21.15.87:0/651127802 wait complete. 2024-04-25T15:54:25.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 Processor -- start 2024-04-25T15:54:25.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.377+0000 7fa46a1b5640 1 -- start start 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa464071e50 0x7fa4641546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4640c4720 0x7fa46414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 0x7fa46414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa4641629b0 con 0x7fa4641529a0 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa464162830 con 0x7fa4640c4720 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa464162b30 con 0x7fa464071e50 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 0x7fa46414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 0x7fa46414bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60390/0 (socket says 172.21.15.87:60390) 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 -- 172.21.15.87:0/2906700367 learned_addr learned my addr 172.21.15.87:0/2906700367 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa45bfff640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4640c4720 0x7fa46414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa4637fe640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa464071e50 0x7fa4641546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 -- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa464071e50 msgr2=0x7fa4641546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa464071e50 0x7fa4641546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 -- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4640c4720 msgr2=0x7fa46414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4640c4720 0x7fa46414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 -- 172.21.15.87:0/2906700367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa464158f50 con 0x7fa4641529a0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa45bfff640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4640c4720 0x7fa46414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa463fff640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 0x7fa46414bf60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00efc0 tx=0x7fa45c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c018020 con 0x7fa4641529a0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45c014480 con 0x7fa4641529a0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4640c1c70 con 0x7fa4641529a0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c009e60 con 0x7fa4641529a0 2024-04-25T15:54:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4640c2230 con 0x7fa4641529a0 2024-04-25T15:54:25.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa464154310 con 0x7fa4641529a0 2024-04-25T15:54:25.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.381+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa45c01b020 con 0x7fa4641529a0 2024-04-25T15:54:25.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.385+0000 7fa460ff9640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa44406f400 0x7fa444071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.385+0000 7fa4637fe640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa44406f400 0x7fa444071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.385+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa45c0903e0 con 0x7fa4641529a0 2024-04-25T15:54:25.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.385+0000 7fa4637fe640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa44406f400 0x7fa444071910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa454007fd0 tx=0x7fa454009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.389+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa45c022020 con 0x7fa4641529a0 2024-04-25T15:54:25.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.549+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4640c2430 con 0x7fa44406f400 2024-04-25T15:54:25.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.561+0000 7fa460ff9640 1 -- 172.21.15.87:0/2906700367 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490412 (secure 0 0 0) 0x7fa4640c2430 con 0x7fa44406f400 2024-04-25T15:54:25.564 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:25.569 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:25.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.565+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa44406f400 msgr2=0x7fa444071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.565+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa44406f400 0x7fa444071910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa454007fd0 tx=0x7fa454009040 comp rx=0 tx=0).stop 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.565+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 msgr2=0x7fa46414bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.565+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 0x7fa46414bf60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00efc0 tx=0x7fa45c00c490 comp rx=0 tx=0).stop 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.565+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 shutdown_connections 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa44406f400 0x7fa444071910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4641529a0 0x7fa46414bf60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4640c4720 0x7fa46414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 --2- 172.21.15.87:0/2906700367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa464071e50 0x7fa4641546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 >> 172.21.15.87:0/2906700367 conn(0x7fa4640c8770 msgr2=0x7fa464150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 shutdown_connections 2024-04-25T15:54:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.569+0000 7fa46a1b5640 1 -- 172.21.15.87:0/2906700367 wait complete. 2024-04-25T15:54:25.586 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-25T15:54:25.106204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219416,"kb_used_data":3236,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755304,"statfs":{"total":773094113280,"available":772869431296,"internally_reserved":0,"allocated":3313664,"data_stored":1963143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002784"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391405+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:21.391405+0000","last_peered":"2024-04-25T15:54:21.391405+0000","last_clean":"2024-04-25T15:54:21.391405+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:21.391405+0000","last_undegraded":"2024-04-25T15:54:21.391405+0000","last_fullsized":"2024-04-25T15:54:21.391405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437024+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:21.437024+0000","last_peered":"2024-04-25T15:54:21.437024+0000","last_clean":"2024-04-25T15:54:21.437024+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:21.437024+0000","last_undegraded":"2024-04-25T15:54:21.437024+0000","last_fullsized":"2024-04-25T15:54:21.437024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923430+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:21.923430+0000","last_peered":"2024-04-25T15:54:21.923430+0000","last_clean":"2024-04-25T15:54:21.923430+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:21.923430+0000","last_undegraded":"2024-04-25T15:54:21.923430+0000","last_fullsized":"2024-04-25T15:54:21.923430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921812+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:21.921812+0000","last_peered":"2024-04-25T15:54:21.921812+0000","last_clean":"2024-04-25T15:54:21.921812+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:21.921812+0000","last_undegraded":"2024-04-25T15:54:21.921812+0000","last_fullsized":"2024-04-25T15:54:21.921812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441214+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:21.441214+0000","last_peered":"2024-04-25T15:54:21.441214+0000","last_clean":"2024-04-25T15:54:21.441214+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:21.441214+0000","last_undegraded":"2024-04-25T15:54:21.441214+0000","last_fullsized":"2024-04-25T15:54:21.441214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923615+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:21.923615+0000","last_peered":"2024-04-25T15:54:21.923615+0000","last_clean":"2024-04-25T15:54:21.923615+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:21.923615+0000","last_undegraded":"2024-04-25T15:54:21.923615+0000","last_fullsized":"2024-04-25T15:54:21.923615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436826+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:21.436826+0000","last_peered":"2024-04-25T15:54:21.436826+0000","last_clean":"2024-04-25T15:54:21.436826+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:21.436826+0000","last_undegraded":"2024-04-25T15:54:21.436826+0000","last_fullsized":"2024-04-25T15:54:21.436826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391229+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:21.391229+0000","last_peered":"2024-04-25T15:54:21.391229+0000","last_clean":"2024-04-25T15:54:21.391229+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:21.391229+0000","last_undegraded":"2024-04-25T15:54:21.391229+0000","last_fullsized":"2024-04-25T15:54:21.391229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921155+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:21.921155+0000","last_peered":"2024-04-25T15:54:21.921155+0000","last_clean":"2024-04-25T15:54:21.921155+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:21.921155+0000","last_undegraded":"2024-04-25T15:54:21.921155+0000","last_fullsized":"2024-04-25T15:54:21.921155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922089+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:21.922089+0000","last_peered":"2024-04-25T15:54:21.922089+0000","last_clean":"2024-04-25T15:54:21.922089+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:21.922089+0000","last_undegraded":"2024-04-25T15:54:21.922089+0000","last_fullsized":"2024-04-25T15:54:21.922089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922747+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:21.922747+0000","last_peered":"2024-04-25T15:54:21.922747+0000","last_clean":"2024-04-25T15:54:21.922747+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:21.922747+0000","last_undegraded":"2024-04-25T15:54:21.922747+0000","last_fullsized":"2024-04-25T15:54:21.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393261+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:21.393261+0000","last_peered":"2024-04-25T15:54:21.393261+0000","last_clean":"2024-04-25T15:54:21.393261+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:21.393261+0000","last_undegraded":"2024-04-25T15:54:21.393261+0000","last_fullsized":"2024-04-25T15:54:21.393261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925213+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:21.925213+0000","last_peered":"2024-04-25T15:54:21.925213+0000","last_clean":"2024-04-25T15:54:21.925213+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:21.925213+0000","last_undegraded":"2024-04-25T15:54:21.925213+0000","last_fullsized":"2024-04-25T15:54:21.925213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924737+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:21.924737+0000","last_peered":"2024-04-25T15:54:21.924737+0000","last_clean":"2024-04-25T15:54:21.924737+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:21.924737+0000","last_undegraded":"2024-04-25T15:54:21.924737+0000","last_fullsized":"2024-04-25T15:54:21.924737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924403+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:21.924403+0000","last_peered":"2024-04-25T15:54:21.924403+0000","last_clean":"2024-04-25T15:54:21.924403+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:21.924403+0000","last_undegraded":"2024-04-25T15:54:21.924403+0000","last_fullsized":"2024-04-25T15:54:21.924403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393266+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:21.393266+0000","last_peered":"2024-04-25T15:54:21.393266+0000","last_clean":"2024-04-25T15:54:21.393266+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:21.393266+0000","last_undegraded":"2024-04-25T15:54:21.393266+0000","last_fullsized":"2024-04-25T15:54:21.393266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442122+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:21.442122+0000","last_peered":"2024-04-25T15:54:21.442122+0000","last_clean":"2024-04-25T15:54:21.442122+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:21.442122+0000","last_undegraded":"2024-04-25T15:54:21.442122+0000","last_fullsized":"2024-04-25T15:54:21.442122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394591+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:21.394591+0000","last_peered":"2024-04-25T15:54:21.394591+0000","last_clean":"2024-04-25T15:54:21.394591+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:21.394591+0000","last_undegraded":"2024-04-25T15:54:21.394591+0000","last_fullsized":"2024-04-25T15:54:21.394591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923550+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:21.923550+0000","last_peered":"2024-04-25T15:54:21.923550+0000","last_clean":"2024-04-25T15:54:21.923550+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:21.923550+0000","last_undegraded":"2024-04-25T15:54:21.923550+0000","last_fullsized":"2024-04-25T15:54:21.923550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396443+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:21.396443+0000","last_peered":"2024-04-25T15:54:21.396443+0000","last_clean":"2024-04-25T15:54:21.396443+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:21.396443+0000","last_undegraded":"2024-04-25T15:54:21.396443+0000","last_fullsized":"2024-04-25T15:54:21.396443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389783+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:21.389783+0000","last_peered":"2024-04-25T15:54:21.389783+0000","last_clean":"2024-04-25T15:54:21.389783+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:21.389783+0000","last_undegraded":"2024-04-25T15:54:21.389783+0000","last_fullsized":"2024-04-25T15:54:21.389783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921814+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:21.921814+0000","last_peered":"2024-04-25T15:54:21.921814+0000","last_clean":"2024-04-25T15:54:21.921814+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:21.921814+0000","last_undegraded":"2024-04-25T15:54:21.921814+0000","last_fullsized":"2024-04-25T15:54:21.921814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441971+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:21.441971+0000","last_peered":"2024-04-25T15:54:21.441971+0000","last_clean":"2024-04-25T15:54:21.441971+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:21.441971+0000","last_undegraded":"2024-04-25T15:54:21.441971+0000","last_fullsized":"2024-04-25T15:54:21.441971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397258+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:21.397258+0000","last_peered":"2024-04-25T15:54:21.397258+0000","last_clean":"2024-04-25T15:54:21.397258+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:21.397258+0000","last_undegraded":"2024-04-25T15:54:21.397258+0000","last_fullsized":"2024-04-25T15:54:21.397258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396002+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:21.396002+0000","last_peered":"2024-04-25T15:54:21.396002+0000","last_clean":"2024-04-25T15:54:21.396002+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:21.396002+0000","last_undegraded":"2024-04-25T15:54:21.396002+0000","last_fullsized":"2024-04-25T15:54:21.396002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922919+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:21.922919+0000","last_peered":"2024-04-25T15:54:21.922919+0000","last_clean":"2024-04-25T15:54:21.922919+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:21.922919+0000","last_undegraded":"2024-04-25T15:54:21.922919+0000","last_fullsized":"2024-04-25T15:54:21.922919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441436+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:21.441436+0000","last_peered":"2024-04-25T15:54:21.441436+0000","last_clean":"2024-04-25T15:54:21.441436+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:21.441436+0000","last_undegraded":"2024-04-25T15:54:21.441436+0000","last_fullsized":"2024-04-25T15:54:21.441436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443460+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:21.443460+0000","last_peered":"2024-04-25T15:54:21.443460+0000","last_clean":"2024-04-25T15:54:21.443460+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:21.443460+0000","last_undegraded":"2024-04-25T15:54:21.443460+0000","last_fullsized":"2024-04-25T15:54:21.443460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924171+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:21.924171+0000","last_peered":"2024-04-25T15:54:21.924171+0000","last_clean":"2024-04-25T15:54:21.924171+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:21.924171+0000","last_undegraded":"2024-04-25T15:54:21.924171+0000","last_fullsized":"2024-04-25T15:54:21.924171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392083+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:21.392083+0000","last_peered":"2024-04-25T15:54:21.392083+0000","last_clean":"2024-04-25T15:54:21.392083+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:21.392083+0000","last_undegraded":"2024-04-25T15:54:21.392083+0000","last_fullsized":"2024-04-25T15:54:21.392083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920688+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:21.920688+0000","last_peered":"2024-04-25T15:54:21.920688+0000","last_clean":"2024-04-25T15:54:21.920688+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:21.920688+0000","last_undegraded":"2024-04-25T15:54:21.920688+0000","last_fullsized":"2024-04-25T15:54:21.920688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395966+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:21.395966+0000","last_peered":"2024-04-25T15:54:21.395966+0000","last_clean":"2024-04-25T15:54:21.395966+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:21.395966+0000","last_undegraded":"2024-04-25T15:54:21.395966+0000","last_fullsized":"2024-04-25T15:54:21.395966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920895+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:21.920895+0000","last_peered":"2024-04-25T15:54:21.920895+0000","last_clean":"2024-04-25T15:54:21.920895+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:21.920895+0000","last_undegraded":"2024-04-25T15:54:21.920895+0000","last_fullsized":"2024-04-25T15:54:21.920895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437142+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:21.437142+0000","last_peered":"2024-04-25T15:54:21.437142+0000","last_clean":"2024-04-25T15:54:21.437142+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:21.437142+0000","last_undegraded":"2024-04-25T15:54:21.437142+0000","last_fullsized":"2024-04-25T15:54:21.437142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397313+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:21.397313+0000","last_peered":"2024-04-25T15:54:21.397313+0000","last_clean":"2024-04-25T15:54:21.397313+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:21.397313+0000","last_undegraded":"2024-04-25T15:54:21.397313+0000","last_fullsized":"2024-04-25T15:54:21.397313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391628+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:21.391628+0000","last_peered":"2024-04-25T15:54:21.391628+0000","last_clean":"2024-04-25T15:54:21.391628+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:21.391628+0000","last_undegraded":"2024-04-25T15:54:21.391628+0000","last_fullsized":"2024-04-25T15:54:21.391628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391487+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:21.391487+0000","last_peered":"2024-04-25T15:54:21.391487+0000","last_clean":"2024-04-25T15:54:21.391487+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:21.391487+0000","last_undegraded":"2024-04-25T15:54:21.391487+0000","last_fullsized":"2024-04-25T15:54:21.391487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923027+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:21.923027+0000","last_peered":"2024-04-25T15:54:21.923027+0000","last_clean":"2024-04-25T15:54:21.923027+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:21.923027+0000","last_undegraded":"2024-04-25T15:54:21.923027+0000","last_fullsized":"2024-04-25T15:54:21.923027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443222+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:21.443222+0000","last_peered":"2024-04-25T15:54:21.443222+0000","last_clean":"2024-04-25T15:54:21.443222+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:21.443222+0000","last_undegraded":"2024-04-25T15:54:21.443222+0000","last_fullsized":"2024-04-25T15:54:21.443222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920541+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:21.920541+0000","last_peered":"2024-04-25T15:54:21.920541+0000","last_clean":"2024-04-25T15:54:21.920541+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:21.920541+0000","last_undegraded":"2024-04-25T15:54:21.920541+0000","last_fullsized":"2024-04-25T15:54:21.920541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394741+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:21.394741+0000","last_peered":"2024-04-25T15:54:21.394741+0000","last_clean":"2024-04-25T15:54:21.394741+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:21.394741+0000","last_undegraded":"2024-04-25T15:54:21.394741+0000","last_fullsized":"2024-04-25T15:54:21.394741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442293+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:21.442293+0000","last_peered":"2024-04-25T15:54:21.442293+0000","last_clean":"2024-04-25T15:54:21.442293+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:21.442293+0000","last_undegraded":"2024-04-25T15:54:21.442293+0000","last_fullsized":"2024-04-25T15:54:21.442293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922453+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:21.922453+0000","last_peered":"2024-04-25T15:54:21.922453+0000","last_clean":"2024-04-25T15:54:21.922453+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:21.922453+0000","last_undegraded":"2024-04-25T15:54:21.922453+0000","last_fullsized":"2024-04-25T15:54:21.922453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436667+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:21.436667+0000","last_peered":"2024-04-25T15:54:21.436667+0000","last_clean":"2024-04-25T15:54:21.436667+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:21.436667+0000","last_undegraded":"2024-04-25T15:54:21.436667+0000","last_fullsized":"2024-04-25T15:54:21.436667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437157+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:21.437157+0000","last_peered":"2024-04-25T15:54:21.437157+0000","last_clean":"2024-04-25T15:54:21.437157+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:21.437157+0000","last_undegraded":"2024-04-25T15:54:21.437157+0000","last_fullsized":"2024-04-25T15:54:21.437157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924519+0000","last_change":"2024-04-25T15:54:10.285534+0000","last_active":"2024-04-25T15:54:21.924519+0000","last_peered":"2024-04-25T15:54:21.924519+0000","last_clean":"2024-04-25T15:54:21.924519+0000","last_became_active":"2024-04-25T15:54:10.279471+0000","last_became_peered":"2024-04-25T15:54:10.279471+0000","last_unstale":"2024-04-25T15:54:21.924519+0000","last_undegraded":"2024-04-25T15:54:21.924519+0000","last_fullsized":"2024-04-25T15:54:21.924519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442305+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:21.442305+0000","last_peered":"2024-04-25T15:54:21.442305+0000","last_clean":"2024-04-25T15:54:21.442305+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:21.442305+0000","last_undegraded":"2024-04-25T15:54:21.442305+0000","last_fullsized":"2024-04-25T15:54:21.442305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441751+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:21.441751+0000","last_peered":"2024-04-25T15:54:21.441751+0000","last_clean":"2024-04-25T15:54:21.441751+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:21.441751+0000","last_undegraded":"2024-04-25T15:54:21.441751+0000","last_fullsized":"2024-04-25T15:54:21.441751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437080+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:21.437080+0000","last_peered":"2024-04-25T15:54:21.437080+0000","last_clean":"2024-04-25T15:54:21.437080+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:21.437080+0000","last_undegraded":"2024-04-25T15:54:21.437080+0000","last_fullsized":"2024-04-25T15:54:21.437080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393701+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:21.393701+0000","last_peered":"2024-04-25T15:54:21.393701+0000","last_clean":"2024-04-25T15:54:21.393701+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:21.393701+0000","last_undegraded":"2024-04-25T15:54:21.393701+0000","last_fullsized":"2024-04-25T15:54:21.393701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922767+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:21.922767+0000","last_peered":"2024-04-25T15:54:21.922767+0000","last_clean":"2024-04-25T15:54:21.922767+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:21.922767+0000","last_undegraded":"2024-04-25T15:54:21.922767+0000","last_fullsized":"2024-04-25T15:54:21.922767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442241+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:21.442241+0000","last_peered":"2024-04-25T15:54:21.442241+0000","last_clean":"2024-04-25T15:54:21.442241+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:21.442241+0000","last_undegraded":"2024-04-25T15:54:21.442241+0000","last_fullsized":"2024-04-25T15:54:21.442241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390373+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:21.390373+0000","last_peered":"2024-04-25T15:54:21.390373+0000","last_clean":"2024-04-25T15:54:21.390373+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:21.390373+0000","last_undegraded":"2024-04-25T15:54:21.390373+0000","last_fullsized":"2024-04-25T15:54:21.390373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441402+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:21.441402+0000","last_peered":"2024-04-25T15:54:21.441402+0000","last_clean":"2024-04-25T15:54:21.441402+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:21.441402+0000","last_undegraded":"2024-04-25T15:54:21.441402+0000","last_fullsized":"2024-04-25T15:54:21.441402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389173+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:21.389173+0000","last_peered":"2024-04-25T15:54:21.389173+0000","last_clean":"2024-04-25T15:54:21.389173+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:21.389173+0000","last_undegraded":"2024-04-25T15:54:21.389173+0000","last_fullsized":"2024-04-25T15:54:21.389173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443394+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:21.443394+0000","last_peered":"2024-04-25T15:54:21.443394+0000","last_clean":"2024-04-25T15:54:21.443394+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:21.443394+0000","last_undegraded":"2024-04-25T15:54:21.443394+0000","last_fullsized":"2024-04-25T15:54:21.443394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925008+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:21.925008+0000","last_peered":"2024-04-25T15:54:21.925008+0000","last_clean":"2024-04-25T15:54:21.925008+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:21.925008+0000","last_undegraded":"2024-04-25T15:54:21.925008+0000","last_fullsized":"2024-04-25T15:54:21.925008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436357+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:21.436357+0000","last_peered":"2024-04-25T15:54:21.436357+0000","last_clean":"2024-04-25T15:54:21.436357+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:21.436357+0000","last_undegraded":"2024-04-25T15:54:21.436357+0000","last_fullsized":"2024-04-25T15:54:21.436357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920818+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:21.920818+0000","last_peered":"2024-04-25T15:54:21.920818+0000","last_clean":"2024-04-25T15:54:21.920818+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:21.920818+0000","last_undegraded":"2024-04-25T15:54:21.920818+0000","last_fullsized":"2024-04-25T15:54:21.920818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.439414+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:21.439414+0000","last_peered":"2024-04-25T15:54:21.439414+0000","last_clean":"2024-04-25T15:54:21.439414+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:21.439414+0000","last_undegraded":"2024-04-25T15:54:21.439414+0000","last_fullsized":"2024-04-25T15:54:21.439414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924237+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:21.924237+0000","last_peered":"2024-04-25T15:54:21.924237+0000","last_clean":"2024-04-25T15:54:21.924237+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:21.924237+0000","last_undegraded":"2024-04-25T15:54:21.924237+0000","last_fullsized":"2024-04-25T15:54:21.924237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921664+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:21.921664+0000","last_peered":"2024-04-25T15:54:21.921664+0000","last_clean":"2024-04-25T15:54:21.921664+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:21.921664+0000","last_undegraded":"2024-04-25T15:54:21.921664+0000","last_fullsized":"2024-04-25T15:54:21.921664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925364+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:21.925364+0000","last_peered":"2024-04-25T15:54:21.925364+0000","last_clean":"2024-04-25T15:54:21.925364+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:21.925364+0000","last_undegraded":"2024-04-25T15:54:21.925364+0000","last_fullsized":"2024-04-25T15:54:21.925364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921478+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:21.921478+0000","last_peered":"2024-04-25T15:54:21.921478+0000","last_clean":"2024-04-25T15:54:21.921478+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:21.921478+0000","last_undegraded":"2024-04-25T15:54:21.921478+0000","last_fullsized":"2024-04-25T15:54:21.921478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394923+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:21.394923+0000","last_peered":"2024-04-25T15:54:21.394923+0000","last_clean":"2024-04-25T15:54:21.394923+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:21.394923+0000","last_undegraded":"2024-04-25T15:54:21.394923+0000","last_fullsized":"2024-04-25T15:54:21.394923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390876+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:21.390876+0000","last_peered":"2024-04-25T15:54:21.390876+0000","last_clean":"2024-04-25T15:54:21.390876+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:21.390876+0000","last_undegraded":"2024-04-25T15:54:21.390876+0000","last_fullsized":"2024-04-25T15:54:21.390876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922057+0000","last_change":"2024-04-25T15:54:10.294873+0000","last_active":"2024-04-25T15:54:21.922057+0000","last_peered":"2024-04-25T15:54:21.922057+0000","last_clean":"2024-04-25T15:54:21.922057+0000","last_became_active":"2024-04-25T15:54:10.291885+0000","last_became_peered":"2024-04-25T15:54:10.291885+0000","last_unstale":"2024-04-25T15:54:21.922057+0000","last_undegraded":"2024-04-25T15:54:21.922057+0000","last_fullsized":"2024-04-25T15:54:21.922057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390368+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:21.390368+0000","last_peered":"2024-04-25T15:54:21.390368+0000","last_clean":"2024-04-25T15:54:21.390368+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:21.390368+0000","last_undegraded":"2024-04-25T15:54:21.390368+0000","last_fullsized":"2024-04-25T15:54:21.390368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394250+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:21.394250+0000","last_peered":"2024-04-25T15:54:21.394250+0000","last_clean":"2024-04-25T15:54:21.394250+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:21.394250+0000","last_undegraded":"2024-04-25T15:54:21.394250+0000","last_fullsized":"2024-04-25T15:54:21.394250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389873+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:21.389873+0000","last_peered":"2024-04-25T15:54:21.389873+0000","last_clean":"2024-04-25T15:54:21.389873+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:21.389873+0000","last_undegraded":"2024-04-25T15:54:21.389873+0000","last_fullsized":"2024-04-25T15:54:21.389873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923240+0000","last_change":"2024-04-25T15:54:10.271652+0000","last_active":"2024-04-25T15:54:21.923240+0000","last_peered":"2024-04-25T15:54:21.923240+0000","last_clean":"2024-04-25T15:54:21.923240+0000","last_became_active":"2024-04-25T15:54:10.270697+0000","last_became_peered":"2024-04-25T15:54:10.270697+0000","last_unstale":"2024-04-25T15:54:21.923240+0000","last_undegraded":"2024-04-25T15:54:21.923240+0000","last_fullsized":"2024-04-25T15:54:21.923240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443076+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:21.443076+0000","last_peered":"2024-04-25T15:54:21.443076+0000","last_clean":"2024-04-25T15:54:21.443076+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:21.443076+0000","last_undegraded":"2024-04-25T15:54:21.443076+0000","last_fullsized":"2024-04-25T15:54:21.443076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436482+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:21.436482+0000","last_peered":"2024-04-25T15:54:21.436482+0000","last_clean":"2024-04-25T15:54:21.436482+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:21.436482+0000","last_undegraded":"2024-04-25T15:54:21.436482+0000","last_fullsized":"2024-04-25T15:54:21.436482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921967+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:21.921967+0000","last_peered":"2024-04-25T15:54:21.921967+0000","last_clean":"2024-04-25T15:54:21.921967+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:21.921967+0000","last_undegraded":"2024-04-25T15:54:21.921967+0000","last_fullsized":"2024-04-25T15:54:21.921967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925121+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:21.925121+0000","last_peered":"2024-04-25T15:54:21.925121+0000","last_clean":"2024-04-25T15:54:21.925121+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:21.925121+0000","last_undegraded":"2024-04-25T15:54:21.925121+0000","last_fullsized":"2024-04-25T15:54:21.925121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390564+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:21.390564+0000","last_peered":"2024-04-25T15:54:21.390564+0000","last_clean":"2024-04-25T15:54:21.390564+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:21.390564+0000","last_undegraded":"2024-04-25T15:54:21.390564+0000","last_fullsized":"2024-04-25T15:54:21.390564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920163+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:21.920163+0000","last_peered":"2024-04-25T15:54:21.920163+0000","last_clean":"2024-04-25T15:54:21.920163+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:21.920163+0000","last_undegraded":"2024-04-25T15:54:21.920163+0000","last_fullsized":"2024-04-25T15:54:21.920163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389276+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:21.389276+0000","last_peered":"2024-04-25T15:54:21.389276+0000","last_clean":"2024-04-25T15:54:21.389276+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:21.389276+0000","last_undegraded":"2024-04-25T15:54:21.389276+0000","last_fullsized":"2024-04-25T15:54:21.389276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925892+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:21.925892+0000","last_peered":"2024-04-25T15:54:21.925892+0000","last_clean":"2024-04-25T15:54:21.925892+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:21.925892+0000","last_undegraded":"2024-04-25T15:54:21.925892+0000","last_fullsized":"2024-04-25T15:54:21.925892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397052+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:21.397052+0000","last_peered":"2024-04-25T15:54:21.397052+0000","last_clean":"2024-04-25T15:54:21.397052+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:21.397052+0000","last_undegraded":"2024-04-25T15:54:21.397052+0000","last_fullsized":"2024-04-25T15:54:21.397052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391328+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:21.391328+0000","last_peered":"2024-04-25T15:54:21.391328+0000","last_clean":"2024-04-25T15:54:21.391328+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:21.391328+0000","last_undegraded":"2024-04-25T15:54:21.391328+0000","last_fullsized":"2024-04-25T15:54:21.391328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922858+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:21.922858+0000","last_peered":"2024-04-25T15:54:21.922858+0000","last_clean":"2024-04-25T15:54:21.922858+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:21.922858+0000","last_undegraded":"2024-04-25T15:54:21.922858+0000","last_fullsized":"2024-04-25T15:54:21.922858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922521+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:21.922521+0000","last_peered":"2024-04-25T15:54:21.922521+0000","last_clean":"2024-04-25T15:54:21.922521+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:21.922521+0000","last_undegraded":"2024-04-25T15:54:21.922521+0000","last_fullsized":"2024-04-25T15:54:21.922521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389197+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:21.389197+0000","last_peered":"2024-04-25T15:54:21.389197+0000","last_clean":"2024-04-25T15:54:21.389197+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:21.389197+0000","last_undegraded":"2024-04-25T15:54:21.389197+0000","last_fullsized":"2024-04-25T15:54:21.389197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437180+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:21.437180+0000","last_peered":"2024-04-25T15:54:21.437180+0000","last_clean":"2024-04-25T15:54:21.437180+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:21.437180+0000","last_undegraded":"2024-04-25T15:54:21.437180+0000","last_fullsized":"2024-04-25T15:54:21.437180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923162+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:21.923162+0000","last_peered":"2024-04-25T15:54:21.923162+0000","last_clean":"2024-04-25T15:54:21.923162+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:21.923162+0000","last_undegraded":"2024-04-25T15:54:21.923162+0000","last_fullsized":"2024-04-25T15:54:21.923162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394159+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:21.394159+0000","last_peered":"2024-04-25T15:54:21.394159+0000","last_clean":"2024-04-25T15:54:21.394159+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:21.394159+0000","last_undegraded":"2024-04-25T15:54:21.394159+0000","last_fullsized":"2024-04-25T15:54:21.394159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395369+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:21.395369+0000","last_peered":"2024-04-25T15:54:21.395369+0000","last_clean":"2024-04-25T15:54:21.395369+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:21.395369+0000","last_undegraded":"2024-04-25T15:54:21.395369+0000","last_fullsized":"2024-04-25T15:54:21.395369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922677+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:21.922677+0000","last_peered":"2024-04-25T15:54:21.922677+0000","last_clean":"2024-04-25T15:54:21.922677+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:21.922677+0000","last_undegraded":"2024-04-25T15:54:21.922677+0000","last_fullsized":"2024-04-25T15:54:21.922677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923119+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:21.923119+0000","last_peered":"2024-04-25T15:54:21.923119+0000","last_clean":"2024-04-25T15:54:21.923119+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:21.923119+0000","last_undegraded":"2024-04-25T15:54:21.923119+0000","last_fullsized":"2024-04-25T15:54:21.923119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923220+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:21.923220+0000","last_peered":"2024-04-25T15:54:21.923220+0000","last_clean":"2024-04-25T15:54:21.923220+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:21.923220+0000","last_undegraded":"2024-04-25T15:54:21.923220+0000","last_fullsized":"2024-04-25T15:54:21.923220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922602+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:21.922602+0000","last_peered":"2024-04-25T15:54:21.922602+0000","last_clean":"2024-04-25T15:54:21.922602+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:21.922602+0000","last_undegraded":"2024-04-25T15:54:21.922602+0000","last_fullsized":"2024-04-25T15:54:21.922602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921972+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:21.921972+0000","last_peered":"2024-04-25T15:54:21.921972+0000","last_clean":"2024-04-25T15:54:21.921972+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:21.921972+0000","last_undegraded":"2024-04-25T15:54:21.921972+0000","last_fullsized":"2024-04-25T15:54:21.921972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436318+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:21.436318+0000","last_peered":"2024-04-25T15:54:21.436318+0000","last_clean":"2024-04-25T15:54:21.436318+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:21.436318+0000","last_undegraded":"2024-04-25T15:54:21.436318+0000","last_fullsized":"2024-04-25T15:54:21.436318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437324+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:21.437324+0000","last_peered":"2024-04-25T15:54:21.437324+0000","last_clean":"2024-04-25T15:54:21.437324+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:21.437324+0000","last_undegraded":"2024-04-25T15:54:21.437324+0000","last_fullsized":"2024-04-25T15:54:21.437324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924345+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:21.924345+0000","last_peered":"2024-04-25T15:54:21.924345+0000","last_clean":"2024-04-25T15:54:21.924345+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:21.924345+0000","last_undegraded":"2024-04-25T15:54:21.924345+0000","last_fullsized":"2024-04-25T15:54:21.924345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922285+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:21.922285+0000","last_peered":"2024-04-25T15:54:21.922285+0000","last_clean":"2024-04-25T15:54:21.922285+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:21.922285+0000","last_undegraded":"2024-04-25T15:54:21.922285+0000","last_fullsized":"2024-04-25T15:54:21.922285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921704+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:21.921704+0000","last_peered":"2024-04-25T15:54:21.921704+0000","last_clean":"2024-04-25T15:54:21.921704+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:21.921704+0000","last_undegraded":"2024-04-25T15:54:21.921704+0000","last_fullsized":"2024-04-25T15:54:21.921704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395230+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:21.395230+0000","last_peered":"2024-04-25T15:54:21.395230+0000","last_clean":"2024-04-25T15:54:21.395230+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:21.395230+0000","last_undegraded":"2024-04-25T15:54:21.395230+0000","last_fullsized":"2024-04-25T15:54:21.395230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441572+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:21.441572+0000","last_peered":"2024-04-25T15:54:21.441572+0000","last_clean":"2024-04-25T15:54:21.441572+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:21.441572+0000","last_undegraded":"2024-04-25T15:54:21.441572+0000","last_fullsized":"2024-04-25T15:54:21.441572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441814+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:21.441814+0000","last_peered":"2024-04-25T15:54:21.441814+0000","last_clean":"2024-04-25T15:54:21.441814+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:21.441814+0000","last_undegraded":"2024-04-25T15:54:21.441814+0000","last_fullsized":"2024-04-25T15:54:21.441814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397497+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:21.397497+0000","last_peered":"2024-04-25T15:54:21.397497+0000","last_clean":"2024-04-25T15:54:21.397497+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:21.397497+0000","last_undegraded":"2024-04-25T15:54:21.397497+0000","last_fullsized":"2024-04-25T15:54:21.397497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443036+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:21.443036+0000","last_peered":"2024-04-25T15:54:21.443036+0000","last_clean":"2024-04-25T15:54:21.443036+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:21.443036+0000","last_undegraded":"2024-04-25T15:54:21.443036+0000","last_fullsized":"2024-04-25T15:54:21.443036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393180+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:21.393180+0000","last_peered":"2024-04-25T15:54:21.393180+0000","last_clean":"2024-04-25T15:54:21.393180+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:21.393180+0000","last_undegraded":"2024-04-25T15:54:21.393180+0000","last_fullsized":"2024-04-25T15:54:21.393180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395117+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:21.395117+0000","last_peered":"2024-04-25T15:54:21.395117+0000","last_clean":"2024-04-25T15:54:21.395117+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:21.395117+0000","last_undegraded":"2024-04-25T15:54:21.395117+0000","last_fullsized":"2024-04-25T15:54:21.395117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436903+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:21.436903+0000","last_peered":"2024-04-25T15:54:21.436903+0000","last_clean":"2024-04-25T15:54:21.436903+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:21.436903+0000","last_undegraded":"2024-04-25T15:54:21.436903+0000","last_fullsized":"2024-04-25T15:54:21.436903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923570+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:21.923570+0000","last_peered":"2024-04-25T15:54:21.923570+0000","last_clean":"2024-04-25T15:54:21.923570+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:21.923570+0000","last_undegraded":"2024-04-25T15:54:21.923570+0000","last_fullsized":"2024-04-25T15:54:21.923570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921005+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:21.921005+0000","last_peered":"2024-04-25T15:54:21.921005+0000","last_clean":"2024-04-25T15:54:21.921005+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:21.921005+0000","last_undegraded":"2024-04-25T15:54:21.921005+0000","last_fullsized":"2024-04-25T15:54:21.921005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920631+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:21.920631+0000","last_peered":"2024-04-25T15:54:21.920631+0000","last_clean":"2024-04-25T15:54:21.920631+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:21.920631+0000","last_undegraded":"2024-04-25T15:54:21.920631+0000","last_fullsized":"2024-04-25T15:54:21.920631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923339+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:21.923339+0000","last_peered":"2024-04-25T15:54:21.923339+0000","last_clean":"2024-04-25T15:54:21.923339+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:21.923339+0000","last_undegraded":"2024-04-25T15:54:21.923339+0000","last_fullsized":"2024-04-25T15:54:21.923339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397036+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:21.397036+0000","last_peered":"2024-04-25T15:54:21.397036+0000","last_clean":"2024-04-25T15:54:21.397036+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:21.397036+0000","last_undegraded":"2024-04-25T15:54:21.397036+0000","last_fullsized":"2024-04-25T15:54:21.397036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920956+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:21.920956+0000","last_peered":"2024-04-25T15:54:21.920956+0000","last_clean":"2024-04-25T15:54:21.920956+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:21.920956+0000","last_undegraded":"2024-04-25T15:54:21.920956+0000","last_fullsized":"2024-04-25T15:54:21.920956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396385+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:21.396385+0000","last_peered":"2024-04-25T15:54:21.396385+0000","last_clean":"2024-04-25T15:54:21.396385+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:21.396385+0000","last_undegraded":"2024-04-25T15:54:21.396385+0000","last_fullsized":"2024-04-25T15:54:21.396385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437021+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:21.437021+0000","last_peered":"2024-04-25T15:54:21.437021+0000","last_clean":"2024-04-25T15:54:21.437021+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:21.437021+0000","last_undegraded":"2024-04-25T15:54:21.437021+0000","last_fullsized":"2024-04-25T15:54:21.437021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441296+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:21.441296+0000","last_peered":"2024-04-25T15:54:21.441296+0000","last_clean":"2024-04-25T15:54:21.441296+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:21.441296+0000","last_undegraded":"2024-04-25T15:54:21.441296+0000","last_fullsized":"2024-04-25T15:54:21.441296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920923+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:21.920923+0000","last_peered":"2024-04-25T15:54:21.920923+0000","last_clean":"2024-04-25T15:54:21.920923+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:21.920923+0000","last_undegraded":"2024-04-25T15:54:21.920923+0000","last_fullsized":"2024-04-25T15:54:21.920923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436823+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:21.436823+0000","last_peered":"2024-04-25T15:54:21.436823+0000","last_clean":"2024-04-25T15:54:21.436823+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:21.436823+0000","last_undegraded":"2024-04-25T15:54:21.436823+0000","last_fullsized":"2024-04-25T15:54:21.436823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396688+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:21.396688+0000","last_peered":"2024-04-25T15:54:21.396688+0000","last_clean":"2024-04-25T15:54:21.396688+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:21.396688+0000","last_undegraded":"2024-04-25T15:54:21.396688+0000","last_fullsized":"2024-04-25T15:54:21.396688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922853+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:21.922853+0000","last_peered":"2024-04-25T15:54:21.922853+0000","last_clean":"2024-04-25T15:54:21.922853+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:21.922853+0000","last_undegraded":"2024-04-25T15:54:21.922853+0000","last_fullsized":"2024-04-25T15:54:21.922853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922209+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:21.922209+0000","last_peered":"2024-04-25T15:54:21.922209+0000","last_clean":"2024-04-25T15:54:21.922209+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:21.922209+0000","last_undegraded":"2024-04-25T15:54:21.922209+0000","last_fullsized":"2024-04-25T15:54:21.922209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442811+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:21.442811+0000","last_peered":"2024-04-25T15:54:21.442811+0000","last_clean":"2024-04-25T15:54:21.442811+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:21.442811+0000","last_undegraded":"2024-04-25T15:54:21.442811+0000","last_fullsized":"2024-04-25T15:54:21.442811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394919+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:21.394919+0000","last_peered":"2024-04-25T15:54:21.394919+0000","last_clean":"2024-04-25T15:54:21.394919+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:21.394919+0000","last_undegraded":"2024-04-25T15:54:21.394919+0000","last_fullsized":"2024-04-25T15:54:21.394919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437206+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:21.437206+0000","last_peered":"2024-04-25T15:54:21.437206+0000","last_clean":"2024-04-25T15:54:21.437206+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:21.437206+0000","last_undegraded":"2024-04-25T15:54:21.437206+0000","last_fullsized":"2024-04-25T15:54:21.437206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390654+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:21.390654+0000","last_peered":"2024-04-25T15:54:21.390654+0000","last_clean":"2024-04-25T15:54:21.390654+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:21.390654+0000","last_undegraded":"2024-04-25T15:54:21.390654+0000","last_fullsized":"2024-04-25T15:54:21.390654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393791+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:21.393791+0000","last_peered":"2024-04-25T15:54:21.393791+0000","last_clean":"2024-04-25T15:54:21.393791+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:21.393791+0000","last_undegraded":"2024-04-25T15:54:21.393791+0000","last_fullsized":"2024-04-25T15:54:21.393791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923014+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:21.923014+0000","last_peered":"2024-04-25T15:54:21.923014+0000","last_clean":"2024-04-25T15:54:21.923014+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:21.923014+0000","last_undegraded":"2024-04-25T15:54:21.923014+0000","last_fullsized":"2024-04-25T15:54:21.923014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393788+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:21.393788+0000","last_peered":"2024-04-25T15:54:21.393788+0000","last_clean":"2024-04-25T15:54:21.393788+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:21.393788+0000","last_undegraded":"2024-04-25T15:54:21.393788+0000","last_fullsized":"2024-04-25T15:54:21.393788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922425+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:21.922425+0000","last_peered":"2024-04-25T15:54:21.922425+0000","last_clean":"2024-04-25T15:54:21.922425+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:21.922425+0000","last_undegraded":"2024-04-25T15:54:21.922425+0000","last_fullsized":"2024-04-25T15:54:21.922425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923390+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:21.923390+0000","last_peered":"2024-04-25T15:54:21.923390+0000","last_clean":"2024-04-25T15:54:21.923390+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:21.923390+0000","last_undegraded":"2024-04-25T15:54:21.923390+0000","last_fullsized":"2024-04-25T15:54:21.923390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393859+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:21.393859+0000","last_peered":"2024-04-25T15:54:21.393859+0000","last_clean":"2024-04-25T15:54:21.393859+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:21.393859+0000","last_undegraded":"2024-04-25T15:54:21.393859+0000","last_fullsized":"2024-04-25T15:54:21.393859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443040+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:21.443040+0000","last_peered":"2024-04-25T15:54:21.443040+0000","last_clean":"2024-04-25T15:54:21.443040+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:21.443040+0000","last_undegraded":"2024-04-25T15:54:21.443040+0000","last_fullsized":"2024-04-25T15:54:21.443040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.388928+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:21.388928+0000","last_peered":"2024-04-25T15:54:21.388928+0000","last_clean":"2024-04-25T15:54:21.388928+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:21.388928+0000","last_undegraded":"2024-04-25T15:54:21.388928+0000","last_fullsized":"2024-04-25T15:54:21.388928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922270+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:21.922270+0000","last_peered":"2024-04-25T15:54:21.922270+0000","last_clean":"2024-04-25T15:54:21.922270+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:21.922270+0000","last_undegraded":"2024-04-25T15:54:21.922270+0000","last_fullsized":"2024-04-25T15:54:21.922270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922344+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:21.922344+0000","last_peered":"2024-04-25T15:54:21.922344+0000","last_clean":"2024-04-25T15:54:21.922344+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:21.922344+0000","last_undegraded":"2024-04-25T15:54:21.922344+0000","last_fullsized":"2024-04-25T15:54:21.922344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442696+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:21.442696+0000","last_peered":"2024-04-25T15:54:21.442696+0000","last_clean":"2024-04-25T15:54:21.442696+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:21.442696+0000","last_undegraded":"2024-04-25T15:54:21.442696+0000","last_fullsized":"2024-04-25T15:54:21.442696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437246+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:21.437246+0000","last_peered":"2024-04-25T15:54:21.437246+0000","last_clean":"2024-04-25T15:54:21.437246+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:21.437246+0000","last_undegraded":"2024-04-25T15:54:21.437246+0000","last_fullsized":"2024-04-25T15:54:21.437246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920646+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:21.920646+0000","last_peered":"2024-04-25T15:54:21.920646+0000","last_clean":"2024-04-25T15:54:21.920646+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:21.920646+0000","last_undegraded":"2024-04-25T15:54:21.920646+0000","last_fullsized":"2024-04-25T15:54:21.920646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922785+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:21.922785+0000","last_peered":"2024-04-25T15:54:21.922785+0000","last_clean":"2024-04-25T15:54:21.922785+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:21.922785+0000","last_undegraded":"2024-04-25T15:54:21.922785+0000","last_fullsized":"2024-04-25T15:54:21.922785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392960+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:21.392960+0000","last_peered":"2024-04-25T15:54:21.392960+0000","last_clean":"2024-04-25T15:54:21.392960+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:21.392960+0000","last_undegraded":"2024-04-25T15:54:21.392960+0000","last_fullsized":"2024-04-25T15:54:21.392960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442870+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:21.442870+0000","last_peered":"2024-04-25T15:54:21.442870+0000","last_clean":"2024-04-25T15:54:21.442870+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:21.442870+0000","last_undegraded":"2024-04-25T15:54:21.442870+0000","last_fullsized":"2024-04-25T15:54:21.442870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:21.920320+0000","last_peered":"2024-04-25T15:54:21.920320+0000","last_clean":"2024-04-25T15:54:21.920320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:21.920320+0000","last_undegraded":"2024-04-25T15:54:21.920320+0000","last_fullsized":"2024-04-25T15:54:21.920320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395555+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:21.395555+0000","last_peered":"2024-04-25T15:54:21.395555+0000","last_clean":"2024-04-25T15:54:21.395555+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:21.395555+0000","last_undegraded":"2024-04-25T15:54:21.395555+0000","last_fullsized":"2024-04-25T15:54:21.395555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394927+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:21.394927+0000","last_peered":"2024-04-25T15:54:21.394927+0000","last_clean":"2024-04-25T15:54:21.394927+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:21.394927+0000","last_undegraded":"2024-04-25T15:54:21.394927+0000","last_fullsized":"2024-04-25T15:54:21.394927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922828+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:21.922828+0000","last_peered":"2024-04-25T15:54:21.922828+0000","last_clean":"2024-04-25T15:54:21.922828+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:21.922828+0000","last_undegraded":"2024-04-25T15:54:21.922828+0000","last_fullsized":"2024-04-25T15:54:21.922828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923075+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:21.923075+0000","last_peered":"2024-04-25T15:54:21.923075+0000","last_clean":"2024-04-25T15:54:21.923075+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:21.923075+0000","last_undegraded":"2024-04-25T15:54:21.923075+0000","last_fullsized":"2024-04-25T15:54:21.923075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920626+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:21.920626+0000","last_peered":"2024-04-25T15:54:21.920626+0000","last_clean":"2024-04-25T15:54:21.920626+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:21.920626+0000","last_undegraded":"2024-04-25T15:54:21.920626+0000","last_fullsized":"2024-04-25T15:54:21.920626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924321+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:21.924321+0000","last_peered":"2024-04-25T15:54:21.924321+0000","last_clean":"2024-04-25T15:54:21.924321+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:21.924321+0000","last_undegraded":"2024-04-25T15:54:21.924321+0000","last_fullsized":"2024-04-25T15:54:21.924321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921198+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:21.921198+0000","last_peered":"2024-04-25T15:54:21.921198+0000","last_clean":"2024-04-25T15:54:21.921198+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:21.921198+0000","last_undegraded":"2024-04-25T15:54:21.921198+0000","last_fullsized":"2024-04-25T15:54:21.921198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389900+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:21.389900+0000","last_peered":"2024-04-25T15:54:21.389900+0000","last_clean":"2024-04-25T15:54:21.389900+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:21.389900+0000","last_undegraded":"2024-04-25T15:54:21.389900+0000","last_fullsized":"2024-04-25T15:54:21.389900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922079+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:21.922079+0000","last_peered":"2024-04-25T15:54:21.922079+0000","last_clean":"2024-04-25T15:54:21.922079+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:21.922079+0000","last_undegraded":"2024-04-25T15:54:21.922079+0000","last_fullsized":"2024-04-25T15:54:21.922079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922061+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:21.922061+0000","last_peered":"2024-04-25T15:54:21.922061+0000","last_clean":"2024-04-25T15:54:21.922061+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:21.922061+0000","last_undegraded":"2024-04-25T15:54:21.922061+0000","last_fullsized":"2024-04-25T15:54:21.922061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436923+0000","last_change":"2024-04-25T15:54:10.267602+0000","last_active":"2024-04-25T15:54:21.436923+0000","last_peered":"2024-04-25T15:54:21.436923+0000","last_clean":"2024-04-25T15:54:21.436923+0000","last_became_active":"2024-04-25T15:54:10.267276+0000","last_became_peered":"2024-04-25T15:54:10.267276+0000","last_unstale":"2024-04-25T15:54:21.436923+0000","last_undegraded":"2024-04-25T15:54:21.436923+0000","last_fullsized":"2024-04-25T15:54:21.436923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392942+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:21.392942+0000","last_peered":"2024-04-25T15:54:21.392942+0000","last_clean":"2024-04-25T15:54:21.392942+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:21.392942+0000","last_undegraded":"2024-04-25T15:54:21.392942+0000","last_fullsized":"2024-04-25T15:54:21.392942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395042+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:21.395042+0000","last_peered":"2024-04-25T15:54:21.395042+0000","last_clean":"2024-04-25T15:54:21.395042+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:21.395042+0000","last_undegraded":"2024-04-25T15:54:21.395042+0000","last_fullsized":"2024-04-25T15:54:21.395042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392913+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:21.392913+0000","last_peered":"2024-04-25T15:54:21.392913+0000","last_clean":"2024-04-25T15:54:21.392913+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:21.392913+0000","last_undegraded":"2024-04-25T15:54:21.392913+0000","last_fullsized":"2024-04-25T15:54:21.392913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922342+0000","last_change":"2024-04-25T15:54:10.295088+0000","last_active":"2024-04-25T15:54:21.922342+0000","last_peered":"2024-04-25T15:54:21.922342+0000","last_clean":"2024-04-25T15:54:21.922342+0000","last_became_active":"2024-04-25T15:54:10.292412+0000","last_became_peered":"2024-04-25T15:54:10.292412+0000","last_unstale":"2024-04-25T15:54:21.922342+0000","last_undegraded":"2024-04-25T15:54:21.922342+0000","last_fullsized":"2024-04-25T15:54:21.922342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920147+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:21.920147+0000","last_peered":"2024-04-25T15:54:21.920147+0000","last_clean":"2024-04-25T15:54:21.920147+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:21.920147+0000","last_undegraded":"2024-04-25T15:54:21.920147+0000","last_fullsized":"2024-04-25T15:54:21.920147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390651+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:21.390651+0000","last_peered":"2024-04-25T15:54:21.390651+0000","last_clean":"2024-04-25T15:54:21.390651+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:21.390651+0000","last_undegraded":"2024-04-25T15:54:21.390651+0000","last_fullsized":"2024-04-25T15:54:21.390651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436337+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:21.436337+0000","last_peered":"2024-04-25T15:54:21.436337+0000","last_clean":"2024-04-25T15:54:21.436337+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:21.436337+0000","last_undegraded":"2024-04-25T15:54:21.436337+0000","last_fullsized":"2024-04-25T15:54:21.436337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925691+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:21.925691+0000","last_peered":"2024-04-25T15:54:21.925691+0000","last_clean":"2024-04-25T15:54:21.925691+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:21.925691+0000","last_undegraded":"2024-04-25T15:54:21.925691+0000","last_fullsized":"2024-04-25T15:54:21.925691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442692+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:21.442692+0000","last_peered":"2024-04-25T15:54:21.442692+0000","last_clean":"2024-04-25T15:54:21.442692+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:21.442692+0000","last_undegraded":"2024-04-25T15:54:21.442692+0000","last_fullsized":"2024-04-25T15:54:21.442692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920342+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:21.920342+0000","last_peered":"2024-04-25T15:54:21.920342+0000","last_clean":"2024-04-25T15:54:21.920342+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:21.920342+0000","last_undegraded":"2024-04-25T15:54:21.920342+0000","last_fullsized":"2024-04-25T15:54:21.920342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397074+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:21.397074+0000","last_peered":"2024-04-25T15:54:21.397074+0000","last_clean":"2024-04-25T15:54:21.397074+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:21.397074+0000","last_undegraded":"2024-04-25T15:54:21.397074+0000","last_fullsized":"2024-04-25T15:54:21.397074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441304+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:21.441304+0000","last_peered":"2024-04-25T15:54:21.441304+0000","last_clean":"2024-04-25T15:54:21.441304+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:21.441304+0000","last_undegraded":"2024-04-25T15:54:21.441304+0000","last_fullsized":"2024-04-25T15:54:21.441304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921760+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:21.921760+0000","last_peered":"2024-04-25T15:54:21.921760+0000","last_clean":"2024-04-25T15:54:21.921760+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:21.921760+0000","last_undegraded":"2024-04-25T15:54:21.921760+0000","last_fullsized":"2024-04-25T15:54:21.921760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436316+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:21.436316+0000","last_peered":"2024-04-25T15:54:21.436316+0000","last_clean":"2024-04-25T15:54:21.436316+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:21.436316+0000","last_undegraded":"2024-04-25T15:54:21.436316+0000","last_fullsized":"2024-04-25T15:54:21.436316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921519+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:21.921519+0000","last_peered":"2024-04-25T15:54:21.921519+0000","last_clean":"2024-04-25T15:54:21.921519+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:21.921519+0000","last_undegraded":"2024-04-25T15:54:21.921519+0000","last_fullsized":"2024-04-25T15:54:21.921519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921500+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:21.921500+0000","last_peered":"2024-04-25T15:54:21.921500+0000","last_clean":"2024-04-25T15:54:21.921500+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:21.921500+0000","last_undegraded":"2024-04-25T15:54:21.921500+0000","last_fullsized":"2024-04-25T15:54:21.921500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397415+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:21.397415+0000","last_peered":"2024-04-25T15:54:21.397415+0000","last_clean":"2024-04-25T15:54:21.397415+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:21.397415+0000","last_undegraded":"2024-04-25T15:54:21.397415+0000","last_fullsized":"2024-04-25T15:54:21.397415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390647+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:21.390647+0000","last_peered":"2024-04-25T15:54:21.390647+0000","last_clean":"2024-04-25T15:54:21.390647+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:21.390647+0000","last_undegraded":"2024-04-25T15:54:21.390647+0000","last_fullsized":"2024-04-25T15:54:21.390647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395244+0000","last_change":"2024-04-25T15:54:10.256856+0000","last_active":"2024-04-25T15:54:21.395244+0000","last_peered":"2024-04-25T15:54:21.395244+0000","last_clean":"2024-04-25T15:54:21.395244+0000","last_became_active":"2024-04-25T15:54:10.256024+0000","last_became_peered":"2024-04-25T15:54:10.256024+0000","last_unstale":"2024-04-25T15:54:21.395244+0000","last_undegraded":"2024-04-25T15:54:21.395244+0000","last_fullsized":"2024-04-25T15:54:21.395244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921320+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:21.921320+0000","last_peered":"2024-04-25T15:54:21.921320+0000","last_clean":"2024-04-25T15:54:21.921320+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:21.921320+0000","last_undegraded":"2024-04-25T15:54:21.921320+0000","last_fullsized":"2024-04-25T15:54:21.921320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395489+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:21.395489+0000","last_peered":"2024-04-25T15:54:21.395489+0000","last_clean":"2024-04-25T15:54:21.395489+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:21.395489+0000","last_undegraded":"2024-04-25T15:54:21.395489+0000","last_fullsized":"2024-04-25T15:54:21.395489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921293+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:21.921293+0000","last_peered":"2024-04-25T15:54:21.921293+0000","last_clean":"2024-04-25T15:54:21.921293+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:21.921293+0000","last_undegraded":"2024-04-25T15:54:21.921293+0000","last_fullsized":"2024-04-25T15:54:21.921293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924964+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:21.924964+0000","last_peered":"2024-04-25T15:54:21.924964+0000","last_clean":"2024-04-25T15:54:21.924964+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:21.924964+0000","last_undegraded":"2024-04-25T15:54:21.924964+0000","last_fullsized":"2024-04-25T15:54:21.924964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922527+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:21.922527+0000","last_peered":"2024-04-25T15:54:21.922527+0000","last_clean":"2024-04-25T15:54:21.922527+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:21.922527+0000","last_undegraded":"2024-04-25T15:54:21.922527+0000","last_fullsized":"2024-04-25T15:54:21.922527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394617+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:21.394617+0000","last_peered":"2024-04-25T15:54:21.394617+0000","last_clean":"2024-04-25T15:54:21.394617+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:21.394617+0000","last_undegraded":"2024-04-25T15:54:21.394617+0000","last_fullsized":"2024-04-25T15:54:21.394617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924299+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:21.924299+0000","last_peered":"2024-04-25T15:54:21.924299+0000","last_clean":"2024-04-25T15:54:21.924299+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:21.924299+0000","last_undegraded":"2024-04-25T15:54:21.924299+0000","last_fullsized":"2024-04-25T15:54:21.924299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441620+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:21.441620+0000","last_peered":"2024-04-25T15:54:21.441620+0000","last_clean":"2024-04-25T15:54:21.441620+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:21.441620+0000","last_undegraded":"2024-04-25T15:54:21.441620+0000","last_fullsized":"2024-04-25T15:54:21.441620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924256+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:21.924256+0000","last_peered":"2024-04-25T15:54:21.924256+0000","last_clean":"2024-04-25T15:54:21.924256+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:21.924256+0000","last_undegraded":"2024-04-25T15:54:21.924256+0000","last_fullsized":"2024-04-25T15:54:21.924256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923071+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:21.923071+0000","last_peered":"2024-04-25T15:54:21.923071+0000","last_clean":"2024-04-25T15:54:21.923071+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:21.923071+0000","last_undegraded":"2024-04-25T15:54:21.923071+0000","last_fullsized":"2024-04-25T15:54:21.923071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921207+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:21.921207+0000","last_peered":"2024-04-25T15:54:21.921207+0000","last_clean":"2024-04-25T15:54:21.921207+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:21.921207+0000","last_undegraded":"2024-04-25T15:54:21.921207+0000","last_fullsized":"2024-04-25T15:54:21.921207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922442+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:21.922442+0000","last_peered":"2024-04-25T15:54:21.922442+0000","last_clean":"2024-04-25T15:54:21.922442+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:21.922442+0000","last_undegraded":"2024-04-25T15:54:21.922442+0000","last_fullsized":"2024-04-25T15:54:21.922442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390298+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:21.390298+0000","last_peered":"2024-04-25T15:54:21.390298+0000","last_clean":"2024-04-25T15:54:21.390298+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:21.390298+0000","last_undegraded":"2024-04-25T15:54:21.390298+0000","last_fullsized":"2024-04-25T15:54:21.390298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437423+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:21.437423+0000","last_peered":"2024-04-25T15:54:21.437423+0000","last_clean":"2024-04-25T15:54:21.437423+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:21.437423+0000","last_undegraded":"2024-04-25T15:54:21.437423+0000","last_fullsized":"2024-04-25T15:54:21.437423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920144+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:21.920144+0000","last_peered":"2024-04-25T15:54:21.920144+0000","last_clean":"2024-04-25T15:54:21.920144+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:21.920144+0000","last_undegraded":"2024-04-25T15:54:21.920144+0000","last_fullsized":"2024-04-25T15:54:21.920144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442947+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:21.442947+0000","last_peered":"2024-04-25T15:54:21.442947+0000","last_clean":"2024-04-25T15:54:21.442947+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:21.442947+0000","last_undegraded":"2024-04-25T15:54:21.442947+0000","last_fullsized":"2024-04-25T15:54:21.442947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922110+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:21.922110+0000","last_peered":"2024-04-25T15:54:21.922110+0000","last_clean":"2024-04-25T15:54:21.922110+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:21.922110+0000","last_undegraded":"2024-04-25T15:54:21.922110+0000","last_fullsized":"2024-04-25T15:54:21.922110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924928+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:21.924928+0000","last_peered":"2024-04-25T15:54:21.924928+0000","last_clean":"2024-04-25T15:54:21.924928+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:21.924928+0000","last_undegraded":"2024-04-25T15:54:21.924928+0000","last_fullsized":"2024-04-25T15:54:21.924928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":683194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":92916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":95400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:25.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:25.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 Processor -- start 2024-04-25T15:54:25.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 -- start start 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 0x7f52f406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f52f4070490 0x7f52f415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f40c5120 con 0x7f52f415b170 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f52f40c3b20 con 0x7f52f4070490 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52faa07640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f52f4070e20 con 0x7f52f40c4250 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f8fa4640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f52f415b170 0x7f52f40c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59396/0 (socket says 172.21.15.87:59396) 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f8fa4640 1 -- 172.21.15.87:0/2188265148 learned_addr learned my addr 172.21.15.87:0/2188265148 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f37fe640 1 --2- 172.21.15.87:0/2188265148 >> v2:172.21.15.155:3300/0 conn(0x7f52f4070490 0x7f52f415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754720157 0 0) 0x7f52ec0014a0 con 0x7f52f415b170 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d8003530 con 0x7f52f415b170 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f3fff640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 0x7f52f406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274174642 0 0) 0x7f52d8003530 con 0x7f52f415b170 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 msgr2=0x7f52f406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 0x7f52f406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 >> v2:172.21.15.155:3300/0 conn(0x7f52f4070490 msgr2=0x7f52f415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 --2- 172.21.15.87:0/2188265148 >> v2:172.21.15.155:3300/0 conn(0x7f52f4070490 0x7f52f415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f40c4b60 con 0x7f52f415b170 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f52ec001bd0 con 0x7f52f415b170 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 >> v1:172.21.15.87:6789/0 conn(0x7f52f415b170 legacy=0x7f52f40c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 0x7f52d80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52d8003ff0 0x7f52d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d8004d50 0x7f52d8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4070e20 con 0x7f52d8004d50 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52d800bbc0 con 0x7f52d8003ff0 2024-04-25T15:54:25.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f52d800bdc0 con 0x7f52f40c4250 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f37fe640 1 --2- 172.21.15.87:0/2188265148 >> v2:172.21.15.155:3300/0 conn(0x7f52f4070490 0x7f52f415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.769+0000 7f52f8fa4640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d8004d50 0x7f52d8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f3fff640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 0x7f52d80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f37fe640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52d8003ff0 0x7f52d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 -- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 msgr2=0x7f52d80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f40c4250 0x7f52d80039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 -- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52d8003ff0 msgr2=0x7f52d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52d8003ff0 0x7f52d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 -- 172.21.15.87:0/2188265148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8003530 con 0x7f52d8004d50 2024-04-25T15:54:25.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f37fe640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52d8003ff0 0x7f52d8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:25.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d8004d50 0x7f52d8005160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00aa40 tx=0x7f52ec01fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e532534b01aa08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00a690 con 0x7f52d8004d50 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec0aa730 con 0x7f52d8004d50 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f2ffd640 1 -- 172.21.15.87:0/2188265148 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0aab60 con 0x7f52d8004d50 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52faa07640 1 -- 172.21.15.87:0/2188265148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d8004d50 msgr2=0x7f52d8005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52faa07640 1 --2- 172.21.15.87:0/2188265148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d8004d50 0x7f52d8005160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00aa40 tx=0x7f52ec01fae0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52f8fa4640 1 -- 172.21.15.87:0/2188265148 reap_dead start 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52faa07640 1 -- 172.21.15.87:0/2188265148 shutdown_connections 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52faa07640 1 -- 172.21.15.87:0/2188265148 >> 172.21.15.87:0/2188265148 conn(0x7f52f406d780 msgr2=0x7f52f406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52faa07640 1 -- 172.21.15.87:0/2188265148 shutdown_connections 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.773+0000 7f52faa07640 1 -- 172.21.15.87:0/2188265148 wait complete. 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 Processor -- start 2024-04-25T15:54:25.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- start start 2024-04-25T15:54:25.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f414cf40 0x7f52f40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 0x7f52f414c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f41ed660 0x7f52f41eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40c4660 con 0x7f52f414c410 2024-04-25T15:54:25.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4070ab0 con 0x7f52f41ed660 2024-04-25T15:54:25.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f52f40c47e0 con 0x7f52f414cf40 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 0x7f52f414c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 0x7f52f414c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60412/0 (socket says 172.21.15.87:60412) 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 -- 172.21.15.87:0/1961650754 learned_addr learned my addr 172.21.15.87:0/1961650754 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f3fff640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f414cf40 0x7f52f40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f8fa4640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f41ed660 0x7f52f41eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 -- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f414cf40 msgr2=0x7f52f40ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f414cf40 0x7f52f40ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 -- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f41ed660 msgr2=0x7f52f41eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f41ed660 0x7f52f41eda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 -- 172.21.15.87:0/1961650754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f40ad0e0 con 0x7f52f414c410 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f37fe640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 0x7f52f414c820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f52e000e7e0 tx=0x7f52e000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0017070 con 0x7f52f414c410 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e000c6d0 con 0x7f52f414c410 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f4150b00 con 0x7f52f414c410 2024-04-25T15:54:25.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e000f040 con 0x7f52f414c410 2024-04-25T15:54:25.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f4150de0 con 0x7f52f414c410 2024-04-25T15:54:25.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.777+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f4069bb0 con 0x7f52f414c410 2024-04-25T15:54:25.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.781+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f52e001a070 con 0x7f52f414c410 2024-04-25T15:54:25.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.781+0000 7f52f0ff9640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f52dc06f400 0x7f52dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:25.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.781+0000 7f52f3fff640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f52dc06f400 0x7f52dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:25.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.781+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f52e008f0b0 con 0x7f52f414c410 2024-04-25T15:54:25.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.781+0000 7f52f3fff640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f52dc06f400 0x7f52dc071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52f41526d0 tx=0x7f52e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:25.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.785+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f52e005bd90 con 0x7f52f414c410 2024-04-25T15:54:25.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.929+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52f414cd60 con 0x7f52dc06f400 2024-04-25T15:54:25.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.949+0000 7f52f0ff9640 1 -- 172.21.15.87:0/1961650754 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490412 (secure 0 0 0) 0x7f52e400cdb0 con 0x7f52dc06f400 2024-04-25T15:54:25.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:25.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f52dc06f400 msgr2=0x7f52dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f52dc06f400 0x7f52dc071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52f41526d0 tx=0x7f52e4008040 comp rx=0 tx=0).stop 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 msgr2=0x7f52f414c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 0x7f52f414c820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f52e000e7e0 tx=0x7f52e000eca0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 shutdown_connections 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f52dc06f400 0x7f52dc071910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f41ed660 0x7f52f41eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f414c410 0x7f52f414c820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 --2- 172.21.15.87:0/1961650754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f414cf40 0x7f52f40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 >> 172.21.15.87:0/1961650754 conn(0x7f52f406d780 msgr2=0x7f52f414ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 shutdown_connections 2024-04-25T15:54:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:25.953+0000 7f52faa07640 1 -- 172.21.15.87:0/1961650754 wait complete. 2024-04-25T15:54:25.972 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-25T15:54:25.106204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219416,"kb_used_data":3236,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755304,"statfs":{"total":773094113280,"available":772869431296,"internally_reserved":0,"allocated":3313664,"data_stored":1963143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002784"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391405+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:21.391405+0000","last_peered":"2024-04-25T15:54:21.391405+0000","last_clean":"2024-04-25T15:54:21.391405+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:21.391405+0000","last_undegraded":"2024-04-25T15:54:21.391405+0000","last_fullsized":"2024-04-25T15:54:21.391405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437024+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:21.437024+0000","last_peered":"2024-04-25T15:54:21.437024+0000","last_clean":"2024-04-25T15:54:21.437024+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:21.437024+0000","last_undegraded":"2024-04-25T15:54:21.437024+0000","last_fullsized":"2024-04-25T15:54:21.437024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923430+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:21.923430+0000","last_peered":"2024-04-25T15:54:21.923430+0000","last_clean":"2024-04-25T15:54:21.923430+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:21.923430+0000","last_undegraded":"2024-04-25T15:54:21.923430+0000","last_fullsized":"2024-04-25T15:54:21.923430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921812+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:21.921812+0000","last_peered":"2024-04-25T15:54:21.921812+0000","last_clean":"2024-04-25T15:54:21.921812+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:21.921812+0000","last_undegraded":"2024-04-25T15:54:21.921812+0000","last_fullsized":"2024-04-25T15:54:21.921812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441214+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:21.441214+0000","last_peered":"2024-04-25T15:54:21.441214+0000","last_clean":"2024-04-25T15:54:21.441214+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:21.441214+0000","last_undegraded":"2024-04-25T15:54:21.441214+0000","last_fullsized":"2024-04-25T15:54:21.441214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923615+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:21.923615+0000","last_peered":"2024-04-25T15:54:21.923615+0000","last_clean":"2024-04-25T15:54:21.923615+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:21.923615+0000","last_undegraded":"2024-04-25T15:54:21.923615+0000","last_fullsized":"2024-04-25T15:54:21.923615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436826+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:21.436826+0000","last_peered":"2024-04-25T15:54:21.436826+0000","last_clean":"2024-04-25T15:54:21.436826+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:21.436826+0000","last_undegraded":"2024-04-25T15:54:21.436826+0000","last_fullsized":"2024-04-25T15:54:21.436826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391229+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:21.391229+0000","last_peered":"2024-04-25T15:54:21.391229+0000","last_clean":"2024-04-25T15:54:21.391229+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:21.391229+0000","last_undegraded":"2024-04-25T15:54:21.391229+0000","last_fullsized":"2024-04-25T15:54:21.391229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921155+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:21.921155+0000","last_peered":"2024-04-25T15:54:21.921155+0000","last_clean":"2024-04-25T15:54:21.921155+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:21.921155+0000","last_undegraded":"2024-04-25T15:54:21.921155+0000","last_fullsized":"2024-04-25T15:54:21.921155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922089+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:21.922089+0000","last_peered":"2024-04-25T15:54:21.922089+0000","last_clean":"2024-04-25T15:54:21.922089+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:21.922089+0000","last_undegraded":"2024-04-25T15:54:21.922089+0000","last_fullsized":"2024-04-25T15:54:21.922089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922747+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:21.922747+0000","last_peered":"2024-04-25T15:54:21.922747+0000","last_clean":"2024-04-25T15:54:21.922747+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:21.922747+0000","last_undegraded":"2024-04-25T15:54:21.922747+0000","last_fullsized":"2024-04-25T15:54:21.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393261+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:21.393261+0000","last_peered":"2024-04-25T15:54:21.393261+0000","last_clean":"2024-04-25T15:54:21.393261+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:21.393261+0000","last_undegraded":"2024-04-25T15:54:21.393261+0000","last_fullsized":"2024-04-25T15:54:21.393261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925213+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:21.925213+0000","last_peered":"2024-04-25T15:54:21.925213+0000","last_clean":"2024-04-25T15:54:21.925213+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:21.925213+0000","last_undegraded":"2024-04-25T15:54:21.925213+0000","last_fullsized":"2024-04-25T15:54:21.925213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924737+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:21.924737+0000","last_peered":"2024-04-25T15:54:21.924737+0000","last_clean":"2024-04-25T15:54:21.924737+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:21.924737+0000","last_undegraded":"2024-04-25T15:54:21.924737+0000","last_fullsized":"2024-04-25T15:54:21.924737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924403+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:21.924403+0000","last_peered":"2024-04-25T15:54:21.924403+0000","last_clean":"2024-04-25T15:54:21.924403+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:21.924403+0000","last_undegraded":"2024-04-25T15:54:21.924403+0000","last_fullsized":"2024-04-25T15:54:21.924403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393266+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:21.393266+0000","last_peered":"2024-04-25T15:54:21.393266+0000","last_clean":"2024-04-25T15:54:21.393266+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:21.393266+0000","last_undegraded":"2024-04-25T15:54:21.393266+0000","last_fullsized":"2024-04-25T15:54:21.393266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442122+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:21.442122+0000","last_peered":"2024-04-25T15:54:21.442122+0000","last_clean":"2024-04-25T15:54:21.442122+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:21.442122+0000","last_undegraded":"2024-04-25T15:54:21.442122+0000","last_fullsized":"2024-04-25T15:54:21.442122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394591+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:21.394591+0000","last_peered":"2024-04-25T15:54:21.394591+0000","last_clean":"2024-04-25T15:54:21.394591+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:21.394591+0000","last_undegraded":"2024-04-25T15:54:21.394591+0000","last_fullsized":"2024-04-25T15:54:21.394591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923550+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:21.923550+0000","last_peered":"2024-04-25T15:54:21.923550+0000","last_clean":"2024-04-25T15:54:21.923550+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:21.923550+0000","last_undegraded":"2024-04-25T15:54:21.923550+0000","last_fullsized":"2024-04-25T15:54:21.923550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396443+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:21.396443+0000","last_peered":"2024-04-25T15:54:21.396443+0000","last_clean":"2024-04-25T15:54:21.396443+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:21.396443+0000","last_undegraded":"2024-04-25T15:54:21.396443+0000","last_fullsized":"2024-04-25T15:54:21.396443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389783+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:21.389783+0000","last_peered":"2024-04-25T15:54:21.389783+0000","last_clean":"2024-04-25T15:54:21.389783+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:21.389783+0000","last_undegraded":"2024-04-25T15:54:21.389783+0000","last_fullsized":"2024-04-25T15:54:21.389783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921814+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:21.921814+0000","last_peered":"2024-04-25T15:54:21.921814+0000","last_clean":"2024-04-25T15:54:21.921814+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:21.921814+0000","last_undegraded":"2024-04-25T15:54:21.921814+0000","last_fullsized":"2024-04-25T15:54:21.921814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441971+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:21.441971+0000","last_peered":"2024-04-25T15:54:21.441971+0000","last_clean":"2024-04-25T15:54:21.441971+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:21.441971+0000","last_undegraded":"2024-04-25T15:54:21.441971+0000","last_fullsized":"2024-04-25T15:54:21.441971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397258+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:21.397258+0000","last_peered":"2024-04-25T15:54:21.397258+0000","last_clean":"2024-04-25T15:54:21.397258+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:21.397258+0000","last_undegraded":"2024-04-25T15:54:21.397258+0000","last_fullsized":"2024-04-25T15:54:21.397258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396002+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:21.396002+0000","last_peered":"2024-04-25T15:54:21.396002+0000","last_clean":"2024-04-25T15:54:21.396002+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:21.396002+0000","last_undegraded":"2024-04-25T15:54:21.396002+0000","last_fullsized":"2024-04-25T15:54:21.396002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922919+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:21.922919+0000","last_peered":"2024-04-25T15:54:21.922919+0000","last_clean":"2024-04-25T15:54:21.922919+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:21.922919+0000","last_undegraded":"2024-04-25T15:54:21.922919+0000","last_fullsized":"2024-04-25T15:54:21.922919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441436+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:21.441436+0000","last_peered":"2024-04-25T15:54:21.441436+0000","last_clean":"2024-04-25T15:54:21.441436+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:21.441436+0000","last_undegraded":"2024-04-25T15:54:21.441436+0000","last_fullsized":"2024-04-25T15:54:21.441436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443460+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:21.443460+0000","last_peered":"2024-04-25T15:54:21.443460+0000","last_clean":"2024-04-25T15:54:21.443460+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:21.443460+0000","last_undegraded":"2024-04-25T15:54:21.443460+0000","last_fullsized":"2024-04-25T15:54:21.443460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924171+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:21.924171+0000","last_peered":"2024-04-25T15:54:21.924171+0000","last_clean":"2024-04-25T15:54:21.924171+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:21.924171+0000","last_undegraded":"2024-04-25T15:54:21.924171+0000","last_fullsized":"2024-04-25T15:54:21.924171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392083+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:21.392083+0000","last_peered":"2024-04-25T15:54:21.392083+0000","last_clean":"2024-04-25T15:54:21.392083+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:21.392083+0000","last_undegraded":"2024-04-25T15:54:21.392083+0000","last_fullsized":"2024-04-25T15:54:21.392083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920688+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:21.920688+0000","last_peered":"2024-04-25T15:54:21.920688+0000","last_clean":"2024-04-25T15:54:21.920688+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:21.920688+0000","last_undegraded":"2024-04-25T15:54:21.920688+0000","last_fullsized":"2024-04-25T15:54:21.920688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395966+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:21.395966+0000","last_peered":"2024-04-25T15:54:21.395966+0000","last_clean":"2024-04-25T15:54:21.395966+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:21.395966+0000","last_undegraded":"2024-04-25T15:54:21.395966+0000","last_fullsized":"2024-04-25T15:54:21.395966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920895+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:21.920895+0000","last_peered":"2024-04-25T15:54:21.920895+0000","last_clean":"2024-04-25T15:54:21.920895+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:21.920895+0000","last_undegraded":"2024-04-25T15:54:21.920895+0000","last_fullsized":"2024-04-25T15:54:21.920895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437142+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:21.437142+0000","last_peered":"2024-04-25T15:54:21.437142+0000","last_clean":"2024-04-25T15:54:21.437142+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:21.437142+0000","last_undegraded":"2024-04-25T15:54:21.437142+0000","last_fullsized":"2024-04-25T15:54:21.437142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397313+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:21.397313+0000","last_peered":"2024-04-25T15:54:21.397313+0000","last_clean":"2024-04-25T15:54:21.397313+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:21.397313+0000","last_undegraded":"2024-04-25T15:54:21.397313+0000","last_fullsized":"2024-04-25T15:54:21.397313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391628+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:21.391628+0000","last_peered":"2024-04-25T15:54:21.391628+0000","last_clean":"2024-04-25T15:54:21.391628+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:21.391628+0000","last_undegraded":"2024-04-25T15:54:21.391628+0000","last_fullsized":"2024-04-25T15:54:21.391628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391487+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:21.391487+0000","last_peered":"2024-04-25T15:54:21.391487+0000","last_clean":"2024-04-25T15:54:21.391487+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:21.391487+0000","last_undegraded":"2024-04-25T15:54:21.391487+0000","last_fullsized":"2024-04-25T15:54:21.391487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923027+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:21.923027+0000","last_peered":"2024-04-25T15:54:21.923027+0000","last_clean":"2024-04-25T15:54:21.923027+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:21.923027+0000","last_undegraded":"2024-04-25T15:54:21.923027+0000","last_fullsized":"2024-04-25T15:54:21.923027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443222+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:21.443222+0000","last_peered":"2024-04-25T15:54:21.443222+0000","last_clean":"2024-04-25T15:54:21.443222+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:21.443222+0000","last_undegraded":"2024-04-25T15:54:21.443222+0000","last_fullsized":"2024-04-25T15:54:21.443222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920541+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:21.920541+0000","last_peered":"2024-04-25T15:54:21.920541+0000","last_clean":"2024-04-25T15:54:21.920541+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:21.920541+0000","last_undegraded":"2024-04-25T15:54:21.920541+0000","last_fullsized":"2024-04-25T15:54:21.920541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394741+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:21.394741+0000","last_peered":"2024-04-25T15:54:21.394741+0000","last_clean":"2024-04-25T15:54:21.394741+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:21.394741+0000","last_undegraded":"2024-04-25T15:54:21.394741+0000","last_fullsized":"2024-04-25T15:54:21.394741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442293+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:21.442293+0000","last_peered":"2024-04-25T15:54:21.442293+0000","last_clean":"2024-04-25T15:54:21.442293+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:21.442293+0000","last_undegraded":"2024-04-25T15:54:21.442293+0000","last_fullsized":"2024-04-25T15:54:21.442293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922453+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:21.922453+0000","last_peered":"2024-04-25T15:54:21.922453+0000","last_clean":"2024-04-25T15:54:21.922453+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:21.922453+0000","last_undegraded":"2024-04-25T15:54:21.922453+0000","last_fullsized":"2024-04-25T15:54:21.922453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436667+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:21.436667+0000","last_peered":"2024-04-25T15:54:21.436667+0000","last_clean":"2024-04-25T15:54:21.436667+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:21.436667+0000","last_undegraded":"2024-04-25T15:54:21.436667+0000","last_fullsized":"2024-04-25T15:54:21.436667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437157+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:21.437157+0000","last_peered":"2024-04-25T15:54:21.437157+0000","last_clean":"2024-04-25T15:54:21.437157+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:21.437157+0000","last_undegraded":"2024-04-25T15:54:21.437157+0000","last_fullsized":"2024-04-25T15:54:21.437157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924519+0000","last_change":"2024-04-25T15:54:10.285534+0000","last_active":"2024-04-25T15:54:21.924519+0000","last_peered":"2024-04-25T15:54:21.924519+0000","last_clean":"2024-04-25T15:54:21.924519+0000","last_became_active":"2024-04-25T15:54:10.279471+0000","last_became_peered":"2024-04-25T15:54:10.279471+0000","last_unstale":"2024-04-25T15:54:21.924519+0000","last_undegraded":"2024-04-25T15:54:21.924519+0000","last_fullsized":"2024-04-25T15:54:21.924519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442305+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:21.442305+0000","last_peered":"2024-04-25T15:54:21.442305+0000","last_clean":"2024-04-25T15:54:21.442305+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:21.442305+0000","last_undegraded":"2024-04-25T15:54:21.442305+0000","last_fullsized":"2024-04-25T15:54:21.442305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441751+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:21.441751+0000","last_peered":"2024-04-25T15:54:21.441751+0000","last_clean":"2024-04-25T15:54:21.441751+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:21.441751+0000","last_undegraded":"2024-04-25T15:54:21.441751+0000","last_fullsized":"2024-04-25T15:54:21.441751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437080+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:21.437080+0000","last_peered":"2024-04-25T15:54:21.437080+0000","last_clean":"2024-04-25T15:54:21.437080+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:21.437080+0000","last_undegraded":"2024-04-25T15:54:21.437080+0000","last_fullsized":"2024-04-25T15:54:21.437080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393701+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:21.393701+0000","last_peered":"2024-04-25T15:54:21.393701+0000","last_clean":"2024-04-25T15:54:21.393701+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:21.393701+0000","last_undegraded":"2024-04-25T15:54:21.393701+0000","last_fullsized":"2024-04-25T15:54:21.393701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922767+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:21.922767+0000","last_peered":"2024-04-25T15:54:21.922767+0000","last_clean":"2024-04-25T15:54:21.922767+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:21.922767+0000","last_undegraded":"2024-04-25T15:54:21.922767+0000","last_fullsized":"2024-04-25T15:54:21.922767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442241+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:21.442241+0000","last_peered":"2024-04-25T15:54:21.442241+0000","last_clean":"2024-04-25T15:54:21.442241+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:21.442241+0000","last_undegraded":"2024-04-25T15:54:21.442241+0000","last_fullsized":"2024-04-25T15:54:21.442241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390373+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:21.390373+0000","last_peered":"2024-04-25T15:54:21.390373+0000","last_clean":"2024-04-25T15:54:21.390373+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:21.390373+0000","last_undegraded":"2024-04-25T15:54:21.390373+0000","last_fullsized":"2024-04-25T15:54:21.390373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441402+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:21.441402+0000","last_peered":"2024-04-25T15:54:21.441402+0000","last_clean":"2024-04-25T15:54:21.441402+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:21.441402+0000","last_undegraded":"2024-04-25T15:54:21.441402+0000","last_fullsized":"2024-04-25T15:54:21.441402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389173+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:21.389173+0000","last_peered":"2024-04-25T15:54:21.389173+0000","last_clean":"2024-04-25T15:54:21.389173+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:21.389173+0000","last_undegraded":"2024-04-25T15:54:21.389173+0000","last_fullsized":"2024-04-25T15:54:21.389173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443394+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:21.443394+0000","last_peered":"2024-04-25T15:54:21.443394+0000","last_clean":"2024-04-25T15:54:21.443394+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:21.443394+0000","last_undegraded":"2024-04-25T15:54:21.443394+0000","last_fullsized":"2024-04-25T15:54:21.443394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925008+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:21.925008+0000","last_peered":"2024-04-25T15:54:21.925008+0000","last_clean":"2024-04-25T15:54:21.925008+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:21.925008+0000","last_undegraded":"2024-04-25T15:54:21.925008+0000","last_fullsized":"2024-04-25T15:54:21.925008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436357+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:21.436357+0000","last_peered":"2024-04-25T15:54:21.436357+0000","last_clean":"2024-04-25T15:54:21.436357+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:21.436357+0000","last_undegraded":"2024-04-25T15:54:21.436357+0000","last_fullsized":"2024-04-25T15:54:21.436357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920818+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:21.920818+0000","last_peered":"2024-04-25T15:54:21.920818+0000","last_clean":"2024-04-25T15:54:21.920818+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:21.920818+0000","last_undegraded":"2024-04-25T15:54:21.920818+0000","last_fullsized":"2024-04-25T15:54:21.920818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.439414+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:21.439414+0000","last_peered":"2024-04-25T15:54:21.439414+0000","last_clean":"2024-04-25T15:54:21.439414+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:21.439414+0000","last_undegraded":"2024-04-25T15:54:21.439414+0000","last_fullsized":"2024-04-25T15:54:21.439414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924237+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:21.924237+0000","last_peered":"2024-04-25T15:54:21.924237+0000","last_clean":"2024-04-25T15:54:21.924237+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:21.924237+0000","last_undegraded":"2024-04-25T15:54:21.924237+0000","last_fullsized":"2024-04-25T15:54:21.924237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921664+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:21.921664+0000","last_peered":"2024-04-25T15:54:21.921664+0000","last_clean":"2024-04-25T15:54:21.921664+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:21.921664+0000","last_undegraded":"2024-04-25T15:54:21.921664+0000","last_fullsized":"2024-04-25T15:54:21.921664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925364+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:21.925364+0000","last_peered":"2024-04-25T15:54:21.925364+0000","last_clean":"2024-04-25T15:54:21.925364+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:21.925364+0000","last_undegraded":"2024-04-25T15:54:21.925364+0000","last_fullsized":"2024-04-25T15:54:21.925364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921478+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:21.921478+0000","last_peered":"2024-04-25T15:54:21.921478+0000","last_clean":"2024-04-25T15:54:21.921478+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:21.921478+0000","last_undegraded":"2024-04-25T15:54:21.921478+0000","last_fullsized":"2024-04-25T15:54:21.921478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394923+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:21.394923+0000","last_peered":"2024-04-25T15:54:21.394923+0000","last_clean":"2024-04-25T15:54:21.394923+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:21.394923+0000","last_undegraded":"2024-04-25T15:54:21.394923+0000","last_fullsized":"2024-04-25T15:54:21.394923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390876+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:21.390876+0000","last_peered":"2024-04-25T15:54:21.390876+0000","last_clean":"2024-04-25T15:54:21.390876+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:21.390876+0000","last_undegraded":"2024-04-25T15:54:21.390876+0000","last_fullsized":"2024-04-25T15:54:21.390876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922057+0000","last_change":"2024-04-25T15:54:10.294873+0000","last_active":"2024-04-25T15:54:21.922057+0000","last_peered":"2024-04-25T15:54:21.922057+0000","last_clean":"2024-04-25T15:54:21.922057+0000","last_became_active":"2024-04-25T15:54:10.291885+0000","last_became_peered":"2024-04-25T15:54:10.291885+0000","last_unstale":"2024-04-25T15:54:21.922057+0000","last_undegraded":"2024-04-25T15:54:21.922057+0000","last_fullsized":"2024-04-25T15:54:21.922057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390368+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:21.390368+0000","last_peered":"2024-04-25T15:54:21.390368+0000","last_clean":"2024-04-25T15:54:21.390368+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:21.390368+0000","last_undegraded":"2024-04-25T15:54:21.390368+0000","last_fullsized":"2024-04-25T15:54:21.390368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394250+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:21.394250+0000","last_peered":"2024-04-25T15:54:21.394250+0000","last_clean":"2024-04-25T15:54:21.394250+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:21.394250+0000","last_undegraded":"2024-04-25T15:54:21.394250+0000","last_fullsized":"2024-04-25T15:54:21.394250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389873+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:21.389873+0000","last_peered":"2024-04-25T15:54:21.389873+0000","last_clean":"2024-04-25T15:54:21.389873+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:21.389873+0000","last_undegraded":"2024-04-25T15:54:21.389873+0000","last_fullsized":"2024-04-25T15:54:21.389873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923240+0000","last_change":"2024-04-25T15:54:10.271652+0000","last_active":"2024-04-25T15:54:21.923240+0000","last_peered":"2024-04-25T15:54:21.923240+0000","last_clean":"2024-04-25T15:54:21.923240+0000","last_became_active":"2024-04-25T15:54:10.270697+0000","last_became_peered":"2024-04-25T15:54:10.270697+0000","last_unstale":"2024-04-25T15:54:21.923240+0000","last_undegraded":"2024-04-25T15:54:21.923240+0000","last_fullsized":"2024-04-25T15:54:21.923240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443076+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:21.443076+0000","last_peered":"2024-04-25T15:54:21.443076+0000","last_clean":"2024-04-25T15:54:21.443076+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:21.443076+0000","last_undegraded":"2024-04-25T15:54:21.443076+0000","last_fullsized":"2024-04-25T15:54:21.443076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436482+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:21.436482+0000","last_peered":"2024-04-25T15:54:21.436482+0000","last_clean":"2024-04-25T15:54:21.436482+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:21.436482+0000","last_undegraded":"2024-04-25T15:54:21.436482+0000","last_fullsized":"2024-04-25T15:54:21.436482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921967+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:21.921967+0000","last_peered":"2024-04-25T15:54:21.921967+0000","last_clean":"2024-04-25T15:54:21.921967+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:21.921967+0000","last_undegraded":"2024-04-25T15:54:21.921967+0000","last_fullsized":"2024-04-25T15:54:21.921967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925121+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:21.925121+0000","last_peered":"2024-04-25T15:54:21.925121+0000","last_clean":"2024-04-25T15:54:21.925121+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:21.925121+0000","last_undegraded":"2024-04-25T15:54:21.925121+0000","last_fullsized":"2024-04-25T15:54:21.925121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390564+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:21.390564+0000","last_peered":"2024-04-25T15:54:21.390564+0000","last_clean":"2024-04-25T15:54:21.390564+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:21.390564+0000","last_undegraded":"2024-04-25T15:54:21.390564+0000","last_fullsized":"2024-04-25T15:54:21.390564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920163+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:21.920163+0000","last_peered":"2024-04-25T15:54:21.920163+0000","last_clean":"2024-04-25T15:54:21.920163+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:21.920163+0000","last_undegraded":"2024-04-25T15:54:21.920163+0000","last_fullsized":"2024-04-25T15:54:21.920163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389276+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:21.389276+0000","last_peered":"2024-04-25T15:54:21.389276+0000","last_clean":"2024-04-25T15:54:21.389276+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:21.389276+0000","last_undegraded":"2024-04-25T15:54:21.389276+0000","last_fullsized":"2024-04-25T15:54:21.389276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925892+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:21.925892+0000","last_peered":"2024-04-25T15:54:21.925892+0000","last_clean":"2024-04-25T15:54:21.925892+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:21.925892+0000","last_undegraded":"2024-04-25T15:54:21.925892+0000","last_fullsized":"2024-04-25T15:54:21.925892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397052+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:21.397052+0000","last_peered":"2024-04-25T15:54:21.397052+0000","last_clean":"2024-04-25T15:54:21.397052+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:21.397052+0000","last_undegraded":"2024-04-25T15:54:21.397052+0000","last_fullsized":"2024-04-25T15:54:21.397052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391328+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:21.391328+0000","last_peered":"2024-04-25T15:54:21.391328+0000","last_clean":"2024-04-25T15:54:21.391328+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:21.391328+0000","last_undegraded":"2024-04-25T15:54:21.391328+0000","last_fullsized":"2024-04-25T15:54:21.391328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922858+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:21.922858+0000","last_peered":"2024-04-25T15:54:21.922858+0000","last_clean":"2024-04-25T15:54:21.922858+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:21.922858+0000","last_undegraded":"2024-04-25T15:54:21.922858+0000","last_fullsized":"2024-04-25T15:54:21.922858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922521+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:21.922521+0000","last_peered":"2024-04-25T15:54:21.922521+0000","last_clean":"2024-04-25T15:54:21.922521+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:21.922521+0000","last_undegraded":"2024-04-25T15:54:21.922521+0000","last_fullsized":"2024-04-25T15:54:21.922521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389197+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:21.389197+0000","last_peered":"2024-04-25T15:54:21.389197+0000","last_clean":"2024-04-25T15:54:21.389197+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:21.389197+0000","last_undegraded":"2024-04-25T15:54:21.389197+0000","last_fullsized":"2024-04-25T15:54:21.389197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437180+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:21.437180+0000","last_peered":"2024-04-25T15:54:21.437180+0000","last_clean":"2024-04-25T15:54:21.437180+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:21.437180+0000","last_undegraded":"2024-04-25T15:54:21.437180+0000","last_fullsized":"2024-04-25T15:54:21.437180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923162+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:21.923162+0000","last_peered":"2024-04-25T15:54:21.923162+0000","last_clean":"2024-04-25T15:54:21.923162+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:21.923162+0000","last_undegraded":"2024-04-25T15:54:21.923162+0000","last_fullsized":"2024-04-25T15:54:21.923162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394159+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:21.394159+0000","last_peered":"2024-04-25T15:54:21.394159+0000","last_clean":"2024-04-25T15:54:21.394159+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:21.394159+0000","last_undegraded":"2024-04-25T15:54:21.394159+0000","last_fullsized":"2024-04-25T15:54:21.394159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395369+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:21.395369+0000","last_peered":"2024-04-25T15:54:21.395369+0000","last_clean":"2024-04-25T15:54:21.395369+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:21.395369+0000","last_undegraded":"2024-04-25T15:54:21.395369+0000","last_fullsized":"2024-04-25T15:54:21.395369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922677+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:21.922677+0000","last_peered":"2024-04-25T15:54:21.922677+0000","last_clean":"2024-04-25T15:54:21.922677+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:21.922677+0000","last_undegraded":"2024-04-25T15:54:21.922677+0000","last_fullsized":"2024-04-25T15:54:21.922677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923119+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:21.923119+0000","last_peered":"2024-04-25T15:54:21.923119+0000","last_clean":"2024-04-25T15:54:21.923119+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:21.923119+0000","last_undegraded":"2024-04-25T15:54:21.923119+0000","last_fullsized":"2024-04-25T15:54:21.923119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923220+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:21.923220+0000","last_peered":"2024-04-25T15:54:21.923220+0000","last_clean":"2024-04-25T15:54:21.923220+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:21.923220+0000","last_undegraded":"2024-04-25T15:54:21.923220+0000","last_fullsized":"2024-04-25T15:54:21.923220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922602+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:21.922602+0000","last_peered":"2024-04-25T15:54:21.922602+0000","last_clean":"2024-04-25T15:54:21.922602+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:21.922602+0000","last_undegraded":"2024-04-25T15:54:21.922602+0000","last_fullsized":"2024-04-25T15:54:21.922602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921972+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:21.921972+0000","last_peered":"2024-04-25T15:54:21.921972+0000","last_clean":"2024-04-25T15:54:21.921972+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:21.921972+0000","last_undegraded":"2024-04-25T15:54:21.921972+0000","last_fullsized":"2024-04-25T15:54:21.921972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436318+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:21.436318+0000","last_peered":"2024-04-25T15:54:21.436318+0000","last_clean":"2024-04-25T15:54:21.436318+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:21.436318+0000","last_undegraded":"2024-04-25T15:54:21.436318+0000","last_fullsized":"2024-04-25T15:54:21.436318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437324+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:21.437324+0000","last_peered":"2024-04-25T15:54:21.437324+0000","last_clean":"2024-04-25T15:54:21.437324+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:21.437324+0000","last_undegraded":"2024-04-25T15:54:21.437324+0000","last_fullsized":"2024-04-25T15:54:21.437324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924345+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:21.924345+0000","last_peered":"2024-04-25T15:54:21.924345+0000","last_clean":"2024-04-25T15:54:21.924345+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:21.924345+0000","last_undegraded":"2024-04-25T15:54:21.924345+0000","last_fullsized":"2024-04-25T15:54:21.924345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922285+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:21.922285+0000","last_peered":"2024-04-25T15:54:21.922285+0000","last_clean":"2024-04-25T15:54:21.922285+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:21.922285+0000","last_undegraded":"2024-04-25T15:54:21.922285+0000","last_fullsized":"2024-04-25T15:54:21.922285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921704+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:21.921704+0000","last_peered":"2024-04-25T15:54:21.921704+0000","last_clean":"2024-04-25T15:54:21.921704+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:21.921704+0000","last_undegraded":"2024-04-25T15:54:21.921704+0000","last_fullsized":"2024-04-25T15:54:21.921704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395230+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:21.395230+0000","last_peered":"2024-04-25T15:54:21.395230+0000","last_clean":"2024-04-25T15:54:21.395230+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:21.395230+0000","last_undegraded":"2024-04-25T15:54:21.395230+0000","last_fullsized":"2024-04-25T15:54:21.395230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441572+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:21.441572+0000","last_peered":"2024-04-25T15:54:21.441572+0000","last_clean":"2024-04-25T15:54:21.441572+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:21.441572+0000","last_undegraded":"2024-04-25T15:54:21.441572+0000","last_fullsized":"2024-04-25T15:54:21.441572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441814+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:21.441814+0000","last_peered":"2024-04-25T15:54:21.441814+0000","last_clean":"2024-04-25T15:54:21.441814+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:21.441814+0000","last_undegraded":"2024-04-25T15:54:21.441814+0000","last_fullsized":"2024-04-25T15:54:21.441814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397497+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:21.397497+0000","last_peered":"2024-04-25T15:54:21.397497+0000","last_clean":"2024-04-25T15:54:21.397497+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:21.397497+0000","last_undegraded":"2024-04-25T15:54:21.397497+0000","last_fullsized":"2024-04-25T15:54:21.397497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443036+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:21.443036+0000","last_peered":"2024-04-25T15:54:21.443036+0000","last_clean":"2024-04-25T15:54:21.443036+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:21.443036+0000","last_undegraded":"2024-04-25T15:54:21.443036+0000","last_fullsized":"2024-04-25T15:54:21.443036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393180+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:21.393180+0000","last_peered":"2024-04-25T15:54:21.393180+0000","last_clean":"2024-04-25T15:54:21.393180+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:21.393180+0000","last_undegraded":"2024-04-25T15:54:21.393180+0000","last_fullsized":"2024-04-25T15:54:21.393180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395117+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:21.395117+0000","last_peered":"2024-04-25T15:54:21.395117+0000","last_clean":"2024-04-25T15:54:21.395117+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:21.395117+0000","last_undegraded":"2024-04-25T15:54:21.395117+0000","last_fullsized":"2024-04-25T15:54:21.395117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436903+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:21.436903+0000","last_peered":"2024-04-25T15:54:21.436903+0000","last_clean":"2024-04-25T15:54:21.436903+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:21.436903+0000","last_undegraded":"2024-04-25T15:54:21.436903+0000","last_fullsized":"2024-04-25T15:54:21.436903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923570+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:21.923570+0000","last_peered":"2024-04-25T15:54:21.923570+0000","last_clean":"2024-04-25T15:54:21.923570+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:21.923570+0000","last_undegraded":"2024-04-25T15:54:21.923570+0000","last_fullsized":"2024-04-25T15:54:21.923570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921005+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:21.921005+0000","last_peered":"2024-04-25T15:54:21.921005+0000","last_clean":"2024-04-25T15:54:21.921005+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:21.921005+0000","last_undegraded":"2024-04-25T15:54:21.921005+0000","last_fullsized":"2024-04-25T15:54:21.921005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920631+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:21.920631+0000","last_peered":"2024-04-25T15:54:21.920631+0000","last_clean":"2024-04-25T15:54:21.920631+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:21.920631+0000","last_undegraded":"2024-04-25T15:54:21.920631+0000","last_fullsized":"2024-04-25T15:54:21.920631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923339+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:21.923339+0000","last_peered":"2024-04-25T15:54:21.923339+0000","last_clean":"2024-04-25T15:54:21.923339+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:21.923339+0000","last_undegraded":"2024-04-25T15:54:21.923339+0000","last_fullsized":"2024-04-25T15:54:21.923339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397036+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:21.397036+0000","last_peered":"2024-04-25T15:54:21.397036+0000","last_clean":"2024-04-25T15:54:21.397036+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:21.397036+0000","last_undegraded":"2024-04-25T15:54:21.397036+0000","last_fullsized":"2024-04-25T15:54:21.397036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920956+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:21.920956+0000","last_peered":"2024-04-25T15:54:21.920956+0000","last_clean":"2024-04-25T15:54:21.920956+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:21.920956+0000","last_undegraded":"2024-04-25T15:54:21.920956+0000","last_fullsized":"2024-04-25T15:54:21.920956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396385+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:21.396385+0000","last_peered":"2024-04-25T15:54:21.396385+0000","last_clean":"2024-04-25T15:54:21.396385+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:21.396385+0000","last_undegraded":"2024-04-25T15:54:21.396385+0000","last_fullsized":"2024-04-25T15:54:21.396385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437021+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:21.437021+0000","last_peered":"2024-04-25T15:54:21.437021+0000","last_clean":"2024-04-25T15:54:21.437021+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:21.437021+0000","last_undegraded":"2024-04-25T15:54:21.437021+0000","last_fullsized":"2024-04-25T15:54:21.437021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441296+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:21.441296+0000","last_peered":"2024-04-25T15:54:21.441296+0000","last_clean":"2024-04-25T15:54:21.441296+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:21.441296+0000","last_undegraded":"2024-04-25T15:54:21.441296+0000","last_fullsized":"2024-04-25T15:54:21.441296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920923+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:21.920923+0000","last_peered":"2024-04-25T15:54:21.920923+0000","last_clean":"2024-04-25T15:54:21.920923+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:21.920923+0000","last_undegraded":"2024-04-25T15:54:21.920923+0000","last_fullsized":"2024-04-25T15:54:21.920923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436823+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:21.436823+0000","last_peered":"2024-04-25T15:54:21.436823+0000","last_clean":"2024-04-25T15:54:21.436823+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:21.436823+0000","last_undegraded":"2024-04-25T15:54:21.436823+0000","last_fullsized":"2024-04-25T15:54:21.436823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396688+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:21.396688+0000","last_peered":"2024-04-25T15:54:21.396688+0000","last_clean":"2024-04-25T15:54:21.396688+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:21.396688+0000","last_undegraded":"2024-04-25T15:54:21.396688+0000","last_fullsized":"2024-04-25T15:54:21.396688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922853+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:21.922853+0000","last_peered":"2024-04-25T15:54:21.922853+0000","last_clean":"2024-04-25T15:54:21.922853+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:21.922853+0000","last_undegraded":"2024-04-25T15:54:21.922853+0000","last_fullsized":"2024-04-25T15:54:21.922853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922209+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:21.922209+0000","last_peered":"2024-04-25T15:54:21.922209+0000","last_clean":"2024-04-25T15:54:21.922209+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:21.922209+0000","last_undegraded":"2024-04-25T15:54:21.922209+0000","last_fullsized":"2024-04-25T15:54:21.922209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442811+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:21.442811+0000","last_peered":"2024-04-25T15:54:21.442811+0000","last_clean":"2024-04-25T15:54:21.442811+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:21.442811+0000","last_undegraded":"2024-04-25T15:54:21.442811+0000","last_fullsized":"2024-04-25T15:54:21.442811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394919+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:21.394919+0000","last_peered":"2024-04-25T15:54:21.394919+0000","last_clean":"2024-04-25T15:54:21.394919+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:21.394919+0000","last_undegraded":"2024-04-25T15:54:21.394919+0000","last_fullsized":"2024-04-25T15:54:21.394919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437206+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:21.437206+0000","last_peered":"2024-04-25T15:54:21.437206+0000","last_clean":"2024-04-25T15:54:21.437206+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:21.437206+0000","last_undegraded":"2024-04-25T15:54:21.437206+0000","last_fullsized":"2024-04-25T15:54:21.437206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390654+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:21.390654+0000","last_peered":"2024-04-25T15:54:21.390654+0000","last_clean":"2024-04-25T15:54:21.390654+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:21.390654+0000","last_undegraded":"2024-04-25T15:54:21.390654+0000","last_fullsized":"2024-04-25T15:54:21.390654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393791+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:21.393791+0000","last_peered":"2024-04-25T15:54:21.393791+0000","last_clean":"2024-04-25T15:54:21.393791+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:21.393791+0000","last_undegraded":"2024-04-25T15:54:21.393791+0000","last_fullsized":"2024-04-25T15:54:21.393791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923014+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:21.923014+0000","last_peered":"2024-04-25T15:54:21.923014+0000","last_clean":"2024-04-25T15:54:21.923014+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:21.923014+0000","last_undegraded":"2024-04-25T15:54:21.923014+0000","last_fullsized":"2024-04-25T15:54:21.923014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393788+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:21.393788+0000","last_peered":"2024-04-25T15:54:21.393788+0000","last_clean":"2024-04-25T15:54:21.393788+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:21.393788+0000","last_undegraded":"2024-04-25T15:54:21.393788+0000","last_fullsized":"2024-04-25T15:54:21.393788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922425+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:21.922425+0000","last_peered":"2024-04-25T15:54:21.922425+0000","last_clean":"2024-04-25T15:54:21.922425+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:21.922425+0000","last_undegraded":"2024-04-25T15:54:21.922425+0000","last_fullsized":"2024-04-25T15:54:21.922425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923390+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:21.923390+0000","last_peered":"2024-04-25T15:54:21.923390+0000","last_clean":"2024-04-25T15:54:21.923390+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:21.923390+0000","last_undegraded":"2024-04-25T15:54:21.923390+0000","last_fullsized":"2024-04-25T15:54:21.923390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393859+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:21.393859+0000","last_peered":"2024-04-25T15:54:21.393859+0000","last_clean":"2024-04-25T15:54:21.393859+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:21.393859+0000","last_undegraded":"2024-04-25T15:54:21.393859+0000","last_fullsized":"2024-04-25T15:54:21.393859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443040+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:21.443040+0000","last_peered":"2024-04-25T15:54:21.443040+0000","last_clean":"2024-04-25T15:54:21.443040+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:21.443040+0000","last_undegraded":"2024-04-25T15:54:21.443040+0000","last_fullsized":"2024-04-25T15:54:21.443040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.388928+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:21.388928+0000","last_peered":"2024-04-25T15:54:21.388928+0000","last_clean":"2024-04-25T15:54:21.388928+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:21.388928+0000","last_undegraded":"2024-04-25T15:54:21.388928+0000","last_fullsized":"2024-04-25T15:54:21.388928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922270+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:21.922270+0000","last_peered":"2024-04-25T15:54:21.922270+0000","last_clean":"2024-04-25T15:54:21.922270+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:21.922270+0000","last_undegraded":"2024-04-25T15:54:21.922270+0000","last_fullsized":"2024-04-25T15:54:21.922270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922344+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:21.922344+0000","last_peered":"2024-04-25T15:54:21.922344+0000","last_clean":"2024-04-25T15:54:21.922344+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:21.922344+0000","last_undegraded":"2024-04-25T15:54:21.922344+0000","last_fullsized":"2024-04-25T15:54:21.922344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442696+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:21.442696+0000","last_peered":"2024-04-25T15:54:21.442696+0000","last_clean":"2024-04-25T15:54:21.442696+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:21.442696+0000","last_undegraded":"2024-04-25T15:54:21.442696+0000","last_fullsized":"2024-04-25T15:54:21.442696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437246+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:21.437246+0000","last_peered":"2024-04-25T15:54:21.437246+0000","last_clean":"2024-04-25T15:54:21.437246+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:21.437246+0000","last_undegraded":"2024-04-25T15:54:21.437246+0000","last_fullsized":"2024-04-25T15:54:21.437246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920646+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:21.920646+0000","last_peered":"2024-04-25T15:54:21.920646+0000","last_clean":"2024-04-25T15:54:21.920646+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:21.920646+0000","last_undegraded":"2024-04-25T15:54:21.920646+0000","last_fullsized":"2024-04-25T15:54:21.920646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922785+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:21.922785+0000","last_peered":"2024-04-25T15:54:21.922785+0000","last_clean":"2024-04-25T15:54:21.922785+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:21.922785+0000","last_undegraded":"2024-04-25T15:54:21.922785+0000","last_fullsized":"2024-04-25T15:54:21.922785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392960+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:21.392960+0000","last_peered":"2024-04-25T15:54:21.392960+0000","last_clean":"2024-04-25T15:54:21.392960+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:21.392960+0000","last_undegraded":"2024-04-25T15:54:21.392960+0000","last_fullsized":"2024-04-25T15:54:21.392960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442870+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:21.442870+0000","last_peered":"2024-04-25T15:54:21.442870+0000","last_clean":"2024-04-25T15:54:21.442870+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:21.442870+0000","last_undegraded":"2024-04-25T15:54:21.442870+0000","last_fullsized":"2024-04-25T15:54:21.442870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:21.920320+0000","last_peered":"2024-04-25T15:54:21.920320+0000","last_clean":"2024-04-25T15:54:21.920320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:21.920320+0000","last_undegraded":"2024-04-25T15:54:21.920320+0000","last_fullsized":"2024-04-25T15:54:21.920320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395555+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:21.395555+0000","last_peered":"2024-04-25T15:54:21.395555+0000","last_clean":"2024-04-25T15:54:21.395555+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:21.395555+0000","last_undegraded":"2024-04-25T15:54:21.395555+0000","last_fullsized":"2024-04-25T15:54:21.395555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394927+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:21.394927+0000","last_peered":"2024-04-25T15:54:21.394927+0000","last_clean":"2024-04-25T15:54:21.394927+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:21.394927+0000","last_undegraded":"2024-04-25T15:54:21.394927+0000","last_fullsized":"2024-04-25T15:54:21.394927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922828+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:21.922828+0000","last_peered":"2024-04-25T15:54:21.922828+0000","last_clean":"2024-04-25T15:54:21.922828+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:21.922828+0000","last_undegraded":"2024-04-25T15:54:21.922828+0000","last_fullsized":"2024-04-25T15:54:21.922828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923075+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:21.923075+0000","last_peered":"2024-04-25T15:54:21.923075+0000","last_clean":"2024-04-25T15:54:21.923075+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:21.923075+0000","last_undegraded":"2024-04-25T15:54:21.923075+0000","last_fullsized":"2024-04-25T15:54:21.923075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920626+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:21.920626+0000","last_peered":"2024-04-25T15:54:21.920626+0000","last_clean":"2024-04-25T15:54:21.920626+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:21.920626+0000","last_undegraded":"2024-04-25T15:54:21.920626+0000","last_fullsized":"2024-04-25T15:54:21.920626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924321+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:21.924321+0000","last_peered":"2024-04-25T15:54:21.924321+0000","last_clean":"2024-04-25T15:54:21.924321+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:21.924321+0000","last_undegraded":"2024-04-25T15:54:21.924321+0000","last_fullsized":"2024-04-25T15:54:21.924321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921198+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:21.921198+0000","last_peered":"2024-04-25T15:54:21.921198+0000","last_clean":"2024-04-25T15:54:21.921198+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:21.921198+0000","last_undegraded":"2024-04-25T15:54:21.921198+0000","last_fullsized":"2024-04-25T15:54:21.921198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389900+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:21.389900+0000","last_peered":"2024-04-25T15:54:21.389900+0000","last_clean":"2024-04-25T15:54:21.389900+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:21.389900+0000","last_undegraded":"2024-04-25T15:54:21.389900+0000","last_fullsized":"2024-04-25T15:54:21.389900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922079+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:21.922079+0000","last_peered":"2024-04-25T15:54:21.922079+0000","last_clean":"2024-04-25T15:54:21.922079+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:21.922079+0000","last_undegraded":"2024-04-25T15:54:21.922079+0000","last_fullsized":"2024-04-25T15:54:21.922079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922061+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:21.922061+0000","last_peered":"2024-04-25T15:54:21.922061+0000","last_clean":"2024-04-25T15:54:21.922061+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:21.922061+0000","last_undegraded":"2024-04-25T15:54:21.922061+0000","last_fullsized":"2024-04-25T15:54:21.922061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436923+0000","last_change":"2024-04-25T15:54:10.267602+0000","last_active":"2024-04-25T15:54:21.436923+0000","last_peered":"2024-04-25T15:54:21.436923+0000","last_clean":"2024-04-25T15:54:21.436923+0000","last_became_active":"2024-04-25T15:54:10.267276+0000","last_became_peered":"2024-04-25T15:54:10.267276+0000","last_unstale":"2024-04-25T15:54:21.436923+0000","last_undegraded":"2024-04-25T15:54:21.436923+0000","last_fullsized":"2024-04-25T15:54:21.436923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392942+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:21.392942+0000","last_peered":"2024-04-25T15:54:21.392942+0000","last_clean":"2024-04-25T15:54:21.392942+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:21.392942+0000","last_undegraded":"2024-04-25T15:54:21.392942+0000","last_fullsized":"2024-04-25T15:54:21.392942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395042+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:21.395042+0000","last_peered":"2024-04-25T15:54:21.395042+0000","last_clean":"2024-04-25T15:54:21.395042+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:21.395042+0000","last_undegraded":"2024-04-25T15:54:21.395042+0000","last_fullsized":"2024-04-25T15:54:21.395042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392913+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:21.392913+0000","last_peered":"2024-04-25T15:54:21.392913+0000","last_clean":"2024-04-25T15:54:21.392913+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:21.392913+0000","last_undegraded":"2024-04-25T15:54:21.392913+0000","last_fullsized":"2024-04-25T15:54:21.392913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922342+0000","last_change":"2024-04-25T15:54:10.295088+0000","last_active":"2024-04-25T15:54:21.922342+0000","last_peered":"2024-04-25T15:54:21.922342+0000","last_clean":"2024-04-25T15:54:21.922342+0000","last_became_active":"2024-04-25T15:54:10.292412+0000","last_became_peered":"2024-04-25T15:54:10.292412+0000","last_unstale":"2024-04-25T15:54:21.922342+0000","last_undegraded":"2024-04-25T15:54:21.922342+0000","last_fullsized":"2024-04-25T15:54:21.922342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920147+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:21.920147+0000","last_peered":"2024-04-25T15:54:21.920147+0000","last_clean":"2024-04-25T15:54:21.920147+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:21.920147+0000","last_undegraded":"2024-04-25T15:54:21.920147+0000","last_fullsized":"2024-04-25T15:54:21.920147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390651+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:21.390651+0000","last_peered":"2024-04-25T15:54:21.390651+0000","last_clean":"2024-04-25T15:54:21.390651+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:21.390651+0000","last_undegraded":"2024-04-25T15:54:21.390651+0000","last_fullsized":"2024-04-25T15:54:21.390651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436337+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:21.436337+0000","last_peered":"2024-04-25T15:54:21.436337+0000","last_clean":"2024-04-25T15:54:21.436337+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:21.436337+0000","last_undegraded":"2024-04-25T15:54:21.436337+0000","last_fullsized":"2024-04-25T15:54:21.436337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925691+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:21.925691+0000","last_peered":"2024-04-25T15:54:21.925691+0000","last_clean":"2024-04-25T15:54:21.925691+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:21.925691+0000","last_undegraded":"2024-04-25T15:54:21.925691+0000","last_fullsized":"2024-04-25T15:54:21.925691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442692+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:21.442692+0000","last_peered":"2024-04-25T15:54:21.442692+0000","last_clean":"2024-04-25T15:54:21.442692+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:21.442692+0000","last_undegraded":"2024-04-25T15:54:21.442692+0000","last_fullsized":"2024-04-25T15:54:21.442692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920342+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:21.920342+0000","last_peered":"2024-04-25T15:54:21.920342+0000","last_clean":"2024-04-25T15:54:21.920342+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:21.920342+0000","last_undegraded":"2024-04-25T15:54:21.920342+0000","last_fullsized":"2024-04-25T15:54:21.920342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397074+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:21.397074+0000","last_peered":"2024-04-25T15:54:21.397074+0000","last_clean":"2024-04-25T15:54:21.397074+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:21.397074+0000","last_undegraded":"2024-04-25T15:54:21.397074+0000","last_fullsized":"2024-04-25T15:54:21.397074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441304+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:21.441304+0000","last_peered":"2024-04-25T15:54:21.441304+0000","last_clean":"2024-04-25T15:54:21.441304+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:21.441304+0000","last_undegraded":"2024-04-25T15:54:21.441304+0000","last_fullsized":"2024-04-25T15:54:21.441304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921760+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:21.921760+0000","last_peered":"2024-04-25T15:54:21.921760+0000","last_clean":"2024-04-25T15:54:21.921760+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:21.921760+0000","last_undegraded":"2024-04-25T15:54:21.921760+0000","last_fullsized":"2024-04-25T15:54:21.921760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436316+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:21.436316+0000","last_peered":"2024-04-25T15:54:21.436316+0000","last_clean":"2024-04-25T15:54:21.436316+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:21.436316+0000","last_undegraded":"2024-04-25T15:54:21.436316+0000","last_fullsized":"2024-04-25T15:54:21.436316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921519+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:21.921519+0000","last_peered":"2024-04-25T15:54:21.921519+0000","last_clean":"2024-04-25T15:54:21.921519+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:21.921519+0000","last_undegraded":"2024-04-25T15:54:21.921519+0000","last_fullsized":"2024-04-25T15:54:21.921519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921500+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:21.921500+0000","last_peered":"2024-04-25T15:54:21.921500+0000","last_clean":"2024-04-25T15:54:21.921500+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:21.921500+0000","last_undegraded":"2024-04-25T15:54:21.921500+0000","last_fullsized":"2024-04-25T15:54:21.921500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397415+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:21.397415+0000","last_peered":"2024-04-25T15:54:21.397415+0000","last_clean":"2024-04-25T15:54:21.397415+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:21.397415+0000","last_undegraded":"2024-04-25T15:54:21.397415+0000","last_fullsized":"2024-04-25T15:54:21.397415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390647+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:21.390647+0000","last_peered":"2024-04-25T15:54:21.390647+0000","last_clean":"2024-04-25T15:54:21.390647+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:21.390647+0000","last_undegraded":"2024-04-25T15:54:21.390647+0000","last_fullsized":"2024-04-25T15:54:21.390647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395244+0000","last_change":"2024-04-25T15:54:10.256856+0000","last_active":"2024-04-25T15:54:21.395244+0000","last_peered":"2024-04-25T15:54:21.395244+0000","last_clean":"2024-04-25T15:54:21.395244+0000","last_became_active":"2024-04-25T15:54:10.256024+0000","last_became_peered":"2024-04-25T15:54:10.256024+0000","last_unstale":"2024-04-25T15:54:21.395244+0000","last_undegraded":"2024-04-25T15:54:21.395244+0000","last_fullsized":"2024-04-25T15:54:21.395244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921320+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:21.921320+0000","last_peered":"2024-04-25T15:54:21.921320+0000","last_clean":"2024-04-25T15:54:21.921320+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:21.921320+0000","last_undegraded":"2024-04-25T15:54:21.921320+0000","last_fullsized":"2024-04-25T15:54:21.921320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395489+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:21.395489+0000","last_peered":"2024-04-25T15:54:21.395489+0000","last_clean":"2024-04-25T15:54:21.395489+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:21.395489+0000","last_undegraded":"2024-04-25T15:54:21.395489+0000","last_fullsized":"2024-04-25T15:54:21.395489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921293+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:21.921293+0000","last_peered":"2024-04-25T15:54:21.921293+0000","last_clean":"2024-04-25T15:54:21.921293+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:21.921293+0000","last_undegraded":"2024-04-25T15:54:21.921293+0000","last_fullsized":"2024-04-25T15:54:21.921293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924964+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:21.924964+0000","last_peered":"2024-04-25T15:54:21.924964+0000","last_clean":"2024-04-25T15:54:21.924964+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:21.924964+0000","last_undegraded":"2024-04-25T15:54:21.924964+0000","last_fullsized":"2024-04-25T15:54:21.924964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922527+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:21.922527+0000","last_peered":"2024-04-25T15:54:21.922527+0000","last_clean":"2024-04-25T15:54:21.922527+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:21.922527+0000","last_undegraded":"2024-04-25T15:54:21.922527+0000","last_fullsized":"2024-04-25T15:54:21.922527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394617+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:21.394617+0000","last_peered":"2024-04-25T15:54:21.394617+0000","last_clean":"2024-04-25T15:54:21.394617+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:21.394617+0000","last_undegraded":"2024-04-25T15:54:21.394617+0000","last_fullsized":"2024-04-25T15:54:21.394617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924299+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:21.924299+0000","last_peered":"2024-04-25T15:54:21.924299+0000","last_clean":"2024-04-25T15:54:21.924299+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:21.924299+0000","last_undegraded":"2024-04-25T15:54:21.924299+0000","last_fullsized":"2024-04-25T15:54:21.924299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441620+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:21.441620+0000","last_peered":"2024-04-25T15:54:21.441620+0000","last_clean":"2024-04-25T15:54:21.441620+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:21.441620+0000","last_undegraded":"2024-04-25T15:54:21.441620+0000","last_fullsized":"2024-04-25T15:54:21.441620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924256+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:21.924256+0000","last_peered":"2024-04-25T15:54:21.924256+0000","last_clean":"2024-04-25T15:54:21.924256+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:21.924256+0000","last_undegraded":"2024-04-25T15:54:21.924256+0000","last_fullsized":"2024-04-25T15:54:21.924256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923071+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:21.923071+0000","last_peered":"2024-04-25T15:54:21.923071+0000","last_clean":"2024-04-25T15:54:21.923071+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:21.923071+0000","last_undegraded":"2024-04-25T15:54:21.923071+0000","last_fullsized":"2024-04-25T15:54:21.923071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921207+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:21.921207+0000","last_peered":"2024-04-25T15:54:21.921207+0000","last_clean":"2024-04-25T15:54:21.921207+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:21.921207+0000","last_undegraded":"2024-04-25T15:54:21.921207+0000","last_fullsized":"2024-04-25T15:54:21.921207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922442+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:21.922442+0000","last_peered":"2024-04-25T15:54:21.922442+0000","last_clean":"2024-04-25T15:54:21.922442+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:21.922442+0000","last_undegraded":"2024-04-25T15:54:21.922442+0000","last_fullsized":"2024-04-25T15:54:21.922442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390298+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:21.390298+0000","last_peered":"2024-04-25T15:54:21.390298+0000","last_clean":"2024-04-25T15:54:21.390298+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:21.390298+0000","last_undegraded":"2024-04-25T15:54:21.390298+0000","last_fullsized":"2024-04-25T15:54:21.390298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437423+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:21.437423+0000","last_peered":"2024-04-25T15:54:21.437423+0000","last_clean":"2024-04-25T15:54:21.437423+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:21.437423+0000","last_undegraded":"2024-04-25T15:54:21.437423+0000","last_fullsized":"2024-04-25T15:54:21.437423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920144+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:21.920144+0000","last_peered":"2024-04-25T15:54:21.920144+0000","last_clean":"2024-04-25T15:54:21.920144+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:21.920144+0000","last_undegraded":"2024-04-25T15:54:21.920144+0000","last_fullsized":"2024-04-25T15:54:21.920144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442947+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:21.442947+0000","last_peered":"2024-04-25T15:54:21.442947+0000","last_clean":"2024-04-25T15:54:21.442947+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:21.442947+0000","last_undegraded":"2024-04-25T15:54:21.442947+0000","last_fullsized":"2024-04-25T15:54:21.442947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922110+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:21.922110+0000","last_peered":"2024-04-25T15:54:21.922110+0000","last_clean":"2024-04-25T15:54:21.922110+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:21.922110+0000","last_undegraded":"2024-04-25T15:54:21.922110+0000","last_fullsized":"2024-04-25T15:54:21.922110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924928+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:21.924928+0000","last_peered":"2024-04-25T15:54:21.924928+0000","last_clean":"2024-04-25T15:54:21.924928+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:21.924928+0000","last_undegraded":"2024-04-25T15:54:21.924928+0000","last_fullsized":"2024-04-25T15:54:21.924928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":683194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":92916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":95400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:25.979 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:54:25.979 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T15:54:25.979 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T15:54:25.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T15:54:25.980 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T15:54:26.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 Processor -- start 2024-04-25T15:54:26.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 -- start start 2024-04-25T15:54:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20152980 0x7f0a200c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a20155320 0x7f0a20155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a20152d90 con 0x7f0a20074160 2024-04-25T15:54:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0a200aa290 con 0x7f0a20155320 2024-04-25T15:54:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a282d4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a201598b0 con 0x7f0a20152980 2024-04-25T15:54:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a20155320 0x7f0a20155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a20155320 0x7f0a20155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60416/0 (socket says 172.21.15.87:60416) 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 -- 172.21.15.87:0/1129789936 learned_addr learned my addr 172.21.15.87:0/1129789936 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a26871640 1 --1- 172.21.15.87:0/1129789936 >> v1:172.21.15.87:6789/0 conn(0x7f0a20074160 0x7f0a200c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59408/0 (socket says 172.21.15.87:59408) 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a26070640 1 --2- 172.21.15.87:0/1129789936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20152980 0x7f0a200c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 -- 172.21.15.87:0/1129789936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20152980 msgr2=0x7f0a200c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 --2- 172.21.15.87:0/1129789936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20152980 0x7f0a200c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 -- 172.21.15.87:0/1129789936 >> v1:172.21.15.87:6789/0 conn(0x7f0a20074160 legacy=0x7f0a200c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2506e640 1 -- 172.21.15.87:0/1129789936 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492988766 0 0) 0x7f0a20152d90 con 0x7f0a20074160 2024-04-25T15:54:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.149+0000 7f0a2586f640 1 -- 172.21.15.87:0/1129789936 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a200ca2f0 con 0x7f0a20155320 2024-04-25T15:54:26.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a2586f640 1 --2- 172.21.15.87:0/1129789936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20155320 0x7f0a20155730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009870 tx=0x7f0a1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acf25c2c0361db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a2506e640 1 -- 172.21.15.87:0/1129789936 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0b0070 con 0x7f0a20155320 2024-04-25T15:54:26.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a2506e640 1 -- 172.21.15.87:0/1129789936 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0ab600 con 0x7f0a20155320 2024-04-25T15:54:26.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a2506e640 1 -- 172.21.15.87:0/1129789936 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0ab9d0 con 0x7f0a20155320 2024-04-25T15:54:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 -- 172.21.15.87:0/1129789936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20155320 msgr2=0x7f0a20155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 --2- 172.21.15.87:0/1129789936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20155320 0x7f0a20155730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009870 tx=0x7f0a1c01c4d0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 -- 172.21.15.87:0/1129789936 shutdown_connections 2024-04-25T15:54:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 --2- 172.21.15.87:0/1129789936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20155320 0x7f0a20155730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 --2- 172.21.15.87:0/1129789936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20152980 0x7f0a200c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 -- 172.21.15.87:0/1129789936 >> 172.21.15.87:0/1129789936 conn(0x7f0a200ac550 msgr2=0x7f0a200ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 -- 172.21.15.87:0/1129789936 shutdown_connections 2024-04-25T15:54:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 -- 172.21.15.87:0/1129789936 wait complete. 2024-04-25T15:54:26.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 Processor -- start 2024-04-25T15:54:26.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.153+0000 7f0a282d4640 1 -- start start 2024-04-25T15:54:26.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a20074160 0x7f0a2014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 0x7f0a200bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20155320 0x7f0a2014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20158f70 con 0x7f0a20152980 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a20158c90 con 0x7f0a20074160 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a200729c0 con 0x7f0a20155320 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 0x7f0a200bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 0x7f0a200bfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60422/0 (socket says 172.21.15.87:60422) 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 -- 172.21.15.87:0/2250418441 learned_addr learned my addr 172.21.15.87:0/2250418441 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a26871640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20155320 0x7f0a2014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a26070640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a20074160 0x7f0a2014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 -- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20155320 msgr2=0x7f0a2014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20155320 0x7f0a2014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 -- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a20074160 msgr2=0x7f0a2014bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a20074160 0x7f0a2014bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 -- 172.21.15.87:0/2250418441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2014c730 con 0x7f0a20152980 2024-04-25T15:54:26.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a2586f640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 0x7f0a200bfe90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c01ab80 tx=0x7f0a1c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0b0040 con 0x7f0a20152980 2024-04-25T15:54:26.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0ab400 con 0x7f0a20152980 2024-04-25T15:54:26.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a201f3090 con 0x7f0a20152980 2024-04-25T15:54:26.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0b6620 con 0x7f0a20152980 2024-04-25T15:54:26.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a201f25b0 con 0x7f0a20152980 2024-04-25T15:54:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a20069bb0 con 0x7f0a20152980 2024-04-25T15:54:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.157+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0a1c0be020 con 0x7f0a20152980 2024-04-25T15:54:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.161+0000 7f0a16ffd640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0a0406f400 0x7f0a04071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.161+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0a1c129260 con 0x7f0a20152980 2024-04-25T15:54:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.161+0000 7f0a26070640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0a0406f400 0x7f0a04071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.161+0000 7f0a26070640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0a0406f400 0x7f0a04071910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000b930 tx=0x7f0a10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.165+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a1c016150 con 0x7f0a20152980 2024-04-25T15:54:26.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.353+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0a200c9b90 con 0x7f0a20152980 2024-04-25T15:54:26.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a16ffd640 1 -- 172.21.15.87:0/2250418441 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179544 (secure 0 0 0) 0x7f0a1c0f5eb0 con 0x7f0a20152980 2024-04-25T15:54:26.362 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:26.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0a0406f400 msgr2=0x7f0a04071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0a0406f400 0x7f0a04071910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000b930 tx=0x7f0a10008040 comp rx=0 tx=0).stop 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 msgr2=0x7f0a200bfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 0x7f0a200bfe90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c01ab80 tx=0x7f0a1c019270 comp rx=0 tx=0).stop 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 shutdown_connections 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0a0406f400 0x7f0a04071910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a20155320 0x7f0a2014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a20152980 0x7f0a200bfe90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 --2- 172.21.15.87:0/2250418441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a20074160 0x7f0a2014bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 >> 172.21.15.87:0/2250418441 conn(0x7f0a200ac550 msgr2=0x7f0a200abe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 shutdown_connections 2024-04-25T15:54:26.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.361+0000 7f0a282d4640 1 -- 172.21.15.87:0/2250418441 wait complete. 2024-04-25T15:54:26.381 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2795128651},{"type":"v1","addr":"172.21.15.87:6833","nonce":2795128651}]},"active_addr":"172.21.15.87:6833/2795128651","active_change":"2024-04-25T15:53:49.087682+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1884775537}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":701761541}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3917257036}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3197331349}]}]} 2024-04-25T15:54:26.385 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T15:54:26.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T15:54:26.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:26.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 Processor -- start 2024-04-25T15:54:26.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 -- start start 2024-04-25T15:54:26.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d700c4250 0x7f2d7006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d70070490 0x7f2d7015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d700c5120 con 0x7f2d7015b170 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2d700c3b20 con 0x7f2d70070490 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7766f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2d70070e20 con 0x7f2d700c4250 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d70070490 0x7f2d7015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d70070490 0x7f2d7015ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60432/0 (socket says 172.21.15.87:60432) 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 -- 172.21.15.87:0/1391358724 learned_addr learned my addr 172.21.15.87:0/1391358724 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 -- 172.21.15.87:0/1391358724 >> v2:172.21.15.155:3300/0 conn(0x7f2d700c4250 msgr2=0x7f2d7006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d7540b640 1 --2- 172.21.15.87:0/1391358724 >> v2:172.21.15.155:3300/0 conn(0x7f2d700c4250 0x7f2d7006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 --2- 172.21.15.87:0/1391358724 >> v2:172.21.15.155:3300/0 conn(0x7f2d700c4250 0x7f2d7006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 -- 172.21.15.87:0/1391358724 >> v1:172.21.15.155:6789/0 conn(0x7f2d7015b170 legacy=0x7f2d700c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:26.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.521+0000 7f2d74c0a640 1 -- 172.21.15.87:0/1391358724 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d700c4b60 con 0x7f2d70070490 2024-04-25T15:54:26.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d74c0a640 1 --2- 172.21.15.87:0/1391358724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70070490 0x7f2d7015ac30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2d700c9570 tx=0x7f2d6c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cb0ad5553dbdbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d67fff640 1 -- 172.21.15.87:0/1391358724 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0b0070 con 0x7f2d70070490 2024-04-25T15:54:26.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d67fff640 1 -- 172.21.15.87:0/1391358724 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c0ab600 con 0x7f2d70070490 2024-04-25T15:54:26.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d67fff640 1 -- 172.21.15.87:0/1391358724 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0ab9d0 con 0x7f2d70070490 2024-04-25T15:54:26.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 -- 172.21.15.87:0/1391358724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70070490 msgr2=0x7f2d7015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 --2- 172.21.15.87:0/1391358724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70070490 0x7f2d7015ac30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2d700c9570 tx=0x7f2d6c01c240 comp rx=0 tx=0).stop 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 -- 172.21.15.87:0/1391358724 shutdown_connections 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 --2- 172.21.15.87:0/1391358724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d70070490 0x7f2d7015ac30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 --2- 172.21.15.87:0/1391358724 >> v2:172.21.15.155:3300/0 conn(0x7f2d700c4250 0x7f2d7006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 -- 172.21.15.87:0/1391358724 >> 172.21.15.87:0/1391358724 conn(0x7f2d7006d780 msgr2=0x7f2d7006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 -- 172.21.15.87:0/1391358724 shutdown_connections 2024-04-25T15:54:26.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 -- 172.21.15.87:0/1391358724 wait complete. 2024-04-25T15:54:26.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 Processor -- start 2024-04-25T15:54:26.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 -- start start 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.525+0000 7f2d7766f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d70070490 0x7f2d7014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d700c4250 0x7f2d701f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 0x7f2d70161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70155280 con 0x7f2d7015b170 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d70155100 con 0x7f2d700c4250 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d70164e80 con 0x7f2d70070490 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 0x7f2d70161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 0x7f2d70161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60434/0 (socket says 172.21.15.87:60434) 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 -- 172.21.15.87:0/865990779 learned_addr learned my addr 172.21.15.87:0/865990779 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:26.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 -- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d70070490 msgr2=0x7f2d7014e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d70070490 0x7f2d7014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d74c0a640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d700c4250 0x7f2d701f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 -- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d700c4250 msgr2=0x7f2d701f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d700c4250 0x7f2d701f4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 -- 172.21.15.87:0/865990779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d701554a0 con 0x7f2d7015b170 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d75c0c640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 0x7f2d70161230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b990 tx=0x7f2d6800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68019070 con 0x7f2d7015b170 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6800cba0 con 0x7f2d7015b170 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d701f5050 con 0x7f2d7015b170 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68014440 con 0x7f2d7015b170 2024-04-25T15:54:26.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d70157aa0 con 0x7f2d7015b170 2024-04-25T15:54:26.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d70069bb0 con 0x7f2d7015b170 2024-04-25T15:54:26.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d6801c070 con 0x7f2d7015b170 2024-04-25T15:54:26.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d65ffb640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5406f430 0x7f2d54071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2d6808f2b0 con 0x7f2d7015b170 2024-04-25T15:54:26.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7540b640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5406f430 0x7f2d54071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.529+0000 7f2d7540b640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5406f430 0x7f2d54071940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d700721c0 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.533+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d6805bf00 con 0x7f2d7015b170 2024-04-25T15:54:26.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.685+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d700c3540 con 0x7f2d7015b170 2024-04-25T15:54:26.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.685+0000 7f2d65ffb640 1 -- 172.21.15.87:0/865990779 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f2d6805b800 con 0x7f2d7015b170 2024-04-25T15:54:26.686 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:26.686 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5406f430 msgr2=0x7f2d54071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5406f430 0x7f2d54071940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d700721c0 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 msgr2=0x7f2d70161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 0x7f2d70161230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b990 tx=0x7f2d6800be50 comp rx=0 tx=0).stop 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 shutdown_connections 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5406f430 0x7f2d54071940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d7015b170 0x7f2d70161230 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d700c4250 0x7f2d701f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 --2- 172.21.15.87:0/865990779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d70070490 0x7f2d7014e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 >> 172.21.15.87:0/865990779 conn(0x7f2d7006d780 msgr2=0x7f2d700c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 shutdown_connections 2024-04-25T15:54:26.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.689+0000 7f2d7766f640 1 -- 172.21.15.87:0/865990779 wait complete. 2024-04-25T15:54:26.707 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T15:54:26.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:26.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 Processor -- start 2024-04-25T15:54:26.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 -- start start 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40c40cb030 0x7f40c415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40c4160230 0x7f40c4162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c40c7570 con 0x7f40c415ad90 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f40c415b8b0 con 0x7f40c40cb030 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40ca0aa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f40c415b5d0 con 0x7f40c4160230 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40c40cb030 0x7f40c415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40c40cb030 0x7f40c415fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60446/0 (socket says 172.21.15.87:60446) 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f40c415ad90 0x7f40c40ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59424/0 (socket says 172.21.15.87:59424) 2024-04-25T15:54:26.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 -- 172.21.15.87:0/208012918 learned_addr learned my addr 172.21.15.87:0/208012918 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c3fff640 1 --2- 172.21.15.87:0/208012918 >> v2:172.21.15.155:3300/0 conn(0x7f40c4160230 0x7f40c4162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 -- 172.21.15.87:0/208012918 >> v2:172.21.15.155:3300/0 conn(0x7f40c4160230 msgr2=0x7f40c4162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 --2- 172.21.15.87:0/208012918 >> v2:172.21.15.155:3300/0 conn(0x7f40c4160230 0x7f40c4162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 -- 172.21.15.87:0/208012918 >> v1:172.21.15.87:6789/0 conn(0x7f40c415ad90 legacy=0x7f40c40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.849+0000 7f40c2ffd640 1 -- 172.21.15.87:0/208012918 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c40c2290 con 0x7f40c40cb030 2024-04-25T15:54:26.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40c2ffd640 1 --2- 172.21.15.87:0/208012918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c415fcf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40c40c7470 tx=0x7f40b801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f439c8602a4220b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40c27fc640 1 -- 172.21.15.87:0/208012918 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80b0070 con 0x7f40c40cb030 2024-04-25T15:54:26.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40c27fc640 1 -- 172.21.15.87:0/208012918 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b80ab600 con 0x7f40c40cb030 2024-04-25T15:54:26.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40c27fc640 1 -- 172.21.15.87:0/208012918 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80ab9d0 con 0x7f40c40cb030 2024-04-25T15:54:26.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 -- 172.21.15.87:0/208012918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 msgr2=0x7f40c415fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/208012918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c415fcf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40c40c7470 tx=0x7f40b801c400 comp rx=0 tx=0).stop 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 -- 172.21.15.87:0/208012918 shutdown_connections 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/208012918 >> v2:172.21.15.155:3300/0 conn(0x7f40c4160230 0x7f40c4162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/208012918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c415fcf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 -- 172.21.15.87:0/208012918 >> 172.21.15.87:0/208012918 conn(0x7f40c40c9330 msgr2=0x7f40c40c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 -- 172.21.15.87:0/208012918 shutdown_connections 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 -- 172.21.15.87:0/208012918 wait complete. 2024-04-25T15:54:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 Processor -- start 2024-04-25T15:54:26.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.853+0000 7f40ca0aa640 1 -- start start 2024-04-25T15:54:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c40af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40c415ad90 0x7f40c40ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40c4160230 0x7f40c4149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f40c415b1a0 con 0x7f40c40cb030 2024-04-25T15:54:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40c40ca190 con 0x7f40c415ad90 2024-04-25T15:54:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f40c415b320 con 0x7f40c4160230 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c40af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c40af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60456/0 (socket says 172.21.15.87:60456) 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 -- 172.21.15.87:0/269876691 learned_addr learned my addr 172.21.15.87:0/269876691 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 -- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40c4160230 msgr2=0x7f40c4149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40c4160230 0x7f40c4149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 -- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40c415ad90 msgr2=0x7f40c40ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c2ffd640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40c415ad90 0x7f40c40ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40c415ad90 0x7f40c40ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 -- 172.21.15.87:0/269876691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c4153970 con 0x7f40c40cb030 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c37fe640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c40af690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c7b0 tx=0x7f40bc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc017070 con 0x7f40c40cb030 2024-04-25T15:54:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40bc00a640 con 0x7f40c40cb030 2024-04-25T15:54:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00a9f0 con 0x7f40c40cb030 2024-04-25T15:54:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c4161c10 con 0x7f40c40cb030 2024-04-25T15:54:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c41621d0 con 0x7f40c40cb030 2024-04-25T15:54:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c4069bb0 con 0x7f40c40cb030 2024-04-25T15:54:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f40bc01a070 con 0x7f40c40cb030 2024-04-25T15:54:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40abfff640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40b006f400 0x7f40b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40c2ffd640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40b006f400 0x7f40b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.857+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f40bc08eb90 con 0x7f40c40cb030 2024-04-25T15:54:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.861+0000 7f40c2ffd640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40b006f400 0x7f40b0071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40b80ad000 tx=0x7f40b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:26.865+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f40bc05b100 con 0x7f40c40cb030 2024-04-25T15:54:27.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.013+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40c4152010 con 0x7f40c40cb030 2024-04-25T15:54:27.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40abfff640 1 -- 172.21.15.87:0/269876691 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f40bc08e030 con 0x7f40c40cb030 2024-04-25T15:54:27.017 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:27.017 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:27.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40b006f400 msgr2=0x7f40b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40b006f400 0x7f40b0071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40b80ad000 tx=0x7f40b8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 msgr2=0x7f40c40af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c40af690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c7b0 tx=0x7f40bc00cc70 comp rx=0 tx=0).stop 2024-04-25T15:54:27.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 shutdown_connections 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40b006f400 0x7f40b0071910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40c4160230 0x7f40c4149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40c415ad90 0x7f40c40ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 --2- 172.21.15.87:0/269876691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c40cb030 0x7f40c40af690 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 >> 172.21.15.87:0/269876691 conn(0x7f40c40c9330 msgr2=0x7f40c41525f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 shutdown_connections 2024-04-25T15:54:27.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.017+0000 7f40ca0aa640 1 -- 172.21.15.87:0/269876691 wait complete. 2024-04-25T15:54:27.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T15:54:27.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T15:54:27.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T15:54:27.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T15:54:27.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T15:54:27.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T15:54:27.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T15:54:27.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T15:54:27.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.257+0000 7f31b87bd640 1 Processor -- start 2024-04-25T15:54:27.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.257+0000 7f31b87bd640 1 -- start start 2024-04-25T15:54:27.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fac8eb640 1 Processor -- start 2024-04-25T15:54:27.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fac8eb640 1 -- start start 2024-04-25T15:54:27.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500759e640 1 Processor -- start 2024-04-25T15:54:27.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b87bd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f31b00a7230 0x7f31b015b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b87bd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31b0164010 0x7f31b0166430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b87bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b00c3150 con 0x7f31b006e870 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b87bd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f31b015bcc0 con 0x7f31b0164010 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b87bd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f31b00c2f00 con 0x7f31b00a7230 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31b0164010 0x7f31b0166430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31b0164010 0x7f31b0166430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60460/0 (socket says 172.21.15.87:60460) 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 -- 172.21.15.87:0/3355174669 learned_addr learned my addr 172.21.15.87:0/3355174669 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500759e640 1 -- start start 2024-04-25T15:54:27.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6559640 1 --2- 172.21.15.87:0/3355174669 >> v2:172.21.15.155:3300/0 conn(0x7f31b00a7230 0x7f31b015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 -- 172.21.15.87:0/3355174669 >> v2:172.21.15.155:3300/0 conn(0x7f31b00a7230 msgr2=0x7f31b015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 --2- 172.21.15.87:0/3355174669 >> v2:172.21.15.155:3300/0 conn(0x7f31b00a7230 0x7f31b015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 -- 172.21.15.87:0/3355174669 >> v1:172.21.15.155:6789/0 conn(0x7f31b006e870 legacy=0x7f31b00c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f31b6d5a640 1 -- 172.21.15.87:0/3355174669 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b00a7ea0 con 0x7f31b0164010 2024-04-25T15:54:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fac8eb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3fa0047db0 0x7f3fa00dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fac8eb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa000b5b0 con 0x7f3fa0046390 2024-04-25T15:54:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fac8eb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa000bbf0 con 0x7f3fa003e9e0 2024-04-25T15:54:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fac8eb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa000b9a0 con 0x7f3fa0047db0 2024-04-25T15:54:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7fe09ffff640 1 Processor -- start 2024-04-25T15:54:27.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3fa0046390 0x7f3fa0049910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59440/0 (socket says 172.21.15.87:59440) 2024-04-25T15:54:27.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa77fe640 1 -- 172.21.15.87:0/4042347373 learned_addr learned my addr 172.21.15.87:0/4042347373 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f553b04a640 1 Processor -- start 2024-04-25T15:54:27.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329340557 0 0) 0x7f3fa000b5b0 con 0x7f3fa0046390 2024-04-25T15:54:27.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f98003530 con 0x7f3fa0046390 2024-04-25T15:54:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500759e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f500815bb10 0x7f500815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500759e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500815f840 con 0x7f50080a7390 2024-04-25T15:54:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500759e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500815fac0 con 0x7f500815c460 2024-04-25T15:54:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500759e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f500815fda0 con 0x7f500815bb10 2024-04-25T15:54:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500659c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f50080a7390 0x7f50080c51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59444/0 (socket says 172.21.15.87:59444) 2024-04-25T15:54:27.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f500659c640 1 -- 172.21.15.87:0/2790268294 learned_addr learned my addr 172.21.15.87:0/2790268294 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1631587028 0 0) 0x7f3f98003530 con 0x7f3fa0046390 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 >> v2:172.21.15.155:3300/0 conn(0x7f3fa0047db0 msgr2=0x7f3fa00dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 --2- 172.21.15.87:0/4042347373 >> v2:172.21.15.155:3300/0 conn(0x7f3fa0047db0 0x7f3fa00dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 >> v1:172.21.15.155:6789/0 conn(0x7f3fa003e9e0 legacy=0x7f3fa00e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa0007570 con 0x7f3fa0046390 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f3f9c001680 con 0x7f3fa0046390 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 >> v1:172.21.15.87:6789/0 conn(0x7f3fa0046390 legacy=0x7f3fa0049910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f980039c0 0x7f3f98003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f98004810 0x7f3f98004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980099c0 0x7f3f9800bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa000b9a0 con 0x7f3f98004810 2024-04-25T15:54:27.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9800c400 con 0x7f3f980099c0 2024-04-25T15:54:27.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9800c600 con 0x7f3f980039c0 2024-04-25T15:54:27.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f5005d9b640 1 --2- 172.21.15.87:0/2790268294 >> v2:172.21.15.155:3300/0 conn(0x7f500815bb10 0x7f500815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f553b04a640 1 -- start start 2024-04-25T15:54:27.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7f2d7b86b640 1 Processor -- start 2024-04-25T15:54:27.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.261+0000 7fe09ffff640 1 -- start start 2024-04-25T15:54:27.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536698514 0 0) 0x7f4ff8001120 con 0x7f50080a7390 2024-04-25T15:54:27.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff0003530 con 0x7f50080a7390 2024-04-25T15:54:27.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa77fe640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f980039c0 0x7f3f98003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa6ffd640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f98004810 0x7f3f98004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187216401 0 0) 0x7f500815fac0 con 0x7f500815c460 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff8001120 con 0x7f500815c460 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5005d9b640 1 -- 172.21.15.87:0/2790268294 >> v1:172.21.15.155:6789/0 conn(0x7f500815c460 legacy=0x7f50081661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5005d9b640 1 -- 172.21.15.87:0/2790268294 >> v1:172.21.15.87:6789/0 conn(0x7f50080a7390 legacy=0x7f50080c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5005d9b640 1 -- 172.21.15.87:0/2790268294 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50080c4470 con 0x7f500815bb10 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa7fff640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980099c0 0x7f3f9800bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe098043140 0x7fe09804e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe09804ecc0 0x7fe0980e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09ffff640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09804f0d0 con 0x7fe098033080 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09ffff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe09804f8d0 con 0x7fe09804ecc0 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09ffff640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe09804af30 con 0x7fe098043140 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa77fe640 1 -- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980099c0 msgr2=0x7f3f9800bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa77fe640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980099c0 0x7f3f9800bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa77fe640 1 -- 172.21.15.87:0/4042347373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f98004810 msgr2=0x7f3f98004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa77fe640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f98004810 0x7f3f98004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa77fe640 1 -- 172.21.15.87:0/4042347373 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa0007570 con 0x7f3f980039c0 2024-04-25T15:54:27.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f31b6d5a640 1 --2- 172.21.15.87:0/3355174669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0164010 0x7f31b0166430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31b00714c0 tx=0x7f31a001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3323a14403d32169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe09804ecc0 0x7fe0980e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe09804ecc0 0x7fe0980e2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60478/0 (socket says 172.21.15.87:60478) 2024-04-25T15:54:27.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 -- 172.21.15.87:0/3554566575 learned_addr learned my addr 172.21.15.87:0/3554566575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09e7fc640 1 --2- 172.21.15.87:0/3554566575 >> v2:172.21.15.155:3300/0 conn(0x7fe098043140 0x7fe09804e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d7b86b640 1 -- start start 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d7b86b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 0x7f2d6c047db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d7b86b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d6c03e9e0 0x7f2d6c03edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d7b86b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d6c00b5b0 con 0x7f2d6c049910 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d7b86b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c0482f0 con 0x7f2d6c03e9e0 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d7b86b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c00b9a0 con 0x7f2d6c046390 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d79607640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 0x7f2d6c047db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d79607640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 0x7f2d6c047db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47002/0 (socket says 172.21.15.87:47002) 2024-04-25T15:54:27.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f2d79607640 1 -- 172.21.15.87:0/662080731 learned_addr learned my addr 172.21.15.87:0/662080731 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 -- 172.21.15.87:0/3554566575 >> v2:172.21.15.155:3300/0 conn(0x7fe098043140 msgr2=0x7fe09804e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 --2- 172.21.15.87:0/3554566575 >> v2:172.21.15.155:3300/0 conn(0x7fe098043140 0x7fe09804e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 -- 172.21.15.87:0/3554566575 >> v1:172.21.15.155:6789/0 conn(0x7fe098033080 legacy=0x7fe0980073c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:54:27.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7fe09f7fe640 1 -- 172.21.15.87:0/3554566575 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09804b210 con 0x7fe09804ecc0 2024-04-25T15:54:27.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f553b04a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5534150c40 0x7f553406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f31b5557640 1 -- 172.21.15.87:0/3355174669 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00b0070 con 0x7f31b0164010 2024-04-25T15:54:27.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5eace7f640 1 Processor -- start 2024-04-25T15:54:27.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5eace7f640 1 -- start start 2024-04-25T15:54:27.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f3fa7fff640 1 -- 172.21.15.87:0/4042347373 reap_dead start 2024-04-25T15:54:27.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f553b04a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55340c5270 0x7f553406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f553b04a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553406fa30 con 0x7f55340c3340 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5533fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f55340c3340 0x7f55340c4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:51162/0 (socket says 172.21.15.87:51162) 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f5533fff640 1 -- 172.21.15.87:0/1969941755 learned_addr learned my addr 172.21.15.87:0/1969941755 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55340a7cb0 con 0x7f5534150c40 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f553406fcd0 con 0x7f55340c5270 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f55395e7640 1 --2- 172.21.15.87:0/1969941755 >> v2:172.21.15.155:3300/0 conn(0x7f55340c5270 0x7f553406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaeddc640 1 Processor -- start 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaeddc640 1 -- start start 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaeddc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4ea0046540 0x7f4ea0046950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaeddc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea0007540 con 0x7f4ea0046e90 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaeddc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea004b320 con 0x7f4ea00309c0 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaeddc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea0030dd0 con 0x7f4ea0046540 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaddda640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4ea00309c0 0x7f4ea000b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:51154/0 (socket says 172.21.15.87:51154) 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f4eaddda640 1 -- 172.21.15.87:0/4293401851 learned_addr learned my addr 172.21.15.87:0/4293401851 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f31b5557640 1 -- 172.21.15.87:0/3355174669 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a00a4e50 con 0x7f31b0164010 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.265+0000 7f31b5557640 1 -- 172.21.15.87:0/3355174669 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00ab820 con 0x7f31b0164010 2024-04-25T15:54:27.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998118608 0 0) 0x7f553406fa30 con 0x7f55340c3340 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f551c003530 con 0x7f55340c3340 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5538de6640 1 --2- 172.21.15.87:0/1969941755 >> v2:172.21.15.87:3300/0 conn(0x7f5534150c40 0x7f553406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4ead5d9640 1 --2- 172.21.15.87:0/4293401851 >> v2:172.21.15.87:3300/0 conn(0x7f4ea0046540 0x7f4ea0046950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272253311 0 0) 0x7f4ea004b320 con 0x7f4ea00309c0 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e94003530 con 0x7f4ea00309c0 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 -- 172.21.15.87:0/3355174669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0164010 msgr2=0x7f31b0166430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3355174669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0164010 0x7f31b0166430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31b00714c0 tx=0x7f31a001c3c0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5005d9b640 1 --2- 172.21.15.87:0/2790268294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500815bb10 0x7f500815bf20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0097c0 tx=0x7f4ffc01c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42bd67123681598 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 -- 172.21.15.87:0/3355174669 shutdown_connections 2024-04-25T15:54:27.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3355174669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0164010 0x7f31b0166430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3355174669 >> v2:172.21.15.155:3300/0 conn(0x7f31b00a7230 0x7f31b015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 -- 172.21.15.87:0/3355174669 >> 172.21.15.87:0/3355174669 conn(0x7f31b00c8b30 msgr2=0x7f31b00aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159444940 0 0) 0x7f4ea0007540 con 0x7f4ea0046e90 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 -- 172.21.15.87:0/3355174669 shutdown_connections 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879839004 0 0) 0x7f551c003530 con 0x7f55340c3340 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 >> v2:172.21.15.155:3300/0 conn(0x7f55340c5270 msgr2=0x7f553406f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 --2- 172.21.15.87:0/1969941755 >> v2:172.21.15.155:3300/0 conn(0x7f55340c5270 0x7f553406f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 >> v2:172.21.15.87:3300/0 conn(0x7f5534150c40 msgr2=0x7f553406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 --2- 172.21.15.87:0/1969941755 >> v2:172.21.15.87:3300/0 conn(0x7f5534150c40 0x7f553406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534153f10 con 0x7f55340c3340 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f552c001a20 con 0x7f55340c3340 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 >> v1:172.21.15.155:6789/0 conn(0x7f55340c3340 legacy=0x7f55340c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea004b320 con 0x7f4ea0046e90 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551c0039c0 0x7f551c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f551c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f551c005160 0x7f551c0145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55340a7cb0 con 0x7f551c004810 2024-04-25T15:54:27.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f553406fcd0 con 0x7f551c005160 2024-04-25T15:54:27.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f551c014b10 con 0x7f551c0039c0 2024-04-25T15:54:27.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 -- 172.21.15.87:0/3355174669 wait complete. 2024-04-25T15:54:27.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fa77fe640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f980039c0 0x7f3f98003e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00c290 tx=0x7f3f9c01cd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=773c49c9d13174f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4ead5d9640 1 -- 172.21.15.87:0/4293401851 >> v1:172.21.15.155:6789/0 conn(0x7f4ea00309c0 legacy=0x7f4ea000b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4ead5d9640 1 -- 172.21.15.87:0/4293401851 >> v1:172.21.15.87:6789/0 conn(0x7f4ea0046e90 legacy=0x7f4ea00e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f4ead5d9640 1 -- 172.21.15.87:0/4293401851 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea00d77b0 con 0x7f4ea0046540 2024-04-25T15:54:27.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5eace7f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5ea815b750 0x7f5ea8063090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5533fff640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f551c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5eace7f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ea80635d0 0x7f5ea81660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5eace7f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea80c4150 con 0x7f5ea806da20 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5eace7f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea815f0b0 con 0x7f5ea80635d0 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5eace7f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea815bb60 con 0x7f5ea815b750 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ea80635d0 0x7f5ea81660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ea80635d0 0x7f5ea81660d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60508/0 (socket says 172.21.15.87:60508) 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 -- 172.21.15.87:0/434007367 learned_addr learned my addr 172.21.15.87:0/434007367 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea6ffd640 1 --2- 172.21.15.87:0/434007367 >> v2:172.21.15.155:3300/0 conn(0x7f5ea815b750 0x7f5ea8063090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f2d79607640 1 -- 172.21.15.87:0/662080731 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c03e9e0 msgr2=0x7f2d6c03edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f2d79607640 1 --2- 172.21.15.87:0/662080731 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c03e9e0 0x7f2d6c03edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f2d79607640 1 -- 172.21.15.87:0/662080731 >> v1:172.21.15.155:6789/0 conn(0x7f2d6c049910 legacy=0x7f2d6c0dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f2d79607640 1 -- 172.21.15.87:0/662080731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c00bbf0 con 0x7f2d6c046390 2024-04-25T15:54:27.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c007d60 con 0x7f3f980039c0 2024-04-25T15:54:27.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5538de6640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551c0039c0 0x7f551c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0b0070 con 0x7f500815bb10 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0ab600 con 0x7f500815bb10 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500559a640 1 -- 172.21.15.87:0/2790268294 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0ab9d0 con 0x7f500815bb10 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 -- 172.21.15.87:0/2790268294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500815bb10 msgr2=0x7f500815bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 --2- 172.21.15.87:0/2790268294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500815bb10 0x7f500815bf20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0097c0 tx=0x7f4ffc01c340 comp rx=0 tx=0).stop 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 -- 172.21.15.87:0/2790268294 shutdown_connections 2024-04-25T15:54:27.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 --2- 172.21.15.87:0/2790268294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f500815bb10 0x7f500815bf20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 -- 172.21.15.87:0/2790268294 >> 172.21.15.87:0/2790268294 conn(0x7f50080c8890 msgr2=0x7f50080c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0a9070 con 0x7f3f980039c0 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fa67fc640 1 -- 172.21.15.87:0/4042347373 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c005d40 con 0x7f3f980039c0 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f55395e7640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f551c005160 0x7f551c0145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5533fff640 1 -- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551c0039c0 msgr2=0x7f551c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5533fff640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551c0039c0 0x7f551c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5533fff640 1 -- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f551c005160 msgr2=0x7f551c0145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5533fff640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f551c005160 0x7f551c0145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5533fff640 1 -- 172.21.15.87:0/1969941755 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534153f10 con 0x7f551c004810 2024-04-25T15:54:27.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7fe09f7fe640 1 --2- 172.21.15.87:0/3554566575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe09804ecc0 0x7fe0980e2d20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0075720 tx=0x7fe0a0099a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbcdc5c895c5c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 -- 172.21.15.87:0/2790268294 shutdown_connections 2024-04-25T15:54:27.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f980039c0 msgr2=0x7f3f98003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f980039c0 0x7f3f98003e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00c290 tx=0x7f3f9c01cd40 comp rx=0 tx=0).stop 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7fe09dffb640 1 -- 172.21.15.87:0/3554566575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0121db0 con 0x7fe09804ecc0 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7fe09dffb640 1 -- 172.21.15.87:0/3554566575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a0129440 con 0x7fe09804ecc0 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7fe09dffb640 1 -- 172.21.15.87:0/3554566575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a01298b0 con 0x7fe09804ecc0 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4042347373 shutdown_connections 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 --2- 172.21.15.87:0/4042347373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f980039c0 0x7f3f98003e10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4042347373 >> 172.21.15.87:0/4042347373 conn(0x7f3fa00060a0 msgr2=0x7f3fa00064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 Processor -- start 2024-04-25T15:54:27.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f2d79607640 1 --2- 172.21.15.87:0/662080731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 0x7f2d6c047db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d7406b820 tx=0x7f2d74099400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaef097ebaf73697 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4042347373 shutdown_connections 2024-04-25T15:54:27.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f500759e640 1 -- 172.21.15.87:0/2790268294 wait complete. 2024-04-25T15:54:27.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4042347373 wait complete. 2024-04-25T15:54:27.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f31b87bd640 1 -- start start 2024-04-25T15:54:27.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 -- 172.21.15.87:0/3554566575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe09804ecc0 msgr2=0x7fe0980e2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 --2- 172.21.15.87:0/3554566575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe09804ecc0 0x7fe0980e2d20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0075720 tx=0x7fe0a0099a60 comp rx=0 tx=0).stop 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 -- 172.21.15.87:0/3554566575 shutdown_connections 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 --2- 172.21.15.87:0/3554566575 >> v2:172.21.15.155:3300/0 conn(0x7fe098043140 0x7fe09804e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 --2- 172.21.15.87:0/3554566575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe09804ecc0 0x7fe0980e2d20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 -- 172.21.15.87:0/3554566575 >> 172.21.15.87:0/3554566575 conn(0x7fe09804c8b0 msgr2=0x7fe09804ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 -- 172.21.15.87:0/3554566575 shutdown_connections 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d6bfff640 1 -- 172.21.15.87:0/662080731 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74129440 con 0x7f2d6c046390 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d6bfff640 1 -- 172.21.15.87:0/662080731 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74129620 con 0x7f2d6c046390 2024-04-25T15:54:27.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d6bfff640 1 -- 172.21.15.87:0/662080731 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74129a90 con 0x7f2d6c046390 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f55395e7640 1 -- 172.21.15.87:0/1969941755 reap_dead start 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 Processor -- start 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b006e870 0x7f31b01f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00a7230 0x7f31b015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00a7230 0x7f31b015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00a7230 0x7f31b015a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60522/0 (socket says 172.21.15.87:60522) 2024-04-25T15:54:27.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 -- 172.21.15.87:0/3796617244 learned_addr learned my addr 172.21.15.87:0/3796617244 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b6559640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b006e870 0x7f31b01f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b0164010 0x7f31b01f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31b006e3e0 con 0x7f31b00a7230 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31b00a7910 con 0x7f31b0164010 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f31b006ec80 con 0x7f31b006e870 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 -- 172.21.15.87:0/662080731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 msgr2=0x7f2d6c047db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 --2- 172.21.15.87:0/662080731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 0x7f2d6c047db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d7406b820 tx=0x7f2d74099400 comp rx=0 tx=0).stop 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 -- 172.21.15.87:0/662080731 shutdown_connections 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 --2- 172.21.15.87:0/662080731 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c03e9e0 0x7f2d6c03edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 --2- 172.21.15.87:0/662080731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c046390 0x7f2d6c047db0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d7406b820 tx=0x7f2d74099400 comp rx=0 tx=0).stop 2024-04-25T15:54:27.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 -- 172.21.15.87:0/662080731 >> 172.21.15.87:0/662080731 conn(0x7f2d6c0060a0 msgr2=0x7f2d6c0064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b6d5a640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b0164010 0x7f31b01f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 -- 172.21.15.87:0/434007367 >> v2:172.21.15.155:3300/0 conn(0x7f5ea815b750 msgr2=0x7f5ea8063090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 --2- 172.21.15.87:0/434007367 >> v2:172.21.15.155:3300/0 conn(0x7f5ea815b750 0x7f5ea8063090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 -- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b006e870 msgr2=0x7f31b01f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b006e870 0x7f31b01f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 -- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b0164010 msgr2=0x7f31b01f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b0164010 0x7f31b01f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b01f7dc0 con 0x7f31b00a7230 2024-04-25T15:54:27.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 -- 172.21.15.87:0/434007367 >> v1:172.21.15.155:6789/0 conn(0x7f5ea806da20 legacy=0x7f5ea815f540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:54:27.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.269+0000 7f5ea7fff640 1 -- 172.21.15.87:0/434007367 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea80c4430 con 0x7f5ea80635d0 2024-04-25T15:54:27.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 -- 172.21.15.87:0/3554566575 wait complete. 2024-04-25T15:54:27.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f3fac8eb640 1 Processor -- start 2024-04-25T15:54:27.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b5d58640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00a7230 0x7f31b015a120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31a800ba80 tx=0x7f31a800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a800cc00 con 0x7f31b00a7230 2024-04-25T15:54:27.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b015c9d0 con 0x7f31b00a7230 2024-04-25T15:54:27.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b015cf90 con 0x7f31b00a7230 2024-04-25T15:54:27.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a800cda0 con 0x7f31b00a7230 2024-04-25T15:54:27.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8022060 con 0x7f31b00a7230 2024-04-25T15:54:27.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 Processor -- start 2024-04-25T15:54:27.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f3fac8eb640 1 -- start start 2024-04-25T15:54:27.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 -- start start 2024-04-25T15:54:27.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50080a7390 0x7f5008151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500815bb10 0x7f500814bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f500815c460 0x7f500814c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f5533fff640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f551c004c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5534157aa0 tx=0x7f552c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdb583fb593c5f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f5ea7fff640 1 --2- 172.21.15.87:0/434007367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80635d0 0x7f5ea81660d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8072330 tx=0x7f5ea001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4aa9e9b68bb29e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50080c47e0 con 0x7f500815c460 2024-04-25T15:54:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50080a7390 0x7f5008151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31b00add40 con 0x7f31b00a7230 2024-04-25T15:54:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50080c3aa0 con 0x7f50080a7390 2024-04-25T15:54:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c00a500 con 0x7f551c004810 2024-04-25T15:54:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0ad630 con 0x7f551c004810 2024-04-25T15:54:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f55337fe640 1 -- 172.21.15.87:0/1969941755 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c0ada40 con 0x7f551c004810 2024-04-25T15:54:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f500816a500 con 0x7f500815bb10 2024-04-25T15:54:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50080a7390 0x7f5008151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:56824/0 (socket says 172.21.15.87:56824) 2024-04-25T15:54:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f500659c640 1 -- 172.21.15.87:0/448331330 learned_addr learned my addr 172.21.15.87:0/448331330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f5005d9b640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500815bb10 0x7f500814bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f2d7b86b640 1 -- 172.21.15.87:0/662080731 shutdown_connections 2024-04-25T15:54:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7f5006d9d640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f500815c460 0x7f500814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.273+0000 7fe09ffff640 1 -- start start 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 -- 172.21.15.87:0/662080731 wait complete. 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500659c640 1 -- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500815bb10 msgr2=0x7f500814bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500659c640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500815bb10 0x7f500814bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500659c640 1 -- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f500815c460 msgr2=0x7f500814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500659c640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f500815c460 0x7f500814c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500659c640 1 -- 172.21.15.87:0/448331330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5008157d80 con 0x7f50080a7390 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5005d9b640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500815bb10 0x7f500814bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5006d9d640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f500815c460 0x7f500814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500659c640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50080a7390 0x7f5008151650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c780 tx=0x7f4ff800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f31a8006d10 con 0x7f31b00a7230 2024-04-25T15:54:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe098033080 0x7fe09817b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5ea67fc640 1 -- 172.21.15.87:0/434007367 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a56d0 con 0x7f5ea80635d0 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5ea67fc640 1 -- 172.21.15.87:0/434007367 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a5870 con 0x7f5ea80635d0 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5ea67fc640 1 -- 172.21.15.87:0/434007367 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a5c40 con 0x7f5ea80635d0 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 -- 172.21.15.87:0/434007367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80635d0 msgr2=0x7f5ea81660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 --2- 172.21.15.87:0/434007367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80635d0 0x7f5ea81660d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8072330 tx=0x7f5ea001c920 comp rx=0 tx=0).stop 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 -- 172.21.15.87:0/434007367 shutdown_connections 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 --2- 172.21.15.87:0/434007367 >> v2:172.21.15.155:3300/0 conn(0x7f5ea815b750 0x7f5ea8063090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 --2- 172.21.15.87:0/434007367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80635d0 0x7f5ea81660d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 -- 172.21.15.87:0/434007367 >> 172.21.15.87:0/434007367 conn(0x7f5ea80c60b0 msgr2=0x7f5ea80c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 -- 172.21.15.87:0/434007367 shutdown_connections 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09ffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe098043140 0x7fe0980ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09804ecc0 0x7fe09800bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09ffff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe098007c50 con 0x7fe098033080 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09ffff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe098007ad0 con 0x7fe09804ecc0 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09ffff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe0980ebf80 con 0x7fe098043140 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe098043140 0x7fe0980ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe098043140 0x7fe0980ded20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47034/0 (socket says 172.21.15.87:47034) 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 -- 172.21.15.87:0/3935244273 learned_addr learned my addr 172.21.15.87:0/3935244273 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09f7fe640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09804ecc0 0x7fe09800bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 -- 172.21.15.87:0/3935244273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09804ecc0 msgr2=0x7fe09800bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09804ecc0 0x7fe09800bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 -- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe098033080 msgr2=0x7fe09817b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe098033080 0x7fe09817b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 -- 172.21.15.87:0/3935244273 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe098007170 con 0x7fe098043140 2024-04-25T15:54:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe09e7fc640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe098043140 0x7fe0980ded20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe09000e870 tx=0x7fe09000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 Processor -- start 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fac8eb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980039c0 0x7f3fa017b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fac8eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa00d11d0 0x7f3fa00d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980039c0 0x7f3fa017b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa00d11d0 0x7f3fa00d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa00d11d0 0x7f3fa00d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60544/0 (socket says 172.21.15.87:60544) 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980039c0 0x7f3fa017b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:56846/0 (socket says 172.21.15.87:56846) 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fac8eb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00d15e0 0x7f3fa00d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fac8eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa003f200 con 0x7f3fa00d11d0 2024-04-25T15:54:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 -- 172.21.15.87:0/4151290330 learned_addr learned my addr 172.21.15.87:0/4151290330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa00dfb60 con 0x7f3f980039c0 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa00dc540 con 0x7f3fa00d15e0 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa7fff640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00d15e0 0x7f3fa00d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 -- 172.21.15.87:0/4151290330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00d15e0 msgr2=0x7f3fa00d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa00d15e0 0x7f3fa00d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 -- 172.21.15.87:0/4151290330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980039c0 msgr2=0x7f3fa017b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f980039c0 0x7f3fa017b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa00dd390 con 0x7f3fa00d11d0 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3fa6ffd640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa00d11d0 0x7f3fa00d21a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f94006de0 tx=0x7f3f9400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 msgr2=0x7f551c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f551c004c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5534157aa0 tx=0x7f552c01d380 comp rx=0 tx=0).stop 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 shutdown_connections 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 --2- 172.21.15.87:0/1969941755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f551c004c20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 >> 172.21.15.87:0/1969941755 conn(0x7f553406c670 msgr2=0x7f553406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 shutdown_connections 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f553b04a640 1 -- 172.21.15.87:0/1969941755 wait complete. 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8017070 con 0x7f50080a7390 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8005ae0 con 0x7f50080a7390 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500759e640 1 -- 172.21.15.87:0/448331330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5008158060 con 0x7f50080a7390 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8007070 con 0x7f50080a7390 2024-04-25T15:54:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f500759e640 1 -- 172.21.15.87:0/448331330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5008158620 con 0x7f50080a7390 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fe0001040 con 0x7f50080a7390 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4ead5d9640 1 --2- 172.21.15.87:0/4293401851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea0046540 0x7f4ea0046950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097c0 tx=0x7f4e9801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13501fc59598b73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b0070 con 0x7f4ea0046540 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980ab600 con 0x7f4ea0046540 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f4eacdd8640 1 -- 172.21.15.87:0/4293401851 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b0070 con 0x7f4ea0046540 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31a6ffd640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f319406f400 0x7f3194071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f31a808f0d0 con 0x7f31b00a7230 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31a6ffd640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f3194079be0 0x7f319407c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f319407c700 con 0x7f3194079be0 2024-04-25T15:54:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f31a8096050 con 0x7f31b00a7230 2024-04-25T15:54:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31b6559640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f319406f400 0x7f3194071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31b6d5a640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f3194079be0 0x7f319407c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31b6559640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f319406f400 0x7f3194071910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0079c0 tx=0x7f31ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f5eace7f640 1 -- 172.21.15.87:0/434007367 wait complete. 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 -- start start 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c03e9e0 0x7f2d6c0e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c049910 0x7f2d6c0d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c041a60 0x7f2d6c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0ea190 con 0x7f2d6c049910 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0dfb60 con 0x7f2d6c041a60 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f2d7b86b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c0ea310 con 0x7f2d6c03e9e0 2024-04-25T15:54:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090017070 con 0x7fe098043140 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c049910 0x7f2d6c0d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c049910 0x7f2d6c0d8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60560/0 (socket says 172.21.15.87:60560) 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 -- 172.21.15.87:0/1047765039 learned_addr learned my addr 172.21.15.87:0/1047765039 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d79607640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c03e9e0 0x7f2d6c0e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94018020 con 0x7f3fa00d11d0 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f94014620 con 0x7f3fa00d11d0 2024-04-25T15:54:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa00d4c80 con 0x7f3fa00d11d0 2024-04-25T15:54:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94014a10 con 0x7f3fa00d11d0 2024-04-25T15:54:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa00d5240 con 0x7f3fa00d11d0 2024-04-25T15:54:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.277+0000 7f31b6d5a640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f3194079be0 0x7f319407c030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d79e08640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c041a60 0x7f2d6c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 -- 172.21.15.87:0/4293401851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea0046540 msgr2=0x7f4ea0046950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 --2- 172.21.15.87:0/4293401851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea0046540 0x7f4ea0046950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097c0 tx=0x7f4e9801c410 comp rx=0 tx=0).stop 2024-04-25T15:54:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 -- 172.21.15.87:0/1047765039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c03e9e0 msgr2=0x7f2d6c0e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d6c03e9e0 0x7f2d6c0e27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 -- 172.21.15.87:0/1047765039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c041a60 msgr2=0x7f2d6c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d6c041a60 0x7f2d6c0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 -- 172.21.15.87:0/1047765039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c0d72f0 con 0x7f2d6c049910 2024-04-25T15:54:27.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fa00d5a40 con 0x7f3fa00d11d0 2024-04-25T15:54:27.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 -- 172.21.15.87:0/4293401851 shutdown_connections 2024-04-25T15:54:27.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 --2- 172.21.15.87:0/4293401851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea0046540 0x7f4ea0046950 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 -- 172.21.15.87:0/4293401851 >> 172.21.15.87:0/4293401851 conn(0x7f4ea00060a0 msgr2=0x7f4ea00064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d78e06640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c049910 0x7f2d6c0d8a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400b3c0 tx=0x7f2d6400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5eace7f640 1 Processor -- start 2024-04-25T15:54:27.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5eace7f640 1 -- start start 2024-04-25T15:54:27.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f553b04a640 1 Processor -- start 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4ff801a070 con 0x7f50080a7390 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4ff6ffd640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4fe806f430 0x7f4fe8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4ff808f050 con 0x7f50080a7390 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5005d9b640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4fe806f430 0x7f4fe8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4ff6ffd640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f4fe8079d10 0x7f4fe807c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 --> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fe807c830 con 0x7f4fe8079d10 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ff808f440 con 0x7f50080a7390 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5eace7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea80635d0 0x7f5ea80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5eace7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea806da20 0x7f5ea81f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5eace7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea815b750 0x7f5ea814f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5ea77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea80635d0 0x7f5ea80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5ea77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea80635d0 0x7f5ea80c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47052/0 (socket says 172.21.15.87:47052) 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0980e1aa0 con 0x7fe098043140 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0980e2bc0 con 0x7fe098043140 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09000c940 con 0x7fe098043140 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09000cd30 con 0x7fe098043140 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f553b04a640 1 -- start start 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f553b04a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f553414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f553b04a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55340ab780 0x7f55340abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5006d9d640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f4fe8079d10 0x7f4fe807c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5005d9b640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4fe806f430 0x7f4fe8071940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0ad000 tx=0x7f4ffc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 -- 172.21.15.87:0/4293401851 shutdown_connections 2024-04-25T15:54:27.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f4eaeddc640 1 -- 172.21.15.87:0/4293401851 wait complete. 2024-04-25T15:54:27.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f5ea6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea806da20 0x7f5ea81f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea806da20 0x7f5ea81f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:56852/0 (socket says 172.21.15.87:56852) 2024-04-25T15:54:27.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea815b750 0x7f5ea814f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea815b750 0x7f5ea814f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60568/0 (socket says 172.21.15.87:60568) 2024-04-25T15:54:27.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe080001040 con 0x7fe098043140 2024-04-25T15:54:27.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f553414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f553414ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60584/0 (socket says 172.21.15.87:60584) 2024-04-25T15:54:27.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea77fe640 1 -- 172.21.15.87:0/1238250097 learned_addr learned my addr 172.21.15.87:0/1238250097 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 Processor -- start 2024-04-25T15:54:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea80c3ae0 con 0x7f5ea815b750 2024-04-25T15:54:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea80750c0 con 0x7f5ea806da20 2024-04-25T15:54:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea80c3c60 con 0x7f5ea80635d0 2024-04-25T15:54:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5533fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55340ab780 0x7f55340abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 -- 172.21.15.87:0/4109746183 learned_addr learned my addr 172.21.15.87:0/4109746183 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5534156800 0x7f5534156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== osd.7 v2:172.21.15.155:6808/209384873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f319407c700 con 0x7f3194079be0 2024-04-25T15:54:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55340c4b60 con 0x7f551c004810 2024-04-25T15:54:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 -- 172.21.15.87:0/1238250097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea80635d0 msgr2=0x7f5ea80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea80635d0 0x7f5ea80c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 -- 172.21.15.87:0/1238250097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea806da20 msgr2=0x7f5ea81f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea806da20 0x7f5ea81f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea81f8d70 con 0x7f5ea815b750 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55340a8350 con 0x7f55340ab780 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f55340c4ce0 con 0x7f5534156800 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011830 con 0x7f2d6c049910 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64016070 con 0x7f2d6c049910 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011c10 con 0x7f2d6c049910 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c0d75d0 con 0x7f2d6c049910 2024-04-25T15:54:27.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.281+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c0d6fc0 con 0x7f2d6c049910 2024-04-25T15:54:27.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d54001040 con 0x7f2d6c049910 2024-04-25T15:54:27.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f9401b020 con 0x7f3fa00d11d0 2024-04-25T15:54:27.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3f8c06f450 0x7f3f8c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f3f9408fe20 con 0x7f3fa00d11d0 2024-04-25T15:54:27.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5ea7fff640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea815b750 0x7f5ea814f180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00ab000 tx=0x7f5ea00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f3f8c079d30 0x7f3f8c07c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3fa77fe640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3f8c06f450 0x7f3f8c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f94026e70 con 0x7f3f8c079d30 2024-04-25T15:54:27.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3f940901d0 con 0x7f3fa00d11d0 2024-04-25T15:54:27.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3fa7fff640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f3f8c079d30 0x7f3f8c07c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 -- start start 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 -- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5534156800 msgr2=0x7f5534156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5534156800 0x7f5534156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 -- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55340ab780 msgr2=0x7f55340abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55340ab780 0x7f55340abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534149e70 con 0x7f551c004810 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5538de6640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f553414ee40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5528003950 tx=0x7f5528003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3fa7fff640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f3f8c079d30 0x7f3f8c07c180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea00309c0 0x7f4ea00d9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ea0046540 0x7f4ea00cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ea0046e90 0x7f4ea017e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea00311a0 con 0x7f4ea00309c0 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0031020 con 0x7f4ea0046540 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaeddc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea002e860 con 0x7f4ea0046e90 2024-04-25T15:54:27.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3fa77fe640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3f8c06f450 0x7f3f8c071960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0ab000 tx=0x7f3f9c0b0040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5006d9d640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f4fe8079d10 0x7f4fe807c160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eae5db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ea0046e90 0x7f4ea017e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea00309c0 0x7f4ea00d9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea00309c0 0x7f4ea00d9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60586/0 (socket says 172.21.15.87:60586) 2024-04-25T15:54:27.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4ead5d9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ea0046540 0x7f4ea00cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 -- 172.21.15.87:0/1965346439 learned_addr learned my addr 172.21.15.87:0/1965346439 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00bc020 con 0x7f5ea815b750 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528011e40 con 0x7f551c004810 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553414fa90 con 0x7f551c004810 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55341ed170 con 0x7f551c004810 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 -- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ea0046e90 msgr2=0x7f4ea017e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ea0046e90 0x7f4ea017e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 -- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ea0046540 msgr2=0x7f4ea00cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ea0046540 0x7f4ea00cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f4eaddda640 1 -- 172.21.15.87:0/1965346439 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea00ca8e0 con 0x7f4ea00309c0 2024-04-25T15:54:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea81546e0 con 0x7f5ea815b750 2024-04-25T15:54:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea8153a20 con 0x7f5ea815b750 2024-04-25T15:54:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ea81f8950 con 0x7f5ea815b750 2024-04-25T15:54:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== osd.3 v2:172.21.15.87:6800/2110638715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f94026e70 con 0x7f3f8c079d30 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe09001a070 con 0x7fe098043140 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe0877fe640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe08c06f450 0x7fe08c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe09008f3b0 con 0x7fe098043140 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe09effd640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe08c06f450 0x7fe08c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe0877fe640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7fe08c079d30 0x7fe08c07c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 --> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe08c07c850 con 0x7fe08c079d30 2024-04-25T15:54:27.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe09008f810 con 0x7fe098043140 2024-04-25T15:54:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7fe09f7fe640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7fe08c079d30 0x7fe08c07c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7fe09effd640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe08c06f450 0x7fe08c071960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe09804bc40 tx=0x7fe094006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5528023440 con 0x7f551c004810 2024-04-25T15:54:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55280237f0 con 0x7f551c004810 2024-04-25T15:54:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.285+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5514001040 con 0x7f551c004810 2024-04-25T15:54:27.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a5790 con 0x7f5ea815b750 2024-04-25T15:54:27.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b8870 con 0x7f5ea815b750 2024-04-25T15:54:27.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f4eaddda640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea00309c0 0x7f4ea00d9b70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4005890 tx=0x7f4ea400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7fe09f7fe640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7fe08c079d30 0x7fe08c07c180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d64025430 con 0x7f2d6c049910 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d69ffb640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5806f4d0 0x7f2d580719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2d6408fa20 con 0x7f2d6c049910 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d69ffb640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f2d58079db0 0x7f2d5807c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 --> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d64025e50 con 0x7f2d58079db0 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d6408fe10 con 0x7f2d6c049910 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d79e08640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f2d58079db0 0x7f2d5807c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.289+0000 7f2d79607640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5806f4d0 0x7f2d580719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f2d79e08640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f2d58079db0 0x7f2d5807c200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ea00bf020 con 0x7f5ea815b750 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5e8ffff640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e9406f400 0x7f5e94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5ea012a970 con 0x7f5ea815b750 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5e8ffff640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f5e94079be0 0x7f5e9407c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea00a9ec0 con 0x7f5e94079be0 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5ea012ad20 con 0x7f5ea815b750 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5ea77fe640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e9406f400 0x7f5e94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5ea6ffd640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f5e94079be0 0x7f5e9407c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5ea6ffd640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f5e94079be0 0x7f5e9407c030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== osd.1 v2:172.21.15.87:6817/4281742736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe08c07c850 con 0x7fe08c079d30 2024-04-25T15:54:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== osd.2 v2:172.21.15.87:6808/3379569220 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d64025e50 con 0x7f2d58079db0 2024-04-25T15:54:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== osd.5 v2:172.21.15.155:6800/3453999396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fe807c830 con 0x7f4fe8079d10 2024-04-25T15:54:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4017070 con 0x7f4ea00309c0 2024-04-25T15:54:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea4005cf0 con 0x7f4ea00309c0 2024-04-25T15:54:27.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4007290 con 0x7f4ea00309c0 2024-04-25T15:54:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea00cb110 con 0x7f4ea00309c0 2024-04-25T15:54:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea00ccf00 con 0x7f4ea00309c0 2024-04-25T15:54:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ea00caec0 con 0x7f4ea00309c0 2024-04-25T15:54:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f2d79607640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5806f4d0 0x7f2d580719e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00bb20 tx=0x7f2d74123070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== osd.0 v2:172.21.15.87:6816/3434086508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea00a9ec0 con 0x7f5e94079be0 2024-04-25T15:54:27.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f5ea77fe640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e9406f400 0x7f5e94071910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009980 tx=0x7f5e9c0090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4ea401a070 con 0x7f4ea00309c0 2024-04-25T15:54:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4e9e7fc640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e8c06f480 0x7f4e8c071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4ea408eeb0 con 0x7f4ea00309c0 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4ead5d9640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e8c06f480 0x7f4e8c071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4e9e7fc640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f4e8c079d60 0x7f4e8c07c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 --> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e8c07c880 con 0x7f4e8c079d60 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ea408f260 con 0x7f4ea00309c0 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4eae5db640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f4e8c079d60 0x7f4e8c07c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4ead5d9640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e8c06f480 0x7f4e8c071990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e980ad000 tx=0x7f4e98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f4eae5db640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f4e8c079d60 0x7f4e8c07c1b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5528023990 con 0x7f551c004810 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55317fa640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f552006f430 0x7f5520071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5528090c00 con 0x7f551c004810 2024-04-25T15:54:27.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55317fa640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f5520079d10 0x7f552007c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5528009e90 con 0x7f5520079d10 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5528090ff0 con 0x7f551c004810 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55395e7640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f5520079d10 0x7f552007c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f5533fff640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f552006f430 0x7f5520071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.293+0000 7f55395e7640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f5520079d10 0x7f552007c160 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f5533fff640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f552006f430 0x7f5520071940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f552c0ad000 tx=0x7f552c0af040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.297+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== osd.4 v2:172.21.15.155:6824/1375627769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5528009e90 con 0x7f5520079d10 2024-04-25T15:54:27.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.301+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== osd.6 v2:172.21.15.155:6816/3434620802 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e8c07c880 con 0x7f4e8c079d60 2024-04-25T15:54:27.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.309+0000 7f3fac8eb640 1 -- 172.21.15.87:0/4151290330 --> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fa017bfe0 con 0x7f3f8c079d30 2024-04-25T15:54:27.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 --> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31b01f4c20 con 0x7f3194079be0 2024-04-25T15:54:27.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f93fff640 1 -- 172.21.15.87:0/4151290330 <== osd.3 v2:172.21.15.87:6800/2110638715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3fa017bfe0 con 0x7f3f8c079d30 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f3f8c079d30 msgr2=0x7f3f8c07c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f3f8c079d30 0x7f3f8c07c180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3f8c06f450 msgr2=0x7f3f8c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3f8c06f450 0x7f3f8c071960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0ab000 tx=0x7f3f9c0b0040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa00d11d0 msgr2=0x7f3fa00d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 --2- 172.21.15.87:0/4151290330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa00d11d0 0x7f3fa00d21a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f94006de0 tx=0x7f3f9400d9e0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3fa7fff640 1 -- 172.21.15.87:0/4151290330 reap_dead start 2024-04-25T15:54:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31a6ffd640 1 -- 172.21.15.87:0/3796617244 <== osd.7 v2:172.21.15.155:6808/209384873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f31b01f4c20 con 0x7f3194079be0 2024-04-25T15:54:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 shutdown_connections 2024-04-25T15:54:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 >> 172.21.15.87:0/4151290330 conn(0x7f3fa00060a0 msgr2=0x7f3fa00d9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 shutdown_connections 2024-04-25T15:54:27.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f3f91ffb640 1 -- 172.21.15.87:0/4151290330 wait complete. 2024-04-25T15:54:27.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 --> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4fe0002de0 con 0x7f4fe8079d10 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f3194079be0 msgr2=0x7f319407c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f3194079be0 0x7f319407c030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f319406f400 msgr2=0x7f3194071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f319406f400 0x7f3194071910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0079c0 tx=0x7f31ac008040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00a7230 msgr2=0x7f31b015a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 --2- 172.21.15.87:0/3796617244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b00a7230 0x7f31b015a120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31a800ba80 tx=0x7f31a800bf40 comp rx=0 tx=0).stop 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b6d5a640 1 -- 172.21.15.87:0/3796617244 reap_dead start 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 shutdown_connections 2024-04-25T15:54:27.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 >> 172.21.15.87:0/3796617244 conn(0x7f31b00c8b30 msgr2=0x7f31b00c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f4ff6ffd640 1 -- 172.21.15.87:0/448331330 <== osd.5 v2:172.21.15.155:6800/3453999396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4fe0002de0 con 0x7f4fe8079d10 2024-04-25T15:54:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 shutdown_connections 2024-04-25T15:54:27.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.313+0000 7f31b87bd640 1 -- 172.21.15.87:0/3796617244 wait complete. 2024-04-25T15:54:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.317+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 --> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe080002de0 con 0x7fe08c079d30 2024-04-25T15:54:27.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.317+0000 7fe0877fe640 1 -- 172.21.15.87:0/3935244273 <== osd.1 v2:172.21.15.87:6817/4281742736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe080002de0 con 0x7fe08c079d30 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7fe08c079d30 msgr2=0x7fe08c07c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7fe08c079d30 0x7fe08c07c180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe08c06f450 msgr2=0x7fe08c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe08c06f450 0x7fe08c071960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe09804bc40 tx=0x7fe094006bb0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe098043140 msgr2=0x7fe0980ded20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 --2- 172.21.15.87:0/3935244273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe098043140 0x7fe0980ded20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe09000e870 tx=0x7fe09000ec70 comp rx=0 tx=0).stop 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09f7fe640 1 -- 172.21.15.87:0/3935244273 reap_dead start 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 shutdown_connections 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 >> 172.21.15.87:0/3935244273 conn(0x7fe09804c8b0 msgr2=0x7fe09802f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 shutdown_connections 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7fe09ffff640 1 -- 172.21.15.87:0/3935244273 wait complete. 2024-04-25T15:54:27.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 --> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ea8154b90 con 0x7f5e94079be0 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f4fe8079d10 msgr2=0x7f4fe807c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f4fe8079d10 0x7f4fe807c160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4fe806f430 msgr2=0x7f4fe8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4fe806f430 0x7f4fe8071940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0ad000 tx=0x7f4ffc0a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50080a7390 msgr2=0x7f5008151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 --2- 172.21.15.87:0/448331330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50080a7390 0x7f5008151650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c780 tx=0x7f4ff800cc40 comp rx=0 tx=0).stop 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f5006d9d640 1 -- 172.21.15.87:0/448331330 reap_dead start 2024-04-25T15:54:27.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 shutdown_connections 2024-04-25T15:54:27.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 >> 172.21.15.87:0/448331330 conn(0x7f50080c8890 msgr2=0x7f5008155560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 shutdown_connections 2024-04-25T15:54:27.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f5e8ffff640 1 -- 172.21.15.87:0/1238250097 <== osd.0 v2:172.21.15.87:6816/3434086508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ea8154b90 con 0x7f5e94079be0 2024-04-25T15:54:27.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f4ff4ff9640 1 -- 172.21.15.87:0/448331330 wait complete. 2024-04-25T15:54:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.321+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 --> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d54002de0 con 0x7f2d58079db0 2024-04-25T15:54:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.325+0000 7f2d69ffb640 1 -- 172.21.15.87:0/1047765039 <== osd.2 v2:172.21.15.87:6808/3379569220 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2d54002de0 con 0x7f2d58079db0 2024-04-25T15:54:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f5e94079be0 msgr2=0x7f5e9407c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f5e94079be0 0x7f5e9407c030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e9406f400 msgr2=0x7f5e94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e9406f400 0x7f5e94071910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009980 tx=0x7f5e9c0090e0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea815b750 msgr2=0x7f5ea814f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 --2- 172.21.15.87:0/1238250097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea815b750 0x7f5ea814f180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00ab000 tx=0x7f5ea00196c0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5ea7fff640 1 -- 172.21.15.87:0/1238250097 reap_dead start 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 shutdown_connections 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 >> 172.21.15.87:0/1238250097 conn(0x7f5ea80c60b0 msgr2=0x7f5ea815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f2d58079db0 msgr2=0x7f2d5807c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f2d58079db0 0x7f2d5807c200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5806f4d0 msgr2=0x7f2d580719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2d5806f4d0 0x7f2d580719e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00bb20 tx=0x7f2d74123070 comp rx=0 tx=0).stop 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c049910 msgr2=0x7f2d6c0d8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 --2- 172.21.15.87:0/1047765039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c049910 0x7f2d6c0d8a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400b3c0 tx=0x7f2d6400b880 comp rx=0 tx=0).stop 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d79e08640 1 -- 172.21.15.87:0/1047765039 reap_dead start 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 shutdown_connections 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 >> 172.21.15.87:0/1047765039 conn(0x7f2d6c0060a0 msgr2=0x7f2d6c005790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 shutdown_connections 2024-04-25T15:54:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 shutdown_connections 2024-04-25T15:54:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f2d7b86b640 1 -- 172.21.15.87:0/1047765039 wait complete. 2024-04-25T15:54:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f5eace7f640 1 -- 172.21.15.87:0/1238250097 wait complete. 2024-04-25T15:54:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f553b04a640 1 -- 172.21.15.87:0/4109746183 --> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5514002d60 con 0x7f5520079d10 2024-04-25T15:54:27.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.329+0000 7f55317fa640 1 -- 172.21.15.87:0/4109746183 <== osd.4 v2:172.21.15.155:6824/1375627769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5514002d60 con 0x7f5520079d10 2024-04-25T15:54:27.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.333+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f5520079d10 msgr2=0x7f552007c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.333+0000 7f551affd640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f5520079d10 0x7f552007c160 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f552006f430 msgr2=0x7f5520071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f552006f430 0x7f5520071940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f552c0ad000 tx=0x7f552c0af040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 msgr2=0x7f553414ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 --2- 172.21.15.87:0/4109746183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f551c004810 0x7f553414ee40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5528003950 tx=0x7f5528003e10 comp rx=0 tx=0).stop 2024-04-25T15:54:27.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f55395e7640 1 -- 172.21.15.87:0/4109746183 reap_dead start 2024-04-25T15:54:27.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 shutdown_connections 2024-04-25T15:54:27.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 >> 172.21.15.87:0/4109746183 conn(0x7f553406c670 msgr2=0x7f55340c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 --> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ea0005580 con 0x7f4e8c079d60 2024-04-25T15:54:27.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 shutdown_connections 2024-04-25T15:54:27.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f551affd640 1 -- 172.21.15.87:0/4109746183 wait complete. 2024-04-25T15:54:27.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.337+0000 7f4e9e7fc640 1 -- 172.21.15.87:0/1965346439 <== osd.6 v2:172.21.15.155:6816/3434620802 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ea0005580 con 0x7f4e8c079d60 2024-04-25T15:54:27.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f4e8c079d60 msgr2=0x7f4e8c07c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f4e8c079d60 0x7f4e8c07c1b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e8c06f480 msgr2=0x7f4e8c071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e8c06f480 0x7f4e8c071990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e980ad000 tx=0x7f4e98008040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea00309c0 msgr2=0x7f4ea00d9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 --2- 172.21.15.87:0/1965346439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea00309c0 0x7f4ea00d9b70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4005890 tx=0x7f4ea400c960 comp rx=0 tx=0).stop 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eae5db640 1 -- 172.21.15.87:0/1965346439 reap_dead start 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 shutdown_connections 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 >> 172.21.15.87:0/1965346439 conn(0x7f4ea00060a0 msgr2=0x7f4ea0005790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 shutdown_connections 2024-04-25T15:54:27.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.345+0000 7f4eaeddc640 1 -- 172.21.15.87:0/1965346439 wait complete. 2024-04-25T15:54:27.363 INFO:teuthology.orchestra.run.smithi087.stdout:55834574857 2024-04-25T15:54:27.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:54:27.364 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:27.364 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:54:27.365 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:27.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:54:27.366 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:27.367 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:54:27.368 INFO:teuthology.orchestra.run.smithi087.stdout:55834574857 2024-04-25T15:54:27.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:54:27.369 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:27.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:54:27.373 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:27.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:54:27.376 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:27.376 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:54:27.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.537+0000 7f50e9acd640 1 Processor -- start 2024-04-25T15:54:27.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.537+0000 7f50e9acd640 1 -- start start 2024-04-25T15:54:27.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e9acd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50e40c56d0 0x7f50e40ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e9acd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e4150730 0x7f50e4150b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e9acd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e4157960 con 0x7f50e40c5ae0 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e9acd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f50e4156aa0 con 0x7f50e40c56d0 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e9acd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50e4151080 con 0x7f50e4150730 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e8acb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50e40c56d0 0x7f50e40ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e8acb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50e40c56d0 0x7f50e40ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60588/0 (socket says 172.21.15.87:60588) 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e3fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f50e40c5ae0 0x7f50e41535d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:51172/0 (socket says 172.21.15.87:51172) 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e3fff640 1 -- 172.21.15.87:0/4160780001 learned_addr learned my addr 172.21.15.87:0/4160780001 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e92cc640 1 --2- 172.21.15.87:0/4160780001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e4150730 0x7f50e4150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e37fe640 1 -- 172.21.15.87:0/4160780001 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304258947 0 0) 0x7f50e4157960 con 0x7f50e40c5ae0 2024-04-25T15:54:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e8acb640 1 -- 172.21.15.87:0/4160780001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e4150730 msgr2=0x7f50e4150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e8acb640 1 --2- 172.21.15.87:0/4160780001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e4150730 0x7f50e4150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e8acb640 1 -- 172.21.15.87:0/4160780001 >> v1:172.21.15.155:6789/0 conn(0x7f50e40c5ae0 legacy=0x7f50e41535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.541+0000 7f50e8acb640 1 -- 172.21.15.87:0/4160780001 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e4154050 con 0x7f50e40c56d0 2024-04-25T15:54:27.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.545+0000 7f50e8acb640 1 --2- 172.21.15.87:0/4160780001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40c56d0 0x7f50e40ab540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009fd0 tx=0x7f50d401ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6144546a94f4924d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.545+0000 7f50e37fe640 1 -- 172.21.15.87:0/4160780001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d40b2070 con 0x7f50e40c56d0 2024-04-25T15:54:27.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.545+0000 7f50e37fe640 1 -- 172.21.15.87:0/4160780001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d40a5a70 con 0x7f50e40c56d0 2024-04-25T15:54:27.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.545+0000 7f50e9acd640 1 -- 172.21.15.87:0/4160780001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40c56d0 msgr2=0x7f50e40ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.545+0000 7f50e9acd640 1 --2- 172.21.15.87:0/4160780001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40c56d0 0x7f50e40ab540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009fd0 tx=0x7f50d401ccb0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 -- 172.21.15.87:0/4160780001 shutdown_connections 2024-04-25T15:54:27.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 --2- 172.21.15.87:0/4160780001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e4150730 0x7f50e4150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 --2- 172.21.15.87:0/4160780001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40c56d0 0x7f50e40ab540 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 -- 172.21.15.87:0/4160780001 >> 172.21.15.87:0/4160780001 conn(0x7f50e40c8490 msgr2=0x7f50e40c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 -- 172.21.15.87:0/4160780001 shutdown_connections 2024-04-25T15:54:27.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 -- 172.21.15.87:0/4160780001 wait complete. 2024-04-25T15:54:27.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 Processor -- start 2024-04-25T15:54:27.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.549+0000 7f50e9acd640 1 -- start start 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e9acd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e40c56d0 0x7f50e40c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e9acd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e40c5ae0 0x7f50e4154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e9acd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 0x7f50e4148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e9acd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40aba80 con 0x7f50e4150730 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e9acd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40c47d0 con 0x7f50e40c56d0 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e9acd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50e40abc00 con 0x7f50e40c5ae0 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 0x7f50e4148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 0x7f50e4148690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60596/0 (socket says 172.21.15.87:60596) 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 -- 172.21.15.87:0/2618568201 learned_addr learned my addr 172.21.15.87:0/2618568201 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e3fff640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e40c5ae0 0x7f50e4154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e8acb640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e40c56d0 0x7f50e40c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 -- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e40c5ae0 msgr2=0x7f50e4154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e40c5ae0 0x7f50e4154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 -- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e40c56d0 msgr2=0x7f50e40c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e40c56d0 0x7f50e40c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 -- 172.21.15.87:0/2618568201 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40c82b0 con 0x7f50e4150730 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e92cc640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 0x7f50e4148690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50d800e820 tx=0x7f50d800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8017070 con 0x7f50e4150730 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.553+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d800c730 con 0x7f50e4150730 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d800cb00 con 0x7f50e4150730 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f50e9acd640 1 -- 172.21.15.87:0/2618568201 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e414a6e0 con 0x7f50e4150730 2024-04-25T15:54:27.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f50e9acd640 1 -- 172.21.15.87:0/2618568201 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e40c7a00 con 0x7f50e4150730 2024-04-25T15:54:27.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f50e9acd640 1 -- 172.21.15.87:0/2618568201 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4069a30 con 0x7f50e4150730 2024-04-25T15:54:27.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50d801a070 con 0x7f50e4150730 2024-04-25T15:54:27.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f50e17fa640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50c806f400 0x7f50c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f50d808f6b0 con 0x7f50e4150730 2024-04-25T15:54:27.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f50e8acb640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50c806f400 0x7f50c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f50e8acb640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50c806f400 0x7f50c8071910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50d40af000 tx=0x7f50d40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f9ad9b78640 1 Processor -- start 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f9ad9b78640 1 -- start start 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad9b78640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 0x7f9ad40c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad9b78640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40c54d0 0x7f9ad415edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad9b78640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad40c3e40 con 0x7f9ad415f310 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad9b78640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad40c4120 con 0x7f9ad40ac870 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad9b78640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad40c4400 con 0x7f9ad40c54d0 2024-04-25T15:54:27.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad8b76640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 0x7f9ad40c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad3fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40c54d0 0x7f9ad415edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad8b76640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 0x7f9ad40c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60598/0 (socket says 172.21.15.87:60598) 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad8b76640 1 -- 172.21.15.87:0/3494803235 learned_addr learned my addr 172.21.15.87:0/3494803235 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad3fff640 1 -- 172.21.15.87:0/3494803235 >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 msgr2=0x7f9ad40c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad3fff640 1 --2- 172.21.15.87:0/3494803235 >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 0x7f9ad40c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad3fff640 1 -- 172.21.15.87:0/3494803235 >> v1:172.21.15.155:6789/0 conn(0x7f9ad415f310 legacy=0x7f9ad406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad3fff640 1 -- 172.21.15.87:0/3494803235 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40c46e0 con 0x7f9ad40c54d0 2024-04-25T15:54:27.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f9ad8b76640 1 --2- 172.21.15.87:0/3494803235 >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 0x7f9ad40c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:27.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f34057c0640 1 Processor -- start 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.557+0000 7f34057c0640 1 -- start start 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f34057c0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34000abd40 0x7f3400074d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f34057c0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3400164ab0 con 0x7f3400168100 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f34057c0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3400164d90 con 0x7f3400167cf0 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f34057c0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3400167580 con 0x7f34000abd40 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f33ff7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3400168100 0x7f340008d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59470/0 (socket says 172.21.15.87:59470) 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.561+0000 7f33ff7fe640 1 -- 172.21.15.87:0/452245200 learned_addr learned my addr 172.21.15.87:0/452245200 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911647148 0 0) 0x7f3400164d90 con 0x7f3400167cf0 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f33feffd640 1 --2- 172.21.15.87:0/452245200 >> v2:172.21.15.155:3300/0 conn(0x7f34000abd40 0x7f3400074d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.565+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e8003dc0 con 0x7f3400167cf0 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3547595464 0 0) 0x7f33e8003dc0 con 0x7f3400167cf0 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 >> v2:172.21.15.155:3300/0 conn(0x7f34000abd40 msgr2=0x7f3400074d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 --2- 172.21.15.87:0/452245200 >> v2:172.21.15.155:3300/0 conn(0x7f34000abd40 0x7f3400074d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 >> v1:172.21.15.87:6789/0 conn(0x7f3400168100 legacy=0x7f340008d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000ab170 con 0x7f3400167cf0 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f33f00015b0 con 0x7f3400167cf0 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 >> v1:172.21.15.155:6789/0 conn(0x7f3400167cf0 legacy=0x7f340006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e8003790 0x7f33e8004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e80045d0 0x7f33e8004a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33e8005400 0x7f33e8005870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3400167580 con 0x7f33e8003790 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33e800c310 con 0x7f33e8005400 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33e800c510 con 0x7f33e80045d0 2024-04-25T15:54:27.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 --2- 172.21.15.87:0/452245200 >> v2:172.21.15.155:3300/0 conn(0x7f34000abd40 0x7f3400074d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:27.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 Processor -- start 2024-04-25T15:54:27.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e8003790 0x7f33e8004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33fe7fc640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e80045d0 0x7f33e8004a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33ff7fe640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33e8005400 0x7f33e8005870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 -- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e80045d0 msgr2=0x7f33e8004a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e80045d0 0x7f33e8004a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 -- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33e8005400 msgr2=0x7f33e8005870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33e8005400 0x7f33e8005870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33feffd640 1 -- 172.21.15.87:0/452245200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000ab170 con 0x7f33e8003790 2024-04-25T15:54:27.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f33ff7fe640 1 -- 172.21.15.87:0/452245200 reap_dead start 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 -- start start 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15b940 0x7ff31c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff31c15c290 0x7ff31c166150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31c15ef40 con 0x7ff31c070d10 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff31c15f220 con 0x7ff31c15c290 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff32235f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c15f500 con 0x7ff31c15b940 2024-04-25T15:54:27.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50e40c82b0 con 0x7f50e4150730 2024-04-25T15:54:27.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7ff31bfff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff31c070d10 0x7ff31c06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:51188/0 (socket says 172.21.15.87:51188) 2024-04-25T15:54:27.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f9ad3fff640 1 --2- 172.21.15.87:0/3494803235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40c54d0 0x7f9ad415edd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80097c0 tx=0x7f9ac801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f044588e6d1f88a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.569+0000 7f9ad37fe640 1 -- 172.21.15.87:0/3494803235 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80b0070 con 0x7f9ad40c54d0 2024-04-25T15:54:27.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad37fe640 1 -- 172.21.15.87:0/3494803235 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac80ab600 con 0x7f9ad40c54d0 2024-04-25T15:54:27.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad37fe640 1 -- 172.21.15.87:0/3494803235 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80ab9d0 con 0x7f9ad40c54d0 2024-04-25T15:54:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff31c15c290 0x7ff31c166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff31c15c290 0x7ff31c166150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:56914/0 (socket says 172.21.15.87:56914) 2024-04-25T15:54:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 -- 172.21.15.87:0/92458013 learned_addr learned my addr 172.21.15.87:0/92458013 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff31b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15b940 0x7ff31c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f33feffd640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e8003790 0x7f33e8004040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae620 tx=0x7f33f801ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731692a6519355ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f800cdf0 con 0x7f33e8003790 2024-04-25T15:54:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 -- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15b940 msgr2=0x7ff31c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 --2- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15b940 0x7ff31c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 -- 172.21.15.87:0/92458013 >> v1:172.21.15.155:6789/0 conn(0x7ff31c070d10 legacy=0x7ff31c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 -- 172.21.15.87:0/3494803235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40c54d0 msgr2=0x7f9ad415edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/3494803235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40c54d0 0x7f9ad415edd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80097c0 tx=0x7f9ac801c400 comp rx=0 tx=0).stop 2024-04-25T15:54:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff31affd640 1 -- 172.21.15.87:0/92458013 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26014691 0 0) 0x7ff31c15ef40 con 0x7ff31c070d10 2024-04-25T15:54:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7ff3208fc640 1 -- 172.21.15.87:0/92458013 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c15f7e0 con 0x7ff31c15c290 2024-04-25T15:54:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 -- 172.21.15.87:0/3494803235 shutdown_connections 2024-04-25T15:54:27.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/3494803235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad40c54d0 0x7f9ad415edd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/3494803235 >> v2:172.21.15.87:3300/0 conn(0x7f9ad40ac870 0x7f9ad40c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 -- 172.21.15.87:0/3494803235 >> 172.21.15.87:0/3494803235 conn(0x7f9ad40ac0e0 msgr2=0x7f9ad406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 -- 172.21.15.87:0/3494803235 shutdown_connections 2024-04-25T15:54:27.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f9ad9b78640 1 -- 172.21.15.87:0/3494803235 wait complete. 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f8008040 con 0x7f33e8003790 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f33fdffb640 1 -- 172.21.15.87:0/452245200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80a7b10 con 0x7f33e8003790 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f34057c0640 1 -- 172.21.15.87:0/452245200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e8003790 msgr2=0x7f33e8004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f34057c0640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e8003790 0x7f33e8004040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae620 tx=0x7f33f801ef20 comp rx=0 tx=0).stop 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f34057c0640 1 -- 172.21.15.87:0/452245200 shutdown_connections 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f34057c0640 1 --2- 172.21.15.87:0/452245200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e8003790 0x7f33e8004040 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae620 tx=0x7f33f801ef20 comp rx=0 tx=0).stop 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.573+0000 7f34057c0640 1 -- 172.21.15.87:0/452245200 >> 172.21.15.87:0/452245200 conn(0x7f34000c8ba0 msgr2=0x7f34000c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f34057c0640 1 -- 172.21.15.87:0/452245200 shutdown_connections 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f34057c0640 1 -- 172.21.15.87:0/452245200 wait complete. 2024-04-25T15:54:27.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 Processor -- start 2024-04-25T15:54:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 -- start start 2024-04-25T15:54:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff3208fc640 1 --2- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15c290 0x7ff31c166150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff314009e50 tx=0x7ff31401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b16295f6b949403 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff31affd640 1 -- 172.21.15.87:0/92458013 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140a5660 con 0x7ff31c15c290 2024-04-25T15:54:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff31affd640 1 -- 172.21.15.87:0/92458013 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3140a5800 con 0x7ff31c15c290 2024-04-25T15:54:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff31affd640 1 -- 172.21.15.87:0/92458013 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140a5bd0 con 0x7ff31c15c290 2024-04-25T15:54:27.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 -- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15c290 msgr2=0x7ff31c166150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 0x7f9ad40a8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 --2- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15c290 0x7ff31c166150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff314009e50 tx=0x7ff31401c9a0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 -- 172.21.15.87:0/92458013 shutdown_connections 2024-04-25T15:54:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 --2- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15c290 0x7ff31c166150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 --2- 172.21.15.87:0/92458013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15b940 0x7ff31c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 -- 172.21.15.87:0/92458013 >> 172.21.15.87:0/92458013 conn(0x7ff31c06d780 msgr2=0x7ff31c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f34057c0640 1 Processor -- start 2024-04-25T15:54:27.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 -- 172.21.15.87:0/92458013 shutdown_connections 2024-04-25T15:54:27.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f34057c0640 1 -- start start 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad40c54d0 0x7f9ad41f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad8b76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 0x7f9ad40a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad8b76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 0x7f9ad40a8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:56922/0 (socket says 172.21.15.87:56922) 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad8b76640 1 -- 172.21.15.87:0/1791787783 learned_addr learned my addr 172.21.15.87:0/1791787783 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad415f310 0x7f9ad40a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad3fff640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad40c54d0 0x7f9ad41f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4169120 con 0x7f9ad40c54d0 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40c2b10 con 0x7f9ad40ac870 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad41692a0 con 0x7f9ad415f310 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad9377640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad415f310 0x7f9ad40a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad8b76640 1 -- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad415f310 msgr2=0x7f9ad40a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad8b76640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad415f310 0x7f9ad40a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad8b76640 1 -- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad40c54d0 msgr2=0x7f9ad41f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad8b76640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad40c54d0 0x7f9ad41f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad8b76640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad414e7e0 con 0x7f9ad40ac870 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad8b76640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 0x7f9ad40a8120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400ea10 tx=0x7f9ac400eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4017070 con 0x7f9ad40ac870 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad415c300 con 0x7f9ad40ac870 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad414ea60 con 0x7f9ad40ac870 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac400ca00 con 0x7f9ad40ac870 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400cdf0 con 0x7f9ad40ac870 2024-04-25T15:54:27.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.577+0000 7ff32235f640 1 -- 172.21.15.87:0/92458013 wait complete. 2024-04-25T15:54:27.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7ff32235f640 1 Processor -- start 2024-04-25T15:54:27.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f34057c0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 0x7f34002092b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7f34057c0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 0x7f340016f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 0x7f340016f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 0x7f340016f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60620/0 (socket says 172.21.15.87:60620) 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33feffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 0x7f34002092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33feffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 0x7f34002092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47156/0 (socket says 172.21.15.87:47156) 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 -- 172.21.15.87:0/1649095621 learned_addr learned my addr 172.21.15.87:0/1649095621 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f34057c0640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3400163910 0x7f34000c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9ac401a070 con 0x7f9ad40ac870 2024-04-25T15:54:27.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3400167860 con 0x7f3400163500 2024-04-25T15:54:27.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34000aaef0 con 0x7f3400163910 2024-04-25T15:54:27.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.581+0000 7ff32235f640 1 -- start start 2024-04-25T15:54:27.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff32235f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 0x7ff31c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33ff7fe640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3400163910 0x7f34000c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34000ab860 con 0x7f340016e470 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 -- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 msgr2=0x7f34002092b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 0x7f34002092b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 -- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3400163910 msgr2=0x7f34000c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3400163910 0x7f34000c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340016eac0 con 0x7f3400163500 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff32235f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15b940 0x7ff31c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 0x7ff31c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 0x7ff31c152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60636/0 (socket says 172.21.15.87:60636) 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 -- 172.21.15.87:0/2413563445 learned_addr learned my addr 172.21.15.87:0/2413563445 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15c290 0x7ff31c15e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c166ea0 con 0x7ff31c070d10 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c074130 con 0x7ff31c15b940 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c167020 con 0x7ff31c15c290 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31b7fe640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15b940 0x7ff31c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff3208fc640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15c290 0x7ff31c15e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f9ad17fa640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9ac006f400 0x7f9ac0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9ac408f380 con 0x7f9ad40ac870 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f9ad3fff640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9ac006f400 0x7f9ac0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f9ad3fff640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9ac006f400 0x7f9ac0071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80ad000 tx=0x7f9ac80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7f33fe7fc640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 0x7f340016f3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f33f000fb90 tx=0x7f33f000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33feffd640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 0x7f34002092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33ff7fe640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3400163910 0x7f34000c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f000fe90 con 0x7f3400163500 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f0018070 con 0x7f3400163500 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f000de50 con 0x7f3400163500 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340016eda0 con 0x7f3400163500 2024-04-25T15:54:27.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34000bdaf0 con 0x7f3400163500 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 -- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15c290 msgr2=0x7ff31c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15c290 0x7ff31c15e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 -- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15b940 msgr2=0x7ff31c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15b940 0x7ff31c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.585+0000 7ff31bfff640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c151870 con 0x7ff31c070d10 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff31bfff640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 0x7ff31c152fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c410 tx=0x7ff31000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3100074e0 con 0x7ff31c070d10 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3100047f0 con 0x7ff31c070d10 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310007680 con 0x7ff31c070d10 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31c151b50 con 0x7ff31c070d10 2024-04-25T15:54:27.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31c152110 con 0x7ff31c070d10 2024-04-25T15:54:27.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f33f00050d0 con 0x7f3400163500 2024-04-25T15:54:27.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31c069bb0 con 0x7ff31c070d10 2024-04-25T15:54:27.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.589+0000 7f33e77fe640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ec06f5a0 0x7f33ec071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f33f008f710 con 0x7f3400163500 2024-04-25T15:54:27.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7f33feffd640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ec06f5a0 0x7f33ec071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7f33feffd640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ec06f5a0 0x7f33ec071ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae620 tx=0x7f33f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff310011070 con 0x7ff31c070d10 2024-04-25T15:54:27.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7ff318ff9640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff30406f5f0 0x7ff304071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff31008f5d0 con 0x7ff31c070d10 2024-04-25T15:54:27.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.593+0000 7ff31b7fe640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff30406f5f0 0x7ff304071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.597+0000 7ff31b7fe640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff30406f5f0 0x7ff304071b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0bf690 tx=0x7ff30c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.601+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3400069bb0 con 0x7f3400163500 2024-04-25T15:54:27.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.601+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab40052a0 con 0x7f9ad40ac870 2024-04-25T15:54:27.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.601+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff31005bc40 con 0x7ff31c070d10 2024-04-25T15:54:27.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.613+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33f005bd00 con 0x7f3400163500 2024-04-25T15:54:27.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.613+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ad414e7e0 con 0x7f9ad40ac870 2024-04-25T15:54:27.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.621+0000 7f5411fb9640 1 Processor -- start 2024-04-25T15:54:27.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.621+0000 7f5411fb9640 1 -- start start 2024-04-25T15:54:27.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f5411fb9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f540c06fee0 0x7f540c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f5411fb9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540c0ab760 con 0x7f540c150bd0 2024-04-25T15:54:27.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f5411fb9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540c0aba40 con 0x7f540c1539b0 2024-04-25T15:54:27.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f5411fb9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f540c0abd20 con 0x7f540c06fee0 2024-04-25T15:54:27.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f540c150bd0 0x7f540c157420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59476/0 (socket says 172.21.15.87:59476) 2024-04-25T15:54:27.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540b7fe640 1 -- 172.21.15.87:0/3166906887 learned_addr learned my addr 172.21.15.87:0/3166906887 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540affd640 1 --2- 172.21.15.87:0/3166906887 >> v2:172.21.15.155:3300/0 conn(0x7f540c06fee0 0x7f540c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540a7fc640 1 -- 172.21.15.87:0/3166906887 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327600481 0 0) 0x7f540c0ab760 con 0x7f540c150bd0 2024-04-25T15:54:27.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540a7fc640 1 -- 172.21.15.87:0/3166906887 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f4003530 con 0x7f540c150bd0 2024-04-25T15:54:27.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540affd640 1 -- 172.21.15.87:0/3166906887 >> v1:172.21.15.155:6789/0 conn(0x7f540c1539b0 legacy=0x7f540c153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540affd640 1 -- 172.21.15.87:0/3166906887 >> v1:172.21.15.87:6789/0 conn(0x7f540c150bd0 legacy=0x7f540c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.625+0000 7f540affd640 1 -- 172.21.15.87:0/3166906887 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c0ac000 con 0x7f540c06fee0 2024-04-25T15:54:27.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb316e22640 1 Processor -- start 2024-04-25T15:54:27.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f540affd640 1 --2- 172.21.15.87:0/3166906887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c06fee0 0x7f540c0702f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5404009c80 tx=0x7f540401ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1790a6d5552fd40a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb316e22640 1 -- start start 2024-04-25T15:54:27.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f540a7fc640 1 -- 172.21.15.87:0/3166906887 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54040b4070 con 0x7f540c06fee0 2024-04-25T15:54:27.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f540a7fc640 1 -- 172.21.15.87:0/3166906887 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54040a78e0 con 0x7f540c06fee0 2024-04-25T15:54:27.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f540a7fc640 1 -- 172.21.15.87:0/3166906887 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54040a7c90 con 0x7f540c06fee0 2024-04-25T15:54:27.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 -- 172.21.15.87:0/3166906887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c06fee0 msgr2=0x7f540c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 --2- 172.21.15.87:0/3166906887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c06fee0 0x7f540c0702f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5404009c80 tx=0x7f540401ea10 comp rx=0 tx=0).stop 2024-04-25T15:54:27.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb316e22640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb31015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb316e22640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31015f400 con 0x7fb3100c4940 2024-04-25T15:54:27.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb316e22640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31015f6e0 con 0x7fb31015c320 2024-04-25T15:54:27.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb316e22640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb31015f9c0 con 0x7fb31015edf0 2024-04-25T15:54:27.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb314bbe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb3100c4940 0x7fb31006ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59492/0 (socket says 172.21.15.87:59492) 2024-04-25T15:54:27.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb314bbe640 1 -- 172.21.15.87:0/4004675922 learned_addr learned my addr 172.21.15.87:0/4004675922 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb30ffff640 1 --2- 172.21.15.87:0/4004675922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb31015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 -- 172.21.15.87:0/3166906887 shutdown_connections 2024-04-25T15:54:27.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 --2- 172.21.15.87:0/3166906887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c06fee0 0x7f540c0702f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 -- 172.21.15.87:0/3166906887 >> 172.21.15.87:0/3166906887 conn(0x7f540c0c8ba0 msgr2=0x7f540c0c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 -- 172.21.15.87:0/3166906887 shutdown_connections 2024-04-25T15:54:27.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb30ffff640 1 -- 172.21.15.87:0/4004675922 >> v1:172.21.15.155:6789/0 conn(0x7fb31015c320 legacy=0x7fb3101661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb30ffff640 1 -- 172.21.15.87:0/4004675922 >> v1:172.21.15.87:6789/0 conn(0x7fb3100c4940 legacy=0x7fb31006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7fb30ffff640 1 -- 172.21.15.87:0/4004675922 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31015fca0 con 0x7fb31015edf0 2024-04-25T15:54:27.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.629+0000 7f5411fb9640 1 -- 172.21.15.87:0/3166906887 wait complete. 2024-04-25T15:54:27.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.633+0000 7f5411fb9640 1 Processor -- start 2024-04-25T15:54:27.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.633+0000 7f5411fb9640 1 -- start start 2024-04-25T15:54:27.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.633+0000 7fb30ffff640 1 --2- 172.21.15.87:0/4004675922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb31015bde0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097f0 tx=0x7fb30001cd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13f096afe0d3cee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 0x7f540c1fe770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c150bd0 0x7f540c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f540c1539b0 0x7f540c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 0x7f540c1fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 0x7f540c1fe770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60644/0 (socket says 172.21.15.87:60644) 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 -- 172.21.15.87:0/910677874 learned_addr learned my addr 172.21.15.87:0/910677874 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f540c161960 con 0x7f540c06fee0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f540c1617e0 con 0x7f540c150bd0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f540c161ae0 con 0x7f540c1539b0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540affd640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c150bd0 0x7f540c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540bfff640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f540c1539b0 0x7f540c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 -- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f540c1539b0 msgr2=0x7f540c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f540c1539b0 0x7f540c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 -- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c150bd0 msgr2=0x7f540c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c150bd0 0x7f540c155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540c0c7bf0 con 0x7f540c06fee0 2024-04-25T15:54:27.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f540b7fe640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 0x7f540c1fe770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00d5c0 tx=0x7f53fc00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7fb30f7fe640 1 -- 172.21.15.87:0/4004675922 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000b0070 con 0x7fb31015edf0 2024-04-25T15:54:27.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc007050 con 0x7f540c06fee0 2024-04-25T15:54:27.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7fb30f7fe640 1 -- 172.21.15.87:0/4004675922 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3000ab400 con 0x7fb31015edf0 2024-04-25T15:54:27.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7fb30f7fe640 1 -- 172.21.15.87:0/4004675922 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000ab7d0 con 0x7fb31015edf0 2024-04-25T15:54:27.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc0088a0 con 0x7f540c06fee0 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc008c90 con 0x7f540c06fee0 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540c0c7e90 con 0x7f540c06fee0 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7f5411fb9640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540c0c6190 con 0x7f540c06fee0 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7fb316e22640 1 -- 172.21.15.87:0/4004675922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 msgr2=0x7fb31015bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.637+0000 7fb316e22640 1 --2- 172.21.15.87:0/4004675922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb31015bde0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097f0 tx=0x7fb30001cd40 comp rx=0 tx=0).stop 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb316e22640 1 -- 172.21.15.87:0/4004675922 shutdown_connections 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb316e22640 1 --2- 172.21.15.87:0/4004675922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb31015bde0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb316e22640 1 -- 172.21.15.87:0/4004675922 >> 172.21.15.87:0/4004675922 conn(0x7fb3100c8770 msgr2=0x7fb3100c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb06d9a6640 1 Processor -- start 2024-04-25T15:54:27.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb06d9a6640 1 -- start start 2024-04-25T15:54:27.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb316e22640 1 -- 172.21.15.87:0/4004675922 shutdown_connections 2024-04-25T15:54:27.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb06d9a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb060047db0 0x7fb0600dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb0677fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb06003e9e0 0x7fb0600e9980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59508/0 (socket says 172.21.15.87:59508) 2024-04-25T15:54:27.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f53fc010420 con 0x7f540c06fee0 2024-04-25T15:54:27.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7f53f3fff640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f806f4d0 0x7f53f80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f53fc08f9b0 con 0x7f540c06fee0 2024-04-25T15:54:27.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7f540affd640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f806f4d0 0x7f53f80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb316e22640 1 -- 172.21.15.87:0/4004675922 wait complete. 2024-04-25T15:54:27.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb0677fe640 1 -- 172.21.15.87:0/2402435722 learned_addr learned my addr 172.21.15.87:0/2402435722 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb0667fc640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb060047db0 0x7fb0600dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06000b5b0 con 0x7fb06003e9e0 2024-04-25T15:54:27.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.641+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540c069bb0 con 0x7f540c06fee0 2024-04-25T15:54:27.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06000bbf0 con 0x7fb060046390 2024-04-25T15:54:27.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595983524 0 0) 0x7fb06000b5b0 con 0x7fb06003e9e0 2024-04-25T15:54:27.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 Processor -- start 2024-04-25T15:54:27.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb06000b9a0 con 0x7fb060047db0 2024-04-25T15:54:27.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7f540affd640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f806f4d0 0x7f53f80719e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54040b1000 tx=0x7f540400e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb050003530 con 0x7fb06003e9e0 2024-04-25T15:54:27.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 -- start start 2024-04-25T15:54:27.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366584881 0 0) 0x7fb06000bbf0 con 0x7fb060046390 2024-04-25T15:54:27.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb06000b5b0 con 0x7fb060046390 2024-04-25T15:54:27.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2578264952 0 0) 0x7fb06000b5b0 con 0x7fb060046390 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb060047db0 msgr2=0x7fb0600dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb060047db0 0x7fb0600dc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 >> v1:172.21.15.87:6789/0 conn(0x7fb06003e9e0 legacy=0x7fb0600e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb060007570 con 0x7fb060046390 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb068076e70 con 0x7fb060046390 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 >> v1:172.21.15.155:6789/0 conn(0x7fb060046390 legacy=0x7fb060049910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb050003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb050004810 0x7fb050004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0500051b0 0x7fb05000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb06000b9a0 con 0x7fb050004810 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb05000c0d0 con 0x7fb050003b50 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb05000c2d0 con 0x7fb0500051b0 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb050003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb0677fe640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0500051b0 0x7fb05000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3100c4940 0x7fb31014c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb31015c320 0x7fb310143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb3101f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb31006f610 con 0x7fb3100c4940 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb31015c730 con 0x7fb31015c320 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb316e22640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb31006f790 con 0x7fb31015edf0 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb30ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb31015c320 0x7fb310143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb3101f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb3101f5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47196/0 (socket says 172.21.15.87:47196) 2024-04-25T15:54:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 -- 172.21.15.87:0/1545746154 learned_addr learned my addr 172.21.15.87:0/1545746154 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb066ffd640 1 -- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0500051b0 msgr2=0x7fb05000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0500051b0 0x7fb05000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb066ffd640 1 -- 172.21.15.87:0/2402435722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb050004810 msgr2=0x7fb050004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb050004810 0x7fb050004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb066ffd640 1 -- 172.21.15.87:0/2402435722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb060007570 con 0x7fb050003b50 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 -- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb31015c320 msgr2=0x7fb310143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb31015c320 0x7fb310143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 -- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3100c4940 msgr2=0x7fb31014c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3100c4940 0x7fb31014c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 -- 172.21.15.87:0/1545746154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31014e170 con 0x7fb31015edf0 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.645+0000 7fb3153bf640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb3101f5490 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c390 tx=0x7fb30400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040052d0 con 0x7fb31015edf0 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb304005470 con 0x7fb31015edf0 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb310150930 con 0x7fb31015edf0 2024-04-25T15:54:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3100c6b70 con 0x7fb31015edf0 2024-04-25T15:54:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304007240 con 0x7fb31015edf0 2024-04-25T15:54:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb050003fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0680755f0 tx=0x7fb068099ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f99dc4f2e367196c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f00052a0 con 0x7fb31015edf0 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068069a30 con 0x7fb050003b50 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0681266b0 con 0x7fb050003b50 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb065ffb640 1 -- 172.21.15.87:0/2402435722 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068126aa0 con 0x7fb050003b50 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 msgr2=0x7fb050003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2402435722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb050003fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0680755f0 tx=0x7fb068099ab0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb0677fe640 1 -- 172.21.15.87:0/2402435722 reap_dead start 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 shutdown_connections 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 >> 172.21.15.87:0/2402435722 conn(0x7fb0600060a0 msgr2=0x7fb0600064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 shutdown_connections 2024-04-25T15:54:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb3040073e0 con 0x7fb31015edf0 2024-04-25T15:54:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7fb30d7fa640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb2fc06f400 0x7fb2fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb30408eaa0 con 0x7fb31015edf0 2024-04-25T15:54:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.649+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2402435722 wait complete. 2024-04-25T15:54:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7fb314bbe640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb2fc06f400 0x7fb2fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7fb314bbe640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb2fc06f400 0x7fb2fc071910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb31006fa90 tx=0x7fb308007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7fb06d9a6640 1 Processor -- start 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7fb06d9a6640 1 -- start start 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb06017c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0600d4380 0x7fb0600d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 0x7fb0600d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0600dfb60 con 0x7fb0600d7710 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0600dcb60 con 0x7fb050003b50 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb06003f200 con 0x7fb0600d4380 2024-04-25T15:54:27.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 0x7fb0600d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 0x7fb0600d33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60674/0 (socket says 172.21.15.87:60674) 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 -- 172.21.15.87:0/2713252459 learned_addr learned my addr 172.21.15.87:0/2713252459 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb06017c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0667fc640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0600d4380 0x7fb0600d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 -- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0600d4380 msgr2=0x7fb0600d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0600d4380 0x7fb0600d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 -- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 msgr2=0x7fb06017c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb06017c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 -- 172.21.15.87:0/2713252459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06017cec0 con 0x7fb0600d7710 2024-04-25T15:54:27.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.653+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f53fc014030 con 0x7f540c06fee0 2024-04-25T15:54:27.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb0677fe640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 0x7fb0600d33a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb06000dba0 tx=0x7fb0580018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058011580 con 0x7fb0600d7710 2024-04-25T15:54:27.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0600eaaa0 con 0x7fb0600d7710 2024-04-25T15:54:27.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0600d9050 con 0x7fb0600d7710 2024-04-25T15:54:27.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058011740 con 0x7fb0600d7710 2024-04-25T15:54:27.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058011930 con 0x7fb0600d7710 2024-04-25T15:54:27.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.657+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0600d4030 con 0x7fb0600d7710 2024-04-25T15:54:27.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.661+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb05801a020 con 0x7fb0600d7710 2024-04-25T15:54:27.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.661+0000 7fb04ffff640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb05406f480 0x7fb054071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.661+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb05406f480 0x7fb054071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.661+0000 7fb066ffd640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb05406f480 0x7fb054071990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c2a0 tx=0x7fb068069720 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.661+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb058093080 con 0x7fb0600d7710 2024-04-25T15:54:27.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.669+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb05805b060 con 0x7fb0600d7710 2024-04-25T15:54:27.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.677+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb30405b090 con 0x7fb31015edf0 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.705+0000 7f476ede4640 1 Processor -- start 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.705+0000 7f476ede4640 1 -- start start 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476ede4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4768074d80 0x7f476806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476ede4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4768070420 0x7f476808d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476ede4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4768168400 con 0x7f47680abd40 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476ede4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4768167580 con 0x7f4768070420 2024-04-25T15:54:27.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476ede4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4768167860 con 0x7f4768074d80 2024-04-25T15:54:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f4767fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4768074d80 0x7f476806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476cb80640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f47680abd40 0x7f4768167cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:51230/0 (socket says 172.21.15.87:51230) 2024-04-25T15:54:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476cb80640 1 -- 172.21.15.87:0/3021480101 learned_addr learned my addr 172.21.15.87:0/3021480101 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f476d381640 1 --2- 172.21.15.87:0/3021480101 >> v2:172.21.15.87:3300/0 conn(0x7f4768070420 0x7f476808d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f4767fff640 1 -- 172.21.15.87:0/3021480101 >> v2:172.21.15.87:3300/0 conn(0x7f4768070420 msgr2=0x7f476808d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f4767fff640 1 --2- 172.21.15.87:0/3021480101 >> v2:172.21.15.87:3300/0 conn(0x7f4768070420 0x7f476808d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f4767fff640 1 -- 172.21.15.87:0/3021480101 >> v1:172.21.15.155:6789/0 conn(0x7f47680abd40 legacy=0x7f4768167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.709+0000 7f4767fff640 1 -- 172.21.15.87:0/3021480101 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4768164ab0 con 0x7f4768074d80 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.713+0000 7f476d381640 1 --2- 172.21.15.87:0/3021480101 >> v2:172.21.15.87:3300/0 conn(0x7f4768070420 0x7f476808d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.713+0000 7f4767fff640 1 --2- 172.21.15.87:0/3021480101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 0x7f476806fee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4768167700 tx=0x7f4758024890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66767a49bed4a717 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.713+0000 7f47677fe640 1 -- 172.21.15.87:0/3021480101 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47580b43f0 con 0x7f4768074d80 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.713+0000 7f47677fe640 1 -- 172.21.15.87:0/3021480101 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47680ab860 con 0x7f4768074d80 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.717+0000 7f476ede4640 1 -- 172.21.15.87:0/3021480101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 msgr2=0x7f476806fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.717+0000 7f476ede4640 1 --2- 172.21.15.87:0/3021480101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 0x7f476806fee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4768167700 tx=0x7f4758024890 comp rx=0 tx=0).stop 2024-04-25T15:54:27.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 -- 172.21.15.87:0/3021480101 shutdown_connections 2024-04-25T15:54:27.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 --2- 172.21.15.87:0/3021480101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 0x7f476806fee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 --2- 172.21.15.87:0/3021480101 >> v2:172.21.15.87:3300/0 conn(0x7f4768070420 0x7f476808d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 -- 172.21.15.87:0/3021480101 >> 172.21.15.87:0/3021480101 conn(0x7f47680c8ba0 msgr2=0x7f47680c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 -- 172.21.15.87:0/3021480101 shutdown_connections 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 -- 172.21.15.87:0/3021480101 wait complete. 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 Processor -- start 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.725+0000 7f476ede4640 1 -- start start 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476ede4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 0x7f47680c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 0x7f47680c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 0x7f47680c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60700/0 (socket says 172.21.15.87:60700) 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 -- 172.21.15.87:0/1430080918 learned_addr learned my addr 172.21.15.87:0/1430080918 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:27.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476ede4640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 0x7f4768162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476ede4640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47680abd40 0x7f47681634d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476ede4640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f476808d9c0 con 0x7f4768070420 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476ede4640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f47680aaf30 con 0x7f4768074d80 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476ede4640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f476808db40 con 0x7f47680abd40 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 -- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47680abd40 msgr2=0x7f47681634d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47680abd40 0x7f47681634d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 -- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 msgr2=0x7f4768162f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 0x7f4768162f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47680c67e0 con 0x7f4768070420 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.729+0000 7f476cb80640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 0x7f47680c6cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f476000cb50 tx=0x7f476000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.733+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760018070 con 0x7f4768070420 2024-04-25T15:54:27.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.733+0000 7f476ede4640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4768163a10 con 0x7f4768070420 2024-04-25T15:54:27.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.733+0000 7f476ede4640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476808a4f0 con 0x7f4768070420 2024-04-25T15:54:27.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476000ce50 con 0x7f4768070420 2024-04-25T15:54:27.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476000ab40 con 0x7f4768070420 2024-04-25T15:54:27.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f476001b070 con 0x7f4768070420 2024-04-25T15:54:27.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f47657fa640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f474c06f500 0x7f474c071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:27.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f4767fff640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f474c06f500 0x7f474c071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:27.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f476008ec20 con 0x7f4768070420 2024-04-25T15:54:27.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f4767fff640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f474c06f500 0x7f474c071a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f47580b5000 tx=0x7f4758004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:27.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.737+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47440052a0 con 0x7f4768070420 2024-04-25T15:54:27.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.749+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f476005b8b0 con 0x7f4768070420 2024-04-25T15:54:27.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.889+0000 7f34057c0640 1 -- 172.21.15.87:0/1649095621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f34000ac1e0 con 0x7f3400163500 2024-04-25T15:54:27.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.889+0000 7f33e77fe640 1 -- 172.21.15.87:0/1649095621 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33f0060000 con 0x7f3400163500 2024-04-25T15:54:27.892 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-04-25T15:54:27.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 -- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ec06f5a0 msgr2=0x7f33ec071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ec06f5a0 0x7f33ec071ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae620 tx=0x7f33f8009040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 -- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 msgr2=0x7f340016f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 0x7f340016f3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f33f000fb90 tx=0x7f33f000d520 comp rx=0 tx=0).stop 2024-04-25T15:54:27.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 -- 172.21.15.87:0/1649095621 shutdown_connections 2024-04-25T15:54:27.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ec06f5a0 0x7f33ec071ab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3400163910 0x7f34000c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3400163500 0x7f340016f3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 --2- 172.21.15.87:0/1649095621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f340016e470 0x7f34002092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 -- 172.21.15.87:0/1649095621 >> 172.21.15.87:0/1649095621 conn(0x7f34000c8ba0 msgr2=0x7f3400165be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 -- 172.21.15.87:0/1649095621 shutdown_connections 2024-04-25T15:54:27.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.893+0000 7f33e57fa640 1 -- 172.21.15.87:0/1649095621 wait complete. 2024-04-25T15:54:27.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.897+0000 7f50e9acd640 1 -- 172.21.15.87:0/2618568201 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f50e4063e60 con 0x7f50e4150730 2024-04-25T15:54:27.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.897+0000 7f50e17fa640 1 -- 172.21.15.87:0/2618568201 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50d805bc20 con 0x7f50e4150730 2024-04-25T15:54:27.900 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 -- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50c806f400 msgr2=0x7f50c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50c806f400 0x7f50c8071910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f50d40af000 tx=0x7f50d40a7070 comp rx=0 tx=0).stop 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 -- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 msgr2=0x7f50e4148690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 0x7f50e4148690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50d800e820 tx=0x7f50d800ece0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 -- 172.21.15.87:0/2618568201 shutdown_connections 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50c806f400 0x7f50c8071910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e4150730 0x7f50e4148690 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50e40c5ae0 0x7f50e4154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 --2- 172.21.15.87:0/2618568201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50e40c56d0 0x7f50e40c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 -- 172.21.15.87:0/2618568201 >> 172.21.15.87:0/2618568201 conn(0x7f50e40c8490 msgr2=0x7f50e4153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 -- 172.21.15.87:0/2618568201 shutdown_connections 2024-04-25T15:54:27.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.905+0000 7f50d2ffd640 1 -- 172.21.15.87:0/2618568201 wait complete. 2024-04-25T15:54:27.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.917+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff31c0aebd0 con 0x7ff31c070d10 2024-04-25T15:54:27.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.917+0000 7ff318ff9640 1 -- 172.21.15.87:0/2413563445 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff310064280 con 0x7ff31c070d10 2024-04-25T15:54:27.920 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-04-25T15:54:27.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff30406f5f0 msgr2=0x7ff304071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff30406f5f0 0x7ff304071b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0bf690 tx=0x7ff30c009190 comp rx=0 tx=0).stop 2024-04-25T15:54:27.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 msgr2=0x7ff31c152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 0x7ff31c152fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c410 tx=0x7ff31000c8d0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 shutdown_connections 2024-04-25T15:54:27.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff30406f5f0 0x7ff304071b00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c15c290 0x7ff31c15e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c15b940 0x7ff31c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 --2- 172.21.15.87:0/2413563445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c070d10 0x7ff31c152fb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 >> 172.21.15.87:0/2413563445 conn(0x7ff31c06d780 msgr2=0x7ff31c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-04-25T15:54:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.921+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 shutdown_connections 2024-04-25T15:54:27.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.925+0000 7ff32235f640 1 -- 172.21.15.87:0/2413563445 wait complete. 2024-04-25T15:54:27.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2024-04-25T15:54:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.933+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9ab4005860 con 0x7f9ad40ac870 2024-04-25T15:54:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.933+0000 7f9ad17fa640 1 -- 172.21.15.87:0/1791787783 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ac405b980 con 0x7f9ad40ac870 2024-04-25T15:54:27.935 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-04-25T15:54:27.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9ac006f400 msgr2=0x7f9ac0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9ac006f400 0x7f9ac0071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80ad000 tx=0x7f9ac80a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:27.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 msgr2=0x7f9ad40a8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 0x7f9ad40a8120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400ea10 tx=0x7f9ac400eed0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 shutdown_connections 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9ac006f400 0x7f9ac0071910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ad415f310 0x7f9ad40a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad40c54d0 0x7f9ad41f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 --2- 172.21.15.87:0/1791787783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ad40ac870 0x7f9ad40a8120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 >> 172.21.15.87:0/1791787783 conn(0x7f9ad40ac0e0 msgr2=0x7f9ad4158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 shutdown_connections 2024-04-25T15:54:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.937+0000 7f9ad9b78640 1 -- 172.21.15.87:0/1791787783 wait complete. 2024-04-25T15:54:27.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2024-04-25T15:54:27.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2024-04-25T15:54:27.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.961+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb0600e27c0 con 0x7fb0600d7710 2024-04-25T15:54:27.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.961+0000 7fb04ffff640 1 -- 172.21.15.87:0/2713252459 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb05805f360 con 0x7fb0600d7710 2024-04-25T15:54:27.962 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-04-25T15:54:27.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb05406f480 msgr2=0x7fb054071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb05406f480 0x7fb054071990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c2a0 tx=0x7fb068069720 comp rx=0 tx=0).stop 2024-04-25T15:54:27.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 msgr2=0x7fb0600d33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 0x7fb0600d33a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb06000dba0 tx=0x7fb0580018b0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 shutdown_connections 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb05406f480 0x7fb054071990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0600d7710 0x7fb0600d33a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0600d4380 0x7fb0600d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 --2- 172.21.15.87:0/2713252459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb050003b50 0x7fb06017c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 >> 172.21.15.87:0/2713252459 conn(0x7fb0600060a0 msgr2=0x7fb0600e4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 shutdown_connections 2024-04-25T15:54:27.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.965+0000 7fb06d9a6640 1 -- 172.21.15.87:0/2713252459 wait complete. 2024-04-25T15:54:27.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2024-04-25T15:54:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.981+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f540c0c4b50 con 0x7f540c06fee0 2024-04-25T15:54:27.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.981+0000 7f53f3fff640 1 -- 172.21.15.87:0/910677874 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53fc05c670 con 0x7f540c06fee0 2024-04-25T15:54:27.983 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-04-25T15:54:27.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f806f4d0 msgr2=0x7f53f80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f806f4d0 0x7f53f80719e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54040b1000 tx=0x7f540400e040 comp rx=0 tx=0).stop 2024-04-25T15:54:27.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 msgr2=0x7f540c1fe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:27.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 0x7f540c1fe770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00d5c0 tx=0x7f53fc00da80 comp rx=0 tx=0).stop 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 shutdown_connections 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f806f4d0 0x7f53f80719e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f540c1539b0 0x7f540c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f540c150bd0 0x7f540c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 --2- 172.21.15.87:0/910677874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f540c06fee0 0x7f540c1fe770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 >> 172.21.15.87:0/910677874 conn(0x7f540c0c8ba0 msgr2=0x7f540c0ac680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 shutdown_connections 2024-04-25T15:54:27.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:27.985+0000 7f53f1ffb640 1 -- 172.21.15.87:0/910677874 wait complete. 2024-04-25T15:54:28.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.005+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb2f0005860 con 0x7fb31015edf0 2024-04-25T15:54:28.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.005+0000 7fb30d7fa640 1 -- 172.21.15.87:0/1545746154 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb304001010 con 0x7fb31015edf0 2024-04-25T15:54:28.006 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-04-25T15:54:28.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb2fc06f400 msgr2=0x7fb2fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:28.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb2fc06f400 0x7fb2fc071910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb31006fa90 tx=0x7fb308007d10 comp rx=0 tx=0).stop 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 msgr2=0x7fb3101f5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb3101f5490 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c390 tx=0x7fb30400c850 comp rx=0 tx=0).stop 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 shutdown_connections 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb2fc06f400 0x7fb2fc071910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb31015edf0 0x7fb3101f5490 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb31015c320 0x7fb310143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 --2- 172.21.15.87:0/1545746154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3100c4940 0x7fb31014c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 >> 172.21.15.87:0/1545746154 conn(0x7fb3100c8770 msgr2=0x7fb31006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 shutdown_connections 2024-04-25T15:54:28.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7fb316e22640 1 -- 172.21.15.87:0/1545746154 wait complete. 2024-04-25T15:54:28.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.2 2024-04-25T15:54:28.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4744005860 con 0x7f4768070420 2024-04-25T15:54:28.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.009+0000 7f47657fa640 1 -- 172.21.15.87:0/1430080918 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f476005b1b0 con 0x7f4768070420 2024-04-25T15:54:28.012 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f474c06f500 msgr2=0x7f474c071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f474c06f500 0x7f474c071a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f47580b5000 tx=0x7f4758004740 comp rx=0 tx=0).stop 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 msgr2=0x7f47680c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 0x7f47680c6cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f476000cb50 tx=0x7f476000a430 comp rx=0 tx=0).stop 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 shutdown_connections 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f474c06f500 0x7f474c071a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47680abd40 0x7f47681634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4768074d80 0x7f4768162f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 --2- 172.21.15.87:0/1430080918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4768070420 0x7f47680c6cc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 >> 172.21.15.87:0/1430080918 conn(0x7f47680c8ba0 msgr2=0x7f47680ac1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:28.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 shutdown_connections 2024-04-25T15:54:28.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:28.013+0000 7f4756ffd640 1 -- 172.21.15.87:0/1430080918 wait complete. 2024-04-25T15:54:28.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.0 2024-04-25T15:54:28.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2024-04-25T15:54:28.925 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:54:28.934 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:54:28.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:54:28.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:54:28.982 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:54:29.010 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:54:29.028 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:54:29.032 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:54:29.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 Processor -- start 2024-04-25T15:54:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 -- start start 2024-04-25T15:54:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f49b40c6400 0x7f49b40c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49b40c3d40 0x7f49b406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49b40c6810 con 0x7f49b40c4150 2024-04-25T15:54:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f49b40c4770 con 0x7f49b40c6400 2024-04-25T15:54:29.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.121+0000 7f49ba77a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f49b4154110 con 0x7f49b40c3d40 2024-04-25T15:54:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49b40c3d40 0x7f49b406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f49b40c6400 0x7f49b40c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49b40c3d40 0x7f49b406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:57012/0 (socket says 172.21.15.87:57012) 2024-04-25T15:54:29.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b37fe640 1 -- 172.21.15.87:0/708785650 learned_addr learned my addr 172.21.15.87:0/708785650 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b3fff640 1 -- 172.21.15.87:0/708785650 >> v2:172.21.15.155:3300/0 conn(0x7f49b40c3d40 msgr2=0x7f49b406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b3fff640 1 --2- 172.21.15.87:0/708785650 >> v2:172.21.15.155:3300/0 conn(0x7f49b40c3d40 0x7f49b406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b3fff640 1 -- 172.21.15.87:0/708785650 >> v1:172.21.15.87:6789/0 conn(0x7f49b40c4150 legacy=0x7f49b41569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.125+0000 7f49b3fff640 1 -- 172.21.15.87:0/708785650 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b40c8010 con 0x7f49b40c6400 2024-04-25T15:54:29.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49b3fff640 1 --2- 172.21.15.87:0/708785650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c6400 0x7f49b40c7160 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49b40ae870 tx=0x7f49a401ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce34ea6e2f4571cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49b2ffd640 1 -- 172.21.15.87:0/708785650 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a40a5d50 con 0x7f49b40c6400 2024-04-25T15:54:29.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49b2ffd640 1 -- 172.21.15.87:0/708785650 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a40a9070 con 0x7f49b40c6400 2024-04-25T15:54:29.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49b2ffd640 1 -- 172.21.15.87:0/708785650 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a40ad640 con 0x7f49b40c6400 2024-04-25T15:54:29.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 -- 172.21.15.87:0/708785650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c6400 msgr2=0x7f49b40c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 --2- 172.21.15.87:0/708785650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c6400 0x7f49b40c7160 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49b40ae870 tx=0x7f49a401ccb0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 -- 172.21.15.87:0/708785650 shutdown_connections 2024-04-25T15:54:29.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 --2- 172.21.15.87:0/708785650 >> v2:172.21.15.155:3300/0 conn(0x7f49b40c3d40 0x7f49b406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 --2- 172.21.15.87:0/708785650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c6400 0x7f49b40c7160 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 -- 172.21.15.87:0/708785650 >> 172.21.15.87:0/708785650 conn(0x7f49b40c8900 msgr2=0x7f49b40c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 -- 172.21.15.87:0/708785650 shutdown_connections 2024-04-25T15:54:29.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.129+0000 7f49ba77a640 1 -- 172.21.15.87:0/708785650 wait complete. 2024-04-25T15:54:29.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.133+0000 7f49ba77a640 1 Processor -- start 2024-04-25T15:54:29.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.133+0000 7f49ba77a640 1 -- start start 2024-04-25T15:54:29.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 0x7f49b4157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b40c4150 0x7f49b40ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49b40c6400 0x7f49b415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f49b406fb30 con 0x7f49b40c3d40 2024-04-25T15:54:29.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49b406f9b0 con 0x7f49b40c4150 2024-04-25T15:54:29.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49b4160d40 con 0x7f49b40c6400 2024-04-25T15:54:29.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 0x7f49b4157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 0x7f49b4157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60720/0 (socket says 172.21.15.87:60720) 2024-04-25T15:54:29.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 -- 172.21.15.87:0/1840375333 learned_addr learned my addr 172.21.15.87:0/1840375333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b37fe640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b40c4150 0x7f49b40ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b8d17640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49b40c6400 0x7f49b415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 -- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49b40c6400 msgr2=0x7f49b415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49b40c6400 0x7f49b415d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 -- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b40c4150 msgr2=0x7f49b40ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b40c4150 0x7f49b40ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 -- 172.21.15.87:0/1840375333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b4159850 con 0x7f49b40c3d40 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b3fff640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 0x7f49b4157cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f49a40198c0 tx=0x7f49a4019a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a40ba070 con 0x7f49b40c3d40 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 -- 172.21.15.87:0/1840375333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b4072d90 con 0x7f49b40c3d40 2024-04-25T15:54:29.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.137+0000 7f49ba77a640 1 -- 172.21.15.87:0/1840375333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b41f45f0 con 0x7f49b40c3d40 2024-04-25T15:54:29.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.141+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a40ad840 con 0x7f49b40c3d40 2024-04-25T15:54:29.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.141+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a40adc30 con 0x7f49b40c3d40 2024-04-25T15:54:29.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.141+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f49a40bd070 con 0x7f49b40c3d40 2024-04-25T15:54:29.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.141+0000 7f49b0ff9640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f499c06f670 0x7f499c071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.141+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f49a412a700 con 0x7f49b40c3d40 2024-04-25T15:54:29.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.145+0000 7f49b37fe640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f499c06f670 0x7f499c071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.145+0000 7f49b37fe640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f499c06f670 0x7f499c071b80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00cfd0 tx=0x7f49ac00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.145+0000 7f49ba77a640 1 -- 172.21.15.87:0/1840375333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49900052a0 con 0x7f49b40c3d40 2024-04-25T15:54:29.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.153+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49a40c4030 con 0x7f49b40c3d40 2024-04-25T15:54:29.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 Processor -- start 2024-04-25T15:54:29.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 -- start start 2024-04-25T15:54:29.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 0x7f8a700d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a700d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a7004a5e0 0x7f8a7004a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8a700d64d0 con 0x7f8a7004cf90 2024-04-25T15:54:29.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8a700d9750 con 0x7f8a7004a5e0 2024-04-25T15:54:29.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7c8d9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a700dc7a0 con 0x7f8a7004bb30 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 0x7f8a700d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 0x7f8a700d5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60728/0 (socket says 172.21.15.87:60728) 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a7659c640 1 -- 172.21.15.87:0/591449592 learned_addr learned my addr 172.21.15.87:0/591449592 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a76d9d640 1 --2- 172.21.15.87:0/591449592 >> v2:172.21.15.155:3300/0 conn(0x7f8a7004a5e0 0x7f8a7004a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a75d9b640 1 --2- 172.21.15.87:0/591449592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a700d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a75d9b640 1 -- 172.21.15.87:0/591449592 >> v2:172.21.15.155:3300/0 conn(0x7f8a7004a5e0 msgr2=0x7f8a7004a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a75d9b640 1 --2- 172.21.15.87:0/591449592 >> v2:172.21.15.155:3300/0 conn(0x7f8a7004a5e0 0x7f8a7004a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a75d9b640 1 -- 172.21.15.87:0/591449592 >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 msgr2=0x7f8a700d5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.157+0000 7f8a75d9b640 1 --2- 172.21.15.87:0/591449592 >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 0x7f8a700d5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.161+0000 7f8a75d9b640 1 -- 172.21.15.87:0/591449592 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a700dca80 con 0x7f8a7004bb30 2024-04-25T15:54:29.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.161+0000 7f8a7659c640 1 --2- 172.21.15.87:0/591449592 >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 0x7f8a700d5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:29.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.161+0000 7f8a75d9b640 1 --2- 172.21.15.87:0/591449592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a700d9210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000bd60 tx=0x7f8a6801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a37df474b6994b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.161+0000 7f8a7559a640 1 -- 172.21.15.87:0/591449592 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a680b0070 con 0x7f8a7004bb30 2024-04-25T15:54:29.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7559a640 1 -- 172.21.15.87:0/591449592 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68004230 con 0x7f8a7004bb30 2024-04-25T15:54:29.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7559a640 1 -- 172.21.15.87:0/591449592 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68003620 con 0x7f8a7004bb30 2024-04-25T15:54:29.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 Processor -- start 2024-04-25T15:54:29.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/591449592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 msgr2=0x7f8a700d9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/591449592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a700d9210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000bd60 tx=0x7f8a6801c480 comp rx=0 tx=0).stop 2024-04-25T15:54:29.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/591449592 shutdown_connections 2024-04-25T15:54:29.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/591449592 >> v2:172.21.15.155:3300/0 conn(0x7f8a7004a5e0 0x7f8a7004a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/591449592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a700d9210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/591449592 >> v2:172.21.15.87:3300/0 conn(0x7f8a7004cf90 0x7f8a700d5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/591449592 >> 172.21.15.87:0/591449592 conn(0x7f8a7002f970 msgr2=0x7f8a7002fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/591449592 shutdown_connections 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 -- start start 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5bd40a7230 0x7f5bd415b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bd406e870 0x7f5bd40c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd40c3150 con 0x7f5bd40c7fa0 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd415bcc0 con 0x7f5bd406e870 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd9931640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd40c2f00 con 0x7f5bd40a7230 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd27fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bd406e870 0x7f5bd40c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd27fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bd406e870 0x7f5bd40c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60738/0 (socket says 172.21.15.87:60738) 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2302460943 learned_addr learned my addr 172.21.15.87:0/2302460943 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f5bd2ffd640 1 --2- 172.21.15.87:0/2302460943 >> v2:172.21.15.155:3300/0 conn(0x7f5bd40a7230 0x7f5bd415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.165+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/591449592 wait complete. 2024-04-25T15:54:29.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2302460943 >> v2:172.21.15.155:3300/0 conn(0x7f5bd40a7230 msgr2=0x7f5bd415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f5bd27fc640 1 --2- 172.21.15.87:0/2302460943 >> v2:172.21.15.155:3300/0 conn(0x7f5bd40a7230 0x7f5bd415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2302460943 >> v1:172.21.15.155:6789/0 conn(0x7f5bd40c7fa0 legacy=0x7f5bd415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2302460943 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd40a7ea0 con 0x7f5bd406e870 2024-04-25T15:54:29.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f8a7c8d9640 1 Processor -- start 2024-04-25T15:54:29.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f8a7c8d9640 1 -- start start 2024-04-25T15:54:29.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7f5bd27fc640 1 --2- 172.21.15.87:0/2302460943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd406e870 0x7f5bd40c7a60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40714c0 tx=0x7f5bcc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0785e649b1c7f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.169+0000 7ff3a08b0640 1 Processor -- start 2024-04-25T15:54:29.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd1ffb640 1 -- 172.21.15.87:0/2302460943 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0a64c0 con 0x7f5bd406e870 2024-04-25T15:54:29.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd1ffb640 1 -- 172.21.15.87:0/2302460943 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0a6660 con 0x7f5bd406e870 2024-04-25T15:54:29.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd1ffb640 1 -- 172.21.15.87:0/2302460943 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0a6a30 con 0x7f5bd406e870 2024-04-25T15:54:29.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff3a08b0640 1 -- start start 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7c8d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7004a5e0 0x7f8a700d46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7004a5e0 0x7f8a700d46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7004a5e0 0x7f8a700d46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60742/0 (socket says 172.21.15.87:60742) 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7659c640 1 -- 172.21.15.87:0/3846571 learned_addr learned my addr 172.21.15.87:0/3846571 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a70171cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 -- 172.21.15.87:0/2302460943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd406e870 msgr2=0x7f5bd40c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2302460943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd406e870 0x7f5bd40c7a60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40714c0 tx=0x7f5bcc01c8d0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7004cf90 0x7f8a700d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 -- 172.21.15.87:0/2302460943 shutdown_connections 2024-04-25T15:54:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2302460943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd406e870 0x7f5bd40c7a60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2302460943 >> v2:172.21.15.155:3300/0 conn(0x7f5bd40a7230 0x7f5bd415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 -- 172.21.15.87:0/2302460943 >> 172.21.15.87:0/2302460943 conn(0x7f5bd40c8b30 msgr2=0x7f5bd40aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 -- 172.21.15.87:0/2302460943 shutdown_connections 2024-04-25T15:54:29.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7004c0c0 con 0x7f8a7004a5e0 2024-04-25T15:54:29.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a75d9b640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a70171cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a76d9d640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7004cf90 0x7f8a700d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7004bf40 con 0x7f8a7004cf90 2024-04-25T15:54:29.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a70033670 con 0x7f8a7004bb30 2024-04-25T15:54:29.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff3a08b0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 0x7ff394047db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff3a08b0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39400b5b0 con 0x7ff39403e9e0 2024-04-25T15:54:29.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff3a08b0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39400bbf0 con 0x7ff394049910 2024-04-25T15:54:29.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff3a08b0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3940482f0 con 0x7ff394046390 2024-04-25T15:54:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f5bd9931640 1 -- 172.21.15.87:0/2302460943 wait complete. 2024-04-25T15:54:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 0x7ff394047db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 0x7ff394047db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47258/0 (socket says 172.21.15.87:47258) 2024-04-25T15:54:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39b7fe640 1 -- 172.21.15.87:0/939115431 learned_addr learned my addr 172.21.15.87:0/939115431 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39bfff640 1 --1- 172.21.15.87:0/939115431 >> v1:172.21.15.87:6789/0 conn(0x7ff39403e9e0 0x7ff3940e9980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59538/0 (socket says 172.21.15.87:59538) 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39a7fc640 1 -- 172.21.15.87:0/939115431 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992235771 0 0) 0x7ff39400b5b0 con 0x7ff39403e9e0 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39b7fe640 1 -- 172.21.15.87:0/939115431 >> v1:172.21.15.155:6789/0 conn(0x7ff394049910 legacy=0x7ff3940dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39b7fe640 1 -- 172.21.15.87:0/939115431 >> v1:172.21.15.87:6789/0 conn(0x7ff39403e9e0 legacy=0x7ff3940e9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7ff39b7fe640 1 -- 172.21.15.87:0/939115431 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394007570 con 0x7ff394046390 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a76d9d640 1 -- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 msgr2=0x7f8a70171cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a76d9d640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a70171cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a76d9d640 1 -- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7004a5e0 msgr2=0x7f8a700d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a76d9d640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7004a5e0 0x7f8a700d46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.173+0000 7f8a76d9d640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a700ced30 con 0x7f8a7004cf90 2024-04-25T15:54:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a76d9d640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7004cf90 0x7f8a700d7ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a7806c120 tx=0x7f8a7806adb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f5bd9931640 1 Processor -- start 2024-04-25T15:54:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7809f070 con 0x7f8a7004cf90 2024-04-25T15:54:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a700cf010 con 0x7f8a7004cf90 2024-04-25T15:54:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a700d5370 con 0x7f8a7004cf90 2024-04-25T15:54:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f5bd9931640 1 -- start start 2024-04-25T15:54:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a701715a0 con 0x7f8a7004cf90 2024-04-25T15:54:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78091030 con 0x7f8a7004cf90 2024-04-25T15:54:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7806d740 con 0x7f8a7004cf90 2024-04-25T15:54:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7ff39b7fe640 1 --2- 172.21.15.87:0/939115431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 0x7ff394047db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3880098a0 tx=0x7ff38801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b9c05e792202d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7ff39a7fc640 1 -- 172.21.15.87:0/939115431 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3880b0070 con 0x7ff394046390 2024-04-25T15:54:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7ff39a7fc640 1 -- 172.21.15.87:0/939115431 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3880ab600 con 0x7ff394046390 2024-04-25T15:54:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.177+0000 7ff39a7fc640 1 -- 172.21.15.87:0/939115431 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3880ab9d0 con 0x7ff394046390 2024-04-25T15:54:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd406e870 0x7f5bd40bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 0x7f5bd4072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40c7fa0 0x7f5bd4072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd2ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd406e870 0x7f5bd40bd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd2ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd406e870 0x7f5bd40bd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:47270/0 (socket says 172.21.15.87:47270) 2024-04-25T15:54:29.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 0x7f5bd4072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 0x7f5bd4072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60748/0 (socket says 172.21.15.87:60748) 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd2ffd640 1 -- 172.21.15.87:0/2407204217 learned_addr learned my addr 172.21.15.87:0/2407204217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd40a7c50 con 0x7f5bd40a7230 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd406ee90 con 0x7f5bd40c7fa0 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd37fe640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40c7fa0 0x7f5bd4072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd406e3e0 con 0x7f5bd406e870 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7ff3a08b0640 1 -- 172.21.15.87:0/939115431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 msgr2=0x7ff394047db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7ff3a08b0640 1 --2- 172.21.15.87:0/939115431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 0x7ff394047db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff3880098a0 tx=0x7ff38801c460 comp rx=0 tx=0).stop 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd406e870 msgr2=0x7f5bd40bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd406e870 0x7f5bd40bd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40c7fa0 msgr2=0x7f5bd4072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40c7fa0 0x7f5bd4072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd40749b0 con 0x7f5bd40a7230 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd27fc640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 0x7f5bd4072240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0ab000 tx=0x7f5bcc019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7ff3a08b0640 1 -- 172.21.15.87:0/939115431 shutdown_connections 2024-04-25T15:54:29.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7ff3a08b0640 1 --2- 172.21.15.87:0/939115431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394046390 0x7ff394047db0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7ff3a08b0640 1 -- 172.21.15.87:0/939115431 >> 172.21.15.87:0/939115431 conn(0x7ff3940060a0 msgr2=0x7ff3940064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8a7806d8e0 con 0x7f8a7004cf90 2024-04-25T15:54:29.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f8a66ffd640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8a5806f430 0x7f8a58071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8a78113ec0 con 0x7f8a7004cf90 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0bf070 con 0x7f5bd40a7230 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0a6810 con 0x7f5bd40a7230 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0a6bc0 con 0x7f5bd40a7230 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd4074c90 con 0x7f5bd40a7230 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.185+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd4071d20 con 0x7f5bd40a7230 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.181+0000 7f8a7659c640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8a5806f430 0x7f8a58071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.185+0000 7f8a7659c640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8a5806f430 0x7f8a58071940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009630 tx=0x7f8a6c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.185+0000 7ff3a08b0640 1 -- 172.21.15.87:0/939115431 shutdown_connections 2024-04-25T15:54:29.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.185+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd4069a30 con 0x7f5bd40a7230 2024-04-25T15:54:29.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.185+0000 7ff3a08b0640 1 -- 172.21.15.87:0/939115431 wait complete. 2024-04-25T15:54:29.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.185+0000 7ff3a08b0640 1 Processor -- start 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 -- start start 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 0x7ff3940d5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff394046390 0x7ff394040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 0x7ff3940d5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 0x7ff3940d5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60758/0 (socket says 172.21.15.87:60758) 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 -- 172.21.15.87:0/1185983341 learned_addr learned my addr 172.21.15.87:0/1185983341 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394049910 0x7ff394184510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940dfb60 con 0x7ff39403e9e0 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff394007320 con 0x7ff394046390 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39affd640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff394046390 0x7ff394040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff3a08b0640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff394049f30 con 0x7ff394049910 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39bfff640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394049910 0x7ff394184510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 -- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394049910 msgr2=0x7ff394184510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394049910 0x7ff394184510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 -- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff394046390 msgr2=0x7ff394040e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff394046390 0x7ff394040e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7ff39b7fe640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394185170 con 0x7ff39403e9e0 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.193+0000 7ff39b7fe640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 0x7ff3940d5940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff388019070 tx=0x7ff38801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5bcc0af480 con 0x7f5bd40a7230 2024-04-25T15:54:29.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7f5bbbfff640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bc006f4d0 0x7f5bc00719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.189+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5bcc002020 con 0x7f5bd40a7230 2024-04-25T15:54:29.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.193+0000 7f5bd2ffd640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bc006f4d0 0x7f5bc00719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.193+0000 7f5bd2ffd640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bc006f4d0 0x7f5bc00719e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009b80 tx=0x7f5bc4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.193+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a780e04b0 con 0x7f8a7004cf90 2024-04-25T15:54:29.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.197+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3880ba020 con 0x7ff39403e9e0 2024-04-25T15:54:29.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.197+0000 7ff3a08b0640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39403f500 con 0x7ff39403e9e0 2024-04-25T15:54:29.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.197+0000 7ff3a08b0640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3940405f0 con 0x7ff39403e9e0 2024-04-25T15:54:29.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.197+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3880b6620 con 0x7ff39403e9e0 2024-04-25T15:54:29.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.197+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3880b0040 con 0x7ff39403e9e0 2024-04-25T15:54:29.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37c0052a0 con 0x7ff39403e9e0 2024-04-25T15:54:29.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5bcc0165e0 con 0x7f5bd40a7230 2024-04-25T15:54:29.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3880bd020 con 0x7ff39403e9e0 2024-04-25T15:54:29.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7ff387fff640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff38c06f4f0 0x7ff38c071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff388129790 con 0x7ff39403e9e0 2024-04-25T15:54:29.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7ff39affd640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff38c06f4f0 0x7ff38c071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.201+0000 7ff39affd640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff38c06f4f0 0x7ff38c071a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff39c051a60 tx=0x7ff39c06f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.213+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3880c4030 con 0x7ff39403e9e0 2024-04-25T15:54:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 Processor -- start 2024-04-25T15:54:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 -- start start 2024-04-25T15:54:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c6400 0x7ff1680c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680c3d40 0x7ff16806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1680c6810 con 0x7ff1680c4150 2024-04-25T15:54:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff1680c4770 con 0x7ff1680c3d40 2024-04-25T15:54:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16e9e0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff168154110 con 0x7ff1680c6400 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16cf7d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff1680c4150 0x7ff1681569f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59544/0 (socket says 172.21.15.87:59544) 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff1677fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1680c3d40 0x7ff16806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff16cf7d640 1 -- 172.21.15.87:0/3072002266 learned_addr learned my addr 172.21.15.87:0/3072002266 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff167fff640 1 --2- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c6400 0x7ff1680c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff1677fe640 1 -- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c6400 msgr2=0x7ff1680c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff1677fe640 1 --2- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c6400 0x7ff1680c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff1677fe640 1 -- 172.21.15.87:0/3072002266 >> v1:172.21.15.87:6789/0 conn(0x7ff1680c4150 legacy=0x7ff1681569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.233+0000 7ff1677fe640 1 -- 172.21.15.87:0/3072002266 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1680c8010 con 0x7ff1680c3d40 2024-04-25T15:54:29.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.237+0000 7ff1677fe640 1 --2- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c3d40 0x7ff16806e3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff158005a20 tx=0x7ff15801cd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b5c8376000a084 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.237+0000 7ff166ffd640 1 -- 172.21.15.87:0/3072002266 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1580b2070 con 0x7ff1680c3d40 2024-04-25T15:54:29.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.237+0000 7ff166ffd640 1 -- 172.21.15.87:0/3072002266 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1580a5cf0 con 0x7ff1680c3d40 2024-04-25T15:54:29.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 -- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c3d40 msgr2=0x7ff16806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c3d40 0x7ff16806e3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff158005a20 tx=0x7ff15801cd10 comp rx=0 tx=0).stop 2024-04-25T15:54:29.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 -- 172.21.15.87:0/3072002266 shutdown_connections 2024-04-25T15:54:29.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c3d40 0x7ff16806e3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/3072002266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c6400 0x7ff1680c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 -- 172.21.15.87:0/3072002266 >> 172.21.15.87:0/3072002266 conn(0x7ff1680c8900 msgr2=0x7ff1680c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 -- 172.21.15.87:0/3072002266 shutdown_connections 2024-04-25T15:54:29.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.241+0000 7ff16e9e0640 1 -- 172.21.15.87:0/3072002266 wait complete. 2024-04-25T15:54:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 Processor -- start 2024-04-25T15:54:29.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7ff16e9e0640 1 Processor -- start 2024-04-25T15:54:29.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7ff16e9e0640 1 -- start start 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 -- start start 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb54c0c38c0 0x7fb54c072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb54c0709d0 0x7fb54c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54c070de0 con 0x7fb54c0705c0 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb54c0a9180 con 0x7fb54c0709d0 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb55351e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb54c154980 con 0x7fb54c0c38c0 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb54c0709d0 0x7fb54c0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb54c0709d0 0x7fb54c0c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60768/0 (socket says 172.21.15.87:60768) 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 -- 172.21.15.87:0/3138823609 learned_addr learned my addr 172.21.15.87:0/3138823609 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb5512ba640 1 --2- 172.21.15.87:0/3138823609 >> v2:172.21.15.155:3300/0 conn(0x7fb54c0c38c0 0x7fb54c072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7ff16e9e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 0x7ff168159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7ff16e9e0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c4150 0x7ff1680c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 0x7ff168159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 0x7ff168159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60772/0 (socket says 172.21.15.87:60772) 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 -- 172.21.15.87:0/824935227 learned_addr learned my addr 172.21.15.87:0/824935227 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c6400 0x7ff16814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff16806fb30 con 0x7ff1680c3d40 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff16806f9b0 con 0x7ff1680c6400 2024-04-25T15:54:29.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff1677fe640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c4150 0x7ff1680c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff16cf7d640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c6400 0x7ff16814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff168160d40 con 0x7ff1680c4150 2024-04-25T15:54:29.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 -- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c4150 msgr2=0x7ff1680c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c4150 0x7ff1680c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 -- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c6400 msgr2=0x7ff16814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c6400 0x7ff16814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1680c1820 con 0x7ff1680c3d40 2024-04-25T15:54:29.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7ff167fff640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 0x7ff168159030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff16000fd20 tx=0x7ff16000c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 -- 172.21.15.87:0/3138823609 >> v2:172.21.15.155:3300/0 conn(0x7fb54c0c38c0 msgr2=0x7fb54c072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 --2- 172.21.15.87:0/3138823609 >> v2:172.21.15.155:3300/0 conn(0x7fb54c0c38c0 0x7fb54c072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 -- 172.21.15.87:0/3138823609 >> v1:172.21.15.155:6789/0 conn(0x7fb54c0705c0 legacy=0x7fb54c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.245+0000 7fb551abb640 1 -- 172.21.15.87:0/3138823609 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c154c60 con 0x7fb54c0709d0 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7fb551abb640 1 --2- 172.21.15.87:0/3138823609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0709d0 0x7fb54c0c48c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb54c072620 tx=0x7fb54401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776d9f3c9e2dbfbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7fb543fff640 1 -- 172.21.15.87:0/3138823609 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54400b2d0 con 0x7fb54c0709d0 2024-04-25T15:54:29.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.249+0000 7fb543fff640 1 -- 172.21.15.87:0/3138823609 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54400b470 con 0x7fb54c0709d0 2024-04-25T15:54:29.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7fb55351e640 1 -- 172.21.15.87:0/3138823609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0709d0 msgr2=0x7fb54c0c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7fb55351e640 1 --2- 172.21.15.87:0/3138823609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0709d0 0x7fb54c0c48c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb54c072620 tx=0x7fb54401eb20 comp rx=0 tx=0).stop 2024-04-25T15:54:29.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16000a2e0 con 0x7ff1680c3d40 2024-04-25T15:54:29.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff16001a070 con 0x7ff1680c3d40 2024-04-25T15:54:29.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1680c1b00 con 0x7ff1680c3d40 2024-04-25T15:54:29.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160008440 con 0x7ff1680c3d40 2024-04-25T15:54:29.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1680c09d0 con 0x7ff1680c3d40 2024-04-25T15:54:29.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.253+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16806f790 con 0x7ff1680c3d40 2024-04-25T15:54:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7fb55351e640 1 -- 172.21.15.87:0/3138823609 shutdown_connections 2024-04-25T15:54:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7fb55351e640 1 --2- 172.21.15.87:0/3138823609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0709d0 0x7fb54c0c48c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7fb55351e640 1 --2- 172.21.15.87:0/3138823609 >> v2:172.21.15.155:3300/0 conn(0x7fb54c0c38c0 0x7fb54c072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7fb55351e640 1 -- 172.21.15.87:0/3138823609 >> 172.21.15.87:0/3138823609 conn(0x7fb54c0c68d0 msgr2=0x7fb54c06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7fb55351e640 1 -- 172.21.15.87:0/3138823609 shutdown_connections 2024-04-25T15:54:29.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7fb55351e640 1 -- 172.21.15.87:0/3138823609 wait complete. 2024-04-25T15:54:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff160014070 con 0x7ff1680c3d40 2024-04-25T15:54:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7ff164ff9640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff15406f450 0x7ff154071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7ff1677fe640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff15406f450 0x7ff154071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.257+0000 7ff1677fe640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff15406f450 0x7ff154071960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1580af000 tx=0x7ff1580a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 Processor -- start 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 -- start start 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 0x7fb54c156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c0709d0 0x7fb54c1f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c0c38c0 0x7fb54c1f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb5512ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 0x7fb54c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb5512ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 0x7fb54c156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60780/0 (socket says 172.21.15.87:60780) 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb5512ba640 1 -- 172.21.15.87:0/628618084 learned_addr learned my addr 172.21.15.87:0/628618084 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c063a20 con 0x7fb54c0705c0 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.261+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0638a0 con 0x7fb54c0c38c0 2024-04-25T15:54:29.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c063ba0 con 0x7fb54c0709d0 2024-04-25T15:54:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb550ab9640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c0709d0 0x7fb54c1f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb551abb640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c0c38c0 0x7fb54c1f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff160016de0 con 0x7ff1680c3d40 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb5512ba640 1 -- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c0709d0 msgr2=0x7fb54c1f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb5512ba640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c0709d0 0x7fb54c1f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb5512ba640 1 -- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c0c38c0 msgr2=0x7fb54c1f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb5512ba640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c0c38c0 0x7fb54c1f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb5512ba640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c1f9120 con 0x7fb54c0705c0 2024-04-25T15:54:29.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb5512ba640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 0x7fb54c156350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb54800d620 tx=0x7fb54800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff16005d600 con 0x7ff1680c3d40 2024-04-25T15:54:29.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54800b620 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c157b40 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.265+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c14a620 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.269+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54c158060 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.269+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb548019070 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.269+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548007380 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.273+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb54800b9c0 con 0x7fb54c0705c0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.273+0000 7fb541ffb640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb53806f570 0x7fb538071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.273+0000 7fb550ab9640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb53806f570 0x7fb538071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.273+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb54808e5f0 con 0x7fb54c0705c0 2024-04-25T15:54:29.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.277+0000 7fb550ab9640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb53806f570 0x7fb538071a80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0c8540 tx=0x7fb53c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.277+0000 7f1fef2f5640 1 Processor -- start 2024-04-25T15:54:29.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.277+0000 7f1fef2f5640 1 -- start start 2024-04-25T15:54:29.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 Processor -- start 2024-04-25T15:54:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fef2f5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 0x7f1fe80c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fef2f5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8073000 con 0x7f1fe8151790 2024-04-25T15:54:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fef2f5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe80732e0 con 0x7f1fe806ff50 2024-04-25T15:54:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fef2f5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe8074a60 con 0x7f1fe80c4020 2024-04-25T15:54:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fed091640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1fe8151790 0x7f1fe8154c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59560/0 (socket says 172.21.15.87:59560) 2024-04-25T15:54:29.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fed091640 1 -- 172.21.15.87:0/3656583099 learned_addr learned my addr 172.21.15.87:0/3656583099 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:29.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491962462 0 0) 0x7f1fe80732e0 con 0x7f1fe806ff50 2024-04-25T15:54:29.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd4003530 con 0x7f1fe806ff50 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 595997133 0 0) 0x7f1fd4003530 con 0x7f1fe806ff50 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 msgr2=0x7f1fe80c4430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 0x7f1fe80c4430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 >> v1:172.21.15.87:6789/0 conn(0x7f1fe8151790 legacy=0x7f1fe8154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe8074c90 con 0x7f1fe806ff50 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f1fe0001a30 con 0x7f1fe806ff50 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 >> v1:172.21.15.155:6789/0 conn(0x7f1fe806ff50 legacy=0x7f1fe8070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fd40039c0 0x7f1fd4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 0x7f1fd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd4004e70 0x7f1fd40052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd400bce0 con 0x7f1fd4004e70 2024-04-25T15:54:29.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd400be90 con 0x7f1fd40039c0 2024-04-25T15:54:29.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 -- start start 2024-04-25T15:54:29.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd400c090 con 0x7f1fe80c4020 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fded80c3d40 0x7fded806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded80c6810 con 0x7fded80c4150 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fded80c4770 con 0x7fded80c3d40 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.281+0000 7fdedf779640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fded8154110 con 0x7fded80c6400 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdeddd16640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fded80c4150 0x7fded81569f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59570/0 (socket says 172.21.15.87:59570) 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdeddd16640 1 -- 172.21.15.87:0/729175489 learned_addr learned my addr 172.21.15.87:0/729175489 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:29.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdedcd14640 1 --2- 172.21.15.87:0/729175489 >> v2:172.21.15.155:3300/0 conn(0x7fded80c3d40 0x7fded806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdedd515640 1 --2- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed091640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fd40039c0 0x7f1fd4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed892640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd4004e70 0x7f1fd40052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fec890640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 0x7f1fd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdedcd14640 1 -- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 msgr2=0x7fded80c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdedcd14640 1 --2- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdedcd14640 1 -- 172.21.15.87:0/729175489 >> v1:172.21.15.87:6789/0 conn(0x7fded80c4150 legacy=0x7fded81569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fdedcd14640 1 -- 172.21.15.87:0/729175489 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80c8010 con 0x7fded80c3d40 2024-04-25T15:54:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed091640 1 -- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 msgr2=0x7f1fd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed091640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fe80c4020 0x7f1fd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed091640 1 -- 172.21.15.87:0/3656583099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd4004e70 msgr2=0x7f1fd40052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed091640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd4004e70 0x7f1fd40052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed091640 1 -- 172.21.15.87:0/3656583099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd4003530 con 0x7f1fd40039c0 2024-04-25T15:54:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7f1fed892640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd4004e70 0x7f1fd40052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.285+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb54c158060 con 0x7fb54c0705c0 2024-04-25T15:54:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7fdedcd14640 1 --2- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded806e3e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fded400d8a0 tx=0x7fded401e650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced69dcf1ccdef7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fed091640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fd40039c0 0x7f1fd4003e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80018b0 tx=0x7f1fd801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4bd7f2ef6df3b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8001500 con 0x7f1fd40039c0 2024-04-25T15:54:29.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd80a7ca0 con 0x7f1fd40039c0 2024-04-25T15:54:29.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fdffff640 1 -- 172.21.15.87:0/3656583099 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8004af0 con 0x7f1fd40039c0 2024-04-25T15:54:29.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fef2f5640 1 -- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fd40039c0 msgr2=0x7f1fd4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fef2f5640 1 --2- 172.21.15.87:0/3656583099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fd40039c0 0x7f1fd4003e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80018b0 tx=0x7f1fd801ebb0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fed892640 1 -- 172.21.15.87:0/3656583099 reap_dead start 2024-04-25T15:54:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fef2f5640 1 -- 172.21.15.87:0/3656583099 shutdown_connections 2024-04-25T15:54:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.289+0000 7f1fef2f5640 1 -- 172.21.15.87:0/3656583099 >> 172.21.15.87:0/3656583099 conn(0x7f1fe80ca040 msgr2=0x7f1fe80ab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdecffff640 1 -- 172.21.15.87:0/729175489 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded40ae070 con 0x7fded80c3d40 2024-04-25T15:54:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdecffff640 1 -- 172.21.15.87:0/729175489 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded40a8640 con 0x7fded80c3d40 2024-04-25T15:54:29.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 -- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 msgr2=0x7fded806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 --2- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded806e3e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fded400d8a0 tx=0x7fded401e650 comp rx=0 tx=0).stop 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 -- 172.21.15.87:0/729175489 shutdown_connections 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 --2- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded806e3e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 --2- 172.21.15.87:0/729175489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 -- 172.21.15.87:0/729175489 >> 172.21.15.87:0/729175489 conn(0x7fded80c8900 msgr2=0x7fded80c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 -- 172.21.15.87:0/729175489 shutdown_connections 2024-04-25T15:54:29.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.293+0000 7fdedf779640 1 -- 172.21.15.87:0/729175489 wait complete. 2024-04-25T15:54:29.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7f1fef2f5640 1 -- 172.21.15.87:0/3656583099 shutdown_connections 2024-04-25T15:54:29.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 Processor -- start 2024-04-25T15:54:29.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 -- start start 2024-04-25T15:54:29.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7f1fef2f5640 1 -- 172.21.15.87:0/3656583099 wait complete. 2024-04-25T15:54:29.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7f1fef2f5640 1 Processor -- start 2024-04-25T15:54:29.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded80a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded80c4150 0x7fded80a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80bec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fded806fb30 con 0x7fded80c4150 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fded806f9b0 con 0x7fded80c3d40 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedf779640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fded8160d40 con 0x7fded80c6400 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedd515640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded80a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedd515640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded80a6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:57148/0 (socket says 172.21.15.87:57148) 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdedd515640 1 -- 172.21.15.87:0/1651273144 learned_addr learned my addr 172.21.15.87:0/1651273144 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7fdeddd16640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80bec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedd515640 1 -- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 msgr2=0x7fded80bec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedd515640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80bec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedd515640 1 -- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded80c4150 msgr2=0x7fded80a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedd515640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded80c4150 0x7fded80a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedd515640 1 -- 172.21.15.87:0/1651273144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80bdeb0 con 0x7fded80c3d40 2024-04-25T15:54:29.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedd515640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded80a6250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e8d0 tx=0x7fdec800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8017070 con 0x7fded80c3d40 2024-04-25T15:54:29.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded80be190 con 0x7fded80c3d40 2024-04-25T15:54:29.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded80a8b30 con 0x7fded80c3d40 2024-04-25T15:54:29.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.297+0000 7f1fef2f5640 1 -- start start 2024-04-25T15:54:29.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fef2f5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fd40039c0 0x7f1fe8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fef2f5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 0x7f1fe81fa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec800c940 con 0x7fded80c3d40 2024-04-25T15:54:29.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fef2f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 0x7f1fe8152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fec890640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 0x7f1fe81fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fec890640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 0x7f1fe81fa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:57150/0 (socket says 172.21.15.87:57150) 2024-04-25T15:54:29.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 0x7f1fe8152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 0x7f1fe8152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60822/0 (socket says 172.21.15.87:60822) 2024-04-25T15:54:29.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fec890640 1 -- 172.21.15.87:0/304078188 learned_addr learned my addr 172.21.15.87:0/304078188 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fef2f5640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe80735c0 con 0x7f1fe8152040 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fef2f5640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8075000 con 0x7f1fe81f9cf0 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fef2f5640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe8070a70 con 0x7f1fd40039c0 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed091640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fd40039c0 0x7f1fe8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 -- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fd40039c0 msgr2=0x7f1fe8154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fd40039c0 0x7f1fe8154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 -- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 msgr2=0x7f1fe81fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 0x7f1fe81fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe81551e0 con 0x7f1fe8152040 2024-04-25T15:54:29.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fec890640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 0x7f1fe81fa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:29.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec800cd30 con 0x7fded80c3d40 2024-04-25T15:54:29.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fed892640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 0x7f1fe8152450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80729a0 tx=0x7f1fe0011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.301+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000c100 con 0x7f1fe8152040 2024-04-25T15:54:29.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7f1fef2f5640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe8154f40 con 0x7f1fe8152040 2024-04-25T15:54:29.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7f1fef2f5640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe80c1b50 con 0x7f1fe8152040 2024-04-25T15:54:29.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdec801a070 con 0x7fded80c3d40 2024-04-25T15:54:29.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7fdecdffb640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdebc06f430 0x7fdebc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fdec808f590 con 0x7fded80c3d40 2024-04-25T15:54:29.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7fdedcd14640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdebc06f430 0x7fdebc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc80052a0 con 0x7f1fe8152040 2024-04-25T15:54:29.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7fdedcd14640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdebc06f430 0x7fdebc071940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fded40b0000 tx=0x7fded400c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe001b070 con 0x7f1fe8152040 2024-04-25T15:54:29.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.305+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00039b0 con 0x7f1fe8152040 2024-04-25T15:54:29.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.309+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1fe0013040 con 0x7f1fe8152040 2024-04-25T15:54:29.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.309+0000 7f1fddffb640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1fcc06f430 0x7f1fcc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:29.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.309+0000 7f1fed091640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1fcc06f430 0x7f1fcc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:29.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.309+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1fe0090d00 con 0x7f1fe8152040 2024-04-25T15:54:29.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.309+0000 7f1fed091640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1fcc06f430 0x7f1fcc071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80ab000 tx=0x7f1fd80011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:29.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.317+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb80052a0 con 0x7fded80c3d40 2024-04-25T15:54:29.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.317+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1fe005eff0 con 0x7f1fe8152040 2024-04-25T15:54:29.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.333+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdec805bc20 con 0x7fded80c3d40 2024-04-25T15:54:29.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.449+0000 7f49ba77a640 1 -- 172.21.15.87:0/1840375333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4990005590 con 0x7f49b40c3d40 2024-04-25T15:54:29.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.449+0000 7f49b0ff9640 1 -- 172.21.15.87:0/1840375333 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49b4072d90 con 0x7f49b40c3d40 2024-04-25T15:54:29.453 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-04-25T15:54:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 -- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f499c06f670 msgr2=0x7f499c071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f499c06f670 0x7f499c071b80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00cfd0 tx=0x7f49ac00b040 comp rx=0 tx=0).stop 2024-04-25T15:54:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 -- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 msgr2=0x7f49b4157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 0x7f49b4157cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f49a40198c0 tx=0x7f49a4019a50 comp rx=0 tx=0).stop 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 -- 172.21.15.87:0/1840375333 shutdown_connections 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f499c06f670 0x7f499c071b80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49b40c6400 0x7f49b415d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b40c4150 0x7f49b40ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 --2- 172.21.15.87:0/1840375333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49b40c3d40 0x7f49b4157cf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 -- 172.21.15.87:0/1840375333 >> 172.21.15.87:0/1840375333 conn(0x7f49b40c8900 msgr2=0x7f49b40c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 -- 172.21.15.87:0/1840375333 shutdown_connections 2024-04-25T15:54:29.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.453+0000 7f49a27fc640 1 -- 172.21.15.87:0/1840375333 wait complete. 2024-04-25T15:54:29.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-04-25T15:54:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.493+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5bd406f320 con 0x7f5bd40a7230 2024-04-25T15:54:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.493+0000 7f5bbbfff640 1 -- 172.21.15.87:0/2407204217 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5bcc0f5e50 con 0x7f5bd40a7230 2024-04-25T15:54:29.495 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bc006f4d0 msgr2=0x7f5bc00719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bc006f4d0 0x7f5bc00719e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009b80 tx=0x7f5bc4009190 comp rx=0 tx=0).stop 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 msgr2=0x7f5bd4072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 0x7f5bd4072240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0ab000 tx=0x7f5bcc019670 comp rx=0 tx=0).stop 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 shutdown_connections 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bc006f4d0 0x7f5bc00719e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40c7fa0 0x7f5bd4072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40a7230 0x7f5bd4072240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 --2- 172.21.15.87:0/2407204217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd406e870 0x7f5bd40bd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 >> 172.21.15.87:0/2407204217 conn(0x7f5bd40c8b30 msgr2=0x7f5bd4167750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 shutdown_connections 2024-04-25T15:54:29.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.497+0000 7f5bd9931640 1 -- 172.21.15.87:0/2407204217 wait complete. 2024-04-25T15:54:29.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-25T15:54:29.526 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:29.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.529+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8a700cf1e0 con 0x7f8a7004cf90 2024-04-25T15:54:29.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.529+0000 7f8a66ffd640 1 -- 172.21.15.87:0/3846571 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a780e47b0 con 0x7f8a7004cf90 2024-04-25T15:54:29.529 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:29.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.529+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff37c005590 con 0x7ff39403e9e0 2024-04-25T15:54:29.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.529+0000 7ff387fff640 1 -- 172.21.15.87:0/1185983341 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff388016170 con 0x7ff39403e9e0 2024-04-25T15:54:29.530 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:29.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8a5806f430 msgr2=0x7f8a58071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8a5806f430 0x7f8a58071940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009630 tx=0x7f8a6c009240 comp rx=0 tx=0).stop 2024-04-25T15:54:29.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7004cf90 msgr2=0x7f8a700d7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7004cf90 0x7f8a700d7ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a7806c120 tx=0x7f8a7806adb0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 shutdown_connections 2024-04-25T15:54:29.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8a5806f430 0x7f8a58071940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a7004cf90 0x7f8a700d7ef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7004bb30 0x7f8a70171cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 --2- 172.21.15.87:0/3846571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a7004a5e0 0x7f8a700d46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 >> 172.21.15.87:0/3846571 conn(0x7f8a7002f970 msgr2=0x7f8a7002d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 shutdown_connections 2024-04-25T15:54:29.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7f8a7c8d9640 1 -- 172.21.15.87:0/3846571 wait complete. 2024-04-25T15:54:29.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff38c06f4f0 msgr2=0x7ff38c071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff38c06f4f0 0x7ff38c071a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff39c051a60 tx=0x7ff39c06f040 comp rx=0 tx=0).stop 2024-04-25T15:54:29.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 msgr2=0x7ff3940d5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 0x7ff3940d5940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff388019070 tx=0x7ff38801aca0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 shutdown_connections 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff38c06f4f0 0x7ff38c071a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff394049910 0x7ff394184510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff394046390 0x7ff394040e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 --2- 172.21.15.87:0/1185983341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff39403e9e0 0x7ff3940d5940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 >> 172.21.15.87:0/1185983341 conn(0x7ff3940060a0 msgr2=0x7ff39402bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 shutdown_connections 2024-04-25T15:54:29.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.533+0000 7ff385ffb640 1 -- 172.21.15.87:0/1185983341 wait complete. 2024-04-25T15:54:29.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff1680ae4c0 con 0x7ff1680c3d40 2024-04-25T15:54:29.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff164ff9640 1 -- 172.21.15.87:0/824935227 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff160061900 con 0x7ff1680c3d40 2024-04-25T15:54:29.553 INFO:teuthology.orchestra.run.smithi087.stdout:55834574857 2024-04-25T15:54:29.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff15406f450 msgr2=0x7ff154071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff15406f450 0x7ff154071960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1580af000 tx=0x7ff1580a7070 comp rx=0 tx=0).stop 2024-04-25T15:54:29.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 msgr2=0x7ff168159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 0x7ff168159030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff16000fd20 tx=0x7ff16000c480 comp rx=0 tx=0).stop 2024-04-25T15:54:29.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 shutdown_connections 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff15406f450 0x7ff154071960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1680c6400 0x7ff16814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1680c4150 0x7ff1680c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 --2- 172.21.15.87:0/824935227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1680c3d40 0x7ff168159030 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 >> 172.21.15.87:0/824935227 conn(0x7ff1680c8900 msgr2=0x7ff168155490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 shutdown_connections 2024-04-25T15:54:29.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.553+0000 7ff16e9e0640 1 -- 172.21.15.87:0/824935227 wait complete. 2024-04-25T15:54:29.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-25T15:54:29.564 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:29.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-25T15:54:29.565 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:29.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-25T15:54:29.574 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:29.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.585+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb54c069a30 con 0x7fb54c0705c0 2024-04-25T15:54:29.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.585+0000 7fb541ffb640 1 -- 172.21.15.87:0/628618084 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb54805d040 con 0x7fb54c0705c0 2024-04-25T15:54:29.587 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:29.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdeb8005860 con 0x7fded80c3d40 2024-04-25T15:54:29.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb53806f570 msgr2=0x7fb538071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb53806f570 0x7fb538071a80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0c8540 tx=0x7fb53c009060 comp rx=0 tx=0).stop 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 msgr2=0x7fb54c156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 0x7fb54c156350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb54800d620 tx=0x7fb54800dae0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 shutdown_connections 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb53806f570 0x7fb538071a80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb54c0c38c0 0x7fb54c1f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb54c0709d0 0x7fb54c1f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 --2- 172.21.15.87:0/628618084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb54c0705c0 0x7fb54c156350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 >> 172.21.15.87:0/628618084 conn(0x7fb54c0c68d0 msgr2=0x7fb54c0c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 shutdown_connections 2024-04-25T15:54:29.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fb55351e640 1 -- 172.21.15.87:0/628618084 wait complete. 2024-04-25T15:54:29.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdecdffb640 1 -- 172.21.15.87:0/1651273144 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdec805ff20 con 0x7fded80c3d40 2024-04-25T15:54:29.591 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:29.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdebc06f430 msgr2=0x7fdebc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdebc06f430 0x7fdebc071940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fded40b0000 tx=0x7fded400c040 comp rx=0 tx=0).stop 2024-04-25T15:54:29.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 msgr2=0x7fded80a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded80a6250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e8d0 tx=0x7fdec800ed90 comp rx=0 tx=0).stop 2024-04-25T15:54:29.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 shutdown_connections 2024-04-25T15:54:29.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdebc06f430 0x7fdebc071940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fded80c6400 0x7fded80bec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded80c4150 0x7fded80a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 --2- 172.21.15.87:0/1651273144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fded80c3d40 0x7fded80a6250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 >> 172.21.15.87:0/1651273144 conn(0x7fded80c8900 msgr2=0x7fded80ad130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 shutdown_connections 2024-04-25T15:54:29.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.589+0000 7fdedf779640 1 -- 172.21.15.87:0/1651273144 wait complete. 2024-04-25T15:54:29.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.597+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1fc8005860 con 0x7f1fe8152040 2024-04-25T15:54:29.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.597+0000 7f1fddffb640 1 -- 172.21.15.87:0/304078188 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fe00632f0 con 0x7f1fe8152040 2024-04-25T15:54:29.599 INFO:teuthology.orchestra.run.smithi087.stdout:55834574858 2024-04-25T15:54:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1fcc06f430 msgr2=0x7f1fcc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1fcc06f430 0x7f1fcc071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80ab000 tx=0x7f1fd80011a0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 msgr2=0x7f1fe8152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 0x7f1fe8152450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80729a0 tx=0x7f1fe0011dc0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 shutdown_connections 2024-04-25T15:54:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1fcc06f430 0x7f1fcc071940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fe8152040 0x7f1fe8152450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe81f9cf0 0x7f1fe81fa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 --2- 172.21.15.87:0/304078188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fd40039c0 0x7f1fe8154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 >> 172.21.15.87:0/304078188 conn(0x7f1fe80ca040 msgr2=0x7f1fe80ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 shutdown_connections 2024-04-25T15:54:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:29.601+0000 7f1fd37fe640 1 -- 172.21.15.87:0/304078188 wait complete. 2024-04-25T15:54:29.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-25T15:54:29.612 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:29.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-25T15:54:29.613 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:29.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-25T15:54:29.624 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:30.484 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:54:30.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.637+0000 7f41e1085640 1 Processor -- start 2024-04-25T15:54:30.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.637+0000 7f41e1085640 1 -- start start 2024-04-25T15:54:30.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41e1085640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41dc1518b0 0x7f41dc06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41e1085640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41dc0ad160 0x7f41dc0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41e1085640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41dc154fc0 con 0x7f41dc0c4620 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41e1085640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f41dc06ed60 con 0x7f41dc0ad160 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41e1085640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f41dc0acb20 con 0x7f41dc1518b0 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41dc0ad160 0x7f41dc0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41dc0ad160 0x7f41dc0c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60836/0 (socket says 172.21.15.87:60836) 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 -- 172.21.15.87:0/2084864423 learned_addr learned my addr 172.21.15.87:0/2084864423 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41db59e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f41dc0c4620 0x7f41dc157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59572/0 (socket says 172.21.15.87:59572) 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41dad9d640 1 --2- 172.21.15.87:0/2084864423 >> v2:172.21.15.155:3300/0 conn(0x7f41dc1518b0 0x7f41dc06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 -- 172.21.15.87:0/2084864423 >> v2:172.21.15.155:3300/0 conn(0x7f41dc1518b0 msgr2=0x7f41dc06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 --2- 172.21.15.87:0/2084864423 >> v2:172.21.15.155:3300/0 conn(0x7f41dc1518b0 0x7f41dc06f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 -- 172.21.15.87:0/2084864423 >> v1:172.21.15.87:6789/0 conn(0x7f41dc0c4620 legacy=0x7f41dc157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 -- 172.21.15.87:0/2084864423 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc0ace00 con 0x7f41dc0ad160 2024-04-25T15:54:30.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41d9d9b640 1 -- 172.21.15.87:0/2084864423 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678207027 0 0) 0x7f41dc154fc0 con 0x7f41dc0c4620 2024-04-25T15:54:30.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41dad9d640 1 --2- 172.21.15.87:0/2084864423 >> v2:172.21.15.155:3300/0 conn(0x7f41dc1518b0 0x7f41dc06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:30.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41da59c640 1 --2- 172.21.15.87:0/2084864423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0ad160 0x7f41dc0c40e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0c4c70 tx=0x7f41d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dd0aad2c5df4f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:30.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41d9d9b640 1 -- 172.21.15.87:0/2084864423 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00a9400 con 0x7f41dc0ad160 2024-04-25T15:54:30.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41d9d9b640 1 -- 172.21.15.87:0/2084864423 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d00a95a0 con 0x7f41dc0ad160 2024-04-25T15:54:30.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.641+0000 7f41d9d9b640 1 -- 172.21.15.87:0/2084864423 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00a9970 con 0x7f41dc0ad160 2024-04-25T15:54:30.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- 172.21.15.87:0/2084864423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0ad160 msgr2=0x7f41dc0c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 --2- 172.21.15.87:0/2084864423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0ad160 0x7f41dc0c40e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0c4c70 tx=0x7f41d001c520 comp rx=0 tx=0).stop 2024-04-25T15:54:30.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- 172.21.15.87:0/2084864423 shutdown_connections 2024-04-25T15:54:30.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 --2- 172.21.15.87:0/2084864423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0ad160 0x7f41dc0c40e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 --2- 172.21.15.87:0/2084864423 >> v2:172.21.15.155:3300/0 conn(0x7f41dc1518b0 0x7f41dc06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- 172.21.15.87:0/2084864423 >> 172.21.15.87:0/2084864423 conn(0x7f41dc0c8770 msgr2=0x7f41dc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:30.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- 172.21.15.87:0/2084864423 shutdown_connections 2024-04-25T15:54:30.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- 172.21.15.87:0/2084864423 wait complete. 2024-04-25T15:54:30.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 Processor -- start 2024-04-25T15:54:30.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- start start 2024-04-25T15:54:30.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc0ad160 0x7f41dc1f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 0x7f41dc0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc1518b0 0x7f41dc14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc15fd50 con 0x7f41dc0c4620 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc15fbd0 con 0x7f41dc1518b0 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41e1085640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc15fed0 con 0x7f41dc0ad160 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 0x7f41dc0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 0x7f41dc0c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60850/0 (socket says 172.21.15.87:60850) 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 -- 172.21.15.87:0/2491481722 learned_addr learned my addr 172.21.15.87:0/2491481722 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41db59e640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc1518b0 0x7f41dc14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41dad9d640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc0ad160 0x7f41dc1f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 -- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc0ad160 msgr2=0x7f41dc1f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc0ad160 0x7f41dc1f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 -- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc1518b0 msgr2=0x7f41dc14cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc1518b0 0x7f41dc14cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 -- 172.21.15.87:0/2491481722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc0bf8a0 con 0x7f41dc0c4620 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.645+0000 7f41da59c640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 0x7f41dc0c0f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41d001ca00 tx=0x7f41d00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00b1800 con 0x7f41dc0c4620 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d00b19a0 con 0x7f41dc0c4620 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc0bfe40 con 0x7f41dc0c4620 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00b1d50 con 0x7f41dc0c4620 2024-04-25T15:54:30.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc0bfb60 con 0x7f41dc0c4620 2024-04-25T15:54:30.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc1f2ca0 con 0x7f41dc0c4620 2024-04-25T15:54:30.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f41d00c0060 con 0x7f41dc0c4620 2024-04-25T15:54:30.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41c37fe640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41c806f400 0x7f41c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f41d01295e0 con 0x7f41dc0c4620 2024-04-25T15:54:30.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41dad9d640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41c806f400 0x7f41c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.649+0000 7f41dad9d640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41c806f400 0x7f41c8071910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f41cc006fd0 tx=0x7f41cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:30.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.653+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41d00ad020 con 0x7f41dc0c4620 2024-04-25T15:54:30.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.801+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f41dc069bb0 con 0x7f41dc0c4620 2024-04-25T15:54:30.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41c37fe640 1 -- 172.21.15.87:0/2491481722 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41d0016110 con 0x7f41dc0c4620 2024-04-25T15:54:30.805 INFO:teuthology.orchestra.run.smithi087.stdout:55834574857 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41c806f400 msgr2=0x7f41c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41c806f400 0x7f41c8071910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f41cc006fd0 tx=0x7f41cc008040 comp rx=0 tx=0).stop 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 msgr2=0x7f41dc0c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 0x7f41dc0c0f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41d001ca00 tx=0x7f41d00192c0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 shutdown_connections 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41c806f400 0x7f41c8071910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc1518b0 0x7f41dc14cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41dc0c4620 0x7f41dc0c0f10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 --2- 172.21.15.87:0/2491481722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc0ad160 0x7f41dc1f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 >> 172.21.15.87:0/2491481722 conn(0x7f41dc0c8770 msgr2=0x7f41dc151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 shutdown_connections 2024-04-25T15:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.805+0000 7f41e1085640 1 -- 172.21.15.87:0/2491481722 wait complete. 2024-04-25T15:54:30.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-25T15:54:30.825 DEBUG:teuthology.parallel:result is None 2024-04-25T15:54:30.825 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:54:30.825 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:30.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.957+0000 7fc589600640 1 Processor -- start 2024-04-25T15:54:30.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.957+0000 7fc589600640 1 -- start start 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc589600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5841518b0 0x7fc58406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc589600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc58406fa10 0x7fc58415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc589600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc584154fc0 con 0x7fc5840ad160 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc589600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc58406ed60 con 0x7fc58406fa10 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc589600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5840acb20 con 0x7fc5841518b0 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc58406fa10 0x7fc58415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc58406fa10 0x7fc58415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60862/0 (socket says 172.21.15.87:60862) 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 -- 172.21.15.87:0/770997858 learned_addr learned my addr 172.21.15.87:0/770997858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:30.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc57bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc5840ad160 0x7fc5840c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59578/0 (socket says 172.21.15.87:59578) 2024-04-25T15:54:30.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 -- 172.21.15.87:0/770997858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5841518b0 msgr2=0x7fc58406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:30.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 --2- 172.21.15.87:0/770997858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5841518b0 0x7fc58406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 -- 172.21.15.87:0/770997858 >> v1:172.21.15.87:6789/0 conn(0x7fc5840ad160 legacy=0x7fc5840c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 -- 172.21.15.87:0/770997858 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5840ace00 con 0x7fc58406fa10 2024-04-25T15:54:30.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5827fc640 1 -- 172.21.15.87:0/770997858 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889438284 0 0) 0x7fc584154fc0 con 0x7fc5840ad160 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5837fe640 1 --2- 172.21.15.87:0/770997858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406fa10 0x7fc58415e9b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009e50 tx=0x7fc57c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0f923bf257680b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5827fc640 1 -- 172.21.15.87:0/770997858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0a5850 con 0x7fc58406fa10 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5827fc640 1 -- 172.21.15.87:0/770997858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57c0a59f0 con 0x7fc58406fa10 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.961+0000 7fc5827fc640 1 -- 172.21.15.87:0/770997858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0a5dc0 con 0x7fc58406fa10 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- 172.21.15.87:0/770997858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406fa10 msgr2=0x7fc58415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 --2- 172.21.15.87:0/770997858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406fa10 0x7fc58415e9b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009e50 tx=0x7fc57c01ca50 comp rx=0 tx=0).stop 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- 172.21.15.87:0/770997858 shutdown_connections 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 --2- 172.21.15.87:0/770997858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406fa10 0x7fc58415e9b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 --2- 172.21.15.87:0/770997858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5841518b0 0x7fc58406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- 172.21.15.87:0/770997858 >> 172.21.15.87:0/770997858 conn(0x7fc5840c8770 msgr2=0x7fc5840c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:30.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- 172.21.15.87:0/770997858 shutdown_connections 2024-04-25T15:54:30.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- 172.21.15.87:0/770997858 wait complete. 2024-04-25T15:54:30.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 Processor -- start 2024-04-25T15:54:30.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- start start 2024-04-25T15:54:30.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58406fa10 0x7fc584148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5840ad160 0x7fc5841eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 0x7fc584152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc584161710 con 0x7fc5841518b0 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc584161890 con 0x7fc58406fa10 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc589600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc584161a10 con 0x7fc5840ad160 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 0x7fc584152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 0x7fc584152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34940/0 (socket says 172.21.15.87:34940) 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 -- 172.21.15.87:0/2994794441 learned_addr learned my addr 172.21.15.87:0/2994794441 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 -- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5840ad160 msgr2=0x7fc5841eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc57bfff640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5840ad160 0x7fc5841eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc582ffd640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58406fa10 0x7fc584148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5840ad160 0x7fc5841eebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 -- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58406fa10 msgr2=0x7fc584148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58406fa10 0x7fc584148300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:30.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 -- 172.21.15.87:0/2994794441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5841f22d0 con 0x7fc5841518b0 2024-04-25T15:54:30.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.965+0000 7fc5837fe640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 0x7fc584152910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009e50 tx=0x7fc57c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:30.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c009270 con 0x7fc5841518b0 2024-04-25T15:54:30.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57c0be070 con 0x7fc5841518b0 2024-04-25T15:54:30.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5841f25b0 con 0x7fc5841518b0 2024-04-25T15:54:30.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0b8ae0 con 0x7fc5841518b0 2024-04-25T15:54:30.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5840c26a0 con 0x7fc5841518b0 2024-04-25T15:54:30.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc584069bb0 con 0x7fc5841518b0 2024-04-25T15:54:30.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc57c0b8c80 con 0x7fc5841518b0 2024-04-25T15:54:30.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc57b7fe640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc56406f400 0x7fc564071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:30.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc57c12b270 con 0x7fc5841518b0 2024-04-25T15:54:30.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc582ffd640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc56406f400 0x7fc564071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:30.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.969+0000 7fc582ffd640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc56406f400 0x7fc564071910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5840aad60 tx=0x7fc574008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:30.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:30.973+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc57c016640 con 0x7fc5841518b0 2024-04-25T15:54:31.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.117+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5840abfa0 con 0x7fc56406f400 2024-04-25T15:54:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.129+0000 7fc57b7fe640 1 -- 172.21.15.87:0/2994794441 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490295 (secure 0 0 0) 0x7fc5840abfa0 con 0x7fc56406f400 2024-04-25T15:54:31.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:31.140 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc56406f400 msgr2=0x7fc564071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc56406f400 0x7fc564071910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc5840aad60 tx=0x7fc574008040 comp rx=0 tx=0).stop 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 msgr2=0x7fc584152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 0x7fc584152910 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009e50 tx=0x7fc57c0197f0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 shutdown_connections 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc56406f400 0x7fc564071910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5841518b0 0x7fc584152910 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5840ad160 0x7fc5841eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 --2- 172.21.15.87:0/2994794441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58406fa10 0x7fc584148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 >> 172.21.15.87:0/2994794441 conn(0x7fc5840c8770 msgr2=0x7fc5840c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 shutdown_connections 2024-04-25T15:54:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.137+0000 7fc589600640 1 -- 172.21.15.87:0/2994794441 wait complete. 2024-04-25T15:54:31.157 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T15:54:31.108425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004265"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391405+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:21.391405+0000","last_peered":"2024-04-25T15:54:21.391405+0000","last_clean":"2024-04-25T15:54:21.391405+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:21.391405+0000","last_undegraded":"2024-04-25T15:54:21.391405+0000","last_fullsized":"2024-04-25T15:54:21.391405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437024+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:21.437024+0000","last_peered":"2024-04-25T15:54:21.437024+0000","last_clean":"2024-04-25T15:54:21.437024+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:21.437024+0000","last_undegraded":"2024-04-25T15:54:21.437024+0000","last_fullsized":"2024-04-25T15:54:21.437024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923430+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:21.923430+0000","last_peered":"2024-04-25T15:54:21.923430+0000","last_clean":"2024-04-25T15:54:21.923430+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:21.923430+0000","last_undegraded":"2024-04-25T15:54:21.923430+0000","last_fullsized":"2024-04-25T15:54:21.923430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921812+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:21.921812+0000","last_peered":"2024-04-25T15:54:21.921812+0000","last_clean":"2024-04-25T15:54:21.921812+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:21.921812+0000","last_undegraded":"2024-04-25T15:54:21.921812+0000","last_fullsized":"2024-04-25T15:54:21.921812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441214+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:21.441214+0000","last_peered":"2024-04-25T15:54:21.441214+0000","last_clean":"2024-04-25T15:54:21.441214+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:21.441214+0000","last_undegraded":"2024-04-25T15:54:21.441214+0000","last_fullsized":"2024-04-25T15:54:21.441214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923615+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:21.923615+0000","last_peered":"2024-04-25T15:54:21.923615+0000","last_clean":"2024-04-25T15:54:21.923615+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:21.923615+0000","last_undegraded":"2024-04-25T15:54:21.923615+0000","last_fullsized":"2024-04-25T15:54:21.923615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436826+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:21.436826+0000","last_peered":"2024-04-25T15:54:21.436826+0000","last_clean":"2024-04-25T15:54:21.436826+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:21.436826+0000","last_undegraded":"2024-04-25T15:54:21.436826+0000","last_fullsized":"2024-04-25T15:54:21.436826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391229+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:21.391229+0000","last_peered":"2024-04-25T15:54:21.391229+0000","last_clean":"2024-04-25T15:54:21.391229+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:21.391229+0000","last_undegraded":"2024-04-25T15:54:21.391229+0000","last_fullsized":"2024-04-25T15:54:21.391229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921155+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:21.921155+0000","last_peered":"2024-04-25T15:54:21.921155+0000","last_clean":"2024-04-25T15:54:21.921155+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:21.921155+0000","last_undegraded":"2024-04-25T15:54:21.921155+0000","last_fullsized":"2024-04-25T15:54:21.921155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922089+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:21.922089+0000","last_peered":"2024-04-25T15:54:21.922089+0000","last_clean":"2024-04-25T15:54:21.922089+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:21.922089+0000","last_undegraded":"2024-04-25T15:54:21.922089+0000","last_fullsized":"2024-04-25T15:54:21.922089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922747+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:21.922747+0000","last_peered":"2024-04-25T15:54:21.922747+0000","last_clean":"2024-04-25T15:54:21.922747+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:21.922747+0000","last_undegraded":"2024-04-25T15:54:21.922747+0000","last_fullsized":"2024-04-25T15:54:21.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393261+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:21.393261+0000","last_peered":"2024-04-25T15:54:21.393261+0000","last_clean":"2024-04-25T15:54:21.393261+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:21.393261+0000","last_undegraded":"2024-04-25T15:54:21.393261+0000","last_fullsized":"2024-04-25T15:54:21.393261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925213+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:21.925213+0000","last_peered":"2024-04-25T15:54:21.925213+0000","last_clean":"2024-04-25T15:54:21.925213+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:21.925213+0000","last_undegraded":"2024-04-25T15:54:21.925213+0000","last_fullsized":"2024-04-25T15:54:21.925213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924737+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:21.924737+0000","last_peered":"2024-04-25T15:54:21.924737+0000","last_clean":"2024-04-25T15:54:21.924737+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:21.924737+0000","last_undegraded":"2024-04-25T15:54:21.924737+0000","last_fullsized":"2024-04-25T15:54:21.924737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924403+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:21.924403+0000","last_peered":"2024-04-25T15:54:21.924403+0000","last_clean":"2024-04-25T15:54:21.924403+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:21.924403+0000","last_undegraded":"2024-04-25T15:54:21.924403+0000","last_fullsized":"2024-04-25T15:54:21.924403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393266+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:21.393266+0000","last_peered":"2024-04-25T15:54:21.393266+0000","last_clean":"2024-04-25T15:54:21.393266+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:21.393266+0000","last_undegraded":"2024-04-25T15:54:21.393266+0000","last_fullsized":"2024-04-25T15:54:21.393266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442122+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:21.442122+0000","last_peered":"2024-04-25T15:54:21.442122+0000","last_clean":"2024-04-25T15:54:21.442122+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:21.442122+0000","last_undegraded":"2024-04-25T15:54:21.442122+0000","last_fullsized":"2024-04-25T15:54:21.442122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394591+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:21.394591+0000","last_peered":"2024-04-25T15:54:21.394591+0000","last_clean":"2024-04-25T15:54:21.394591+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:21.394591+0000","last_undegraded":"2024-04-25T15:54:21.394591+0000","last_fullsized":"2024-04-25T15:54:21.394591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923550+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:21.923550+0000","last_peered":"2024-04-25T15:54:21.923550+0000","last_clean":"2024-04-25T15:54:21.923550+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:21.923550+0000","last_undegraded":"2024-04-25T15:54:21.923550+0000","last_fullsized":"2024-04-25T15:54:21.923550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396443+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:21.396443+0000","last_peered":"2024-04-25T15:54:21.396443+0000","last_clean":"2024-04-25T15:54:21.396443+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:21.396443+0000","last_undegraded":"2024-04-25T15:54:21.396443+0000","last_fullsized":"2024-04-25T15:54:21.396443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389783+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:21.389783+0000","last_peered":"2024-04-25T15:54:21.389783+0000","last_clean":"2024-04-25T15:54:21.389783+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:21.389783+0000","last_undegraded":"2024-04-25T15:54:21.389783+0000","last_fullsized":"2024-04-25T15:54:21.389783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921814+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:21.921814+0000","last_peered":"2024-04-25T15:54:21.921814+0000","last_clean":"2024-04-25T15:54:21.921814+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:21.921814+0000","last_undegraded":"2024-04-25T15:54:21.921814+0000","last_fullsized":"2024-04-25T15:54:21.921814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441971+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:21.441971+0000","last_peered":"2024-04-25T15:54:21.441971+0000","last_clean":"2024-04-25T15:54:21.441971+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:21.441971+0000","last_undegraded":"2024-04-25T15:54:21.441971+0000","last_fullsized":"2024-04-25T15:54:21.441971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397258+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:21.397258+0000","last_peered":"2024-04-25T15:54:21.397258+0000","last_clean":"2024-04-25T15:54:21.397258+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:21.397258+0000","last_undegraded":"2024-04-25T15:54:21.397258+0000","last_fullsized":"2024-04-25T15:54:21.397258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396002+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:21.396002+0000","last_peered":"2024-04-25T15:54:21.396002+0000","last_clean":"2024-04-25T15:54:21.396002+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:21.396002+0000","last_undegraded":"2024-04-25T15:54:21.396002+0000","last_fullsized":"2024-04-25T15:54:21.396002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922919+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:21.922919+0000","last_peered":"2024-04-25T15:54:21.922919+0000","last_clean":"2024-04-25T15:54:21.922919+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:21.922919+0000","last_undegraded":"2024-04-25T15:54:21.922919+0000","last_fullsized":"2024-04-25T15:54:21.922919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441436+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:21.441436+0000","last_peered":"2024-04-25T15:54:21.441436+0000","last_clean":"2024-04-25T15:54:21.441436+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:21.441436+0000","last_undegraded":"2024-04-25T15:54:21.441436+0000","last_fullsized":"2024-04-25T15:54:21.441436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443460+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:21.443460+0000","last_peered":"2024-04-25T15:54:21.443460+0000","last_clean":"2024-04-25T15:54:21.443460+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:21.443460+0000","last_undegraded":"2024-04-25T15:54:21.443460+0000","last_fullsized":"2024-04-25T15:54:21.443460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924171+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:21.924171+0000","last_peered":"2024-04-25T15:54:21.924171+0000","last_clean":"2024-04-25T15:54:21.924171+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:21.924171+0000","last_undegraded":"2024-04-25T15:54:21.924171+0000","last_fullsized":"2024-04-25T15:54:21.924171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392083+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:21.392083+0000","last_peered":"2024-04-25T15:54:21.392083+0000","last_clean":"2024-04-25T15:54:21.392083+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:21.392083+0000","last_undegraded":"2024-04-25T15:54:21.392083+0000","last_fullsized":"2024-04-25T15:54:21.392083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920688+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:21.920688+0000","last_peered":"2024-04-25T15:54:21.920688+0000","last_clean":"2024-04-25T15:54:21.920688+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:21.920688+0000","last_undegraded":"2024-04-25T15:54:21.920688+0000","last_fullsized":"2024-04-25T15:54:21.920688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395966+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:21.395966+0000","last_peered":"2024-04-25T15:54:21.395966+0000","last_clean":"2024-04-25T15:54:21.395966+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:21.395966+0000","last_undegraded":"2024-04-25T15:54:21.395966+0000","last_fullsized":"2024-04-25T15:54:21.395966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920895+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:21.920895+0000","last_peered":"2024-04-25T15:54:21.920895+0000","last_clean":"2024-04-25T15:54:21.920895+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:21.920895+0000","last_undegraded":"2024-04-25T15:54:21.920895+0000","last_fullsized":"2024-04-25T15:54:21.920895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437142+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:21.437142+0000","last_peered":"2024-04-25T15:54:21.437142+0000","last_clean":"2024-04-25T15:54:21.437142+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:21.437142+0000","last_undegraded":"2024-04-25T15:54:21.437142+0000","last_fullsized":"2024-04-25T15:54:21.437142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397313+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:21.397313+0000","last_peered":"2024-04-25T15:54:21.397313+0000","last_clean":"2024-04-25T15:54:21.397313+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:21.397313+0000","last_undegraded":"2024-04-25T15:54:21.397313+0000","last_fullsized":"2024-04-25T15:54:21.397313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391628+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:21.391628+0000","last_peered":"2024-04-25T15:54:21.391628+0000","last_clean":"2024-04-25T15:54:21.391628+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:21.391628+0000","last_undegraded":"2024-04-25T15:54:21.391628+0000","last_fullsized":"2024-04-25T15:54:21.391628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391487+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:21.391487+0000","last_peered":"2024-04-25T15:54:21.391487+0000","last_clean":"2024-04-25T15:54:21.391487+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:21.391487+0000","last_undegraded":"2024-04-25T15:54:21.391487+0000","last_fullsized":"2024-04-25T15:54:21.391487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923027+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:21.923027+0000","last_peered":"2024-04-25T15:54:21.923027+0000","last_clean":"2024-04-25T15:54:21.923027+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:21.923027+0000","last_undegraded":"2024-04-25T15:54:21.923027+0000","last_fullsized":"2024-04-25T15:54:21.923027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443222+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:21.443222+0000","last_peered":"2024-04-25T15:54:21.443222+0000","last_clean":"2024-04-25T15:54:21.443222+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:21.443222+0000","last_undegraded":"2024-04-25T15:54:21.443222+0000","last_fullsized":"2024-04-25T15:54:21.443222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920541+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:21.920541+0000","last_peered":"2024-04-25T15:54:21.920541+0000","last_clean":"2024-04-25T15:54:21.920541+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:21.920541+0000","last_undegraded":"2024-04-25T15:54:21.920541+0000","last_fullsized":"2024-04-25T15:54:21.920541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394741+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:21.394741+0000","last_peered":"2024-04-25T15:54:21.394741+0000","last_clean":"2024-04-25T15:54:21.394741+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:21.394741+0000","last_undegraded":"2024-04-25T15:54:21.394741+0000","last_fullsized":"2024-04-25T15:54:21.394741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442293+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:21.442293+0000","last_peered":"2024-04-25T15:54:21.442293+0000","last_clean":"2024-04-25T15:54:21.442293+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:21.442293+0000","last_undegraded":"2024-04-25T15:54:21.442293+0000","last_fullsized":"2024-04-25T15:54:21.442293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922453+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:21.922453+0000","last_peered":"2024-04-25T15:54:21.922453+0000","last_clean":"2024-04-25T15:54:21.922453+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:21.922453+0000","last_undegraded":"2024-04-25T15:54:21.922453+0000","last_fullsized":"2024-04-25T15:54:21.922453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436667+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:21.436667+0000","last_peered":"2024-04-25T15:54:21.436667+0000","last_clean":"2024-04-25T15:54:21.436667+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:21.436667+0000","last_undegraded":"2024-04-25T15:54:21.436667+0000","last_fullsized":"2024-04-25T15:54:21.436667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437157+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:21.437157+0000","last_peered":"2024-04-25T15:54:21.437157+0000","last_clean":"2024-04-25T15:54:21.437157+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:21.437157+0000","last_undegraded":"2024-04-25T15:54:21.437157+0000","last_fullsized":"2024-04-25T15:54:21.437157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924519+0000","last_change":"2024-04-25T15:54:10.285534+0000","last_active":"2024-04-25T15:54:21.924519+0000","last_peered":"2024-04-25T15:54:21.924519+0000","last_clean":"2024-04-25T15:54:21.924519+0000","last_became_active":"2024-04-25T15:54:10.279471+0000","last_became_peered":"2024-04-25T15:54:10.279471+0000","last_unstale":"2024-04-25T15:54:21.924519+0000","last_undegraded":"2024-04-25T15:54:21.924519+0000","last_fullsized":"2024-04-25T15:54:21.924519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442305+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:21.442305+0000","last_peered":"2024-04-25T15:54:21.442305+0000","last_clean":"2024-04-25T15:54:21.442305+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:21.442305+0000","last_undegraded":"2024-04-25T15:54:21.442305+0000","last_fullsized":"2024-04-25T15:54:21.442305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441751+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:21.441751+0000","last_peered":"2024-04-25T15:54:21.441751+0000","last_clean":"2024-04-25T15:54:21.441751+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:21.441751+0000","last_undegraded":"2024-04-25T15:54:21.441751+0000","last_fullsized":"2024-04-25T15:54:21.441751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437080+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:21.437080+0000","last_peered":"2024-04-25T15:54:21.437080+0000","last_clean":"2024-04-25T15:54:21.437080+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:21.437080+0000","last_undegraded":"2024-04-25T15:54:21.437080+0000","last_fullsized":"2024-04-25T15:54:21.437080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393701+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:21.393701+0000","last_peered":"2024-04-25T15:54:21.393701+0000","last_clean":"2024-04-25T15:54:21.393701+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:21.393701+0000","last_undegraded":"2024-04-25T15:54:21.393701+0000","last_fullsized":"2024-04-25T15:54:21.393701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922767+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:21.922767+0000","last_peered":"2024-04-25T15:54:21.922767+0000","last_clean":"2024-04-25T15:54:21.922767+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:21.922767+0000","last_undegraded":"2024-04-25T15:54:21.922767+0000","last_fullsized":"2024-04-25T15:54:21.922767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442241+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:21.442241+0000","last_peered":"2024-04-25T15:54:21.442241+0000","last_clean":"2024-04-25T15:54:21.442241+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:21.442241+0000","last_undegraded":"2024-04-25T15:54:21.442241+0000","last_fullsized":"2024-04-25T15:54:21.442241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390373+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:21.390373+0000","last_peered":"2024-04-25T15:54:21.390373+0000","last_clean":"2024-04-25T15:54:21.390373+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:21.390373+0000","last_undegraded":"2024-04-25T15:54:21.390373+0000","last_fullsized":"2024-04-25T15:54:21.390373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441402+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:21.441402+0000","last_peered":"2024-04-25T15:54:21.441402+0000","last_clean":"2024-04-25T15:54:21.441402+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:21.441402+0000","last_undegraded":"2024-04-25T15:54:21.441402+0000","last_fullsized":"2024-04-25T15:54:21.441402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389173+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:21.389173+0000","last_peered":"2024-04-25T15:54:21.389173+0000","last_clean":"2024-04-25T15:54:21.389173+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:21.389173+0000","last_undegraded":"2024-04-25T15:54:21.389173+0000","last_fullsized":"2024-04-25T15:54:21.389173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443394+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:21.443394+0000","last_peered":"2024-04-25T15:54:21.443394+0000","last_clean":"2024-04-25T15:54:21.443394+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:21.443394+0000","last_undegraded":"2024-04-25T15:54:21.443394+0000","last_fullsized":"2024-04-25T15:54:21.443394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925008+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:21.925008+0000","last_peered":"2024-04-25T15:54:21.925008+0000","last_clean":"2024-04-25T15:54:21.925008+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:21.925008+0000","last_undegraded":"2024-04-25T15:54:21.925008+0000","last_fullsized":"2024-04-25T15:54:21.925008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436357+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:21.436357+0000","last_peered":"2024-04-25T15:54:21.436357+0000","last_clean":"2024-04-25T15:54:21.436357+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:21.436357+0000","last_undegraded":"2024-04-25T15:54:21.436357+0000","last_fullsized":"2024-04-25T15:54:21.436357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920818+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:21.920818+0000","last_peered":"2024-04-25T15:54:21.920818+0000","last_clean":"2024-04-25T15:54:21.920818+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:21.920818+0000","last_undegraded":"2024-04-25T15:54:21.920818+0000","last_fullsized":"2024-04-25T15:54:21.920818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.439414+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:21.439414+0000","last_peered":"2024-04-25T15:54:21.439414+0000","last_clean":"2024-04-25T15:54:21.439414+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:21.439414+0000","last_undegraded":"2024-04-25T15:54:21.439414+0000","last_fullsized":"2024-04-25T15:54:21.439414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924237+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:21.924237+0000","last_peered":"2024-04-25T15:54:21.924237+0000","last_clean":"2024-04-25T15:54:21.924237+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:21.924237+0000","last_undegraded":"2024-04-25T15:54:21.924237+0000","last_fullsized":"2024-04-25T15:54:21.924237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921664+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:21.921664+0000","last_peered":"2024-04-25T15:54:21.921664+0000","last_clean":"2024-04-25T15:54:21.921664+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:21.921664+0000","last_undegraded":"2024-04-25T15:54:21.921664+0000","last_fullsized":"2024-04-25T15:54:21.921664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925364+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:21.925364+0000","last_peered":"2024-04-25T15:54:21.925364+0000","last_clean":"2024-04-25T15:54:21.925364+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:21.925364+0000","last_undegraded":"2024-04-25T15:54:21.925364+0000","last_fullsized":"2024-04-25T15:54:21.925364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921478+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:21.921478+0000","last_peered":"2024-04-25T15:54:21.921478+0000","last_clean":"2024-04-25T15:54:21.921478+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:21.921478+0000","last_undegraded":"2024-04-25T15:54:21.921478+0000","last_fullsized":"2024-04-25T15:54:21.921478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394923+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:21.394923+0000","last_peered":"2024-04-25T15:54:21.394923+0000","last_clean":"2024-04-25T15:54:21.394923+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:21.394923+0000","last_undegraded":"2024-04-25T15:54:21.394923+0000","last_fullsized":"2024-04-25T15:54:21.394923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390876+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:21.390876+0000","last_peered":"2024-04-25T15:54:21.390876+0000","last_clean":"2024-04-25T15:54:21.390876+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:21.390876+0000","last_undegraded":"2024-04-25T15:54:21.390876+0000","last_fullsized":"2024-04-25T15:54:21.390876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922057+0000","last_change":"2024-04-25T15:54:10.294873+0000","last_active":"2024-04-25T15:54:21.922057+0000","last_peered":"2024-04-25T15:54:21.922057+0000","last_clean":"2024-04-25T15:54:21.922057+0000","last_became_active":"2024-04-25T15:54:10.291885+0000","last_became_peered":"2024-04-25T15:54:10.291885+0000","last_unstale":"2024-04-25T15:54:21.922057+0000","last_undegraded":"2024-04-25T15:54:21.922057+0000","last_fullsized":"2024-04-25T15:54:21.922057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390368+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:21.390368+0000","last_peered":"2024-04-25T15:54:21.390368+0000","last_clean":"2024-04-25T15:54:21.390368+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:21.390368+0000","last_undegraded":"2024-04-25T15:54:21.390368+0000","last_fullsized":"2024-04-25T15:54:21.390368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394250+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:21.394250+0000","last_peered":"2024-04-25T15:54:21.394250+0000","last_clean":"2024-04-25T15:54:21.394250+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:21.394250+0000","last_undegraded":"2024-04-25T15:54:21.394250+0000","last_fullsized":"2024-04-25T15:54:21.394250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389873+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:21.389873+0000","last_peered":"2024-04-25T15:54:21.389873+0000","last_clean":"2024-04-25T15:54:21.389873+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:21.389873+0000","last_undegraded":"2024-04-25T15:54:21.389873+0000","last_fullsized":"2024-04-25T15:54:21.389873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923240+0000","last_change":"2024-04-25T15:54:10.271652+0000","last_active":"2024-04-25T15:54:21.923240+0000","last_peered":"2024-04-25T15:54:21.923240+0000","last_clean":"2024-04-25T15:54:21.923240+0000","last_became_active":"2024-04-25T15:54:10.270697+0000","last_became_peered":"2024-04-25T15:54:10.270697+0000","last_unstale":"2024-04-25T15:54:21.923240+0000","last_undegraded":"2024-04-25T15:54:21.923240+0000","last_fullsized":"2024-04-25T15:54:21.923240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443076+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:21.443076+0000","last_peered":"2024-04-25T15:54:21.443076+0000","last_clean":"2024-04-25T15:54:21.443076+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:21.443076+0000","last_undegraded":"2024-04-25T15:54:21.443076+0000","last_fullsized":"2024-04-25T15:54:21.443076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436482+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:21.436482+0000","last_peered":"2024-04-25T15:54:21.436482+0000","last_clean":"2024-04-25T15:54:21.436482+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:21.436482+0000","last_undegraded":"2024-04-25T15:54:21.436482+0000","last_fullsized":"2024-04-25T15:54:21.436482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921967+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:21.921967+0000","last_peered":"2024-04-25T15:54:21.921967+0000","last_clean":"2024-04-25T15:54:21.921967+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:21.921967+0000","last_undegraded":"2024-04-25T15:54:21.921967+0000","last_fullsized":"2024-04-25T15:54:21.921967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925121+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:21.925121+0000","last_peered":"2024-04-25T15:54:21.925121+0000","last_clean":"2024-04-25T15:54:21.925121+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:21.925121+0000","last_undegraded":"2024-04-25T15:54:21.925121+0000","last_fullsized":"2024-04-25T15:54:21.925121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390564+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:21.390564+0000","last_peered":"2024-04-25T15:54:21.390564+0000","last_clean":"2024-04-25T15:54:21.390564+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:21.390564+0000","last_undegraded":"2024-04-25T15:54:21.390564+0000","last_fullsized":"2024-04-25T15:54:21.390564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920163+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:21.920163+0000","last_peered":"2024-04-25T15:54:21.920163+0000","last_clean":"2024-04-25T15:54:21.920163+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:21.920163+0000","last_undegraded":"2024-04-25T15:54:21.920163+0000","last_fullsized":"2024-04-25T15:54:21.920163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389276+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:21.389276+0000","last_peered":"2024-04-25T15:54:21.389276+0000","last_clean":"2024-04-25T15:54:21.389276+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:21.389276+0000","last_undegraded":"2024-04-25T15:54:21.389276+0000","last_fullsized":"2024-04-25T15:54:21.389276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925892+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:21.925892+0000","last_peered":"2024-04-25T15:54:21.925892+0000","last_clean":"2024-04-25T15:54:21.925892+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:21.925892+0000","last_undegraded":"2024-04-25T15:54:21.925892+0000","last_fullsized":"2024-04-25T15:54:21.925892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397052+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:21.397052+0000","last_peered":"2024-04-25T15:54:21.397052+0000","last_clean":"2024-04-25T15:54:21.397052+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:21.397052+0000","last_undegraded":"2024-04-25T15:54:21.397052+0000","last_fullsized":"2024-04-25T15:54:21.397052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391328+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:21.391328+0000","last_peered":"2024-04-25T15:54:21.391328+0000","last_clean":"2024-04-25T15:54:21.391328+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:21.391328+0000","last_undegraded":"2024-04-25T15:54:21.391328+0000","last_fullsized":"2024-04-25T15:54:21.391328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922858+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:21.922858+0000","last_peered":"2024-04-25T15:54:21.922858+0000","last_clean":"2024-04-25T15:54:21.922858+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:21.922858+0000","last_undegraded":"2024-04-25T15:54:21.922858+0000","last_fullsized":"2024-04-25T15:54:21.922858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922521+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:21.922521+0000","last_peered":"2024-04-25T15:54:21.922521+0000","last_clean":"2024-04-25T15:54:21.922521+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:21.922521+0000","last_undegraded":"2024-04-25T15:54:21.922521+0000","last_fullsized":"2024-04-25T15:54:21.922521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389197+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:21.389197+0000","last_peered":"2024-04-25T15:54:21.389197+0000","last_clean":"2024-04-25T15:54:21.389197+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:21.389197+0000","last_undegraded":"2024-04-25T15:54:21.389197+0000","last_fullsized":"2024-04-25T15:54:21.389197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437180+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:21.437180+0000","last_peered":"2024-04-25T15:54:21.437180+0000","last_clean":"2024-04-25T15:54:21.437180+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:21.437180+0000","last_undegraded":"2024-04-25T15:54:21.437180+0000","last_fullsized":"2024-04-25T15:54:21.437180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923162+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:21.923162+0000","last_peered":"2024-04-25T15:54:21.923162+0000","last_clean":"2024-04-25T15:54:21.923162+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:21.923162+0000","last_undegraded":"2024-04-25T15:54:21.923162+0000","last_fullsized":"2024-04-25T15:54:21.923162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394159+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:21.394159+0000","last_peered":"2024-04-25T15:54:21.394159+0000","last_clean":"2024-04-25T15:54:21.394159+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:21.394159+0000","last_undegraded":"2024-04-25T15:54:21.394159+0000","last_fullsized":"2024-04-25T15:54:21.394159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395369+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:21.395369+0000","last_peered":"2024-04-25T15:54:21.395369+0000","last_clean":"2024-04-25T15:54:21.395369+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:21.395369+0000","last_undegraded":"2024-04-25T15:54:21.395369+0000","last_fullsized":"2024-04-25T15:54:21.395369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922677+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:21.922677+0000","last_peered":"2024-04-25T15:54:21.922677+0000","last_clean":"2024-04-25T15:54:21.922677+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:21.922677+0000","last_undegraded":"2024-04-25T15:54:21.922677+0000","last_fullsized":"2024-04-25T15:54:21.922677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923119+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:21.923119+0000","last_peered":"2024-04-25T15:54:21.923119+0000","last_clean":"2024-04-25T15:54:21.923119+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:21.923119+0000","last_undegraded":"2024-04-25T15:54:21.923119+0000","last_fullsized":"2024-04-25T15:54:21.923119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923220+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:21.923220+0000","last_peered":"2024-04-25T15:54:21.923220+0000","last_clean":"2024-04-25T15:54:21.923220+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:21.923220+0000","last_undegraded":"2024-04-25T15:54:21.923220+0000","last_fullsized":"2024-04-25T15:54:21.923220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922602+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:21.922602+0000","last_peered":"2024-04-25T15:54:21.922602+0000","last_clean":"2024-04-25T15:54:21.922602+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:21.922602+0000","last_undegraded":"2024-04-25T15:54:21.922602+0000","last_fullsized":"2024-04-25T15:54:21.922602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921972+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:21.921972+0000","last_peered":"2024-04-25T15:54:21.921972+0000","last_clean":"2024-04-25T15:54:21.921972+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:21.921972+0000","last_undegraded":"2024-04-25T15:54:21.921972+0000","last_fullsized":"2024-04-25T15:54:21.921972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436318+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:21.436318+0000","last_peered":"2024-04-25T15:54:21.436318+0000","last_clean":"2024-04-25T15:54:21.436318+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:21.436318+0000","last_undegraded":"2024-04-25T15:54:21.436318+0000","last_fullsized":"2024-04-25T15:54:21.436318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437324+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:21.437324+0000","last_peered":"2024-04-25T15:54:21.437324+0000","last_clean":"2024-04-25T15:54:21.437324+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:21.437324+0000","last_undegraded":"2024-04-25T15:54:21.437324+0000","last_fullsized":"2024-04-25T15:54:21.437324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924345+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:21.924345+0000","last_peered":"2024-04-25T15:54:21.924345+0000","last_clean":"2024-04-25T15:54:21.924345+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:21.924345+0000","last_undegraded":"2024-04-25T15:54:21.924345+0000","last_fullsized":"2024-04-25T15:54:21.924345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922285+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:21.922285+0000","last_peered":"2024-04-25T15:54:21.922285+0000","last_clean":"2024-04-25T15:54:21.922285+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:21.922285+0000","last_undegraded":"2024-04-25T15:54:21.922285+0000","last_fullsized":"2024-04-25T15:54:21.922285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921704+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:21.921704+0000","last_peered":"2024-04-25T15:54:21.921704+0000","last_clean":"2024-04-25T15:54:21.921704+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:21.921704+0000","last_undegraded":"2024-04-25T15:54:21.921704+0000","last_fullsized":"2024-04-25T15:54:21.921704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395230+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:21.395230+0000","last_peered":"2024-04-25T15:54:21.395230+0000","last_clean":"2024-04-25T15:54:21.395230+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:21.395230+0000","last_undegraded":"2024-04-25T15:54:21.395230+0000","last_fullsized":"2024-04-25T15:54:21.395230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441572+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:21.441572+0000","last_peered":"2024-04-25T15:54:21.441572+0000","last_clean":"2024-04-25T15:54:21.441572+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:21.441572+0000","last_undegraded":"2024-04-25T15:54:21.441572+0000","last_fullsized":"2024-04-25T15:54:21.441572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441814+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:21.441814+0000","last_peered":"2024-04-25T15:54:21.441814+0000","last_clean":"2024-04-25T15:54:21.441814+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:21.441814+0000","last_undegraded":"2024-04-25T15:54:21.441814+0000","last_fullsized":"2024-04-25T15:54:21.441814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397497+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:21.397497+0000","last_peered":"2024-04-25T15:54:21.397497+0000","last_clean":"2024-04-25T15:54:21.397497+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:21.397497+0000","last_undegraded":"2024-04-25T15:54:21.397497+0000","last_fullsized":"2024-04-25T15:54:21.397497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443036+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:21.443036+0000","last_peered":"2024-04-25T15:54:21.443036+0000","last_clean":"2024-04-25T15:54:21.443036+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:21.443036+0000","last_undegraded":"2024-04-25T15:54:21.443036+0000","last_fullsized":"2024-04-25T15:54:21.443036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393180+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:21.393180+0000","last_peered":"2024-04-25T15:54:21.393180+0000","last_clean":"2024-04-25T15:54:21.393180+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:21.393180+0000","last_undegraded":"2024-04-25T15:54:21.393180+0000","last_fullsized":"2024-04-25T15:54:21.393180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395117+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:21.395117+0000","last_peered":"2024-04-25T15:54:21.395117+0000","last_clean":"2024-04-25T15:54:21.395117+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:21.395117+0000","last_undegraded":"2024-04-25T15:54:21.395117+0000","last_fullsized":"2024-04-25T15:54:21.395117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436903+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:21.436903+0000","last_peered":"2024-04-25T15:54:21.436903+0000","last_clean":"2024-04-25T15:54:21.436903+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:21.436903+0000","last_undegraded":"2024-04-25T15:54:21.436903+0000","last_fullsized":"2024-04-25T15:54:21.436903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923570+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:21.923570+0000","last_peered":"2024-04-25T15:54:21.923570+0000","last_clean":"2024-04-25T15:54:21.923570+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:21.923570+0000","last_undegraded":"2024-04-25T15:54:21.923570+0000","last_fullsized":"2024-04-25T15:54:21.923570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921005+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:21.921005+0000","last_peered":"2024-04-25T15:54:21.921005+0000","last_clean":"2024-04-25T15:54:21.921005+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:21.921005+0000","last_undegraded":"2024-04-25T15:54:21.921005+0000","last_fullsized":"2024-04-25T15:54:21.921005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920631+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:21.920631+0000","last_peered":"2024-04-25T15:54:21.920631+0000","last_clean":"2024-04-25T15:54:21.920631+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:21.920631+0000","last_undegraded":"2024-04-25T15:54:21.920631+0000","last_fullsized":"2024-04-25T15:54:21.920631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923339+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:21.923339+0000","last_peered":"2024-04-25T15:54:21.923339+0000","last_clean":"2024-04-25T15:54:21.923339+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:21.923339+0000","last_undegraded":"2024-04-25T15:54:21.923339+0000","last_fullsized":"2024-04-25T15:54:21.923339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397036+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:21.397036+0000","last_peered":"2024-04-25T15:54:21.397036+0000","last_clean":"2024-04-25T15:54:21.397036+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:21.397036+0000","last_undegraded":"2024-04-25T15:54:21.397036+0000","last_fullsized":"2024-04-25T15:54:21.397036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920956+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:21.920956+0000","last_peered":"2024-04-25T15:54:21.920956+0000","last_clean":"2024-04-25T15:54:21.920956+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:21.920956+0000","last_undegraded":"2024-04-25T15:54:21.920956+0000","last_fullsized":"2024-04-25T15:54:21.920956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396385+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:21.396385+0000","last_peered":"2024-04-25T15:54:21.396385+0000","last_clean":"2024-04-25T15:54:21.396385+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:21.396385+0000","last_undegraded":"2024-04-25T15:54:21.396385+0000","last_fullsized":"2024-04-25T15:54:21.396385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437021+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:21.437021+0000","last_peered":"2024-04-25T15:54:21.437021+0000","last_clean":"2024-04-25T15:54:21.437021+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:21.437021+0000","last_undegraded":"2024-04-25T15:54:21.437021+0000","last_fullsized":"2024-04-25T15:54:21.437021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441296+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:21.441296+0000","last_peered":"2024-04-25T15:54:21.441296+0000","last_clean":"2024-04-25T15:54:21.441296+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:21.441296+0000","last_undegraded":"2024-04-25T15:54:21.441296+0000","last_fullsized":"2024-04-25T15:54:21.441296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920923+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:21.920923+0000","last_peered":"2024-04-25T15:54:21.920923+0000","last_clean":"2024-04-25T15:54:21.920923+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:21.920923+0000","last_undegraded":"2024-04-25T15:54:21.920923+0000","last_fullsized":"2024-04-25T15:54:21.920923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436823+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:21.436823+0000","last_peered":"2024-04-25T15:54:21.436823+0000","last_clean":"2024-04-25T15:54:21.436823+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:21.436823+0000","last_undegraded":"2024-04-25T15:54:21.436823+0000","last_fullsized":"2024-04-25T15:54:21.436823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396688+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:21.396688+0000","last_peered":"2024-04-25T15:54:21.396688+0000","last_clean":"2024-04-25T15:54:21.396688+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:21.396688+0000","last_undegraded":"2024-04-25T15:54:21.396688+0000","last_fullsized":"2024-04-25T15:54:21.396688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922853+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:21.922853+0000","last_peered":"2024-04-25T15:54:21.922853+0000","last_clean":"2024-04-25T15:54:21.922853+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:21.922853+0000","last_undegraded":"2024-04-25T15:54:21.922853+0000","last_fullsized":"2024-04-25T15:54:21.922853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922209+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:21.922209+0000","last_peered":"2024-04-25T15:54:21.922209+0000","last_clean":"2024-04-25T15:54:21.922209+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:21.922209+0000","last_undegraded":"2024-04-25T15:54:21.922209+0000","last_fullsized":"2024-04-25T15:54:21.922209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442811+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:21.442811+0000","last_peered":"2024-04-25T15:54:21.442811+0000","last_clean":"2024-04-25T15:54:21.442811+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:21.442811+0000","last_undegraded":"2024-04-25T15:54:21.442811+0000","last_fullsized":"2024-04-25T15:54:21.442811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394919+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:21.394919+0000","last_peered":"2024-04-25T15:54:21.394919+0000","last_clean":"2024-04-25T15:54:21.394919+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:21.394919+0000","last_undegraded":"2024-04-25T15:54:21.394919+0000","last_fullsized":"2024-04-25T15:54:21.394919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437206+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:21.437206+0000","last_peered":"2024-04-25T15:54:21.437206+0000","last_clean":"2024-04-25T15:54:21.437206+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:21.437206+0000","last_undegraded":"2024-04-25T15:54:21.437206+0000","last_fullsized":"2024-04-25T15:54:21.437206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390654+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:21.390654+0000","last_peered":"2024-04-25T15:54:21.390654+0000","last_clean":"2024-04-25T15:54:21.390654+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:21.390654+0000","last_undegraded":"2024-04-25T15:54:21.390654+0000","last_fullsized":"2024-04-25T15:54:21.390654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393791+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:21.393791+0000","last_peered":"2024-04-25T15:54:21.393791+0000","last_clean":"2024-04-25T15:54:21.393791+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:21.393791+0000","last_undegraded":"2024-04-25T15:54:21.393791+0000","last_fullsized":"2024-04-25T15:54:21.393791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923014+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:21.923014+0000","last_peered":"2024-04-25T15:54:21.923014+0000","last_clean":"2024-04-25T15:54:21.923014+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:21.923014+0000","last_undegraded":"2024-04-25T15:54:21.923014+0000","last_fullsized":"2024-04-25T15:54:21.923014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393788+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:21.393788+0000","last_peered":"2024-04-25T15:54:21.393788+0000","last_clean":"2024-04-25T15:54:21.393788+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:21.393788+0000","last_undegraded":"2024-04-25T15:54:21.393788+0000","last_fullsized":"2024-04-25T15:54:21.393788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922425+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:21.922425+0000","last_peered":"2024-04-25T15:54:21.922425+0000","last_clean":"2024-04-25T15:54:21.922425+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:21.922425+0000","last_undegraded":"2024-04-25T15:54:21.922425+0000","last_fullsized":"2024-04-25T15:54:21.922425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923390+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:21.923390+0000","last_peered":"2024-04-25T15:54:21.923390+0000","last_clean":"2024-04-25T15:54:21.923390+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:21.923390+0000","last_undegraded":"2024-04-25T15:54:21.923390+0000","last_fullsized":"2024-04-25T15:54:21.923390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393859+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:21.393859+0000","last_peered":"2024-04-25T15:54:21.393859+0000","last_clean":"2024-04-25T15:54:21.393859+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:21.393859+0000","last_undegraded":"2024-04-25T15:54:21.393859+0000","last_fullsized":"2024-04-25T15:54:21.393859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443040+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:21.443040+0000","last_peered":"2024-04-25T15:54:21.443040+0000","last_clean":"2024-04-25T15:54:21.443040+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:21.443040+0000","last_undegraded":"2024-04-25T15:54:21.443040+0000","last_fullsized":"2024-04-25T15:54:21.443040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.388928+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:21.388928+0000","last_peered":"2024-04-25T15:54:21.388928+0000","last_clean":"2024-04-25T15:54:21.388928+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:21.388928+0000","last_undegraded":"2024-04-25T15:54:21.388928+0000","last_fullsized":"2024-04-25T15:54:21.388928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922270+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:21.922270+0000","last_peered":"2024-04-25T15:54:21.922270+0000","last_clean":"2024-04-25T15:54:21.922270+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:21.922270+0000","last_undegraded":"2024-04-25T15:54:21.922270+0000","last_fullsized":"2024-04-25T15:54:21.922270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922344+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:21.922344+0000","last_peered":"2024-04-25T15:54:21.922344+0000","last_clean":"2024-04-25T15:54:21.922344+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:21.922344+0000","last_undegraded":"2024-04-25T15:54:21.922344+0000","last_fullsized":"2024-04-25T15:54:21.922344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442696+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:21.442696+0000","last_peered":"2024-04-25T15:54:21.442696+0000","last_clean":"2024-04-25T15:54:21.442696+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:21.442696+0000","last_undegraded":"2024-04-25T15:54:21.442696+0000","last_fullsized":"2024-04-25T15:54:21.442696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437246+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:21.437246+0000","last_peered":"2024-04-25T15:54:21.437246+0000","last_clean":"2024-04-25T15:54:21.437246+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:21.437246+0000","last_undegraded":"2024-04-25T15:54:21.437246+0000","last_fullsized":"2024-04-25T15:54:21.437246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920646+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:21.920646+0000","last_peered":"2024-04-25T15:54:21.920646+0000","last_clean":"2024-04-25T15:54:21.920646+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:21.920646+0000","last_undegraded":"2024-04-25T15:54:21.920646+0000","last_fullsized":"2024-04-25T15:54:21.920646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922785+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:21.922785+0000","last_peered":"2024-04-25T15:54:21.922785+0000","last_clean":"2024-04-25T15:54:21.922785+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:21.922785+0000","last_undegraded":"2024-04-25T15:54:21.922785+0000","last_fullsized":"2024-04-25T15:54:21.922785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392960+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:21.392960+0000","last_peered":"2024-04-25T15:54:21.392960+0000","last_clean":"2024-04-25T15:54:21.392960+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:21.392960+0000","last_undegraded":"2024-04-25T15:54:21.392960+0000","last_fullsized":"2024-04-25T15:54:21.392960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442870+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:21.442870+0000","last_peered":"2024-04-25T15:54:21.442870+0000","last_clean":"2024-04-25T15:54:21.442870+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:21.442870+0000","last_undegraded":"2024-04-25T15:54:21.442870+0000","last_fullsized":"2024-04-25T15:54:21.442870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:21.920320+0000","last_peered":"2024-04-25T15:54:21.920320+0000","last_clean":"2024-04-25T15:54:21.920320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:21.920320+0000","last_undegraded":"2024-04-25T15:54:21.920320+0000","last_fullsized":"2024-04-25T15:54:21.920320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395555+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:21.395555+0000","last_peered":"2024-04-25T15:54:21.395555+0000","last_clean":"2024-04-25T15:54:21.395555+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:21.395555+0000","last_undegraded":"2024-04-25T15:54:21.395555+0000","last_fullsized":"2024-04-25T15:54:21.395555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394927+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:21.394927+0000","last_peered":"2024-04-25T15:54:21.394927+0000","last_clean":"2024-04-25T15:54:21.394927+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:21.394927+0000","last_undegraded":"2024-04-25T15:54:21.394927+0000","last_fullsized":"2024-04-25T15:54:21.394927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922828+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:21.922828+0000","last_peered":"2024-04-25T15:54:21.922828+0000","last_clean":"2024-04-25T15:54:21.922828+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:21.922828+0000","last_undegraded":"2024-04-25T15:54:21.922828+0000","last_fullsized":"2024-04-25T15:54:21.922828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923075+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:21.923075+0000","last_peered":"2024-04-25T15:54:21.923075+0000","last_clean":"2024-04-25T15:54:21.923075+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:21.923075+0000","last_undegraded":"2024-04-25T15:54:21.923075+0000","last_fullsized":"2024-04-25T15:54:21.923075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920626+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:21.920626+0000","last_peered":"2024-04-25T15:54:21.920626+0000","last_clean":"2024-04-25T15:54:21.920626+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:21.920626+0000","last_undegraded":"2024-04-25T15:54:21.920626+0000","last_fullsized":"2024-04-25T15:54:21.920626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924321+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:21.924321+0000","last_peered":"2024-04-25T15:54:21.924321+0000","last_clean":"2024-04-25T15:54:21.924321+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:21.924321+0000","last_undegraded":"2024-04-25T15:54:21.924321+0000","last_fullsized":"2024-04-25T15:54:21.924321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921198+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:21.921198+0000","last_peered":"2024-04-25T15:54:21.921198+0000","last_clean":"2024-04-25T15:54:21.921198+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:21.921198+0000","last_undegraded":"2024-04-25T15:54:21.921198+0000","last_fullsized":"2024-04-25T15:54:21.921198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389900+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:21.389900+0000","last_peered":"2024-04-25T15:54:21.389900+0000","last_clean":"2024-04-25T15:54:21.389900+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:21.389900+0000","last_undegraded":"2024-04-25T15:54:21.389900+0000","last_fullsized":"2024-04-25T15:54:21.389900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922079+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:21.922079+0000","last_peered":"2024-04-25T15:54:21.922079+0000","last_clean":"2024-04-25T15:54:21.922079+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:21.922079+0000","last_undegraded":"2024-04-25T15:54:21.922079+0000","last_fullsized":"2024-04-25T15:54:21.922079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922061+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:21.922061+0000","last_peered":"2024-04-25T15:54:21.922061+0000","last_clean":"2024-04-25T15:54:21.922061+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:21.922061+0000","last_undegraded":"2024-04-25T15:54:21.922061+0000","last_fullsized":"2024-04-25T15:54:21.922061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436923+0000","last_change":"2024-04-25T15:54:10.267602+0000","last_active":"2024-04-25T15:54:21.436923+0000","last_peered":"2024-04-25T15:54:21.436923+0000","last_clean":"2024-04-25T15:54:21.436923+0000","last_became_active":"2024-04-25T15:54:10.267276+0000","last_became_peered":"2024-04-25T15:54:10.267276+0000","last_unstale":"2024-04-25T15:54:21.436923+0000","last_undegraded":"2024-04-25T15:54:21.436923+0000","last_fullsized":"2024-04-25T15:54:21.436923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392942+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:21.392942+0000","last_peered":"2024-04-25T15:54:21.392942+0000","last_clean":"2024-04-25T15:54:21.392942+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:21.392942+0000","last_undegraded":"2024-04-25T15:54:21.392942+0000","last_fullsized":"2024-04-25T15:54:21.392942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395042+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:21.395042+0000","last_peered":"2024-04-25T15:54:21.395042+0000","last_clean":"2024-04-25T15:54:21.395042+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:21.395042+0000","last_undegraded":"2024-04-25T15:54:21.395042+0000","last_fullsized":"2024-04-25T15:54:21.395042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392913+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:21.392913+0000","last_peered":"2024-04-25T15:54:21.392913+0000","last_clean":"2024-04-25T15:54:21.392913+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:21.392913+0000","last_undegraded":"2024-04-25T15:54:21.392913+0000","last_fullsized":"2024-04-25T15:54:21.392913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922342+0000","last_change":"2024-04-25T15:54:10.295088+0000","last_active":"2024-04-25T15:54:21.922342+0000","last_peered":"2024-04-25T15:54:21.922342+0000","last_clean":"2024-04-25T15:54:21.922342+0000","last_became_active":"2024-04-25T15:54:10.292412+0000","last_became_peered":"2024-04-25T15:54:10.292412+0000","last_unstale":"2024-04-25T15:54:21.922342+0000","last_undegraded":"2024-04-25T15:54:21.922342+0000","last_fullsized":"2024-04-25T15:54:21.922342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920147+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:21.920147+0000","last_peered":"2024-04-25T15:54:21.920147+0000","last_clean":"2024-04-25T15:54:21.920147+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:21.920147+0000","last_undegraded":"2024-04-25T15:54:21.920147+0000","last_fullsized":"2024-04-25T15:54:21.920147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390651+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:21.390651+0000","last_peered":"2024-04-25T15:54:21.390651+0000","last_clean":"2024-04-25T15:54:21.390651+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:21.390651+0000","last_undegraded":"2024-04-25T15:54:21.390651+0000","last_fullsized":"2024-04-25T15:54:21.390651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436337+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:21.436337+0000","last_peered":"2024-04-25T15:54:21.436337+0000","last_clean":"2024-04-25T15:54:21.436337+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:21.436337+0000","last_undegraded":"2024-04-25T15:54:21.436337+0000","last_fullsized":"2024-04-25T15:54:21.436337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925691+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:21.925691+0000","last_peered":"2024-04-25T15:54:21.925691+0000","last_clean":"2024-04-25T15:54:21.925691+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:21.925691+0000","last_undegraded":"2024-04-25T15:54:21.925691+0000","last_fullsized":"2024-04-25T15:54:21.925691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442692+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:21.442692+0000","last_peered":"2024-04-25T15:54:21.442692+0000","last_clean":"2024-04-25T15:54:21.442692+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:21.442692+0000","last_undegraded":"2024-04-25T15:54:21.442692+0000","last_fullsized":"2024-04-25T15:54:21.442692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920342+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:21.920342+0000","last_peered":"2024-04-25T15:54:21.920342+0000","last_clean":"2024-04-25T15:54:21.920342+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:21.920342+0000","last_undegraded":"2024-04-25T15:54:21.920342+0000","last_fullsized":"2024-04-25T15:54:21.920342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397074+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:21.397074+0000","last_peered":"2024-04-25T15:54:21.397074+0000","last_clean":"2024-04-25T15:54:21.397074+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:21.397074+0000","last_undegraded":"2024-04-25T15:54:21.397074+0000","last_fullsized":"2024-04-25T15:54:21.397074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441304+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:21.441304+0000","last_peered":"2024-04-25T15:54:21.441304+0000","last_clean":"2024-04-25T15:54:21.441304+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:21.441304+0000","last_undegraded":"2024-04-25T15:54:21.441304+0000","last_fullsized":"2024-04-25T15:54:21.441304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921760+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:21.921760+0000","last_peered":"2024-04-25T15:54:21.921760+0000","last_clean":"2024-04-25T15:54:21.921760+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:21.921760+0000","last_undegraded":"2024-04-25T15:54:21.921760+0000","last_fullsized":"2024-04-25T15:54:21.921760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436316+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:21.436316+0000","last_peered":"2024-04-25T15:54:21.436316+0000","last_clean":"2024-04-25T15:54:21.436316+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:21.436316+0000","last_undegraded":"2024-04-25T15:54:21.436316+0000","last_fullsized":"2024-04-25T15:54:21.436316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921519+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:21.921519+0000","last_peered":"2024-04-25T15:54:21.921519+0000","last_clean":"2024-04-25T15:54:21.921519+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:21.921519+0000","last_undegraded":"2024-04-25T15:54:21.921519+0000","last_fullsized":"2024-04-25T15:54:21.921519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921500+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:21.921500+0000","last_peered":"2024-04-25T15:54:21.921500+0000","last_clean":"2024-04-25T15:54:21.921500+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:21.921500+0000","last_undegraded":"2024-04-25T15:54:21.921500+0000","last_fullsized":"2024-04-25T15:54:21.921500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397415+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:21.397415+0000","last_peered":"2024-04-25T15:54:21.397415+0000","last_clean":"2024-04-25T15:54:21.397415+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:21.397415+0000","last_undegraded":"2024-04-25T15:54:21.397415+0000","last_fullsized":"2024-04-25T15:54:21.397415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390647+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:21.390647+0000","last_peered":"2024-04-25T15:54:21.390647+0000","last_clean":"2024-04-25T15:54:21.390647+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:21.390647+0000","last_undegraded":"2024-04-25T15:54:21.390647+0000","last_fullsized":"2024-04-25T15:54:21.390647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395244+0000","last_change":"2024-04-25T15:54:10.256856+0000","last_active":"2024-04-25T15:54:21.395244+0000","last_peered":"2024-04-25T15:54:21.395244+0000","last_clean":"2024-04-25T15:54:21.395244+0000","last_became_active":"2024-04-25T15:54:10.256024+0000","last_became_peered":"2024-04-25T15:54:10.256024+0000","last_unstale":"2024-04-25T15:54:21.395244+0000","last_undegraded":"2024-04-25T15:54:21.395244+0000","last_fullsized":"2024-04-25T15:54:21.395244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921320+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:21.921320+0000","last_peered":"2024-04-25T15:54:21.921320+0000","last_clean":"2024-04-25T15:54:21.921320+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:21.921320+0000","last_undegraded":"2024-04-25T15:54:21.921320+0000","last_fullsized":"2024-04-25T15:54:21.921320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395489+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:21.395489+0000","last_peered":"2024-04-25T15:54:21.395489+0000","last_clean":"2024-04-25T15:54:21.395489+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:21.395489+0000","last_undegraded":"2024-04-25T15:54:21.395489+0000","last_fullsized":"2024-04-25T15:54:21.395489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921293+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:21.921293+0000","last_peered":"2024-04-25T15:54:21.921293+0000","last_clean":"2024-04-25T15:54:21.921293+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:21.921293+0000","last_undegraded":"2024-04-25T15:54:21.921293+0000","last_fullsized":"2024-04-25T15:54:21.921293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924964+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:21.924964+0000","last_peered":"2024-04-25T15:54:21.924964+0000","last_clean":"2024-04-25T15:54:21.924964+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:21.924964+0000","last_undegraded":"2024-04-25T15:54:21.924964+0000","last_fullsized":"2024-04-25T15:54:21.924964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922527+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:21.922527+0000","last_peered":"2024-04-25T15:54:21.922527+0000","last_clean":"2024-04-25T15:54:21.922527+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:21.922527+0000","last_undegraded":"2024-04-25T15:54:21.922527+0000","last_fullsized":"2024-04-25T15:54:21.922527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394617+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:21.394617+0000","last_peered":"2024-04-25T15:54:21.394617+0000","last_clean":"2024-04-25T15:54:21.394617+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:21.394617+0000","last_undegraded":"2024-04-25T15:54:21.394617+0000","last_fullsized":"2024-04-25T15:54:21.394617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924299+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:21.924299+0000","last_peered":"2024-04-25T15:54:21.924299+0000","last_clean":"2024-04-25T15:54:21.924299+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:21.924299+0000","last_undegraded":"2024-04-25T15:54:21.924299+0000","last_fullsized":"2024-04-25T15:54:21.924299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441620+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:21.441620+0000","last_peered":"2024-04-25T15:54:21.441620+0000","last_clean":"2024-04-25T15:54:21.441620+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:21.441620+0000","last_undegraded":"2024-04-25T15:54:21.441620+0000","last_fullsized":"2024-04-25T15:54:21.441620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924256+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:21.924256+0000","last_peered":"2024-04-25T15:54:21.924256+0000","last_clean":"2024-04-25T15:54:21.924256+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:21.924256+0000","last_undegraded":"2024-04-25T15:54:21.924256+0000","last_fullsized":"2024-04-25T15:54:21.924256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923071+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:21.923071+0000","last_peered":"2024-04-25T15:54:21.923071+0000","last_clean":"2024-04-25T15:54:21.923071+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:21.923071+0000","last_undegraded":"2024-04-25T15:54:21.923071+0000","last_fullsized":"2024-04-25T15:54:21.923071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921207+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:21.921207+0000","last_peered":"2024-04-25T15:54:21.921207+0000","last_clean":"2024-04-25T15:54:21.921207+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:21.921207+0000","last_undegraded":"2024-04-25T15:54:21.921207+0000","last_fullsized":"2024-04-25T15:54:21.921207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922442+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:21.922442+0000","last_peered":"2024-04-25T15:54:21.922442+0000","last_clean":"2024-04-25T15:54:21.922442+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:21.922442+0000","last_undegraded":"2024-04-25T15:54:21.922442+0000","last_fullsized":"2024-04-25T15:54:21.922442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390298+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:21.390298+0000","last_peered":"2024-04-25T15:54:21.390298+0000","last_clean":"2024-04-25T15:54:21.390298+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:21.390298+0000","last_undegraded":"2024-04-25T15:54:21.390298+0000","last_fullsized":"2024-04-25T15:54:21.390298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437423+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:21.437423+0000","last_peered":"2024-04-25T15:54:21.437423+0000","last_clean":"2024-04-25T15:54:21.437423+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:21.437423+0000","last_undegraded":"2024-04-25T15:54:21.437423+0000","last_fullsized":"2024-04-25T15:54:21.437423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920144+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:21.920144+0000","last_peered":"2024-04-25T15:54:21.920144+0000","last_clean":"2024-04-25T15:54:21.920144+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:21.920144+0000","last_undegraded":"2024-04-25T15:54:21.920144+0000","last_fullsized":"2024-04-25T15:54:21.920144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442947+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:21.442947+0000","last_peered":"2024-04-25T15:54:21.442947+0000","last_clean":"2024-04-25T15:54:21.442947+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:21.442947+0000","last_undegraded":"2024-04-25T15:54:21.442947+0000","last_fullsized":"2024-04-25T15:54:21.442947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922110+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:21.922110+0000","last_peered":"2024-04-25T15:54:21.922110+0000","last_clean":"2024-04-25T15:54:21.922110+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:21.922110+0000","last_undegraded":"2024-04-25T15:54:21.922110+0000","last_fullsized":"2024-04-25T15:54:21.922110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924928+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:21.924928+0000","last_peered":"2024-04-25T15:54:21.924928+0000","last_clean":"2024-04-25T15:54:21.924928+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:21.924928+0000","last_undegraded":"2024-04-25T15:54:21.924928+0000","last_fullsized":"2024-04-25T15:54:21.924928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:31.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:31.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 Processor -- start 2024-04-25T15:54:31.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 -- start start 2024-04-25T15:54:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3844158a00 0x7f38440ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38440adfb0 0x7f384415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3844063660 con 0x7f3844158e10 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f38440c5470 con 0x7f38440adfb0 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3848cfb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f38440ab670 con 0x7f3844158a00 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38440adfb0 0x7f384415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38440adfb0 0x7f384415fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34944/0 (socket says 172.21.15.87:34944) 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 -- 172.21.15.87:0/1624462453 learned_addr learned my addr 172.21.15.87:0/1624462453 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3841d9b640 1 --1- 172.21.15.87:0/1624462453 >> v1:172.21.15.87:6789/0 conn(0x7f3844158e10 0x7f3844152680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54778/0 (socket says 172.21.15.87:54778) 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f384259c640 1 --2- 172.21.15.87:0/1624462453 >> v2:172.21.15.155:3300/0 conn(0x7f3844158a00 0x7f38440ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 -- 172.21.15.87:0/1624462453 >> v2:172.21.15.155:3300/0 conn(0x7f3844158a00 msgr2=0x7f38440ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 --2- 172.21.15.87:0/1624462453 >> v2:172.21.15.155:3300/0 conn(0x7f3844158a00 0x7f38440ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 -- 172.21.15.87:0/1624462453 >> v1:172.21.15.87:6789/0 conn(0x7f3844158e10 legacy=0x7f3844152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f3842d9d640 1 -- 172.21.15.87:0/1624462453 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38440ab930 con 0x7f38440adfb0 2024-04-25T15:54:31.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.341+0000 7f384159a640 1 -- 172.21.15.87:0/1624462453 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871317467 0 0) 0x7f3844063660 con 0x7f3844158e10 2024-04-25T15:54:31.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3842d9d640 1 --2- 172.21.15.87:0/1624462453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38440adfb0 0x7f384415fb60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38440721b0 tx=0x7f383401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88e57182fb98115 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:31.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f384159a640 1 -- 172.21.15.87:0/1624462453 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340a5840 con 0x7f38440adfb0 2024-04-25T15:54:31.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f384159a640 1 -- 172.21.15.87:0/1624462453 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38340a59e0 con 0x7f38440adfb0 2024-04-25T15:54:31.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f384159a640 1 -- 172.21.15.87:0/1624462453 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340a5db0 con 0x7f38440adfb0 2024-04-25T15:54:31.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 -- 172.21.15.87:0/1624462453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38440adfb0 msgr2=0x7f384415fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 --2- 172.21.15.87:0/1624462453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38440adfb0 0x7f384415fb60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f38440721b0 tx=0x7f383401c9c0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 -- 172.21.15.87:0/1624462453 shutdown_connections 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 --2- 172.21.15.87:0/1624462453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38440adfb0 0x7f384415fb60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 --2- 172.21.15.87:0/1624462453 >> v2:172.21.15.155:3300/0 conn(0x7f3844158a00 0x7f38440ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 -- 172.21.15.87:0/1624462453 >> 172.21.15.87:0/1624462453 conn(0x7f384406d650 msgr2=0x7f38440c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 -- 172.21.15.87:0/1624462453 shutdown_connections 2024-04-25T15:54:31.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.345+0000 7f3848cfb640 1 -- 172.21.15.87:0/1624462453 wait complete. 2024-04-25T15:54:31.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 Processor -- start 2024-04-25T15:54:31.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- start start 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38440adfb0 0x7f38441452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844158a00 0x7f38441efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 0x7f38440c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f38440af0f0 con 0x7f3844158e10 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f38440aef70 con 0x7f3844158a00 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f38440749b0 con 0x7f38440adfb0 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 0x7f38440c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 0x7f38440c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34960/0 (socket says 172.21.15.87:34960) 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 -- 172.21.15.87:0/642250760 learned_addr learned my addr 172.21.15.87:0/642250760 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:31.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3841d9b640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844158a00 0x7f38441efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 -- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38440adfb0 msgr2=0x7f38441452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f384259c640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38440adfb0 0x7f38441452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38440adfb0 0x7f38441452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 -- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844158a00 msgr2=0x7f38441efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844158a00 0x7f38441efd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 -- 172.21.15.87:0/642250760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384414dac0 con 0x7f3844158e10 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3841d9b640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844158a00 0x7f38441efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3842d9d640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 0x7f38440c7fb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f383401a5f0 tx=0x7f3834019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b8670 con 0x7f3844158e10 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38340be070 con 0x7f3844158e10 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384414c620 con 0x7f3844158e10 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b8a90 con 0x7f3844158e10 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384414e040 con 0x7f3844158e10 2024-04-25T15:54:31.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3844069bb0 con 0x7f3844158e10 2024-04-25T15:54:31.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.349+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f38340b8c30 con 0x7f3844158e10 2024-04-25T15:54:31.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.353+0000 7f383affd640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f382406f430 0x7f3824071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.353+0000 7f384259c640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f382406f430 0x7f3824071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.353+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f383412a770 con 0x7f3844158e10 2024-04-25T15:54:31.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.353+0000 7f384259c640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f382406f430 0x7f3824071940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f383c0096f0 tx=0x7f383c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:31.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.357+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f38340165e0 con 0x7f3844158e10 2024-04-25T15:54:31.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.501+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38440704e0 con 0x7f382406f430 2024-04-25T15:54:31.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.513+0000 7f383affd640 1 -- 172.21.15.87:0/642250760 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490295 (secure 0 0 0) 0x7f38440704e0 con 0x7f382406f430 2024-04-25T15:54:31.516 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:31.523 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:31.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f382406f430 msgr2=0x7f3824071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f382406f430 0x7f3824071940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f383c0096f0 tx=0x7f383c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:31.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 msgr2=0x7f38440c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 0x7f38440c7fb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f383401a5f0 tx=0x7f3834019760 comp rx=0 tx=0).stop 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 shutdown_connections 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f382406f430 0x7f3824071940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3844158e10 0x7f38440c7fb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844158a00 0x7f38441efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 --2- 172.21.15.87:0/642250760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38440adfb0 0x7f38441452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 >> 172.21.15.87:0/642250760 conn(0x7f384406d650 msgr2=0x7f3844156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 shutdown_connections 2024-04-25T15:54:31.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.521+0000 7f3848cfb640 1 -- 172.21.15.87:0/642250760 wait complete. 2024-04-25T15:54:31.540 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T15:54:31.108425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":191,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004265"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391405+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:21.391405+0000","last_peered":"2024-04-25T15:54:21.391405+0000","last_clean":"2024-04-25T15:54:21.391405+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:21.391405+0000","last_undegraded":"2024-04-25T15:54:21.391405+0000","last_fullsized":"2024-04-25T15:54:21.391405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437024+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:21.437024+0000","last_peered":"2024-04-25T15:54:21.437024+0000","last_clean":"2024-04-25T15:54:21.437024+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:21.437024+0000","last_undegraded":"2024-04-25T15:54:21.437024+0000","last_fullsized":"2024-04-25T15:54:21.437024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923430+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:21.923430+0000","last_peered":"2024-04-25T15:54:21.923430+0000","last_clean":"2024-04-25T15:54:21.923430+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:21.923430+0000","last_undegraded":"2024-04-25T15:54:21.923430+0000","last_fullsized":"2024-04-25T15:54:21.923430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921812+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:21.921812+0000","last_peered":"2024-04-25T15:54:21.921812+0000","last_clean":"2024-04-25T15:54:21.921812+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:21.921812+0000","last_undegraded":"2024-04-25T15:54:21.921812+0000","last_fullsized":"2024-04-25T15:54:21.921812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441214+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:21.441214+0000","last_peered":"2024-04-25T15:54:21.441214+0000","last_clean":"2024-04-25T15:54:21.441214+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:21.441214+0000","last_undegraded":"2024-04-25T15:54:21.441214+0000","last_fullsized":"2024-04-25T15:54:21.441214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923615+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:21.923615+0000","last_peered":"2024-04-25T15:54:21.923615+0000","last_clean":"2024-04-25T15:54:21.923615+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:21.923615+0000","last_undegraded":"2024-04-25T15:54:21.923615+0000","last_fullsized":"2024-04-25T15:54:21.923615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436826+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:21.436826+0000","last_peered":"2024-04-25T15:54:21.436826+0000","last_clean":"2024-04-25T15:54:21.436826+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:21.436826+0000","last_undegraded":"2024-04-25T15:54:21.436826+0000","last_fullsized":"2024-04-25T15:54:21.436826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391229+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:21.391229+0000","last_peered":"2024-04-25T15:54:21.391229+0000","last_clean":"2024-04-25T15:54:21.391229+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:21.391229+0000","last_undegraded":"2024-04-25T15:54:21.391229+0000","last_fullsized":"2024-04-25T15:54:21.391229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921155+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:21.921155+0000","last_peered":"2024-04-25T15:54:21.921155+0000","last_clean":"2024-04-25T15:54:21.921155+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:21.921155+0000","last_undegraded":"2024-04-25T15:54:21.921155+0000","last_fullsized":"2024-04-25T15:54:21.921155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922089+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:21.922089+0000","last_peered":"2024-04-25T15:54:21.922089+0000","last_clean":"2024-04-25T15:54:21.922089+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:21.922089+0000","last_undegraded":"2024-04-25T15:54:21.922089+0000","last_fullsized":"2024-04-25T15:54:21.922089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922747+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:21.922747+0000","last_peered":"2024-04-25T15:54:21.922747+0000","last_clean":"2024-04-25T15:54:21.922747+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:21.922747+0000","last_undegraded":"2024-04-25T15:54:21.922747+0000","last_fullsized":"2024-04-25T15:54:21.922747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393261+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:21.393261+0000","last_peered":"2024-04-25T15:54:21.393261+0000","last_clean":"2024-04-25T15:54:21.393261+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:21.393261+0000","last_undegraded":"2024-04-25T15:54:21.393261+0000","last_fullsized":"2024-04-25T15:54:21.393261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925213+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:21.925213+0000","last_peered":"2024-04-25T15:54:21.925213+0000","last_clean":"2024-04-25T15:54:21.925213+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:21.925213+0000","last_undegraded":"2024-04-25T15:54:21.925213+0000","last_fullsized":"2024-04-25T15:54:21.925213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924737+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:21.924737+0000","last_peered":"2024-04-25T15:54:21.924737+0000","last_clean":"2024-04-25T15:54:21.924737+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:21.924737+0000","last_undegraded":"2024-04-25T15:54:21.924737+0000","last_fullsized":"2024-04-25T15:54:21.924737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924403+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:21.924403+0000","last_peered":"2024-04-25T15:54:21.924403+0000","last_clean":"2024-04-25T15:54:21.924403+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:21.924403+0000","last_undegraded":"2024-04-25T15:54:21.924403+0000","last_fullsized":"2024-04-25T15:54:21.924403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393266+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:21.393266+0000","last_peered":"2024-04-25T15:54:21.393266+0000","last_clean":"2024-04-25T15:54:21.393266+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:21.393266+0000","last_undegraded":"2024-04-25T15:54:21.393266+0000","last_fullsized":"2024-04-25T15:54:21.393266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442122+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:21.442122+0000","last_peered":"2024-04-25T15:54:21.442122+0000","last_clean":"2024-04-25T15:54:21.442122+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:21.442122+0000","last_undegraded":"2024-04-25T15:54:21.442122+0000","last_fullsized":"2024-04-25T15:54:21.442122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394591+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:21.394591+0000","last_peered":"2024-04-25T15:54:21.394591+0000","last_clean":"2024-04-25T15:54:21.394591+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:21.394591+0000","last_undegraded":"2024-04-25T15:54:21.394591+0000","last_fullsized":"2024-04-25T15:54:21.394591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923550+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:21.923550+0000","last_peered":"2024-04-25T15:54:21.923550+0000","last_clean":"2024-04-25T15:54:21.923550+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:21.923550+0000","last_undegraded":"2024-04-25T15:54:21.923550+0000","last_fullsized":"2024-04-25T15:54:21.923550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396443+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:21.396443+0000","last_peered":"2024-04-25T15:54:21.396443+0000","last_clean":"2024-04-25T15:54:21.396443+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:21.396443+0000","last_undegraded":"2024-04-25T15:54:21.396443+0000","last_fullsized":"2024-04-25T15:54:21.396443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389783+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:21.389783+0000","last_peered":"2024-04-25T15:54:21.389783+0000","last_clean":"2024-04-25T15:54:21.389783+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:21.389783+0000","last_undegraded":"2024-04-25T15:54:21.389783+0000","last_fullsized":"2024-04-25T15:54:21.389783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921814+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:21.921814+0000","last_peered":"2024-04-25T15:54:21.921814+0000","last_clean":"2024-04-25T15:54:21.921814+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:21.921814+0000","last_undegraded":"2024-04-25T15:54:21.921814+0000","last_fullsized":"2024-04-25T15:54:21.921814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441971+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:21.441971+0000","last_peered":"2024-04-25T15:54:21.441971+0000","last_clean":"2024-04-25T15:54:21.441971+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:21.441971+0000","last_undegraded":"2024-04-25T15:54:21.441971+0000","last_fullsized":"2024-04-25T15:54:21.441971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397258+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:21.397258+0000","last_peered":"2024-04-25T15:54:21.397258+0000","last_clean":"2024-04-25T15:54:21.397258+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:21.397258+0000","last_undegraded":"2024-04-25T15:54:21.397258+0000","last_fullsized":"2024-04-25T15:54:21.397258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396002+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:21.396002+0000","last_peered":"2024-04-25T15:54:21.396002+0000","last_clean":"2024-04-25T15:54:21.396002+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:21.396002+0000","last_undegraded":"2024-04-25T15:54:21.396002+0000","last_fullsized":"2024-04-25T15:54:21.396002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922919+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:21.922919+0000","last_peered":"2024-04-25T15:54:21.922919+0000","last_clean":"2024-04-25T15:54:21.922919+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:21.922919+0000","last_undegraded":"2024-04-25T15:54:21.922919+0000","last_fullsized":"2024-04-25T15:54:21.922919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441436+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:21.441436+0000","last_peered":"2024-04-25T15:54:21.441436+0000","last_clean":"2024-04-25T15:54:21.441436+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:21.441436+0000","last_undegraded":"2024-04-25T15:54:21.441436+0000","last_fullsized":"2024-04-25T15:54:21.441436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443460+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:21.443460+0000","last_peered":"2024-04-25T15:54:21.443460+0000","last_clean":"2024-04-25T15:54:21.443460+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:21.443460+0000","last_undegraded":"2024-04-25T15:54:21.443460+0000","last_fullsized":"2024-04-25T15:54:21.443460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924171+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:21.924171+0000","last_peered":"2024-04-25T15:54:21.924171+0000","last_clean":"2024-04-25T15:54:21.924171+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:21.924171+0000","last_undegraded":"2024-04-25T15:54:21.924171+0000","last_fullsized":"2024-04-25T15:54:21.924171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392083+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:21.392083+0000","last_peered":"2024-04-25T15:54:21.392083+0000","last_clean":"2024-04-25T15:54:21.392083+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:21.392083+0000","last_undegraded":"2024-04-25T15:54:21.392083+0000","last_fullsized":"2024-04-25T15:54:21.392083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920688+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:21.920688+0000","last_peered":"2024-04-25T15:54:21.920688+0000","last_clean":"2024-04-25T15:54:21.920688+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:21.920688+0000","last_undegraded":"2024-04-25T15:54:21.920688+0000","last_fullsized":"2024-04-25T15:54:21.920688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395966+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:21.395966+0000","last_peered":"2024-04-25T15:54:21.395966+0000","last_clean":"2024-04-25T15:54:21.395966+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:21.395966+0000","last_undegraded":"2024-04-25T15:54:21.395966+0000","last_fullsized":"2024-04-25T15:54:21.395966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920895+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:21.920895+0000","last_peered":"2024-04-25T15:54:21.920895+0000","last_clean":"2024-04-25T15:54:21.920895+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:21.920895+0000","last_undegraded":"2024-04-25T15:54:21.920895+0000","last_fullsized":"2024-04-25T15:54:21.920895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437142+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:21.437142+0000","last_peered":"2024-04-25T15:54:21.437142+0000","last_clean":"2024-04-25T15:54:21.437142+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:21.437142+0000","last_undegraded":"2024-04-25T15:54:21.437142+0000","last_fullsized":"2024-04-25T15:54:21.437142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397313+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:21.397313+0000","last_peered":"2024-04-25T15:54:21.397313+0000","last_clean":"2024-04-25T15:54:21.397313+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:21.397313+0000","last_undegraded":"2024-04-25T15:54:21.397313+0000","last_fullsized":"2024-04-25T15:54:21.397313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391628+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:21.391628+0000","last_peered":"2024-04-25T15:54:21.391628+0000","last_clean":"2024-04-25T15:54:21.391628+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:21.391628+0000","last_undegraded":"2024-04-25T15:54:21.391628+0000","last_fullsized":"2024-04-25T15:54:21.391628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391487+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:21.391487+0000","last_peered":"2024-04-25T15:54:21.391487+0000","last_clean":"2024-04-25T15:54:21.391487+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:21.391487+0000","last_undegraded":"2024-04-25T15:54:21.391487+0000","last_fullsized":"2024-04-25T15:54:21.391487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923027+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:21.923027+0000","last_peered":"2024-04-25T15:54:21.923027+0000","last_clean":"2024-04-25T15:54:21.923027+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:21.923027+0000","last_undegraded":"2024-04-25T15:54:21.923027+0000","last_fullsized":"2024-04-25T15:54:21.923027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443222+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:21.443222+0000","last_peered":"2024-04-25T15:54:21.443222+0000","last_clean":"2024-04-25T15:54:21.443222+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:21.443222+0000","last_undegraded":"2024-04-25T15:54:21.443222+0000","last_fullsized":"2024-04-25T15:54:21.443222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920541+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:21.920541+0000","last_peered":"2024-04-25T15:54:21.920541+0000","last_clean":"2024-04-25T15:54:21.920541+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:21.920541+0000","last_undegraded":"2024-04-25T15:54:21.920541+0000","last_fullsized":"2024-04-25T15:54:21.920541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394741+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:21.394741+0000","last_peered":"2024-04-25T15:54:21.394741+0000","last_clean":"2024-04-25T15:54:21.394741+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:21.394741+0000","last_undegraded":"2024-04-25T15:54:21.394741+0000","last_fullsized":"2024-04-25T15:54:21.394741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442293+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:21.442293+0000","last_peered":"2024-04-25T15:54:21.442293+0000","last_clean":"2024-04-25T15:54:21.442293+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:21.442293+0000","last_undegraded":"2024-04-25T15:54:21.442293+0000","last_fullsized":"2024-04-25T15:54:21.442293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922453+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:21.922453+0000","last_peered":"2024-04-25T15:54:21.922453+0000","last_clean":"2024-04-25T15:54:21.922453+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:21.922453+0000","last_undegraded":"2024-04-25T15:54:21.922453+0000","last_fullsized":"2024-04-25T15:54:21.922453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436667+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:21.436667+0000","last_peered":"2024-04-25T15:54:21.436667+0000","last_clean":"2024-04-25T15:54:21.436667+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:21.436667+0000","last_undegraded":"2024-04-25T15:54:21.436667+0000","last_fullsized":"2024-04-25T15:54:21.436667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437157+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:21.437157+0000","last_peered":"2024-04-25T15:54:21.437157+0000","last_clean":"2024-04-25T15:54:21.437157+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:21.437157+0000","last_undegraded":"2024-04-25T15:54:21.437157+0000","last_fullsized":"2024-04-25T15:54:21.437157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924519+0000","last_change":"2024-04-25T15:54:10.285534+0000","last_active":"2024-04-25T15:54:21.924519+0000","last_peered":"2024-04-25T15:54:21.924519+0000","last_clean":"2024-04-25T15:54:21.924519+0000","last_became_active":"2024-04-25T15:54:10.279471+0000","last_became_peered":"2024-04-25T15:54:10.279471+0000","last_unstale":"2024-04-25T15:54:21.924519+0000","last_undegraded":"2024-04-25T15:54:21.924519+0000","last_fullsized":"2024-04-25T15:54:21.924519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442305+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:21.442305+0000","last_peered":"2024-04-25T15:54:21.442305+0000","last_clean":"2024-04-25T15:54:21.442305+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:21.442305+0000","last_undegraded":"2024-04-25T15:54:21.442305+0000","last_fullsized":"2024-04-25T15:54:21.442305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441751+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:21.441751+0000","last_peered":"2024-04-25T15:54:21.441751+0000","last_clean":"2024-04-25T15:54:21.441751+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:21.441751+0000","last_undegraded":"2024-04-25T15:54:21.441751+0000","last_fullsized":"2024-04-25T15:54:21.441751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437080+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:21.437080+0000","last_peered":"2024-04-25T15:54:21.437080+0000","last_clean":"2024-04-25T15:54:21.437080+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:21.437080+0000","last_undegraded":"2024-04-25T15:54:21.437080+0000","last_fullsized":"2024-04-25T15:54:21.437080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393701+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:21.393701+0000","last_peered":"2024-04-25T15:54:21.393701+0000","last_clean":"2024-04-25T15:54:21.393701+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:21.393701+0000","last_undegraded":"2024-04-25T15:54:21.393701+0000","last_fullsized":"2024-04-25T15:54:21.393701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922767+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:21.922767+0000","last_peered":"2024-04-25T15:54:21.922767+0000","last_clean":"2024-04-25T15:54:21.922767+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:21.922767+0000","last_undegraded":"2024-04-25T15:54:21.922767+0000","last_fullsized":"2024-04-25T15:54:21.922767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442241+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:21.442241+0000","last_peered":"2024-04-25T15:54:21.442241+0000","last_clean":"2024-04-25T15:54:21.442241+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:21.442241+0000","last_undegraded":"2024-04-25T15:54:21.442241+0000","last_fullsized":"2024-04-25T15:54:21.442241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390373+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:21.390373+0000","last_peered":"2024-04-25T15:54:21.390373+0000","last_clean":"2024-04-25T15:54:21.390373+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:21.390373+0000","last_undegraded":"2024-04-25T15:54:21.390373+0000","last_fullsized":"2024-04-25T15:54:21.390373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441402+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:21.441402+0000","last_peered":"2024-04-25T15:54:21.441402+0000","last_clean":"2024-04-25T15:54:21.441402+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:21.441402+0000","last_undegraded":"2024-04-25T15:54:21.441402+0000","last_fullsized":"2024-04-25T15:54:21.441402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389173+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:21.389173+0000","last_peered":"2024-04-25T15:54:21.389173+0000","last_clean":"2024-04-25T15:54:21.389173+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:21.389173+0000","last_undegraded":"2024-04-25T15:54:21.389173+0000","last_fullsized":"2024-04-25T15:54:21.389173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443394+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:21.443394+0000","last_peered":"2024-04-25T15:54:21.443394+0000","last_clean":"2024-04-25T15:54:21.443394+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:21.443394+0000","last_undegraded":"2024-04-25T15:54:21.443394+0000","last_fullsized":"2024-04-25T15:54:21.443394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925008+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:21.925008+0000","last_peered":"2024-04-25T15:54:21.925008+0000","last_clean":"2024-04-25T15:54:21.925008+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:21.925008+0000","last_undegraded":"2024-04-25T15:54:21.925008+0000","last_fullsized":"2024-04-25T15:54:21.925008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436357+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:21.436357+0000","last_peered":"2024-04-25T15:54:21.436357+0000","last_clean":"2024-04-25T15:54:21.436357+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:21.436357+0000","last_undegraded":"2024-04-25T15:54:21.436357+0000","last_fullsized":"2024-04-25T15:54:21.436357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920818+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:21.920818+0000","last_peered":"2024-04-25T15:54:21.920818+0000","last_clean":"2024-04-25T15:54:21.920818+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:21.920818+0000","last_undegraded":"2024-04-25T15:54:21.920818+0000","last_fullsized":"2024-04-25T15:54:21.920818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.439414+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:21.439414+0000","last_peered":"2024-04-25T15:54:21.439414+0000","last_clean":"2024-04-25T15:54:21.439414+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:21.439414+0000","last_undegraded":"2024-04-25T15:54:21.439414+0000","last_fullsized":"2024-04-25T15:54:21.439414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924237+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:21.924237+0000","last_peered":"2024-04-25T15:54:21.924237+0000","last_clean":"2024-04-25T15:54:21.924237+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:21.924237+0000","last_undegraded":"2024-04-25T15:54:21.924237+0000","last_fullsized":"2024-04-25T15:54:21.924237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921664+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:21.921664+0000","last_peered":"2024-04-25T15:54:21.921664+0000","last_clean":"2024-04-25T15:54:21.921664+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:21.921664+0000","last_undegraded":"2024-04-25T15:54:21.921664+0000","last_fullsized":"2024-04-25T15:54:21.921664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925364+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:21.925364+0000","last_peered":"2024-04-25T15:54:21.925364+0000","last_clean":"2024-04-25T15:54:21.925364+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:21.925364+0000","last_undegraded":"2024-04-25T15:54:21.925364+0000","last_fullsized":"2024-04-25T15:54:21.925364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921478+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:21.921478+0000","last_peered":"2024-04-25T15:54:21.921478+0000","last_clean":"2024-04-25T15:54:21.921478+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:21.921478+0000","last_undegraded":"2024-04-25T15:54:21.921478+0000","last_fullsized":"2024-04-25T15:54:21.921478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394923+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:21.394923+0000","last_peered":"2024-04-25T15:54:21.394923+0000","last_clean":"2024-04-25T15:54:21.394923+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:21.394923+0000","last_undegraded":"2024-04-25T15:54:21.394923+0000","last_fullsized":"2024-04-25T15:54:21.394923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390876+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:21.390876+0000","last_peered":"2024-04-25T15:54:21.390876+0000","last_clean":"2024-04-25T15:54:21.390876+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:21.390876+0000","last_undegraded":"2024-04-25T15:54:21.390876+0000","last_fullsized":"2024-04-25T15:54:21.390876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922057+0000","last_change":"2024-04-25T15:54:10.294873+0000","last_active":"2024-04-25T15:54:21.922057+0000","last_peered":"2024-04-25T15:54:21.922057+0000","last_clean":"2024-04-25T15:54:21.922057+0000","last_became_active":"2024-04-25T15:54:10.291885+0000","last_became_peered":"2024-04-25T15:54:10.291885+0000","last_unstale":"2024-04-25T15:54:21.922057+0000","last_undegraded":"2024-04-25T15:54:21.922057+0000","last_fullsized":"2024-04-25T15:54:21.922057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390368+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:21.390368+0000","last_peered":"2024-04-25T15:54:21.390368+0000","last_clean":"2024-04-25T15:54:21.390368+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:21.390368+0000","last_undegraded":"2024-04-25T15:54:21.390368+0000","last_fullsized":"2024-04-25T15:54:21.390368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394250+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:21.394250+0000","last_peered":"2024-04-25T15:54:21.394250+0000","last_clean":"2024-04-25T15:54:21.394250+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:21.394250+0000","last_undegraded":"2024-04-25T15:54:21.394250+0000","last_fullsized":"2024-04-25T15:54:21.394250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389873+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:21.389873+0000","last_peered":"2024-04-25T15:54:21.389873+0000","last_clean":"2024-04-25T15:54:21.389873+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:21.389873+0000","last_undegraded":"2024-04-25T15:54:21.389873+0000","last_fullsized":"2024-04-25T15:54:21.389873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923240+0000","last_change":"2024-04-25T15:54:10.271652+0000","last_active":"2024-04-25T15:54:21.923240+0000","last_peered":"2024-04-25T15:54:21.923240+0000","last_clean":"2024-04-25T15:54:21.923240+0000","last_became_active":"2024-04-25T15:54:10.270697+0000","last_became_peered":"2024-04-25T15:54:10.270697+0000","last_unstale":"2024-04-25T15:54:21.923240+0000","last_undegraded":"2024-04-25T15:54:21.923240+0000","last_fullsized":"2024-04-25T15:54:21.923240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443076+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:21.443076+0000","last_peered":"2024-04-25T15:54:21.443076+0000","last_clean":"2024-04-25T15:54:21.443076+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:21.443076+0000","last_undegraded":"2024-04-25T15:54:21.443076+0000","last_fullsized":"2024-04-25T15:54:21.443076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436482+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:21.436482+0000","last_peered":"2024-04-25T15:54:21.436482+0000","last_clean":"2024-04-25T15:54:21.436482+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:21.436482+0000","last_undegraded":"2024-04-25T15:54:21.436482+0000","last_fullsized":"2024-04-25T15:54:21.436482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921967+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:21.921967+0000","last_peered":"2024-04-25T15:54:21.921967+0000","last_clean":"2024-04-25T15:54:21.921967+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:21.921967+0000","last_undegraded":"2024-04-25T15:54:21.921967+0000","last_fullsized":"2024-04-25T15:54:21.921967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925121+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:21.925121+0000","last_peered":"2024-04-25T15:54:21.925121+0000","last_clean":"2024-04-25T15:54:21.925121+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:21.925121+0000","last_undegraded":"2024-04-25T15:54:21.925121+0000","last_fullsized":"2024-04-25T15:54:21.925121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390564+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:21.390564+0000","last_peered":"2024-04-25T15:54:21.390564+0000","last_clean":"2024-04-25T15:54:21.390564+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:21.390564+0000","last_undegraded":"2024-04-25T15:54:21.390564+0000","last_fullsized":"2024-04-25T15:54:21.390564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920163+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:21.920163+0000","last_peered":"2024-04-25T15:54:21.920163+0000","last_clean":"2024-04-25T15:54:21.920163+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:21.920163+0000","last_undegraded":"2024-04-25T15:54:21.920163+0000","last_fullsized":"2024-04-25T15:54:21.920163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389276+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:21.389276+0000","last_peered":"2024-04-25T15:54:21.389276+0000","last_clean":"2024-04-25T15:54:21.389276+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:21.389276+0000","last_undegraded":"2024-04-25T15:54:21.389276+0000","last_fullsized":"2024-04-25T15:54:21.389276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925892+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:21.925892+0000","last_peered":"2024-04-25T15:54:21.925892+0000","last_clean":"2024-04-25T15:54:21.925892+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:21.925892+0000","last_undegraded":"2024-04-25T15:54:21.925892+0000","last_fullsized":"2024-04-25T15:54:21.925892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397052+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:21.397052+0000","last_peered":"2024-04-25T15:54:21.397052+0000","last_clean":"2024-04-25T15:54:21.397052+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:21.397052+0000","last_undegraded":"2024-04-25T15:54:21.397052+0000","last_fullsized":"2024-04-25T15:54:21.397052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.391328+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:21.391328+0000","last_peered":"2024-04-25T15:54:21.391328+0000","last_clean":"2024-04-25T15:54:21.391328+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:21.391328+0000","last_undegraded":"2024-04-25T15:54:21.391328+0000","last_fullsized":"2024-04-25T15:54:21.391328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922858+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:21.922858+0000","last_peered":"2024-04-25T15:54:21.922858+0000","last_clean":"2024-04-25T15:54:21.922858+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:21.922858+0000","last_undegraded":"2024-04-25T15:54:21.922858+0000","last_fullsized":"2024-04-25T15:54:21.922858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922521+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:21.922521+0000","last_peered":"2024-04-25T15:54:21.922521+0000","last_clean":"2024-04-25T15:54:21.922521+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:21.922521+0000","last_undegraded":"2024-04-25T15:54:21.922521+0000","last_fullsized":"2024-04-25T15:54:21.922521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389197+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:21.389197+0000","last_peered":"2024-04-25T15:54:21.389197+0000","last_clean":"2024-04-25T15:54:21.389197+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:21.389197+0000","last_undegraded":"2024-04-25T15:54:21.389197+0000","last_fullsized":"2024-04-25T15:54:21.389197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437180+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:21.437180+0000","last_peered":"2024-04-25T15:54:21.437180+0000","last_clean":"2024-04-25T15:54:21.437180+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:21.437180+0000","last_undegraded":"2024-04-25T15:54:21.437180+0000","last_fullsized":"2024-04-25T15:54:21.437180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923162+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:21.923162+0000","last_peered":"2024-04-25T15:54:21.923162+0000","last_clean":"2024-04-25T15:54:21.923162+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:21.923162+0000","last_undegraded":"2024-04-25T15:54:21.923162+0000","last_fullsized":"2024-04-25T15:54:21.923162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394159+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:21.394159+0000","last_peered":"2024-04-25T15:54:21.394159+0000","last_clean":"2024-04-25T15:54:21.394159+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:21.394159+0000","last_undegraded":"2024-04-25T15:54:21.394159+0000","last_fullsized":"2024-04-25T15:54:21.394159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395369+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:21.395369+0000","last_peered":"2024-04-25T15:54:21.395369+0000","last_clean":"2024-04-25T15:54:21.395369+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:21.395369+0000","last_undegraded":"2024-04-25T15:54:21.395369+0000","last_fullsized":"2024-04-25T15:54:21.395369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922677+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:21.922677+0000","last_peered":"2024-04-25T15:54:21.922677+0000","last_clean":"2024-04-25T15:54:21.922677+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:21.922677+0000","last_undegraded":"2024-04-25T15:54:21.922677+0000","last_fullsized":"2024-04-25T15:54:21.922677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923119+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:21.923119+0000","last_peered":"2024-04-25T15:54:21.923119+0000","last_clean":"2024-04-25T15:54:21.923119+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:21.923119+0000","last_undegraded":"2024-04-25T15:54:21.923119+0000","last_fullsized":"2024-04-25T15:54:21.923119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923220+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:21.923220+0000","last_peered":"2024-04-25T15:54:21.923220+0000","last_clean":"2024-04-25T15:54:21.923220+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:21.923220+0000","last_undegraded":"2024-04-25T15:54:21.923220+0000","last_fullsized":"2024-04-25T15:54:21.923220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922602+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:21.922602+0000","last_peered":"2024-04-25T15:54:21.922602+0000","last_clean":"2024-04-25T15:54:21.922602+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:21.922602+0000","last_undegraded":"2024-04-25T15:54:21.922602+0000","last_fullsized":"2024-04-25T15:54:21.922602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921972+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:21.921972+0000","last_peered":"2024-04-25T15:54:21.921972+0000","last_clean":"2024-04-25T15:54:21.921972+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:21.921972+0000","last_undegraded":"2024-04-25T15:54:21.921972+0000","last_fullsized":"2024-04-25T15:54:21.921972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436318+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:21.436318+0000","last_peered":"2024-04-25T15:54:21.436318+0000","last_clean":"2024-04-25T15:54:21.436318+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:21.436318+0000","last_undegraded":"2024-04-25T15:54:21.436318+0000","last_fullsized":"2024-04-25T15:54:21.436318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437324+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:21.437324+0000","last_peered":"2024-04-25T15:54:21.437324+0000","last_clean":"2024-04-25T15:54:21.437324+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:21.437324+0000","last_undegraded":"2024-04-25T15:54:21.437324+0000","last_fullsized":"2024-04-25T15:54:21.437324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924345+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:21.924345+0000","last_peered":"2024-04-25T15:54:21.924345+0000","last_clean":"2024-04-25T15:54:21.924345+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:21.924345+0000","last_undegraded":"2024-04-25T15:54:21.924345+0000","last_fullsized":"2024-04-25T15:54:21.924345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922285+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:21.922285+0000","last_peered":"2024-04-25T15:54:21.922285+0000","last_clean":"2024-04-25T15:54:21.922285+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:21.922285+0000","last_undegraded":"2024-04-25T15:54:21.922285+0000","last_fullsized":"2024-04-25T15:54:21.922285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921704+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:21.921704+0000","last_peered":"2024-04-25T15:54:21.921704+0000","last_clean":"2024-04-25T15:54:21.921704+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:21.921704+0000","last_undegraded":"2024-04-25T15:54:21.921704+0000","last_fullsized":"2024-04-25T15:54:21.921704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395230+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:21.395230+0000","last_peered":"2024-04-25T15:54:21.395230+0000","last_clean":"2024-04-25T15:54:21.395230+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:21.395230+0000","last_undegraded":"2024-04-25T15:54:21.395230+0000","last_fullsized":"2024-04-25T15:54:21.395230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441572+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:21.441572+0000","last_peered":"2024-04-25T15:54:21.441572+0000","last_clean":"2024-04-25T15:54:21.441572+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:21.441572+0000","last_undegraded":"2024-04-25T15:54:21.441572+0000","last_fullsized":"2024-04-25T15:54:21.441572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441814+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:21.441814+0000","last_peered":"2024-04-25T15:54:21.441814+0000","last_clean":"2024-04-25T15:54:21.441814+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:21.441814+0000","last_undegraded":"2024-04-25T15:54:21.441814+0000","last_fullsized":"2024-04-25T15:54:21.441814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397497+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:21.397497+0000","last_peered":"2024-04-25T15:54:21.397497+0000","last_clean":"2024-04-25T15:54:21.397497+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:21.397497+0000","last_undegraded":"2024-04-25T15:54:21.397497+0000","last_fullsized":"2024-04-25T15:54:21.397497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443036+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:21.443036+0000","last_peered":"2024-04-25T15:54:21.443036+0000","last_clean":"2024-04-25T15:54:21.443036+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:21.443036+0000","last_undegraded":"2024-04-25T15:54:21.443036+0000","last_fullsized":"2024-04-25T15:54:21.443036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393180+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:21.393180+0000","last_peered":"2024-04-25T15:54:21.393180+0000","last_clean":"2024-04-25T15:54:21.393180+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:21.393180+0000","last_undegraded":"2024-04-25T15:54:21.393180+0000","last_fullsized":"2024-04-25T15:54:21.393180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395117+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:21.395117+0000","last_peered":"2024-04-25T15:54:21.395117+0000","last_clean":"2024-04-25T15:54:21.395117+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:21.395117+0000","last_undegraded":"2024-04-25T15:54:21.395117+0000","last_fullsized":"2024-04-25T15:54:21.395117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436903+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:21.436903+0000","last_peered":"2024-04-25T15:54:21.436903+0000","last_clean":"2024-04-25T15:54:21.436903+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:21.436903+0000","last_undegraded":"2024-04-25T15:54:21.436903+0000","last_fullsized":"2024-04-25T15:54:21.436903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923570+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:21.923570+0000","last_peered":"2024-04-25T15:54:21.923570+0000","last_clean":"2024-04-25T15:54:21.923570+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:21.923570+0000","last_undegraded":"2024-04-25T15:54:21.923570+0000","last_fullsized":"2024-04-25T15:54:21.923570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921005+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:21.921005+0000","last_peered":"2024-04-25T15:54:21.921005+0000","last_clean":"2024-04-25T15:54:21.921005+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:21.921005+0000","last_undegraded":"2024-04-25T15:54:21.921005+0000","last_fullsized":"2024-04-25T15:54:21.921005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920631+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:21.920631+0000","last_peered":"2024-04-25T15:54:21.920631+0000","last_clean":"2024-04-25T15:54:21.920631+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:21.920631+0000","last_undegraded":"2024-04-25T15:54:21.920631+0000","last_fullsized":"2024-04-25T15:54:21.920631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923339+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:21.923339+0000","last_peered":"2024-04-25T15:54:21.923339+0000","last_clean":"2024-04-25T15:54:21.923339+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:21.923339+0000","last_undegraded":"2024-04-25T15:54:21.923339+0000","last_fullsized":"2024-04-25T15:54:21.923339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397036+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:21.397036+0000","last_peered":"2024-04-25T15:54:21.397036+0000","last_clean":"2024-04-25T15:54:21.397036+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:21.397036+0000","last_undegraded":"2024-04-25T15:54:21.397036+0000","last_fullsized":"2024-04-25T15:54:21.397036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920956+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:21.920956+0000","last_peered":"2024-04-25T15:54:21.920956+0000","last_clean":"2024-04-25T15:54:21.920956+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:21.920956+0000","last_undegraded":"2024-04-25T15:54:21.920956+0000","last_fullsized":"2024-04-25T15:54:21.920956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396385+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:21.396385+0000","last_peered":"2024-04-25T15:54:21.396385+0000","last_clean":"2024-04-25T15:54:21.396385+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:21.396385+0000","last_undegraded":"2024-04-25T15:54:21.396385+0000","last_fullsized":"2024-04-25T15:54:21.396385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437021+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:21.437021+0000","last_peered":"2024-04-25T15:54:21.437021+0000","last_clean":"2024-04-25T15:54:21.437021+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:21.437021+0000","last_undegraded":"2024-04-25T15:54:21.437021+0000","last_fullsized":"2024-04-25T15:54:21.437021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441296+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:21.441296+0000","last_peered":"2024-04-25T15:54:21.441296+0000","last_clean":"2024-04-25T15:54:21.441296+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:21.441296+0000","last_undegraded":"2024-04-25T15:54:21.441296+0000","last_fullsized":"2024-04-25T15:54:21.441296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920923+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:21.920923+0000","last_peered":"2024-04-25T15:54:21.920923+0000","last_clean":"2024-04-25T15:54:21.920923+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:21.920923+0000","last_undegraded":"2024-04-25T15:54:21.920923+0000","last_fullsized":"2024-04-25T15:54:21.920923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436823+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:21.436823+0000","last_peered":"2024-04-25T15:54:21.436823+0000","last_clean":"2024-04-25T15:54:21.436823+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:21.436823+0000","last_undegraded":"2024-04-25T15:54:21.436823+0000","last_fullsized":"2024-04-25T15:54:21.436823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.396688+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:21.396688+0000","last_peered":"2024-04-25T15:54:21.396688+0000","last_clean":"2024-04-25T15:54:21.396688+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:21.396688+0000","last_undegraded":"2024-04-25T15:54:21.396688+0000","last_fullsized":"2024-04-25T15:54:21.396688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922853+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:21.922853+0000","last_peered":"2024-04-25T15:54:21.922853+0000","last_clean":"2024-04-25T15:54:21.922853+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:21.922853+0000","last_undegraded":"2024-04-25T15:54:21.922853+0000","last_fullsized":"2024-04-25T15:54:21.922853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922209+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:21.922209+0000","last_peered":"2024-04-25T15:54:21.922209+0000","last_clean":"2024-04-25T15:54:21.922209+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:21.922209+0000","last_undegraded":"2024-04-25T15:54:21.922209+0000","last_fullsized":"2024-04-25T15:54:21.922209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442811+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:21.442811+0000","last_peered":"2024-04-25T15:54:21.442811+0000","last_clean":"2024-04-25T15:54:21.442811+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:21.442811+0000","last_undegraded":"2024-04-25T15:54:21.442811+0000","last_fullsized":"2024-04-25T15:54:21.442811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394919+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:21.394919+0000","last_peered":"2024-04-25T15:54:21.394919+0000","last_clean":"2024-04-25T15:54:21.394919+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:21.394919+0000","last_undegraded":"2024-04-25T15:54:21.394919+0000","last_fullsized":"2024-04-25T15:54:21.394919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437206+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:21.437206+0000","last_peered":"2024-04-25T15:54:21.437206+0000","last_clean":"2024-04-25T15:54:21.437206+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:21.437206+0000","last_undegraded":"2024-04-25T15:54:21.437206+0000","last_fullsized":"2024-04-25T15:54:21.437206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390654+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:21.390654+0000","last_peered":"2024-04-25T15:54:21.390654+0000","last_clean":"2024-04-25T15:54:21.390654+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:21.390654+0000","last_undegraded":"2024-04-25T15:54:21.390654+0000","last_fullsized":"2024-04-25T15:54:21.390654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393791+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:21.393791+0000","last_peered":"2024-04-25T15:54:21.393791+0000","last_clean":"2024-04-25T15:54:21.393791+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:21.393791+0000","last_undegraded":"2024-04-25T15:54:21.393791+0000","last_fullsized":"2024-04-25T15:54:21.393791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923014+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:21.923014+0000","last_peered":"2024-04-25T15:54:21.923014+0000","last_clean":"2024-04-25T15:54:21.923014+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:21.923014+0000","last_undegraded":"2024-04-25T15:54:21.923014+0000","last_fullsized":"2024-04-25T15:54:21.923014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393788+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:21.393788+0000","last_peered":"2024-04-25T15:54:21.393788+0000","last_clean":"2024-04-25T15:54:21.393788+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:21.393788+0000","last_undegraded":"2024-04-25T15:54:21.393788+0000","last_fullsized":"2024-04-25T15:54:21.393788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922425+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:21.922425+0000","last_peered":"2024-04-25T15:54:21.922425+0000","last_clean":"2024-04-25T15:54:21.922425+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:21.922425+0000","last_undegraded":"2024-04-25T15:54:21.922425+0000","last_fullsized":"2024-04-25T15:54:21.922425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923390+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:21.923390+0000","last_peered":"2024-04-25T15:54:21.923390+0000","last_clean":"2024-04-25T15:54:21.923390+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:21.923390+0000","last_undegraded":"2024-04-25T15:54:21.923390+0000","last_fullsized":"2024-04-25T15:54:21.923390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.393859+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:21.393859+0000","last_peered":"2024-04-25T15:54:21.393859+0000","last_clean":"2024-04-25T15:54:21.393859+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:21.393859+0000","last_undegraded":"2024-04-25T15:54:21.393859+0000","last_fullsized":"2024-04-25T15:54:21.393859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.443040+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:21.443040+0000","last_peered":"2024-04-25T15:54:21.443040+0000","last_clean":"2024-04-25T15:54:21.443040+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:21.443040+0000","last_undegraded":"2024-04-25T15:54:21.443040+0000","last_fullsized":"2024-04-25T15:54:21.443040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.388928+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:21.388928+0000","last_peered":"2024-04-25T15:54:21.388928+0000","last_clean":"2024-04-25T15:54:21.388928+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:21.388928+0000","last_undegraded":"2024-04-25T15:54:21.388928+0000","last_fullsized":"2024-04-25T15:54:21.388928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922270+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:21.922270+0000","last_peered":"2024-04-25T15:54:21.922270+0000","last_clean":"2024-04-25T15:54:21.922270+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:21.922270+0000","last_undegraded":"2024-04-25T15:54:21.922270+0000","last_fullsized":"2024-04-25T15:54:21.922270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922344+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:21.922344+0000","last_peered":"2024-04-25T15:54:21.922344+0000","last_clean":"2024-04-25T15:54:21.922344+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:21.922344+0000","last_undegraded":"2024-04-25T15:54:21.922344+0000","last_fullsized":"2024-04-25T15:54:21.922344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442696+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:21.442696+0000","last_peered":"2024-04-25T15:54:21.442696+0000","last_clean":"2024-04-25T15:54:21.442696+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:21.442696+0000","last_undegraded":"2024-04-25T15:54:21.442696+0000","last_fullsized":"2024-04-25T15:54:21.442696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437246+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:21.437246+0000","last_peered":"2024-04-25T15:54:21.437246+0000","last_clean":"2024-04-25T15:54:21.437246+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:21.437246+0000","last_undegraded":"2024-04-25T15:54:21.437246+0000","last_fullsized":"2024-04-25T15:54:21.437246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920646+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:21.920646+0000","last_peered":"2024-04-25T15:54:21.920646+0000","last_clean":"2024-04-25T15:54:21.920646+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:21.920646+0000","last_undegraded":"2024-04-25T15:54:21.920646+0000","last_fullsized":"2024-04-25T15:54:21.920646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922785+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:21.922785+0000","last_peered":"2024-04-25T15:54:21.922785+0000","last_clean":"2024-04-25T15:54:21.922785+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:21.922785+0000","last_undegraded":"2024-04-25T15:54:21.922785+0000","last_fullsized":"2024-04-25T15:54:21.922785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392960+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:21.392960+0000","last_peered":"2024-04-25T15:54:21.392960+0000","last_clean":"2024-04-25T15:54:21.392960+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:21.392960+0000","last_undegraded":"2024-04-25T15:54:21.392960+0000","last_fullsized":"2024-04-25T15:54:21.392960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442870+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:21.442870+0000","last_peered":"2024-04-25T15:54:21.442870+0000","last_clean":"2024-04-25T15:54:21.442870+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:21.442870+0000","last_undegraded":"2024-04-25T15:54:21.442870+0000","last_fullsized":"2024-04-25T15:54:21.442870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:21.920320+0000","last_peered":"2024-04-25T15:54:21.920320+0000","last_clean":"2024-04-25T15:54:21.920320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:21.920320+0000","last_undegraded":"2024-04-25T15:54:21.920320+0000","last_fullsized":"2024-04-25T15:54:21.920320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395555+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:21.395555+0000","last_peered":"2024-04-25T15:54:21.395555+0000","last_clean":"2024-04-25T15:54:21.395555+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:21.395555+0000","last_undegraded":"2024-04-25T15:54:21.395555+0000","last_fullsized":"2024-04-25T15:54:21.395555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394927+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:21.394927+0000","last_peered":"2024-04-25T15:54:21.394927+0000","last_clean":"2024-04-25T15:54:21.394927+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:21.394927+0000","last_undegraded":"2024-04-25T15:54:21.394927+0000","last_fullsized":"2024-04-25T15:54:21.394927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922828+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:21.922828+0000","last_peered":"2024-04-25T15:54:21.922828+0000","last_clean":"2024-04-25T15:54:21.922828+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:21.922828+0000","last_undegraded":"2024-04-25T15:54:21.922828+0000","last_fullsized":"2024-04-25T15:54:21.922828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923075+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:21.923075+0000","last_peered":"2024-04-25T15:54:21.923075+0000","last_clean":"2024-04-25T15:54:21.923075+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:21.923075+0000","last_undegraded":"2024-04-25T15:54:21.923075+0000","last_fullsized":"2024-04-25T15:54:21.923075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920626+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:21.920626+0000","last_peered":"2024-04-25T15:54:21.920626+0000","last_clean":"2024-04-25T15:54:21.920626+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:21.920626+0000","last_undegraded":"2024-04-25T15:54:21.920626+0000","last_fullsized":"2024-04-25T15:54:21.920626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924321+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:21.924321+0000","last_peered":"2024-04-25T15:54:21.924321+0000","last_clean":"2024-04-25T15:54:21.924321+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:21.924321+0000","last_undegraded":"2024-04-25T15:54:21.924321+0000","last_fullsized":"2024-04-25T15:54:21.924321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921198+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:21.921198+0000","last_peered":"2024-04-25T15:54:21.921198+0000","last_clean":"2024-04-25T15:54:21.921198+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:21.921198+0000","last_undegraded":"2024-04-25T15:54:21.921198+0000","last_fullsized":"2024-04-25T15:54:21.921198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.389900+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:21.389900+0000","last_peered":"2024-04-25T15:54:21.389900+0000","last_clean":"2024-04-25T15:54:21.389900+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:21.389900+0000","last_undegraded":"2024-04-25T15:54:21.389900+0000","last_fullsized":"2024-04-25T15:54:21.389900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922079+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:21.922079+0000","last_peered":"2024-04-25T15:54:21.922079+0000","last_clean":"2024-04-25T15:54:21.922079+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:21.922079+0000","last_undegraded":"2024-04-25T15:54:21.922079+0000","last_fullsized":"2024-04-25T15:54:21.922079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922061+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:21.922061+0000","last_peered":"2024-04-25T15:54:21.922061+0000","last_clean":"2024-04-25T15:54:21.922061+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:21.922061+0000","last_undegraded":"2024-04-25T15:54:21.922061+0000","last_fullsized":"2024-04-25T15:54:21.922061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436923+0000","last_change":"2024-04-25T15:54:10.267602+0000","last_active":"2024-04-25T15:54:21.436923+0000","last_peered":"2024-04-25T15:54:21.436923+0000","last_clean":"2024-04-25T15:54:21.436923+0000","last_became_active":"2024-04-25T15:54:10.267276+0000","last_became_peered":"2024-04-25T15:54:10.267276+0000","last_unstale":"2024-04-25T15:54:21.436923+0000","last_undegraded":"2024-04-25T15:54:21.436923+0000","last_fullsized":"2024-04-25T15:54:21.436923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392942+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:21.392942+0000","last_peered":"2024-04-25T15:54:21.392942+0000","last_clean":"2024-04-25T15:54:21.392942+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:21.392942+0000","last_undegraded":"2024-04-25T15:54:21.392942+0000","last_fullsized":"2024-04-25T15:54:21.392942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395042+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:21.395042+0000","last_peered":"2024-04-25T15:54:21.395042+0000","last_clean":"2024-04-25T15:54:21.395042+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:21.395042+0000","last_undegraded":"2024-04-25T15:54:21.395042+0000","last_fullsized":"2024-04-25T15:54:21.395042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.392913+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:21.392913+0000","last_peered":"2024-04-25T15:54:21.392913+0000","last_clean":"2024-04-25T15:54:21.392913+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:21.392913+0000","last_undegraded":"2024-04-25T15:54:21.392913+0000","last_fullsized":"2024-04-25T15:54:21.392913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922342+0000","last_change":"2024-04-25T15:54:10.295088+0000","last_active":"2024-04-25T15:54:21.922342+0000","last_peered":"2024-04-25T15:54:21.922342+0000","last_clean":"2024-04-25T15:54:21.922342+0000","last_became_active":"2024-04-25T15:54:10.292412+0000","last_became_peered":"2024-04-25T15:54:10.292412+0000","last_unstale":"2024-04-25T15:54:21.922342+0000","last_undegraded":"2024-04-25T15:54:21.922342+0000","last_fullsized":"2024-04-25T15:54:21.922342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920147+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:21.920147+0000","last_peered":"2024-04-25T15:54:21.920147+0000","last_clean":"2024-04-25T15:54:21.920147+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:21.920147+0000","last_undegraded":"2024-04-25T15:54:21.920147+0000","last_fullsized":"2024-04-25T15:54:21.920147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390651+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:21.390651+0000","last_peered":"2024-04-25T15:54:21.390651+0000","last_clean":"2024-04-25T15:54:21.390651+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:21.390651+0000","last_undegraded":"2024-04-25T15:54:21.390651+0000","last_fullsized":"2024-04-25T15:54:21.390651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436337+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:21.436337+0000","last_peered":"2024-04-25T15:54:21.436337+0000","last_clean":"2024-04-25T15:54:21.436337+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:21.436337+0000","last_undegraded":"2024-04-25T15:54:21.436337+0000","last_fullsized":"2024-04-25T15:54:21.436337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.925691+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:21.925691+0000","last_peered":"2024-04-25T15:54:21.925691+0000","last_clean":"2024-04-25T15:54:21.925691+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:21.925691+0000","last_undegraded":"2024-04-25T15:54:21.925691+0000","last_fullsized":"2024-04-25T15:54:21.925691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442692+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:21.442692+0000","last_peered":"2024-04-25T15:54:21.442692+0000","last_clean":"2024-04-25T15:54:21.442692+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:21.442692+0000","last_undegraded":"2024-04-25T15:54:21.442692+0000","last_fullsized":"2024-04-25T15:54:21.442692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920342+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:21.920342+0000","last_peered":"2024-04-25T15:54:21.920342+0000","last_clean":"2024-04-25T15:54:21.920342+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:21.920342+0000","last_undegraded":"2024-04-25T15:54:21.920342+0000","last_fullsized":"2024-04-25T15:54:21.920342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397074+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:21.397074+0000","last_peered":"2024-04-25T15:54:21.397074+0000","last_clean":"2024-04-25T15:54:21.397074+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:21.397074+0000","last_undegraded":"2024-04-25T15:54:21.397074+0000","last_fullsized":"2024-04-25T15:54:21.397074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441304+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:21.441304+0000","last_peered":"2024-04-25T15:54:21.441304+0000","last_clean":"2024-04-25T15:54:21.441304+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:21.441304+0000","last_undegraded":"2024-04-25T15:54:21.441304+0000","last_fullsized":"2024-04-25T15:54:21.441304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921760+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:21.921760+0000","last_peered":"2024-04-25T15:54:21.921760+0000","last_clean":"2024-04-25T15:54:21.921760+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:21.921760+0000","last_undegraded":"2024-04-25T15:54:21.921760+0000","last_fullsized":"2024-04-25T15:54:21.921760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.436316+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:21.436316+0000","last_peered":"2024-04-25T15:54:21.436316+0000","last_clean":"2024-04-25T15:54:21.436316+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:21.436316+0000","last_undegraded":"2024-04-25T15:54:21.436316+0000","last_fullsized":"2024-04-25T15:54:21.436316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921519+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:21.921519+0000","last_peered":"2024-04-25T15:54:21.921519+0000","last_clean":"2024-04-25T15:54:21.921519+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:21.921519+0000","last_undegraded":"2024-04-25T15:54:21.921519+0000","last_fullsized":"2024-04-25T15:54:21.921519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921500+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:21.921500+0000","last_peered":"2024-04-25T15:54:21.921500+0000","last_clean":"2024-04-25T15:54:21.921500+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:21.921500+0000","last_undegraded":"2024-04-25T15:54:21.921500+0000","last_fullsized":"2024-04-25T15:54:21.921500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.397415+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:21.397415+0000","last_peered":"2024-04-25T15:54:21.397415+0000","last_clean":"2024-04-25T15:54:21.397415+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:21.397415+0000","last_undegraded":"2024-04-25T15:54:21.397415+0000","last_fullsized":"2024-04-25T15:54:21.397415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390647+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:21.390647+0000","last_peered":"2024-04-25T15:54:21.390647+0000","last_clean":"2024-04-25T15:54:21.390647+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:21.390647+0000","last_undegraded":"2024-04-25T15:54:21.390647+0000","last_fullsized":"2024-04-25T15:54:21.390647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395244+0000","last_change":"2024-04-25T15:54:10.256856+0000","last_active":"2024-04-25T15:54:21.395244+0000","last_peered":"2024-04-25T15:54:21.395244+0000","last_clean":"2024-04-25T15:54:21.395244+0000","last_became_active":"2024-04-25T15:54:10.256024+0000","last_became_peered":"2024-04-25T15:54:10.256024+0000","last_unstale":"2024-04-25T15:54:21.395244+0000","last_undegraded":"2024-04-25T15:54:21.395244+0000","last_fullsized":"2024-04-25T15:54:21.395244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921320+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:21.921320+0000","last_peered":"2024-04-25T15:54:21.921320+0000","last_clean":"2024-04-25T15:54:21.921320+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:21.921320+0000","last_undegraded":"2024-04-25T15:54:21.921320+0000","last_fullsized":"2024-04-25T15:54:21.921320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.395489+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:21.395489+0000","last_peered":"2024-04-25T15:54:21.395489+0000","last_clean":"2024-04-25T15:54:21.395489+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:21.395489+0000","last_undegraded":"2024-04-25T15:54:21.395489+0000","last_fullsized":"2024-04-25T15:54:21.395489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921293+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:21.921293+0000","last_peered":"2024-04-25T15:54:21.921293+0000","last_clean":"2024-04-25T15:54:21.921293+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:21.921293+0000","last_undegraded":"2024-04-25T15:54:21.921293+0000","last_fullsized":"2024-04-25T15:54:21.921293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924964+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:21.924964+0000","last_peered":"2024-04-25T15:54:21.924964+0000","last_clean":"2024-04-25T15:54:21.924964+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:21.924964+0000","last_undegraded":"2024-04-25T15:54:21.924964+0000","last_fullsized":"2024-04-25T15:54:21.924964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923331+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:21.923331+0000","last_peered":"2024-04-25T15:54:21.923331+0000","last_clean":"2024-04-25T15:54:21.923331+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:21.923331+0000","last_undegraded":"2024-04-25T15:54:21.923331+0000","last_fullsized":"2024-04-25T15:54:21.923331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922527+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:21.922527+0000","last_peered":"2024-04-25T15:54:21.922527+0000","last_clean":"2024-04-25T15:54:21.922527+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:21.922527+0000","last_undegraded":"2024-04-25T15:54:21.922527+0000","last_fullsized":"2024-04-25T15:54:21.922527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.394617+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:21.394617+0000","last_peered":"2024-04-25T15:54:21.394617+0000","last_clean":"2024-04-25T15:54:21.394617+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:21.394617+0000","last_undegraded":"2024-04-25T15:54:21.394617+0000","last_fullsized":"2024-04-25T15:54:21.394617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924299+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:21.924299+0000","last_peered":"2024-04-25T15:54:21.924299+0000","last_clean":"2024-04-25T15:54:21.924299+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:21.924299+0000","last_undegraded":"2024-04-25T15:54:21.924299+0000","last_fullsized":"2024-04-25T15:54:21.924299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.441620+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:21.441620+0000","last_peered":"2024-04-25T15:54:21.441620+0000","last_clean":"2024-04-25T15:54:21.441620+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:21.441620+0000","last_undegraded":"2024-04-25T15:54:21.441620+0000","last_fullsized":"2024-04-25T15:54:21.441620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921778+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:21.921778+0000","last_peered":"2024-04-25T15:54:21.921778+0000","last_clean":"2024-04-25T15:54:21.921778+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:21.921778+0000","last_undegraded":"2024-04-25T15:54:21.921778+0000","last_fullsized":"2024-04-25T15:54:21.921778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924256+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:21.924256+0000","last_peered":"2024-04-25T15:54:21.924256+0000","last_clean":"2024-04-25T15:54:21.924256+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:21.924256+0000","last_undegraded":"2024-04-25T15:54:21.924256+0000","last_fullsized":"2024-04-25T15:54:21.924256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.923071+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:21.923071+0000","last_peered":"2024-04-25T15:54:21.923071+0000","last_clean":"2024-04-25T15:54:21.923071+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:21.923071+0000","last_undegraded":"2024-04-25T15:54:21.923071+0000","last_fullsized":"2024-04-25T15:54:21.923071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.921207+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:21.921207+0000","last_peered":"2024-04-25T15:54:21.921207+0000","last_clean":"2024-04-25T15:54:21.921207+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:21.921207+0000","last_undegraded":"2024-04-25T15:54:21.921207+0000","last_fullsized":"2024-04-25T15:54:21.921207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922442+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:21.922442+0000","last_peered":"2024-04-25T15:54:21.922442+0000","last_clean":"2024-04-25T15:54:21.922442+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:21.922442+0000","last_undegraded":"2024-04-25T15:54:21.922442+0000","last_fullsized":"2024-04-25T15:54:21.922442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.390298+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:21.390298+0000","last_peered":"2024-04-25T15:54:21.390298+0000","last_clean":"2024-04-25T15:54:21.390298+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:21.390298+0000","last_undegraded":"2024-04-25T15:54:21.390298+0000","last_fullsized":"2024-04-25T15:54:21.390298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.437423+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:21.437423+0000","last_peered":"2024-04-25T15:54:21.437423+0000","last_clean":"2024-04-25T15:54:21.437423+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:21.437423+0000","last_undegraded":"2024-04-25T15:54:21.437423+0000","last_fullsized":"2024-04-25T15:54:21.437423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.920144+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:21.920144+0000","last_peered":"2024-04-25T15:54:21.920144+0000","last_clean":"2024-04-25T15:54:21.920144+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:21.920144+0000","last_undegraded":"2024-04-25T15:54:21.920144+0000","last_fullsized":"2024-04-25T15:54:21.920144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.442947+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:21.442947+0000","last_peered":"2024-04-25T15:54:21.442947+0000","last_clean":"2024-04-25T15:54:21.442947+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:21.442947+0000","last_undegraded":"2024-04-25T15:54:21.442947+0000","last_fullsized":"2024-04-25T15:54:21.442947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.922110+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:21.922110+0000","last_peered":"2024-04-25T15:54:21.922110+0000","last_clean":"2024-04-25T15:54:21.922110+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:21.922110+0000","last_undegraded":"2024-04-25T15:54:21.922110+0000","last_fullsized":"2024-04-25T15:54:21.922110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T15:54:21.924928+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:21.924928+0000","last_peered":"2024-04-25T15:54:21.924928+0000","last_clean":"2024-04-25T15:54:21.924928+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:21.924928+0000","last_undegraded":"2024-04-25T15:54:21.924928+0000","last_fullsized":"2024-04-25T15:54:21.924928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:31.547 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:54:31.547 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T15:54:31.547 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T15:54:31.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T15:54:31.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 Processor -- start 2024-04-25T15:54:31.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 -- start start 2024-04-25T15:54:31.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9dc1529a0 0x7ff9dc071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff9dc0ad990 0x7ff9dc0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff9dc072430 con 0x7ff9dc0ad990 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9dc074730 con 0x7ff9dc1529a0 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.725+0000 7ff9e2a01640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc074a10 con 0x7ff9dc0c41e0 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff9dc0ad990 0x7ff9dc0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff9dc0ad990 0x7ff9dc0adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34972/0 (socket says 172.21.15.87:34972) 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 -- 172.21.15.87:0/418428506 learned_addr learned my addr 172.21.15.87:0/418428506 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e0f9e640 1 --2- 172.21.15.87:0/418428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9dbfff640 1 --2- 172.21.15.87:0/418428506 >> v2:172.21.15.155:3300/0 conn(0x7ff9dc1529a0 0x7ff9dc071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 -- 172.21.15.87:0/418428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 msgr2=0x7ff9dc0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 --2- 172.21.15.87:0/418428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 -- 172.21.15.87:0/418428506 >> v2:172.21.15.155:3300/0 conn(0x7ff9dc1529a0 msgr2=0x7ff9dc071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 --2- 172.21.15.87:0/418428506 >> v2:172.21.15.155:3300/0 conn(0x7ff9dc1529a0 0x7ff9dc071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 -- 172.21.15.87:0/418428506 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc074cf0 con 0x7ff9dc0ad990 2024-04-25T15:54:31.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9db7fe640 1 --2- 172.21.15.87:0/418428506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0adda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0ae520 tx=0x7ff9d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a29d466f7df4a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:31.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9daffd640 1 -- 172.21.15.87:0/418428506 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00b0070 con 0x7ff9dc0ad990 2024-04-25T15:54:31.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9daffd640 1 -- 172.21.15.87:0/418428506 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d00ab600 con 0x7ff9dc0ad990 2024-04-25T15:54:31.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9daffd640 1 -- 172.21.15.87:0/418428506 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00ab9d0 con 0x7ff9dc0ad990 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 -- 172.21.15.87:0/418428506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc0ad990 msgr2=0x7ff9dc0adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/418428506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0adda0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0ae520 tx=0x7ff9d001c490 comp rx=0 tx=0).stop 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 -- 172.21.15.87:0/418428506 shutdown_connections 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/418428506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/418428506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0adda0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/418428506 >> v2:172.21.15.155:3300/0 conn(0x7ff9dc1529a0 0x7ff9dc071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 -- 172.21.15.87:0/418428506 >> 172.21.15.87:0/418428506 conn(0x7ff9dc0c8770 msgr2=0x7ff9dc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 -- 172.21.15.87:0/418428506 shutdown_connections 2024-04-25T15:54:31.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.729+0000 7ff9e2a01640 1 -- 172.21.15.87:0/418428506 wait complete. 2024-04-25T15:54:31.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 Processor -- start 2024-04-25T15:54:31.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 -- start start 2024-04-25T15:54:31.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc1f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 0x7ff9dc15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc159340 con 0x7ff9dc1529a0 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc1591c0 con 0x7ff9dc0ad990 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc1594c0 con 0x7ff9dc0c41e0 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 0x7ff9dc15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 0x7ff9dc15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34974/0 (socket says 172.21.15.87:34974) 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 -- 172.21.15.87:0/721793044 learned_addr learned my addr 172.21.15.87:0/721793044 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 -- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 msgr2=0x7ff9dc1f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9dbfff640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc1f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 -- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9dc0ad990 msgr2=0x7ff9dc0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 -- 172.21.15.87:0/721793044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc0abc80 con 0x7ff9dc1529a0 2024-04-25T15:54:31.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e0f9e640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 0x7ff9dc15e080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009fd0 tx=0x7ff9d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4014420 con 0x7ff9dc1529a0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4019070 con 0x7ff9dc1529a0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9dc151e70 con 0x7ff9dc1529a0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4014800 con 0x7ff9dc1529a0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.733+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9dc151570 con 0x7ff9dc1529a0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.737+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9dc069bb0 con 0x7ff9dc1529a0 2024-04-25T15:54:31.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.737+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9d40149a0 con 0x7ff9dc1529a0 2024-04-25T15:54:31.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.737+0000 7ff9d8ff9640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9c806f400 0x7ff9c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:31.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.737+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff9d408fdd0 con 0x7ff9dc1529a0 2024-04-25T15:54:31.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.737+0000 7ff9dbfff640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9c806f400 0x7ff9c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:31.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.737+0000 7ff9dbfff640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9c806f400 0x7ff9c8071910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc073d40 tx=0x7ff9cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:31.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.741+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9d405ca20 con 0x7ff9dc1529a0 2024-04-25T15:54:31.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff9dc0c3760 con 0x7ff9dc1529a0 2024-04-25T15:54:31.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9d8ff9640 1 -- 172.21.15.87:0/721793044 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff9d4091040 con 0x7ff9dc1529a0 2024-04-25T15:54:31.941 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:31.941 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9c806f400 msgr2=0x7ff9c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9c806f400 0x7ff9c8071910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc073d40 tx=0x7ff9cc008040 comp rx=0 tx=0).stop 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 msgr2=0x7ff9dc15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 0x7ff9dc15e080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009fd0 tx=0x7ff9d400e4b0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 shutdown_connections 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9c806f400 0x7ff9c8071910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9dc1529a0 0x7ff9dc15e080 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9dc0c41e0 0x7ff9dc1f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 --2- 172.21.15.87:0/721793044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9dc0ad990 0x7ff9dc0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 >> 172.21.15.87:0/721793044 conn(0x7ff9dc0c8770 msgr2=0x7ff9dc154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:31.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 shutdown_connections 2024-04-25T15:54:31.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:31.941+0000 7ff9e2a01640 1 -- 172.21.15.87:0/721793044 wait complete. 2024-04-25T15:54:31.962 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T15:54:31.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:32.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.093+0000 7ff1c6a44640 1 Processor -- start 2024-04-25T15:54:32.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.093+0000 7ff1c6a44640 1 -- start start 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1c6a44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1c014d810 0x7ff1c0157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1c6a44640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c0157d50 con 0x7ff1c0154d00 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1c6a44640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c00add10 con 0x7ff1c006f790 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1c6a44640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c00adff0 con 0x7ff1c014d810 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1c014d810 0x7ff1c0157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1c014d810 0x7ff1c0157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34988/0 (socket says 172.21.15.87:34988) 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bffff640 1 -- 172.21.15.87:0/3326341543 learned_addr learned my addr 172.21.15.87:0/3326341543 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:32.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bf7fe640 1 --1- 172.21.15.87:0/3326341543 >> v1:172.21.15.87:6789/0 conn(0x7ff1c0154d00 0x7ff1c0154200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54784/0 (socket says 172.21.15.87:54784) 2024-04-25T15:54:32.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bffff640 1 -- 172.21.15.87:0/3326341543 >> v1:172.21.15.155:6789/0 conn(0x7ff1c006f790 legacy=0x7ff1c015e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bffff640 1 -- 172.21.15.87:0/3326341543 >> v1:172.21.15.87:6789/0 conn(0x7ff1c0154d00 legacy=0x7ff1c0154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1beffd640 1 -- 172.21.15.87:0/3326341543 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540678925 0 0) 0x7ff1c0157d50 con 0x7ff1c0154d00 2024-04-25T15:54:32.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.097+0000 7ff1bffff640 1 -- 172.21.15.87:0/3326341543 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0157010 con 0x7ff1c014d810 2024-04-25T15:54:32.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1bffff640 1 --2- 172.21.15.87:0/3326341543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c014d810 0x7ff1c0157810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000bb10 tx=0x7ff1b001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e54154c2b62c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1beffd640 1 -- 172.21.15.87:0/3326341543 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00b4070 con 0x7ff1c014d810 2024-04-25T15:54:32.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1beffd640 1 -- 172.21.15.87:0/3326341543 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b00a79e0 con 0x7ff1c014d810 2024-04-25T15:54:32.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1beffd640 1 -- 172.21.15.87:0/3326341543 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00a7db0 con 0x7ff1c014d810 2024-04-25T15:54:32.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 -- 172.21.15.87:0/3326341543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c014d810 msgr2=0x7ff1c0157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/3326341543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c014d810 0x7ff1c0157810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000bb10 tx=0x7ff1b001eb10 comp rx=0 tx=0).stop 2024-04-25T15:54:32.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 -- 172.21.15.87:0/3326341543 shutdown_connections 2024-04-25T15:54:32.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/3326341543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c014d810 0x7ff1c0157810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 -- 172.21.15.87:0/3326341543 >> 172.21.15.87:0/3326341543 conn(0x7ff1c00c8770 msgr2=0x7ff1c00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:32.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 -- 172.21.15.87:0/3326341543 shutdown_connections 2024-04-25T15:54:32.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 -- 172.21.15.87:0/3326341543 wait complete. 2024-04-25T15:54:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 Processor -- start 2024-04-25T15:54:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.101+0000 7ff1c6a44640 1 -- start start 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c006f790 0x7ff1c01ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c014d810 0x7ff1c00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 0x7ff1c00c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01618c0 con 0x7ff1c0154d00 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c006ffb0 con 0x7ff1c014d810 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c0161a40 con 0x7ff1c006f790 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 0x7ff1c00c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 0x7ff1c00c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34992/0 (socket says 172.21.15.87:34992) 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 -- 172.21.15.87:0/134052385 learned_addr learned my addr 172.21.15.87:0/134052385 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bffff640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c006f790 0x7ff1c01ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bf7fe640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c014d810 0x7ff1c00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 -- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c006f790 msgr2=0x7ff1c01ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c006f790 0x7ff1c01ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 -- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c014d810 msgr2=0x7ff1c00abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c014d810 0x7ff1c00abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 -- 172.21.15.87:0/134052385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c00ace30 con 0x7ff1c0154d00 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bffff640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c006f790 0x7ff1c01ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bf7fe640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c014d810 0x7ff1c00abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c4fe1640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 0x7ff1c00c71e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800c760 tx=0x7ff1b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8003ba0 con 0x7ff1c0154d00 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b8003d40 con 0x7ff1c0154d00 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b800aa90 con 0x7ff1c0154d00 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c00ad110 con 0x7ff1c0154d00 2024-04-25T15:54:32.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c00c7d90 con 0x7ff1c0154d00 2024-04-25T15:54:32.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c00acba0 con 0x7ff1c0154d00 2024-04-25T15:54:32.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff1b800ac30 con 0x7ff1c0154d00 2024-04-25T15:54:32.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bcff9640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff1ac06f400 0x7ff1ac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bffff640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff1ac06f400 0x7ff1ac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff1b808f450 con 0x7ff1c0154d00 2024-04-25T15:54:32.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.105+0000 7ff1bffff640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff1ac06f400 0x7ff1ac071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00b1000 tx=0x7ff1b00a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.109+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1b805c010 con 0x7ff1c0154d00 2024-04-25T15:54:32.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.261+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1c0069bb0 con 0x7ff1c0154d00 2024-04-25T15:54:32.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1bcff9640 1 -- 172.21.15.87:0/134052385 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7ff1b8064090 con 0x7ff1c0154d00 2024-04-25T15:54:32.265 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:32.265 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:32.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff1ac06f400 msgr2=0x7ff1ac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff1ac06f400 0x7ff1ac071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00b1000 tx=0x7ff1b00a9070 comp rx=0 tx=0).stop 2024-04-25T15:54:32.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 msgr2=0x7ff1c00c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 0x7ff1c00c71e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800c760 tx=0x7ff1b800cc20 comp rx=0 tx=0).stop 2024-04-25T15:54:32.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 shutdown_connections 2024-04-25T15:54:32.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff1ac06f400 0x7ff1ac071910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1c0154d00 0x7ff1c00c71e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c014d810 0x7ff1c00abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 --2- 172.21.15.87:0/134052385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c006f790 0x7ff1c01ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 >> 172.21.15.87:0/134052385 conn(0x7ff1c00c8770 msgr2=0x7ff1c0152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:32.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 shutdown_connections 2024-04-25T15:54:32.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.265+0000 7ff1c6a44640 1 -- 172.21.15.87:0/134052385 wait complete. 2024-04-25T15:54:32.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:32.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 Processor -- start 2024-04-25T15:54:32.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 -- start start 2024-04-25T15:54:32.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5560152980 0x7f55600c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f556015fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5560152d90 con 0x7f5560155320 2024-04-25T15:54:32.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55600aa290 con 0x7f5560152980 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f5565f08640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f55601598b0 con 0x7f5560155730 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5560152980 0x7f55600c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5560152980 0x7f55600c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34994/0 (socket says 172.21.15.87:34994) 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 -- 172.21.15.87:0/252740188 learned_addr learned my addr 172.21.15.87:0/252740188 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555ffff640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f556015fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 -- 172.21.15.87:0/252740188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 msgr2=0x7f556015fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f556015fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 -- 172.21.15.87:0/252740188 >> v1:172.21.15.87:6789/0 conn(0x7f5560155320 legacy=0x7f5560074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555f7fe640 1 -- 172.21.15.87:0/252740188 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55600ca2f0 con 0x7f5560152980 2024-04-25T15:54:32.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.421+0000 7f555ffff640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f556015fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:32.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f555f7fe640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560152980 0x7f55600c9db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5550009870 tx=0x7f555001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db8037740f88dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f555e7fc640 1 -- 172.21.15.87:0/252740188 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500b0070 con 0x7f5560152980 2024-04-25T15:54:32.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f555e7fc640 1 -- 172.21.15.87:0/252740188 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55500ab600 con 0x7f5560152980 2024-04-25T15:54:32.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f555e7fc640 1 -- 172.21.15.87:0/252740188 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500ab9d0 con 0x7f5560152980 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 -- 172.21.15.87:0/252740188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560152980 msgr2=0x7f55600c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560152980 0x7f55600c9db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5550009870 tx=0x7f555001c4d0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 -- 172.21.15.87:0/252740188 shutdown_connections 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f556015fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 --2- 172.21.15.87:0/252740188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560152980 0x7f55600c9db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 -- 172.21.15.87:0/252740188 >> 172.21.15.87:0/252740188 conn(0x7f55600ac550 msgr2=0x7f55600ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 -- 172.21.15.87:0/252740188 shutdown_connections 2024-04-25T15:54:32.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.425+0000 7f5565f08640 1 -- 172.21.15.87:0/252740188 wait complete. 2024-04-25T15:54:32.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 Processor -- start 2024-04-25T15:54:32.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- start start 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560152980 0x7f55600bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 0x7f556014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f55601f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5560158f70 con 0x7f5560155320 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5560158c90 con 0x7f5560152980 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5560074870 con 0x7f5560155730 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 0x7f556014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 0x7f556014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34996/0 (socket says 172.21.15.87:34996) 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 -- 172.21.15.87:0/2925955239 learned_addr learned my addr 172.21.15.87:0/2925955239 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:32.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555f7fe640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560152980 0x7f55600bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 -- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 msgr2=0x7f55601f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555ffff640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f55601f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f55601f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 -- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560152980 msgr2=0x7f55600bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560152980 0x7f55600bf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 -- 172.21.15.87:0/2925955239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55601ef710 con 0x7f5560155320 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555f7fe640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560152980 0x7f55600bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f555effd640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 0x7f556014ff30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f555400c3a0 tx=0x7f555400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55540052d0 con 0x7f5560155320 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554005470 con 0x7f5560155320 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554007260 con 0x7f5560155320 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55600c0370 con 0x7f5560155320 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55600c1480 con 0x7f5560155320 2024-04-25T15:54:32.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5560069bb0 con 0x7f5560155320 2024-04-25T15:54:32.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.429+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5554007400 con 0x7f5560155320 2024-04-25T15:54:32.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.433+0000 7f5547fff640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f554c06f400 0x7f554c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.433+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f555408ea30 con 0x7f5560155320 2024-04-25T15:54:32.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.433+0000 7f555f7fe640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f554c06f400 0x7f554c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.433+0000 7f555f7fe640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f554c06f400 0x7f554c071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55500ad000 tx=0x7f5550008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.437+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f555405b680 con 0x7f5560155320 2024-04-25T15:54:32.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f556014fc90 con 0x7f5560155320 2024-04-25T15:54:32.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5547fff640 1 -- 172.21.15.87:0/2925955239 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f555405af80 con 0x7f5560155320 2024-04-25T15:54:32.594 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f554c06f400 msgr2=0x7f554c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f554c06f400 0x7f554c071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55500ad000 tx=0x7f5550008040 comp rx=0 tx=0).stop 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 msgr2=0x7f556014ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 0x7f556014ff30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f555400c3a0 tx=0x7f555400c860 comp rx=0 tx=0).stop 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 shutdown_connections 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f554c06f400 0x7f554c071910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5560155730 0x7f55601f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5560155320 0x7f556014ff30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 --2- 172.21.15.87:0/2925955239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5560152980 0x7f55600bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 >> 172.21.15.87:0/2925955239 conn(0x7f55600ac550 msgr2=0x7f5560151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:32.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 shutdown_connections 2024-04-25T15:54:32.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.593+0000 7f5565f08640 1 -- 172.21.15.87:0/2925955239 wait complete. 2024-04-25T15:54:32.613 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:32.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.749+0000 7f9d246b8640 1 Processor -- start 2024-04-25T15:54:32.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.749+0000 7f9d246b8640 1 -- start start 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d246b8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0ad160 0x7f9d1c0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d246b8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d1c0c4620 0x7f9d1c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d246b8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1c154fc0 con 0x7f9d1c1518b0 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d246b8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1c06ed60 con 0x7f9d1c0c4620 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d246b8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1c0acb20 con 0x7f9d1c0ad160 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d1c0c4620 0x7f9d1c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d1c0c4620 0x7f9d1c15e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35006/0 (socket says 172.21.15.87:35006) 2024-04-25T15:54:32.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 -- 172.21.15.87:0/2448350573 learned_addr learned my addr 172.21.15.87:0/2448350573 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:32.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d21c53640 1 --2- 172.21.15.87:0/2448350573 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0ad160 0x7f9d1c0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 -- 172.21.15.87:0/2448350573 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0ad160 msgr2=0x7f9d1c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:32.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 --2- 172.21.15.87:0/2448350573 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0ad160 0x7f9d1c0c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 -- 172.21.15.87:0/2448350573 >> v1:172.21.15.155:6789/0 conn(0x7f9d1c1518b0 legacy=0x7f9d1c06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:32.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.753+0000 7f9d22c55640 1 -- 172.21.15.87:0/2448350573 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c0ace00 con 0x7f9d1c0c4620 2024-04-25T15:54:32.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d22c55640 1 --2- 172.21.15.87:0/2448350573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c15e9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c070d80 tx=0x7f9d1401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c4add559d0f6d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d21452640 1 -- 172.21.15.87:0/2448350573 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d140ab610 con 0x7f9d1c0c4620 2024-04-25T15:54:32.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d21452640 1 -- 172.21.15.87:0/2448350573 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d140b0070 con 0x7f9d1c0c4620 2024-04-25T15:54:32.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d21452640 1 -- 172.21.15.87:0/2448350573 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d140ab9d0 con 0x7f9d1c0c4620 2024-04-25T15:54:32.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 -- 172.21.15.87:0/2448350573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0c4620 msgr2=0x7f9d1c15e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 --2- 172.21.15.87:0/2448350573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c15e9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c070d80 tx=0x7f9d1401c4e0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 -- 172.21.15.87:0/2448350573 shutdown_connections 2024-04-25T15:54:32.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 --2- 172.21.15.87:0/2448350573 >> v2:172.21.15.155:3300/0 conn(0x7f9d1c0ad160 0x7f9d1c0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 --2- 172.21.15.87:0/2448350573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c15e9b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 -- 172.21.15.87:0/2448350573 >> 172.21.15.87:0/2448350573 conn(0x7f9d1c0c8770 msgr2=0x7f9d1c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:32.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 -- 172.21.15.87:0/2448350573 shutdown_connections 2024-04-25T15:54:32.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 -- 172.21.15.87:0/2448350573 wait complete. 2024-04-25T15:54:32.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 Processor -- start 2024-04-25T15:54:32.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.757+0000 7f9d246b8640 1 -- start start 2024-04-25T15:54:32.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 0x7f9d1c1f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c1518b0 0x7f9d1c0c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c161710 con 0x7f9d1c0ad160 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c161890 con 0x7f9d1c0c4620 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1c161a10 con 0x7f9d1c1518b0 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 0x7f9d1c1f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 0x7f9d1c1f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35012/0 (socket says 172.21.15.87:35012) 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 -- 172.21.15.87:0/286199307 learned_addr learned my addr 172.21.15.87:0/286199307 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 -- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c1518b0 msgr2=0x7f9d1c0c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d21c53640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c1518b0 0x7f9d1c0c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 -- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0c4620 msgr2=0x7f9d1c1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 -- 172.21.15.87:0/286199307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c0bf6c0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d22454640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 0x7f9d1c1f1ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00df70 tx=0x7f9d0c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00e9e0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00ebc0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c0c0120 con 0x7f9d1c0ad160 2024-04-25T15:54:32.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c009530 con 0x7f9d1c0ad160 2024-04-25T15:54:32.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c0bf9a0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1c069bb0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9d0c006d10 con 0x7f9d1c0ad160 2024-04-25T15:54:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d1affd640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9d0806f430 0x7f9d08071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9d0c0910e0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d21c53640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9d0806f430 0x7f9d08071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:32.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.761+0000 7f9d21c53640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9d0806f430 0x7f9d08071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0bef50 tx=0x7f9d10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:32.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.765+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d0c05dca0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f9d1c0abfa0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d1affd640 1 -- 172.21.15.87:0/286199307 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f9d0c05d5a0 con 0x7f9d1c0ad160 2024-04-25T15:54:32.917 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9d0806f430 msgr2=0x7f9d08071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9d0806f430 0x7f9d08071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0bef50 tx=0x7f9d10008040 comp rx=0 tx=0).stop 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 msgr2=0x7f9d1c1f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 0x7f9d1c1f1ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00df70 tx=0x7f9d0c00bd50 comp rx=0 tx=0).stop 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 shutdown_connections 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9d0806f430 0x7f9d08071940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1c1518b0 0x7f9d1c0c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1c0c4620 0x7f9d1c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 --2- 172.21.15.87:0/286199307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0ad160 0x7f9d1c1f1ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:32.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 >> 172.21.15.87:0/286199307 conn(0x7f9d1c0c8770 msgr2=0x7f9d1c0ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:32.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 shutdown_connections 2024-04-25T15:54:32.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:32.917+0000 7f9d246b8640 1 -- 172.21.15.87:0/286199307 wait complete. 2024-04-25T15:54:32.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:33.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 Processor -- start 2024-04-25T15:54:33.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 -- start start 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f89501529a0 0x7f8950071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89500c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89500c4e30 con 0x7f89500ad990 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f89500ae1b0 con 0x7f89501529a0 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f8955388640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8950072430 con 0x7f89500adda0 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894e7fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f89500ad990 0x7f89500c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54798/0 (socket says 172.21.15.87:54798) 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894e7fc640 1 -- 172.21.15.87:0/1805686960 learned_addr learned my addr 172.21.15.87:0/1805686960 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894effd640 1 --2- 172.21.15.87:0/1805686960 >> v2:172.21.15.155:3300/0 conn(0x7f89501529a0 0x7f8950071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89500c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544644942 0 0) 0x7f8944001120 con 0x7f89500ad990 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8938003530 con 0x7f89500ad990 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 984837780 0 0) 0x7f8938003530 con 0x7f89500ad990 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 msgr2=0x7f89500c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89500c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 >> v2:172.21.15.155:3300/0 conn(0x7f89501529a0 msgr2=0x7f8950071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 --2- 172.21.15.87:0/1805686960 >> v2:172.21.15.155:3300/0 conn(0x7f89501529a0 0x7f8950071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950074730 con 0x7f89500ad990 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f8944001850 con 0x7f89500ad990 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 >> v1:172.21.15.87:6789/0 conn(0x7f89500ad990 legacy=0x7f89500c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938003f60 0x7f8938004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8938004d50 0x7f8938005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f89500ae1b0 con 0x7f8938004d50 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8950072430 con 0x7f8938003f60 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f893800bb00 con 0x7f89500adda0 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8938004d50 0x7f8938005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894effd640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 -- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 msgr2=0x7f89380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 -- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938003f60 msgr2=0x7f8938004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938003f60 0x7f8938004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894f7fe640 1 -- 172.21.15.87:0/1805686960 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8938003530 con 0x7f8938004d50 2024-04-25T15:54:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.085+0000 7f894effd640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89500adda0 0x7f89380039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8938004d50 0x7f8938005160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8948009f90 tx=0x7f894801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b226ac074aee96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480b2070 con 0x7f8938004d50 2024-04-25T15:54:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89480a5bb0 con 0x7f8938004d50 2024-04-25T15:54:33.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f894dffb640 1 -- 172.21.15.87:0/1805686960 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948009c10 con 0x7f8938004d50 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f8955388640 1 -- 172.21.15.87:0/1805686960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8938004d50 msgr2=0x7f8938005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f8955388640 1 --2- 172.21.15.87:0/1805686960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8938004d50 0x7f8938005160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8948009f90 tx=0x7f894801cba0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f894f7fe640 1 -- 172.21.15.87:0/1805686960 reap_dead start 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f8955388640 1 -- 172.21.15.87:0/1805686960 shutdown_connections 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f8955388640 1 -- 172.21.15.87:0/1805686960 >> 172.21.15.87:0/1805686960 conn(0x7f89500c8770 msgr2=0x7f89500c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f8955388640 1 -- 172.21.15.87:0/1805686960 shutdown_connections 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.089+0000 7f8955388640 1 -- 172.21.15.87:0/1805686960 wait complete. 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 Processor -- start 2024-04-25T15:54:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- start start 2024-04-25T15:54:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938004d50 0x7f89501531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950153700 0x7f8950157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 0x7f8950149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8950074fd0 con 0x7f8950157fb0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8950074cf0 con 0x7f8938004d50 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89500ab1a0 con 0x7f8950153700 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 0x7f8950149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 0x7f8950149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35024/0 (socket says 172.21.15.87:35024) 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 -- 172.21.15.87:0/1943328446 learned_addr learned my addr 172.21.15.87:0/1943328446 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894effd640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938004d50 0x7f89501531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 -- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950153700 msgr2=0x7f8950157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950153700 0x7f8950157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 -- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938004d50 msgr2=0x7f89501531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938004d50 0x7f89501531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 -- 172.21.15.87:0/1943328446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950159430 con 0x7f8950157fb0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f894f7fe640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 0x7f8950149540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89480b0040 tx=0x7f8938005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480be070 con 0x7f8950157fb0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89480b3040 con 0x7f8950157fb0 2024-04-25T15:54:33.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480b2050 con 0x7f8950157fb0 2024-04-25T15:54:33.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89500c2990 con 0x7f8950157fb0 2024-04-25T15:54:33.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89500c2f50 con 0x7f8950157fb0 2024-04-25T15:54:33.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8950069bb0 con 0x7f8950157fb0 2024-04-25T15:54:33.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.093+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f89480c1070 con 0x7f8950157fb0 2024-04-25T15:54:33.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.097+0000 7f89377fe640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f893c06f400 0x7f893c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.097+0000 7f894effd640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f893c06f400 0x7f893c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.097+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8948129750 con 0x7f8950157fb0 2024-04-25T15:54:33.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.097+0000 7f894effd640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f893c06f400 0x7f893c071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8950073d40 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.101+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8948016970 con 0x7f8950157fb0 2024-04-25T15:54:33.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.253+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f89500c3760 con 0x7f8950157fb0 2024-04-25T15:54:33.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.253+0000 7f89377fe640 1 -- 172.21.15.87:0/1943328446 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f89480f5de0 con 0x7f8950157fb0 2024-04-25T15:54:33.254 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:33.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f893c06f400 msgr2=0x7f893c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f893c06f400 0x7f893c071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8950073d40 tx=0x7f8940008040 comp rx=0 tx=0).stop 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 msgr2=0x7f8950149540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 0x7f8950149540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89480b0040 tx=0x7f8938005840 comp rx=0 tx=0).stop 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 shutdown_connections 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f893c06f400 0x7f893c071910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8950157fb0 0x7f8950149540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8950153700 0x7f8950157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 --2- 172.21.15.87:0/1943328446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8938004d50 0x7f89501531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 >> 172.21.15.87:0/1943328446 conn(0x7f89500c8770 msgr2=0x7f895014f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 shutdown_connections 2024-04-25T15:54:33.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.257+0000 7f8955388640 1 -- 172.21.15.87:0/1943328446 wait complete. 2024-04-25T15:54:33.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:33.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 Processor -- start 2024-04-25T15:54:33.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 -- start start 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efccc152870 0x7efccc159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efccc0c9fe0 0x7efccc1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc070cb0 con 0x7efccc06c670 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efccc152c80 con 0x7efccc0c9fe0 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd3479640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efccc070f90 con 0x7efccc152870 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efccc0c9fe0 0x7efccc1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efccc0c9fe0 0x7efccc1551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35040/0 (socket says 172.21.15.87:35040) 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd1a16640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efccc06c670 0x7efccc0add30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54802/0 (socket says 172.21.15.87:54802) 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 -- 172.21.15.87:0/1162493117 learned_addr learned my addr 172.21.15.87:0/1162493117 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:33.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd1215640 1 --2- 172.21.15.87:0/1162493117 >> v2:172.21.15.155:3300/0 conn(0x7efccc152870 0x7efccc159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 -- 172.21.15.87:0/1162493117 >> v2:172.21.15.155:3300/0 conn(0x7efccc152870 msgr2=0x7efccc159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:33.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 --2- 172.21.15.87:0/1162493117 >> v2:172.21.15.155:3300/0 conn(0x7efccc152870 0x7efccc159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 -- 172.21.15.87:0/1162493117 >> v1:172.21.15.87:6789/0 conn(0x7efccc06c670 legacy=0x7efccc0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcc3fff640 1 -- 172.21.15.87:0/1162493117 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876110287 0 0) 0x7efccc070cb0 con 0x7efccc06c670 2024-04-25T15:54:33.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.413+0000 7efcd0a14640 1 -- 172.21.15.87:0/1162493117 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc1587b0 con 0x7efccc0c9fe0 2024-04-25T15:54:33.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd0a14640 1 --2- 172.21.15.87:0/1162493117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc0c9fe0 0x7efccc1551c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efccc0ca650 tx=0x7efcc801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9cb2484087b3f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcc3fff640 1 -- 172.21.15.87:0/1162493117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc80b0070 con 0x7efccc0c9fe0 2024-04-25T15:54:33.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcc3fff640 1 -- 172.21.15.87:0/1162493117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc80ab600 con 0x7efccc0c9fe0 2024-04-25T15:54:33.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcc3fff640 1 -- 172.21.15.87:0/1162493117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc80ab9d0 con 0x7efccc0c9fe0 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 -- 172.21.15.87:0/1162493117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc0c9fe0 msgr2=0x7efccc1551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 --2- 172.21.15.87:0/1162493117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc0c9fe0 0x7efccc1551c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efccc0ca650 tx=0x7efcc801c520 comp rx=0 tx=0).stop 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 -- 172.21.15.87:0/1162493117 shutdown_connections 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 --2- 172.21.15.87:0/1162493117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc0c9fe0 0x7efccc1551c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 --2- 172.21.15.87:0/1162493117 >> v2:172.21.15.155:3300/0 conn(0x7efccc152870 0x7efccc159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 -- 172.21.15.87:0/1162493117 >> 172.21.15.87:0/1162493117 conn(0x7efccc06d780 msgr2=0x7efccc06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 -- 172.21.15.87:0/1162493117 shutdown_connections 2024-04-25T15:54:33.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 -- 172.21.15.87:0/1162493117 wait complete. 2024-04-25T15:54:33.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 Processor -- start 2024-04-25T15:54:33.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.417+0000 7efcd3479640 1 -- start start 2024-04-25T15:54:33.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 0x7efccc0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efccc0c9fe0 0x7efccc1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efccc152870 0x7efccc149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efccc155700 con 0x7efccc06c670 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efccc06ce90 con 0x7efccc0c9fe0 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efccc155880 con 0x7efccc152870 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 0x7efccc0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 0x7efccc0c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35050/0 (socket says 172.21.15.87:35050) 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 -- 172.21.15.87:0/2047577332 learned_addr learned my addr 172.21.15.87:0/2047577332 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 -- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efccc152870 msgr2=0x7efccc149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1a16640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efccc152870 0x7efccc149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd0a14640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efccc0c9fe0 0x7efccc1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efccc152870 0x7efccc149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 -- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efccc0c9fe0 msgr2=0x7efccc1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efccc0c9fe0 0x7efccc1493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 -- 172.21.15.87:0/2047577332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc0c3b00 con 0x7efccc06c670 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd1215640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 0x7efccc0c7440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e870 tx=0x7efcbc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc017070 con 0x7efccc06c670 2024-04-25T15:54:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc00c8e0 con 0x7efccc06c670 2024-04-25T15:54:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00cc90 con 0x7efccc06c670 2024-04-25T15:54:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc0abde0 con 0x7efccc06c670 2024-04-25T15:54:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc1ef880 con 0x7efccc06c670 2024-04-25T15:54:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc069bb0 con 0x7efccc06c670 2024-04-25T15:54:33.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efcbc01a070 con 0x7efccc06c670 2024-04-25T15:54:33.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcc1ffb640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efcb006f400 0x7efcb0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7efcbc08f7e0 con 0x7efccc06c670 2024-04-25T15:54:33.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.421+0000 7efcd0a14640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efcb006f400 0x7efcb0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.425+0000 7efcd0a14640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efcb006f400 0x7efcb0071910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc80ad000 tx=0x7efcc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.429+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efccc0c3b00 con 0x7efccc06c670 2024-04-25T15:54:33.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.577+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7efccc070840 con 0x7efccc06c670 2024-04-25T15:54:33.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcc1ffb640 1 -- 172.21.15.87:0/2047577332 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7efcbc05c430 con 0x7efccc06c670 2024-04-25T15:54:33.580 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efcb006f400 msgr2=0x7efcb0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efcb006f400 0x7efcb0071910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc80ad000 tx=0x7efcc8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 msgr2=0x7efccc0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 0x7efccc0c7440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e870 tx=0x7efcbc00ec70 comp rx=0 tx=0).stop 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 shutdown_connections 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efcb006f400 0x7efcb0071910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efccc152870 0x7efccc149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efccc0c9fe0 0x7efccc1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 --2- 172.21.15.87:0/2047577332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efccc06c670 0x7efccc0c7440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 >> 172.21.15.87:0/2047577332 conn(0x7efccc06d780 msgr2=0x7efccc153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:33.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 shutdown_connections 2024-04-25T15:54:33.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.581+0000 7efcd3479640 1 -- 172.21.15.87:0/2047577332 wait complete. 2024-04-25T15:54:33.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:33.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.737+0000 7f7b847eb640 1 Processor -- start 2024-04-25T15:54:33.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.737+0000 7f7b847eb640 1 -- start start 2024-04-25T15:54:33.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b847eb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b847eb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b7c06f790 0x7f7b7c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b847eb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c0add10 con 0x7f7b7c14d810 2024-04-25T15:54:33.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b847eb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7c0adff0 con 0x7f7b7c06f790 2024-04-25T15:54:33.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b847eb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c157010 con 0x7f7b7c154d00 2024-04-25T15:54:33.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b7c06f790 0x7f7b7c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b7c06f790 0x7f7b7c06fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35064/0 (socket says 172.21.15.87:35064) 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 -- 172.21.15.87:0/3083438611 learned_addr learned my addr 172.21.15.87:0/3083438611 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b81d86640 1 --2- 172.21.15.87:0/3083438611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 -- 172.21.15.87:0/3083438611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 msgr2=0x7f7b7c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 --2- 172.21.15.87:0/3083438611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 -- 172.21.15.87:0/3083438611 >> v1:172.21.15.155:6789/0 conn(0x7f7b7c14d810 legacy=0x7f7b7c157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 -- 172.21.15.87:0/3083438611 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c1572f0 con 0x7f7b7c06f790 2024-04-25T15:54:33.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b82d88640 1 --2- 172.21.15.87:0/3083438611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c06f790 0x7f7b7c06fba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400af60 tx=0x7f7b7401da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaf14d1e04742b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b81585640 1 -- 172.21.15.87:0/3083438611 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400a2d0 con 0x7f7b7c06f790 2024-04-25T15:54:33.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b81585640 1 -- 172.21.15.87:0/3083438611 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b740a6670 con 0x7f7b7c06f790 2024-04-25T15:54:33.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.741+0000 7f7b81585640 1 -- 172.21.15.87:0/3083438611 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b740a6a40 con 0x7f7b7c06f790 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- 172.21.15.87:0/3083438611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c06f790 msgr2=0x7f7b7c06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3083438611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c06f790 0x7f7b7c06fba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400af60 tx=0x7f7b7401da10 comp rx=0 tx=0).stop 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- 172.21.15.87:0/3083438611 shutdown_connections 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3083438611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3083438611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c06f790 0x7f7b7c06fba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- 172.21.15.87:0/3083438611 >> 172.21.15.87:0/3083438611 conn(0x7f7b7c0c8770 msgr2=0x7f7b7c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- 172.21.15.87:0/3083438611 shutdown_connections 2024-04-25T15:54:33.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- 172.21.15.87:0/3083438611 wait complete. 2024-04-25T15:54:33.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 Processor -- start 2024-04-25T15:54:33.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- start start 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b7c06f790 0x7f7b7c0c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 0x7f7b7c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c1edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c160320 con 0x7f7b7c14d810 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c1601a0 con 0x7f7b7c06f790 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b847eb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7c1604a0 con 0x7f7b7c154d00 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 0x7f7b7c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 0x7f7b7c14e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35070/0 (socket says 172.21.15.87:35070) 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 -- 172.21.15.87:0/3960010258 learned_addr learned my addr 172.21.15.87:0/3960010258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b82587640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b7c06f790 0x7f7b7c0c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b82d88640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c1edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 -- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 msgr2=0x7f7b7c1edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c1edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 -- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b7c06f790 msgr2=0x7f7b7c0c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b7c06f790 0x7f7b7c0c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b81d86640 1 -- 172.21.15.87:0/3960010258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c150930 con 0x7f7b7c14d810 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b82587640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b7c06f790 0x7f7b7c0c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.745+0000 7f7b82d88640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c1edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b81d86640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 0x7f7b7c14e810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00c820 tx=0x7f7b6c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c015070 con 0x7f7b7c14d810 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0079d0 con 0x7f7b7c14d810 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c150c10 con 0x7f7b7c14d810 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c007dc0 con 0x7f7b7c14d810 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c14ff60 con 0x7f7b7c14d810 2024-04-25T15:54:33.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7c069bb0 con 0x7f7b7c14d810 2024-04-25T15:54:33.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7b6c018070 con 0x7f7b7c14d810 2024-04-25T15:54:33.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b72ffd640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b6006f430 0x7f7b60071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:33.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7b6c08f640 con 0x7f7b7c14d810 2024-04-25T15:54:33.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.749+0000 7f7b82587640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b6006f430 0x7f7b60071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:33.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.753+0000 7f7b82587640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b6006f430 0x7f7b60071940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c075050 tx=0x7f7b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:33.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.753+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b6c05c400 con 0x7f7b7c14d810 2024-04-25T15:54:33.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.901+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f7b7c150de0 con 0x7f7b7c14d810 2024-04-25T15:54:33.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.901+0000 7f7b72ffd640 1 -- 172.21.15.87:0/3960010258 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f7b6c05bd00 con 0x7f7b7c14d810 2024-04-25T15:54:33.904 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:33.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b6006f430 msgr2=0x7f7b60071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b6006f430 0x7f7b60071940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c075050 tx=0x7f7b78009040 comp rx=0 tx=0).stop 2024-04-25T15:54:33.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 msgr2=0x7f7b7c14e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:33.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 0x7f7b7c14e810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00c820 tx=0x7f7b6c00cce0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 shutdown_connections 2024-04-25T15:54:33.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b6006f430 0x7f7b60071940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b7c154d00 0x7f7b7c1edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b7c14d810 0x7f7b7c14e810 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 --2- 172.21.15.87:0/3960010258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b7c06f790 0x7f7b7c0c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:33.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 >> 172.21.15.87:0/3960010258 conn(0x7f7b7c0c8770 msgr2=0x7f7b7c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:33.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 shutdown_connections 2024-04-25T15:54:33.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:33.905+0000 7f7b847eb640 1 -- 172.21.15.87:0/3960010258 wait complete. 2024-04-25T15:54:33.924 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:34.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.061+0000 7f24c0d0e640 1 Processor -- start 2024-04-25T15:54:34.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.061+0000 7f24c0d0e640 1 -- start start 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24c0d0e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24bc14d810 0x7f24bc157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24c0d0e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc06f790 0x7f24bc06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24c0d0e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc157d50 con 0x7f24bc154d00 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24c0d0e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f24bc0add10 con 0x7f24bc14d810 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24c0d0e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24bc0adff0 con 0x7f24bc06f790 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24bc14d810 0x7f24bc157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24bc14d810 0x7f24bc157810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35074/0 (socket says 172.21.15.87:35074) 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 -- 172.21.15.87:0/2284521472 learned_addr learned my addr 172.21.15.87:0/2284521472 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24bad9d640 1 --2- 172.21.15.87:0/2284521472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc06f790 0x7f24bc06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 -- 172.21.15.87:0/2284521472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc06f790 msgr2=0x7f24bc06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 --2- 172.21.15.87:0/2284521472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc06f790 0x7f24bc06fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 -- 172.21.15.87:0/2284521472 >> v1:172.21.15.155:6789/0 conn(0x7f24bc154d00 legacy=0x7f24bc154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 -- 172.21.15.87:0/2284521472 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc157010 con 0x7f24bc14d810 2024-04-25T15:54:34.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24ba59c640 1 --2- 172.21.15.87:0/2284521472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc157810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009870 tx=0x7f24a401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c31b164f426518b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24b959a640 1 -- 172.21.15.87:0/2284521472 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a40b0070 con 0x7f24bc14d810 2024-04-25T15:54:34.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24b959a640 1 -- 172.21.15.87:0/2284521472 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a40ab600 con 0x7f24bc14d810 2024-04-25T15:54:34.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.065+0000 7f24b959a640 1 -- 172.21.15.87:0/2284521472 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a40ab9d0 con 0x7f24bc14d810 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- 172.21.15.87:0/2284521472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 msgr2=0x7f24bc157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/2284521472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc157810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009870 tx=0x7f24a401c400 comp rx=0 tx=0).stop 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- 172.21.15.87:0/2284521472 shutdown_connections 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/2284521472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc06f790 0x7f24bc06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/2284521472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc157810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- 172.21.15.87:0/2284521472 >> 172.21.15.87:0/2284521472 conn(0x7f24bc0c8770 msgr2=0x7f24bc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- 172.21.15.87:0/2284521472 shutdown_connections 2024-04-25T15:54:34.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- 172.21.15.87:0/2284521472 wait complete. 2024-04-25T15:54:34.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 Processor -- start 2024-04-25T15:54:34.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- start start 2024-04-25T15:54:34.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24bc06f790 0x7f24bc1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc0abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc154d00 0x7f24bc14a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc161430 con 0x7f24bc14d810 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc1612b0 con 0x7f24bc06f790 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24c0d0e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24bc1615b0 con 0x7f24bc154d00 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24b9d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc0abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24b9d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc0abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35086/0 (socket says 172.21.15.87:35086) 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24b9d9b640 1 -- 172.21.15.87:0/716308360 learned_addr learned my addr 172.21.15.87:0/716308360 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24ba59c640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24bc06f790 0x7f24bc1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.069+0000 7f24bad9d640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc154d00 0x7f24bc14a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b9d9b640 1 -- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc154d00 msgr2=0x7f24bc14a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b9d9b640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc154d00 0x7f24bc14a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b9d9b640 1 -- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24bc06f790 msgr2=0x7f24bc1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b9d9b640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24bc06f790 0x7f24bc1505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b9d9b640 1 -- 172.21.15.87:0/716308360 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc14e9c0 con 0x7f24bc14d810 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b9d9b640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc0abdb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00b440 tx=0x7f24ac00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac015020 con 0x7f24bc14d810 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ac011890 con 0x7f24bc14d810 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc14eca0 con 0x7f24bc14d810 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac011c80 con 0x7f24bc14d810 2024-04-25T15:54:34.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc1ef2c0 con 0x7f24bc14d810 2024-04-25T15:54:34.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc1ef5a0 con 0x7f24bc14d810 2024-04-25T15:54:34.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f24ac018020 con 0x7f24bc14d810 2024-04-25T15:54:34.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b2ffd640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f249c06f430 0x7f249c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f24ac08f3c0 con 0x7f24bc14d810 2024-04-25T15:54:34.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24ba59c640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f249c06f430 0x7f249c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.073+0000 7f24ba59c640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f249c06f430 0x7f249c071940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24a40ad000 tx=0x7f24a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.077+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24ac01f030 con 0x7f24bc14d810 2024-04-25T15:54:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.273+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24bc069bb0 con 0x7f24bc14d810 2024-04-25T15:54:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.273+0000 7f24b2ffd640 1 -- 172.21.15.87:0/716308360 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f24ac00d040 con 0x7f24bc14d810 2024-04-25T15:54:34.276 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:34.276 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:34.276 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f249c06f430 msgr2=0x7f249c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f249c06f430 0x7f249c071940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24a40ad000 tx=0x7f24a4008040 comp rx=0 tx=0).stop 2024-04-25T15:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 msgr2=0x7f24bc0abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc0abdb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00b440 tx=0x7f24ac00b900 comp rx=0 tx=0).stop 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 shutdown_connections 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f249c06f430 0x7f249c071940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24bc154d00 0x7f24bc14a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24bc14d810 0x7f24bc0abdb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 --2- 172.21.15.87:0/716308360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24bc06f790 0x7f24bc1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 >> 172.21.15.87:0/716308360 conn(0x7f24bc0c8770 msgr2=0x7f24bc146930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 shutdown_connections 2024-04-25T15:54:34.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.277+0000 7f24c0d0e640 1 -- 172.21.15.87:0/716308360 wait complete. 2024-04-25T15:54:34.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:34.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 Processor -- start 2024-04-25T15:54:34.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 -- start start 2024-04-25T15:54:34.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b50157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b50158200 0x7f0b5015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b500c5290 con 0x7f0b501517d0 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0b500c5e80 con 0x7f0b50158200 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b55805640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b50154fd0 con 0x7f0b501578b0 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b50158200 0x7f0b5015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4e7fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b50157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4effd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0b501517d0 0x7f0b500c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:50928/0 (socket says 172.21.15.87:50928) 2024-04-25T15:54:34.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b50158200 0x7f0b5015ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:50546/0 (socket says 172.21.15.87:50546) 2024-04-25T15:54:34.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4e7fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b50157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:39812/0 (socket says 172.21.15.87:39812) 2024-04-25T15:54:34.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4effd640 1 -- 172.21.15.87:0/747243204 learned_addr learned my addr 172.21.15.87:0/747243204 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:34.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4f7fe640 1 -- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 msgr2=0x7f0b50157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4f7fe640 1 --2- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b50157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4f7fe640 1 -- 172.21.15.87:0/747243204 >> v1:172.21.15.155:6789/0 conn(0x7f0b501517d0 legacy=0x7f0b500c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.429+0000 7f0b4f7fe640 1 -- 172.21.15.87:0/747243204 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b500c5550 con 0x7f0b50158200 2024-04-25T15:54:34.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b4f7fe640 1 --2- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5015ea90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b400097c0 tx=0x7f0b4001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23abfd34d249b690 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b4dffb640 1 -- 172.21.15.87:0/747243204 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b400b0070 con 0x7f0b50158200 2024-04-25T15:54:34.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b4dffb640 1 -- 172.21.15.87:0/747243204 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b400ab600 con 0x7f0b50158200 2024-04-25T15:54:34.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b4dffb640 1 -- 172.21.15.87:0/747243204 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b400ab9d0 con 0x7f0b50158200 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 -- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 msgr2=0x7f0b5015ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 --2- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5015ea90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b400097c0 tx=0x7f0b4001c4a0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 -- 172.21.15.87:0/747243204 shutdown_connections 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 --2- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5015ea90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 --2- 172.21.15.87:0/747243204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b50157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 -- 172.21.15.87:0/747243204 >> 172.21.15.87:0/747243204 conn(0x7f0b5006d780 msgr2=0x7f0b5006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 -- 172.21.15.87:0/747243204 shutdown_connections 2024-04-25T15:54:34.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.433+0000 7f0b55805640 1 -- 172.21.15.87:0/747243204 wait complete. 2024-04-25T15:54:34.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 Processor -- start 2024-04-25T15:54:34.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 -- start start 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 0x7f0b501ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b501571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0b500ac870 con 0x7f0b501517d0 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b500ac6f0 con 0x7f0b50158200 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b500a8f70 con 0x7f0b501578b0 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 0x7f0b501ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 0x7f0b501ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35092/0 (socket says 172.21.15.87:35092) 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 -- 172.21.15.87:0/3659351548 learned_addr learned my addr 172.21.15.87:0/3659351548 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:34.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4e7fc640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b501571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4f7fe640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 -- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 msgr2=0x7f0b501571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b501571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 -- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 msgr2=0x7f0b5014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 -- 172.21.15.87:0/3659351548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5006dd30 con 0x7f0b501517d0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4f7fe640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b4effd640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 0x7f0b501ee680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800cad0 tx=0x7f0b4800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48017070 con 0x7f0b501517d0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4800abd0 con 0x7f0b501517d0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b501f2810 con 0x7f0b501517d0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48012400 con 0x7f0b501517d0 2024-04-25T15:54:34.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.437+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501eec10 con 0x7f0b501517d0 2024-04-25T15:54:34.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.441+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5006df00 con 0x7f0b501517d0 2024-04-25T15:54:34.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.441+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b4801a070 con 0x7f0b501517d0 2024-04-25T15:54:34.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.441+0000 7f0b47fff640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b3006f430 0x7f0b30071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.441+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0b4808f2a0 con 0x7f0b501517d0 2024-04-25T15:54:34.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.441+0000 7f0b4e7fc640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b3006f430 0x7f0b30071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.441+0000 7f0b4e7fc640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b3006f430 0x7f0b30071940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b500c6ee0 tx=0x7f0b38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.445+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b5006df00 con 0x7f0b501517d0 2024-04-25T15:54:34.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.609+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b501eee70 con 0x7f0b501517d0 2024-04-25T15:54:34.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b47fff640 1 -- 172.21.15.87:0/3659351548 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f0b4805bef0 con 0x7f0b501517d0 2024-04-25T15:54:34.614 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:34.614 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b3006f430 msgr2=0x7f0b30071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b3006f430 0x7f0b30071940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0b500c6ee0 tx=0x7f0b38008040 comp rx=0 tx=0).stop 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 msgr2=0x7f0b501ee680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 0x7f0b501ee680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800cad0 tx=0x7f0b4800cf90 comp rx=0 tx=0).stop 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 shutdown_connections 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b3006f430 0x7f0b30071940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b50158200 0x7f0b5014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b501578b0 0x7f0b501571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 --2- 172.21.15.87:0/3659351548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b501517d0 0x7f0b501ee680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 >> 172.21.15.87:0/3659351548 conn(0x7f0b5006d780 msgr2=0x7f0b50154360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 shutdown_connections 2024-04-25T15:54:34.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.613+0000 7f0b55805640 1 -- 172.21.15.87:0/3659351548 wait complete. 2024-04-25T15:54:34.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:34.635 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 Processor -- start 2024-04-25T15:54:34.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 -- start start 2024-04-25T15:54:34.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 0x7ff9f815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9f815fe30 0x7ff9f8162250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f80c45a0 con 0x7ff9f8154ca0 2024-04-25T15:54:34.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f80c9f30 con 0x7ff9f815fe30 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fea29640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f80c3fe0 con 0x7ff9f815ab10 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff9f8154ca0 0x7ff9f80c5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54818/0 (socket says 172.21.15.87:54818) 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 -- 172.21.15.87:0/3864735352 learned_addr learned my addr 172.21.15.87:0/3864735352 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9fcfc6640 1 --2- 172.21.15.87:0/3864735352 >> v2:172.21.15.155:3300/0 conn(0x7ff9f815fe30 0x7ff9f8162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f77fe640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 0x7ff9f815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759579250 0 0) 0x7ff9f80c45a0 con 0x7ff9f8154ca0 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e0003530 con 0x7ff9f8154ca0 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 551615077 0 0) 0x7ff9e0003530 con 0x7ff9f8154ca0 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 msgr2=0x7ff9f815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 0x7ff9f815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 >> v2:172.21.15.155:3300/0 conn(0x7ff9f815fe30 msgr2=0x7ff9f8162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 --2- 172.21.15.87:0/3864735352 >> v2:172.21.15.155:3300/0 conn(0x7ff9f815fe30 0x7ff9f8162250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f80c42c0 con 0x7ff9f8154ca0 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ff9e8001680 con 0x7ff9f8154ca0 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 >> v1:172.21.15.87:6789/0 conn(0x7ff9f8154ca0 legacy=0x7ff9f80c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00039c0 0x7ff9e0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 0x7ff9e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e0004d50 0x7ff9e0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80c9f30 con 0x7ff9e00039c0 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80c3fe0 con 0x7ff9e0004d50 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e000ba50 con 0x7ff9f815ab10 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00039c0 0x7ff9e0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f77fe640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 0x7ff9e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 -- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 msgr2=0x7ff9e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9f815ab10 0x7ff9e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 -- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e0004d50 msgr2=0x7ff9e0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:34.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e0004d50 0x7ff9e0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.789+0000 7ff9f7fff640 1 -- 172.21.15.87:0/3864735352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e0003530 con 0x7ff9e00039c0 2024-04-25T15:54:34.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00039c0 0x7ff9e0003e30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800c240 tx=0x7ff9e801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da05c3e7f8ffbca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007d40 con 0x7ff9e00039c0 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e80a9020 con 0x7ff9e00039c0 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9f6ffd640 1 -- 172.21.15.87:0/3864735352 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8005b00 con 0x7ff9e00039c0 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fea29640 1 -- 172.21.15.87:0/3864735352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00039c0 msgr2=0x7ff9e0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fea29640 1 --2- 172.21.15.87:0/3864735352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e00039c0 0x7ff9e0003e30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800c240 tx=0x7ff9e801cc40 comp rx=0 tx=0).stop 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fcfc6640 1 -- 172.21.15.87:0/3864735352 reap_dead start 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fea29640 1 -- 172.21.15.87:0/3864735352 shutdown_connections 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fea29640 1 -- 172.21.15.87:0/3864735352 >> 172.21.15.87:0/3864735352 conn(0x7ff9f80ac5c0 msgr2=0x7ff9f80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fea29640 1 -- 172.21.15.87:0/3864735352 shutdown_connections 2024-04-25T15:54:34.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.793+0000 7ff9fea29640 1 -- 172.21.15.87:0/3864735352 wait complete. 2024-04-25T15:54:34.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 Processor -- start 2024-04-25T15:54:34.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- start start 2024-04-25T15:54:34.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9e00039c0 0x7ff9f806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f8155410 0x7ff9f81f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 0x7ff9f814de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80c3dc0 con 0x7ff9f81f0a30 2024-04-25T15:54:34.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80c3c40 con 0x7ff9f8155410 2024-04-25T15:54:34.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f80aa1d0 con 0x7ff9e00039c0 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 0x7ff9f814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 0x7ff9f814de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35110/0 (socket says 172.21.15.87:35110) 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 -- 172.21.15.87:0/1196702226 learned_addr learned my addr 172.21.15.87:0/1196702226 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9e00039c0 0x7ff9f806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9f77fe640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f8155410 0x7ff9f81f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 -- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9e00039c0 msgr2=0x7ff9f806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9e00039c0 0x7ff9f806ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 -- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f8155410 msgr2=0x7ff9f81f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f8155410 0x7ff9f81f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 -- 172.21.15.87:0/1196702226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f8156180 con 0x7ff9f81f0a30 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fcfc6640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 0x7ff9f814de60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9f81586d0 tx=0x7ff9f000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000bd10 con 0x7ff9f81f0a30 2024-04-25T15:54:34.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f001a070 con 0x7ff9f81f0a30 2024-04-25T15:54:34.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f81f44a0 con 0x7ff9f81f0a30 2024-04-25T15:54:34.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0014640 con 0x7ff9f81f0a30 2024-04-25T15:54:34.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f8155e20 con 0x7ff9f81f0a30 2024-04-25T15:54:34.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.797+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f8069bb0 con 0x7ff9f81f0a30 2024-04-25T15:54:34.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.801+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9f0013070 con 0x7ff9f81f0a30 2024-04-25T15:54:34.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.801+0000 7ff9f4ff9640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9e406f430 0x7ff9e4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:34.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.801+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff9f008f610 con 0x7ff9f81f0a30 2024-04-25T15:54:34.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.801+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9e406f430 0x7ff9e4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:34.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.801+0000 7ff9f7fff640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9e406f430 0x7ff9e4071940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80aa000 tx=0x7ff9f81575a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:34.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.805+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9f005c260 con 0x7ff9f81f0a30 2024-04-25T15:54:34.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.965+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9f8155a40 con 0x7ff9f81f0a30 2024-04-25T15:54:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.965+0000 7ff9f4ff9640 1 -- 172.21.15.87:0/1196702226 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7ff9f0064250 con 0x7ff9f81f0a30 2024-04-25T15:54:34.966 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9e406f430 msgr2=0x7ff9e4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9e406f430 0x7ff9e4071940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80aa000 tx=0x7ff9f81575a0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 msgr2=0x7ff9f814de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 0x7ff9f814de60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9f81586d0 tx=0x7ff9f000b480 comp rx=0 tx=0).stop 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 shutdown_connections 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff9e406f430 0x7ff9e4071940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f81f0a30 0x7ff9f814de60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9f8155410 0x7ff9f81f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 --2- 172.21.15.87:0/1196702226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9e00039c0 0x7ff9f806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 >> 172.21.15.87:0/1196702226 conn(0x7ff9f80ac5c0 msgr2=0x7ff9f80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 shutdown_connections 2024-04-25T15:54:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:34.969+0000 7ff9fea29640 1 -- 172.21.15.87:0/1196702226 wait complete. 2024-04-25T15:54:34.988 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:35.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 Processor -- start 2024-04-25T15:54:35.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 -- start start 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89e81529a0 0x7f89e8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80ad990 0x7f89e80adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e8072430 con 0x7f89e80c41e0 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f89e8074730 con 0x7f89e81529a0 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89ed07c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89e8074a10 con 0x7f89e80ad990 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89e81529a0 0x7f89e8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89e81529a0 0x7f89e8071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35122/0 (socket says 172.21.15.87:35122) 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 -- 172.21.15.87:0/1688695403 learned_addr learned my addr 172.21.15.87:0/1688695403 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89dffff640 1 --2- 172.21.15.87:0/1688695403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80ad990 0x7f89e80adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 -- 172.21.15.87:0/1688695403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80ad990 msgr2=0x7f89e80adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 --2- 172.21.15.87:0/1688695403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80ad990 0x7f89e80adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 -- 172.21.15.87:0/1688695403 >> v1:172.21.15.155:6789/0 conn(0x7f89e80c41e0 legacy=0x7f89e80c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.137+0000 7f89e6d9d640 1 -- 172.21.15.87:0/1688695403 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8074cf0 con 0x7f89e81529a0 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89e6d9d640 1 --2- 172.21.15.87:0/1688695403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8071e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009870 tx=0x7f89d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b1b5b19559a7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89e659c640 1 -- 172.21.15.87:0/1688695403 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d80b0070 con 0x7f89e81529a0 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89e659c640 1 -- 172.21.15.87:0/1688695403 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d80ab600 con 0x7f89e81529a0 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89e659c640 1 -- 172.21.15.87:0/1688695403 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d80ab9d0 con 0x7f89e81529a0 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 -- 172.21.15.87:0/1688695403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 msgr2=0x7f89e8071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1688695403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8071e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009870 tx=0x7f89d801c490 comp rx=0 tx=0).stop 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 -- 172.21.15.87:0/1688695403 shutdown_connections 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1688695403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80ad990 0x7f89e80adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1688695403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8071e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 -- 172.21.15.87:0/1688695403 >> 172.21.15.87:0/1688695403 conn(0x7f89e80c8770 msgr2=0x7f89e80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 -- 172.21.15.87:0/1688695403 shutdown_connections 2024-04-25T15:54:35.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.141+0000 7f89ed07c640 1 -- 172.21.15.87:0/1688695403 wait complete. 2024-04-25T15:54:35.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 Processor -- start 2024-04-25T15:54:35.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- start start 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89e80ad990 0x7f89e814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80c41e0 0x7f89e81514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f89e8162470 con 0x7f89e81529a0 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89e81622f0 con 0x7f89e80ad990 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89e81625f0 con 0x7f89e80c41e0 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35132/0 (socket says 172.21.15.87:35132) 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 -- 172.21.15.87:0/1062171130 learned_addr learned my addr 172.21.15.87:0/1062171130 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:35.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89dffff640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80c41e0 0x7f89e81514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e6d9d640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89e80ad990 0x7f89e814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 -- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80c41e0 msgr2=0x7f89e81514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80c41e0 0x7f89e81514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 -- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89e80ad990 msgr2=0x7f89e814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89e80ad990 0x7f89e814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 -- 172.21.15.87:0/1062171130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8151a30 con 0x7f89e81529a0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89e759e640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8147030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f89e000b9e0 tx=0x7f89e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0003b80 con 0x7f89e81529a0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e0003d20 con 0x7f89e81529a0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e814e850 con 0x7f89e81529a0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e000cb60 con 0x7f89e81529a0 2024-04-25T15:54:35.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e814d890 con 0x7f89e81529a0 2024-04-25T15:54:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.145+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e8069bb0 con 0x7f89e81529a0 2024-04-25T15:54:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.148+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f89e0006d10 con 0x7f89e81529a0 2024-04-25T15:54:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.148+0000 7f89df7fe640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f89c806f400 0x7f89c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.148+0000 7f89e6d9d640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f89c806f400 0x7f89c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.148+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f89e008f020 con 0x7f89e81529a0 2024-04-25T15:54:35.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.148+0000 7f89e6d9d640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f89c806f400 0x7f89c8071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89d80ad000 tx=0x7f89d80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.152+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f89e005bd00 con 0x7f89e81529a0 2024-04-25T15:54:35.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.312+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f89e80c3760 con 0x7f89e81529a0 2024-04-25T15:54:35.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.312+0000 7f89df7fe640 1 -- 172.21.15.87:0/1062171130 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f89e005b600 con 0x7f89e81529a0 2024-04-25T15:54:35.315 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:35.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f89c806f400 msgr2=0x7f89c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f89c806f400 0x7f89c8071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89d80ad000 tx=0x7f89d80a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:35.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 msgr2=0x7f89e8147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8147030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f89e000b9e0 tx=0x7f89e000bea0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 shutdown_connections 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f89c806f400 0x7f89c8071910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89e81529a0 0x7f89e8147030 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89e80c41e0 0x7f89e81514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 --2- 172.21.15.87:0/1062171130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89e80ad990 0x7f89e814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 >> 172.21.15.87:0/1062171130 conn(0x7f89e80c8770 msgr2=0x7f89e80c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 shutdown_connections 2024-04-25T15:54:35.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.316+0000 7f89ed07c640 1 -- 172.21.15.87:0/1062171130 wait complete. 2024-04-25T15:54:35.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:35.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f9587b4d640 1 Processor -- start 2024-04-25T15:54:35.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f9587b4d640 1 -- start start 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f9587b4d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95801529a0 0x7f9580071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f9587b4d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95800ae1b0 con 0x7f95800ad990 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f9587b4d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9580072430 con 0x7f95800adda0 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f9587b4d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9580074730 con 0x7f95801529a0 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95858e9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95801529a0 0x7f9580071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95850e8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f95800ad990 0x7f95800c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54820/0 (socket says 172.21.15.87:54820) 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95858e9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95801529a0 0x7f9580071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35146/0 (socket says 172.21.15.87:35146) 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95850e8640 1 -- 172.21.15.87:0/3043775660 learned_addr learned my addr 172.21.15.87:0/3043775660 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95858e9640 1 -- 172.21.15.87:0/3043775660 >> v1:172.21.15.155:6789/0 conn(0x7f95800adda0 legacy=0x7f95800c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95858e9640 1 -- 172.21.15.87:0/3043775660 >> v1:172.21.15.87:6789/0 conn(0x7f95800ad990 legacy=0x7f95800c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.488+0000 7f95858e9640 1 -- 172.21.15.87:0/3043775660 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580074a10 con 0x7f95801529a0 2024-04-25T15:54:35.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f95858e9640 1 --2- 172.21.15.87:0/3043775660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580071e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96cc0ace00b981c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f95848e7640 1 -- 172.21.15.87:0/3043775660 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0b0070 con 0x7f95801529a0 2024-04-25T15:54:35.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f95848e7640 1 -- 172.21.15.87:0/3043775660 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0ab600 con 0x7f95801529a0 2024-04-25T15:54:35.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f95848e7640 1 -- 172.21.15.87:0/3043775660 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0a4e60 con 0x7f95801529a0 2024-04-25T15:54:35.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 -- 172.21.15.87:0/3043775660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 msgr2=0x7f9580071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 --2- 172.21.15.87:0/3043775660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580071e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c01c3d0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 -- 172.21.15.87:0/3043775660 shutdown_connections 2024-04-25T15:54:35.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 --2- 172.21.15.87:0/3043775660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580071e50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 -- 172.21.15.87:0/3043775660 >> 172.21.15.87:0/3043775660 conn(0x7f95800c8770 msgr2=0x7f95800c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:35.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 -- 172.21.15.87:0/3043775660 shutdown_connections 2024-04-25T15:54:35.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.492+0000 7f9587b4d640 1 -- 172.21.15.87:0/3043775660 wait complete. 2024-04-25T15:54:35.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 Processor -- start 2024-04-25T15:54:35.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- start start 2024-04-25T15:54:35.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95800ad990 0x7f9580150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95800adda0 0x7f9580141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9580163890 con 0x7f95801529a0 2024-04-25T15:54:35.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9580163710 con 0x7f95800ad990 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9580163a10 con 0x7f95800adda0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35148/0 (socket says 172.21.15.87:35148) 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 -- 172.21.15.87:0/421843200 learned_addr learned my addr 172.21.15.87:0/421843200 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95858e9640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95800ad990 0x7f9580150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95850e8640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95800adda0 0x7f9580141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 -- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95800adda0 msgr2=0x7f9580141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95800adda0 0x7f9580141750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 -- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95800ad990 msgr2=0x7f9580150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95800ad990 0x7f9580150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 -- 172.21.15.87:0/421843200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580150e90 con 0x7f95801529a0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95860ea640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580141c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f957800be90 tx=0x7f957800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578019070 con 0x7f95801529a0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9578014440 con 0x7f95801529a0 2024-04-25T15:54:35.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578014870 con 0x7f95801529a0 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9580151170 con 0x7f95801529a0 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95800c74e0 con 0x7f95801529a0 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.496+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9580069bb0 con 0x7f95801529a0 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.500+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f957801c070 con 0x7f95801529a0 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.500+0000 7f95767fc640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f956406f400 0x7f9564071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.500+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f957808f760 con 0x7f95801529a0 2024-04-25T15:54:35.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.500+0000 7f95858e9640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f956406f400 0x7f9564071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.500+0000 7f95858e9640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f956406f400 0x7f9564071910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f957c0ad000 tx=0x7f957c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.504+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9578023080 con 0x7f95801529a0 2024-04-25T15:54:35.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.668+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f95800c3760 con 0x7f95801529a0 2024-04-25T15:54:35.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.668+0000 7f95767fc640 1 -- 172.21.15.87:0/421843200 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f957805c490 con 0x7f95801529a0 2024-04-25T15:54:35.672 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:35.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f956406f400 msgr2=0x7f9564071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f956406f400 0x7f9564071910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f957c0ad000 tx=0x7f957c0a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:35.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 msgr2=0x7f9580141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580141c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f957800be90 tx=0x7f957800bf80 comp rx=0 tx=0).stop 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 shutdown_connections 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f956406f400 0x7f9564071910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801529a0 0x7f9580141c90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95800adda0 0x7f9580141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 --2- 172.21.15.87:0/421843200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95800ad990 0x7f9580150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 >> 172.21.15.87:0/421843200 conn(0x7f95800c8770 msgr2=0x7f9580147d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 shutdown_connections 2024-04-25T15:54:35.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.672+0000 7f9587b4d640 1 -- 172.21.15.87:0/421843200 wait complete. 2024-04-25T15:54:35.694 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:35.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.840+0000 7f8dcb7be640 1 Processor -- start 2024-04-25T15:54:35.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.840+0000 7f8dcb7be640 1 -- start start 2024-04-25T15:54:35.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dcb7be640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8dc41518b0 0x7f8dc406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dcb7be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8dc40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dcb7be640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc4154fc0 con 0x7f8dc40c4620 2024-04-25T15:54:35.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dcb7be640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc406ed60 con 0x7f8dc41518b0 2024-04-25T15:54:35.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dcb7be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc40acb20 con 0x7f8dc40ad160 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc9d5b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8dc40c4620 0x7f8dc4157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54832/0 (socket says 172.21.15.87:54832) 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc9d5b640 1 -- 172.21.15.87:0/62192616 learned_addr learned my addr 172.21.15.87:0/62192616 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc955a640 1 --2- 172.21.15.87:0/62192616 >> v2:172.21.15.155:3300/0 conn(0x7f8dc41518b0 0x7f8dc406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8dc40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898005596 0 0) 0x7f8dc4154fc0 con 0x7f8dc40c4620 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8db0003530 con 0x7f8dc40c4620 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2133911500 0 0) 0x7f8db0003530 con 0x7f8dc40c4620 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 msgr2=0x7f8dc40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8dc40c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 >> v2:172.21.15.155:3300/0 conn(0x7f8dc41518b0 msgr2=0x7f8dc406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 --2- 172.21.15.87:0/62192616 >> v2:172.21.15.155:3300/0 conn(0x7f8dc41518b0 0x7f8dc406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc40ace00 con 0x7f8dc40c4620 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f8dbc001a00 con 0x7f8dc40c4620 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 >> v1:172.21.15.87:6789/0 conn(0x7f8dc40c4620 legacy=0x7f8dc4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8db00039c0 0x7f8db0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8db0004810 0x7f8db0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8db0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc406ed60 con 0x7f8db0004810 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40acb20 con 0x7f8db00039c0 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8db000b9d0 con 0x7f8dc40ad160 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8db0004810 0x7f8db0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc955a640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8db00039c0 0x7f8db0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc9d5b640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8db0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 -- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 msgr2=0x7f8db0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8db0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 -- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8db00039c0 msgr2=0x7f8db0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8db00039c0 0x7f8db0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc8d59640 1 -- 172.21.15.87:0/62192616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db0003530 con 0x7f8db0004810 2024-04-25T15:54:35.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.844+0000 7f8dc9d5b640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40ad160 0x7f8db0005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:35.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8db0004810 0x7f8db0004c20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009ae0 tx=0x7f8db401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398fce943a4872c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db40b2070 con 0x7f8db0004810 2024-04-25T15:54:35.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db40a5680 con 0x7f8db0004810 2024-04-25T15:54:35.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dbbfff640 1 -- 172.21.15.87:0/62192616 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db40096b0 con 0x7f8db0004810 2024-04-25T15:54:35.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 -- 172.21.15.87:0/62192616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8db0004810 msgr2=0x7f8db0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/62192616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8db0004810 0x7f8db0004c20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009ae0 tx=0x7f8db401ca90 comp rx=0 tx=0).stop 2024-04-25T15:54:35.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dc9d5b640 1 -- 172.21.15.87:0/62192616 reap_dead start 2024-04-25T15:54:35.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 -- 172.21.15.87:0/62192616 shutdown_connections 2024-04-25T15:54:35.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 -- 172.21.15.87:0/62192616 >> 172.21.15.87:0/62192616 conn(0x7f8dc40c8770 msgr2=0x7f8dc40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:35.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 -- 172.21.15.87:0/62192616 shutdown_connections 2024-04-25T15:54:35.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 -- 172.21.15.87:0/62192616 wait complete. 2024-04-25T15:54:35.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 Processor -- start 2024-04-25T15:54:35.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.852+0000 7f8dcb7be640 1 -- start start 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 0x7f8dc40c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc414c790 0x7f8dc414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc4156900 0x7f8dc4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4071fd0 con 0x7f8dc40be810 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4071e50 con 0x7f8dc414c790 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc406fa10 con 0x7f8dc4156900 2024-04-25T15:54:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 0x7f8dc40c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 0x7f8dc40c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35168/0 (socket says 172.21.15.87:35168) 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 -- 172.21.15.87:0/2765490336 learned_addr learned my addr 172.21.15.87:0/2765490336 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc414c790 0x7f8dc414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc9d5b640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc4156900 0x7f8dc4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 -- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc4156900 msgr2=0x7f8dc4156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc4156900 0x7f8dc4156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 -- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc414c790 msgr2=0x7f8dc414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc414c790 0x7f8dc414cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 -- 172.21.15.87:0/2765490336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4155be0 con 0x7f8dc40be810 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc9d5b640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc4156900 0x7f8dc4156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc955a640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 0x7f8dc40c3230 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00119d0 tx=0x7f8dc0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000fb50 con 0x7f8dc40be810 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc000fcf0 con 0x7f8dc40be810 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc4155ec0 con 0x7f8dc40be810 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000fea0 con 0x7f8dc40be810 2024-04-25T15:54:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc4158200 con 0x7f8dc40be810 2024-04-25T15:54:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4069bb0 con 0x7f8dc40be810 2024-04-25T15:54:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8dc0012040 con 0x7f8dc40be810 2024-04-25T15:54:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8db9ffb640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8da806f400 0x7f8da8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8dc008fd40 con 0x7f8dc40be810 2024-04-25T15:54:35.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.856+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8da806f400 0x7f8da8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:35.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.860+0000 7f8dc8d59640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8da806f400 0x7f8da8071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8db40af000 tx=0x7f8db4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:35.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:35.864+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8dc0019030 con 0x7f8dc40be810 2024-04-25T15:54:36.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.024+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f8dc40abfa0 con 0x7f8dc40be810 2024-04-25T15:54:36.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.024+0000 7f8db9ffb640 1 -- 172.21.15.87:0/2765490336 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f8dc005c990 con 0x7f8dc40be810 2024-04-25T15:54:36.026 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:36.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8da806f400 msgr2=0x7f8da8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8da806f400 0x7f8da8071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8db40af000 tx=0x7f8db4008040 comp rx=0 tx=0).stop 2024-04-25T15:54:36.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 msgr2=0x7f8dc40c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 0x7f8dc40c3230 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00119d0 tx=0x7f8dc0011e90 comp rx=0 tx=0).stop 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 shutdown_connections 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8da806f400 0x7f8da8071910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc4156900 0x7f8dc4156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc414c790 0x7f8dc414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 --2- 172.21.15.87:0/2765490336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40be810 0x7f8dc40c3230 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 >> 172.21.15.87:0/2765490336 conn(0x7f8dc40c8770 msgr2=0x7f8dc414d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 shutdown_connections 2024-04-25T15:54:36.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.028+0000 7f8dcb7be640 1 -- 172.21.15.87:0/2765490336 wait complete. 2024-04-25T15:54:36.048 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:36.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.188+0000 7fa3bcad0640 1 Processor -- start 2024-04-25T15:54:36.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.188+0000 7fa3bcad0640 1 -- start start 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3bcad0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b815ad90 0x7fa3b80ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3bcad0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3b80cb270 0x7fa3b8157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3bcad0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b80c7570 con 0x7fa3b80cae60 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3bcad0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b815b8b0 con 0x7fa3b80cb270 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3bcad0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b815b5d0 con 0x7fa3b815ad90 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3b80cb270 0x7fa3b8157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3b80cb270 0x7fa3b8157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35180/0 (socket says 172.21.15.87:35180) 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 -- 172.21.15.87:0/3198709249 learned_addr learned my addr 172.21.15.87:0/3198709249 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b659c640 1 --2- 172.21.15.87:0/3198709249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b815ad90 0x7fa3b80ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 -- 172.21.15.87:0/3198709249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b815ad90 msgr2=0x7fa3b80ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 --2- 172.21.15.87:0/3198709249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b815ad90 0x7fa3b80ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 -- 172.21.15.87:0/3198709249 >> v1:172.21.15.155:6789/0 conn(0x7fa3b80cae60 legacy=0x7fa3b8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.192+0000 7fa3b6d9d640 1 -- 172.21.15.87:0/3198709249 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b80c2290 con 0x7fa3b80cb270 2024-04-25T15:54:36.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3b6d9d640 1 --2- 172.21.15.87:0/3198709249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b8157a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009870 tx=0x7fa3b001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a82b26fab6962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3b559a640 1 -- 172.21.15.87:0/3198709249 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00b0070 con 0x7fa3b80cb270 2024-04-25T15:54:36.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3b559a640 1 -- 172.21.15.87:0/3198709249 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b00ab600 con 0x7fa3b80cb270 2024-04-25T15:54:36.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3b559a640 1 -- 172.21.15.87:0/3198709249 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00ab9d0 con 0x7fa3b80cb270 2024-04-25T15:54:36.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3198709249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 msgr2=0x7fa3b8157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3198709249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b8157a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009870 tx=0x7fa3b001c440 comp rx=0 tx=0).stop 2024-04-25T15:54:36.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3198709249 shutdown_connections 2024-04-25T15:54:36.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3198709249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b8157a90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3198709249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b815ad90 0x7fa3b80ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3198709249 >> 172.21.15.87:0/3198709249 conn(0x7fa3b80c9330 msgr2=0x7fa3b80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:36.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3198709249 shutdown_connections 2024-04-25T15:54:36.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3198709249 wait complete. 2024-04-25T15:54:36.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 Processor -- start 2024-04-25T15:54:36.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.196+0000 7fa3bcad0640 1 -- start start 2024-04-25T15:54:36.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b80cae60 0x7fa3b8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b81473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b815ad90 0x7fa3b80ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b815b1a0 con 0x7fa3b80cb270 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b80ca190 con 0x7fa3b815ad90 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b815b320 con 0x7fa3b80cae60 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b81473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b81473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35186/0 (socket says 172.21.15.87:35186) 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 -- 172.21.15.87:0/3552013534 learned_addr learned my addr 172.21.15.87:0/3552013534 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b6d9d640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b815ad90 0x7fa3b80ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b659c640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b80cae60 0x7fa3b8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 -- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b80cae60 msgr2=0x7fa3b8159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b80cae60 0x7fa3b8159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 -- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b815ad90 msgr2=0x7fa3b80ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b815ad90 0x7fa3b80ad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 -- 172.21.15.87:0/3552013534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b8156a60 con 0x7fa3b80cb270 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b659c640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b80cae60 0x7fa3b8159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3b5d9b640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b81473c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c340 tx=0x7fa3ac00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0052d0 con 0x7fa3b80cb270 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac005470 con 0x7fa3b80cb270 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b8159460 con 0x7fa3b80cb270 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac007260 con 0x7fa3b80cb270 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b815a6c0 con 0x7fa3b80cb270 2024-04-25T15:54:36.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b8069bb0 con 0x7fa3b80cb270 2024-04-25T15:54:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa3ac007400 con 0x7fa3b80cb270 2024-04-25T15:54:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.200+0000 7fa3a6ffd640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa39806f400 0x7fa398071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.204+0000 7fa3b659c640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa39806f400 0x7fa398071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.204+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa3ac08ed30 con 0x7fa3b80cb270 2024-04-25T15:54:36.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.204+0000 7fa3b659c640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa39806f400 0x7fa398071910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009f50 tx=0x7fa3a800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.204+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3ac05baf0 con 0x7fa3b80cb270 2024-04-25T15:54:36.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.352+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fa3b8157db0 con 0x7fa3b80cb270 2024-04-25T15:54:36.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3a6ffd640 1 -- 172.21.15.87:0/3552013534 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7fa3ac05b3f0 con 0x7fa3b80cb270 2024-04-25T15:54:36.356 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa39806f400 msgr2=0x7fa398071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa39806f400 0x7fa398071910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009f50 tx=0x7fa3a800b040 comp rx=0 tx=0).stop 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 msgr2=0x7fa3b81473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b81473c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c340 tx=0x7fa3ac00c800 comp rx=0 tx=0).stop 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 shutdown_connections 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa39806f400 0x7fa398071910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b815ad90 0x7fa3b80ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3b80cb270 0x7fa3b81473c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 --2- 172.21.15.87:0/3552013534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b80cae60 0x7fa3b8159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 >> 172.21.15.87:0/3552013534 conn(0x7fa3b80c9330 msgr2=0x7fa3b8152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 shutdown_connections 2024-04-25T15:54:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.356+0000 7fa3bcad0640 1 -- 172.21.15.87:0/3552013534 wait complete. 2024-04-25T15:54:36.376 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:36.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769c7bc640 1 Processor -- start 2024-04-25T15:54:36.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769c7bc640 1 -- start start 2024-04-25T15:54:36.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769c7bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f769415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769c7bc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76940c7570 con 0x7f7694160230 2024-04-25T15:54:36.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769c7bc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769415b8b0 con 0x7f769415ad90 2024-04-25T15:54:36.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769c7bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f769415b5d0 con 0x7f76940cb030 2024-04-25T15:54:36.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769ad59640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7694160230 0x7f7694162650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54846/0 (socket says 172.21.15.87:54846) 2024-04-25T15:54:36.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f769ad59640 1 -- 172.21.15.87:0/497411157 learned_addr learned my addr 172.21.15.87:0/497411157 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349714596 0 0) 0x7f76940c7570 con 0x7f7694160230 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7680003530 con 0x7f7694160230 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699d57640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f769415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3412214312 0 0) 0x7f7680003530 con 0x7f7694160230 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 msgr2=0x7f769415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f769415fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 >> v1:172.21.15.155:6789/0 conn(0x7f769415ad90 legacy=0x7f76940ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76940c2290 con 0x7f7694160230 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f768c001a00 con 0x7f7694160230 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699d57640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f769415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 >> v1:172.21.15.87:6789/0 conn(0x7f7694160230 legacy=0x7f7694162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7680003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7680004810 0x7f7680004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f768000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.512+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f769415b5d0 con 0x7f76800039f0 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7680005690 con 0x7f7680004810 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f768000bf90 con 0x7f76940cb030 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7680003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769ad59640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f768000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f7699d57640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7680004810 0x7f7680004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 -- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 msgr2=0x7f768000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76940cb030 0x7f768000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 -- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7680004810 msgr2=0x7f7680004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7680004810 0x7f7680004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 -- 172.21.15.87:0/497411157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7680003530 con 0x7f76800039f0 2024-04-25T15:54:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769a558640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7680003e60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7690001780 tx=0x7f769001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47541005a280c1da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900013a0 con 0x7f76800039f0 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76900052f0 con 0x7f76800039f0 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f7699556640 1 -- 172.21.15.87:0/497411157 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690003840 con 0x7f76800039f0 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769c7bc640 1 -- 172.21.15.87:0/497411157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 msgr2=0x7f7680003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769c7bc640 1 --2- 172.21.15.87:0/497411157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7680003e60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7690001780 tx=0x7f769001c420 comp rx=0 tx=0).stop 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769ad59640 1 -- 172.21.15.87:0/497411157 reap_dead start 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769c7bc640 1 -- 172.21.15.87:0/497411157 shutdown_connections 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769c7bc640 1 -- 172.21.15.87:0/497411157 >> 172.21.15.87:0/497411157 conn(0x7f76940c9330 msgr2=0x7f76940c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769c7bc640 1 -- 172.21.15.87:0/497411157 shutdown_connections 2024-04-25T15:54:36.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.516+0000 7f769c7bc640 1 -- 172.21.15.87:0/497411157 wait complete. 2024-04-25T15:54:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 Processor -- start 2024-04-25T15:54:36.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- start start 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7694149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769414a890 0x7f76940ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76941f1430 0x7f76940b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f769415b1a0 con 0x7f76800039f0 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76940ca190 con 0x7f769414a890 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f769415b320 con 0x7f76941f1430 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7694149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7694149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35206/0 (socket says 172.21.15.87:35206) 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 -- 172.21.15.87:0/79840476 learned_addr learned my addr 172.21.15.87:0/79840476 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f7699d57640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769414a890 0x7f76940ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769ad59640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76941f1430 0x7f76940b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 -- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76941f1430 msgr2=0x7f76940b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76941f1430 0x7f76940b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 -- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769414a890 msgr2=0x7f76940ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769414a890 0x7f76940ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 -- 172.21.15.87:0/79840476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76940adfe0 con 0x7f76800039f0 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769a558640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7694149330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7690001780 tx=0x7f7680005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690007a40 con 0x7f76800039f0 2024-04-25T15:54:36.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76900bb070 con 0x7f76800039f0 2024-04-25T15:54:36.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76941f49c0 con 0x7f76800039f0 2024-04-25T15:54:36.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900013a0 con 0x7f76800039f0 2024-04-25T15:54:36.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76941f0c30 con 0x7f76800039f0 2024-04-25T15:54:36.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.520+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76940c1f90 con 0x7f76800039f0 2024-04-25T15:54:36.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.524+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f76900b4040 con 0x7f76800039f0 2024-04-25T15:54:36.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.524+0000 7f768affd640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f767806f400 0x7f7678071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.524+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f76901295a0 con 0x7f76800039f0 2024-04-25T15:54:36.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.524+0000 7f7699d57640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f767806f400 0x7f7678071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.524+0000 7f7699d57640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f767806f400 0x7f7678071910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7694158360 tx=0x7f7684008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.528+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f76940adfe0 con 0x7f76800039f0 2024-04-25T15:54:36.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.724+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76941f0760 con 0x7f76800039f0 2024-04-25T15:54:36.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.724+0000 7f768affd640 1 -- 172.21.15.87:0/79840476 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f76900f6e20 con 0x7f76800039f0 2024-04-25T15:54:36.727 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:36.727 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:36.728 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:36.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f767806f400 msgr2=0x7f7678071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f767806f400 0x7f7678071910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7694158360 tx=0x7f7684008040 comp rx=0 tx=0).stop 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 msgr2=0x7f7694149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7694149330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7690001780 tx=0x7f7680005840 comp rx=0 tx=0).stop 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 shutdown_connections 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f767806f400 0x7f7678071910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76941f1430 0x7f76940b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769414a890 0x7f76940ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 --2- 172.21.15.87:0/79840476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76800039f0 0x7f7694149330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 >> 172.21.15.87:0/79840476 conn(0x7f76940c9330 msgr2=0x7f76940c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 shutdown_connections 2024-04-25T15:54:36.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.728+0000 7f769c7bc640 1 -- 172.21.15.87:0/79840476 wait complete. 2024-04-25T15:54:36.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 Processor -- start 2024-04-25T15:54:36.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 -- start start 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c1518b0 0x7fb57c06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb57c06fa10 0x7fb57c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb57c154fc0 con 0x7fb57c0ad160 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb57c06ed60 con 0x7fb57c06fa10 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb581abb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb57c0acb20 con 0x7fb57c1518b0 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb57c06fa10 0x7fb57c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb57c06fa10 0x7fb57c15e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35220/0 (socket says 172.21.15.87:35220) 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 -- 172.21.15.87:0/1057791518 learned_addr learned my addr 172.21.15.87:0/1057791518 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57b7fe640 1 --2- 172.21.15.87:0/1057791518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c1518b0 0x7fb57c06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 -- 172.21.15.87:0/1057791518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c1518b0 msgr2=0x7fb57c06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:36.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 --2- 172.21.15.87:0/1057791518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c1518b0 0x7fb57c06f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 -- 172.21.15.87:0/1057791518 >> v1:172.21.15.155:6789/0 conn(0x7fb57c0ad160 legacy=0x7fb57c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:36.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.896+0000 7fb57bfff640 1 -- 172.21.15.87:0/1057791518 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57c0ace00 con 0x7fb57c06fa10 2024-04-25T15:54:36.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb57bfff640 1 --2- 172.21.15.87:0/1057791518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c06fa10 0x7fb57c15e9b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb574009e50 tx=0x7fb57401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5c7c4abc58b996 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb57a7fc640 1 -- 172.21.15.87:0/1057791518 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740a57a0 con 0x7fb57c06fa10 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb57a7fc640 1 -- 172.21.15.87:0/1057791518 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5740a5940 con 0x7fb57c06fa10 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb57a7fc640 1 -- 172.21.15.87:0/1057791518 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740a5d10 con 0x7fb57c06fa10 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 -- 172.21.15.87:0/1057791518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c06fa10 msgr2=0x7fb57c15e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 --2- 172.21.15.87:0/1057791518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c06fa10 0x7fb57c15e9b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb574009e50 tx=0x7fb57401c9f0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 -- 172.21.15.87:0/1057791518 shutdown_connections 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 --2- 172.21.15.87:0/1057791518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c06fa10 0x7fb57c15e9b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 --2- 172.21.15.87:0/1057791518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c1518b0 0x7fb57c06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 -- 172.21.15.87:0/1057791518 >> 172.21.15.87:0/1057791518 conn(0x7fb57c0c8770 msgr2=0x7fb57c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 -- 172.21.15.87:0/1057791518 shutdown_connections 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 -- 172.21.15.87:0/1057791518 wait complete. 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 Processor -- start 2024-04-25T15:54:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.900+0000 7fb581abb640 1 -- start start 2024-04-25T15:54:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c06fa10 0x7fb57c074150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c0ad160 0x7fb57c15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 0x7fb57c0bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c161710 con 0x7fb57c1518b0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c161890 con 0x7fb57c0ad160 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb57c161a10 con 0x7fb57c06fa10 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 0x7fb57c0bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 0x7fb57c0bebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35236/0 (socket says 172.21.15.87:35236) 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 -- 172.21.15.87:0/298604777 learned_addr learned my addr 172.21.15.87:0/298604777 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57b7fe640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c06fa10 0x7fb57c074150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 -- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c06fa10 msgr2=0x7fb57c074150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57affd640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c0ad160 0x7fb57c15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c06fa10 0x7fb57c074150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 -- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c0ad160 msgr2=0x7fb57c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c0ad160 0x7fb57c15e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 -- 172.21.15.87:0/298604777 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57c1f09b0 con 0x7fb57c1518b0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57bfff640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 0x7fb57c0bebf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af040 tx=0x7fb574019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740b8670 con 0x7fb57c1518b0 2024-04-25T15:54:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5740be070 con 0x7fb57c1518b0 2024-04-25T15:54:36.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57c1f4df0 con 0x7fb57c1518b0 2024-04-25T15:54:36.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740b8a50 con 0x7fb57c1518b0 2024-04-25T15:54:36.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57c0bdd50 con 0x7fb57c1518b0 2024-04-25T15:54:36.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb57c069bb0 con 0x7fb57c1518b0 2024-04-25T15:54:36.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb5740b8bf0 con 0x7fb57c1518b0 2024-04-25T15:54:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb563fff640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb56806f400 0x7fb568071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb57412a670 con 0x7fb57c1518b0 2024-04-25T15:54:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.904+0000 7fb57b7fe640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb56806f400 0x7fb568071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.908+0000 7fb57b7fe640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb56806f400 0x7fb568071910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0aad60 tx=0x7fb56c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:36.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:36.912+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb5740165e0 con 0x7fb57c1518b0 2024-04-25T15:54:37.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.072+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb57c0abfa0 con 0x7fb57c1518b0 2024-04-25T15:54:37.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb563fff640 1 -- 172.21.15.87:0/298604777 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7fb5740f72c0 con 0x7fb57c1518b0 2024-04-25T15:54:37.076 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:37.077 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb56806f400 msgr2=0x7fb568071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb56806f400 0x7fb568071910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0aad60 tx=0x7fb56c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 msgr2=0x7fb57c0bebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 0x7fb57c0bebf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af040 tx=0x7fb574019790 comp rx=0 tx=0).stop 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 shutdown_connections 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb56806f400 0x7fb568071910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb57c1518b0 0x7fb57c0bebf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c0ad160 0x7fb57c15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 --2- 172.21.15.87:0/298604777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57c06fa10 0x7fb57c074150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 >> 172.21.15.87:0/298604777 conn(0x7fb57c0c8770 msgr2=0x7fb57c0c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:37.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 shutdown_connections 2024-04-25T15:54:37.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.076+0000 7fb581abb640 1 -- 172.21.15.87:0/298604777 wait complete. 2024-04-25T15:54:37.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.252+0000 7f06e5b3d640 1 Processor -- start 2024-04-25T15:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.252+0000 7f06e5b3d640 1 -- start start 2024-04-25T15:54:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06e01529a0 0x7f06e0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e00adda0 0x7f06e00c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e00c4e30 con 0x7f06e00ad990 2024-04-25T15:54:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f06e00ae1b0 con 0x7f06e01529a0 2024-04-25T15:54:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f06e0072430 con 0x7f06e00adda0 2024-04-25T15:54:37.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06df7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06e01529a0 0x7f06e0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06d6ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f06e00ad990 0x7f06e00c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54860/0 (socket says 172.21.15.87:54860) 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06d6ffd640 1 -- 172.21.15.87:0/2220665270 learned_addr learned my addr 172.21.15.87:0/2220665270 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06dffff640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e00adda0 0x7f06e00c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06df7fe640 1 -- 172.21.15.87:0/2220665270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e00adda0 msgr2=0x7f06e00c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06df7fe640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e00adda0 0x7f06e00c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06df7fe640 1 -- 172.21.15.87:0/2220665270 >> v1:172.21.15.87:6789/0 conn(0x7f06e00ad990 legacy=0x7f06e00c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06deffd640 1 -- 172.21.15.87:0/2220665270 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048006362 0 0) 0x7f06c8001120 con 0x7f06e00ad990 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06df7fe640 1 -- 172.21.15.87:0/2220665270 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e0074730 con 0x7f06e01529a0 2024-04-25T15:54:37.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06dffff640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e00adda0 0x7f06e00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06df7fe640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e01529a0 0x7f06e0071e50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097c0 tx=0x7f06d001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d847883d235545 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06deffd640 1 -- 172.21.15.87:0/2220665270 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b0070 con 0x7f06e01529a0 2024-04-25T15:54:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06deffd640 1 -- 172.21.15.87:0/2220665270 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00ab600 con 0x7f06e01529a0 2024-04-25T15:54:37.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06deffd640 1 -- 172.21.15.87:0/2220665270 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ab9d0 con 0x7f06e01529a0 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- 172.21.15.87:0/2220665270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e01529a0 msgr2=0x7f06e0071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e01529a0 0x7f06e0071e50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097c0 tx=0x7f06d001c410 comp rx=0 tx=0).stop 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- 172.21.15.87:0/2220665270 shutdown_connections 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e00adda0 0x7f06e00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/2220665270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e01529a0 0x7f06e0071e50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- 172.21.15.87:0/2220665270 >> 172.21.15.87:0/2220665270 conn(0x7f06e00c8770 msgr2=0x7f06e00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- 172.21.15.87:0/2220665270 shutdown_connections 2024-04-25T15:54:37.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.256+0000 7f06e5b3d640 1 -- 172.21.15.87:0/2220665270 wait complete. 2024-04-25T15:54:37.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 Processor -- start 2024-04-25T15:54:37.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 -- start start 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e00ad990 0x7f06e0157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 0x7f06e014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e01529a0 0x7f06e015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01622f0 con 0x7f06e00adda0 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06e00ab1a0 con 0x7f06e00ad990 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f06e0162470 con 0x7f06e01529a0 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 0x7f06e014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 0x7f06e014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35254/0 (socket says 172.21.15.87:35254) 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 -- 172.21.15.87:0/1103832185 learned_addr learned my addr 172.21.15.87:0/1103832185 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:37.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06df7fe640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e00ad990 0x7f06e0157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06dffff640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e01529a0 0x7f06e015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 -- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e01529a0 msgr2=0x7f06e015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e01529a0 0x7f06e015b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 -- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e00ad990 msgr2=0x7f06e0157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e00ad990 0x7f06e0157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 -- 172.21.15.87:0/1103832185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e0159cd0 con 0x7f06e00adda0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06df7fe640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e00ad990 0x7f06e0157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06d6ffd640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 0x7f06e014f180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c3e0 tx=0x7f06c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80074e0 con 0x7f06e00adda0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c80047f0 con 0x7f06e00adda0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e015a7d0 con 0x7f06e00adda0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8004be0 con 0x7f06e00adda0 2024-04-25T15:54:37.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.260+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e0158300 con 0x7f06e00adda0 2024-04-25T15:54:37.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.264+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e0069bb0 con 0x7f06e00adda0 2024-04-25T15:54:37.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.264+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06c8011070 con 0x7f06e00adda0 2024-04-25T15:54:37.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.264+0000 7f06dcff9640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f06c006f430 0x7f06c0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:37.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.264+0000 7f06df7fe640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f06c006f430 0x7f06c0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:37.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.264+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f06c808f090 con 0x7f06e00adda0 2024-04-25T15:54:37.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.264+0000 7f06df7fe640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f06c006f430 0x7f06c0071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ad000 tx=0x7f06d00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:37.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.268+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06e00c4e30 con 0x7f06e00adda0 2024-04-25T15:54:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06e00c3760 con 0x7f06e00adda0 2024-04-25T15:54:37.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06dcff9640 1 -- 172.21.15.87:0/1103832185 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f06c805bd70 con 0x7f06e00adda0 2024-04-25T15:54:37.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:37.474 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f06c006f430 msgr2=0x7f06c0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f06c006f430 0x7f06c0071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ad000 tx=0x7f06d00a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 msgr2=0x7f06e014f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 0x7f06e014f180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06c800c3e0 tx=0x7f06c800c8a0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 shutdown_connections 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f06c006f430 0x7f06c0071940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e01529a0 0x7f06e015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06e00adda0 0x7f06e014f180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 --2- 172.21.15.87:0/1103832185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e00ad990 0x7f06e0157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 >> 172.21.15.87:0/1103832185 conn(0x7f06e00c8770 msgr2=0x7f06e0155460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 shutdown_connections 2024-04-25T15:54:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:37.472+0000 7f06e5b3d640 1 -- 172.21.15.87:0/1103832185 wait complete. 2024-04-25T15:54:37.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:54:09.584331+0000', 'modified': '2024-04-25T15:54:13.695809+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6837/2324940240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6835', 'nonce': 2324940240}, {'type': 'v1', 'addr': '172.21.15.87:6837', 'nonce': 2324940240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4266, 'qdb_cluster': [4266]} 2024-04-25T15:54:37.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:54:37.898 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:54:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 Processor -- start 2024-04-25T15:54:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 -- start start 2024-04-25T15:54:38.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ce01518b0 0x7f1ce006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce00ad160 0x7f1ce00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce0154fc0 con 0x7f1ce00c4620 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce006ed60 con 0x7f1ce01518b0 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1ce4a63640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce00acb20 con 0x7f1ce00ad160 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1cde59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ce01518b0 0x7f1ce006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1cde59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ce01518b0 0x7f1ce006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35264/0 (socket says 172.21.15.87:35264) 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.056+0000 7f1cde59c640 1 -- 172.21.15.87:0/1995171049 learned_addr learned my addr 172.21.15.87:0/1995171049 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cde59c640 1 -- 172.21.15.87:0/1995171049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce00ad160 msgr2=0x7f1ce00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cde59c640 1 --2- 172.21.15.87:0/1995171049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce00ad160 0x7f1ce00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cde59c640 1 -- 172.21.15.87:0/1995171049 >> v1:172.21.15.155:6789/0 conn(0x7f1ce00c4620 legacy=0x7f1ce0157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cde59c640 1 -- 172.21.15.87:0/1995171049 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00ace00 con 0x7f1ce01518b0 2024-04-25T15:54:38.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cde59c640 1 --2- 172.21.15.87:0/1995171049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce01518b0 0x7f1ce006f4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beefcab7e60f923b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cddd9b640 1 -- 172.21.15.87:0/1995171049 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00aa660 con 0x7f1ce01518b0 2024-04-25T15:54:38.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cddd9b640 1 -- 172.21.15.87:0/1995171049 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00af070 con 0x7f1ce01518b0 2024-04-25T15:54:38.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1cddd9b640 1 -- 172.21.15.87:0/1995171049 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00aaa20 con 0x7f1ce01518b0 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 -- 172.21.15.87:0/1995171049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce01518b0 msgr2=0x7f1ce006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/1995171049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce01518b0 0x7f1ce006f4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd001c520 comp rx=0 tx=0).stop 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 -- 172.21.15.87:0/1995171049 shutdown_connections 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/1995171049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce00ad160 0x7f1ce00c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/1995171049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce01518b0 0x7f1ce006f4d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 -- 172.21.15.87:0/1995171049 >> 172.21.15.87:0/1995171049 conn(0x7f1ce00c8770 msgr2=0x7f1ce00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 -- 172.21.15.87:0/1995171049 shutdown_connections 2024-04-25T15:54:38.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.060+0000 7f1ce4a63640 1 -- 172.21.15.87:0/1995171049 wait complete. 2024-04-25T15:54:38.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 Processor -- start 2024-04-25T15:54:38.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 -- start start 2024-04-25T15:54:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 0x7f1ce014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ce00c4620 0x7f1ce00be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce01518b0 0x7f1ce0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce015fdd0 con 0x7f1ce00ad160 2024-04-25T15:54:38.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce015fc50 con 0x7f1ce00c4620 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce015ff50 con 0x7f1ce01518b0 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 0x7f1ce014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 0x7f1ce014a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35280/0 (socket says 172.21.15.87:35280) 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 -- 172.21.15.87:0/4185362206 learned_addr learned my addr 172.21.15.87:0/4185362206 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cded9d640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce01518b0 0x7f1ce0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ce00c4620 0x7f1ce00be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 -- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce01518b0 msgr2=0x7f1ce0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce01518b0 0x7f1ce0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 -- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ce00c4620 msgr2=0x7f1ce00be2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ce00c4620 0x7f1ce00be2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 -- 172.21.15.87:0/4185362206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce014f890 con 0x7f1ce00ad160 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ce00c4620 0x7f1ce00be2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cded9d640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce01518b0 0x7f1ce0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cde59c640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 0x7f1ce014a320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00ac040 tx=0x7f1cd001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cd77fe640 1 -- 172.21.15.87:0/4185362206 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00b3800 con 0x7f1ce00ad160 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cd77fe640 1 -- 172.21.15.87:0/4185362206 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00b39c0 con 0x7f1ce00ad160 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce0157010 con 0x7f1ce00ad160 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1cd77fe640 1 -- 172.21.15.87:0/4185362206 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00b3db0 con 0x7f1ce00ad160 2024-04-25T15:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.064+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce014fe50 con 0x7f1ce00ad160 2024-04-25T15:54:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cd77fe640 1 -- 172.21.15.87:0/4185362206 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1cd00c6390 con 0x7f1ce00ad160 2024-04-25T15:54:38.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cd77fe640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1cc406f430 0x7f1cc4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cd77fe640 1 -- 172.21.15.87:0/4185362206 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1cd0129cf0 con 0x7f1ce00ad160 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1cc406f430 0x7f1cc4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1cc406f430 0x7f1cc4071940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0156920 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 Processor -- start 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 -- start start 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 0x55b5d60fa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fcaea0 0x55b5d60fa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d60f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b5d5fac160 con 0x55b5d5fdec20 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5d5f41e20 con 0x55b5d5fcaea0 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5d5efaa20 con 0x55b5d5bc3280 2024-04-25T15:54:38.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 0x55b5d60fa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 0x55b5d60fa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35290/0 (socket says 172.21.15.87:35290) 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cde59c640 1 -- 172.21.15.87:0/3960319280 learned_addr learned my addr 172.21.15.87:0/3960319280 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.068+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fcaea0 0x55b5d60fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 -- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 msgr2=0x55b5d60f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d60f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 -- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fcaea0 msgr2=0x55b5d60fa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fcaea0 0x55b5d60fa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 -- 172.21.15.87:0/3960319280 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d5eff100 con 0x55b5d5fdec20 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fcaea0 0x55b5d60fa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 0x55b5d60fa320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cd001ca00 tx=0x7f1cd00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9922712163db40ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1ccffff640 1 -- 172.21.15.87:0/3960319280 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00f5e70 con 0x55b5d5fdec20 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1ccffff640 1 -- 172.21.15.87:0/3960319280 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00af050 con 0x55b5d5fdec20 2024-04-25T15:54:38.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1ccffff640 1 -- 172.21.15.87:0/3960319280 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00f5800 con 0x55b5d5fdec20 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- 172.21.15.87:0/3960319280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 msgr2=0x55b5d60fa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 0x55b5d60fa320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cd001ca00 tx=0x7f1cd00192c0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- 172.21.15.87:0/3960319280 shutdown_connections 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d60f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fcaea0 0x55b5d60fa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/3960319280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fdec20 0x55b5d60fa320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- 172.21.15.87:0/3960319280 >> 172.21.15.87:0/3960319280 conn(0x55b5d5c02ff0 msgr2=0x55b5d6131020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- 172.21.15.87:0/3960319280 shutdown_connections 2024-04-25T15:54:38.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- 172.21.15.87:0/3960319280 wait complete. 2024-04-25T15:54:38.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- start start 2024-04-25T15:54:38.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 Processor -- start 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5bc3280 0x55b5d61313e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d6131920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fdec20 0x55b5d613cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b5d5fac160 con 0x55b5d5fcaea0 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5d5ee5ea0 con 0x55b5d5bc3280 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5d5f3cb00 con 0x55b5d5fdec20 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cebdc0000 10 client.0 _ll_register_callbacks cb 0x55b5d5f4edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d6131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d6131920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35300/0 (socket says 172.21.15.87:35300) 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/2106955275 learned_addr learned my addr 172.21.15.87:0/2106955275 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cde59c640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5bc3280 0x55b5d61313e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cded9d640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fdec20 0x55b5d613cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fdec20 msgr2=0x55b5d613cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fdec20 0x55b5d613cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5bc3280 msgr2=0x55b5d61313e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5bc3280 0x55b5d61313e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/2106955275 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d5ee1500 con 0x55b5d5fcaea0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.072+0000 7f1cded9d640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fdec20 0x55b5d613cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d6131920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800cee0 tx=0x7f1cc80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19bb46d8458f386 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/2106955275 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80117e0 con 0x55b5d5fcaea0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/2106955275 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1cc8011980 con 0x55b5d5fcaea0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd00af050 con 0x55b5d5fcaea0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/2106955275 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f1cc802b050 con 0x55b5d5fcaea0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 10 client.4815 fetch_fsmap learned FSMap version 15 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55b5d5ec7ea0 con 0x55b5d5fcaea0 2024-04-25T15:54:38.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/2106955275 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00af050 con 0x55b5d5fcaea0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/2106955275 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7f1cc802e020 con 0x55b5d5fcaea0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 10 client.4815 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 10 client.4815 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 20 client.4815 populate_metadata read hostname 'smithi087' 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5be77d0 0x55b5d613d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 4 client.4815 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 --> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5d5edabe0 con 0x55b5d5be77d0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cde59c640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5be77d0 0x55b5d613d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 10 client.4815 ms_handle_connect on v2:172.21.15.87:6835/2324940240 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cde59c640 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5be77d0 0x55b5d613d8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75f573a2b35a43b server_cookie=cb41b91562bbb3e in_seq=0 out_seq=0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/2106955275 <== mds.0 v2:172.21.15.87:6835/2324940240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b5d5edabe0 con 0x55b5d5be77d0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 10 client.4815 handle_command_reply: tid=0 2024-04-25T15:54:38.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 client.4815 shutdown 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 msgr2=0x55b5d6131920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d6131920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800cee0 tx=0x7f1cc80046d0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 shutdown_connections 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5be77d0 0x55b5d613d8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fdec20 0x55b5d613cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d6131920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1ccd7fa640 0 client.4815 ms_handle_reset on v2:172.21.15.87:6835/2324940240 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2106955275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5bc3280 0x55b5d61313e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 >> 172.21.15.87:0/2106955275 conn(0x55b5d5c02ff0 msgr2=0x55b5d60f0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 shutdown_connections 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2106955275 wait complete. 2024-04-25T15:54:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.076+0000 7f1cebdc0000 20 client.4815 trim_cache size 0 max 16384 2024-04-25T15:54:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 Processor -- start 2024-04-25T15:54:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- start start 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 0x55b5d614f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fcaea0 0x55b5d6144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d61450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce01fcae0 con 0x55b5d5bc3280 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce01625c0 con 0x55b5d5fdec20 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce01faba0 con 0x55b5d5fcaea0 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 0x55b5d614f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 0x55b5d614f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35316/0 (socket says 172.21.15.87:35316) 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 -- 172.21.15.87:0/2325338266 learned_addr learned my addr 172.21.15.87:0/2325338266 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cded9d640 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d61450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 -- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fcaea0 msgr2=0x55b5d6144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fcaea0 0x55b5d6144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 -- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 msgr2=0x55b5d61450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d61450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 -- 172.21.15.87:0/2325338266 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d5efac70 con 0x55b5d5bc3280 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cded9d640 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d61450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cde59c640 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 0x55b5d614f0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1cd001ca90 tx=0x7f1cd00f8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ee7b9b2233c6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1ccf7fe640 1 -- 172.21.15.87:0/2325338266 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00f6360 con 0x55b5d5bc3280 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1ccf7fe640 1 -- 172.21.15.87:0/2325338266 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00af040 con 0x55b5d5bc3280 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1ccf7fe640 1 -- 172.21.15.87:0/2325338266 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00f57e0 con 0x55b5d5bc3280 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2325338266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 msgr2=0x55b5d614f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 0x55b5d614f0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1cd001ca90 tx=0x7f1cd00f8000 comp rx=0 tx=0).stop 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2325338266 shutdown_connections 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d61450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5fcaea0 0x55b5d6144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/2325338266 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5bc3280 0x55b5d614f0e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2325338266 >> 172.21.15.87:0/2325338266 conn(0x55b5d5c02ff0 msgr2=0x55b5d60f04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2325338266 shutdown_connections 2024-04-25T15:54:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.096+0000 7f1cebdc0000 1 -- 172.21.15.87:0/2325338266 wait complete. 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- start start 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 Processor -- start 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d616fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d616ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d6170500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55b5d5f41130 con 0x55b5d5fcaea0 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5d5ed77d0 con 0x55b5d5fdec20 2024-04-25T15:54:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5d5f4e0c0 con 0x55b5d5bc3280 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 10 client.0 _ll_register_callbacks cb 0x7f1cc800a460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d616ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d616ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35322/0 (socket says 172.21.15.87:35322) 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/771569507 learned_addr learned my addr 172.21.15.87:0/771569507 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cde59c640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d616fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 msgr2=0x55b5d616fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cded9d640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d6170500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d616fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 msgr2=0x55b5d6170500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d6170500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 -- 172.21.15.87:0/771569507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d5fc4180 con 0x55b5d5fcaea0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cded9d640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d6170500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cd5d9b640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d616ffc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8004710 tx=0x7f1cc8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64da32014eaaa6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-04-25T15:54:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/771569507 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8011a70 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/771569507 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1cc8026350 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd00af040 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/771569507 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f1cc8026550 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 10 client.4821 fetch_fsmap learned FSMap version 15 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55b5d5bfb0c0 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/771569507 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00af040 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/771569507 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7f1cc802e050 con 0x55b5d5fcaea0 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 10 client.4821 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 10 client.4821 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 20 client.4821 populate_metadata read hostname 'smithi087' 2024-04-25T15:54:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5bd5830 0x55b5d6170a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 4 client.4821 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 --> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] -- command(tid 0: {"prefix": "status"}) -- 0x55b5d613cec0 con 0x55b5d5bd5830 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cde59c640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5bd5830 0x55b5d6170a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 10 client.4821 ms_handle_connect on v2:172.21.15.87:6835/2324940240 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cde59c640 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5bd5830 0x55b5d6170a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26aa125634c2daa server_cookie=c628c6102526cc60 in_seq=0 out_seq=0 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 1 -- 172.21.15.87:0/771569507 <== mds.0 v2:172.21.15.87:6835/2324940240 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55b5d613cec0 con 0x55b5d5bd5830 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1ccd7fa640 10 client.4821 handle_command_reply: tid=0 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 client.4821 shutdown 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.100+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 msgr2=0x55b5d616ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d616ffc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8004710 tx=0x7f1cc8011e90 comp rx=0 tx=0).stop 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 shutdown_connections 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:6835/2324940240,v1:172.21.15.87:6837/2324940240] conn(0x55b5d5bd5830 0x55b5d6170a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5d5fdec20 0x55b5d6170500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55b5d5fcaea0 0x55b5d616ffc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ccd7fa640 0 client.4821 ms_handle_reset on v2:172.21.15.87:6835/2324940240 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 --2- 172.21.15.87:0/771569507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5d5bc3280 0x55b5d616fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 >> 172.21.15.87:0/771569507 conn(0x55b5d5c02ff0 msgr2=0x55b5d60f0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 shutdown_connections 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 1 -- 172.21.15.87:0/771569507 wait complete. 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1cebdc0000 20 client.4821 trim_cache size 0 max 16384 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "527c0db7-6346-492d-a157-2cd52d90e62b", 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4266, 2024-04-25T15:54:38.110 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "a", 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 27.885793617000001, 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 9, 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 24, 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 35.208549259000002 2024-04-25T15:54:38.111 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1cc406f430 msgr2=0x7f1cc4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1cc406f430 0x7f1cc4071940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0156920 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 msgr2=0x7f1ce014a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 0x7f1ce014a320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00ac040 tx=0x7f1cd001ad60 comp rx=0 tx=0).stop 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 shutdown_connections 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1cc406f430 0x7f1cc4071940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ce01518b0 0x7f1ce0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ce00c4620 0x7f1ce00be2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 --2- 172.21.15.87:0/4185362206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce00ad160 0x7f1ce014a320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 >> 172.21.15.87:0/4185362206 conn(0x7f1ce00c8770 msgr2=0x7f1ce00c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 shutdown_connections 2024-04-25T15:54:38.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.104+0000 7f1ce4a63640 1 -- 172.21.15.87:0/4185362206 wait complete. 2024-04-25T15:54:38.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:38.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:38.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:38.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.248+0000 7ff3e9f17640 1 Processor -- start 2024-04-25T15:54:38.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.248+0000 7ff3e9f17640 1 -- start start 2024-04-25T15:54:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e9f17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3e406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e9f17640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e4154fc0 con 0x7ff3e406fa10 2024-04-25T15:54:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e9f17640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e40acb20 con 0x7ff3e40ad160 2024-04-25T15:54:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e9f17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e406ed60 con 0x7ff3e41518b0 2024-04-25T15:54:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e3fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff3e406fa10 0x7ff3e415e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54872/0 (socket says 172.21.15.87:54872) 2024-04-25T15:54:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e3fff640 1 -- 172.21.15.87:0/376843018 learned_addr learned my addr 172.21.15.87:0/376843018 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681356664 0 0) 0x7ff3e4154fc0 con 0x7ff3e406fa10 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3cc005740 con 0x7ff3e406fa10 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3e406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 670589127 0 0) 0x7ff3cc005740 con 0x7ff3e406fa10 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 msgr2=0x7ff3e406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3e406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 >> v1:172.21.15.155:6789/0 conn(0x7ff3e40ad160 legacy=0x7ff3e40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e40ace00 con 0x7ff3e406fa10 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ff3dc001a00 con 0x7ff3e406fa10 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3e406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 >> v1:172.21.15.87:6789/0 conn(0x7ff3e406fa10 legacy=0x7ff3e415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3cc005c00 0x7ff3cc006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc006a20 0x7ff3cc006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3cc0074b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e406ed60 con 0x7ff3cc005c00 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc00dda0 con 0x7ff3cc006a20 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc00dfa0 con 0x7ff3e41518b0 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3cc005c00 0x7ff3cc006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e3fff640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3cc0074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e2ffd640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc006a20 0x7ff3cc006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 -- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 msgr2=0x7ff3cc0074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3cc0074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 -- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc006a20 msgr2=0x7ff3cc006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc006a20 0x7ff3cc006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 -- 172.21.15.87:0/376843018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc005740 con 0x7ff3cc005c00 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e3fff640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41518b0 0x7ff3cc0074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e2ffd640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc006a20 0x7ff3cc006e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3cc005c00 0x7ff3cc006070 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098a0 tx=0x7ff3d401c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97c2e2ce989cf95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400f040 con 0x7ff3cc005c00 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d40b0070 con 0x7ff3cc005c00 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.252+0000 7ff3e27fc640 1 -- 172.21.15.87:0/376843018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40ab830 con 0x7ff3cc005c00 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- 172.21.15.87:0/376843018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3cc005c00 msgr2=0x7ff3cc006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/376843018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3cc005c00 0x7ff3cc006070 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098a0 tx=0x7ff3d401c5b0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 -- 172.21.15.87:0/376843018 reap_dead start 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- 172.21.15.87:0/376843018 shutdown_connections 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- 172.21.15.87:0/376843018 >> 172.21.15.87:0/376843018 conn(0x7ff3e40c8770 msgr2=0x7ff3e40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- 172.21.15.87:0/376843018 shutdown_connections 2024-04-25T15:54:38.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- 172.21.15.87:0/376843018 wait complete. 2024-04-25T15:54:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 Processor -- start 2024-04-25T15:54:38.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- start start 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc005c00 0x7ff3e4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41e0b70 0x7ff3e41e0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 0x7ff3e414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40c3930 con 0x7ff3e414eb70 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40c37b0 con 0x7ff3cc005c00 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e9f17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e40c3ab0 con 0x7ff3e41e0b70 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 0x7ff3e414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 0x7ff3e414ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35338/0 (socket says 172.21.15.87:35338) 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 -- 172.21.15.87:0/3123223336 learned_addr learned my addr 172.21.15.87:0/3123223336 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc005c00 0x7ff3e4157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e2ffd640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41e0b70 0x7ff3e41e0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 -- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41e0b70 msgr2=0x7ff3e41e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41e0b70 0x7ff3e41e0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 -- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc005c00 msgr2=0x7ff3e4157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc005c00 0x7ff3e4157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.256+0000 7ff3e3fff640 1 -- 172.21.15.87:0/3123223336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e414f4c0 con 0x7ff3e414eb70 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3e3fff640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 0x7ff3e414ef80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40ae910 tx=0x7ff3dc00df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00b860 con 0x7ff3e414eb70 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc00ba20 con 0x7ff3e414eb70 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e41f4fe0 con 0x7ff3e414eb70 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00be10 con 0x7ff3e414eb70 2024-04-25T15:54:38.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e41f4d00 con 0x7ff3e414eb70 2024-04-25T15:54:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e4069bb0 con 0x7ff3e414eb70 2024-04-25T15:54:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3dc01b020 con 0x7ff3e414eb70 2024-04-25T15:54:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3cbfff640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3d006f400 0x7ff3d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3d006f400 0x7ff3d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff3dc08f6a0 con 0x7ff3e414eb70 2024-04-25T15:54:38.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.260+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3d006f400 0x7ff3d0071910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40af000 tx=0x7ff3d40046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.264+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3dc05c260 con 0x7ff3e414eb70 2024-04-25T15:54:38.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.420+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3e40abfa0 con 0x7ff3e414eb70 2024-04-25T15:54:38.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.420+0000 7ff3cbfff640 1 -- 172.21.15.87:0/3123223336 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7ff3dc05bb60 con 0x7ff3e414eb70 2024-04-25T15:54:38.424 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:38.424 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3d006f400 msgr2=0x7ff3d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3d006f400 0x7ff3d0071910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40af000 tx=0x7ff3d40046d0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 msgr2=0x7ff3e414ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 0x7ff3e414ef80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40ae910 tx=0x7ff3dc00df50 comp rx=0 tx=0).stop 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 shutdown_connections 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3d006f400 0x7ff3d0071910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3e414eb70 0x7ff3e414ef80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e41e0b70 0x7ff3e41e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 --2- 172.21.15.87:0/3123223336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3cc005c00 0x7ff3e4157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 >> 172.21.15.87:0/3123223336 conn(0x7ff3e40c8770 msgr2=0x7ff3e40adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 shutdown_connections 2024-04-25T15:54:38.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.424+0000 7ff3e9f17640 1 -- 172.21.15.87:0/3123223336 wait complete. 2024-04-25T15:54:38.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:38.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:38.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.636+0000 7fccb9f48640 1 Processor -- start 2024-04-25T15:54:38.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.636+0000 7fccb9f48640 1 -- start start 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb9f48640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fccb4152820 0x7fccb4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb9f48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 0x7fccb40744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb9f48640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb40a9e00 con 0x7fccb40c9b60 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb9f48640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fccb4155900 con 0x7fccb4152820 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb9f48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fccb40c8e20 con 0x7fccb40740a0 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fccb40c9b60 0x7fccb40c8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54886/0 (socket says 172.21.15.87:54886) 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb37fe640 1 -- 172.21.15.87:0/3284101286 learned_addr learned my addr 172.21.15.87:0/3284101286 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb2ffd640 1 --2- 172.21.15.87:0/3284101286 >> v2:172.21.15.155:3300/0 conn(0x7fccb4152820 0x7fccb4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 0x7fccb40744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508069380 0 0) 0x7fccb40a9e00 con 0x7fccb40c9b60 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca0003530 con 0x7fccb40c9b60 2024-04-25T15:54:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2819698777 0 0) 0x7fcca0003530 con 0x7fccb40c9b60 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 msgr2=0x7fccb40744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 0x7fccb40744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 >> v2:172.21.15.155:3300/0 conn(0x7fccb4152820 msgr2=0x7fccb4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 --2- 172.21.15.87:0/3284101286 >> v2:172.21.15.155:3300/0 conn(0x7fccb4152820 0x7fccb4155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb41552b0 con 0x7fccb40c9b60 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fccac001680 con 0x7fccb40c9b60 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 >> v1:172.21.15.87:6789/0 conn(0x7fccb40c9b60 legacy=0x7fccb40c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca00039c0 0x7fcca0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 0x7fcca0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0004d50 0x7fcca0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fccb4155900 con 0x7fcca0004d50 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fccb40c8e20 con 0x7fcca00039c0 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcca000bb30 con 0x7fccb40740a0 2024-04-25T15:54:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0004d50 0x7fcca0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb37fe640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca00039c0 0x7fcca0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb2ffd640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 0x7fcca0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 -- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 msgr2=0x7fcca0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb40740a0 0x7fcca0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 -- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca00039c0 msgr2=0x7fcca0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca00039c0 0x7fcca0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb3fff640 1 -- 172.21.15.87:0/3284101286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca0003530 con 0x7fcca0004d50 2024-04-25T15:54:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.640+0000 7fccb37fe640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca00039c0 0x7fcca0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:38.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb3fff640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0004d50 0x7fcca0005160 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009fc0 tx=0x7fcca401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfd2b8eae7b9362 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2070 con 0x7fcca0004d50 2024-04-25T15:54:38.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40a5a90 con 0x7fcca0004d50 2024-04-25T15:54:38.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb27fc640 1 -- 172.21.15.87:0/3284101286 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009c10 con 0x7fcca0004d50 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb9f48640 1 -- 172.21.15.87:0/3284101286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0004d50 msgr2=0x7fcca0005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb9f48640 1 --2- 172.21.15.87:0/3284101286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcca0004d50 0x7fcca0005160 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009fc0 tx=0x7fcca401cca0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb3fff640 1 -- 172.21.15.87:0/3284101286 reap_dead start 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb9f48640 1 -- 172.21.15.87:0/3284101286 shutdown_connections 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb9f48640 1 -- 172.21.15.87:0/3284101286 >> 172.21.15.87:0/3284101286 conn(0x7fccb40ac5c0 msgr2=0x7fccb40ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb9f48640 1 -- 172.21.15.87:0/3284101286 shutdown_connections 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.644+0000 7fccb9f48640 1 -- 172.21.15.87:0/3284101286 wait complete. 2024-04-25T15:54:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 Processor -- start 2024-04-25T15:54:38.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- start start 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 0x7fccb4157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb415bcf0 0x7fccb41563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb41580a0 0x7fccb41568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fccb41604b0 con 0x7fccb415b8e0 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fccb4160330 con 0x7fccb41580a0 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fccb4160630 con 0x7fccb415bcf0 2024-04-25T15:54:38.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 0x7fccb4157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 0x7fccb4157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35350/0 (socket says 172.21.15.87:35350) 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 -- 172.21.15.87:0/2661736858 learned_addr learned my addr 172.21.15.87:0/2661736858 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb2ffd640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb415bcf0 0x7fccb41563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb3fff640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb41580a0 0x7fccb41568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 -- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb415bcf0 msgr2=0x7fccb41563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb415bcf0 0x7fccb41563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 -- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb41580a0 msgr2=0x7fccb41568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb41580a0 0x7fccb41568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 -- 172.21.15.87:0/2661736858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb41f2640 con 0x7fccb415b8e0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb37fe640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 0x7fccb4157b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fccac000c10 tx=0x7fccac00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac00ee60 con 0x7fccb415b8e0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac018070 con 0x7fccb415b8e0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb41f2920 con 0x7fccb415b8e0 2024-04-25T15:54:38.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac00ca40 con 0x7fccb415b8e0 2024-04-25T15:54:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb414f7a0 con 0x7fccb415b8e0 2024-04-25T15:54:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.648+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb414f2b0 con 0x7fccb415b8e0 2024-04-25T15:54:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.652+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fccac00cbe0 con 0x7fccb415b8e0 2024-04-25T15:54:38.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.652+0000 7fccabfff640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcc9406f400 0x7fcc94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.652+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fccac08f370 con 0x7fccb415b8e0 2024-04-25T15:54:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.652+0000 7fccb2ffd640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcc9406f400 0x7fcc94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.652+0000 7fccb2ffd640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcc9406f400 0x7fcc94071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fccb40cb850 tx=0x7fcc9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.656+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fccac05c050 con 0x7fccb415b8e0 2024-04-25T15:54:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fccb40c9940 con 0x7fccb415b8e0 2024-04-25T15:54:38.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccabfff640 1 -- 172.21.15.87:0/2661736858 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fccac064040 con 0x7fccb415b8e0 2024-04-25T15:54:38.813 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:38.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcc9406f400 msgr2=0x7fcc94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcc9406f400 0x7fcc94071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fccb40cb850 tx=0x7fcc9c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 msgr2=0x7fccb4157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 0x7fccb4157b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fccac000c10 tx=0x7fccac00ec10 comp rx=0 tx=0).stop 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 shutdown_connections 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcc9406f400 0x7fcc94071910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb41580a0 0x7fccb41568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccb415bcf0 0x7fccb41563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 --2- 172.21.15.87:0/2661736858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb415b8e0 0x7fccb4157b60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 >> 172.21.15.87:0/2661736858 conn(0x7fccb40ac5c0 msgr2=0x7fccb4071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 shutdown_connections 2024-04-25T15:54:38.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.812+0000 7fccb9f48640 1 -- 172.21.15.87:0/2661736858 wait complete. 2024-04-25T15:54:38.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:38.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 Processor -- start 2024-04-25T15:54:38.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 -- start start 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f54081529a0 0x7f5408071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54080ad990 0x7f54080adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5408072430 con 0x7f54080c41e0 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5408074730 con 0x7f54081529a0 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f540dc9d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5408074a10 con 0x7f54080ad990 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f54077fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f54081529a0 0x7f5408071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f5407fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f54080c41e0 0x7f54080c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54896/0 (socket says 172.21.15.87:54896) 2024-04-25T15:54:38.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f5407fff640 1 -- 172.21.15.87:0/3164374219 learned_addr learned my addr 172.21.15.87:0/3164374219 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f5406ffd640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54080ad990 0x7f54080adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f54077fe640 1 -- 172.21.15.87:0/3164374219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54080ad990 msgr2=0x7f54080adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f54077fe640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54080ad990 0x7f54080adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f54077fe640 1 -- 172.21.15.87:0/3164374219 >> v1:172.21.15.87:6789/0 conn(0x7f54080c41e0 legacy=0x7f54080c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f54067fc640 1 -- 172.21.15.87:0/3164374219 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010962680 0 0) 0x7f5408072430 con 0x7f54080c41e0 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f54077fe640 1 -- 172.21.15.87:0/3164374219 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5408074cf0 con 0x7f54081529a0 2024-04-25T15:54:38.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.972+0000 7f5406ffd640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54080ad990 0x7f54080adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:38.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f54077fe640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54081529a0 0x7f5408071e50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f53f80097c0 tx=0x7f53f801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e598ac717f1189 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f54067fc640 1 -- 172.21.15.87:0/3164374219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f80b0070 con 0x7f54081529a0 2024-04-25T15:54:38.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f54067fc640 1 -- 172.21.15.87:0/3164374219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f80ab600 con 0x7f54081529a0 2024-04-25T15:54:38.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f54067fc640 1 -- 172.21.15.87:0/3164374219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f80ab9d0 con 0x7f54081529a0 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 -- 172.21.15.87:0/3164374219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54081529a0 msgr2=0x7f5408071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54081529a0 0x7f5408071e50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f53f80097c0 tx=0x7f53f801c410 comp rx=0 tx=0).stop 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 -- 172.21.15.87:0/3164374219 shutdown_connections 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54080ad990 0x7f54080adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 --2- 172.21.15.87:0/3164374219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54081529a0 0x7f5408071e50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 -- 172.21.15.87:0/3164374219 >> 172.21.15.87:0/3164374219 conn(0x7f54080c8770 msgr2=0x7f54080c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 -- 172.21.15.87:0/3164374219 shutdown_connections 2024-04-25T15:54:38.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 -- 172.21.15.87:0/3164374219 wait complete. 2024-04-25T15:54:38.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 Processor -- start 2024-04-25T15:54:38.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.976+0000 7f540dc9d640 1 -- start start 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54080ad990 0x7f540814bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 0x7f5408151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54081529a0 0x7f540814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5408162470 con 0x7f54080c41e0 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f54081622f0 con 0x7f54080ad990 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f54081625f0 con 0x7f54081529a0 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 0x7f5408151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 0x7f5408151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35374/0 (socket says 172.21.15.87:35374) 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 -- 172.21.15.87:0/4255224015 learned_addr learned my addr 172.21.15.87:0/4255224015 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 -- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54081529a0 msgr2=0x7f540814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54081529a0 0x7f540814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f54077fe640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54080ad990 0x7f540814bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 -- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54080ad990 msgr2=0x7f540814bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54080ad990 0x7f540814bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 -- 172.21.15.87:0/4255224015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540814dbd0 con 0x7f54080c41e0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f5406ffd640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 0x7f5408151580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00c820 tx=0x7f53fc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc015070 con 0x7f54080c41e0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc004220 con 0x7f54080c41e0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540814e500 con 0x7f54080c41e0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00ce10 con 0x7f54080c41e0 2024-04-25T15:54:38.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f540814c290 con 0x7f54080c41e0 2024-04-25T15:54:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5408069bb0 con 0x7f54080c41e0 2024-04-25T15:54:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f53fc007830 con 0x7f54080c41e0 2024-04-25T15:54:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f53effff640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f406f400 0x7f53f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f53fc08f330 con 0x7f54080c41e0 2024-04-25T15:54:38.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.980+0000 7f54077fe640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f406f400 0x7f53f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:38.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.984+0000 7f54077fe640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f406f400 0x7f53f4071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53f80ad000 tx=0x7f53f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:38.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:38.988+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f53fc05c010 con 0x7f54080c41e0 2024-04-25T15:54:39.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.132+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f54080c3760 con 0x7f54080c41e0 2024-04-25T15:54:39.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f53effff640 1 -- 172.21.15.87:0/4255224015 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f53fc05b910 con 0x7f54080c41e0 2024-04-25T15:54:39.136 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:39.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f406f400 msgr2=0x7f53f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f406f400 0x7f53f4071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53f80ad000 tx=0x7f53f8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 msgr2=0x7f5408151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 0x7f5408151580 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00c820 tx=0x7f53fc00cce0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 shutdown_connections 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f53f406f400 0x7f53f4071910 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54081529a0 0x7f540814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54080c41e0 0x7f5408151580 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 --2- 172.21.15.87:0/4255224015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54080ad990 0x7f540814bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 >> 172.21.15.87:0/4255224015 conn(0x7f54080c8770 msgr2=0x7f5408155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 shutdown_connections 2024-04-25T15:54:39.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.136+0000 7f540dc9d640 1 -- 172.21.15.87:0/4255224015 wait complete. 2024-04-25T15:54:39.157 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:39.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.300+0000 7f7b2a6af640 1 Processor -- start 2024-04-25T15:54:39.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.300+0000 7f7b2a6af640 1 -- start start 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b2a6af640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b240ad160 0x7f7b240c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b2a6af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 0x7f7b2415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b2a6af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b24154fc0 con 0x7f7b241518b0 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b2a6af640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2406ed60 con 0x7f7b240ad160 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b2a6af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b240acb20 con 0x7f7b240c4620 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7b241518b0 0x7f7b2406f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54908/0 (socket says 172.21.15.87:54908) 2024-04-25T15:54:39.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 -- 172.21.15.87:0/3763380769 learned_addr learned my addr 172.21.15.87:0/3763380769 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b1b7fe640 1 --2- 172.21.15.87:0/3763380769 >> v2:172.21.15.155:3300/0 conn(0x7f7b240ad160 0x7f7b240c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b28c4c640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 0x7f7b2415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828730220 0 0) 0x7f7b24154fc0 con 0x7f7b241518b0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b10003530 con 0x7f7b241518b0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1417427149 0 0) 0x7f7b10003530 con 0x7f7b241518b0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 msgr2=0x7f7b2415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 0x7f7b2415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 >> v2:172.21.15.155:3300/0 conn(0x7f7b240ad160 msgr2=0x7f7b240c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 --2- 172.21.15.87:0/3763380769 >> v2:172.21.15.155:3300/0 conn(0x7f7b240ad160 0x7f7b240c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240ace00 con 0x7f7b241518b0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f7b14001680 con 0x7f7b241518b0 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 >> v1:172.21.15.87:6789/0 conn(0x7f7b241518b0 legacy=0x7f7b2406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b100039c0 0x7f7b10003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 0x7f7b10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b10004d50 0x7f7b10005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2406ed60 con 0x7f7b100039c0 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240acb20 con 0x7f7b10004d50 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1000ba20 con 0x7f7b240c4620 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b100039c0 0x7f7b10003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b1b7fe640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 0x7f7b10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b28c4c640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b10004d50 0x7f7b10005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 -- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 msgr2=0x7f7b10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b240c4620 0x7f7b10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 -- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b10004d50 msgr2=0x7f7b10005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b10004d50 0x7f7b10005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.304+0000 7f7b23fff640 1 -- 172.21.15.87:0/3763380769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b10003530 con 0x7f7b100039c0 2024-04-25T15:54:39.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b23fff640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b100039c0 0x7f7b10003e50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400c210 tx=0x7f7b1401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7896abe3f6e8cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14007d60 con 0x7f7b100039c0 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b140a9020 con 0x7f7b100039c0 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b237fe640 1 -- 172.21.15.87:0/3763380769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14005b20 con 0x7f7b100039c0 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 -- 172.21.15.87:0/3763380769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b100039c0 msgr2=0x7f7b10003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/3763380769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b100039c0 0x7f7b10003e50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400c210 tx=0x7f7b1401cba0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b28c4c640 1 -- 172.21.15.87:0/3763380769 reap_dead start 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 -- 172.21.15.87:0/3763380769 shutdown_connections 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 -- 172.21.15.87:0/3763380769 >> 172.21.15.87:0/3763380769 conn(0x7f7b240c8770 msgr2=0x7f7b240c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 -- 172.21.15.87:0/3763380769 shutdown_connections 2024-04-25T15:54:39.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 -- 172.21.15.87:0/3763380769 wait complete. 2024-04-25T15:54:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.308+0000 7f7b2a6af640 1 Processor -- start 2024-04-25T15:54:39.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- start start 2024-04-25T15:54:39.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b100039c0 0x7f7b24159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2415b510 0x7f7b24158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 0x7f7b2414aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2415f1c0 con 0x7f7b240c2740 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2415f340 con 0x7f7b2415b510 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2415f4c0 con 0x7f7b100039c0 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 0x7f7b2414aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 0x7f7b2414aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35400/0 (socket says 172.21.15.87:35400) 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 -- 172.21.15.87:0/506851132 learned_addr learned my addr 172.21.15.87:0/506851132 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b1b7fe640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2415b510 0x7f7b24158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b23fff640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b100039c0 0x7f7b24159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 -- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b100039c0 msgr2=0x7f7b24159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b100039c0 0x7f7b24159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 -- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2415b510 msgr2=0x7f7b24158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2415b510 0x7f7b24158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 -- 172.21.15.87:0/506851132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240c1bd0 con 0x7f7b240c2740 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b28c4c640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 0x7f7b2414aa10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7b240ae910 tx=0x7f7b1c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c011e40 con 0x7f7b240c2740 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c01b070 con 0x7f7b240c2740 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b24158450 con 0x7f7b240c2740 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0039a0 con 0x7f7b240c2740 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b24152f60 con 0x7f7b240c2740 2024-04-25T15:54:39.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.312+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b24069bb0 con 0x7f7b240c2740 2024-04-25T15:54:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.316+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7b1c003b40 con 0x7f7b240c2740 2024-04-25T15:54:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.316+0000 7f7b217fa640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b0406f400 0x7f7b04071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.316+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7b1c090b30 con 0x7f7b240c2740 2024-04-25T15:54:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.316+0000 7f7b23fff640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b0406f400 0x7f7b04071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.316+0000 7f7b23fff640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b0406f400 0x7f7b04071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b140aa000 tx=0x7f7b14000ff0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.320+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b1c025020 con 0x7f7b240c2740 2024-04-25T15:54:39.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f7b240c2c80 con 0x7f7b240c2740 2024-04-25T15:54:39.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b217fa640 1 -- 172.21.15.87:0/506851132 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f7b240c1bd0 con 0x7f7b240c2740 2024-04-25T15:54:39.469 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b0406f400 msgr2=0x7f7b04071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b0406f400 0x7f7b04071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b140aa000 tx=0x7f7b14000ff0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 msgr2=0x7f7b2414aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 0x7f7b2414aa10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7b240ae910 tx=0x7f7b1c0115a0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 shutdown_connections 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7b0406f400 0x7f7b04071910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b240c2740 0x7f7b2414aa10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2415b510 0x7f7b24158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 --2- 172.21.15.87:0/506851132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b100039c0 0x7f7b24159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 >> 172.21.15.87:0/506851132 conn(0x7f7b240c8770 msgr2=0x7f7b240c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 shutdown_connections 2024-04-25T15:54:39.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.468+0000 7f7b2a6af640 1 -- 172.21.15.87:0/506851132 wait complete. 2024-04-25T15:54:39.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 Processor -- start 2024-04-25T15:54:39.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 -- start start 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b415b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62b415b580 0x7f62b4161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b40c5120 con 0x7f62b40c4250 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f62b40c3b20 con 0x7f62b415b580 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62bb863640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62b4070e20 con 0x7f62b415ac30 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62b415b580 0x7f62b4161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62b415b580 0x7f62b4161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35414/0 (socket says 172.21.15.87:35414) 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 -- 172.21.15.87:0/209548682 learned_addr learned my addr 172.21.15.87:0/209548682 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b95ff640 1 --1- 172.21.15.87:0/209548682 >> v1:172.21.15.87:6789/0 conn(0x7f62b40c4250 0x7f62b406ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54916/0 (socket says 172.21.15.87:54916) 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 -- 172.21.15.87:0/209548682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 msgr2=0x7f62b415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 --2- 172.21.15.87:0/209548682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 -- 172.21.15.87:0/209548682 >> v1:172.21.15.87:6789/0 conn(0x7f62b40c4250 legacy=0x7f62b406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62abfff640 1 -- 172.21.15.87:0/209548682 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513963164 0 0) 0x7f62b0001120 con 0x7f62b40c4250 2024-04-25T15:54:39.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.628+0000 7f62b9e00640 1 -- 172.21.15.87:0/209548682 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b40c4b60 con 0x7f62b415b580 2024-04-25T15:54:39.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62b9e00640 1 --2- 172.21.15.87:0/209548682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b4161e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e50 tx=0x7f62ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904e35fabc3d2979 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62abfff640 1 -- 172.21.15.87:0/209548682 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a5750 con 0x7f62b415b580 2024-04-25T15:54:39.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62abfff640 1 -- 172.21.15.87:0/209548682 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ac0a58f0 con 0x7f62b415b580 2024-04-25T15:54:39.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62abfff640 1 -- 172.21.15.87:0/209548682 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a5cc0 con 0x7f62b415b580 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 -- 172.21.15.87:0/209548682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 msgr2=0x7f62b4161e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 --2- 172.21.15.87:0/209548682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b4161e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009e50 tx=0x7f62ac01c9a0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 -- 172.21.15.87:0/209548682 shutdown_connections 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 --2- 172.21.15.87:0/209548682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b4161e60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 --2- 172.21.15.87:0/209548682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 -- 172.21.15.87:0/209548682 >> 172.21.15.87:0/209548682 conn(0x7f62b406d780 msgr2=0x7f62b406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 -- 172.21.15.87:0/209548682 shutdown_connections 2024-04-25T15:54:39.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 -- 172.21.15.87:0/209548682 wait complete. 2024-04-25T15:54:39.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 Processor -- start 2024-04-25T15:54:39.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.632+0000 7f62bb863640 1 -- start start 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b40c4250 0x7f62b41f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b41493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40c47e0 con 0x7f62b415b580 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62b40c4660 con 0x7f62b40c4250 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62b4155100 con 0x7f62b415ac30 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b41493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b41493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35416/0 (socket says 172.21.15.87:35416) 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 -- 172.21.15.87:0/1192466264 learned_addr learned my addr 172.21.15.87:0/1192466264 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b8dfe640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b95ff640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b40c4250 0x7f62b41f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 -- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 msgr2=0x7f62b414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b414a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 -- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b40c4250 msgr2=0x7f62b41f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b40c4250 0x7f62b41f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 -- 172.21.15.87:0/1192466264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b40738d0 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b95ff640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b40c4250 0x7f62b41f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62b9e00640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b41493e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0af040 tx=0x7f62ac019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0bc030 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ac0b8470 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b41f4880 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0b8820 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b4153a00 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b414bca0 con 0x7f62b415b580 2024-04-25T15:54:39.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f62ac0bf070 con 0x7f62b415b580 2024-04-25T15:54:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.636+0000 7f62a9ffb640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f629806f400 0x7f6298071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.640+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f62ac12ad70 con 0x7f62b415b580 2024-04-25T15:54:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.640+0000 7f62b95ff640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f629806f400 0x7f6298071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.640+0000 7f62b95ff640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f629806f400 0x7f6298071910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007fd0 tx=0x7f62b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.644+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62ac016620 con 0x7f62b415b580 2024-04-25T15:54:39.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.788+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f62b40c3540 con 0x7f62b415b580 2024-04-25T15:54:39.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62a9ffb640 1 -- 172.21.15.87:0/1192466264 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f62ac0f7b30 con 0x7f62b415b580 2024-04-25T15:54:39.792 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f629806f400 msgr2=0x7f6298071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f629806f400 0x7f6298071910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007fd0 tx=0x7f62b0009040 comp rx=0 tx=0).stop 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 msgr2=0x7f62b41493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b41493e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0af040 tx=0x7f62ac019740 comp rx=0 tx=0).stop 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 shutdown_connections 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f629806f400 0x7f6298071910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b415b580 0x7f62b41493e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62b415ac30 0x7f62b414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 --2- 172.21.15.87:0/1192466264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b40c4250 0x7f62b41f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 >> 172.21.15.87:0/1192466264 conn(0x7f62b406d780 msgr2=0x7f62b414ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:39.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 shutdown_connections 2024-04-25T15:54:39.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.792+0000 7f62bb863640 1 -- 172.21.15.87:0/1192466264 wait complete. 2024-04-25T15:54:39.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f208470f640 1 Processor -- start 2024-04-25T15:54:39.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f208470f640 1 -- start start 2024-04-25T15:54:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f208470f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f207c161410 0x7f207c163830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f208470f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207c0c7570 con 0x7f207c15ad90 2024-04-25T15:54:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f208470f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207c15b8b0 con 0x7f207c0cb030 2024-04-25T15:54:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f208470f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f207c15b5d0 con 0x7f207c161410 2024-04-25T15:54:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20824ab640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f207c15ad90 0x7f207c0ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54928/0 (socket says 172.21.15.87:54928) 2024-04-25T15:54:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20824ab640 1 -- 172.21.15.87:0/3448824067 learned_addr learned my addr 172.21.15.87:0/3448824067 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f2082cac640 1 --2- 172.21.15.87:0/3448824067 >> v2:172.21.15.155:3300/0 conn(0x7f207c161410 0x7f207c163830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519733569 0 0) 0x7f207c0c7570 con 0x7f207c15ad90 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2068003530 con 0x7f207c15ad90 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3046564513 0 0) 0x7f2068003530 con 0x7f207c15ad90 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 >> v2:172.21.15.155:3300/0 conn(0x7f207c161410 msgr2=0x7f207c163830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20814a9640 1 --2- 172.21.15.87:0/3448824067 >> v2:172.21.15.155:3300/0 conn(0x7f207c161410 0x7f207c163830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.964+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 >> v1:172.21.15.155:6789/0 conn(0x7f207c0cb030 legacy=0x7f207c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c0c2290 con 0x7f207c15ad90 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f2078001680 con 0x7f207c15ad90 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 >> v1:172.21.15.87:6789/0 conn(0x7f207c15ad90 legacy=0x7f207c0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20680039c0 0x7f2068003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2068004810 0x7f2068004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2068005360 0x7f206800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f207c15b5d0 con 0x7f20680039c0 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f206800c290 con 0x7f2068005360 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f206800c490 con 0x7f2068004810 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20680039c0 0x7f2068003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f2081caa640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2068004810 0x7f2068004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 -- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2068004810 msgr2=0x7f2068004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2068004810 0x7f2068004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 -- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2068005360 msgr2=0x7f206800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2068005360 0x7f206800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 -- 172.21.15.87:0/3448824067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2068003530 con 0x7f20680039c0 2024-04-25T15:54:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f2082cac640 1 -- 172.21.15.87:0/3448824067 reap_dead start 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20824ab640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20680039c0 0x7f2068003e30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f207800c1c0 tx=0x7f207801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f177405fd290a77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078007d00 con 0x7f20680039c0 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20780a9020 con 0x7f20680039c0 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f20814a9640 1 -- 172.21.15.87:0/3448824067 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078005ae0 con 0x7f20680039c0 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 -- 172.21.15.87:0/3448824067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20680039c0 msgr2=0x7f2068003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20680039c0 0x7f2068003e30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f207800c1c0 tx=0x7f207801cc60 comp rx=0 tx=0).stop 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 -- 172.21.15.87:0/3448824067 shutdown_connections 2024-04-25T15:54:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 --2- 172.21.15.87:0/3448824067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20680039c0 0x7f2068003e30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 -- 172.21.15.87:0/3448824067 >> 172.21.15.87:0/3448824067 conn(0x7f207c0c9330 msgr2=0x7f207c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 -- 172.21.15.87:0/3448824067 shutdown_connections 2024-04-25T15:54:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.968+0000 7f208470f640 1 -- 172.21.15.87:0/3448824067 wait complete. 2024-04-25T15:54:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 Processor -- start 2024-04-25T15:54:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 -- start start 2024-04-25T15:54:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20680039c0 0x7f207c14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 0x7f207c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f207c0b11c0 0x7f207c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f207c0ca2e0 con 0x7f207c0b0db0 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f207c0ca160 con 0x7f20680039c0 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f207c0cad30 con 0x7f207c0b11c0 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 0x7f207c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 0x7f207c159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35434/0 (socket says 172.21.15.87:35434) 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 -- 172.21.15.87:0/536515952 learned_addr learned my addr 172.21.15.87:0/536515952 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f20824ab640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20680039c0 0x7f207c14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2082cac640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f207c0b11c0 0x7f207c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 -- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f207c0b11c0 msgr2=0x7f207c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f207c0b11c0 0x7f207c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 -- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20680039c0 msgr2=0x7f207c14aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20680039c0 0x7f207c14aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 -- 172.21.15.87:0/536515952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c0b1d80 con 0x7f207c0b0db0 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f20824ab640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20680039c0 0x7f207c14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2081caa640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 0x7f207c159af0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f206c00d4a0 tx=0x7f206c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c005480 con 0x7f207c0b0db0 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c017070 con 0x7f207c0b0db0 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207c14b3f0 con 0x7f207c0b0db0 2024-04-25T15:54:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c003820 con 0x7f207c0b0db0 2024-04-25T15:54:39.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.972+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207c1609f0 con 0x7f207c0b0db0 2024-04-25T15:54:39.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.976+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207c069bb0 con 0x7f207c0b0db0 2024-04-25T15:54:39.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.976+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f206c01c460 con 0x7f207c0b0db0 2024-04-25T15:54:39.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.976+0000 7f2072ffd640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f206006f400 0x7f2060071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:39.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.976+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f206c08fcb0 con 0x7f207c0b0db0 2024-04-25T15:54:39.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.976+0000 7f20824ab640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f206006f400 0x7f2060071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:39.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.976+0000 7f20824ab640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f206006f400 0x7f2060071910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20780aa000 tx=0x7f207c158390 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:39.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:39.980+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f206c05ca70 con 0x7f207c0b0db0 2024-04-25T15:54:40.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.144+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f207c0c7760 con 0x7f207c0b0db0 2024-04-25T15:54:40.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.144+0000 7f2072ffd640 1 -- 172.21.15.87:0/536515952 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f206c05c370 con 0x7f207c0b0db0 2024-04-25T15:54:40.147 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:40.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f206006f400 msgr2=0x7f2060071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f206006f400 0x7f2060071910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20780aa000 tx=0x7f207c158390 comp rx=0 tx=0).stop 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 msgr2=0x7f207c159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 0x7f207c159af0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f206c00d4a0 tx=0x7f206c00d960 comp rx=0 tx=0).stop 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 shutdown_connections 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f206006f400 0x7f2060071910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f207c0b11c0 0x7f207c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f207c0b0db0 0x7f207c159af0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 --2- 172.21.15.87:0/536515952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20680039c0 0x7f207c14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 >> 172.21.15.87:0/536515952 conn(0x7f207c0c9330 msgr2=0x7f207c0ac580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 shutdown_connections 2024-04-25T15:54:40.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.148+0000 7f208470f640 1 -- 172.21.15.87:0/536515952 wait complete. 2024-04-25T15:54:40.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:40.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd171910640 1 Processor -- start 2024-04-25T15:54:40.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd171910640 1 -- start start 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd171910640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd16c0a8cc0 0x7fd16c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd171910640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c152c80 con 0x7fd16c06c670 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd171910640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0ae8e0 con 0x7fd16c152870 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd171910640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd16c0aebc0 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd16c0a8cc0 0x7fd16c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd16c0a8cc0 0x7fd16c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35448/0 (socket says 172.21.15.87:35448) 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16affd640 1 -- 172.21.15.87:0/2656800298 learned_addr learned my addr 172.21.15.87:0/2656800298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd16c06c670 0x7fd16c15fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54940/0 (socket says 172.21.15.87:54940) 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16affd640 1 -- 172.21.15.87:0/2656800298 >> v1:172.21.15.155:6789/0 conn(0x7fd16c152870 legacy=0x7fd16c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:40.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16affd640 1 -- 172.21.15.87:0/2656800298 >> v1:172.21.15.87:6789/0 conn(0x7fd16c06c670 legacy=0x7fd16c15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd16affd640 1 -- 172.21.15.87:0/2656800298 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c1588d0 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.312+0000 7fd169ffb640 1 -- 172.21.15.87:0/2656800298 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615818112 0 0) 0x7fd16c152c80 con 0x7fd16c06c670 2024-04-25T15:54:40.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd16affd640 1 --2- 172.21.15.87:0/2656800298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1593b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009870 tx=0x7fd15c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92da5cc5309a021f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:40.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd169ffb640 1 -- 172.21.15.87:0/2656800298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0b0070 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd169ffb640 1 -- 172.21.15.87:0/2656800298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c0ab600 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd169ffb640 1 -- 172.21.15.87:0/2656800298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0ab9d0 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 -- 172.21.15.87:0/2656800298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 msgr2=0x7fd16c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 --2- 172.21.15.87:0/2656800298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1593b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009870 tx=0x7fd15c01c400 comp rx=0 tx=0).stop 2024-04-25T15:54:40.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 -- 172.21.15.87:0/2656800298 shutdown_connections 2024-04-25T15:54:40.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 --2- 172.21.15.87:0/2656800298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1593b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 -- 172.21.15.87:0/2656800298 >> 172.21.15.87:0/2656800298 conn(0x7fd16c06d780 msgr2=0x7fd16c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:40.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 -- 172.21.15.87:0/2656800298 shutdown_connections 2024-04-25T15:54:40.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.316+0000 7fd171910640 1 -- 172.21.15.87:0/2656800298 wait complete. 2024-04-25T15:54:40.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 Processor -- start 2024-04-25T15:54:40.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- start start 2024-04-25T15:54:40.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd16c06c670 0x7fd16c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd16c152870 0x7fd16c1ef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c163c80 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c163b00 con 0x7fd16c152870 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c163e00 con 0x7fd16c06c670 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35464/0 (socket says 172.21.15.87:35464) 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 -- 172.21.15.87:0/334425497 learned_addr learned my addr 172.21.15.87:0/334425497 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16b7fe640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd16c152870 0x7fd16c1ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16affd640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd16c06c670 0x7fd16c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 -- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd16c06c670 msgr2=0x7fd16c14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd16c06c670 0x7fd16c14dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 -- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd16c152870 msgr2=0x7fd16c1ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd16c152870 0x7fd16c1ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 -- 172.21.15.87:0/334425497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c1f2c70 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd16a7fc640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1473c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd16000b3f0 tx=0x7fd16000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160015020 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd160011830 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c1f2f50 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160011c00 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c1ef210 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.320+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c1ef000 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.324+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd160018020 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.324+0000 7fd153fff640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd15806f400 0x7fd158071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.324+0000 7fd16affd640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd15806f400 0x7fd158071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.324+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd16008f660 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.324+0000 7fd16affd640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd15806f400 0x7fd158071910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0ad000 tx=0x7fd15c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:40.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.328+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd16001f030 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.520+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd16c069bb0 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd153fff640 1 -- 172.21.15.87:0/334425497 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7fd16005c300 con 0x7fd16c0a8cc0 2024-04-25T15:54:40.524 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:40.525 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:40.525 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd15806f400 msgr2=0x7fd158071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd15806f400 0x7fd158071910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0ad000 tx=0x7fd15c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 msgr2=0x7fd16c1473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1473c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd16000b3f0 tx=0x7fd16000b8b0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 shutdown_connections 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd15806f400 0x7fd158071910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd16c152870 0x7fd16c1ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0a8cc0 0x7fd16c1473c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 --2- 172.21.15.87:0/334425497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd16c06c670 0x7fd16c14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 >> 172.21.15.87:0/334425497 conn(0x7fd16c06d780 msgr2=0x7fd16c14a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 shutdown_connections 2024-04-25T15:54:40.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.524+0000 7fd171910640 1 -- 172.21.15.87:0/334425497 wait complete. 2024-04-25T15:54:40.546 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:40.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90fc4d640 1 Processor -- start 2024-04-25T15:54:40.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90fc4d640 1 -- start start 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90fc4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 0x7fa90806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90fc4d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9080add10 con 0x7fa90814d810 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90fc4d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9080adff0 con 0x7fa908154d00 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90fc4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa908157010 con 0x7fa90806f790 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90d9e9640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa90814d810 0x7fa908157810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54948/0 (socket says 172.21.15.87:54948) 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90d9e9640 1 -- 172.21.15.87:0/3597305981 learned_addr learned my addr 172.21.15.87:0/3597305981 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 0x7fa90806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475449236 0 0) 0x7fa9080add10 con 0x7fa90814d810 2024-04-25T15:54:40.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f0003530 con 0x7fa90814d810 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805973748 0 0) 0x7fa9080adff0 con 0x7fa908154d00 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9080add10 con 0x7fa908154d00 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3782484737 0 0) 0x7fa8f0003530 con 0x7fa90814d810 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 msgr2=0x7fa90806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 0x7fa90806fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 >> v1:172.21.15.155:6789/0 conn(0x7fa908154d00 legacy=0x7fa908154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9081572f0 con 0x7fa90814d810 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fa8f8001a00 con 0x7fa90814d810 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 >> v1:172.21.15.87:6789/0 conn(0x7fa90814d810 legacy=0x7fa908157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 0x7fa8f0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8f0004130 0x7fa8f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0004da0 0x7fa8f0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa908157010 con 0x7fa8f0004da0 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f000bcd0 con 0x7fa8f0004130 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f000bed0 con 0x7fa90806f790 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0004da0 0x7fa8f0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90d9e9640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 0x7fa8f0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90d1e8640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8f0004130 0x7fa8f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 -- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 msgr2=0x7fa8f0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa90806f790 0x7fa8f0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 -- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8f0004130 msgr2=0x7fa8f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8f0004130 0x7fa8f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.704+0000 7fa90e1ea640 1 -- 172.21.15.87:0/3597305981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f0003530 con 0x7fa8f0004da0 2024-04-25T15:54:40.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0004da0 0x7fa8f0005230 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa9080c48b0 tx=0x7fa90001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779ee0eb61074985 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:40.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9000096b0 con 0x7fa8f0004da0 2024-04-25T15:54:40.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9000a9410 con 0x7fa8f0004da0 2024-04-25T15:54:40.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90c9e7640 1 -- 172.21.15.87:0/3597305981 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9000a9800 con 0x7fa8f0004da0 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3597305981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0004da0 msgr2=0x7fa8f0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3597305981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f0004da0 0x7fa8f0005230 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa9080c48b0 tx=0x7fa90001ca30 comp rx=0 tx=0).stop 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90e1ea640 1 -- 172.21.15.87:0/3597305981 reap_dead start 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3597305981 shutdown_connections 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3597305981 >> 172.21.15.87:0/3597305981 conn(0x7fa9080c8770 msgr2=0x7fa9080c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3597305981 shutdown_connections 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.708+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3597305981 wait complete. 2024-04-25T15:54:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 Processor -- start 2024-04-25T15:54:40.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- start start 2024-04-25T15:54:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa908164030 0x7fa90815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 0x7fa9081f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9081f49f0 0x7fa9081622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa90815f530 con 0x7fa9081f08a0 2024-04-25T15:54:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa90815f3b0 con 0x7fa908164030 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa90815f6b0 con 0x7fa9081f49f0 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 0x7fa9081f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 0x7fa9081f44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35484/0 (socket says 172.21.15.87:35484) 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 -- 172.21.15.87:0/3164414329 learned_addr learned my addr 172.21.15.87:0/3164414329 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d9e9640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa908164030 0x7fa90815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9081f49f0 0x7fa9081622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 -- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9081f49f0 msgr2=0x7fa9081622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9081f49f0 0x7fa9081622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 -- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa908164030 msgr2=0x7fa90815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa908164030 0x7fa90815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 -- 172.21.15.87:0/3164414329 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90814cb70 con 0x7fa9081f08a0 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90e1ea640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9081f49f0 0x7fa9081622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d9e9640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa908164030 0x7fa90815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90d1e8640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 0x7fa9081f44b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00f7d0 tx=0x7fa8fc00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc01a070 con 0x7fa9081f08a0 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc005110 con 0x7fa9081f08a0 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90814ac20 con 0x7fa9081f08a0 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0067e0 con 0x7fa9081f08a0 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90814a940 con 0x7fa9081f08a0 2024-04-25T15:54:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.712+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa908069bb0 con 0x7fa9081f08a0 2024-04-25T15:54:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.716+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa8fc01d070 con 0x7fa9081f08a0 2024-04-25T15:54:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.716+0000 7fa9067fc640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8f406f400 0x7fa8f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.716+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa8fc08ecf0 con 0x7fa9081f08a0 2024-04-25T15:54:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.716+0000 7fa90d9e9640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8f406f400 0x7fa8f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.716+0000 7fa90d9e9640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8f406f400 0x7fa8f4071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa908073e60 tx=0x7fa8f8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.720+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8fc093070 con 0x7fa9081f08a0 2024-04-25T15:54:40.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.884+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa908151e30 con 0x7fa9081f08a0 2024-04-25T15:54:40.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa9067fc640 1 -- 172.21.15.87:0/3164414329 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7fa8fc05b9d0 con 0x7fa9081f08a0 2024-04-25T15:54:40.890 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:40.890 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:40.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8f406f400 msgr2=0x7fa8f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8f406f400 0x7fa8f4071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa908073e60 tx=0x7fa8f8006040 comp rx=0 tx=0).stop 2024-04-25T15:54:40.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 msgr2=0x7fa9081f44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:40.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 0x7fa9081f44b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00f7d0 tx=0x7fa8fc00fc90 comp rx=0 tx=0).stop 2024-04-25T15:54:40.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 shutdown_connections 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8f406f400 0x7fa8f4071910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9081f49f0 0x7fa9081622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9081f08a0 0x7fa9081f44b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 --2- 172.21.15.87:0/3164414329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa908164030 0x7fa90815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 >> 172.21.15.87:0/3164414329 conn(0x7fa9080c8770 msgr2=0x7fa908072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 shutdown_connections 2024-04-25T15:54:40.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:40.888+0000 7fa90fc4d640 1 -- 172.21.15.87:0/3164414329 wait complete. 2024-04-25T15:54:40.912 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:41.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f48784640 1 Processor -- start 2024-04-25T15:54:41.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f48784640 1 -- start start 2024-04-25T15:54:41.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f48784640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f401529a0 0x7f8f40071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f48784640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f400ae1b0 con 0x7f8f400adda0 2024-04-25T15:54:41.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f48784640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f40072430 con 0x7f8f400ad990 2024-04-25T15:54:41.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f48784640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8f40074730 con 0x7f8f401529a0 2024-04-25T15:54:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46520640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f401529a0 0x7f8f40071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46d21640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8f400adda0 0x7f8f400c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49990/0 (socket says 172.21.15.87:49990) 2024-04-25T15:54:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46520640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f401529a0 0x7f8f40071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40984/0 (socket says 172.21.15.87:40984) 2024-04-25T15:54:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46d21640 1 -- 172.21.15.87:0/2335211216 learned_addr learned my addr 172.21.15.87:0/2335211216 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46520640 1 -- 172.21.15.87:0/2335211216 >> v1:172.21.15.155:6789/0 conn(0x7f8f400ad990 legacy=0x7f8f400c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46520640 1 -- 172.21.15.87:0/2335211216 >> v1:172.21.15.87:6789/0 conn(0x7f8f400adda0 legacy=0x7f8f400c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f46520640 1 -- 172.21.15.87:0/2335211216 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f40074a10 con 0x7f8f401529a0 2024-04-25T15:54:41.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.056+0000 7f8f4551e640 1 -- 172.21.15.87:0/2335211216 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258980985 0 0) 0x7f8f400ae1b0 con 0x7f8f400adda0 2024-04-25T15:54:41.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f46520640 1 --2- 172.21.15.87:0/2335211216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f401529a0 0x7f8f40071e50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f300097c0 tx=0x7f8f3001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8991db466760ce89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f4551e640 1 -- 172.21.15.87:0/2335211216 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300b0070 con 0x7f8f401529a0 2024-04-25T15:54:41.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f4551e640 1 -- 172.21.15.87:0/2335211216 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f300ab600 con 0x7f8f401529a0 2024-04-25T15:54:41.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f4551e640 1 -- 172.21.15.87:0/2335211216 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300ab9d0 con 0x7f8f401529a0 2024-04-25T15:54:41.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 -- 172.21.15.87:0/2335211216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f401529a0 msgr2=0x7f8f40071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 --2- 172.21.15.87:0/2335211216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f401529a0 0x7f8f40071e50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8f300097c0 tx=0x7f8f3001c410 comp rx=0 tx=0).stop 2024-04-25T15:54:41.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 -- 172.21.15.87:0/2335211216 shutdown_connections 2024-04-25T15:54:41.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 --2- 172.21.15.87:0/2335211216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f401529a0 0x7f8f40071e50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 -- 172.21.15.87:0/2335211216 >> 172.21.15.87:0/2335211216 conn(0x7f8f400c8770 msgr2=0x7f8f400c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 -- 172.21.15.87:0/2335211216 shutdown_connections 2024-04-25T15:54:41.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.060+0000 7f8f48784640 1 -- 172.21.15.87:0/2335211216 wait complete. 2024-04-25T15:54:41.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 Processor -- start 2024-04-25T15:54:41.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 -- start start 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f400ad990 0x7f8f400c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 0x7f8f40146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f401529a0 0x7f8f401f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8f40163890 con 0x7f8f400adda0 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f40163710 con 0x7f8f401529a0 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f40163a10 con 0x7f8f400ad990 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 0x7f8f40146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 0x7f8f40146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40986/0 (socket says 172.21.15.87:40986) 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 -- 172.21.15.87:0/3705490334 learned_addr learned my addr 172.21.15.87:0/3705490334 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f46d21640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f401529a0 0x7f8f401f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f46520640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f400ad990 0x7f8f400c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 -- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f400ad990 msgr2=0x7f8f400c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f400ad990 0x7f8f400c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 -- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f401529a0 msgr2=0x7f8f401f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f401529a0 0x7f8f401f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 -- 172.21.15.87:0/3705490334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f400c80a0 con 0x7f8f400adda0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f45d1f640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 0x7f8f40146520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c3f0 tx=0x7f8f3c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c017070 con 0x7f8f400adda0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c0052d0 con 0x7f8f400adda0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f401f2bf0 con 0x7f8f400adda0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c003840 con 0x7f8f400adda0 2024-04-25T15:54:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.064+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f401476c0 con 0x7f8f400adda0 2024-04-25T15:54:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.068+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f40069bb0 con 0x7f8f400adda0 2024-04-25T15:54:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.068+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8f3c01a070 con 0x7f8f400adda0 2024-04-25T15:54:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.068+0000 7f8f36ffd640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2406f430 0x7f8f24071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.068+0000 7f8f46520640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2406f430 0x7f8f24071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.068+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8f3c08ed10 con 0x7f8f400adda0 2024-04-25T15:54:41.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.068+0000 7f8f46520640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2406f430 0x7f8f24071940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8f300ad000 tx=0x7f8f300a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.072+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f3c021020 con 0x7f8f400adda0 2024-04-25T15:54:41.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.276+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f400c3760 con 0x7f8f400adda0 2024-04-25T15:54:41.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.276+0000 7f8f36ffd640 1 -- 172.21.15.87:0/3705490334 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f8f3c005480 con 0x7f8f400adda0 2024-04-25T15:54:41.278 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:41.279 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:41.279 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2406f430 msgr2=0x7f8f24071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2406f430 0x7f8f24071940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8f300ad000 tx=0x7f8f300a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 msgr2=0x7f8f40146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 0x7f8f40146520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c3f0 tx=0x7f8f3c00c8b0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 shutdown_connections 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2406f430 0x7f8f24071940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f401529a0 0x7f8f401f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f400adda0 0x7f8f40146520 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 --2- 172.21.15.87:0/3705490334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f400ad990 0x7f8f400c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 >> 172.21.15.87:0/3705490334 conn(0x7f8f400c8770 msgr2=0x7f8f4014c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 shutdown_connections 2024-04-25T15:54:41.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.280+0000 7f8f48784640 1 -- 172.21.15.87:0/3705490334 wait complete. 2024-04-25T15:54:41.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:54:19.744734+0000', 'modified': '2024-04-25T15:54:23.848714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.87:6836/2742361177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2742361177}, {'type': 'v1', 'addr': '172.21.15.87:6836', 'nonce': 2742361177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4263, 'qdb_cluster': [4263]} 2024-04-25T15:54:41.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:54:41.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T15:54:41.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.864+0000 7fe988a47640 1 Processor -- start 2024-04-25T15:54:41.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.864+0000 7fe988a47640 1 -- start start 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe988a47640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9840a8cc0 0x7fe9841593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe988a47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe988a47640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe984152c80 con 0x7fe984152870 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe988a47640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe9840aebc0 con 0x7fe9840a8cc0 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe988a47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe984158f20 con 0x7fe98406c670 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9840a8cc0 0x7fe9841593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9840a8cc0 0x7fe9841593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40988/0 (socket says 172.21.15.87:40988) 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 -- 172.21.15.87:0/1609402946 learned_addr learned my addr 172.21.15.87:0/1609402946 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe982d9d640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 -- 172.21.15.87:0/1609402946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 msgr2=0x7fe98406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 -- 172.21.15.87:0/1609402946 >> v1:172.21.15.155:6789/0 conn(0x7fe984152870 legacy=0x7fe984155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe98259c640 1 -- 172.21.15.87:0/1609402946 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9840ae8e0 con 0x7fe9840a8cc0 2024-04-25T15:54:41.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.868+0000 7fe982d9d640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:41.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe98259c640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9840a8cc0 0x7fe9841593b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c60a0 tx=0x7fe97401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15e4df267450af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe98159a640 1 -- 172.21.15.87:0/1609402946 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740b0070 con 0x7fe9840a8cc0 2024-04-25T15:54:41.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe98159a640 1 -- 172.21.15.87:0/1609402946 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9740ab600 con 0x7fe9840a8cc0 2024-04-25T15:54:41.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe98159a640 1 -- 172.21.15.87:0/1609402946 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740ab9d0 con 0x7fe9840a8cc0 2024-04-25T15:54:41.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 -- 172.21.15.87:0/1609402946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9840a8cc0 msgr2=0x7fe9841593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9840a8cc0 0x7fe9841593b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe9840c60a0 tx=0x7fe97401c3b0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 -- 172.21.15.87:0/1609402946 shutdown_connections 2024-04-25T15:54:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 --2- 172.21.15.87:0/1609402946 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9840a8cc0 0x7fe9841593b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 -- 172.21.15.87:0/1609402946 >> 172.21.15.87:0/1609402946 conn(0x7fe98406d780 msgr2=0x7fe98406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 -- 172.21.15.87:0/1609402946 shutdown_connections 2024-04-25T15:54:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 -- 172.21.15.87:0/1609402946 wait complete. 2024-04-25T15:54:41.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 Processor -- start 2024-04-25T15:54:41.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.872+0000 7fe988a47640 1 -- start start 2024-04-25T15:54:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9840a8cc0 0x7fe98414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 0x7fe9840c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840ac870 con 0x7fe984152870 2024-04-25T15:54:41.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840ac6f0 con 0x7fe9840a8cc0 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9841623e0 con 0x7fe98406c670 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 0x7fe9840c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 0x7fe9840c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40990/0 (socket says 172.21.15.87:40990) 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 -- 172.21.15.87:0/2619684884 learned_addr learned my addr 172.21.15.87:0/2619684884 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe98259c640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe981d9b640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9840a8cc0 0x7fe98414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 -- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 msgr2=0x7fe98415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98415e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 -- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9840a8cc0 msgr2=0x7fe98414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9840a8cc0 0x7fe98414b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 -- 172.21.15.87:0/2619684884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9840c76c0 con 0x7fe984152870 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe981d9b640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9840a8cc0 0x7fe98414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:41.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe982d9d640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 0x7fe9840c91b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00cd80 tx=0x7fe97c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe972ffd640 1 -- 172.21.15.87:0/2619684884 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00f680 con 0x7fe984152870 2024-04-25T15:54:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe972ffd640 1 -- 172.21.15.87:0/2619684884 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c00f840 con 0x7fe984152870 2024-04-25T15:54:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe972ffd640 1 -- 172.21.15.87:0/2619684884 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00fc30 con 0x7fe984152870 2024-04-25T15:54:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9841f0820 con 0x7fe984152870 2024-04-25T15:54:41.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9841f0de0 con 0x7fe984152870 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.876+0000 7fe972ffd640 1 -- 172.21.15.87:0/2619684884 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe97c00e3e0 con 0x7fe984152870 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe972ffd640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96406f430 0x7fe964071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98259c640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96406f430 0x7fe964071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe972ffd640 1 -- 172.21.15.87:0/2619684884 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe97c0902e0 con 0x7fe984152870 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98259c640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96406f430 0x7fe964071940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ad000 tx=0x7fe9740a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 Processor -- start 2024-04-25T15:54:41.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- start start 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x55683877f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838658ea0 0x55683877fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 0x55683877ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55683863a160 con 0x556838251280 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5568385cfe20 con 0x556838658ea0 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x556838588a20 con 0x55683866cc20 2024-04-25T15:54:41.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 0x55683877ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 0x55683877ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40996/0 (socket says 172.21.15.87:40996) 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 -- 172.21.15.87:0/4038105337 learned_addr learned my addr 172.21.15.87:0/4038105337 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98259c640 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x55683877f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe981d9b640 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838658ea0 0x55683877fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 -- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 msgr2=0x55683877f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x55683877f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 -- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838658ea0 msgr2=0x55683877fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838658ea0 0x55683877fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 -- 172.21.15.87:0/4038105337 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55683858d100 con 0x556838251280 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe981d9b640 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838658ea0 0x55683877fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe982d9d640 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 0x55683877ff40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe97c08e590 tx=0x7fe97c05c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31fa0419629f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe963fff640 1 -- 172.21.15.87:0/4038105337 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c060bf0 con 0x556838251280 2024-04-25T15:54:41.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe963fff640 1 -- 172.21.15.87:0/4038105337 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c065610 con 0x556838251280 2024-04-25T15:54:41.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe963fff640 1 -- 172.21.15.87:0/4038105337 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c065180 con 0x556838251280 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- 172.21.15.87:0/4038105337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 msgr2=0x55683877ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 0x55683877ff40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe97c08e590 tx=0x7fe97c05c410 comp rx=0 tx=0).stop 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- 172.21.15.87:0/4038105337 shutdown_connections 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838251280 0x55683877ff40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838658ea0 0x55683877fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4038105337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x55683877f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- 172.21.15.87:0/4038105337 >> 172.21.15.87:0/4038105337 conn(0x556838290ff0 msgr2=0x5568387bf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- 172.21.15.87:0/4038105337 shutdown_connections 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.880+0000 7fe98fda4000 1 -- 172.21.15.87:0/4038105337 wait complete. 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- start start 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 Processor -- start 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838251280 0x556838784b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387850d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55683866cc20 0x556838785610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5568385dd220 con 0x556838658ea0 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556838573ea0 con 0x55683866cc20 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5568385cab00 con 0x556838251280 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 10 client.0 _ll_register_callbacks cb 0x5568385dcdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387850d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41004/0 (socket says 172.21.15.87:41004) 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 -- 172.21.15.87:0/4149219683 learned_addr learned my addr 172.21.15.87:0/4149219683 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 -- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838251280 msgr2=0x556838784b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838251280 0x556838784b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe982d9d640 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55683866cc20 0x556838785610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 -- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55683866cc20 msgr2=0x556838785610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55683866cc20 0x556838785610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 -- 172.21.15.87:0/4149219683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55683856f500 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe981d9b640 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387850d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe97800e170 tx=0x7fe97800e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e056922f25fbac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 1 -- 172.21.15.87:0/4149219683 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978017020 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 1 -- 172.21.15.87:0/4149219683 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe978013610 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe97c065610 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 1 -- 172.21.15.87:0/4149219683 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe97800f040 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 10 client.4899 fetch_fsmap learned FSMap version 15 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x556838555ea0 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 1 -- 172.21.15.87:0/4149219683 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c065610 con 0x556838658ea0 2024-04-25T15:54:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 1 -- 172.21.15.87:0/4149219683 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7fe978024080 con 0x556838658ea0 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 10 client.4899 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 10 client.4899 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 20 client.4899 populate_metadata read hostname 'smithi087' 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x5568382757d0 0x5568387d3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 4 client.4899 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 --> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556838568be0 con 0x5568382757d0 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98259c640 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x5568382757d0 0x5568387d3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe9617fa640 10 client.4899 ms_handle_connect on v2:172.21.15.87:6834/2742361177 2024-04-25T15:54:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.884+0000 7fe98259c640 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x5568382757d0 0x5568387d3620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32a34c62337fc53 server_cookie=e0724515da65b113 in_seq=0 out_seq=0 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe9617fa640 1 -- 172.21.15.87:0/4149219683 <== mds.0 v2:172.21.15.87:6834/2742361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556838568be0 con 0x5568382757d0 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe9617fa640 10 client.4899 handle_command_reply: tid=0 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 client.4899 shutdown 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 msgr2=0x5568387850d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387850d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe97800e170 tx=0x7fe97800e630 comp rx=0 tx=0).stop 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 shutdown_connections 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x5568382757d0 0x5568387d3620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55683866cc20 0x556838785610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387850d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe9617fa640 0 client.4899 ms_handle_reset on v2:172.21.15.87:6834/2742361177 2024-04-25T15:54:41.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 --2- 172.21.15.87:0/4149219683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838251280 0x556838784b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 >> 172.21.15.87:0/4149219683 conn(0x556838290ff0 msgr2=0x5568387be1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 shutdown_connections 2024-04-25T15:54:41.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 1 -- 172.21.15.87:0/4149219683 wait complete. 2024-04-25T15:54:41.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.888+0000 7fe98fda4000 20 client.4899 trim_cache size 0 max 16384 2024-04-25T15:54:41.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.904+0000 7fe98fda4000 1 Processor -- start 2024-04-25T15:54:41.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.904+0000 7fe98fda4000 1 -- start start 2024-04-25T15:54:41.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568387d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387d4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x5568387d5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9842002d0 con 0x556838658ea0 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9841fdd40 con 0x556838251280 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9841fe300 con 0x55683866cc20 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387d4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387d4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41016/0 (socket says 172.21.15.87:41016) 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 -- 172.21.15.87:0/2929006138 learned_addr learned my addr 172.21.15.87:0/2929006138 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 -- 172.21.15.87:0/2929006138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 msgr2=0x5568387d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x5568387d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 -- 172.21.15.87:0/2929006138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 msgr2=0x5568387d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568387d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 -- 172.21.15.87:0/2929006138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556838588c70 con 0x556838658ea0 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe981d9b640 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387d4d40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe978008010 tx=0x7fe978011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f45946ca511103d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe9637fe640 1 -- 172.21.15.87:0/2929006138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978017030 con 0x556838658ea0 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe9637fe640 1 -- 172.21.15.87:0/2929006138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978027070 con 0x556838658ea0 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe9637fe640 1 -- 172.21.15.87:0/2929006138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978004260 con 0x556838658ea0 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- 172.21.15.87:0/2929006138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 msgr2=0x5568387d4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387d4d40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe978008010 tx=0x7fe978011000 comp rx=0 tx=0).stop 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- 172.21.15.87:0/2929006138 shutdown_connections 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55683866cc20 0x5568387d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x556838658ea0 0x5568387d4d40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 --2- 172.21.15.87:0/2929006138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568387d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- 172.21.15.87:0/2929006138 >> 172.21.15.87:0/2929006138 conn(0x556838290ff0 msgr2=0x5568387d3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- 172.21.15.87:0/2929006138 shutdown_connections 2024-04-25T15:54:41.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- 172.21.15.87:0/2929006138 wait complete. 2024-04-25T15:54:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 -- start start 2024-04-25T15:54:41.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.908+0000 7fe98fda4000 1 Processor -- start 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568388324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838658ea0 0x5568388330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 0x556838833630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5568385cf130 con 0x55683866cc20 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5568385657d0 con 0x556838251280 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5568385dc0c0 con 0x556838658ea0 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 10 client.0 _ll_register_callbacks cb 0x7fe978009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 0x556838833630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 0x556838833630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41032/0 (socket says 172.21.15.87:41032) 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 -- 172.21.15.87:0/125985865 learned_addr learned my addr 172.21.15.87:0/125985865 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98259c640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568388324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe981d9b640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838658ea0 0x5568388330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 -- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838658ea0 msgr2=0x5568388330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838658ea0 0x5568388330f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 -- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 msgr2=0x5568388324d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568388324d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 -- 172.21.15.87:0/125985865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556838652180 con 0x55683866cc20 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe981d9b640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838658ea0 0x5568388330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98259c640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568388324d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe982d9d640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 0x556838833630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0630b0 tx=0x7fe97c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae1f4ec45a86d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 1 -- 172.21.15.87:0/125985865 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c01d030 con 0x55683866cc20 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 1 -- 172.21.15.87:0/125985865 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe97c065380 con 0x55683866cc20 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe978027070 con 0x55683866cc20 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 1 -- 172.21.15.87:0/125985865 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe97c065610 con 0x55683866cc20 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 10 client.4905 fetch_fsmap learned FSMap version 15 2024-04-25T15:54:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5568382890c0 con 0x55683866cc20 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 1 -- 172.21.15.87:0/125985865 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978027070 con 0x55683866cc20 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 1 -- 172.21.15.87:0/125985865 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 15) ==== 4128+0+0 (secure 0 0 0) 0x7fe97c07bce0 con 0x55683866cc20 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 10 client.4905 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 10 client.4905 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 20 client.4905 populate_metadata read hostname 'smithi087' 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x556838263830 0x556838833b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 4 client.4905 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 --> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] -- command(tid 0: {"prefix": "status"}) -- 0x5568385dda30 con 0x556838263830 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98259c640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x556838263830 0x556838833b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 10 client.4905 ms_handle_connect on v2:172.21.15.87:6834/2742361177 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98259c640 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x556838263830 0x556838833b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16eacf29c7e2b94d server_cookie=372f7e2bc14bb8a0 in_seq=0 out_seq=0 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 1 -- 172.21.15.87:0/125985865 <== mds.0 v2:172.21.15.87:6834/2742361177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5568385dda30 con 0x556838263830 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 10 client.4905 handle_command_reply: tid=0 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 client.4905 shutdown 2024-04-25T15:54:41.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 msgr2=0x556838833630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 0x556838833630 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0630b0 tx=0x7fe97c004a50 comp rx=0 tx=0).stop 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 shutdown_connections 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:6834/2742361177,v1:172.21.15.87:6836/2742361177] conn(0x556838263830 0x556838833b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55683866cc20 0x556838833630 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x556838658ea0 0x5568388330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe9617fa640 0 client.4905 ms_handle_reset on v2:172.21.15.87:6834/2742361177 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 --2- 172.21.15.87:0/125985865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556838251280 0x5568388324d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 >> 172.21.15.87:0/125985865 conn(0x556838290ff0 msgr2=0x5568387d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 shutdown_connections 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 1 -- 172.21.15.87:0/125985865 wait complete. 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe98fda4000 20 client.4905 trim_cache size 0 max 16384 2024-04-25T15:54:41.921 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "527c0db7-6346-492d-a157-2cd52d90e62b", 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4263, 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "b", 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 21.493246633999998, 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 15, 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 24, 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 39.019300413000003 2024-04-25T15:54:41.922 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T15:54:41.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96406f430 msgr2=0x7fe964071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96406f430 0x7fe964071940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ad000 tx=0x7fe9740a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:41.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 msgr2=0x7fe9840c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:41.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 0x7fe9840c91b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00cd80 tx=0x7fe97c00a650 comp rx=0 tx=0).stop 2024-04-25T15:54:41.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 shutdown_connections 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96406f430 0x7fe964071940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe984152870 0x7fe9840c91b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9840a8cc0 0x7fe98414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 --2- 172.21.15.87:0/2619684884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe98406c670 0x7fe98415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 >> 172.21.15.87:0/2619684884 conn(0x7fe98406d780 msgr2=0x7fe984153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 shutdown_connections 2024-04-25T15:54:41.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:41.912+0000 7fe988a47640 1 -- 172.21.15.87:0/2619684884 wait complete. 2024-04-25T15:54:41.933 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T15:54:41.943 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T15:54:41.944 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T15:54:41.944 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T15:54:41.944 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T15:54:41.975 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T15:54:41.975 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-25T15:54:41.975 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'a'} 2024-04-25T15:54:41.975 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:54:41.976 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:41.976 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'b'} 2024-04-25T15:54:41.976 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:54:41.976 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:41.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:41.976 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T15:54:41.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:41.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-25T15:54:42.040 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-04-25T15:54:42.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:54:42.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.042 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-25T15:54:42.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.048 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-04-25T15:54:42.107 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-04-25T15:54:42.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:54:42.108 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T15:54:42.109 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:54:42.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 Processor -- start 2024-04-25T15:54:42.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 -- start start 2024-04-25T15:54:42.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c1529a0 0x7f267c071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f267c0ad990 0x7f267c0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267c072430 con 0x7f267c0c41e0 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f267c074730 con 0x7f267c0ad990 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f2683b7f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f267c074a10 con 0x7f267c1529a0 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f267c0ad990 0x7f267c0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f267c0ad990 0x7f267c0adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41048/0 (socket says 172.21.15.87:41048) 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 -- 172.21.15.87:0/3460593213 learned_addr learned my addr 172.21.15.87:0/3460593213 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 -- 172.21.15.87:0/3460593213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c1529a0 msgr2=0x7f267c071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268191b640 1 --2- 172.21.15.87:0/3460593213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c1529a0 0x7f267c071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:42.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 --2- 172.21.15.87:0/3460593213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c1529a0 0x7f267c071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 -- 172.21.15.87:0/3460593213 >> v1:172.21.15.155:6789/0 conn(0x7f267c0c41e0 legacy=0x7f267c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:42.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.308+0000 7f268111a640 1 -- 172.21.15.87:0/3460593213 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c074cf0 con 0x7f267c0ad990 2024-04-25T15:54:42.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f268111a640 1 --2- 172.21.15.87:0/3460593213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c0adda0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f266c009870 tx=0x7f266c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b62e4a8459a1904 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:42.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2680919640 1 -- 172.21.15.87:0/3460593213 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c0b0070 con 0x7f267c0ad990 2024-04-25T15:54:42.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2680919640 1 -- 172.21.15.87:0/3460593213 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0ab600 con 0x7f267c0ad990 2024-04-25T15:54:42.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2680919640 1 -- 172.21.15.87:0/3460593213 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c0ab9d0 con 0x7f267c0ad990 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 -- 172.21.15.87:0/3460593213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 msgr2=0x7f267c0adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3460593213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c0adda0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f266c009870 tx=0x7f266c01c490 comp rx=0 tx=0).stop 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 -- 172.21.15.87:0/3460593213 shutdown_connections 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3460593213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c0adda0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3460593213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c1529a0 0x7f267c071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 -- 172.21.15.87:0/3460593213 >> 172.21.15.87:0/3460593213 conn(0x7f267c0c8770 msgr2=0x7f267c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 -- 172.21.15.87:0/3460593213 shutdown_connections 2024-04-25T15:54:42.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 -- 172.21.15.87:0/3460593213 wait complete. 2024-04-25T15:54:42.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 Processor -- start 2024-04-25T15:54:42.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.312+0000 7f2683b7f640 1 -- start start 2024-04-25T15:54:42.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c0c41e0 0x7f267c0c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f267c1529a0 0x7f267c1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f267c162470 con 0x7f267c0ad990 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f267c1622f0 con 0x7f267c1529a0 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f267c1625f0 con 0x7f267c0c41e0 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41052/0 (socket says 172.21.15.87:41052) 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 -- 172.21.15.87:0/3066594379 learned_addr learned my addr 172.21.15.87:0/3066594379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268111a640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c0c41e0 0x7f267c0c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268211c640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f267c1529a0 0x7f267c1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:42.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 -- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c0c41e0 msgr2=0x7f267c0c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c0c41e0 0x7f267c0c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 -- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f267c1529a0 msgr2=0x7f267c1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f267c1529a0 0x7f267c1487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 -- 172.21.15.87:0/3066594379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c0c45f0 con 0x7f267c0ad990 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268211c640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f267c1529a0 0x7f267c1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268191b640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c149260 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f267800c7f0 tx=0x7f267800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678004230 con 0x7f267c0ad990 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26780043d0 con 0x7f267c0ad990 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c1f25c0 con 0x7f267c0ad990 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2678003860 con 0x7f267c0ad990 2024-04-25T15:54:42.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c159150 con 0x7f267c0ad990 2024-04-25T15:54:42.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c069bb0 con 0x7f267c0ad990 2024-04-25T15:54:42.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2678003c10 con 0x7f267c0ad990 2024-04-25T15:54:42.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f26727fc640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f266006f430 0x7f2660071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:42.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f267808f770 con 0x7f267c0ad990 2024-04-25T15:54:42.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.316+0000 7f268111a640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f266006f430 0x7f2660071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:42.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.320+0000 7f268111a640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f266006f430 0x7f2660071940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f266c0ad000 tx=0x7f266c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:42.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.324+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2678015020 con 0x7f267c0ad990 2024-04-25T15:54:42.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.524+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f267c0c3760 con 0x7f267c0ad990 2024-04-25T15:54:42.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.524+0000 7f26727fc640 1 -- 172.21.15.87:0/3066594379 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+116 (secure 0 0 0) 0x7f267805c330 con 0x7f267c0ad990 2024-04-25T15:54:42.526 INFO:teuthology.orchestra.run.smithi087.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-25T15:54:42.526 INFO:teuthology.orchestra.run.smithi087.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f266006f430 msgr2=0x7f2660071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f266006f430 0x7f2660071940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f266c0ad000 tx=0x7f266c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 msgr2=0x7f267c149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c149260 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f267800c7f0 tx=0x7f267800ccb0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 shutdown_connections 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f266006f430 0x7f2660071940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f267c1529a0 0x7f267c1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f267c0c41e0 0x7f267c0c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 --2- 172.21.15.87:0/3066594379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f267c0ad990 0x7f267c149260 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:42.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 >> 172.21.15.87:0/3066594379 conn(0x7f267c0c8770 msgr2=0x7f267c154a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:42.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 shutdown_connections 2024-04-25T15:54:42.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42.528+0000 7f2683b7f640 1 -- 172.21.15.87:0/3066594379 wait complete. 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:54:42.548 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:54:42.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.549 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-04-25T15:54:42.555 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42469sec preferred_lft 42469sec 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:99:cb:db:7d brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:42.556 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T15:54:42.557 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:42.557 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:54:42.557 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:42.557 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-25T15:54:42.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:54:42.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-04-25T15:54:42.557 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-04-25T15:54:42.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:54:42.558 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-25T15:54:42.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:42.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:42.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.676 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:54:42.729 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-04-25T15:54:42.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.730 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T15:54:42.803 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T15:54:42.804 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T15:54:42.804 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:54:42.804 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:42.804 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-25T15:54:42.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:54:42.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:54:42.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:54:42.804 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-25T15:54:42.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:42.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.927 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-25T15:54:42.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:42.933 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-04-25T15:54:42.980 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:42.980 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-25T15:54:42.980 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:42.980 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T15:54:42.980 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-25T15:54:43.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:43.098 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T15:54:43.098 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:43.098 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-25T15:54:43.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T15:54:43.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:54:43.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T15:54:43.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T15:54:43.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T15:54:43.099 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-25T15:54:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:43.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:43.206 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:43.206 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-25T15:54:43.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-04-25T15:54:43.206 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:54:43.206 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-25T15:54:43.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:43.310 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'a'} 2024-04-25T15:54:43.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:54:43.311 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:43.356 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:54:43.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:54:43.357 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:43.404 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-25T15:54:43.463 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:54:43.510 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-25T15:54:43.510 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-25T15:54:43.510 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-25T15:54:43.510 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-25T15:54:43.511 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-25T15:54:43.512 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-25T15:54:43.513 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:43.514 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:43.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:43.515 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-25T15:54:43.561 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T15:54:43.561 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=a) 2024-04-25T15:54:43.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-25T15:54:43.621 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:54:43.672 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:54:43.673 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:54:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:54:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:54:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-25T15:54:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:43.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:43.676 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-25T15:54:43.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-04-25T15:54:43.712+0000 7f2e99622580 -1 init, newargv = 0x7f2e88005830 newargc=15 2024-04-25T15:54:43.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[36014]: starting ceph client 2024-04-25T15:54:43.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[36014]: starting fuse 2024-04-25T15:54:44.819 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-25T15:54:44.835 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:54:44.883 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-25T15:54:44.884 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/run/lock 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-25T15:54:44.885 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-25T15:54:44.886 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-25T15:54:44.886 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-25T15:54:44.886 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/fs/nfsd 2024-04-25T15:54:44.886 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-25T15:54:44.886 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-25T15:54:44.886 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/run/rpc_pipefs 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:54:44.887 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:54:44.888 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-25T15:54:44.888 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:44.888 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:54:44.888 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:44.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:44.889 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-25T15:54:44.937 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-04-25T15:54:44.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T15:54:44.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-04-25T15:54:44.938 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-04-25T15:54:44.938 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-04-25T15:54:44.939 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-04-25T15:54:44.940 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-04-25T15:54:44.941 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-04-25T15:54:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.36014.asok 2024-04-25T15:54:45.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:45.073 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36014.asok 2024-04-25T15:54:45.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:45.073 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36014.asok status 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36014", 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-04-25T15:54:45.252 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4920, 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4920 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1619047436 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1619047436 2024-04-25T15:54:45.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4920 192.168.0.1:0/1619047436", 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1619047436", 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 9, 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 24, 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "a" 2024-04-25T15:54:45.254 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T15:54:45.268 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:54:45.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0f505b640 1 Processor -- start 2024-04-25T15:54:45.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0f505b640 1 -- start start 2024-04-25T15:54:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0f505b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0f0074930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0f505b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f006dbd0 con 0x7ff0f006f8a0 2024-04-25T15:54:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0f505b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f0154870 con 0x7ff0f0151700 2024-04-25T15:54:45.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0f505b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f0070440 con 0x7ff0f00aeca0 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0ef59e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff0f006f8a0 0x7ff0f015eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49992/0 (socket says 172.21.15.87:49992) 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0ef59e640 1 -- 172.21.15.87:0/1308215253 learned_addr learned my addr 172.21.15.87:0/1308215253 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.412+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0f0074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715373444 0 0) 0x7ff0e0001120 con 0x7ff0f006f8a0 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0dc003530 con 0x7ff0f006f8a0 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72847630 0 0) 0x7ff0f0154870 con 0x7ff0f0151700 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e0001120 con 0x7ff0f0151700 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 582152161 0 0) 0x7ff0dc003530 con 0x7ff0f006f8a0 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 msgr2=0x7ff0f0074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0f0074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 >> v1:172.21.15.155:6789/0 conn(0x7ff0f0151700 legacy=0x7ff0f0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0070690 con 0x7ff0f006f8a0 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ff0e0001870 con 0x7ff0f006f8a0 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 >> v1:172.21.15.87:6789/0 conn(0x7ff0f006f8a0 legacy=0x7ff0f015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0dc003b80 0x7ff0dc003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc004d50 0x7ff0dc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0070440 con 0x7ff0dc003b80 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc00de40 con 0x7ff0dc004d50 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0dc00e040 con 0x7ff0f00aeca0 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0dc003b80 0x7ff0dc003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0ef59e640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc004d50 0x7ff0dc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0ee59c640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 -- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 msgr2=0x7ff0dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 -- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc004d50 msgr2=0x7ff0dc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:45.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc004d50 0x7ff0dc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 -- 172.21.15.87:0/1308215253 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc003530 con 0x7ff0dc003b80 2024-04-25T15:54:45.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0ef59e640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc004d50 0x7ff0dc0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:45.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0ee59c640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f00aeca0 0x7ff0dc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0dc003b80 0x7ff0dc003fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009fc0 tx=0x7ff0e801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1366f5014deee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80b2070 con 0x7ff0dc003b80 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e80a5990 con 0x7ff0dc003b80 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0edd9b640 1 -- 172.21.15.87:0/1308215253 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8009c10 con 0x7ff0dc003b80 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0f505b640 1 -- 172.21.15.87:0/1308215253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0dc003b80 msgr2=0x7ff0dc003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.416+0000 7ff0f505b640 1 --2- 172.21.15.87:0/1308215253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0dc003b80 0x7ff0dc003fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009fc0 tx=0x7ff0e801cca0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0ef59e640 1 -- 172.21.15.87:0/1308215253 reap_dead start 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0f505b640 1 -- 172.21.15.87:0/1308215253 shutdown_connections 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0f505b640 1 -- 172.21.15.87:0/1308215253 >> 172.21.15.87:0/1308215253 conn(0x7ff0f006d650 msgr2=0x7ff0f00c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:45.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0f505b640 1 -- 172.21.15.87:0/1308215253 shutdown_connections 2024-04-25T15:54:45.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0f505b640 1 -- 172.21.15.87:0/1308215253 wait complete. 2024-04-25T15:54:45.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0f505b640 1 Processor -- start 2024-04-25T15:54:45.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.420+0000 7ff0f505b640 1 -- start start 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc003b80 0x7ff0f014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 0x7ff0f0142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f014c620 0x7ff0f01f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f006efa0 con 0x7ff0f0149e00 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0151b10 con 0x7ff0dc003b80 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f006f120 con 0x7ff0f014c620 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 0x7ff0f0142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 0x7ff0f0142ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41074/0 (socket says 172.21.15.87:41074) 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 -- 172.21.15.87:0/4269018365 learned_addr learned my addr 172.21.15.87:0/4269018365 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc003b80 0x7ff0f014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ef59e640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f014c620 0x7ff0f01f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 -- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f014c620 msgr2=0x7ff0f01f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f014c620 0x7ff0f01f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 -- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc003b80 msgr2=0x7ff0f014c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc003b80 0x7ff0f014c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 -- 172.21.15.87:0/4269018365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f014cb40 con 0x7ff0f0149e00 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ef59e640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f014c620 0x7ff0f01f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc003b80 0x7ff0f014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0ee59c640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 0x7ff0f0142ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800d770 tx=0x7ff0d800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8016070 con 0x7ff0f0149e00 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d8007220 con 0x7ff0f0149e00 2024-04-25T15:54:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8007630 con 0x7ff0f0149e00 2024-04-25T15:54:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f0149720 con 0x7ff0f0149e00 2024-04-25T15:54:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f01463d0 con 0x7ff0f0149e00 2024-04-25T15:54:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f0149bd0 con 0x7ff0f0149e00 2024-04-25T15:54:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff0d80067e0 con 0x7ff0f0149e00 2024-04-25T15:54:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0e77fe640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff0d006f430 0x7ff0d0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff0d808f3d0 con 0x7ff0f0149e00 2024-04-25T15:54:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.424+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff0d006f430 0x7ff0d0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.428+0000 7ff0eed9d640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff0d006f430 0x7ff0d0071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80af000 tx=0x7ff0e80a7040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.432+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0d805c020 con 0x7ff0f0149e00 2024-04-25T15:54:45.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.624+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff0f01f1130 con 0x7ff0f0149e00 2024-04-25T15:54:45.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.624+0000 7ff0e77fe640 1 -- 172.21.15.87:0/4269018365 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+116 (secure 0 0 0) 0x7ff0d805b920 con 0x7ff0f0149e00 2024-04-25T15:54:45.627 INFO:teuthology.orchestra.run.smithi087.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-25T15:54:45.628 INFO:teuthology.orchestra.run.smithi087.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-25T15:54:45.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff0d006f430 msgr2=0x7ff0d0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff0d006f430 0x7ff0d0071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80af000 tx=0x7ff0e80a7040 comp rx=0 tx=0).stop 2024-04-25T15:54:45.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 msgr2=0x7ff0f0142ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 0x7ff0f0142ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800d770 tx=0x7ff0d800dc30 comp rx=0 tx=0).stop 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 shutdown_connections 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff0d006f430 0x7ff0d0071940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0f014c620 0x7ff0f01f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f0149e00 0x7ff0f0142ad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 --2- 172.21.15.87:0/4269018365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0dc003b80 0x7ff0f014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 >> 172.21.15.87:0/4269018365 conn(0x7ff0f006d650 msgr2=0x7ff0f014eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 shutdown_connections 2024-04-25T15:54:45.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:45.628+0000 7ff0f505b640 1 -- 172.21.15.87:0/4269018365 wait complete. 2024-04-25T15:54:45.647 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-04-25T15:54:45.647 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:54:45.648 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:54:45.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:45.648 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:45.655 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-04-25T15:54:45.656 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:45.657 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T15:54:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e5:bf:a1:1c brd ff:ff:ff:ff:ff:ff 2024-04-25T15:54:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T15:54:45.657 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:54:45.657 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:54:45.657 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T15:54:45.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:45.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:45.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:45.788 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:54:45.797 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-25T15:54:45.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:45.799 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-04-25T15:54:45.860 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-04-25T15:54:45.860 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:54:45.860 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T15:54:45.861 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:54:45.861 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:45.862 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T15:54:45.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T15:54:45.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T15:54:45.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T15:54:45.862 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T15:54:45.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:45.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:45.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:45.985 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T15:54:46.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:46.033 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-04-25T15:54:46.081 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:46.081 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T15:54:46.081 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:46.081 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T15:54:46.081 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T15:54:46.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:46.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:46.195 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T15:54:46.195 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T15:54:46.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:46.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:46.311 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:54:46.311 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T15:54:46.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-04-25T15:54:46.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:54:46.311 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T15:54:46.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:54:46.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:46.413 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'b'} 2024-04-25T15:54:46.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:54:46.413 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:46.464 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T15:54:46.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:54:46.464 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:46.516 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T15:54:46.573 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:54:46.621 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T15:54:46.621 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T15:54:46.621 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T15:54:46.621 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T15:54:46.621 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T15:54:46.621 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T15:54:46.622 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:46.623 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:46.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:46.624 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T15:54:46.672 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T15:54:46.672 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=b) 2024-04-25T15:54:46.717 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T15:54:46.731 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T15:54:46.781 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T15:54:46.782 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:46.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:46.783 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T15:54:46.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:2024-04-25T15:54:46.822+0000 7f3ea1224580 -1 init, newargv = 0x7f3e9001b4c0 newargc=15 2024-04-25T15:54:46.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[33195]: starting ceph client 2024-04-25T15:54:46.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[33195]: starting fuse 2024-04-25T15:54:47.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T15:54:47.946 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:54:47.993 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/run/lock 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T15:54:47.994 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/fs/nfsd 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/run/rpc_pipefs 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-4 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-5 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-6 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-7 2024-04-25T15:54:47.995 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T15:54:47.996 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:47.996 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T15:54:47.996 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:47.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:47.997 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T15:54:48.044 INFO:teuthology.orchestra.run.smithi155.stdout:45 2024-04-25T15:54:48.045 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-25T15:54:48.045 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T15:54:48.046 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T15:54:48.047 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.1")) 2024-04-25T15:54:48.047 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-04-25T15:54:48.169 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.1.33195.asok 2024-04-25T15:54:48.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:54:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:54:48.181 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33195.asok 2024-04-25T15:54:48.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:48.181 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33195.asok status 2024-04-25T15:54:48.356 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T15:54:48.356 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-04-25T15:54:48.356 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T15:54:48.356 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T15:54:48.356 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "1", 2024-04-25T15:54:48.356 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "33195", 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4684, 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4684 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:54:48.357 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 1507696907 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 1507696907 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4684 192.168.0.1:0/1507696907", 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/1507696907", 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-04-25T15:54:48.358 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 15, 2024-04-25T15:54:48.359 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 24, 2024-04-25T15:54:48.359 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-04-25T15:54:48.359 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-04-25T15:54:48.359 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "b" 2024-04-25T15:54:48.359 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T15:54:48.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:48.372 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-04-25T15:54:48.372 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:48.379 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-04-25T15:54:48.379 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:48.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:48.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:48.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:48.434 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-04-25T15:54:48.434 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:48.441 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-04-25T15:54:48.441 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:48.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:54:48.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:48.499 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-04-25T15:54:48.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:48.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 Processor -- start 2024-04-25T15:54:48.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 -- start start 2024-04-25T15:54:48.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feab815ab10 0x7feab815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:48.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feab815fe30 0x7feab8162250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:48.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab80c45a0 con 0x7feab8154ca0 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7feab80c9f30 con 0x7feab815fe30 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feabd40e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7feab80c3fe0 con 0x7feab815ab10 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab77fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feab815fe30 0x7feab8162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab6ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feab8154ca0 0x7feab80c5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49996/0 (socket says 172.21.15.87:49996) 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab6ffd640 1 -- 172.21.15.87:0/222577422 learned_addr learned my addr 172.21.15.87:0/222577422 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab67fc640 1 --2- 172.21.15.87:0/222577422 >> v2:172.21.15.155:3300/0 conn(0x7feab815ab10 0x7feab815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab77fe640 1 -- 172.21.15.87:0/222577422 >> v2:172.21.15.155:3300/0 conn(0x7feab815ab10 msgr2=0x7feab815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab77fe640 1 --2- 172.21.15.87:0/222577422 >> v2:172.21.15.155:3300/0 conn(0x7feab815ab10 0x7feab815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab77fe640 1 -- 172.21.15.87:0/222577422 >> v1:172.21.15.87:6789/0 conn(0x7feab8154ca0 legacy=0x7feab80c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:48.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.672+0000 7feab77fe640 1 -- 172.21.15.87:0/222577422 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab80c42c0 con 0x7feab815fe30 2024-04-25T15:54:48.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feab77fe640 1 --2- 172.21.15.87:0/222577422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8162250 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feab80c6910 tx=0x7feab001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2231c758db668f74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:48.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feab5ffb640 1 -- 172.21.15.87:0/222577422 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00b2070 con 0x7feab815fe30 2024-04-25T15:54:48.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feab5ffb640 1 -- 172.21.15.87:0/222577422 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab00a5850 con 0x7feab815fe30 2024-04-25T15:54:48.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feab5ffb640 1 -- 172.21.15.87:0/222577422 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00a5c20 con 0x7feab815fe30 2024-04-25T15:54:48.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 -- 172.21.15.87:0/222577422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 msgr2=0x7feab8162250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:48.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 --2- 172.21.15.87:0/222577422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8162250 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feab80c6910 tx=0x7feab001c8a0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 -- 172.21.15.87:0/222577422 shutdown_connections 2024-04-25T15:54:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 --2- 172.21.15.87:0/222577422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8162250 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 --2- 172.21.15.87:0/222577422 >> v2:172.21.15.155:3300/0 conn(0x7feab815ab10 0x7feab815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 -- 172.21.15.87:0/222577422 >> 172.21.15.87:0/222577422 conn(0x7feab80ac5c0 msgr2=0x7feab80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 -- 172.21.15.87:0/222577422 shutdown_connections 2024-04-25T15:54:48.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.676+0000 7feabd40e640 1 -- 172.21.15.87:0/222577422 wait complete. 2024-04-25T15:54:48.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 Processor -- start 2024-04-25T15:54:48.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- start start 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8154ca0 0x7feab80abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab815ab10 0x7feab8143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8161d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feab80c3dc0 con 0x7feab815fe30 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feab80c3c40 con 0x7feab815ab10 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feab815b460 con 0x7feab8154ca0 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8161d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8161d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41102/0 (socket says 172.21.15.87:41102) 2024-04-25T15:54:48.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 -- 172.21.15.87:0/3953046442 learned_addr learned my addr 172.21.15.87:0/3953046442 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab67fc640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab815ab10 0x7feab8143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab6ffd640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8154ca0 0x7feab80abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 -- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8154ca0 msgr2=0x7feab80abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8154ca0 0x7feab80abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 -- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab815ab10 msgr2=0x7feab8143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab815ab10 0x7feab8143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 -- 172.21.15.87:0/3953046442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab81622c0 con 0x7feab815fe30 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab6ffd640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8154ca0 0x7feab80abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feab77fe640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8161d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feab00194b0 tx=0x7feab0019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00b2050 con 0x7feab815fe30 2024-04-25T15:54:48.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab00be070 con 0x7feab815fe30 2024-04-25T15:54:48.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab80aa490 con 0x7feab815fe30 2024-04-25T15:54:48.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00ada90 con 0x7feab815fe30 2024-04-25T15:54:48.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab80ab2c0 con 0x7feab815fe30 2024-04-25T15:54:48.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab8153cb0 con 0x7feab815fe30 2024-04-25T15:54:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.680+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7feab00adc30 con 0x7feab815fe30 2024-04-25T15:54:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.684+0000 7feaaf7fe640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fea9806f400 0x7fea98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.684+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7feab012a770 con 0x7feab815fe30 2024-04-25T15:54:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.684+0000 7feab6ffd640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fea9806f400 0x7fea98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.684+0000 7feab6ffd640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fea9806f400 0x7fea98071910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feaa0007fd0 tx=0x7feaa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:48.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.688+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feab8153cb0 con 0x7feab815fe30 2024-04-25T15:54:48.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.852+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feab8069bb0 con 0x7feab815fe30 2024-04-25T15:54:48.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.852+0000 7feaaf7fe640 1 -- 172.21.15.87:0/3953046442 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7feab0016520 con 0x7feab815fe30 2024-04-25T15:54:48.856 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:48.856 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:21.374504+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fea9806f400 msgr2=0x7fea98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fea9806f400 0x7fea98071910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feaa0007fd0 tx=0x7feaa0009040 comp rx=0 tx=0).stop 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 msgr2=0x7feab8161d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8161d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feab00194b0 tx=0x7feab0019640 comp rx=0 tx=0).stop 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 shutdown_connections 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fea9806f400 0x7fea98071910 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feab815fe30 0x7feab8161d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab815ab10 0x7feab8143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 --2- 172.21.15.87:0/3953046442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8154ca0 0x7feab80abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 >> 172.21.15.87:0/3953046442 conn(0x7feab80ac5c0 msgr2=0x7feab80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:48.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 shutdown_connections 2024-04-25T15:54:48.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:48.856+0000 7feabd40e640 1 -- 172.21.15.87:0/3953046442 wait complete. 2024-04-25T15:54:48.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:48.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:49.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb2572640 1 Processor -- start 2024-04-25T15:54:49.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb2572640 1 -- start start 2024-04-25T15:54:49.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb2572640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcfac0ac1c0 0x7fcfac15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb2572640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfac154fc0 con 0x7fcfac0ad160 2024-04-25T15:54:49.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb2572640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfac0acb20 con 0x7fcfac1518b0 2024-04-25T15:54:49.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb2572640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcfac06ed60 con 0x7fcfac0ac1c0 2024-04-25T15:54:49.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcfac0ad160 0x7fcfac0c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:50004/0 (socket says 172.21.15.87:50004) 2024-04-25T15:54:49.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 -- 172.21.15.87:0/1644638219 learned_addr learned my addr 172.21.15.87:0/1644638219 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb0b0f640 1 --2- 172.21.15.87:0/1644638219 >> v2:172.21.15.155:3300/0 conn(0x7fcfac0ac1c0 0x7fcfac15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127820636 0 0) 0x7fcfac154fc0 con 0x7fcfac0ad160 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf94003530 con 0x7fcfac0ad160 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3554815949 0 0) 0x7fcf94003530 con 0x7fcfac0ad160 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 >> v2:172.21.15.155:3300/0 conn(0x7fcfac0ac1c0 msgr2=0x7fcfac15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 --2- 172.21.15.87:0/1644638219 >> v2:172.21.15.155:3300/0 conn(0x7fcfac0ac1c0 0x7fcfac15f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 >> v1:172.21.15.155:6789/0 conn(0x7fcfac1518b0 legacy=0x7fcfac06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac0ace00 con 0x7fcfac0ad160 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fcfa0001680 con 0x7fcfac0ad160 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 >> v1:172.21.15.87:6789/0 conn(0x7fcfac0ad160 legacy=0x7fcfac0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf940039c0 0x7fcf94003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf94004810 0x7fcf94004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94005280 0x7fcf9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac06ed60 con 0x7fcf94004810 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9400c1a0 con 0x7fcf94005280 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9400c3a0 con 0x7fcf940039c0 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf94004810 0x7fcf94004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfabfff640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf940039c0 0x7fcf94003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 -- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf940039c0 msgr2=0x7fcf94003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf940039c0 0x7fcf94003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb0b0f640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94005280 0x7fcf9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 -- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94005280 msgr2=0x7fcf9400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94005280 0x7fcf9400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfab7fe640 1 -- 172.21.15.87:0/1644638219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf94003530 con 0x7fcf94004810 2024-04-25T15:54:49.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.032+0000 7fcfb0b0f640 1 -- 172.21.15.87:0/1644638219 reap_dead start 2024-04-25T15:54:49.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfab7fe640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf94004810 0x7fcf94004c20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c1c0 tx=0x7fcfa001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a894930ec58ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007d00 con 0x7fcf94004810 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa0005b00 con 0x7fcf94004810 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfaaffd640 1 -- 172.21.15.87:0/1644638219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007070 con 0x7fcf94004810 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 -- 172.21.15.87:0/1644638219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf94004810 msgr2=0x7fcf94004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf94004810 0x7fcf94004c20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c1c0 tx=0x7fcfa001f350 comp rx=0 tx=0).stop 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 -- 172.21.15.87:0/1644638219 shutdown_connections 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 --2- 172.21.15.87:0/1644638219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf94004810 0x7fcf94004c20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 -- 172.21.15.87:0/1644638219 >> 172.21.15.87:0/1644638219 conn(0x7fcfac0c8770 msgr2=0x7fcfac0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 -- 172.21.15.87:0/1644638219 shutdown_connections 2024-04-25T15:54:49.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.036+0000 7fcfb2572640 1 -- 172.21.15.87:0/1644638219 wait complete. 2024-04-25T15:54:49.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 Processor -- start 2024-04-25T15:54:49.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- start start 2024-04-25T15:54:49.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94004810 0x7fcfac0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfac14c530 0x7fcfac0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 0x7fcfac1f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac071fd0 con 0x7fcfac1f11e0 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac071e50 con 0x7fcf94004810 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfac0c40e0 con 0x7fcfac14c530 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 0x7fcfac1f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 0x7fcfac1f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41116/0 (socket says 172.21.15.87:41116) 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 -- 172.21.15.87:0/155742736 learned_addr learned my addr 172.21.15.87:0/155742736 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfabfff640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94004810 0x7fcfac0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfab7fe640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfac14c530 0x7fcfac0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 -- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfac14c530 msgr2=0x7fcfac0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfac14c530 0x7fcfac0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 -- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94004810 msgr2=0x7fcfac0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94004810 0x7fcfac0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 -- 172.21.15.87:0/155742736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac155a90 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb0b0f640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 0x7fcfac1f15f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0753c0 tx=0x7fcfa400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4016620 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa401b070 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfac1ee090 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4016a20 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfac1f0cc0 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.040+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfac069bb0 con 0x7fcfac1f11e0 2024-04-25T15:54:49.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.044+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcfa4016bc0 con 0x7fcfac1f11e0 2024-04-25T15:54:49.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.044+0000 7fcfa8ff9640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcf9806f400 0x7fcf98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.044+0000 7fcfabfff640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcf9806f400 0x7fcf98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.044+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fcfa4090290 con 0x7fcfac1f11e0 2024-04-25T15:54:49.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.044+0000 7fcfabfff640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcf9806f400 0x7fcf98071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000c10 tx=0x7fcf9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.048+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfa405cf70 con 0x7fcfac1f11e0 2024-04-25T15:54:49.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.224+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcfac155820 con 0x7fcfac1f11e0 2024-04-25T15:54:49.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.224+0000 7fcfa8ff9640 1 -- 172.21.15.87:0/155742736 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fcfa405c870 con 0x7fcfac1f11e0 2024-04-25T15:54:49.226 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:49.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.224+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcf9806f400 msgr2=0x7fcf98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcf9806f400 0x7fcf98071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000c10 tx=0x7fcf9c009040 comp rx=0 tx=0).stop 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 msgr2=0x7fcfac1f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 0x7fcfac1f15f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0753c0 tx=0x7fcfa400f520 comp rx=0 tx=0).stop 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 shutdown_connections 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcf9806f400 0x7fcf98071910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfac1f11e0 0x7fcfac1f15f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfac14c530 0x7fcfac0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 --2- 172.21.15.87:0/155742736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf94004810 0x7fcfac0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 >> 172.21.15.87:0/155742736 conn(0x7fcfac0c8770 msgr2=0x7fcfac152420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 shutdown_connections 2024-04-25T15:54:49.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.228+0000 7fcfb2572640 1 -- 172.21.15.87:0/155742736 wait complete. 2024-04-25T15:54:49.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:49.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 Processor -- start 2024-04-25T15:54:49.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 -- start start 2024-04-25T15:54:49.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c201518b0 0x7f8c2006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c200ad160 0x7f8c200c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c200c4620 0x7f8c20157640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2006ed60 con 0x7f8c200c4620 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8c20154fc0 con 0x7f8c201518b0 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c2711c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c200acb20 con 0x7f8c200ad160 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c200c4620 0x7f8c20157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c200c4620 0x7f8c20157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41120/0 (socket says 172.21.15.87:41120) 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 -- 172.21.15.87:0/324430414 learned_addr learned my addr 172.21.15.87:0/324430414 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c1ffff640 1 --2- 172.21.15.87:0/324430414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c200ad160 0x7f8c200c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c24eb8640 1 --2- 172.21.15.87:0/324430414 >> v2:172.21.15.155:3300/0 conn(0x7f8c201518b0 0x7f8c2006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 -- 172.21.15.87:0/324430414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c200ad160 msgr2=0x7f8c200c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 --2- 172.21.15.87:0/324430414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c200ad160 0x7f8c200c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 -- 172.21.15.87:0/324430414 >> v2:172.21.15.155:3300/0 conn(0x7f8c201518b0 msgr2=0x7f8c2006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 --2- 172.21.15.87:0/324430414 >> v2:172.21.15.155:3300/0 conn(0x7f8c201518b0 0x7f8c2006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c256b9640 1 -- 172.21.15.87:0/324430414 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c200ace00 con 0x7f8c200c4620 2024-04-25T15:54:49.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.384+0000 7f8c24eb8640 1 --2- 172.21.15.87:0/324430414 >> v2:172.21.15.155:3300/0 conn(0x7f8c201518b0 0x7f8c2006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:49.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c256b9640 1 --2- 172.21.15.87:0/324430414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200c4620 0x7f8c20157640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c4c70 tx=0x7f8c1801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f154c6e4244bf396 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c1f7fe640 1 -- 172.21.15.87:0/324430414 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180a5890 con 0x7f8c200c4620 2024-04-25T15:54:49.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c1f7fe640 1 -- 172.21.15.87:0/324430414 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c180a5a30 con 0x7f8c200c4620 2024-04-25T15:54:49.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c1f7fe640 1 -- 172.21.15.87:0/324430414 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180a5e00 con 0x7f8c200c4620 2024-04-25T15:54:49.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 -- 172.21.15.87:0/324430414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200c4620 msgr2=0x7f8c20157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 --2- 172.21.15.87:0/324430414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200c4620 0x7f8c20157640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c4c70 tx=0x7f8c1801c9f0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 -- 172.21.15.87:0/324430414 shutdown_connections 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 --2- 172.21.15.87:0/324430414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200c4620 0x7f8c20157640 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 --2- 172.21.15.87:0/324430414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c200ad160 0x7f8c200c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 --2- 172.21.15.87:0/324430414 >> v2:172.21.15.155:3300/0 conn(0x7f8c201518b0 0x7f8c2006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 -- 172.21.15.87:0/324430414 >> 172.21.15.87:0/324430414 conn(0x7f8c200c8770 msgr2=0x7f8c200c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 -- 172.21.15.87:0/324430414 shutdown_connections 2024-04-25T15:54:49.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 -- 172.21.15.87:0/324430414 wait complete. 2024-04-25T15:54:49.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 Processor -- start 2024-04-25T15:54:49.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.388+0000 7f8c2711c640 1 -- start start 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 0x7f8c2015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c200c4620 0x7f8c20153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c201518b0 0x7f8c201f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20160b40 con 0x7f8c200ad160 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c201609c0 con 0x7f8c200c4620 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c20160cc0 con 0x7f8c201518b0 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 0x7f8c2015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 0x7f8c2015cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41124/0 (socket says 172.21.15.87:41124) 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 -- 172.21.15.87:0/357036741 learned_addr learned my addr 172.21.15.87:0/357036741 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:49.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c256b9640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c201518b0 0x7f8c201f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1ffff640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c200c4620 0x7f8c20153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 -- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c201518b0 msgr2=0x7f8c201f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c201518b0 0x7f8c201f42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 -- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c200c4620 msgr2=0x7f8c20153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c200c4620 0x7f8c20153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 -- 172.21.15.87:0/357036741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2014be30 con 0x7f8c200ad160 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1ffff640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c200c4620 0x7f8c20153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c24eb8640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 0x7f8c2015cf60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000c7f0 tx=0x7f8c1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10015070 con 0x7f8c200ad160 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c10007820 con 0x7f8c200ad160 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2014b9e0 con 0x7f8c200ad160 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10007bd0 con 0x7f8c200ad160 2024-04-25T15:54:49.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c201521e0 con 0x7f8c200ad160 2024-04-25T15:54:49.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c20152440 con 0x7f8c200ad160 2024-04-25T15:54:49.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8c10018070 con 0x7f8c200ad160 2024-04-25T15:54:49.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1d7fa640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8c0c06f430 0x7f8c0c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6695+0+0 (secure 0 0 0) 0x7f8c1008fb40 con 0x7f8c200ad160 2024-04-25T15:54:49.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1ffff640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8c0c06f430 0x7f8c0c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.392+0000 7f8c1ffff640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8c0c06f430 0x7f8c0c071940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c20157950 tx=0x7f8c14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.396+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c1005c730 con 0x7f8c200ad160 2024-04-25T15:54:49.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.556+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f8c201f17f0 con 0x7f8c200ad160 2024-04-25T15:54:49.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.556+0000 7f8c1d7fa640 1 -- 172.21.15.87:0/357036741 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f8c1005c030 con 0x7f8c200ad160 2024-04-25T15:54:49.560 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8c0c06f430 msgr2=0x7f8c0c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8c0c06f430 0x7f8c0c071940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c20157950 tx=0x7f8c14008040 comp rx=0 tx=0).stop 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 msgr2=0x7f8c2015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 0x7f8c2015cf60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000c7f0 tx=0x7f8c1000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 shutdown_connections 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8c0c06f430 0x7f8c0c071940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c201518b0 0x7f8c201f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c200c4620 0x7f8c20153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 --2- 172.21.15.87:0/357036741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c200ad160 0x7f8c2015cf60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 >> 172.21.15.87:0/357036741 conn(0x7f8c200c8770 msgr2=0x7f8c20150590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:49.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 shutdown_connections 2024-04-25T15:54:49.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.560+0000 7f8c2711c640 1 -- 172.21.15.87:0/357036741 wait complete. 2024-04-25T15:54:49.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:49.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 Processor -- start 2024-04-25T15:54:49.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 -- start start 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa214154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa214154ac0 0x7fa214161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa214063220 con 0x7fa2140740d0 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa2140c5570 con 0x7fa214154ac0 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa218f1c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa214074a90 con 0x7fa2140744e0 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa214154ac0 0x7fa214161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa214154ac0 0x7fa214161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41130/0 (socket says 172.21.15.87:41130) 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 -- 172.21.15.87:0/3321731437 learned_addr learned my addr 172.21.15.87:0/3321731437 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa211d9b640 1 --2- 172.21.15.87:0/3321731437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa214154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 -- 172.21.15.87:0/3321731437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 msgr2=0x7fa214154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 --2- 172.21.15.87:0/3321731437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa214154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 -- 172.21.15.87:0/3321731437 >> v1:172.21.15.155:6789/0 conn(0x7fa2140740d0 legacy=0x7fa2140c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:49.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.732+0000 7fa212d9d640 1 -- 172.21.15.87:0/3321731437 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2140634c0 con 0x7fa214154ac0 2024-04-25T15:54:49.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa212d9d640 1 --2- 172.21.15.87:0/3321731437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214161e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa214075350 tx=0x7fa20c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500812abc3e4c269 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa21159a640 1 -- 172.21.15.87:0/3321731437 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0a5630 con 0x7fa214154ac0 2024-04-25T15:54:49.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa21159a640 1 -- 172.21.15.87:0/3321731437 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20c0a57d0 con 0x7fa214154ac0 2024-04-25T15:54:49.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa21159a640 1 -- 172.21.15.87:0/3321731437 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0a5ba0 con 0x7fa214154ac0 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 -- 172.21.15.87:0/3321731437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 msgr2=0x7fa214161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 --2- 172.21.15.87:0/3321731437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214161e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa214075350 tx=0x7fa20c01c920 comp rx=0 tx=0).stop 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 -- 172.21.15.87:0/3321731437 shutdown_connections 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 --2- 172.21.15.87:0/3321731437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa214154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 --2- 172.21.15.87:0/3321731437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214161e70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 -- 172.21.15.87:0/3321731437 >> 172.21.15.87:0/3321731437 conn(0x7fa21406d650 msgr2=0x7fa2140c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 -- 172.21.15.87:0/3321731437 shutdown_connections 2024-04-25T15:54:49.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.736+0000 7fa218f1c640 1 -- 172.21.15.87:0/3321731437 wait complete. 2024-04-25T15:54:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 Processor -- start 2024-04-25T15:54:49.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 -- start start 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2140740d0 0x7fa21414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa2141463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa21406dbe0 con 0x7fa214154ac0 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa21406da60 con 0x7fa2140740d0 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2140c2a80 con 0x7fa2140744e0 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41140/0 (socket says 172.21.15.87:41140) 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 -- 172.21.15.87:0/2932766628 learned_addr learned my addr 172.21.15.87:0/2932766628 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa21259c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2140740d0 0x7fa21414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa211d9b640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa2141463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 -- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 msgr2=0x7fa2141463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa2141463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 -- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2140740d0 msgr2=0x7fa21414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2140740d0 0x7fa21414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 -- 172.21.15.87:0/2932766628 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21406fa70 con 0x7fa214154ac0 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa212d9d640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214145640 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa20c01afd0 tx=0x7fa20c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0bb020 con 0x7fa214154ac0 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20c0b6660 con 0x7fa214154ac0 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c009510 con 0x7fa214154ac0 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2141f47b0 con 0x7fa214154ac0 2024-04-25T15:54:49.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.740+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141f4a90 con 0x7fa214154ac0 2024-04-25T15:54:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.744+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214069bb0 con 0x7fa214154ac0 2024-04-25T15:54:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.744+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa20c0be020 con 0x7fa214154ac0 2024-04-25T15:54:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.744+0000 7fa202ffd640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1f406f400 0x7fa1f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:49.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.744+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6695+0+0 (secure 0 0 0) 0x7fa20c12a820 con 0x7fa214154ac0 2024-04-25T15:54:49.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.744+0000 7fa21259c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1f406f400 0x7fa1f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:49.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.744+0000 7fa21259c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1f406f400 0x7fa1f4071910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa20400b810 tx=0x7fa204008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:49.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.748+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa20c0c5030 con 0x7fa214154ac0 2024-04-25T15:54:49.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.908+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fa21406a340 con 0x7fa214154ac0 2024-04-25T15:54:49.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.908+0000 7fa202ffd640 1 -- 172.21.15.87:0/2932766628 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7fa20c0165a0 con 0x7fa214154ac0 2024-04-25T15:54:49.910 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1f406f400 msgr2=0x7fa1f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1f406f400 0x7fa1f4071910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa20400b810 tx=0x7fa204008040 comp rx=0 tx=0).stop 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 msgr2=0x7fa214145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214145640 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa20c01afd0 tx=0x7fa20c0196c0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 shutdown_connections 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1f406f400 0x7fa1f4071910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa214154ac0 0x7fa214145640 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2140744e0 0x7fa2141463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 --2- 172.21.15.87:0/2932766628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2140740d0 0x7fa21414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 >> 172.21.15.87:0/2932766628 conn(0x7fa21406d650 msgr2=0x7fa214155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 shutdown_connections 2024-04-25T15:54:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:49.912+0000 7fa218f1c640 1 -- 172.21.15.87:0/2932766628 wait complete. 2024-04-25T15:54:49.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:50.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2cc2b640 1 Processor -- start 2024-04-25T15:54:50.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2cc2b640 1 -- start start 2024-04-25T15:54:50.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2cc2b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9f281518b0 0x7f9f2806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2cc2b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28154fc0 con 0x7f9f2806fa10 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2cc2b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f280acb20 con 0x7f9f280ad160 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2cc2b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2806ed60 con 0x7f9f281518b0 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9f281518b0 0x7f9f2806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f26d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9f2806fa10 0x7f9f2815e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:50020/0 (socket says 172.21.15.87:50020) 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2659c640 1 --2- 172.21.15.87:0/3642229878 >> v2:172.21.15.87:3300/0 conn(0x7f9f281518b0 0x7f9f2806f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41150/0 (socket says 172.21.15.87:41150) 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f26d9d640 1 -- 172.21.15.87:0/3642229878 learned_addr learned my addr 172.21.15.87:0/3642229878 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2659c640 1 -- 172.21.15.87:0/3642229878 >> v1:172.21.15.155:6789/0 conn(0x7f9f280ad160 legacy=0x7f9f280c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2659c640 1 -- 172.21.15.87:0/3642229878 >> v1:172.21.15.87:6789/0 conn(0x7f9f2806fa10 legacy=0x7f9f2815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.068+0000 7f9f2659c640 1 -- 172.21.15.87:0/3642229878 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280ace00 con 0x7f9f281518b0 2024-04-25T15:54:50.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2659c640 1 --2- 172.21.15.87:0/3642229878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f2806f4d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9f2806eee0 tx=0x7f9f1801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b60007fea16764 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2559a640 1 -- 172.21.15.87:0/3642229878 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180b0070 con 0x7f9f281518b0 2024-04-25T15:54:50.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2559a640 1 -- 172.21.15.87:0/3642229878 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f180ab600 con 0x7f9f281518b0 2024-04-25T15:54:50.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2559a640 1 -- 172.21.15.87:0/3642229878 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180ab9d0 con 0x7f9f281518b0 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3642229878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 msgr2=0x7f9f2806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3642229878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f2806f4d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9f2806eee0 tx=0x7f9f1801c2f0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3642229878 shutdown_connections 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3642229878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f2806f4d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3642229878 >> 172.21.15.87:0/3642229878 conn(0x7f9f280c8770 msgr2=0x7f9f280c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3642229878 shutdown_connections 2024-04-25T15:54:50.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.072+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3642229878 wait complete. 2024-04-25T15:54:50.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 Processor -- start 2024-04-25T15:54:50.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- start start 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f2806fa10 0x7f9f281dd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f280ad160 0x7f9f2814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f28147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280c4970 con 0x7f9f281518b0 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280c47f0 con 0x7f9f2806fa10 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f28071e50 con 0x7f9f280ad160 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f28147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f28147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41164/0 (socket says 172.21.15.87:41164) 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 -- 172.21.15.87:0/3272379445 learned_addr learned my addr 172.21.15.87:0/3272379445 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2659c640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f2806fa10 0x7f9f281dd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f25d9b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f280ad160 0x7f9f2814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 -- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f280ad160 msgr2=0x7f9f2814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f280ad160 0x7f9f2814fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 -- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f2806fa10 msgr2=0x7f9f281dd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f2806fa10 0x7f9f281dd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 -- 172.21.15.87:0/3272379445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f281de940 con 0x7f9f281518b0 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f26d9d640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f28147480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000e4d0 tx=0x7f9f2000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f200127f0 con 0x7f9f281518b0 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f20018070 con 0x7f9f281518b0 2024-04-25T15:54:50.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f280c68d0 con 0x7f9f281518b0 2024-04-25T15:54:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20012bd0 con 0x7f9f281518b0 2024-04-25T15:54:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f281ee840 con 0x7f9f281518b0 2024-04-25T15:54:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.076+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f280c6aa0 con 0x7f9f281518b0 2024-04-25T15:54:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.080+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f20013480 con 0x7f9f281518b0 2024-04-25T15:54:50.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.080+0000 7f9f16ffd640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f0806f430 0x7f9f08071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.080+0000 7f9f2659c640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f0806f430 0x7f9f08071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.080+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6695+0+0 (secure 0 0 0) 0x7f9f20092710 con 0x7f9f281518b0 2024-04-25T15:54:50.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.080+0000 7f9f2659c640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f0806f430 0x7f9f08071940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f180ad000 tx=0x7f9f180a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.084+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f2005f2b0 con 0x7f9f281518b0 2024-04-25T15:54:50.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.252+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f9f280abfa0 con 0x7f9f281518b0 2024-04-25T15:54:50.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.252+0000 7f9f16ffd640 1 -- 172.21.15.87:0/3272379445 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f9f2005ebb0 con 0x7f9f281518b0 2024-04-25T15:54:50.254 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:50.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f0806f430 msgr2=0x7f9f08071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f0806f430 0x7f9f08071940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9f180ad000 tx=0x7f9f180a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 msgr2=0x7f9f28147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f28147480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000e4d0 tx=0x7f9f2000e990 comp rx=0 tx=0).stop 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 shutdown_connections 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f0806f430 0x7f9f08071940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f281518b0 0x7f9f28147480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f280ad160 0x7f9f2814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 --2- 172.21.15.87:0/3272379445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f2806fa10 0x7f9f281dd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 >> 172.21.15.87:0/3272379445 conn(0x7f9f280c8770 msgr2=0x7f9f280c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 shutdown_connections 2024-04-25T15:54:50.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.256+0000 7f9f2cc2b640 1 -- 172.21.15.87:0/3272379445 wait complete. 2024-04-25T15:54:50.275 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:50.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 Processor -- start 2024-04-25T15:54:50.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 -- start start 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a141518b0 0x7f3a1406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a140ad160 0x7f3a140c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a140c4620 0x7f3a14157640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3a1406ed60 con 0x7f3a140ad160 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3a14154fc0 con 0x7f3a141518b0 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a193d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a140acb20 con 0x7f3a140c4620 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a140ad160 0x7f3a140c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a140ad160 0x7f3a140c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41168/0 (socket says 172.21.15.87:41168) 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 -- 172.21.15.87:0/1063129529 learned_addr learned my addr 172.21.15.87:0/1063129529 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a12ffd640 1 --2- 172.21.15.87:0/1063129529 >> v2:172.21.15.155:3300/0 conn(0x7f3a141518b0 0x7f3a1406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a137fe640 1 --2- 172.21.15.87:0/1063129529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a140c4620 0x7f3a14157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 -- 172.21.15.87:0/1063129529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a140c4620 msgr2=0x7f3a14157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 --2- 172.21.15.87:0/1063129529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a140c4620 0x7f3a14157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 -- 172.21.15.87:0/1063129529 >> v2:172.21.15.155:3300/0 conn(0x7f3a141518b0 msgr2=0x7f3a1406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 --2- 172.21.15.87:0/1063129529 >> v2:172.21.15.155:3300/0 conn(0x7f3a141518b0 0x7f3a1406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.424+0000 7f3a127fc640 1 -- 172.21.15.87:0/1063129529 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a140ace00 con 0x7f3a140ad160 2024-04-25T15:54:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a127fc640 1 --2- 172.21.15.87:0/1063129529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140ad160 0x7f3a140c40e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a140c4c70 tx=0x7f39fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4152d7504655c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a11ffb640 1 -- 172.21.15.87:0/1063129529 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0aa660 con 0x7f3a140ad160 2024-04-25T15:54:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a11ffb640 1 -- 172.21.15.87:0/1063129529 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc0af070 con 0x7f3a140ad160 2024-04-25T15:54:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a11ffb640 1 -- 172.21.15.87:0/1063129529 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0aaa20 con 0x7f3a140ad160 2024-04-25T15:54:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 -- 172.21.15.87:0/1063129529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140ad160 msgr2=0x7f3a140c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 --2- 172.21.15.87:0/1063129529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140ad160 0x7f3a140c40e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a140c4c70 tx=0x7f39fc01c520 comp rx=0 tx=0).stop 2024-04-25T15:54:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 -- 172.21.15.87:0/1063129529 shutdown_connections 2024-04-25T15:54:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 --2- 172.21.15.87:0/1063129529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a140c4620 0x7f3a14157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 --2- 172.21.15.87:0/1063129529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140ad160 0x7f3a140c40e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 --2- 172.21.15.87:0/1063129529 >> v2:172.21.15.155:3300/0 conn(0x7f3a141518b0 0x7f3a1406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 -- 172.21.15.87:0/1063129529 >> 172.21.15.87:0/1063129529 conn(0x7f3a140c8770 msgr2=0x7f3a140c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 -- 172.21.15.87:0/1063129529 shutdown_connections 2024-04-25T15:54:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.428+0000 7f3a193d2640 1 -- 172.21.15.87:0/1063129529 wait complete. 2024-04-25T15:54:50.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 Processor -- start 2024-04-25T15:54:50.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 -- start start 2024-04-25T15:54:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a140ad160 0x7f3a140c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 0x7f3a14148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a141518b0 0x7f3a141564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14160b40 con 0x7f3a140c4620 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141609c0 con 0x7f3a140ad160 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a14160cc0 con 0x7f3a141518b0 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 0x7f3a14148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 0x7f3a14148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41180/0 (socket says 172.21.15.87:41180) 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 -- 172.21.15.87:0/3257887988 learned_addr learned my addr 172.21.15.87:0/3257887988 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a12ffd640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a140ad160 0x7f3a140c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a137fe640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a141518b0 0x7f3a141564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 -- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a141518b0 msgr2=0x7f3a141564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a141518b0 0x7f3a141564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 -- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a140ad160 msgr2=0x7f3a140c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a140ad160 0x7f3a140c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 -- 172.21.15.87:0/3257887988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a14146e70 con 0x7f3a140c4620 2024-04-25T15:54:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a127fc640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 0x7f3a14148840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f39fc01abd0 tx=0x7f39fc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0bd5f0 con 0x7f3a140c4620 2024-04-25T15:54:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc0bd790 con 0x7f3a140c4620 2024-04-25T15:54:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a14146bd0 con 0x7f3a140c4620 2024-04-25T15:54:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0bdb80 con 0x7f3a140c4620 2024-04-25T15:54:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.432+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a141466f0 con 0x7f3a140c4620 2024-04-25T15:54:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.436+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a14069bb0 con 0x7f3a140c4620 2024-04-25T15:54:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.436+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39fc0b33f0 con 0x7f3a140c4620 2024-04-25T15:54:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.436+0000 7f3a0b7fe640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39f406f400 0x7f39f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.436+0000 7f3a12ffd640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39f406f400 0x7f39f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.436+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f39fc12a400 con 0x7f3a140c4620 2024-04-25T15:54:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.436+0000 7f3a12ffd640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39f406f400 0x7f39f4071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a140aad60 tx=0x7f3a0c009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.440+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39fc0c3060 con 0x7f3a140c4620 2024-04-25T15:54:50.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.588+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f3a140abfa0 con 0x7f3a140c4620 2024-04-25T15:54:50.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.588+0000 7f3a0b7fe640 1 -- 172.21.15.87:0/3257887988 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f39fc016110 con 0x7f3a140c4620 2024-04-25T15:54:50.591 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:50.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39f406f400 msgr2=0x7f39f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39f406f400 0x7f39f4071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a140aad60 tx=0x7f3a0c009830 comp rx=0 tx=0).stop 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 msgr2=0x7f3a14148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 0x7f3a14148840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f39fc01abd0 tx=0x7f39fc01ad60 comp rx=0 tx=0).stop 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 shutdown_connections 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39f406f400 0x7f39f4071910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a141518b0 0x7f3a141564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a140c4620 0x7f3a14148840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 --2- 172.21.15.87:0/3257887988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a140ad160 0x7f3a140c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 >> 172.21.15.87:0/3257887988 conn(0x7f3a140c8770 msgr2=0x7f3a14073e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 shutdown_connections 2024-04-25T15:54:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.592+0000 7f3a193d2640 1 -- 172.21.15.87:0/3257887988 wait complete. 2024-04-25T15:54:50.610 INFO:tasks.mds_thrash:mds thrasher using random seed: 1714060490 2024-04-25T15:54:50.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:50.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73d6387640 1 Processor -- start 2024-04-25T15:54:50.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73d6387640 1 -- start start 2024-04-25T15:54:50.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73d6387640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f73d00ad160 0x7f73d00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73d6387640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d0154fc0 con 0x7f73d01518b0 2024-04-25T15:54:50.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73d6387640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d00acb20 con 0x7f73d00c4620 2024-04-25T15:54:50.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73d6387640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f73d006ed60 con 0x7f73d00ad160 2024-04-25T15:54:50.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73cffff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f73d01518b0 0x7f73d006f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:50028/0 (socket says 172.21.15.87:50028) 2024-04-25T15:54:50.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73cffff640 1 -- 172.21.15.87:0/3532528885 learned_addr learned my addr 172.21.15.87:0/3532528885 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:50.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73cf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f73d00ad160 0x7f73d00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73cf7fe640 1 -- 172.21.15.87:0/3532528885 >> v1:172.21.15.155:6789/0 conn(0x7f73d00c4620 legacy=0x7f73d015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:50.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73cf7fe640 1 -- 172.21.15.87:0/3532528885 >> v1:172.21.15.87:6789/0 conn(0x7f73d01518b0 legacy=0x7f73d006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73ceffd640 1 -- 172.21.15.87:0/3532528885 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49645689 0 0) 0x7f73d0154fc0 con 0x7f73d01518b0 2024-04-25T15:54:50.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.752+0000 7f73cf7fe640 1 -- 172.21.15.87:0/3532528885 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d00ace00 con 0x7f73d00ad160 2024-04-25T15:54:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73cf7fe640 1 --2- 172.21.15.87:0/3532528885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d00ad160 0x7f73d00c40e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f73d006eee0 tx=0x7f73b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6feecb6b9099e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73ceffd640 1 -- 172.21.15.87:0/3532528885 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80b1070 con 0x7f73d00ad160 2024-04-25T15:54:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73ceffd640 1 -- 172.21.15.87:0/3532528885 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b80ac5f0 con 0x7f73d00ad160 2024-04-25T15:54:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73ceffd640 1 -- 172.21.15.87:0/3532528885 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80ac9c0 con 0x7f73d00ad160 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 -- 172.21.15.87:0/3532528885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d00ad160 msgr2=0x7f73d00c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 --2- 172.21.15.87:0/3532528885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d00ad160 0x7f73d00c40e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f73d006eee0 tx=0x7f73b801c460 comp rx=0 tx=0).stop 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 -- 172.21.15.87:0/3532528885 shutdown_connections 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 --2- 172.21.15.87:0/3532528885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d00ad160 0x7f73d00c40e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 -- 172.21.15.87:0/3532528885 >> 172.21.15.87:0/3532528885 conn(0x7f73d00c8770 msgr2=0x7f73d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 -- 172.21.15.87:0/3532528885 shutdown_connections 2024-04-25T15:54:50.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 -- 172.21.15.87:0/3532528885 wait complete. 2024-04-25T15:54:50.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 Processor -- start 2024-04-25T15:54:50.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.756+0000 7f73d6387640 1 -- start start 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73d00ad160 0x7f73d00bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00c4620 0x7f73d00c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 0x7f73d014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73d01628f0 con 0x7f73d01518b0 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f73d0162a70 con 0x7f73d00c4620 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73d0162bf0 con 0x7f73d00ad160 2024-04-25T15:54:50.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 0x7f73d014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 0x7f73d014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41194/0 (socket says 172.21.15.87:41194) 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 -- 172.21.15.87:0/100653664 learned_addr learned my addr 172.21.15.87:0/100653664 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73cf7fe640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00c4620 0x7f73d00c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73cffff640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73d00ad160 0x7f73d00bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 -- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73d00ad160 msgr2=0x7f73d00bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73d00ad160 0x7f73d00bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 -- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00c4620 msgr2=0x7f73d00c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00c4620 0x7f73d00c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 -- 172.21.15.87:0/100653664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d01594e0 con 0x7f73d01518b0 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73cf7fe640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00c4620 0x7f73d00c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73cffff640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73d00ad160 0x7f73d00bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d4924640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 0x7f73d014d710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73c800be90 tx=0x7f73c800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8019070 con 0x7f73d01518b0 2024-04-25T15:54:50.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c8014440 con 0x7f73d01518b0 2024-04-25T15:54:50.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d00beca0 con 0x7f73d01518b0 2024-04-25T15:54:50.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c8014830 con 0x7f73d01518b0 2024-04-25T15:54:50.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d00bf260 con 0x7f73d01518b0 2024-04-25T15:54:50.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d0069bb0 con 0x7f73d01518b0 2024-04-25T15:54:50.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f73c801c070 con 0x7f73d01518b0 2024-04-25T15:54:50.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.760+0000 7f73ccff9640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73b006f400 0x7f73b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:50.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.764+0000 7f73cffff640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73b006f400 0x7f73b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:50.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.764+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f73c808f6e0 con 0x7f73d01518b0 2024-04-25T15:54:50.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.764+0000 7f73cffff640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73b006f400 0x7f73b0071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73c0007fd0 tx=0x7f73c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:50.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.768+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73c805c360 con 0x7f73d01518b0 2024-04-25T15:54:50.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.916+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73d015feb0 con 0x7f73d01518b0 2024-04-25T15:54:50.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73ccff9640 1 -- 172.21.15.87:0/100653664 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20684 (secure 0 0 0) 0x7f73c805bc60 con 0x7f73d01518b0 2024-04-25T15:54:50.921 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:50.921 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:50.184879+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73b006f400 msgr2=0x7f73b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73b006f400 0x7f73b0071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73c0007fd0 tx=0x7f73c0009040 comp rx=0 tx=0).stop 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 msgr2=0x7f73d014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 0x7f73d014d710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73c800be90 tx=0x7f73c800bf80 comp rx=0 tx=0).stop 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 shutdown_connections 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73b006f400 0x7f73b0071910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73d01518b0 0x7f73d014d710 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73d00c4620 0x7f73d00c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 --2- 172.21.15.87:0/100653664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73d00ad160 0x7f73d00bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:50.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 >> 172.21.15.87:0/100653664 conn(0x7f73d00c8770 msgr2=0x7f73d0150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:50.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 shutdown_connections 2024-04-25T15:54:50.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:50.920+0000 7f73d6387640 1 -- 172.21.15.87:0/100653664 wait complete. 2024-04-25T15:54:50.942 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:50.943 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:51.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.080+0000 7ff3dbaf2640 1 Processor -- start 2024-04-25T15:54:51.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.080+0000 7ff3dbaf2640 1 -- start start 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.080+0000 7ff3dbaf2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3d415c4f0 0x7ff3d41671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.080+0000 7ff3dbaf2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d415f400 con 0x7ff3d415edf0 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.080+0000 7ff3dbaf2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d415f6e0 con 0x7ff3d40c4940 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.080+0000 7ff3dbaf2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff3d415f9c0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3da08f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3d415c4f0 0x7ff3d41671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3d908d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff3d415edf0 0x7ff3d415bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58844/0 (socket says 172.21.15.87:58844) 2024-04-25T15:54:51.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3d908d640 1 -- 172.21.15.87:0/2857676584 learned_addr learned my addr 172.21.15.87:0/2857676584 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:51.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3da08f640 1 -- 172.21.15.87:0/2857676584 >> v1:172.21.15.155:6789/0 conn(0x7ff3d40c4940 legacy=0x7ff3d406ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:51.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3da08f640 1 -- 172.21.15.87:0/2857676584 >> v1:172.21.15.87:6789/0 conn(0x7ff3d415edf0 legacy=0x7ff3d415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3d888c640 1 -- 172.21.15.87:0/2857676584 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709593979 0 0) 0x7ff3d415f400 con 0x7ff3d415edf0 2024-04-25T15:54:51.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3da08f640 1 -- 172.21.15.87:0/2857676584 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d415fca0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3da08f640 1 --2- 172.21.15.87:0/2857676584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d41671e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00097c0 tx=0x7ff3d001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a542b2cf66ca538a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3d888c640 1 -- 172.21.15.87:0/2857676584 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00b0070 con 0x7ff3d415c4f0 2024-04-25T15:54:51.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3d888c640 1 -- 172.21.15.87:0/2857676584 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d00ab600 con 0x7ff3d415c4f0 2024-04-25T15:54:51.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3d888c640 1 -- 172.21.15.87:0/2857676584 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00a4e60 con 0x7ff3d415c4f0 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/2857676584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 msgr2=0x7ff3d41671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/2857676584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d41671e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00097c0 tx=0x7ff3d001c3d0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/2857676584 shutdown_connections 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/2857676584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d41671e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/2857676584 >> 172.21.15.87:0/2857676584 conn(0x7ff3d40c8770 msgr2=0x7ff3d40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/2857676584 shutdown_connections 2024-04-25T15:54:51.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.084+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/2857676584 wait complete. 2024-04-25T15:54:51.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 Processor -- start 2024-04-25T15:54:51.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 -- start start 2024-04-25T15:54:51.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d40c4940 0x7ff3d414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d40c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d415edf0 0x7ff3d40c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d406f790 con 0x7ff3d415c4f0 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d406f610 con 0x7ff3d40c4940 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d4169f40 con 0x7ff3d415edf0 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d40c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d40c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52468/0 (socket says 172.21.15.87:52468) 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 -- 172.21.15.87:0/1917352394 learned_addr learned my addr 172.21.15.87:0/1917352394 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 -- 172.21.15.87:0/1917352394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d415edf0 msgr2=0x7ff3d40c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d415edf0 0x7ff3d40c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 -- 172.21.15.87:0/1917352394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d40c4940 msgr2=0x7ff3d414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d40c4940 0x7ff3d414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 -- 172.21.15.87:0/1917352394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d41f8a80 con 0x7ff3d415c4f0 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3d908d640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d40c75d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c3e0 tx=0x7ff3c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80074e0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c80047f0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d40c6dd0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8004be0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.088+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d4159290 con 0x7ff3d415c4f0 2024-04-25T15:54:51.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.092+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d41548c0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.092+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3c8011070 con 0x7ff3d415c4f0 2024-04-25T15:54:51.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.092+0000 7ff3c67fc640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3b806f400 0x7ff3b8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.092+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7ff3c808f200 con 0x7ff3d415c4f0 2024-04-25T15:54:51.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.092+0000 7ff3d988e640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3b806f400 0x7ff3b8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.092+0000 7ff3d988e640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3b806f400 0x7ff3b8071910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406fa90 tx=0x7ff3cc009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.096+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3d41548c0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.256+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3d4069bb0 con 0x7ff3d415c4f0 2024-04-25T15:54:51.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.256+0000 7ff3c67fc640 1 -- 172.21.15.87:0/1917352394 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7ff3c805be30 con 0x7ff3d415c4f0 2024-04-25T15:54:51.258 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:51.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3b806f400 msgr2=0x7ff3b8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3b806f400 0x7ff3b8071910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406fa90 tx=0x7ff3cc009230 comp rx=0 tx=0).stop 2024-04-25T15:54:51.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 msgr2=0x7ff3d40c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d40c75d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c3e0 tx=0x7ff3c800c8a0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 shutdown_connections 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff3b806f400 0x7ff3b8071910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d415edf0 0x7ff3d40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d415c4f0 0x7ff3d40c75d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 --2- 172.21.15.87:0/1917352394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d40c4940 0x7ff3d414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 >> 172.21.15.87:0/1917352394 conn(0x7ff3d40c8770 msgr2=0x7ff3d41595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 shutdown_connections 2024-04-25T15:54:51.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.260+0000 7ff3dbaf2640 1 -- 172.21.15.87:0/1917352394 wait complete. 2024-04-25T15:54:51.278 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:51.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 Processor -- start 2024-04-25T15:54:51.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 -- start start 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feba015ab10 0x7feba015af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feba015fe30 0x7feba0162250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba00c45a0 con 0x7feba0154ca0 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7feba00c9f30 con 0x7feba015ab10 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feba4e58640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7feba00c3fe0 con 0x7feba015fe30 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feba015ab10 0x7feba015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feba015ab10 0x7feba015af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52470/0 (socket says 172.21.15.87:52470) 2024-04-25T15:54:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 -- 172.21.15.87:0/2670316873 learned_addr learned my addr 172.21.15.87:0/2670316873 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9ed9d640 1 --2- 172.21.15.87:0/2670316873 >> v2:172.21.15.155:3300/0 conn(0x7feba015fe30 0x7feba0162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 -- 172.21.15.87:0/2670316873 >> v2:172.21.15.155:3300/0 conn(0x7feba015fe30 msgr2=0x7feba0162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 --2- 172.21.15.87:0/2670316873 >> v2:172.21.15.155:3300/0 conn(0x7feba015fe30 0x7feba0162250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 -- 172.21.15.87:0/2670316873 >> v1:172.21.15.155:6789/0 conn(0x7feba0154ca0 legacy=0x7feba00c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.428+0000 7feb9dd9b640 1 -- 172.21.15.87:0/2670316873 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00c42c0 con 0x7feba015ab10 2024-04-25T15:54:51.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feb9dd9b640 1 --2- 172.21.15.87:0/2670316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015ab10 0x7feba015af20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feba01586b0 tx=0x7feb9001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416fcd7820771668 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feb9d59a640 1 -- 172.21.15.87:0/2670316873 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb900b0070 con 0x7feba015ab10 2024-04-25T15:54:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feb9d59a640 1 -- 172.21.15.87:0/2670316873 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb900ab600 con 0x7feba015ab10 2024-04-25T15:54:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feb9d59a640 1 -- 172.21.15.87:0/2670316873 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb900ab9d0 con 0x7feba015ab10 2024-04-25T15:54:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 -- 172.21.15.87:0/2670316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015ab10 msgr2=0x7feba015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 --2- 172.21.15.87:0/2670316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015ab10 0x7feba015af20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feba01586b0 tx=0x7feb9001c450 comp rx=0 tx=0).stop 2024-04-25T15:54:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 -- 172.21.15.87:0/2670316873 shutdown_connections 2024-04-25T15:54:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 --2- 172.21.15.87:0/2670316873 >> v2:172.21.15.155:3300/0 conn(0x7feba015fe30 0x7feba0162250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 --2- 172.21.15.87:0/2670316873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015ab10 0x7feba015af20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 -- 172.21.15.87:0/2670316873 >> 172.21.15.87:0/2670316873 conn(0x7feba00ac5c0 msgr2=0x7feba00ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 -- 172.21.15.87:0/2670316873 shutdown_connections 2024-04-25T15:54:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.432+0000 7feba4e58640 1 -- 172.21.15.87:0/2670316873 wait complete. 2024-04-25T15:54:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 Processor -- start 2024-04-25T15:54:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- start start 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 0x7feba0153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba015ab10 0x7feba01f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015fe30 0x7feba0143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feba00c3dc0 con 0x7feba0154ca0 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feba00c3c40 con 0x7feba015fe30 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feba015b460 con 0x7feba015ab10 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 0x7feba0153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 0x7feba0153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52472/0 (socket says 172.21.15.87:52472) 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 -- 172.21.15.87:0/4121413378 learned_addr learned my addr 172.21.15.87:0/4121413378 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9dd9b640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba015ab10 0x7feba01f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9ed9d640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015fe30 0x7feba0143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 -- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba015ab10 msgr2=0x7feba01f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba015ab10 0x7feba01f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 -- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015fe30 msgr2=0x7feba0143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015fe30 0x7feba0143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 -- 172.21.15.87:0/4121413378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba0152560 con 0x7feba0154ca0 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb9e59c640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 0x7feba0153ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feb9400b440 tx=0x7feb9400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94015020 con 0x7feba0154ca0 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb94011890 con 0x7feba0154ca0 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94011c80 con 0x7feba0154ca0 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba006aa80 con 0x7feba0154ca0 2024-04-25T15:54:51.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba00ac030 con 0x7feba0154ca0 2024-04-25T15:54:51.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.436+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba00abe20 con 0x7feba0154ca0 2024-04-25T15:54:51.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.440+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7feb94018020 con 0x7feba0154ca0 2024-04-25T15:54:51.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.440+0000 7feb8effd640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb8006f400 0x7feb80071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.440+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7feb9408f540 con 0x7feba0154ca0 2024-04-25T15:54:51.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.440+0000 7feb9dd9b640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb8006f400 0x7feb80071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.440+0000 7feb9dd9b640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb8006f400 0x7feb80071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feba0075260 tx=0x7feb90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.444+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb9401f030 con 0x7feba0154ca0 2024-04-25T15:54:51.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.592+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7feba0069bb0 con 0x7feba0154ca0 2024-04-25T15:54:51.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.592+0000 7feb8effd640 1 -- 172.21.15.87:0/4121413378 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7feb9400d040 con 0x7feba0154ca0 2024-04-25T15:54:51.595 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:51.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb8006f400 msgr2=0x7feb80071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb8006f400 0x7feb80071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feba0075260 tx=0x7feb90008040 comp rx=0 tx=0).stop 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 msgr2=0x7feba0153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 0x7feba0153ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feb9400b440 tx=0x7feb9400b900 comp rx=0 tx=0).stop 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 shutdown_connections 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb8006f400 0x7feb80071910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015fe30 0x7feba0143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba015ab10 0x7feba01f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 --2- 172.21.15.87:0/4121413378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba0154ca0 0x7feba0153ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 >> 172.21.15.87:0/4121413378 conn(0x7feba00ac5c0 msgr2=0x7feba00ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 shutdown_connections 2024-04-25T15:54:51.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.596+0000 7feba4e58640 1 -- 172.21.15.87:0/4121413378 wait complete. 2024-04-25T15:54:51.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:51.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 Processor -- start 2024-04-25T15:54:51.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 -- start start 2024-04-25T15:54:51.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29f00cb030 0x7f29f015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f0160230 0x7f29f0162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f00c7570 con 0x7f29f015ad90 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f29f015b8b0 con 0x7f29f00cb030 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f8664640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29f015b5d0 con 0x7f29f0160230 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f5bff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29f00cb030 0x7f29f015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f6400640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f29f015ad90 0x7f29f00ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58852/0 (socket says 172.21.15.87:58852) 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f6400640 1 -- 172.21.15.87:0/3969175164 learned_addr learned my addr 172.21.15.87:0/3969175164 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f5bff640 1 -- 172.21.15.87:0/3969175164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f0160230 msgr2=0x7f29f0162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f6c01640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f0160230 0x7f29f0162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f53fe640 1 -- 172.21.15.87:0/3969175164 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679562421 0 0) 0x7f29f00c7570 con 0x7f29f015ad90 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f5bff640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f0160230 0x7f29f0162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f5bff640 1 -- 172.21.15.87:0/3969175164 >> v1:172.21.15.87:6789/0 conn(0x7f29f015ad90 legacy=0x7f29f00ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f5bff640 1 -- 172.21.15.87:0/3969175164 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f00c2290 con 0x7f29f00cb030 2024-04-25T15:54:51.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.760+0000 7f29f6c01640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f0160230 0x7f29f0162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:51.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f5bff640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00cb030 0x7f29f015fcf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097c0 tx=0x7f29e001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801484a785d25dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f53fe640 1 -- 172.21.15.87:0/3969175164 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e00b0070 con 0x7f29f00cb030 2024-04-25T15:54:51.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f53fe640 1 -- 172.21.15.87:0/3969175164 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e00ab600 con 0x7f29f00cb030 2024-04-25T15:54:51.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f53fe640 1 -- 172.21.15.87:0/3969175164 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e00ab9d0 con 0x7f29f00cb030 2024-04-25T15:54:51.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 -- 172.21.15.87:0/3969175164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00cb030 msgr2=0x7f29f015fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00cb030 0x7f29f015fcf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097c0 tx=0x7f29e001c380 comp rx=0 tx=0).stop 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 -- 172.21.15.87:0/3969175164 shutdown_connections 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f00cb030 0x7f29f015fcf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 --2- 172.21.15.87:0/3969175164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f0160230 0x7f29f0162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 -- 172.21.15.87:0/3969175164 >> 172.21.15.87:0/3969175164 conn(0x7f29f00c9330 msgr2=0x7f29f00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 -- 172.21.15.87:0/3969175164 shutdown_connections 2024-04-25T15:54:51.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 -- 172.21.15.87:0/3969175164 wait complete. 2024-04-25T15:54:51.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 Processor -- start 2024-04-25T15:54:51.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.764+0000 7f29f8664640 1 -- start start 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f00cb030 0x7f29f0147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f015ad90 0x7f29f01612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 0x7f29f014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f29f015b1a0 con 0x7f29f0160230 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29f00ca190 con 0x7f29f00cb030 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29f015b320 con 0x7f29f015ad90 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 0x7f29f014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 0x7f29f014ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52490/0 (socket says 172.21.15.87:52490) 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 -- 172.21.15.87:0/662850929 learned_addr learned my addr 172.21.15.87:0/662850929 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6400640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f00cb030 0x7f29f0147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f5bff640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f015ad90 0x7f29f01612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 -- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f015ad90 msgr2=0x7f29f01612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f015ad90 0x7f29f01612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 -- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f00cb030 msgr2=0x7f29f0147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f00cb030 0x7f29f0147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 -- 172.21.15.87:0/662850929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f01470a0 con 0x7f29f0160230 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6400640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f00cb030 0x7f29f0147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6c01640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 0x7f29f014ce80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f29e800cd40 tx=0x7f29e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8003ba0 con 0x7f29f0160230 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e8003d60 con 0x7f29f0160230 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f0147ff0 con 0x7f29f0160230 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8004260 con 0x7f29f0160230 2024-04-25T15:54:51.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f0160020 con 0x7f29f0160230 2024-04-25T15:54:51.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f0069bb0 con 0x7f29f0160230 2024-04-25T15:54:51.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f29e8004400 con 0x7f29f0160230 2024-04-25T15:54:51.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29e6ffd640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f29d406f400 0x7f29d4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:51.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f29e8090030 con 0x7f29f0160230 2024-04-25T15:54:51.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.768+0000 7f29f6400640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f29d406f400 0x7f29d4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:51.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.772+0000 7f29f6400640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f29d406f400 0x7f29d4071910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29ec007fd0 tx=0x7f29ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:51.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.776+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f29e8014030 con 0x7f29f0160230 2024-04-25T15:54:51.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.932+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f29f00c7760 con 0x7f29f0160230 2024-04-25T15:54:51.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29e6ffd640 1 -- 172.21.15.87:0/662850929 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f29e805cbd0 con 0x7f29f0160230 2024-04-25T15:54:51.936 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:51.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f29d406f400 msgr2=0x7f29d4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f29d406f400 0x7f29d4071910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29ec007fd0 tx=0x7f29ec009040 comp rx=0 tx=0).stop 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 msgr2=0x7f29f014ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 0x7f29f014ce80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f29e800cd40 tx=0x7f29e800a650 comp rx=0 tx=0).stop 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 shutdown_connections 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f29d406f400 0x7f29d4071910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f0160230 0x7f29f014ce80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f015ad90 0x7f29f01612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 --2- 172.21.15.87:0/662850929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f00cb030 0x7f29f0147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 >> 172.21.15.87:0/662850929 conn(0x7f29f00c9330 msgr2=0x7f29f015a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 shutdown_connections 2024-04-25T15:54:51.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:51.936+0000 7f29f8664640 1 -- 172.21.15.87:0/662850929 wait complete. 2024-04-25T15:54:51.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f0688d640 1 Processor -- start 2024-04-25T15:54:52.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f0688d640 1 -- start start 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f0688d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f000c48f0 0x7f6f00160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f0688d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f00072430 con 0x7f6f00071e50 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f0688d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f00074730 con 0x7f6f001529a0 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f0688d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6f00074a10 con 0x7f6f000c48f0 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f04e2a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f000c48f0 0x7f6f00160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f04e2a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f000c48f0 0x7f6f00160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52498/0 (socket says 172.21.15.87:52498) 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3075661186 learned_addr learned my addr 172.21.15.87:0/3075661186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:52.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6ef7fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6f00071e50 0x7f6f000c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58858/0 (socket says 172.21.15.87:58858) 2024-04-25T15:54:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3075661186 >> v1:172.21.15.155:6789/0 conn(0x7f6f001529a0 legacy=0x7f6f000ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3075661186 >> v1:172.21.15.87:6789/0 conn(0x7f6f00071e50 legacy=0x7f6f000c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6eff7fe640 1 -- 172.21.15.87:0/3075661186 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580657285 0 0) 0x7f6f00072430 con 0x7f6f00071e50 2024-04-25T15:54:52.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.104+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3075661186 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f00074cf0 con 0x7f6f000c48f0 2024-04-25T15:54:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f04e2a640 1 --2- 172.21.15.87:0/3075661186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f000c48f0 0x7f6f00160ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009e50 tx=0x7f6ef801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5f942d5a767c43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6eff7fe640 1 -- 172.21.15.87:0/3075661186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80a5660 con 0x7f6f000c48f0 2024-04-25T15:54:52.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6eff7fe640 1 -- 172.21.15.87:0/3075661186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef80a5800 con 0x7f6f000c48f0 2024-04-25T15:54:52.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6eff7fe640 1 -- 172.21.15.87:0/3075661186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80a5bd0 con 0x7f6f000c48f0 2024-04-25T15:54:52.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 -- 172.21.15.87:0/3075661186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f000c48f0 msgr2=0x7f6f00160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3075661186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f000c48f0 0x7f6f00160ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009e50 tx=0x7f6ef801c9a0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 -- 172.21.15.87:0/3075661186 shutdown_connections 2024-04-25T15:54:52.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3075661186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f000c48f0 0x7f6f00160ae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 -- 172.21.15.87:0/3075661186 >> 172.21.15.87:0/3075661186 conn(0x7f6f000c8770 msgr2=0x7f6f000c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:52.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 -- 172.21.15.87:0/3075661186 shutdown_connections 2024-04-25T15:54:52.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.108+0000 7f6f0688d640 1 -- 172.21.15.87:0/3075661186 wait complete. 2024-04-25T15:54:52.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 Processor -- start 2024-04-25T15:54:52.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- start start 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f00071e50 0x7f6f000c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f000c48f0 0x7f6f001438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 0x7f6f00158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f000c4d00 con 0x7f6f001529a0 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00163840 con 0x7f6f00071e50 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f001445d0 con 0x7f6f000c48f0 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 0x7f6f00158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 0x7f6f00158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52502/0 (socket says 172.21.15.87:52502) 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3981938912 learned_addr learned my addr 172.21.15.87:0/3981938912 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6efffff640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f00071e50 0x7f6f000c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6ef7fff640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f000c48f0 0x7f6f001438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f000c48f0 msgr2=0x7f6f001438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f000c48f0 0x7f6f001438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f00071e50 msgr2=0x7f6f000c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f00071e50 0x7f6f000c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 -- 172.21.15.87:0/3981938912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0014b1c0 con 0x7f6f001529a0 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f04e2a640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 0x7f6f00158c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80af040 tx=0x7f6ef8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80bc020 con 0x7f6f001529a0 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef80b8670 con 0x7f6f001529a0 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f000c61e0 con 0x7f6f001529a0 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80b8aa0 con 0x7f6f001529a0 2024-04-25T15:54:52.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f000c70e0 con 0x7f6f001529a0 2024-04-25T15:54:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.112+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f00143420 con 0x7f6f001529a0 2024-04-25T15:54:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.116+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6ef80bf020 con 0x7f6f001529a0 2024-04-25T15:54:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.116+0000 7f6efd7fa640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6ee006f400 0x7f6ee0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.116+0000 7f6efffff640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6ee006f400 0x7f6ee0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.116+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f6ef812a6a0 con 0x7f6f001529a0 2024-04-25T15:54:52.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.116+0000 7f6efffff640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6ee006f400 0x7f6ee0071910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8000f70 tx=0x7f6ee8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.120+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f00143420 con 0x7f6f001529a0 2024-04-25T15:54:52.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.272+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f6f001f23f0 con 0x7f6f001529a0 2024-04-25T15:54:52.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.272+0000 7f6efd7fa640 1 -- 172.21.15.87:0/3981938912 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f6ef80c6030 con 0x7f6f001529a0 2024-04-25T15:54:52.274 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:52.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6ee006f400 msgr2=0x7f6ee0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6ee006f400 0x7f6ee0071910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8000f70 tx=0x7f6ee8009040 comp rx=0 tx=0).stop 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 msgr2=0x7f6f00158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 0x7f6f00158c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80af040 tx=0x7f6ef8019740 comp rx=0 tx=0).stop 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 shutdown_connections 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6ee006f400 0x7f6ee0071910 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f001529a0 0x7f6f00158c20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f000c48f0 0x7f6f001438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 --2- 172.21.15.87:0/3981938912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f00071e50 0x7f6f000c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 >> 172.21.15.87:0/3981938912 conn(0x7f6f000c8770 msgr2=0x7f6f0006ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 shutdown_connections 2024-04-25T15:54:52.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.276+0000 7f6f0688d640 1 -- 172.21.15.87:0/3981938912 wait complete. 2024-04-25T15:54:52.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:52.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 Processor -- start 2024-04-25T15:54:52.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 -- start start 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a381517d0 0x7f5a380c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a380c9ae0 0x7f5a381578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380c5290 con 0x7f5a38157df0 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5a380c5e80 con 0x7f5a381517d0 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a3e632640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a38154fd0 con 0x7f5a380c9ae0 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a381517d0 0x7f5a380c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a381517d0 0x7f5a380c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52514/0 (socket says 172.21.15.87:52514) 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 -- 172.21.15.87:0/3447486640 learned_addr learned my addr 172.21.15.87:0/3447486640 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a377fe640 1 --2- 172.21.15.87:0/3447486640 >> v2:172.21.15.155:3300/0 conn(0x7f5a380c9ae0 0x7f5a381578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 -- 172.21.15.87:0/3447486640 >> v2:172.21.15.155:3300/0 conn(0x7f5a380c9ae0 msgr2=0x7f5a381578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 --2- 172.21.15.87:0/3447486640 >> v2:172.21.15.155:3300/0 conn(0x7f5a380c9ae0 0x7f5a381578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 -- 172.21.15.87:0/3447486640 >> v1:172.21.15.155:6789/0 conn(0x7f5a38157df0 legacy=0x7f5a3806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.448+0000 7f5a37fff640 1 -- 172.21.15.87:0/3447486640 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a380c5550 con 0x7f5a381517d0 2024-04-25T15:54:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a37fff640 1 --2- 172.21.15.87:0/3447486640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a381517d0 0x7f5a380c95a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a38074ca0 tx=0x7f5a2c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4b3098a59ac964 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a36ffd640 1 -- 172.21.15.87:0/3447486640 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0b0070 con 0x7f5a381517d0 2024-04-25T15:54:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a36ffd640 1 -- 172.21.15.87:0/3447486640 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0ab600 con 0x7f5a381517d0 2024-04-25T15:54:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a36ffd640 1 -- 172.21.15.87:0/3447486640 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0ab9d0 con 0x7f5a381517d0 2024-04-25T15:54:52.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 -- 172.21.15.87:0/3447486640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a381517d0 msgr2=0x7f5a380c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 --2- 172.21.15.87:0/3447486640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a381517d0 0x7f5a380c95a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a38074ca0 tx=0x7f5a2c01c4e0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 -- 172.21.15.87:0/3447486640 shutdown_connections 2024-04-25T15:54:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 --2- 172.21.15.87:0/3447486640 >> v2:172.21.15.155:3300/0 conn(0x7f5a380c9ae0 0x7f5a381578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 --2- 172.21.15.87:0/3447486640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a381517d0 0x7f5a380c95a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 -- 172.21.15.87:0/3447486640 >> 172.21.15.87:0/3447486640 conn(0x7f5a3806d780 msgr2=0x7f5a3806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 -- 172.21.15.87:0/3447486640 shutdown_connections 2024-04-25T15:54:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 -- 172.21.15.87:0/3447486640 wait complete. 2024-04-25T15:54:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.452+0000 7f5a3e632640 1 Processor -- start 2024-04-25T15:54:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- start start 2024-04-25T15:54:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 0x7f5a38073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a381517d0 0x7f5a381edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a38157df0 0x7f5a38147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380a90f0 con 0x7f5a380c9ae0 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380a8f70 con 0x7f5a38157df0 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a38161ab0 con 0x7f5a381517d0 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 0x7f5a38073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 0x7f5a38073580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52520/0 (socket says 172.21.15.87:52520) 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 -- 172.21.15.87:0/720330333 learned_addr learned my addr 172.21.15.87:0/720330333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3cbcf640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a38157df0 0x7f5a38147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 -- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a381517d0 msgr2=0x7f5a381edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a381517d0 0x7f5a381edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 -- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a38157df0 msgr2=0x7f5a38147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a38157df0 0x7f5a38147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 -- 172.21.15.87:0/720330333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a381f1340 con 0x7f5a380c9ae0 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a37fff640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 0x7f5a38073580 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c01ab90 tx=0x7f5a2c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0b0040 con 0x7f5a380c9ae0 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0bc070 con 0x7f5a380c9ae0 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a381f1620 con 0x7f5a380c9ae0 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0b6640 con 0x7f5a380c9ae0 2024-04-25T15:54:52.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a381f1be0 con 0x7f5a380c9ae0 2024-04-25T15:54:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a38069bb0 con 0x7f5a380c9ae0 2024-04-25T15:54:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.456+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5a2c0b67e0 con 0x7f5a380c9ae0 2024-04-25T15:54:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.460+0000 7f5a34ff9640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a2406f430 0x7f5a24071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.460+0000 7f5a377fe640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a2406f430 0x7f5a24071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.460+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f5a2c129950 con 0x7f5a380c9ae0 2024-04-25T15:54:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.460+0000 7f5a377fe640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a2406f430 0x7f5a24071940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a380c9250 tx=0x7f5a28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.464+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a2c0160d0 con 0x7f5a380c9ae0 2024-04-25T15:54:52.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.612+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f5a380c4910 con 0x7f5a380c9ae0 2024-04-25T15:54:52.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.612+0000 7f5a34ff9640 1 -- 172.21.15.87:0/720330333 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f5a2c0f6460 con 0x7f5a380c9ae0 2024-04-25T15:54:52.615 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a2406f430 msgr2=0x7f5a24071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a2406f430 0x7f5a24071940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a380c9250 tx=0x7f5a28008040 comp rx=0 tx=0).stop 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 msgr2=0x7f5a38073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 0x7f5a38073580 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c01ab90 tx=0x7f5a2c01ad20 comp rx=0 tx=0).stop 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 shutdown_connections 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a2406f430 0x7f5a24071940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a38157df0 0x7f5a38147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a381517d0 0x7f5a381edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 --2- 172.21.15.87:0/720330333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380c9ae0 0x7f5a38073580 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 >> 172.21.15.87:0/720330333 conn(0x7f5a3806d780 msgr2=0x7f5a38144490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 shutdown_connections 2024-04-25T15:54:52.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.616+0000 7f5a3e632640 1 -- 172.21.15.87:0/720330333 wait complete. 2024-04-25T15:54:52.635 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-04-25T15:54:52.635 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:52.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.780+0000 7ff32f646640 1 Processor -- start 2024-04-25T15:54:52.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.780+0000 7ff32f646640 1 -- start start 2024-04-25T15:54:52.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32f646640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3281529a0 0x7ff328071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32f646640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff3280adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32f646640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff328072430 con 0x7ff3280c41e0 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32f646640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff328074730 con 0x7ff3281529a0 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32f646640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff328074a10 con 0x7ff3280ad990 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32d3e2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3281529a0 0x7ff328071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32dbe3640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff3280c41e0 0x7ff3280c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58874/0 (socket says 172.21.15.87:58874) 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32dbe3640 1 -- 172.21.15.87:0/3966658473 learned_addr learned my addr 172.21.15.87:0/3966658473 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:52.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32cbe1640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff3280adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32d3e2640 1 -- 172.21.15.87:0/3966658473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 msgr2=0x7ff3280adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32d3e2640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff3280adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32d3e2640 1 -- 172.21.15.87:0/3966658473 >> v1:172.21.15.87:6789/0 conn(0x7ff3280c41e0 legacy=0x7ff3280c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32d3e2640 1 -- 172.21.15.87:0/3966658473 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff328074cf0 con 0x7ff3281529a0 2024-04-25T15:54:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32cbe1640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff3280adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:52.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff327fff640 1 -- 172.21.15.87:0/3966658473 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293245887 0 0) 0x7ff328072430 con 0x7ff3280c41e0 2024-04-25T15:54:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff32d3e2640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3281529a0 0x7ff328071e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff320009d90 tx=0x7ff32001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbbf55546e111f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff327fff640 1 -- 172.21.15.87:0/3966658473 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200b2070 con 0x7ff3281529a0 2024-04-25T15:54:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff327fff640 1 -- 172.21.15.87:0/3966658473 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200a57a0 con 0x7ff3281529a0 2024-04-25T15:54:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.784+0000 7ff327fff640 1 -- 172.21.15.87:0/3966658473 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200a5b70 con 0x7ff3281529a0 2024-04-25T15:54:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- 172.21.15.87:0/3966658473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3281529a0 msgr2=0x7ff328071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3281529a0 0x7ff328071e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff320009d90 tx=0x7ff32001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- 172.21.15.87:0/3966658473 shutdown_connections 2024-04-25T15:54:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff3280adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 --2- 172.21.15.87:0/3966658473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3281529a0 0x7ff328071e50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- 172.21.15.87:0/3966658473 >> 172.21.15.87:0/3966658473 conn(0x7ff3280c8770 msgr2=0x7ff3280c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- 172.21.15.87:0/3966658473 shutdown_connections 2024-04-25T15:54:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- 172.21.15.87:0/3966658473 wait complete. 2024-04-25T15:54:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 Processor -- start 2024-04-25T15:54:52.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- start start 2024-04-25T15:54:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff32814dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 0x7ff32815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3281529a0 0x7ff328145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff328162470 con 0x7ff3280c41e0 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3281622f0 con 0x7ff3281529a0 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32f646640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3281625f0 con 0x7ff3280ad990 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32cbe1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 0x7ff32815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32cbe1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 0x7ff32815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52534/0 (socket says 172.21.15.87:52534) 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.788+0000 7ff32cbe1640 1 -- 172.21.15.87:0/562656920 learned_addr learned my addr 172.21.15.87:0/562656920 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32d3e2640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff32814dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32dbe3640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3281529a0 0x7ff328145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32cbe1640 1 -- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 msgr2=0x7ff32814dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32cbe1640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff32814dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32cbe1640 1 -- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3281529a0 msgr2=0x7ff328145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32cbe1640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3281529a0 0x7ff328145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32cbe1640 1 -- 172.21.15.87:0/562656920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3281f3b60 con 0x7ff3280c41e0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32cbe1640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 0x7ff32815e080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c820 tx=0x7ff31c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c015070 con 0x7ff3280c41e0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c004220 con 0x7ff3280c41e0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3281f3e40 con 0x7ff3280c41e0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00ce10 con 0x7ff3280c41e0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3281f4400 con 0x7ff3280c41e0 2024-04-25T15:54:52.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff328069bb0 con 0x7ff3280c41e0 2024-04-25T15:54:52.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff31c007830 con 0x7ff3280c41e0 2024-04-25T15:54:52.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff325ffb640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:52.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7ff31c08f2e0 con 0x7ff3280c41e0 2024-04-25T15:54:52.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32d3e2640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:52.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.792+0000 7ff32d3e2640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3200af000 tx=0x7ff3200a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:52.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.796+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff31c05bf10 con 0x7ff3280c41e0 2024-04-25T15:54:52.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.996+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3280c4690 con 0x7ff3280c41e0 2024-04-25T15:54:53.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:52.996+0000 7ff325ffb640 1 -- 172.21.15.87:0/562656920 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7ff31c0620e0 con 0x7ff3280c41e0 2024-04-25T15:54:53.000 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:53.000 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:53.000 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:53.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 msgr2=0x7ff314071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3200af000 tx=0x7ff3200a7070 comp rx=0 tx=0).stop 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 msgr2=0x7ff32815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 0x7ff32815e080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c820 tx=0x7ff31c00cce0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 shutdown_connections 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3281529a0 0x7ff328145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3280c41e0 0x7ff32815e080 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 --2- 172.21.15.87:0/562656920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3280ad990 0x7ff32814dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 >> 172.21.15.87:0/562656920 conn(0x7ff3280c8770 msgr2=0x7ff3280c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 shutdown_connections 2024-04-25T15:54:53.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.000+0000 7ff32f646640 1 -- 172.21.15.87:0/562656920 wait complete. 2024-04-25T15:54:53.022 INFO:tasks.mds_thrash:Ready to start thrashing 2024-04-25T15:54:53.022 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-04-25T15:54:53.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:53.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 Processor -- start 2024-04-25T15:54:53.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 -- start start 2024-04-25T15:54:53.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18dc1518b0 0x7f18dc06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc0c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18dc154fc0 con 0x7f18dc0c4620 2024-04-25T15:54:53.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f18dc06ed60 con 0x7f18dc1518b0 2024-04-25T15:54:53.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e2bab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f18dc0acb20 con 0x7f18dc0ad160 2024-04-25T15:54:53.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18dc1518b0 0x7f18dc06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18d3fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc0c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18dc1518b0 0x7f18dc06f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:59406/0 (socket says 172.21.15.87:59406) 2024-04-25T15:54:53.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 -- 172.21.15.87:0/1847202102 learned_addr learned my addr 172.21.15.87:0/1847202102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:53.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 -- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 msgr2=0x7f18dc0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:53.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 --2- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc0c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 -- 172.21.15.87:0/1847202102 >> v1:172.21.15.155:6789/0 conn(0x7f18dc0c4620 legacy=0x7f18dc157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18e0947640 1 -- 172.21.15.87:0/1847202102 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18dc0ace00 con 0x7f18dc1518b0 2024-04-25T15:54:53.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.156+0000 7f18d3fff640 1 --2- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:53.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e0947640 1 --2- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc06f4d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009870 tx=0x7f18d801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6487990872834552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18d37fe640 1 -- 172.21.15.87:0/1847202102 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80a9640 con 0x7f18dc1518b0 2024-04-25T15:54:53.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18d37fe640 1 -- 172.21.15.87:0/1847202102 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d80a97e0 con 0x7f18dc1518b0 2024-04-25T15:54:53.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18d37fe640 1 -- 172.21.15.87:0/1847202102 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80a9bb0 con 0x7f18dc1518b0 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 -- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 msgr2=0x7f18dc06f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 --2- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc06f4d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009870 tx=0x7f18d801c560 comp rx=0 tx=0).stop 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 -- 172.21.15.87:0/1847202102 shutdown_connections 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 --2- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc0c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 --2- 172.21.15.87:0/1847202102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc06f4d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 -- 172.21.15.87:0/1847202102 >> 172.21.15.87:0/1847202102 conn(0x7f18dc0c8770 msgr2=0x7f18dc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 -- 172.21.15.87:0/1847202102 shutdown_connections 2024-04-25T15:54:53.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.160+0000 7f18e2bab640 1 -- 172.21.15.87:0/1847202102 wait complete. 2024-04-25T15:54:53.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 Processor -- start 2024-04-25T15:54:53.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 -- start start 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 0x7f18dc142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc1f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f18dc161d60 con 0x7f18dc0c4620 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18dc161be0 con 0x7f18dc1518b0 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f18dc161ee0 con 0x7f18dc0ad160 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 0x7f18dc142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 0x7f18dc142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52538/0 (socket says 172.21.15.87:52538) 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 -- 172.21.15.87:0/204271576 learned_addr learned my addr 172.21.15.87:0/204271576 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e1148640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc1f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e0947640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 -- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 msgr2=0x7f18dc1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 -- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 msgr2=0x7f18dc1f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc1f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 -- 172.21.15.87:0/204271576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18dc155e20 con 0x7f18dc0c4620 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d3fff640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 0x7f18dc142890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e9b0 tx=0x7f18cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc017070 con 0x7f18dc0c4620 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18cc00ca00 con 0x7f18dc0c4620 2024-04-25T15:54:53.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00cdd0 con 0x7f18dc0c4620 2024-04-25T15:54:53.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18dc158ab0 con 0x7f18dc0c4620 2024-04-25T15:54:53.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.164+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18dc1560a0 con 0x7f18dc0c4620 2024-04-25T15:54:53.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.168+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18dc069bb0 con 0x7f18dc0c4620 2024-04-25T15:54:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.168+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f18cc01a070 con 0x7f18dc0c4620 2024-04-25T15:54:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.168+0000 7f18d17fa640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f18c806f400 0x7f18c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.168+0000 7f18e0947640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f18c806f400 0x7f18c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.168+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f18cc08fb90 con 0x7f18dc0c4620 2024-04-25T15:54:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.168+0000 7f18e0947640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f18c806f400 0x7f18c8071910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ae000 tx=0x7f18d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.172+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18dc155e20 con 0x7f18dc0c4620 2024-04-25T15:54:53.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.320+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18dc1f5510 con 0x7f18c806f400 2024-04-25T15:54:53.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.352+0000 7f18d17fa640 1 -- 172.21.15.87:0/204271576 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490401 (secure 0 0 0) 0x7f18dc1f5510 con 0x7f18c806f400 2024-04-25T15:54:53.362 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:53.366 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f18c806f400 msgr2=0x7f18c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f18c806f400 0x7f18c8071910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f18d80ae000 tx=0x7f18d8009040 comp rx=0 tx=0).stop 2024-04-25T15:54:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 msgr2=0x7f18dc142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 0x7f18dc142890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e9b0 tx=0x7f18cc00ee70 comp rx=0 tx=0).stop 2024-04-25T15:54:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 shutdown_connections 2024-04-25T15:54:53.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f18c806f400 0x7f18c8071910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18dc1518b0 0x7f18dc1f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc0c4620 0x7f18dc142890 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 --2- 172.21.15.87:0/204271576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18dc0ad160 0x7f18dc1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 >> 172.21.15.87:0/204271576 conn(0x7f18dc0c8770 msgr2=0x7f18dc0741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 shutdown_connections 2024-04-25T15:54:53.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.360+0000 7f18e2bab640 1 -- 172.21.15.87:0/204271576 wait complete. 2024-04-25T15:54:53.385 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-04-25T15:54:53.117025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596070,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":195,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":389,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3547136,"data_stored":2098260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":882,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003042"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623593+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:50.623593+0000","last_peered":"2024-04-25T15:54:50.623593+0000","last_clean":"2024-04-25T15:54:50.623593+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:50.623593+0000","last_undegraded":"2024-04-25T15:54:50.623593+0000","last_fullsized":"2024-04-25T15:54:50.623593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623787+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:50.623787+0000","last_peered":"2024-04-25T15:54:50.623787+0000","last_clean":"2024-04-25T15:54:50.623787+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:50.623787+0000","last_undegraded":"2024-04-25T15:54:50.623787+0000","last_fullsized":"2024-04-25T15:54:50.623787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201386+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:50.201386+0000","last_peered":"2024-04-25T15:54:50.201386+0000","last_clean":"2024-04-25T15:54:50.201386+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:50.201386+0000","last_undegraded":"2024-04-25T15:54:50.201386+0000","last_fullsized":"2024-04-25T15:54:50.201386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199876+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:50.199876+0000","last_peered":"2024-04-25T15:54:50.199876+0000","last_clean":"2024-04-25T15:54:50.199876+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:50.199876+0000","last_undegraded":"2024-04-25T15:54:50.199876+0000","last_fullsized":"2024-04-25T15:54:50.199876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207311+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:50.207311+0000","last_peered":"2024-04-25T15:54:50.207311+0000","last_clean":"2024-04-25T15:54:50.207311+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:50.207311+0000","last_undegraded":"2024-04-25T15:54:50.207311+0000","last_fullsized":"2024-04-25T15:54:50.207311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201847+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:50.201847+0000","last_peered":"2024-04-25T15:54:50.201847+0000","last_clean":"2024-04-25T15:54:50.201847+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:50.201847+0000","last_undegraded":"2024-04-25T15:54:50.201847+0000","last_fullsized":"2024-04-25T15:54:50.201847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622933+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:50.622933+0000","last_peered":"2024-04-25T15:54:50.622933+0000","last_clean":"2024-04-25T15:54:50.622933+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:50.622933+0000","last_undegraded":"2024-04-25T15:54:50.622933+0000","last_fullsized":"2024-04-25T15:54:50.622933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623974+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:50.623974+0000","last_peered":"2024-04-25T15:54:50.623974+0000","last_clean":"2024-04-25T15:54:50.623974+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:50.623974+0000","last_undegraded":"2024-04-25T15:54:50.623974+0000","last_fullsized":"2024-04-25T15:54:50.623974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212070+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:50.212070+0000","last_peered":"2024-04-25T15:54:50.212070+0000","last_clean":"2024-04-25T15:54:50.212070+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:50.212070+0000","last_undegraded":"2024-04-25T15:54:50.212070+0000","last_fullsized":"2024-04-25T15:54:50.212070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215172+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:50.215172+0000","last_peered":"2024-04-25T15:54:50.215172+0000","last_clean":"2024-04-25T15:54:50.215172+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:50.215172+0000","last_undegraded":"2024-04-25T15:54:50.215172+0000","last_fullsized":"2024-04-25T15:54:50.215172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203775+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:50.203775+0000","last_peered":"2024-04-25T15:54:50.203775+0000","last_clean":"2024-04-25T15:54:50.203775+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:50.203775+0000","last_undegraded":"2024-04-25T15:54:50.203775+0000","last_fullsized":"2024-04-25T15:54:50.203775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624486+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:50.624486+0000","last_peered":"2024-04-25T15:54:50.624486+0000","last_clean":"2024-04-25T15:54:50.624486+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:50.624486+0000","last_undegraded":"2024-04-25T15:54:50.624486+0000","last_fullsized":"2024-04-25T15:54:50.624486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203201+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:50.203201+0000","last_peered":"2024-04-25T15:54:50.203201+0000","last_clean":"2024-04-25T15:54:50.203201+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:50.203201+0000","last_undegraded":"2024-04-25T15:54:50.203201+0000","last_fullsized":"2024-04-25T15:54:50.203201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213316+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:50.213316+0000","last_peered":"2024-04-25T15:54:50.213316+0000","last_clean":"2024-04-25T15:54:50.213316+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:50.213316+0000","last_undegraded":"2024-04-25T15:54:50.213316+0000","last_fullsized":"2024-04-25T15:54:50.213316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204667+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:50.204667+0000","last_peered":"2024-04-25T15:54:50.204667+0000","last_clean":"2024-04-25T15:54:50.204667+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:50.204667+0000","last_undegraded":"2024-04-25T15:54:50.204667+0000","last_fullsized":"2024-04-25T15:54:50.204667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624016+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:50.624016+0000","last_peered":"2024-04-25T15:54:50.624016+0000","last_clean":"2024-04-25T15:54:50.624016+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:50.624016+0000","last_undegraded":"2024-04-25T15:54:50.624016+0000","last_fullsized":"2024-04-25T15:54:50.624016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208037+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:50.208037+0000","last_peered":"2024-04-25T15:54:50.208037+0000","last_clean":"2024-04-25T15:54:50.208037+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:50.208037+0000","last_undegraded":"2024-04-25T15:54:50.208037+0000","last_fullsized":"2024-04-25T15:54:50.208037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207285+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:50.207285+0000","last_peered":"2024-04-25T15:54:50.207285+0000","last_clean":"2024-04-25T15:54:50.207285+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:50.207285+0000","last_undegraded":"2024-04-25T15:54:50.207285+0000","last_fullsized":"2024-04-25T15:54:50.207285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212064+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:50.212064+0000","last_peered":"2024-04-25T15:54:50.212064+0000","last_clean":"2024-04-25T15:54:50.212064+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:50.212064+0000","last_undegraded":"2024-04-25T15:54:50.212064+0000","last_fullsized":"2024-04-25T15:54:50.212064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625062+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:50.625062+0000","last_peered":"2024-04-25T15:54:50.625062+0000","last_clean":"2024-04-25T15:54:50.625062+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:50.625062+0000","last_undegraded":"2024-04-25T15:54:50.625062+0000","last_fullsized":"2024-04-25T15:54:50.625062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204629+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:50.204629+0000","last_peered":"2024-04-25T15:54:50.204629+0000","last_clean":"2024-04-25T15:54:50.204629+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:50.204629+0000","last_undegraded":"2024-04-25T15:54:50.204629+0000","last_fullsized":"2024-04-25T15:54:50.204629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200033+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:50.200033+0000","last_peered":"2024-04-25T15:54:50.200033+0000","last_clean":"2024-04-25T15:54:50.200033+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:50.200033+0000","last_undegraded":"2024-04-25T15:54:50.200033+0000","last_fullsized":"2024-04-25T15:54:50.200033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208435+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:50.208435+0000","last_peered":"2024-04-25T15:54:50.208435+0000","last_clean":"2024-04-25T15:54:50.208435+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:50.208435+0000","last_undegraded":"2024-04-25T15:54:50.208435+0000","last_fullsized":"2024-04-25T15:54:50.208435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625126+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:50.625126+0000","last_peered":"2024-04-25T15:54:50.625126+0000","last_clean":"2024-04-25T15:54:50.625126+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:50.625126+0000","last_undegraded":"2024-04-25T15:54:50.625126+0000","last_fullsized":"2024-04-25T15:54:50.625126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625014+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:50.625014+0000","last_peered":"2024-04-25T15:54:50.625014+0000","last_clean":"2024-04-25T15:54:50.625014+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:50.625014+0000","last_undegraded":"2024-04-25T15:54:50.625014+0000","last_fullsized":"2024-04-25T15:54:50.625014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201187+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:50.201187+0000","last_peered":"2024-04-25T15:54:50.201187+0000","last_clean":"2024-04-25T15:54:50.201187+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:50.201187+0000","last_undegraded":"2024-04-25T15:54:50.201187+0000","last_fullsized":"2024-04-25T15:54:50.201187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.209227+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:50.209227+0000","last_peered":"2024-04-25T15:54:50.209227+0000","last_clean":"2024-04-25T15:54:50.209227+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:50.209227+0000","last_undegraded":"2024-04-25T15:54:50.209227+0000","last_fullsized":"2024-04-25T15:54:50.209227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208644+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:50.208644+0000","last_peered":"2024-04-25T15:54:50.208644+0000","last_clean":"2024-04-25T15:54:50.208644+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:50.208644+0000","last_undegraded":"2024-04-25T15:54:50.208644+0000","last_fullsized":"2024-04-25T15:54:50.208644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204363+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:50.204363+0000","last_peered":"2024-04-25T15:54:50.204363+0000","last_clean":"2024-04-25T15:54:50.204363+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:50.204363+0000","last_undegraded":"2024-04-25T15:54:50.204363+0000","last_fullsized":"2024-04-25T15:54:50.204363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622545+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:50.622545+0000","last_peered":"2024-04-25T15:54:50.622545+0000","last_clean":"2024-04-25T15:54:50.622545+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:50.622545+0000","last_undegraded":"2024-04-25T15:54:50.622545+0000","last_fullsized":"2024-04-25T15:54:50.622545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211334+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:50.211334+0000","last_peered":"2024-04-25T15:54:50.211334+0000","last_clean":"2024-04-25T15:54:50.211334+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:50.211334+0000","last_undegraded":"2024-04-25T15:54:50.211334+0000","last_fullsized":"2024-04-25T15:54:50.211334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625243+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:50.625243+0000","last_peered":"2024-04-25T15:54:50.625243+0000","last_clean":"2024-04-25T15:54:50.625243+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:50.625243+0000","last_undegraded":"2024-04-25T15:54:50.625243+0000","last_fullsized":"2024-04-25T15:54:50.625243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199497+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:50.199497+0000","last_peered":"2024-04-25T15:54:50.199497+0000","last_clean":"2024-04-25T15:54:50.199497+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:50.199497+0000","last_undegraded":"2024-04-25T15:54:50.199497+0000","last_fullsized":"2024-04-25T15:54:50.199497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622635+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:50.622635+0000","last_peered":"2024-04-25T15:54:50.622635+0000","last_clean":"2024-04-25T15:54:50.622635+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:50.622635+0000","last_undegraded":"2024-04-25T15:54:50.622635+0000","last_fullsized":"2024-04-25T15:54:50.622635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207014+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:50.207014+0000","last_peered":"2024-04-25T15:54:50.207014+0000","last_clean":"2024-04-25T15:54:50.207014+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:50.207014+0000","last_undegraded":"2024-04-25T15:54:50.207014+0000","last_fullsized":"2024-04-25T15:54:50.207014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623518+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:50.623518+0000","last_peered":"2024-04-25T15:54:50.623518+0000","last_clean":"2024-04-25T15:54:50.623518+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:50.623518+0000","last_undegraded":"2024-04-25T15:54:50.623518+0000","last_fullsized":"2024-04-25T15:54:50.623518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623247+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:50.623247+0000","last_peered":"2024-04-25T15:54:50.623247+0000","last_clean":"2024-04-25T15:54:50.623247+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:50.623247+0000","last_undegraded":"2024-04-25T15:54:50.623247+0000","last_fullsized":"2024-04-25T15:54:50.623247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202126+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:50.202126+0000","last_peered":"2024-04-25T15:54:50.202126+0000","last_clean":"2024-04-25T15:54:50.202126+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:50.202126+0000","last_undegraded":"2024-04-25T15:54:50.202126+0000","last_fullsized":"2024-04-25T15:54:50.202126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208896+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:50.208896+0000","last_peered":"2024-04-25T15:54:50.208896+0000","last_clean":"2024-04-25T15:54:50.208896+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:50.208896+0000","last_undegraded":"2024-04-25T15:54:50.208896+0000","last_fullsized":"2024-04-25T15:54:50.208896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199497+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:50.199497+0000","last_peered":"2024-04-25T15:54:50.199497+0000","last_clean":"2024-04-25T15:54:50.199497+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:50.199497+0000","last_undegraded":"2024-04-25T15:54:50.199497+0000","last_fullsized":"2024-04-25T15:54:50.199497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206872+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:50.206872+0000","last_peered":"2024-04-25T15:54:50.206872+0000","last_clean":"2024-04-25T15:54:50.206872+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:50.206872+0000","last_undegraded":"2024-04-25T15:54:50.206872+0000","last_fullsized":"2024-04-25T15:54:50.206872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.209136+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:50.209136+0000","last_peered":"2024-04-25T15:54:50.209136+0000","last_clean":"2024-04-25T15:54:50.209136+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:50.209136+0000","last_undegraded":"2024-04-25T15:54:50.209136+0000","last_fullsized":"2024-04-25T15:54:50.209136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215734+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:50.215734+0000","last_peered":"2024-04-25T15:54:50.215734+0000","last_clean":"2024-04-25T15:54:50.215734+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:50.215734+0000","last_undegraded":"2024-04-25T15:54:50.215734+0000","last_fullsized":"2024-04-25T15:54:50.215734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623506+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:50.623506+0000","last_peered":"2024-04-25T15:54:50.623506+0000","last_clean":"2024-04-25T15:54:50.623506+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:50.623506+0000","last_undegraded":"2024-04-25T15:54:50.623506+0000","last_fullsized":"2024-04-25T15:54:50.623506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623814+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:50.623814+0000","last_peered":"2024-04-25T15:54:50.623814+0000","last_clean":"2024-04-25T15:54:50.623814+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:50.623814+0000","last_undegraded":"2024-04-25T15:54:50.623814+0000","last_fullsized":"2024-04-25T15:54:50.623814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214162+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T15:54:50.214162+0000","last_peered":"2024-04-25T15:54:50.214162+0000","last_clean":"2024-04-25T15:54:50.214162+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T15:54:50.214162+0000","last_undegraded":"2024-04-25T15:54:50.214162+0000","last_fullsized":"2024-04-25T15:54:50.214162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208854+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:50.208854+0000","last_peered":"2024-04-25T15:54:50.208854+0000","last_clean":"2024-04-25T15:54:50.208854+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:50.208854+0000","last_undegraded":"2024-04-25T15:54:50.208854+0000","last_fullsized":"2024-04-25T15:54:50.208854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207971+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:50.207971+0000","last_peered":"2024-04-25T15:54:50.207971+0000","last_clean":"2024-04-25T15:54:50.207971+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:50.207971+0000","last_undegraded":"2024-04-25T15:54:50.207971+0000","last_fullsized":"2024-04-25T15:54:50.207971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623567+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:50.623567+0000","last_peered":"2024-04-25T15:54:50.623567+0000","last_clean":"2024-04-25T15:54:50.623567+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:50.623567+0000","last_undegraded":"2024-04-25T15:54:50.623567+0000","last_fullsized":"2024-04-25T15:54:50.623567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625403+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:50.625403+0000","last_peered":"2024-04-25T15:54:50.625403+0000","last_clean":"2024-04-25T15:54:50.625403+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:50.625403+0000","last_undegraded":"2024-04-25T15:54:50.625403+0000","last_fullsized":"2024-04-25T15:54:50.625403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203394+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:50.203394+0000","last_peered":"2024-04-25T15:54:50.203394+0000","last_clean":"2024-04-25T15:54:50.203394+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:50.203394+0000","last_undegraded":"2024-04-25T15:54:50.203394+0000","last_fullsized":"2024-04-25T15:54:50.203394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208549+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:50.208549+0000","last_peered":"2024-04-25T15:54:50.208549+0000","last_clean":"2024-04-25T15:54:50.208549+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:50.208549+0000","last_undegraded":"2024-04-25T15:54:50.208549+0000","last_fullsized":"2024-04-25T15:54:50.208549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204593+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:50.204593+0000","last_peered":"2024-04-25T15:54:50.204593+0000","last_clean":"2024-04-25T15:54:50.204593+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:50.204593+0000","last_undegraded":"2024-04-25T15:54:50.204593+0000","last_fullsized":"2024-04-25T15:54:50.204593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207717+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:50.207717+0000","last_peered":"2024-04-25T15:54:50.207717+0000","last_clean":"2024-04-25T15:54:50.207717+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:50.207717+0000","last_undegraded":"2024-04-25T15:54:50.207717+0000","last_fullsized":"2024-04-25T15:54:50.207717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205589+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:50.205589+0000","last_peered":"2024-04-25T15:54:50.205589+0000","last_clean":"2024-04-25T15:54:50.205589+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:50.205589+0000","last_undegraded":"2024-04-25T15:54:50.205589+0000","last_fullsized":"2024-04-25T15:54:50.205589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208777+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:50.208777+0000","last_peered":"2024-04-25T15:54:50.208777+0000","last_clean":"2024-04-25T15:54:50.208777+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:50.208777+0000","last_undegraded":"2024-04-25T15:54:50.208777+0000","last_fullsized":"2024-04-25T15:54:50.208777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204634+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:50.204634+0000","last_peered":"2024-04-25T15:54:50.204634+0000","last_clean":"2024-04-25T15:54:50.204634+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:50.204634+0000","last_undegraded":"2024-04-25T15:54:50.204634+0000","last_fullsized":"2024-04-25T15:54:50.204634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623181+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:50.623181+0000","last_peered":"2024-04-25T15:54:50.623181+0000","last_clean":"2024-04-25T15:54:50.623181+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:50.623181+0000","last_undegraded":"2024-04-25T15:54:50.623181+0000","last_fullsized":"2024-04-25T15:54:50.623181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211387+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:50.211387+0000","last_peered":"2024-04-25T15:54:50.211387+0000","last_clean":"2024-04-25T15:54:50.211387+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:50.211387+0000","last_undegraded":"2024-04-25T15:54:50.211387+0000","last_fullsized":"2024-04-25T15:54:50.211387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623887+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:50.623887+0000","last_peered":"2024-04-25T15:54:50.623887+0000","last_clean":"2024-04-25T15:54:50.623887+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:50.623887+0000","last_undegraded":"2024-04-25T15:54:50.623887+0000","last_fullsized":"2024-04-25T15:54:50.623887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211756+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:50.211756+0000","last_peered":"2024-04-25T15:54:50.211756+0000","last_clean":"2024-04-25T15:54:50.211756+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:50.211756+0000","last_undegraded":"2024-04-25T15:54:50.211756+0000","last_fullsized":"2024-04-25T15:54:50.211756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200580+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:50.200580+0000","last_peered":"2024-04-25T15:54:50.200580+0000","last_clean":"2024-04-25T15:54:50.200580+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:50.200580+0000","last_undegraded":"2024-04-25T15:54:50.200580+0000","last_fullsized":"2024-04-25T15:54:50.200580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203394+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:50.203394+0000","last_peered":"2024-04-25T15:54:50.203394+0000","last_clean":"2024-04-25T15:54:50.203394+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:50.203394+0000","last_undegraded":"2024-04-25T15:54:50.203394+0000","last_fullsized":"2024-04-25T15:54:50.203394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211562+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:50.211562+0000","last_peered":"2024-04-25T15:54:50.211562+0000","last_clean":"2024-04-25T15:54:50.211562+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:50.211562+0000","last_undegraded":"2024-04-25T15:54:50.211562+0000","last_fullsized":"2024-04-25T15:54:50.211562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206060+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:50.206060+0000","last_peered":"2024-04-25T15:54:50.206060+0000","last_clean":"2024-04-25T15:54:50.206060+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:50.206060+0000","last_undegraded":"2024-04-25T15:54:50.206060+0000","last_fullsized":"2024-04-25T15:54:50.206060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205501+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:50.205501+0000","last_peered":"2024-04-25T15:54:50.205501+0000","last_clean":"2024-04-25T15:54:50.205501+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:50.205501+0000","last_undegraded":"2024-04-25T15:54:50.205501+0000","last_fullsized":"2024-04-25T15:54:50.205501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.218519+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T15:54:50.218519+0000","last_peered":"2024-04-25T15:54:50.218519+0000","last_clean":"2024-04-25T15:54:50.218519+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T15:54:50.218519+0000","last_undegraded":"2024-04-25T15:54:50.218519+0000","last_fullsized":"2024-04-25T15:54:50.218519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206444+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:50.206444+0000","last_peered":"2024-04-25T15:54:50.206444+0000","last_clean":"2024-04-25T15:54:50.206444+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:50.206444+0000","last_undegraded":"2024-04-25T15:54:50.206444+0000","last_fullsized":"2024-04-25T15:54:50.206444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207024+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:50.207024+0000","last_peered":"2024-04-25T15:54:50.207024+0000","last_clean":"2024-04-25T15:54:50.207024+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:50.207024+0000","last_undegraded":"2024-04-25T15:54:50.207024+0000","last_fullsized":"2024-04-25T15:54:50.207024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204340+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:50.204340+0000","last_peered":"2024-04-25T15:54:50.204340+0000","last_clean":"2024-04-25T15:54:50.204340+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:50.204340+0000","last_undegraded":"2024-04-25T15:54:50.204340+0000","last_fullsized":"2024-04-25T15:54:50.204340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213297+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T15:54:50.213297+0000","last_peered":"2024-04-25T15:54:50.213297+0000","last_clean":"2024-04-25T15:54:50.213297+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T15:54:50.213297+0000","last_undegraded":"2024-04-25T15:54:50.213297+0000","last_fullsized":"2024-04-25T15:54:50.213297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.210895+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:50.210895+0000","last_peered":"2024-04-25T15:54:50.210895+0000","last_clean":"2024-04-25T15:54:50.210895+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:50.210895+0000","last_undegraded":"2024-04-25T15:54:50.210895+0000","last_fullsized":"2024-04-25T15:54:50.210895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623154+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:50.623154+0000","last_peered":"2024-04-25T15:54:50.623154+0000","last_clean":"2024-04-25T15:54:50.623154+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:50.623154+0000","last_undegraded":"2024-04-25T15:54:50.623154+0000","last_fullsized":"2024-04-25T15:54:50.623154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211197+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:50.211197+0000","last_peered":"2024-04-25T15:54:50.211197+0000","last_clean":"2024-04-25T15:54:50.211197+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:50.211197+0000","last_undegraded":"2024-04-25T15:54:50.211197+0000","last_fullsized":"2024-04-25T15:54:50.211197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215210+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:50.215210+0000","last_peered":"2024-04-25T15:54:50.215210+0000","last_clean":"2024-04-25T15:54:50.215210+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:50.215210+0000","last_undegraded":"2024-04-25T15:54:50.215210+0000","last_fullsized":"2024-04-25T15:54:50.215210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206081+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:50.206081+0000","last_peered":"2024-04-25T15:54:50.206081+0000","last_clean":"2024-04-25T15:54:50.206081+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:50.206081+0000","last_undegraded":"2024-04-25T15:54:50.206081+0000","last_fullsized":"2024-04-25T15:54:50.206081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202416+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:50.202416+0000","last_peered":"2024-04-25T15:54:50.202416+0000","last_clean":"2024-04-25T15:54:50.202416+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:50.202416+0000","last_undegraded":"2024-04-25T15:54:50.202416+0000","last_fullsized":"2024-04-25T15:54:50.202416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206112+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:50.206112+0000","last_peered":"2024-04-25T15:54:50.206112+0000","last_clean":"2024-04-25T15:54:50.206112+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:50.206112+0000","last_undegraded":"2024-04-25T15:54:50.206112+0000","last_fullsized":"2024-04-25T15:54:50.206112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214705+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:50.214705+0000","last_peered":"2024-04-25T15:54:50.214705+0000","last_clean":"2024-04-25T15:54:50.214705+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:50.214705+0000","last_undegraded":"2024-04-25T15:54:50.214705+0000","last_fullsized":"2024-04-25T15:54:50.214705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625685+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:50.625685+0000","last_peered":"2024-04-25T15:54:50.625685+0000","last_clean":"2024-04-25T15:54:50.625685+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:50.625685+0000","last_undegraded":"2024-04-25T15:54:50.625685+0000","last_fullsized":"2024-04-25T15:54:50.625685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623390+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:50.623390+0000","last_peered":"2024-04-25T15:54:50.623390+0000","last_clean":"2024-04-25T15:54:50.623390+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:50.623390+0000","last_undegraded":"2024-04-25T15:54:50.623390+0000","last_fullsized":"2024-04-25T15:54:50.623390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201524+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:50.201524+0000","last_peered":"2024-04-25T15:54:50.201524+0000","last_clean":"2024-04-25T15:54:50.201524+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:50.201524+0000","last_undegraded":"2024-04-25T15:54:50.201524+0000","last_fullsized":"2024-04-25T15:54:50.201524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211861+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:50.211861+0000","last_peered":"2024-04-25T15:54:50.211861+0000","last_clean":"2024-04-25T15:54:50.211861+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:50.211861+0000","last_undegraded":"2024-04-25T15:54:50.211861+0000","last_fullsized":"2024-04-25T15:54:50.211861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204497+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:50.204497+0000","last_peered":"2024-04-25T15:54:50.204497+0000","last_clean":"2024-04-25T15:54:50.204497+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:50.204497+0000","last_undegraded":"2024-04-25T15:54:50.204497+0000","last_fullsized":"2024-04-25T15:54:50.204497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623838+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:50.623838+0000","last_peered":"2024-04-25T15:54:50.623838+0000","last_clean":"2024-04-25T15:54:50.623838+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:50.623838+0000","last_undegraded":"2024-04-25T15:54:50.623838+0000","last_fullsized":"2024-04-25T15:54:50.623838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204798+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:50.204798+0000","last_peered":"2024-04-25T15:54:50.204798+0000","last_clean":"2024-04-25T15:54:50.204798+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:50.204798+0000","last_undegraded":"2024-04-25T15:54:50.204798+0000","last_fullsized":"2024-04-25T15:54:50.204798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205220+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:50.205220+0000","last_peered":"2024-04-25T15:54:50.205220+0000","last_clean":"2024-04-25T15:54:50.205220+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:50.205220+0000","last_undegraded":"2024-04-25T15:54:50.205220+0000","last_fullsized":"2024-04-25T15:54:50.205220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207350+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:50.207350+0000","last_peered":"2024-04-25T15:54:50.207350+0000","last_clean":"2024-04-25T15:54:50.207350+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:50.207350+0000","last_undegraded":"2024-04-25T15:54:50.207350+0000","last_fullsized":"2024-04-25T15:54:50.207350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201801+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:50.201801+0000","last_peered":"2024-04-25T15:54:50.201801+0000","last_clean":"2024-04-25T15:54:50.201801+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:50.201801+0000","last_undegraded":"2024-04-25T15:54:50.201801+0000","last_fullsized":"2024-04-25T15:54:50.201801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203781+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:50.203781+0000","last_peered":"2024-04-25T15:54:50.203781+0000","last_clean":"2024-04-25T15:54:50.203781+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:50.203781+0000","last_undegraded":"2024-04-25T15:54:50.203781+0000","last_fullsized":"2024-04-25T15:54:50.203781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211910+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:50.211910+0000","last_peered":"2024-04-25T15:54:50.211910+0000","last_clean":"2024-04-25T15:54:50.211910+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:50.211910+0000","last_undegraded":"2024-04-25T15:54:50.211910+0000","last_fullsized":"2024-04-25T15:54:50.211910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203500+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:50.203500+0000","last_peered":"2024-04-25T15:54:50.203500+0000","last_clean":"2024-04-25T15:54:50.203500+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:50.203500+0000","last_undegraded":"2024-04-25T15:54:50.203500+0000","last_fullsized":"2024-04-25T15:54:50.203500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201268+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:50.201268+0000","last_peered":"2024-04-25T15:54:50.201268+0000","last_clean":"2024-04-25T15:54:50.201268+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:50.201268+0000","last_undegraded":"2024-04-25T15:54:50.201268+0000","last_fullsized":"2024-04-25T15:54:50.201268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201169+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:50.201169+0000","last_peered":"2024-04-25T15:54:50.201169+0000","last_clean":"2024-04-25T15:54:50.201169+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:50.201169+0000","last_undegraded":"2024-04-25T15:54:50.201169+0000","last_fullsized":"2024-04-25T15:54:50.201169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622255+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:50.622255+0000","last_peered":"2024-04-25T15:54:50.622255+0000","last_clean":"2024-04-25T15:54:50.622255+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:50.622255+0000","last_undegraded":"2024-04-25T15:54:50.622255+0000","last_fullsized":"2024-04-25T15:54:50.622255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624036+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:50.624036+0000","last_peered":"2024-04-25T15:54:50.624036+0000","last_clean":"2024-04-25T15:54:50.624036+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:50.624036+0000","last_undegraded":"2024-04-25T15:54:50.624036+0000","last_fullsized":"2024-04-25T15:54:50.624036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204545+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:50.204545+0000","last_peered":"2024-04-25T15:54:50.204545+0000","last_clean":"2024-04-25T15:54:50.204545+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:50.204545+0000","last_undegraded":"2024-04-25T15:54:50.204545+0000","last_fullsized":"2024-04-25T15:54:50.204545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199925+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:50.199925+0000","last_peered":"2024-04-25T15:54:50.199925+0000","last_clean":"2024-04-25T15:54:50.199925+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:50.199925+0000","last_undegraded":"2024-04-25T15:54:50.199925+0000","last_fullsized":"2024-04-25T15:54:50.199925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214847+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:50.214847+0000","last_peered":"2024-04-25T15:54:50.214847+0000","last_clean":"2024-04-25T15:54:50.214847+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:50.214847+0000","last_undegraded":"2024-04-25T15:54:50.214847+0000","last_fullsized":"2024-04-25T15:54:50.214847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206537+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:50.206537+0000","last_peered":"2024-04-25T15:54:50.206537+0000","last_clean":"2024-04-25T15:54:50.206537+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:50.206537+0000","last_undegraded":"2024-04-25T15:54:50.206537+0000","last_fullsized":"2024-04-25T15:54:50.206537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207810+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:50.207810+0000","last_peered":"2024-04-25T15:54:50.207810+0000","last_clean":"2024-04-25T15:54:50.207810+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:50.207810+0000","last_undegraded":"2024-04-25T15:54:50.207810+0000","last_fullsized":"2024-04-25T15:54:50.207810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208232+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:50.208232+0000","last_peered":"2024-04-25T15:54:50.208232+0000","last_clean":"2024-04-25T15:54:50.208232+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:50.208232+0000","last_undegraded":"2024-04-25T15:54:50.208232+0000","last_fullsized":"2024-04-25T15:54:50.208232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622677+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:50.622677+0000","last_peered":"2024-04-25T15:54:50.622677+0000","last_clean":"2024-04-25T15:54:50.622677+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:50.622677+0000","last_undegraded":"2024-04-25T15:54:50.622677+0000","last_fullsized":"2024-04-25T15:54:50.622677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211211+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:50.211211+0000","last_peered":"2024-04-25T15:54:50.211211+0000","last_clean":"2024-04-25T15:54:50.211211+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:50.211211+0000","last_undegraded":"2024-04-25T15:54:50.211211+0000","last_fullsized":"2024-04-25T15:54:50.211211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624862+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:50.624862+0000","last_peered":"2024-04-25T15:54:50.624862+0000","last_clean":"2024-04-25T15:54:50.624862+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:50.624862+0000","last_undegraded":"2024-04-25T15:54:50.624862+0000","last_fullsized":"2024-04-25T15:54:50.624862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206075+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:50.206075+0000","last_peered":"2024-04-25T15:54:50.206075+0000","last_clean":"2024-04-25T15:54:50.206075+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:50.206075+0000","last_undegraded":"2024-04-25T15:54:50.206075+0000","last_fullsized":"2024-04-25T15:54:50.206075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622623+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:50.622623+0000","last_peered":"2024-04-25T15:54:50.622623+0000","last_clean":"2024-04-25T15:54:50.622623+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:50.622623+0000","last_undegraded":"2024-04-25T15:54:50.622623+0000","last_fullsized":"2024-04-25T15:54:50.622623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205087+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:50.205087+0000","last_peered":"2024-04-25T15:54:50.205087+0000","last_clean":"2024-04-25T15:54:50.205087+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:50.205087+0000","last_undegraded":"2024-04-25T15:54:50.205087+0000","last_fullsized":"2024-04-25T15:54:50.205087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200482+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:50.200482+0000","last_peered":"2024-04-25T15:54:50.200482+0000","last_clean":"2024-04-25T15:54:50.200482+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:50.200482+0000","last_undegraded":"2024-04-25T15:54:50.200482+0000","last_fullsized":"2024-04-25T15:54:50.200482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211241+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:50.211241+0000","last_peered":"2024-04-25T15:54:50.211241+0000","last_clean":"2024-04-25T15:54:50.211241+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:50.211241+0000","last_undegraded":"2024-04-25T15:54:50.211241+0000","last_fullsized":"2024-04-25T15:54:50.211241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204976+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:50.204976+0000","last_peered":"2024-04-25T15:54:50.204976+0000","last_clean":"2024-04-25T15:54:50.204976+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:50.204976+0000","last_undegraded":"2024-04-25T15:54:50.204976+0000","last_fullsized":"2024-04-25T15:54:50.204976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206918+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:50.206918+0000","last_peered":"2024-04-25T15:54:50.206918+0000","last_clean":"2024-04-25T15:54:50.206918+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:50.206918+0000","last_undegraded":"2024-04-25T15:54:50.206918+0000","last_fullsized":"2024-04-25T15:54:50.206918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199525+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:50.199525+0000","last_peered":"2024-04-25T15:54:50.199525+0000","last_clean":"2024-04-25T15:54:50.199525+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:50.199525+0000","last_undegraded":"2024-04-25T15:54:50.199525+0000","last_fullsized":"2024-04-25T15:54:50.199525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206303+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:50.206303+0000","last_peered":"2024-04-25T15:54:50.206303+0000","last_clean":"2024-04-25T15:54:50.206303+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:50.206303+0000","last_undegraded":"2024-04-25T15:54:50.206303+0000","last_fullsized":"2024-04-25T15:54:50.206303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623709+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:50.623709+0000","last_peered":"2024-04-25T15:54:50.623709+0000","last_clean":"2024-04-25T15:54:50.623709+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:50.623709+0000","last_undegraded":"2024-04-25T15:54:50.623709+0000","last_fullsized":"2024-04-25T15:54:50.623709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207631+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:50.207631+0000","last_peered":"2024-04-25T15:54:50.207631+0000","last_clean":"2024-04-25T15:54:50.207631+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:50.207631+0000","last_undegraded":"2024-04-25T15:54:50.207631+0000","last_fullsized":"2024-04-25T15:54:50.207631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202699+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:50.202699+0000","last_peered":"2024-04-25T15:54:50.202699+0000","last_clean":"2024-04-25T15:54:50.202699+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:50.202699+0000","last_undegraded":"2024-04-25T15:54:50.202699+0000","last_fullsized":"2024-04-25T15:54:50.202699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623675+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:50.623675+0000","last_peered":"2024-04-25T15:54:50.623675+0000","last_clean":"2024-04-25T15:54:50.623675+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:50.623675+0000","last_undegraded":"2024-04-25T15:54:50.623675+0000","last_fullsized":"2024-04-25T15:54:50.623675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206577+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:50.206577+0000","last_peered":"2024-04-25T15:54:50.206577+0000","last_clean":"2024-04-25T15:54:50.206577+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:50.206577+0000","last_undegraded":"2024-04-25T15:54:50.206577+0000","last_fullsized":"2024-04-25T15:54:50.206577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201097+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:50.201097+0000","last_peered":"2024-04-25T15:54:50.201097+0000","last_clean":"2024-04-25T15:54:50.201097+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:50.201097+0000","last_undegraded":"2024-04-25T15:54:50.201097+0000","last_fullsized":"2024-04-25T15:54:50.201097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200563+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:50.200563+0000","last_peered":"2024-04-25T15:54:50.200563+0000","last_clean":"2024-04-25T15:54:50.200563+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:50.200563+0000","last_undegraded":"2024-04-25T15:54:50.200563+0000","last_fullsized":"2024-04-25T15:54:50.200563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211960+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:50.211960+0000","last_peered":"2024-04-25T15:54:50.211960+0000","last_clean":"2024-04-25T15:54:50.211960+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:50.211960+0000","last_undegraded":"2024-04-25T15:54:50.211960+0000","last_fullsized":"2024-04-25T15:54:50.211960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207471+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:50.207471+0000","last_peered":"2024-04-25T15:54:50.207471+0000","last_clean":"2024-04-25T15:54:50.207471+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:50.207471+0000","last_undegraded":"2024-04-25T15:54:50.207471+0000","last_fullsized":"2024-04-25T15:54:50.207471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623908+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:50.623908+0000","last_peered":"2024-04-25T15:54:50.623908+0000","last_clean":"2024-04-25T15:54:50.623908+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:50.623908+0000","last_undegraded":"2024-04-25T15:54:50.623908+0000","last_fullsized":"2024-04-25T15:54:50.623908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205752+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:50.205752+0000","last_peered":"2024-04-25T15:54:50.205752+0000","last_clean":"2024-04-25T15:54:50.205752+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:50.205752+0000","last_undegraded":"2024-04-25T15:54:50.205752+0000","last_fullsized":"2024-04-25T15:54:50.205752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624560+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:50.624560+0000","last_peered":"2024-04-25T15:54:50.624560+0000","last_clean":"2024-04-25T15:54:50.624560+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:50.624560+0000","last_undegraded":"2024-04-25T15:54:50.624560+0000","last_fullsized":"2024-04-25T15:54:50.624560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200941+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:50.200941+0000","last_peered":"2024-04-25T15:54:50.200941+0000","last_clean":"2024-04-25T15:54:50.200941+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:50.200941+0000","last_undegraded":"2024-04-25T15:54:50.200941+0000","last_fullsized":"2024-04-25T15:54:50.200941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622596+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:50.622596+0000","last_peered":"2024-04-25T15:54:50.622596+0000","last_clean":"2024-04-25T15:54:50.622596+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:50.622596+0000","last_undegraded":"2024-04-25T15:54:50.622596+0000","last_fullsized":"2024-04-25T15:54:50.622596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200870+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:50.200870+0000","last_peered":"2024-04-25T15:54:50.200870+0000","last_clean":"2024-04-25T15:54:50.200870+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:50.200870+0000","last_undegraded":"2024-04-25T15:54:50.200870+0000","last_fullsized":"2024-04-25T15:54:50.200870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201579+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:50.201579+0000","last_peered":"2024-04-25T15:54:50.201579+0000","last_clean":"2024-04-25T15:54:50.201579+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:50.201579+0000","last_undegraded":"2024-04-25T15:54:50.201579+0000","last_fullsized":"2024-04-25T15:54:50.201579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205057+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:50.205057+0000","last_peered":"2024-04-25T15:54:50.205057+0000","last_clean":"2024-04-25T15:54:50.205057+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:50.205057+0000","last_undegraded":"2024-04-25T15:54:50.205057+0000","last_fullsized":"2024-04-25T15:54:50.205057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208316+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:50.208316+0000","last_peered":"2024-04-25T15:54:50.208316+0000","last_clean":"2024-04-25T15:54:50.208316+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:50.208316+0000","last_undegraded":"2024-04-25T15:54:50.208316+0000","last_fullsized":"2024-04-25T15:54:50.208316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204797+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:50.204797+0000","last_peered":"2024-04-25T15:54:50.204797+0000","last_clean":"2024-04-25T15:54:50.204797+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:50.204797+0000","last_undegraded":"2024-04-25T15:54:50.204797+0000","last_fullsized":"2024-04-25T15:54:50.204797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203600+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:50.203600+0000","last_peered":"2024-04-25T15:54:50.203600+0000","last_clean":"2024-04-25T15:54:50.203600+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:50.203600+0000","last_undegraded":"2024-04-25T15:54:50.203600+0000","last_fullsized":"2024-04-25T15:54:50.203600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203262+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:50.203262+0000","last_peered":"2024-04-25T15:54:50.203262+0000","last_clean":"2024-04-25T15:54:50.203262+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:50.203262+0000","last_undegraded":"2024-04-25T15:54:50.203262+0000","last_fullsized":"2024-04-25T15:54:50.203262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212225+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:50.212225+0000","last_peered":"2024-04-25T15:54:50.212225+0000","last_clean":"2024-04-25T15:54:50.212225+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:50.212225+0000","last_undegraded":"2024-04-25T15:54:50.212225+0000","last_fullsized":"2024-04-25T15:54:50.212225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622349+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:50.622349+0000","last_peered":"2024-04-25T15:54:50.622349+0000","last_clean":"2024-04-25T15:54:50.622349+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:50.622349+0000","last_undegraded":"2024-04-25T15:54:50.622349+0000","last_fullsized":"2024-04-25T15:54:50.622349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211826+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:50.211826+0000","last_peered":"2024-04-25T15:54:50.211826+0000","last_clean":"2024-04-25T15:54:50.211826+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:50.211826+0000","last_undegraded":"2024-04-25T15:54:50.211826+0000","last_fullsized":"2024-04-25T15:54:50.211826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201505+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:50.201505+0000","last_peered":"2024-04-25T15:54:50.201505+0000","last_clean":"2024-04-25T15:54:50.201505+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:50.201505+0000","last_undegraded":"2024-04-25T15:54:50.201505+0000","last_fullsized":"2024-04-25T15:54:50.201505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623379+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:50.623379+0000","last_peered":"2024-04-25T15:54:50.623379+0000","last_clean":"2024-04-25T15:54:50.623379+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:50.623379+0000","last_undegraded":"2024-04-25T15:54:50.623379+0000","last_fullsized":"2024-04-25T15:54:50.623379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211500+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:50.211500+0000","last_peered":"2024-04-25T15:54:50.211500+0000","last_clean":"2024-04-25T15:54:50.211500+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:50.211500+0000","last_undegraded":"2024-04-25T15:54:50.211500+0000","last_fullsized":"2024-04-25T15:54:50.211500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211157+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:50.211157+0000","last_peered":"2024-04-25T15:54:50.211157+0000","last_clean":"2024-04-25T15:54:50.211157+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:50.211157+0000","last_undegraded":"2024-04-25T15:54:50.211157+0000","last_fullsized":"2024-04-25T15:54:50.211157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206300+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:50.206300+0000","last_peered":"2024-04-25T15:54:50.206300+0000","last_clean":"2024-04-25T15:54:50.206300+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:50.206300+0000","last_undegraded":"2024-04-25T15:54:50.206300+0000","last_fullsized":"2024-04-25T15:54:50.206300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205814+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:50.205814+0000","last_peered":"2024-04-25T15:54:50.205814+0000","last_clean":"2024-04-25T15:54:50.205814+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:50.205814+0000","last_undegraded":"2024-04-25T15:54:50.205814+0000","last_fullsized":"2024-04-25T15:54:50.205814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202059+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:50.202059+0000","last_peered":"2024-04-25T15:54:50.202059+0000","last_clean":"2024-04-25T15:54:50.202059+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:50.202059+0000","last_undegraded":"2024-04-25T15:54:50.202059+0000","last_fullsized":"2024-04-25T15:54:50.202059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200450+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:50.200450+0000","last_peered":"2024-04-25T15:54:50.200450+0000","last_clean":"2024-04-25T15:54:50.200450+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:50.200450+0000","last_undegraded":"2024-04-25T15:54:50.200450+0000","last_fullsized":"2024-04-25T15:54:50.200450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202891+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:50.202891+0000","last_peered":"2024-04-25T15:54:50.202891+0000","last_clean":"2024-04-25T15:54:50.202891+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:50.202891+0000","last_undegraded":"2024-04-25T15:54:50.202891+0000","last_fullsized":"2024-04-25T15:54:50.202891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214917+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:50.214917+0000","last_peered":"2024-04-25T15:54:50.214917+0000","last_clean":"2024-04-25T15:54:50.214917+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:50.214917+0000","last_undegraded":"2024-04-25T15:54:50.214917+0000","last_fullsized":"2024-04-25T15:54:50.214917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200162+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:50.200162+0000","last_peered":"2024-04-25T15:54:50.200162+0000","last_clean":"2024-04-25T15:54:50.200162+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:50.200162+0000","last_undegraded":"2024-04-25T15:54:50.200162+0000","last_fullsized":"2024-04-25T15:54:50.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205458+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:50.205458+0000","last_peered":"2024-04-25T15:54:50.205458+0000","last_clean":"2024-04-25T15:54:50.205458+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:50.205458+0000","last_undegraded":"2024-04-25T15:54:50.205458+0000","last_fullsized":"2024-04-25T15:54:50.205458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203208+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:50.203208+0000","last_peered":"2024-04-25T15:54:50.203208+0000","last_clean":"2024-04-25T15:54:50.203208+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:50.203208+0000","last_undegraded":"2024-04-25T15:54:50.203208+0000","last_fullsized":"2024-04-25T15:54:50.203208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200083+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:50.200083+0000","last_peered":"2024-04-25T15:54:50.200083+0000","last_clean":"2024-04-25T15:54:50.200083+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:50.200083+0000","last_undegraded":"2024-04-25T15:54:50.200083+0000","last_fullsized":"2024-04-25T15:54:50.200083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.218706+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T15:54:50.218706+0000","last_peered":"2024-04-25T15:54:50.218706+0000","last_clean":"2024-04-25T15:54:50.218706+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T15:54:50.218706+0000","last_undegraded":"2024-04-25T15:54:50.218706+0000","last_fullsized":"2024-04-25T15:54:50.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624450+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:50.624450+0000","last_peered":"2024-04-25T15:54:50.624450+0000","last_clean":"2024-04-25T15:54:50.624450+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:50.624450+0000","last_undegraded":"2024-04-25T15:54:50.624450+0000","last_fullsized":"2024-04-25T15:54:50.624450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206216+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:50.206216+0000","last_peered":"2024-04-25T15:54:50.206216+0000","last_clean":"2024-04-25T15:54:50.206216+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:50.206216+0000","last_undegraded":"2024-04-25T15:54:50.206216+0000","last_fullsized":"2024-04-25T15:54:50.206216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623282+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:50.623282+0000","last_peered":"2024-04-25T15:54:50.623282+0000","last_clean":"2024-04-25T15:54:50.623282+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:50.623282+0000","last_undegraded":"2024-04-25T15:54:50.623282+0000","last_fullsized":"2024-04-25T15:54:50.623282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.223994+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T15:54:50.223994+0000","last_peered":"2024-04-25T15:54:50.223994+0000","last_clean":"2024-04-25T15:54:50.223994+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T15:54:50.223994+0000","last_undegraded":"2024-04-25T15:54:50.223994+0000","last_fullsized":"2024-04-25T15:54:50.223994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202114+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:50.202114+0000","last_peered":"2024-04-25T15:54:50.202114+0000","last_clean":"2024-04-25T15:54:50.202114+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:50.202114+0000","last_undegraded":"2024-04-25T15:54:50.202114+0000","last_fullsized":"2024-04-25T15:54:50.202114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205909+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:50.205909+0000","last_peered":"2024-04-25T15:54:50.205909+0000","last_clean":"2024-04-25T15:54:50.205909+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:50.205909+0000","last_undegraded":"2024-04-25T15:54:50.205909+0000","last_fullsized":"2024-04-25T15:54:50.205909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623078+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:50.623078+0000","last_peered":"2024-04-25T15:54:50.623078+0000","last_clean":"2024-04-25T15:54:50.623078+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:50.623078+0000","last_undegraded":"2024-04-25T15:54:50.623078+0000","last_fullsized":"2024-04-25T15:54:50.623078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205112+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:50.205112+0000","last_peered":"2024-04-25T15:54:50.205112+0000","last_clean":"2024-04-25T15:54:50.205112+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:50.205112+0000","last_undegraded":"2024-04-25T15:54:50.205112+0000","last_fullsized":"2024-04-25T15:54:50.205112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207524+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:50.207524+0000","last_peered":"2024-04-25T15:54:50.207524+0000","last_clean":"2024-04-25T15:54:50.207524+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:50.207524+0000","last_undegraded":"2024-04-25T15:54:50.207524+0000","last_fullsized":"2024-04-25T15:54:50.207524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202477+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:50.202477+0000","last_peered":"2024-04-25T15:54:50.202477+0000","last_clean":"2024-04-25T15:54:50.202477+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:50.202477+0000","last_undegraded":"2024-04-25T15:54:50.202477+0000","last_fullsized":"2024-04-25T15:54:50.202477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625039+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:50.625039+0000","last_peered":"2024-04-25T15:54:50.625039+0000","last_clean":"2024-04-25T15:54:50.625039+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:50.625039+0000","last_undegraded":"2024-04-25T15:54:50.625039+0000","last_fullsized":"2024-04-25T15:54:50.625039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207721+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:50.207721+0000","last_peered":"2024-04-25T15:54:50.207721+0000","last_clean":"2024-04-25T15:54:50.207721+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:50.207721+0000","last_undegraded":"2024-04-25T15:54:50.207721+0000","last_fullsized":"2024-04-25T15:54:50.207721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203453+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:50.203453+0000","last_peered":"2024-04-25T15:54:50.203453+0000","last_clean":"2024-04-25T15:54:50.203453+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:50.203453+0000","last_undegraded":"2024-04-25T15:54:50.203453+0000","last_fullsized":"2024-04-25T15:54:50.203453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622280+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:50.622280+0000","last_peered":"2024-04-25T15:54:50.622280+0000","last_clean":"2024-04-25T15:54:50.622280+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:50.622280+0000","last_undegraded":"2024-04-25T15:54:50.622280+0000","last_fullsized":"2024-04-25T15:54:50.622280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213490+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:50.213490+0000","last_peered":"2024-04-25T15:54:50.213490+0000","last_clean":"2024-04-25T15:54:50.213490+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:50.213490+0000","last_undegraded":"2024-04-25T15:54:50.213490+0000","last_fullsized":"2024-04-25T15:54:50.213490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200025+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:50.200025+0000","last_peered":"2024-04-25T15:54:50.200025+0000","last_clean":"2024-04-25T15:54:50.200025+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:50.200025+0000","last_undegraded":"2024-04-25T15:54:50.200025+0000","last_fullsized":"2024-04-25T15:54:50.200025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200254+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:50.200254+0000","last_peered":"2024-04-25T15:54:50.200254+0000","last_clean":"2024-04-25T15:54:50.200254+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:50.200254+0000","last_undegraded":"2024-04-25T15:54:50.200254+0000","last_fullsized":"2024-04-25T15:54:50.200254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623054+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:50.623054+0000","last_peered":"2024-04-25T15:54:50.623054+0000","last_clean":"2024-04-25T15:54:50.623054+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:50.623054+0000","last_undegraded":"2024-04-25T15:54:50.623054+0000","last_fullsized":"2024-04-25T15:54:50.623054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204302+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:50.204302+0000","last_peered":"2024-04-25T15:54:50.204302+0000","last_clean":"2024-04-25T15:54:50.204302+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:50.204302+0000","last_undegraded":"2024-04-25T15:54:50.204302+0000","last_fullsized":"2024-04-25T15:54:50.204302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.210919+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T15:54:50.210919+0000","last_peered":"2024-04-25T15:54:50.210919+0000","last_clean":"2024-04-25T15:54:50.210919+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T15:54:50.210919+0000","last_undegraded":"2024-04-25T15:54:50.210919+0000","last_fullsized":"2024-04-25T15:54:50.210919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211448+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:50.211448+0000","last_peered":"2024-04-25T15:54:50.211448+0000","last_clean":"2024-04-25T15:54:50.211448+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:50.211448+0000","last_undegraded":"2024-04-25T15:54:50.211448+0000","last_fullsized":"2024-04-25T15:54:50.211448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206135+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:50.206135+0000","last_peered":"2024-04-25T15:54:50.206135+0000","last_clean":"2024-04-25T15:54:50.206135+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:50.206135+0000","last_undegraded":"2024-04-25T15:54:50.206135+0000","last_fullsized":"2024-04-25T15:54:50.206135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202309+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:50.202309+0000","last_peered":"2024-04-25T15:54:50.202309+0000","last_clean":"2024-04-25T15:54:50.202309+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:50.202309+0000","last_undegraded":"2024-04-25T15:54:50.202309+0000","last_fullsized":"2024-04-25T15:54:50.202309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215139+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:50.215139+0000","last_peered":"2024-04-25T15:54:50.215139+0000","last_clean":"2024-04-25T15:54:50.215139+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:50.215139+0000","last_undegraded":"2024-04-25T15:54:50.215139+0000","last_fullsized":"2024-04-25T15:54:50.215139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200157+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:50.200157+0000","last_peered":"2024-04-25T15:54:50.200157+0000","last_clean":"2024-04-25T15:54:50.200157+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:50.200157+0000","last_undegraded":"2024-04-25T15:54:50.200157+0000","last_fullsized":"2024-04-25T15:54:50.200157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200814+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:50.200814+0000","last_peered":"2024-04-25T15:54:50.200814+0000","last_clean":"2024-04-25T15:54:50.200814+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:50.200814+0000","last_undegraded":"2024-04-25T15:54:50.200814+0000","last_fullsized":"2024-04-25T15:54:50.200814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206016+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:50.206016+0000","last_peered":"2024-04-25T15:54:50.206016+0000","last_clean":"2024-04-25T15:54:50.206016+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:50.206016+0000","last_undegraded":"2024-04-25T15:54:50.206016+0000","last_fullsized":"2024-04-25T15:54:50.206016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211786+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:50.211786+0000","last_peered":"2024-04-25T15:54:50.211786+0000","last_clean":"2024-04-25T15:54:50.211786+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:50.211786+0000","last_undegraded":"2024-04-25T15:54:50.211786+0000","last_fullsized":"2024-04-25T15:54:50.211786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207802+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:50.207802+0000","last_peered":"2024-04-25T15:54:50.207802+0000","last_clean":"2024-04-25T15:54:50.207802+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:50.207802+0000","last_undegraded":"2024-04-25T15:54:50.207802+0000","last_fullsized":"2024-04-25T15:54:50.207802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203144+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:50.203144+0000","last_peered":"2024-04-25T15:54:50.203144+0000","last_clean":"2024-04-25T15:54:50.203144+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:50.203144+0000","last_undegraded":"2024-04-25T15:54:50.203144+0000","last_fullsized":"2024-04-25T15:54:50.203144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204480+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:50.204480+0000","last_peered":"2024-04-25T15:54:50.204480+0000","last_clean":"2024-04-25T15:54:50.204480+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:50.204480+0000","last_undegraded":"2024-04-25T15:54:50.204480+0000","last_fullsized":"2024-04-25T15:54:50.204480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211866+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:50.211866+0000","last_peered":"2024-04-25T15:54:50.211866+0000","last_clean":"2024-04-25T15:54:50.211866+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:50.211866+0000","last_undegraded":"2024-04-25T15:54:50.211866+0000","last_fullsized":"2024-04-25T15:54:50.211866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199776+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:50.199776+0000","last_peered":"2024-04-25T15:54:50.199776+0000","last_clean":"2024-04-25T15:54:50.199776+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:50.199776+0000","last_undegraded":"2024-04-25T15:54:50.199776+0000","last_fullsized":"2024-04-25T15:54:50.199776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204117+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:50.204117+0000","last_peered":"2024-04-25T15:54:50.204117+0000","last_clean":"2024-04-25T15:54:50.204117+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:50.204117+0000","last_undegraded":"2024-04-25T15:54:50.204117+0000","last_fullsized":"2024-04-25T15:54:50.204117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204155+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:50.204155+0000","last_peered":"2024-04-25T15:54:50.204155+0000","last_clean":"2024-04-25T15:54:50.204155+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:50.204155+0000","last_undegraded":"2024-04-25T15:54:50.204155+0000","last_fullsized":"2024-04-25T15:54:50.204155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622781+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:50.622781+0000","last_peered":"2024-04-25T15:54:50.622781+0000","last_clean":"2024-04-25T15:54:50.622781+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:50.622781+0000","last_undegraded":"2024-04-25T15:54:50.622781+0000","last_fullsized":"2024-04-25T15:54:50.622781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211121+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:50.211121+0000","last_peered":"2024-04-25T15:54:50.211121+0000","last_clean":"2024-04-25T15:54:50.211121+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:50.211121+0000","last_undegraded":"2024-04-25T15:54:50.211121+0000","last_fullsized":"2024-04-25T15:54:50.211121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207794+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:50.207794+0000","last_peered":"2024-04-25T15:54:50.207794+0000","last_clean":"2024-04-25T15:54:50.207794+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:50.207794+0000","last_undegraded":"2024-04-25T15:54:50.207794+0000","last_fullsized":"2024-04-25T15:54:50.207794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211544+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:50.211544+0000","last_peered":"2024-04-25T15:54:50.211544+0000","last_clean":"2024-04-25T15:54:50.211544+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:50.211544+0000","last_undegraded":"2024-04-25T15:54:50.211544+0000","last_fullsized":"2024-04-25T15:54:50.211544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215061+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:50.215061+0000","last_peered":"2024-04-25T15:54:50.215061+0000","last_clean":"2024-04-25T15:54:50.215061+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:50.215061+0000","last_undegraded":"2024-04-25T15:54:50.215061+0000","last_fullsized":"2024-04-25T15:54:50.215061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":704305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":115934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":113495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":117393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:53.393 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.568+0000 7f8f324a7640 1 Processor -- start 2024-04-25T15:54:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.568+0000 7f8f324a7640 1 -- start start 2024-04-25T15:54:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f324a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c152980 0x7f8f2c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f324a7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f2c155730 0x7f8f2c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f324a7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f2c152d90 con 0x7f8f2c155320 2024-04-25T15:54:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f324a7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2c0aa290 con 0x7f8f2c155730 2024-04-25T15:54:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f324a7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c1598b0 con 0x7f8f2c152980 2024-04-25T15:54:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f2c155730 0x7f8f2c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f2c155730 0x7f8f2c15fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52540/0 (socket says 172.21.15.87:52540) 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 -- 172.21.15.87:0/1267687515 learned_addr learned my addr 172.21.15.87:0/1267687515 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 -- 172.21.15.87:0/1267687515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c152980 msgr2=0x7f8f2c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f2bfff640 1 --2- 172.21.15.87:0/1267687515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c152980 0x7f8f2c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 --2- 172.21.15.87:0/1267687515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c152980 0x7f8f2c0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 -- 172.21.15.87:0/1267687515 >> v1:172.21.15.155:6789/0 conn(0x7f8f2c155320 legacy=0x7f8f2c074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.572+0000 7f8f30a44640 1 -- 172.21.15.87:0/1267687515 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c0ca2f0 con 0x7f8f2c155730 2024-04-25T15:54:53.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f30a44640 1 --2- 172.21.15.87:0/1267687515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c155730 0x7f8f2c15fca0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009e50 tx=0x7f8f2401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d54deca088a7630 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f2affd640 1 -- 172.21.15.87:0/1267687515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f240a55e0 con 0x7f8f2c155730 2024-04-25T15:54:53.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f2affd640 1 -- 172.21.15.87:0/1267687515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f240a5780 con 0x7f8f2c155730 2024-04-25T15:54:53.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f2affd640 1 -- 172.21.15.87:0/1267687515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f240a5b50 con 0x7f8f2c155730 2024-04-25T15:54:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- 172.21.15.87:0/1267687515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c155730 msgr2=0x7f8f2c15fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 --2- 172.21.15.87:0/1267687515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c155730 0x7f8f2c15fca0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009e50 tx=0x7f8f2401c960 comp rx=0 tx=0).stop 2024-04-25T15:54:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- 172.21.15.87:0/1267687515 shutdown_connections 2024-04-25T15:54:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 --2- 172.21.15.87:0/1267687515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c155730 0x7f8f2c15fca0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 --2- 172.21.15.87:0/1267687515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c152980 0x7f8f2c0c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- 172.21.15.87:0/1267687515 >> 172.21.15.87:0/1267687515 conn(0x7f8f2c0ac550 msgr2=0x7f8f2c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- 172.21.15.87:0/1267687515 shutdown_connections 2024-04-25T15:54:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- 172.21.15.87:0/1267687515 wait complete. 2024-04-25T15:54:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 Processor -- start 2024-04-25T15:54:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- start start 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 0x7f8f2c0ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c155320 0x7f8f2c1f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c155730 0x7f8f2c1ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c158f70 con 0x7f8f2c152980 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c158c90 con 0x7f8f2c155320 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.576+0000 7f8f324a7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c074870 con 0x7f8f2c155730 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 0x7f8f2c0ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 0x7f8f2c0ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52554/0 (socket says 172.21.15.87:52554) 2024-04-25T15:54:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 -- 172.21.15.87:0/3727345701 learned_addr learned my addr 172.21.15.87:0/3727345701 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2b7fe640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c155320 0x7f8f2c1f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f30a44640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c155730 0x7f8f2c1ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 -- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c155730 msgr2=0x7f8f2c1ef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c155730 0x7f8f2c1ef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 -- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c155320 msgr2=0x7f8f2c1f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c155320 0x7f8f2c1f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 -- 172.21.15.87:0/3727345701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c1eed50 con 0x7f8f2c152980 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2bfff640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 0x7f8f2c0ab810 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c820 tx=0x7f8f1c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c015070 con 0x7f8f2c152980 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c007a30 con 0x7f8f2c152980 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c0bfb30 con 0x7f8f2c152980 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c007e20 con 0x7f8f2c152980 2024-04-25T15:54:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c150610 con 0x7f8f2c152980 2024-04-25T15:54:53.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2c069bb0 con 0x7f8f2c152980 2024-04-25T15:54:53.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8f1c018070 con 0x7f8f2c152980 2024-04-25T15:54:53.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f28ff9640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f1806f400 0x7f8f18071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f8f1c08f5c0 con 0x7f8f2c152980 2024-04-25T15:54:53.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2b7fe640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f1806f400 0x7f8f18071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.580+0000 7f8f2b7fe640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f1806f400 0x7f8f18071910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0c4f60 tx=0x7f8f20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.584+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f1c05c0d0 con 0x7f8f2c152980 2024-04-25T15:54:53.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.732+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f2c0bf8e0 con 0x7f8f1806f400 2024-04-25T15:54:53.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.768+0000 7f8f28ff9640 1 -- 172.21.15.87:0/3727345701 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490401 (secure 0 0 0) 0x7f8f2c0bf8e0 con 0x7f8f1806f400 2024-04-25T15:54:53.770 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:53.776 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f1806f400 msgr2=0x7f8f18071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f1806f400 0x7f8f18071910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0c4f60 tx=0x7f8f20008040 comp rx=0 tx=0).stop 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 msgr2=0x7f8f2c0ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 0x7f8f2c0ab810 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c820 tx=0x7f8f1c00cce0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 shutdown_connections 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f1806f400 0x7f8f18071910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c155730 0x7f8f2c1ef180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c155320 0x7f8f2c1f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 --2- 172.21.15.87:0/3727345701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c152980 0x7f8f2c0ab810 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 >> 172.21.15.87:0/3727345701 conn(0x7f8f2c0ac550 msgr2=0x7f8f2c074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:53.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 shutdown_connections 2024-04-25T15:54:53.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.772+0000 7f8f324a7640 1 -- 172.21.15.87:0/3727345701 wait complete. 2024-04-25T15:54:53.798 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-04-25T15:54:53.117025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596070,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":195,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":389,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3547136,"data_stored":2098260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":882,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003042"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623593+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:50.623593+0000","last_peered":"2024-04-25T15:54:50.623593+0000","last_clean":"2024-04-25T15:54:50.623593+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:50.623593+0000","last_undegraded":"2024-04-25T15:54:50.623593+0000","last_fullsized":"2024-04-25T15:54:50.623593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623787+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:50.623787+0000","last_peered":"2024-04-25T15:54:50.623787+0000","last_clean":"2024-04-25T15:54:50.623787+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:50.623787+0000","last_undegraded":"2024-04-25T15:54:50.623787+0000","last_fullsized":"2024-04-25T15:54:50.623787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201386+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:50.201386+0000","last_peered":"2024-04-25T15:54:50.201386+0000","last_clean":"2024-04-25T15:54:50.201386+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:50.201386+0000","last_undegraded":"2024-04-25T15:54:50.201386+0000","last_fullsized":"2024-04-25T15:54:50.201386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199876+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:50.199876+0000","last_peered":"2024-04-25T15:54:50.199876+0000","last_clean":"2024-04-25T15:54:50.199876+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:50.199876+0000","last_undegraded":"2024-04-25T15:54:50.199876+0000","last_fullsized":"2024-04-25T15:54:50.199876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207311+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:50.207311+0000","last_peered":"2024-04-25T15:54:50.207311+0000","last_clean":"2024-04-25T15:54:50.207311+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:50.207311+0000","last_undegraded":"2024-04-25T15:54:50.207311+0000","last_fullsized":"2024-04-25T15:54:50.207311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201847+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:50.201847+0000","last_peered":"2024-04-25T15:54:50.201847+0000","last_clean":"2024-04-25T15:54:50.201847+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:50.201847+0000","last_undegraded":"2024-04-25T15:54:50.201847+0000","last_fullsized":"2024-04-25T15:54:50.201847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622933+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:50.622933+0000","last_peered":"2024-04-25T15:54:50.622933+0000","last_clean":"2024-04-25T15:54:50.622933+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:50.622933+0000","last_undegraded":"2024-04-25T15:54:50.622933+0000","last_fullsized":"2024-04-25T15:54:50.622933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623974+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:50.623974+0000","last_peered":"2024-04-25T15:54:50.623974+0000","last_clean":"2024-04-25T15:54:50.623974+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:50.623974+0000","last_undegraded":"2024-04-25T15:54:50.623974+0000","last_fullsized":"2024-04-25T15:54:50.623974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212070+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:50.212070+0000","last_peered":"2024-04-25T15:54:50.212070+0000","last_clean":"2024-04-25T15:54:50.212070+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:50.212070+0000","last_undegraded":"2024-04-25T15:54:50.212070+0000","last_fullsized":"2024-04-25T15:54:50.212070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215172+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:50.215172+0000","last_peered":"2024-04-25T15:54:50.215172+0000","last_clean":"2024-04-25T15:54:50.215172+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:50.215172+0000","last_undegraded":"2024-04-25T15:54:50.215172+0000","last_fullsized":"2024-04-25T15:54:50.215172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203775+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:50.203775+0000","last_peered":"2024-04-25T15:54:50.203775+0000","last_clean":"2024-04-25T15:54:50.203775+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:50.203775+0000","last_undegraded":"2024-04-25T15:54:50.203775+0000","last_fullsized":"2024-04-25T15:54:50.203775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624486+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:50.624486+0000","last_peered":"2024-04-25T15:54:50.624486+0000","last_clean":"2024-04-25T15:54:50.624486+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:50.624486+0000","last_undegraded":"2024-04-25T15:54:50.624486+0000","last_fullsized":"2024-04-25T15:54:50.624486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203201+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:50.203201+0000","last_peered":"2024-04-25T15:54:50.203201+0000","last_clean":"2024-04-25T15:54:50.203201+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:50.203201+0000","last_undegraded":"2024-04-25T15:54:50.203201+0000","last_fullsized":"2024-04-25T15:54:50.203201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213316+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:50.213316+0000","last_peered":"2024-04-25T15:54:50.213316+0000","last_clean":"2024-04-25T15:54:50.213316+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:50.213316+0000","last_undegraded":"2024-04-25T15:54:50.213316+0000","last_fullsized":"2024-04-25T15:54:50.213316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204667+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:50.204667+0000","last_peered":"2024-04-25T15:54:50.204667+0000","last_clean":"2024-04-25T15:54:50.204667+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:50.204667+0000","last_undegraded":"2024-04-25T15:54:50.204667+0000","last_fullsized":"2024-04-25T15:54:50.204667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624016+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:50.624016+0000","last_peered":"2024-04-25T15:54:50.624016+0000","last_clean":"2024-04-25T15:54:50.624016+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:50.624016+0000","last_undegraded":"2024-04-25T15:54:50.624016+0000","last_fullsized":"2024-04-25T15:54:50.624016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208037+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:50.208037+0000","last_peered":"2024-04-25T15:54:50.208037+0000","last_clean":"2024-04-25T15:54:50.208037+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:50.208037+0000","last_undegraded":"2024-04-25T15:54:50.208037+0000","last_fullsized":"2024-04-25T15:54:50.208037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207285+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:50.207285+0000","last_peered":"2024-04-25T15:54:50.207285+0000","last_clean":"2024-04-25T15:54:50.207285+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:50.207285+0000","last_undegraded":"2024-04-25T15:54:50.207285+0000","last_fullsized":"2024-04-25T15:54:50.207285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212064+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:50.212064+0000","last_peered":"2024-04-25T15:54:50.212064+0000","last_clean":"2024-04-25T15:54:50.212064+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:50.212064+0000","last_undegraded":"2024-04-25T15:54:50.212064+0000","last_fullsized":"2024-04-25T15:54:50.212064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625062+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:50.625062+0000","last_peered":"2024-04-25T15:54:50.625062+0000","last_clean":"2024-04-25T15:54:50.625062+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:50.625062+0000","last_undegraded":"2024-04-25T15:54:50.625062+0000","last_fullsized":"2024-04-25T15:54:50.625062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204629+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:50.204629+0000","last_peered":"2024-04-25T15:54:50.204629+0000","last_clean":"2024-04-25T15:54:50.204629+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:50.204629+0000","last_undegraded":"2024-04-25T15:54:50.204629+0000","last_fullsized":"2024-04-25T15:54:50.204629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200033+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:50.200033+0000","last_peered":"2024-04-25T15:54:50.200033+0000","last_clean":"2024-04-25T15:54:50.200033+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:50.200033+0000","last_undegraded":"2024-04-25T15:54:50.200033+0000","last_fullsized":"2024-04-25T15:54:50.200033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208435+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:50.208435+0000","last_peered":"2024-04-25T15:54:50.208435+0000","last_clean":"2024-04-25T15:54:50.208435+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:50.208435+0000","last_undegraded":"2024-04-25T15:54:50.208435+0000","last_fullsized":"2024-04-25T15:54:50.208435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625126+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:50.625126+0000","last_peered":"2024-04-25T15:54:50.625126+0000","last_clean":"2024-04-25T15:54:50.625126+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:50.625126+0000","last_undegraded":"2024-04-25T15:54:50.625126+0000","last_fullsized":"2024-04-25T15:54:50.625126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625014+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:50.625014+0000","last_peered":"2024-04-25T15:54:50.625014+0000","last_clean":"2024-04-25T15:54:50.625014+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:50.625014+0000","last_undegraded":"2024-04-25T15:54:50.625014+0000","last_fullsized":"2024-04-25T15:54:50.625014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201187+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:50.201187+0000","last_peered":"2024-04-25T15:54:50.201187+0000","last_clean":"2024-04-25T15:54:50.201187+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:50.201187+0000","last_undegraded":"2024-04-25T15:54:50.201187+0000","last_fullsized":"2024-04-25T15:54:50.201187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.209227+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:50.209227+0000","last_peered":"2024-04-25T15:54:50.209227+0000","last_clean":"2024-04-25T15:54:50.209227+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:50.209227+0000","last_undegraded":"2024-04-25T15:54:50.209227+0000","last_fullsized":"2024-04-25T15:54:50.209227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208644+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:50.208644+0000","last_peered":"2024-04-25T15:54:50.208644+0000","last_clean":"2024-04-25T15:54:50.208644+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:50.208644+0000","last_undegraded":"2024-04-25T15:54:50.208644+0000","last_fullsized":"2024-04-25T15:54:50.208644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204363+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:50.204363+0000","last_peered":"2024-04-25T15:54:50.204363+0000","last_clean":"2024-04-25T15:54:50.204363+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:50.204363+0000","last_undegraded":"2024-04-25T15:54:50.204363+0000","last_fullsized":"2024-04-25T15:54:50.204363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622545+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:50.622545+0000","last_peered":"2024-04-25T15:54:50.622545+0000","last_clean":"2024-04-25T15:54:50.622545+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:50.622545+0000","last_undegraded":"2024-04-25T15:54:50.622545+0000","last_fullsized":"2024-04-25T15:54:50.622545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211334+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:50.211334+0000","last_peered":"2024-04-25T15:54:50.211334+0000","last_clean":"2024-04-25T15:54:50.211334+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:50.211334+0000","last_undegraded":"2024-04-25T15:54:50.211334+0000","last_fullsized":"2024-04-25T15:54:50.211334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625243+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:50.625243+0000","last_peered":"2024-04-25T15:54:50.625243+0000","last_clean":"2024-04-25T15:54:50.625243+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:50.625243+0000","last_undegraded":"2024-04-25T15:54:50.625243+0000","last_fullsized":"2024-04-25T15:54:50.625243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199497+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:50.199497+0000","last_peered":"2024-04-25T15:54:50.199497+0000","last_clean":"2024-04-25T15:54:50.199497+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:50.199497+0000","last_undegraded":"2024-04-25T15:54:50.199497+0000","last_fullsized":"2024-04-25T15:54:50.199497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622635+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:50.622635+0000","last_peered":"2024-04-25T15:54:50.622635+0000","last_clean":"2024-04-25T15:54:50.622635+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:50.622635+0000","last_undegraded":"2024-04-25T15:54:50.622635+0000","last_fullsized":"2024-04-25T15:54:50.622635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207014+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:50.207014+0000","last_peered":"2024-04-25T15:54:50.207014+0000","last_clean":"2024-04-25T15:54:50.207014+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:50.207014+0000","last_undegraded":"2024-04-25T15:54:50.207014+0000","last_fullsized":"2024-04-25T15:54:50.207014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623518+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:50.623518+0000","last_peered":"2024-04-25T15:54:50.623518+0000","last_clean":"2024-04-25T15:54:50.623518+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:50.623518+0000","last_undegraded":"2024-04-25T15:54:50.623518+0000","last_fullsized":"2024-04-25T15:54:50.623518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623247+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:50.623247+0000","last_peered":"2024-04-25T15:54:50.623247+0000","last_clean":"2024-04-25T15:54:50.623247+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:50.623247+0000","last_undegraded":"2024-04-25T15:54:50.623247+0000","last_fullsized":"2024-04-25T15:54:50.623247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202126+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:50.202126+0000","last_peered":"2024-04-25T15:54:50.202126+0000","last_clean":"2024-04-25T15:54:50.202126+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:50.202126+0000","last_undegraded":"2024-04-25T15:54:50.202126+0000","last_fullsized":"2024-04-25T15:54:50.202126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208896+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:50.208896+0000","last_peered":"2024-04-25T15:54:50.208896+0000","last_clean":"2024-04-25T15:54:50.208896+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:50.208896+0000","last_undegraded":"2024-04-25T15:54:50.208896+0000","last_fullsized":"2024-04-25T15:54:50.208896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199497+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:50.199497+0000","last_peered":"2024-04-25T15:54:50.199497+0000","last_clean":"2024-04-25T15:54:50.199497+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:50.199497+0000","last_undegraded":"2024-04-25T15:54:50.199497+0000","last_fullsized":"2024-04-25T15:54:50.199497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206872+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:50.206872+0000","last_peered":"2024-04-25T15:54:50.206872+0000","last_clean":"2024-04-25T15:54:50.206872+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:50.206872+0000","last_undegraded":"2024-04-25T15:54:50.206872+0000","last_fullsized":"2024-04-25T15:54:50.206872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.209136+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:50.209136+0000","last_peered":"2024-04-25T15:54:50.209136+0000","last_clean":"2024-04-25T15:54:50.209136+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:50.209136+0000","last_undegraded":"2024-04-25T15:54:50.209136+0000","last_fullsized":"2024-04-25T15:54:50.209136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215734+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:50.215734+0000","last_peered":"2024-04-25T15:54:50.215734+0000","last_clean":"2024-04-25T15:54:50.215734+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:50.215734+0000","last_undegraded":"2024-04-25T15:54:50.215734+0000","last_fullsized":"2024-04-25T15:54:50.215734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623506+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:50.623506+0000","last_peered":"2024-04-25T15:54:50.623506+0000","last_clean":"2024-04-25T15:54:50.623506+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:50.623506+0000","last_undegraded":"2024-04-25T15:54:50.623506+0000","last_fullsized":"2024-04-25T15:54:50.623506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623814+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:50.623814+0000","last_peered":"2024-04-25T15:54:50.623814+0000","last_clean":"2024-04-25T15:54:50.623814+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:50.623814+0000","last_undegraded":"2024-04-25T15:54:50.623814+0000","last_fullsized":"2024-04-25T15:54:50.623814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214162+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T15:54:50.214162+0000","last_peered":"2024-04-25T15:54:50.214162+0000","last_clean":"2024-04-25T15:54:50.214162+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T15:54:50.214162+0000","last_undegraded":"2024-04-25T15:54:50.214162+0000","last_fullsized":"2024-04-25T15:54:50.214162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208854+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:50.208854+0000","last_peered":"2024-04-25T15:54:50.208854+0000","last_clean":"2024-04-25T15:54:50.208854+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:50.208854+0000","last_undegraded":"2024-04-25T15:54:50.208854+0000","last_fullsized":"2024-04-25T15:54:50.208854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207971+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:50.207971+0000","last_peered":"2024-04-25T15:54:50.207971+0000","last_clean":"2024-04-25T15:54:50.207971+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:50.207971+0000","last_undegraded":"2024-04-25T15:54:50.207971+0000","last_fullsized":"2024-04-25T15:54:50.207971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623567+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:50.623567+0000","last_peered":"2024-04-25T15:54:50.623567+0000","last_clean":"2024-04-25T15:54:50.623567+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:50.623567+0000","last_undegraded":"2024-04-25T15:54:50.623567+0000","last_fullsized":"2024-04-25T15:54:50.623567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625403+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:50.625403+0000","last_peered":"2024-04-25T15:54:50.625403+0000","last_clean":"2024-04-25T15:54:50.625403+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:50.625403+0000","last_undegraded":"2024-04-25T15:54:50.625403+0000","last_fullsized":"2024-04-25T15:54:50.625403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203394+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:50.203394+0000","last_peered":"2024-04-25T15:54:50.203394+0000","last_clean":"2024-04-25T15:54:50.203394+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:50.203394+0000","last_undegraded":"2024-04-25T15:54:50.203394+0000","last_fullsized":"2024-04-25T15:54:50.203394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208549+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:50.208549+0000","last_peered":"2024-04-25T15:54:50.208549+0000","last_clean":"2024-04-25T15:54:50.208549+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:50.208549+0000","last_undegraded":"2024-04-25T15:54:50.208549+0000","last_fullsized":"2024-04-25T15:54:50.208549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204593+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:50.204593+0000","last_peered":"2024-04-25T15:54:50.204593+0000","last_clean":"2024-04-25T15:54:50.204593+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:50.204593+0000","last_undegraded":"2024-04-25T15:54:50.204593+0000","last_fullsized":"2024-04-25T15:54:50.204593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207717+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:50.207717+0000","last_peered":"2024-04-25T15:54:50.207717+0000","last_clean":"2024-04-25T15:54:50.207717+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:50.207717+0000","last_undegraded":"2024-04-25T15:54:50.207717+0000","last_fullsized":"2024-04-25T15:54:50.207717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205589+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:50.205589+0000","last_peered":"2024-04-25T15:54:50.205589+0000","last_clean":"2024-04-25T15:54:50.205589+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:50.205589+0000","last_undegraded":"2024-04-25T15:54:50.205589+0000","last_fullsized":"2024-04-25T15:54:50.205589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208777+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:50.208777+0000","last_peered":"2024-04-25T15:54:50.208777+0000","last_clean":"2024-04-25T15:54:50.208777+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:50.208777+0000","last_undegraded":"2024-04-25T15:54:50.208777+0000","last_fullsized":"2024-04-25T15:54:50.208777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204634+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:50.204634+0000","last_peered":"2024-04-25T15:54:50.204634+0000","last_clean":"2024-04-25T15:54:50.204634+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:50.204634+0000","last_undegraded":"2024-04-25T15:54:50.204634+0000","last_fullsized":"2024-04-25T15:54:50.204634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623181+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:50.623181+0000","last_peered":"2024-04-25T15:54:50.623181+0000","last_clean":"2024-04-25T15:54:50.623181+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:50.623181+0000","last_undegraded":"2024-04-25T15:54:50.623181+0000","last_fullsized":"2024-04-25T15:54:50.623181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211387+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:50.211387+0000","last_peered":"2024-04-25T15:54:50.211387+0000","last_clean":"2024-04-25T15:54:50.211387+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:50.211387+0000","last_undegraded":"2024-04-25T15:54:50.211387+0000","last_fullsized":"2024-04-25T15:54:50.211387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623887+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:50.623887+0000","last_peered":"2024-04-25T15:54:50.623887+0000","last_clean":"2024-04-25T15:54:50.623887+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:50.623887+0000","last_undegraded":"2024-04-25T15:54:50.623887+0000","last_fullsized":"2024-04-25T15:54:50.623887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211756+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:50.211756+0000","last_peered":"2024-04-25T15:54:50.211756+0000","last_clean":"2024-04-25T15:54:50.211756+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:50.211756+0000","last_undegraded":"2024-04-25T15:54:50.211756+0000","last_fullsized":"2024-04-25T15:54:50.211756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200580+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:50.200580+0000","last_peered":"2024-04-25T15:54:50.200580+0000","last_clean":"2024-04-25T15:54:50.200580+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:50.200580+0000","last_undegraded":"2024-04-25T15:54:50.200580+0000","last_fullsized":"2024-04-25T15:54:50.200580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203394+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:50.203394+0000","last_peered":"2024-04-25T15:54:50.203394+0000","last_clean":"2024-04-25T15:54:50.203394+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:50.203394+0000","last_undegraded":"2024-04-25T15:54:50.203394+0000","last_fullsized":"2024-04-25T15:54:50.203394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211562+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:50.211562+0000","last_peered":"2024-04-25T15:54:50.211562+0000","last_clean":"2024-04-25T15:54:50.211562+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:50.211562+0000","last_undegraded":"2024-04-25T15:54:50.211562+0000","last_fullsized":"2024-04-25T15:54:50.211562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206060+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:50.206060+0000","last_peered":"2024-04-25T15:54:50.206060+0000","last_clean":"2024-04-25T15:54:50.206060+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:50.206060+0000","last_undegraded":"2024-04-25T15:54:50.206060+0000","last_fullsized":"2024-04-25T15:54:50.206060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205501+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:50.205501+0000","last_peered":"2024-04-25T15:54:50.205501+0000","last_clean":"2024-04-25T15:54:50.205501+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:50.205501+0000","last_undegraded":"2024-04-25T15:54:50.205501+0000","last_fullsized":"2024-04-25T15:54:50.205501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.218519+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T15:54:50.218519+0000","last_peered":"2024-04-25T15:54:50.218519+0000","last_clean":"2024-04-25T15:54:50.218519+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T15:54:50.218519+0000","last_undegraded":"2024-04-25T15:54:50.218519+0000","last_fullsized":"2024-04-25T15:54:50.218519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206444+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:50.206444+0000","last_peered":"2024-04-25T15:54:50.206444+0000","last_clean":"2024-04-25T15:54:50.206444+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:50.206444+0000","last_undegraded":"2024-04-25T15:54:50.206444+0000","last_fullsized":"2024-04-25T15:54:50.206444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207024+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:50.207024+0000","last_peered":"2024-04-25T15:54:50.207024+0000","last_clean":"2024-04-25T15:54:50.207024+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:50.207024+0000","last_undegraded":"2024-04-25T15:54:50.207024+0000","last_fullsized":"2024-04-25T15:54:50.207024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204340+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:50.204340+0000","last_peered":"2024-04-25T15:54:50.204340+0000","last_clean":"2024-04-25T15:54:50.204340+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:50.204340+0000","last_undegraded":"2024-04-25T15:54:50.204340+0000","last_fullsized":"2024-04-25T15:54:50.204340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213297+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T15:54:50.213297+0000","last_peered":"2024-04-25T15:54:50.213297+0000","last_clean":"2024-04-25T15:54:50.213297+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T15:54:50.213297+0000","last_undegraded":"2024-04-25T15:54:50.213297+0000","last_fullsized":"2024-04-25T15:54:50.213297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.210895+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:50.210895+0000","last_peered":"2024-04-25T15:54:50.210895+0000","last_clean":"2024-04-25T15:54:50.210895+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:50.210895+0000","last_undegraded":"2024-04-25T15:54:50.210895+0000","last_fullsized":"2024-04-25T15:54:50.210895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623154+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:50.623154+0000","last_peered":"2024-04-25T15:54:50.623154+0000","last_clean":"2024-04-25T15:54:50.623154+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:50.623154+0000","last_undegraded":"2024-04-25T15:54:50.623154+0000","last_fullsized":"2024-04-25T15:54:50.623154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211197+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:50.211197+0000","last_peered":"2024-04-25T15:54:50.211197+0000","last_clean":"2024-04-25T15:54:50.211197+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:50.211197+0000","last_undegraded":"2024-04-25T15:54:50.211197+0000","last_fullsized":"2024-04-25T15:54:50.211197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215210+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:50.215210+0000","last_peered":"2024-04-25T15:54:50.215210+0000","last_clean":"2024-04-25T15:54:50.215210+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:50.215210+0000","last_undegraded":"2024-04-25T15:54:50.215210+0000","last_fullsized":"2024-04-25T15:54:50.215210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206081+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:50.206081+0000","last_peered":"2024-04-25T15:54:50.206081+0000","last_clean":"2024-04-25T15:54:50.206081+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:50.206081+0000","last_undegraded":"2024-04-25T15:54:50.206081+0000","last_fullsized":"2024-04-25T15:54:50.206081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202416+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:50.202416+0000","last_peered":"2024-04-25T15:54:50.202416+0000","last_clean":"2024-04-25T15:54:50.202416+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:50.202416+0000","last_undegraded":"2024-04-25T15:54:50.202416+0000","last_fullsized":"2024-04-25T15:54:50.202416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206112+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:50.206112+0000","last_peered":"2024-04-25T15:54:50.206112+0000","last_clean":"2024-04-25T15:54:50.206112+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:50.206112+0000","last_undegraded":"2024-04-25T15:54:50.206112+0000","last_fullsized":"2024-04-25T15:54:50.206112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214705+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:50.214705+0000","last_peered":"2024-04-25T15:54:50.214705+0000","last_clean":"2024-04-25T15:54:50.214705+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:50.214705+0000","last_undegraded":"2024-04-25T15:54:50.214705+0000","last_fullsized":"2024-04-25T15:54:50.214705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625685+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:50.625685+0000","last_peered":"2024-04-25T15:54:50.625685+0000","last_clean":"2024-04-25T15:54:50.625685+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:50.625685+0000","last_undegraded":"2024-04-25T15:54:50.625685+0000","last_fullsized":"2024-04-25T15:54:50.625685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623390+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:50.623390+0000","last_peered":"2024-04-25T15:54:50.623390+0000","last_clean":"2024-04-25T15:54:50.623390+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:50.623390+0000","last_undegraded":"2024-04-25T15:54:50.623390+0000","last_fullsized":"2024-04-25T15:54:50.623390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201524+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:50.201524+0000","last_peered":"2024-04-25T15:54:50.201524+0000","last_clean":"2024-04-25T15:54:50.201524+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:50.201524+0000","last_undegraded":"2024-04-25T15:54:50.201524+0000","last_fullsized":"2024-04-25T15:54:50.201524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211861+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:50.211861+0000","last_peered":"2024-04-25T15:54:50.211861+0000","last_clean":"2024-04-25T15:54:50.211861+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:50.211861+0000","last_undegraded":"2024-04-25T15:54:50.211861+0000","last_fullsized":"2024-04-25T15:54:50.211861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204497+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:50.204497+0000","last_peered":"2024-04-25T15:54:50.204497+0000","last_clean":"2024-04-25T15:54:50.204497+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:50.204497+0000","last_undegraded":"2024-04-25T15:54:50.204497+0000","last_fullsized":"2024-04-25T15:54:50.204497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623838+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:50.623838+0000","last_peered":"2024-04-25T15:54:50.623838+0000","last_clean":"2024-04-25T15:54:50.623838+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:50.623838+0000","last_undegraded":"2024-04-25T15:54:50.623838+0000","last_fullsized":"2024-04-25T15:54:50.623838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204798+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:50.204798+0000","last_peered":"2024-04-25T15:54:50.204798+0000","last_clean":"2024-04-25T15:54:50.204798+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:50.204798+0000","last_undegraded":"2024-04-25T15:54:50.204798+0000","last_fullsized":"2024-04-25T15:54:50.204798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205220+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:50.205220+0000","last_peered":"2024-04-25T15:54:50.205220+0000","last_clean":"2024-04-25T15:54:50.205220+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:50.205220+0000","last_undegraded":"2024-04-25T15:54:50.205220+0000","last_fullsized":"2024-04-25T15:54:50.205220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207350+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:50.207350+0000","last_peered":"2024-04-25T15:54:50.207350+0000","last_clean":"2024-04-25T15:54:50.207350+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:50.207350+0000","last_undegraded":"2024-04-25T15:54:50.207350+0000","last_fullsized":"2024-04-25T15:54:50.207350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201801+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:50.201801+0000","last_peered":"2024-04-25T15:54:50.201801+0000","last_clean":"2024-04-25T15:54:50.201801+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:50.201801+0000","last_undegraded":"2024-04-25T15:54:50.201801+0000","last_fullsized":"2024-04-25T15:54:50.201801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203781+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:50.203781+0000","last_peered":"2024-04-25T15:54:50.203781+0000","last_clean":"2024-04-25T15:54:50.203781+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:50.203781+0000","last_undegraded":"2024-04-25T15:54:50.203781+0000","last_fullsized":"2024-04-25T15:54:50.203781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211910+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:50.211910+0000","last_peered":"2024-04-25T15:54:50.211910+0000","last_clean":"2024-04-25T15:54:50.211910+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:50.211910+0000","last_undegraded":"2024-04-25T15:54:50.211910+0000","last_fullsized":"2024-04-25T15:54:50.211910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203500+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:50.203500+0000","last_peered":"2024-04-25T15:54:50.203500+0000","last_clean":"2024-04-25T15:54:50.203500+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:50.203500+0000","last_undegraded":"2024-04-25T15:54:50.203500+0000","last_fullsized":"2024-04-25T15:54:50.203500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201268+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:50.201268+0000","last_peered":"2024-04-25T15:54:50.201268+0000","last_clean":"2024-04-25T15:54:50.201268+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:50.201268+0000","last_undegraded":"2024-04-25T15:54:50.201268+0000","last_fullsized":"2024-04-25T15:54:50.201268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201169+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:50.201169+0000","last_peered":"2024-04-25T15:54:50.201169+0000","last_clean":"2024-04-25T15:54:50.201169+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:50.201169+0000","last_undegraded":"2024-04-25T15:54:50.201169+0000","last_fullsized":"2024-04-25T15:54:50.201169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622255+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:50.622255+0000","last_peered":"2024-04-25T15:54:50.622255+0000","last_clean":"2024-04-25T15:54:50.622255+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:50.622255+0000","last_undegraded":"2024-04-25T15:54:50.622255+0000","last_fullsized":"2024-04-25T15:54:50.622255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624036+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:50.624036+0000","last_peered":"2024-04-25T15:54:50.624036+0000","last_clean":"2024-04-25T15:54:50.624036+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:50.624036+0000","last_undegraded":"2024-04-25T15:54:50.624036+0000","last_fullsized":"2024-04-25T15:54:50.624036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204545+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:50.204545+0000","last_peered":"2024-04-25T15:54:50.204545+0000","last_clean":"2024-04-25T15:54:50.204545+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:50.204545+0000","last_undegraded":"2024-04-25T15:54:50.204545+0000","last_fullsized":"2024-04-25T15:54:50.204545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199925+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:50.199925+0000","last_peered":"2024-04-25T15:54:50.199925+0000","last_clean":"2024-04-25T15:54:50.199925+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:50.199925+0000","last_undegraded":"2024-04-25T15:54:50.199925+0000","last_fullsized":"2024-04-25T15:54:50.199925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214847+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:50.214847+0000","last_peered":"2024-04-25T15:54:50.214847+0000","last_clean":"2024-04-25T15:54:50.214847+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:50.214847+0000","last_undegraded":"2024-04-25T15:54:50.214847+0000","last_fullsized":"2024-04-25T15:54:50.214847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206537+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:50.206537+0000","last_peered":"2024-04-25T15:54:50.206537+0000","last_clean":"2024-04-25T15:54:50.206537+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:50.206537+0000","last_undegraded":"2024-04-25T15:54:50.206537+0000","last_fullsized":"2024-04-25T15:54:50.206537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207810+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:50.207810+0000","last_peered":"2024-04-25T15:54:50.207810+0000","last_clean":"2024-04-25T15:54:50.207810+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:50.207810+0000","last_undegraded":"2024-04-25T15:54:50.207810+0000","last_fullsized":"2024-04-25T15:54:50.207810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208232+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:50.208232+0000","last_peered":"2024-04-25T15:54:50.208232+0000","last_clean":"2024-04-25T15:54:50.208232+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:50.208232+0000","last_undegraded":"2024-04-25T15:54:50.208232+0000","last_fullsized":"2024-04-25T15:54:50.208232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622677+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:50.622677+0000","last_peered":"2024-04-25T15:54:50.622677+0000","last_clean":"2024-04-25T15:54:50.622677+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:50.622677+0000","last_undegraded":"2024-04-25T15:54:50.622677+0000","last_fullsized":"2024-04-25T15:54:50.622677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211211+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:50.211211+0000","last_peered":"2024-04-25T15:54:50.211211+0000","last_clean":"2024-04-25T15:54:50.211211+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:50.211211+0000","last_undegraded":"2024-04-25T15:54:50.211211+0000","last_fullsized":"2024-04-25T15:54:50.211211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624862+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:50.624862+0000","last_peered":"2024-04-25T15:54:50.624862+0000","last_clean":"2024-04-25T15:54:50.624862+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:50.624862+0000","last_undegraded":"2024-04-25T15:54:50.624862+0000","last_fullsized":"2024-04-25T15:54:50.624862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206075+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:50.206075+0000","last_peered":"2024-04-25T15:54:50.206075+0000","last_clean":"2024-04-25T15:54:50.206075+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:50.206075+0000","last_undegraded":"2024-04-25T15:54:50.206075+0000","last_fullsized":"2024-04-25T15:54:50.206075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622623+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:50.622623+0000","last_peered":"2024-04-25T15:54:50.622623+0000","last_clean":"2024-04-25T15:54:50.622623+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:50.622623+0000","last_undegraded":"2024-04-25T15:54:50.622623+0000","last_fullsized":"2024-04-25T15:54:50.622623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205087+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:50.205087+0000","last_peered":"2024-04-25T15:54:50.205087+0000","last_clean":"2024-04-25T15:54:50.205087+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:50.205087+0000","last_undegraded":"2024-04-25T15:54:50.205087+0000","last_fullsized":"2024-04-25T15:54:50.205087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200482+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:50.200482+0000","last_peered":"2024-04-25T15:54:50.200482+0000","last_clean":"2024-04-25T15:54:50.200482+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:50.200482+0000","last_undegraded":"2024-04-25T15:54:50.200482+0000","last_fullsized":"2024-04-25T15:54:50.200482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211241+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:50.211241+0000","last_peered":"2024-04-25T15:54:50.211241+0000","last_clean":"2024-04-25T15:54:50.211241+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:50.211241+0000","last_undegraded":"2024-04-25T15:54:50.211241+0000","last_fullsized":"2024-04-25T15:54:50.211241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204976+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:50.204976+0000","last_peered":"2024-04-25T15:54:50.204976+0000","last_clean":"2024-04-25T15:54:50.204976+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:50.204976+0000","last_undegraded":"2024-04-25T15:54:50.204976+0000","last_fullsized":"2024-04-25T15:54:50.204976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206918+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:50.206918+0000","last_peered":"2024-04-25T15:54:50.206918+0000","last_clean":"2024-04-25T15:54:50.206918+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:50.206918+0000","last_undegraded":"2024-04-25T15:54:50.206918+0000","last_fullsized":"2024-04-25T15:54:50.206918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199525+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:50.199525+0000","last_peered":"2024-04-25T15:54:50.199525+0000","last_clean":"2024-04-25T15:54:50.199525+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:50.199525+0000","last_undegraded":"2024-04-25T15:54:50.199525+0000","last_fullsized":"2024-04-25T15:54:50.199525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206303+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:50.206303+0000","last_peered":"2024-04-25T15:54:50.206303+0000","last_clean":"2024-04-25T15:54:50.206303+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:50.206303+0000","last_undegraded":"2024-04-25T15:54:50.206303+0000","last_fullsized":"2024-04-25T15:54:50.206303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623709+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:50.623709+0000","last_peered":"2024-04-25T15:54:50.623709+0000","last_clean":"2024-04-25T15:54:50.623709+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:50.623709+0000","last_undegraded":"2024-04-25T15:54:50.623709+0000","last_fullsized":"2024-04-25T15:54:50.623709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207631+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:50.207631+0000","last_peered":"2024-04-25T15:54:50.207631+0000","last_clean":"2024-04-25T15:54:50.207631+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:50.207631+0000","last_undegraded":"2024-04-25T15:54:50.207631+0000","last_fullsized":"2024-04-25T15:54:50.207631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202699+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:50.202699+0000","last_peered":"2024-04-25T15:54:50.202699+0000","last_clean":"2024-04-25T15:54:50.202699+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:50.202699+0000","last_undegraded":"2024-04-25T15:54:50.202699+0000","last_fullsized":"2024-04-25T15:54:50.202699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623675+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:50.623675+0000","last_peered":"2024-04-25T15:54:50.623675+0000","last_clean":"2024-04-25T15:54:50.623675+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:50.623675+0000","last_undegraded":"2024-04-25T15:54:50.623675+0000","last_fullsized":"2024-04-25T15:54:50.623675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206577+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:50.206577+0000","last_peered":"2024-04-25T15:54:50.206577+0000","last_clean":"2024-04-25T15:54:50.206577+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:50.206577+0000","last_undegraded":"2024-04-25T15:54:50.206577+0000","last_fullsized":"2024-04-25T15:54:50.206577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201097+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:50.201097+0000","last_peered":"2024-04-25T15:54:50.201097+0000","last_clean":"2024-04-25T15:54:50.201097+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:50.201097+0000","last_undegraded":"2024-04-25T15:54:50.201097+0000","last_fullsized":"2024-04-25T15:54:50.201097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200563+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:50.200563+0000","last_peered":"2024-04-25T15:54:50.200563+0000","last_clean":"2024-04-25T15:54:50.200563+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:50.200563+0000","last_undegraded":"2024-04-25T15:54:50.200563+0000","last_fullsized":"2024-04-25T15:54:50.200563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211960+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:50.211960+0000","last_peered":"2024-04-25T15:54:50.211960+0000","last_clean":"2024-04-25T15:54:50.211960+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:50.211960+0000","last_undegraded":"2024-04-25T15:54:50.211960+0000","last_fullsized":"2024-04-25T15:54:50.211960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207471+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:50.207471+0000","last_peered":"2024-04-25T15:54:50.207471+0000","last_clean":"2024-04-25T15:54:50.207471+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:50.207471+0000","last_undegraded":"2024-04-25T15:54:50.207471+0000","last_fullsized":"2024-04-25T15:54:50.207471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623908+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:50.623908+0000","last_peered":"2024-04-25T15:54:50.623908+0000","last_clean":"2024-04-25T15:54:50.623908+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:50.623908+0000","last_undegraded":"2024-04-25T15:54:50.623908+0000","last_fullsized":"2024-04-25T15:54:50.623908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205752+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:50.205752+0000","last_peered":"2024-04-25T15:54:50.205752+0000","last_clean":"2024-04-25T15:54:50.205752+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:50.205752+0000","last_undegraded":"2024-04-25T15:54:50.205752+0000","last_fullsized":"2024-04-25T15:54:50.205752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624560+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:50.624560+0000","last_peered":"2024-04-25T15:54:50.624560+0000","last_clean":"2024-04-25T15:54:50.624560+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:50.624560+0000","last_undegraded":"2024-04-25T15:54:50.624560+0000","last_fullsized":"2024-04-25T15:54:50.624560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200941+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:50.200941+0000","last_peered":"2024-04-25T15:54:50.200941+0000","last_clean":"2024-04-25T15:54:50.200941+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:50.200941+0000","last_undegraded":"2024-04-25T15:54:50.200941+0000","last_fullsized":"2024-04-25T15:54:50.200941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622596+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:50.622596+0000","last_peered":"2024-04-25T15:54:50.622596+0000","last_clean":"2024-04-25T15:54:50.622596+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:50.622596+0000","last_undegraded":"2024-04-25T15:54:50.622596+0000","last_fullsized":"2024-04-25T15:54:50.622596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200870+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:50.200870+0000","last_peered":"2024-04-25T15:54:50.200870+0000","last_clean":"2024-04-25T15:54:50.200870+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:50.200870+0000","last_undegraded":"2024-04-25T15:54:50.200870+0000","last_fullsized":"2024-04-25T15:54:50.200870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201579+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:50.201579+0000","last_peered":"2024-04-25T15:54:50.201579+0000","last_clean":"2024-04-25T15:54:50.201579+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:50.201579+0000","last_undegraded":"2024-04-25T15:54:50.201579+0000","last_fullsized":"2024-04-25T15:54:50.201579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205057+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:50.205057+0000","last_peered":"2024-04-25T15:54:50.205057+0000","last_clean":"2024-04-25T15:54:50.205057+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:50.205057+0000","last_undegraded":"2024-04-25T15:54:50.205057+0000","last_fullsized":"2024-04-25T15:54:50.205057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208316+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:50.208316+0000","last_peered":"2024-04-25T15:54:50.208316+0000","last_clean":"2024-04-25T15:54:50.208316+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:50.208316+0000","last_undegraded":"2024-04-25T15:54:50.208316+0000","last_fullsized":"2024-04-25T15:54:50.208316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204797+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:50.204797+0000","last_peered":"2024-04-25T15:54:50.204797+0000","last_clean":"2024-04-25T15:54:50.204797+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:50.204797+0000","last_undegraded":"2024-04-25T15:54:50.204797+0000","last_fullsized":"2024-04-25T15:54:50.204797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203600+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:50.203600+0000","last_peered":"2024-04-25T15:54:50.203600+0000","last_clean":"2024-04-25T15:54:50.203600+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:50.203600+0000","last_undegraded":"2024-04-25T15:54:50.203600+0000","last_fullsized":"2024-04-25T15:54:50.203600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203262+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:50.203262+0000","last_peered":"2024-04-25T15:54:50.203262+0000","last_clean":"2024-04-25T15:54:50.203262+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:50.203262+0000","last_undegraded":"2024-04-25T15:54:50.203262+0000","last_fullsized":"2024-04-25T15:54:50.203262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212225+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:50.212225+0000","last_peered":"2024-04-25T15:54:50.212225+0000","last_clean":"2024-04-25T15:54:50.212225+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:50.212225+0000","last_undegraded":"2024-04-25T15:54:50.212225+0000","last_fullsized":"2024-04-25T15:54:50.212225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622349+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:50.622349+0000","last_peered":"2024-04-25T15:54:50.622349+0000","last_clean":"2024-04-25T15:54:50.622349+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:50.622349+0000","last_undegraded":"2024-04-25T15:54:50.622349+0000","last_fullsized":"2024-04-25T15:54:50.622349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211826+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:50.211826+0000","last_peered":"2024-04-25T15:54:50.211826+0000","last_clean":"2024-04-25T15:54:50.211826+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:50.211826+0000","last_undegraded":"2024-04-25T15:54:50.211826+0000","last_fullsized":"2024-04-25T15:54:50.211826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201505+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:50.201505+0000","last_peered":"2024-04-25T15:54:50.201505+0000","last_clean":"2024-04-25T15:54:50.201505+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:50.201505+0000","last_undegraded":"2024-04-25T15:54:50.201505+0000","last_fullsized":"2024-04-25T15:54:50.201505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623379+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:50.623379+0000","last_peered":"2024-04-25T15:54:50.623379+0000","last_clean":"2024-04-25T15:54:50.623379+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:50.623379+0000","last_undegraded":"2024-04-25T15:54:50.623379+0000","last_fullsized":"2024-04-25T15:54:50.623379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211500+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:50.211500+0000","last_peered":"2024-04-25T15:54:50.211500+0000","last_clean":"2024-04-25T15:54:50.211500+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:50.211500+0000","last_undegraded":"2024-04-25T15:54:50.211500+0000","last_fullsized":"2024-04-25T15:54:50.211500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211157+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:50.211157+0000","last_peered":"2024-04-25T15:54:50.211157+0000","last_clean":"2024-04-25T15:54:50.211157+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:50.211157+0000","last_undegraded":"2024-04-25T15:54:50.211157+0000","last_fullsized":"2024-04-25T15:54:50.211157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206300+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:50.206300+0000","last_peered":"2024-04-25T15:54:50.206300+0000","last_clean":"2024-04-25T15:54:50.206300+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:50.206300+0000","last_undegraded":"2024-04-25T15:54:50.206300+0000","last_fullsized":"2024-04-25T15:54:50.206300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205814+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:50.205814+0000","last_peered":"2024-04-25T15:54:50.205814+0000","last_clean":"2024-04-25T15:54:50.205814+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:50.205814+0000","last_undegraded":"2024-04-25T15:54:50.205814+0000","last_fullsized":"2024-04-25T15:54:50.205814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202059+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:50.202059+0000","last_peered":"2024-04-25T15:54:50.202059+0000","last_clean":"2024-04-25T15:54:50.202059+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:50.202059+0000","last_undegraded":"2024-04-25T15:54:50.202059+0000","last_fullsized":"2024-04-25T15:54:50.202059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200450+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:50.200450+0000","last_peered":"2024-04-25T15:54:50.200450+0000","last_clean":"2024-04-25T15:54:50.200450+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:50.200450+0000","last_undegraded":"2024-04-25T15:54:50.200450+0000","last_fullsized":"2024-04-25T15:54:50.200450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202891+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:50.202891+0000","last_peered":"2024-04-25T15:54:50.202891+0000","last_clean":"2024-04-25T15:54:50.202891+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:50.202891+0000","last_undegraded":"2024-04-25T15:54:50.202891+0000","last_fullsized":"2024-04-25T15:54:50.202891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214917+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:50.214917+0000","last_peered":"2024-04-25T15:54:50.214917+0000","last_clean":"2024-04-25T15:54:50.214917+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:50.214917+0000","last_undegraded":"2024-04-25T15:54:50.214917+0000","last_fullsized":"2024-04-25T15:54:50.214917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200162+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:50.200162+0000","last_peered":"2024-04-25T15:54:50.200162+0000","last_clean":"2024-04-25T15:54:50.200162+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:50.200162+0000","last_undegraded":"2024-04-25T15:54:50.200162+0000","last_fullsized":"2024-04-25T15:54:50.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205458+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:50.205458+0000","last_peered":"2024-04-25T15:54:50.205458+0000","last_clean":"2024-04-25T15:54:50.205458+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:50.205458+0000","last_undegraded":"2024-04-25T15:54:50.205458+0000","last_fullsized":"2024-04-25T15:54:50.205458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203208+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:50.203208+0000","last_peered":"2024-04-25T15:54:50.203208+0000","last_clean":"2024-04-25T15:54:50.203208+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:50.203208+0000","last_undegraded":"2024-04-25T15:54:50.203208+0000","last_fullsized":"2024-04-25T15:54:50.203208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200083+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:50.200083+0000","last_peered":"2024-04-25T15:54:50.200083+0000","last_clean":"2024-04-25T15:54:50.200083+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:50.200083+0000","last_undegraded":"2024-04-25T15:54:50.200083+0000","last_fullsized":"2024-04-25T15:54:50.200083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.218706+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T15:54:50.218706+0000","last_peered":"2024-04-25T15:54:50.218706+0000","last_clean":"2024-04-25T15:54:50.218706+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T15:54:50.218706+0000","last_undegraded":"2024-04-25T15:54:50.218706+0000","last_fullsized":"2024-04-25T15:54:50.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624450+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:50.624450+0000","last_peered":"2024-04-25T15:54:50.624450+0000","last_clean":"2024-04-25T15:54:50.624450+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:50.624450+0000","last_undegraded":"2024-04-25T15:54:50.624450+0000","last_fullsized":"2024-04-25T15:54:50.624450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206216+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:50.206216+0000","last_peered":"2024-04-25T15:54:50.206216+0000","last_clean":"2024-04-25T15:54:50.206216+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:50.206216+0000","last_undegraded":"2024-04-25T15:54:50.206216+0000","last_fullsized":"2024-04-25T15:54:50.206216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623282+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:50.623282+0000","last_peered":"2024-04-25T15:54:50.623282+0000","last_clean":"2024-04-25T15:54:50.623282+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:50.623282+0000","last_undegraded":"2024-04-25T15:54:50.623282+0000","last_fullsized":"2024-04-25T15:54:50.623282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.223994+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T15:54:50.223994+0000","last_peered":"2024-04-25T15:54:50.223994+0000","last_clean":"2024-04-25T15:54:50.223994+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T15:54:50.223994+0000","last_undegraded":"2024-04-25T15:54:50.223994+0000","last_fullsized":"2024-04-25T15:54:50.223994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202114+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:50.202114+0000","last_peered":"2024-04-25T15:54:50.202114+0000","last_clean":"2024-04-25T15:54:50.202114+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:50.202114+0000","last_undegraded":"2024-04-25T15:54:50.202114+0000","last_fullsized":"2024-04-25T15:54:50.202114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205909+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:50.205909+0000","last_peered":"2024-04-25T15:54:50.205909+0000","last_clean":"2024-04-25T15:54:50.205909+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:50.205909+0000","last_undegraded":"2024-04-25T15:54:50.205909+0000","last_fullsized":"2024-04-25T15:54:50.205909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623078+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:50.623078+0000","last_peered":"2024-04-25T15:54:50.623078+0000","last_clean":"2024-04-25T15:54:50.623078+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:50.623078+0000","last_undegraded":"2024-04-25T15:54:50.623078+0000","last_fullsized":"2024-04-25T15:54:50.623078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205112+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:50.205112+0000","last_peered":"2024-04-25T15:54:50.205112+0000","last_clean":"2024-04-25T15:54:50.205112+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:50.205112+0000","last_undegraded":"2024-04-25T15:54:50.205112+0000","last_fullsized":"2024-04-25T15:54:50.205112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207524+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:50.207524+0000","last_peered":"2024-04-25T15:54:50.207524+0000","last_clean":"2024-04-25T15:54:50.207524+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:50.207524+0000","last_undegraded":"2024-04-25T15:54:50.207524+0000","last_fullsized":"2024-04-25T15:54:50.207524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202477+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:50.202477+0000","last_peered":"2024-04-25T15:54:50.202477+0000","last_clean":"2024-04-25T15:54:50.202477+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:50.202477+0000","last_undegraded":"2024-04-25T15:54:50.202477+0000","last_fullsized":"2024-04-25T15:54:50.202477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625039+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:50.625039+0000","last_peered":"2024-04-25T15:54:50.625039+0000","last_clean":"2024-04-25T15:54:50.625039+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:50.625039+0000","last_undegraded":"2024-04-25T15:54:50.625039+0000","last_fullsized":"2024-04-25T15:54:50.625039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207721+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:50.207721+0000","last_peered":"2024-04-25T15:54:50.207721+0000","last_clean":"2024-04-25T15:54:50.207721+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:50.207721+0000","last_undegraded":"2024-04-25T15:54:50.207721+0000","last_fullsized":"2024-04-25T15:54:50.207721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203453+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:50.203453+0000","last_peered":"2024-04-25T15:54:50.203453+0000","last_clean":"2024-04-25T15:54:50.203453+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:50.203453+0000","last_undegraded":"2024-04-25T15:54:50.203453+0000","last_fullsized":"2024-04-25T15:54:50.203453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622280+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:50.622280+0000","last_peered":"2024-04-25T15:54:50.622280+0000","last_clean":"2024-04-25T15:54:50.622280+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:50.622280+0000","last_undegraded":"2024-04-25T15:54:50.622280+0000","last_fullsized":"2024-04-25T15:54:50.622280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213490+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:50.213490+0000","last_peered":"2024-04-25T15:54:50.213490+0000","last_clean":"2024-04-25T15:54:50.213490+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:50.213490+0000","last_undegraded":"2024-04-25T15:54:50.213490+0000","last_fullsized":"2024-04-25T15:54:50.213490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200025+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:50.200025+0000","last_peered":"2024-04-25T15:54:50.200025+0000","last_clean":"2024-04-25T15:54:50.200025+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:50.200025+0000","last_undegraded":"2024-04-25T15:54:50.200025+0000","last_fullsized":"2024-04-25T15:54:50.200025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200254+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:50.200254+0000","last_peered":"2024-04-25T15:54:50.200254+0000","last_clean":"2024-04-25T15:54:50.200254+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:50.200254+0000","last_undegraded":"2024-04-25T15:54:50.200254+0000","last_fullsized":"2024-04-25T15:54:50.200254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623054+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:50.623054+0000","last_peered":"2024-04-25T15:54:50.623054+0000","last_clean":"2024-04-25T15:54:50.623054+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:50.623054+0000","last_undegraded":"2024-04-25T15:54:50.623054+0000","last_fullsized":"2024-04-25T15:54:50.623054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204302+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:50.204302+0000","last_peered":"2024-04-25T15:54:50.204302+0000","last_clean":"2024-04-25T15:54:50.204302+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:50.204302+0000","last_undegraded":"2024-04-25T15:54:50.204302+0000","last_fullsized":"2024-04-25T15:54:50.204302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.210919+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T15:54:50.210919+0000","last_peered":"2024-04-25T15:54:50.210919+0000","last_clean":"2024-04-25T15:54:50.210919+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T15:54:50.210919+0000","last_undegraded":"2024-04-25T15:54:50.210919+0000","last_fullsized":"2024-04-25T15:54:50.210919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211448+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:50.211448+0000","last_peered":"2024-04-25T15:54:50.211448+0000","last_clean":"2024-04-25T15:54:50.211448+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:50.211448+0000","last_undegraded":"2024-04-25T15:54:50.211448+0000","last_fullsized":"2024-04-25T15:54:50.211448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206135+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:50.206135+0000","last_peered":"2024-04-25T15:54:50.206135+0000","last_clean":"2024-04-25T15:54:50.206135+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:50.206135+0000","last_undegraded":"2024-04-25T15:54:50.206135+0000","last_fullsized":"2024-04-25T15:54:50.206135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202309+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:50.202309+0000","last_peered":"2024-04-25T15:54:50.202309+0000","last_clean":"2024-04-25T15:54:50.202309+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:50.202309+0000","last_undegraded":"2024-04-25T15:54:50.202309+0000","last_fullsized":"2024-04-25T15:54:50.202309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215139+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:50.215139+0000","last_peered":"2024-04-25T15:54:50.215139+0000","last_clean":"2024-04-25T15:54:50.215139+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:50.215139+0000","last_undegraded":"2024-04-25T15:54:50.215139+0000","last_fullsized":"2024-04-25T15:54:50.215139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200157+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:50.200157+0000","last_peered":"2024-04-25T15:54:50.200157+0000","last_clean":"2024-04-25T15:54:50.200157+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:50.200157+0000","last_undegraded":"2024-04-25T15:54:50.200157+0000","last_fullsized":"2024-04-25T15:54:50.200157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200814+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:50.200814+0000","last_peered":"2024-04-25T15:54:50.200814+0000","last_clean":"2024-04-25T15:54:50.200814+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:50.200814+0000","last_undegraded":"2024-04-25T15:54:50.200814+0000","last_fullsized":"2024-04-25T15:54:50.200814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206016+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:50.206016+0000","last_peered":"2024-04-25T15:54:50.206016+0000","last_clean":"2024-04-25T15:54:50.206016+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:50.206016+0000","last_undegraded":"2024-04-25T15:54:50.206016+0000","last_fullsized":"2024-04-25T15:54:50.206016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211786+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:50.211786+0000","last_peered":"2024-04-25T15:54:50.211786+0000","last_clean":"2024-04-25T15:54:50.211786+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:50.211786+0000","last_undegraded":"2024-04-25T15:54:50.211786+0000","last_fullsized":"2024-04-25T15:54:50.211786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207802+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:50.207802+0000","last_peered":"2024-04-25T15:54:50.207802+0000","last_clean":"2024-04-25T15:54:50.207802+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:50.207802+0000","last_undegraded":"2024-04-25T15:54:50.207802+0000","last_fullsized":"2024-04-25T15:54:50.207802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203144+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:50.203144+0000","last_peered":"2024-04-25T15:54:50.203144+0000","last_clean":"2024-04-25T15:54:50.203144+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:50.203144+0000","last_undegraded":"2024-04-25T15:54:50.203144+0000","last_fullsized":"2024-04-25T15:54:50.203144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204480+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:50.204480+0000","last_peered":"2024-04-25T15:54:50.204480+0000","last_clean":"2024-04-25T15:54:50.204480+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:50.204480+0000","last_undegraded":"2024-04-25T15:54:50.204480+0000","last_fullsized":"2024-04-25T15:54:50.204480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211866+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:50.211866+0000","last_peered":"2024-04-25T15:54:50.211866+0000","last_clean":"2024-04-25T15:54:50.211866+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:50.211866+0000","last_undegraded":"2024-04-25T15:54:50.211866+0000","last_fullsized":"2024-04-25T15:54:50.211866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199776+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:50.199776+0000","last_peered":"2024-04-25T15:54:50.199776+0000","last_clean":"2024-04-25T15:54:50.199776+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:50.199776+0000","last_undegraded":"2024-04-25T15:54:50.199776+0000","last_fullsized":"2024-04-25T15:54:50.199776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204117+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:50.204117+0000","last_peered":"2024-04-25T15:54:50.204117+0000","last_clean":"2024-04-25T15:54:50.204117+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:50.204117+0000","last_undegraded":"2024-04-25T15:54:50.204117+0000","last_fullsized":"2024-04-25T15:54:50.204117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204155+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:50.204155+0000","last_peered":"2024-04-25T15:54:50.204155+0000","last_clean":"2024-04-25T15:54:50.204155+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:50.204155+0000","last_undegraded":"2024-04-25T15:54:50.204155+0000","last_fullsized":"2024-04-25T15:54:50.204155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622781+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:50.622781+0000","last_peered":"2024-04-25T15:54:50.622781+0000","last_clean":"2024-04-25T15:54:50.622781+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:50.622781+0000","last_undegraded":"2024-04-25T15:54:50.622781+0000","last_fullsized":"2024-04-25T15:54:50.622781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211121+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:50.211121+0000","last_peered":"2024-04-25T15:54:50.211121+0000","last_clean":"2024-04-25T15:54:50.211121+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:50.211121+0000","last_undegraded":"2024-04-25T15:54:50.211121+0000","last_fullsized":"2024-04-25T15:54:50.211121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207794+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:50.207794+0000","last_peered":"2024-04-25T15:54:50.207794+0000","last_clean":"2024-04-25T15:54:50.207794+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:50.207794+0000","last_undegraded":"2024-04-25T15:54:50.207794+0000","last_fullsized":"2024-04-25T15:54:50.207794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211544+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:50.211544+0000","last_peered":"2024-04-25T15:54:50.211544+0000","last_clean":"2024-04-25T15:54:50.211544+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:50.211544+0000","last_undegraded":"2024-04-25T15:54:50.211544+0000","last_fullsized":"2024-04-25T15:54:50.211544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215061+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:50.215061+0000","last_peered":"2024-04-25T15:54:50.215061+0000","last_clean":"2024-04-25T15:54:50.215061+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:50.215061+0000","last_undegraded":"2024-04-25T15:54:50.215061+0000","last_fullsized":"2024-04-25T15:54:50.215061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":704305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":115934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":113495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":117393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:53.805 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-04-25T15:54:53.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:54:53.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 Processor -- start 2024-04-25T15:54:53.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 -- start start 2024-04-25T15:54:53.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a80a8cc0 0x7f61a81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f61a8152870 0x7f61a8155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a8152c80 con 0x7f61a8155780 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f61a80aebc0 con 0x7f61a8152870 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61aee83640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61a8158f20 con 0x7f61a80a8cc0 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f61a8152870 0x7f61a8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f61a8152870 0x7f61a8155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52564/0 (socket says 172.21.15.87:52564) 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 -- 172.21.15.87:0/3413170163 learned_addr learned my addr 172.21.15.87:0/3413170163 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61acc1f640 1 --2- 172.21.15.87:0/3413170163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a80a8cc0 0x7f61a81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 -- 172.21.15.87:0/3413170163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a80a8cc0 msgr2=0x7f61a81593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 --2- 172.21.15.87:0/3413170163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a80a8cc0 0x7f61a81593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 -- 172.21.15.87:0/3413170163 >> v1:172.21.15.155:6789/0 conn(0x7f61a8155780 legacy=0x7f61a806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:53.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.980+0000 7f61a7fff640 1 -- 172.21.15.87:0/3413170163 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a80ae8e0 con 0x7f61a8152870 2024-04-25T15:54:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61a7fff640 1 --2- 172.21.15.87:0/3413170163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a8152870 0x7f61a8155240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61a80aed40 tx=0x7f619c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750c38611663af58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61a77fe640 1 -- 172.21.15.87:0/3413170163 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c0b0070 con 0x7f61a8152870 2024-04-25T15:54:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61a77fe640 1 -- 172.21.15.87:0/3413170163 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619c0ab600 con 0x7f61a8152870 2024-04-25T15:54:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61a77fe640 1 -- 172.21.15.87:0/3413170163 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c0ab9d0 con 0x7f61a8152870 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 -- 172.21.15.87:0/3413170163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a8152870 msgr2=0x7f61a8155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 --2- 172.21.15.87:0/3413170163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a8152870 0x7f61a8155240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f61a80aed40 tx=0x7f619c01c3b0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 -- 172.21.15.87:0/3413170163 shutdown_connections 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 --2- 172.21.15.87:0/3413170163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a8152870 0x7f61a8155240 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 --2- 172.21.15.87:0/3413170163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a80a8cc0 0x7f61a81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 -- 172.21.15.87:0/3413170163 >> 172.21.15.87:0/3413170163 conn(0x7f61a806d780 msgr2=0x7f61a806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 -- 172.21.15.87:0/3413170163 shutdown_connections 2024-04-25T15:54:53.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.984+0000 7f61aee83640 1 -- 172.21.15.87:0/3413170163 wait complete. 2024-04-25T15:54:53.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 Processor -- start 2024-04-25T15:54:53.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- start start 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 0x7f61a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a8152870 0x7f61a80c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8155780 0x7f61a814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f61a80ac870 con 0x7f61a80a8cc0 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61a80ac6f0 con 0x7f61a8155780 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61a81623e0 con 0x7f61a8152870 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 0x7f61a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 0x7f61a815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52566/0 (socket says 172.21.15.87:52566) 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 -- 172.21.15.87:0/2596046678 learned_addr learned my addr 172.21.15.87:0/2596046678 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61ad420640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8155780 0x7f61a814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61a7fff640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a8152870 0x7f61a80c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 -- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a8152870 msgr2=0x7f61a80c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a8152870 0x7f61a80c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 -- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8155780 msgr2=0x7f61a814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8155780 0x7f61a814d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 -- 172.21.15.87:0/2596046678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a814ce50 con 0x7f61a80a8cc0 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61a7fff640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a8152870 0x7f61a80c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61acc1f640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 0x7f61a815abd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f61a000cd00 tx=0x7f61a000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00039a0 con 0x7f61a80a8cc0 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0003b40 con 0x7f61a80a8cc0 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0004020 con 0x7f61a80a8cc0 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a8159de0 con 0x7f61a80a8cc0 2024-04-25T15:54:53.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a815b110 con 0x7f61a80a8cc0 2024-04-25T15:54:53.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.988+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a8069bb0 con 0x7f61a80a8cc0 2024-04-25T15:54:53.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.992+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f61a00041c0 con 0x7f61a80a8cc0 2024-04-25T15:54:53.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.992+0000 7f61a57fa640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f619406f400 0x7f6194071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:53.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.992+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f61a008fbd0 con 0x7f61a80a8cc0 2024-04-25T15:54:53.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.992+0000 7f61a7fff640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f619406f400 0x7f6194071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:53.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.992+0000 7f61a7fff640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f619406f400 0x7f6194071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ad000 tx=0x7f619c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:53.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:53.996+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f61a0014030 con 0x7f61a80a8cc0 2024-04-25T15:54:54.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.140+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61a80c9350 con 0x7f619406f400 2024-04-25T15:54:54.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.152+0000 7f61a57fa640 1 -- 172.21.15.87:0/2596046678 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490401 (secure 0 0 0) 0x7f61a80c9350 con 0x7f619406f400 2024-04-25T15:54:54.160 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:54.163 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f619406f400 msgr2=0x7f6194071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f619406f400 0x7f6194071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ad000 tx=0x7f619c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 msgr2=0x7f61a815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 0x7f61a815abd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f61a000cd00 tx=0x7f61a000a5c0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 shutdown_connections 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f619406f400 0x7f6194071910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.156+0000 7f61aee83640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a8155780 0x7f61a814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.160+0000 7f61aee83640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a8152870 0x7f61a80c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.160+0000 7f61aee83640 1 --2- 172.21.15.87:0/2596046678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61a80a8cc0 0x7f61a815abd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.160+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 >> 172.21.15.87:0/2596046678 conn(0x7f61a806d780 msgr2=0x7f61a8156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:54.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.160+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 shutdown_connections 2024-04-25T15:54:54.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.160+0000 7f61aee83640 1 -- 172.21.15.87:0/2596046678 wait complete. 2024-04-25T15:54:54.178 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-04-25T15:54:53.117025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596070,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":195,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":389,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219656,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755064,"statfs":{"total":773094113280,"available":772869185536,"internally_reserved":0,"allocated":3547136,"data_stored":2098260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":882,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003042"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623593+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T15:54:50.623593+0000","last_peered":"2024-04-25T15:54:50.623593+0000","last_clean":"2024-04-25T15:54:50.623593+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T15:54:50.623593+0000","last_undegraded":"2024-04-25T15:54:50.623593+0000","last_fullsized":"2024-04-25T15:54:50.623593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623787+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T15:54:50.623787+0000","last_peered":"2024-04-25T15:54:50.623787+0000","last_clean":"2024-04-25T15:54:50.623787+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T15:54:50.623787+0000","last_undegraded":"2024-04-25T15:54:50.623787+0000","last_fullsized":"2024-04-25T15:54:50.623787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201386+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T15:54:50.201386+0000","last_peered":"2024-04-25T15:54:50.201386+0000","last_clean":"2024-04-25T15:54:50.201386+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T15:54:50.201386+0000","last_undegraded":"2024-04-25T15:54:50.201386+0000","last_fullsized":"2024-04-25T15:54:50.201386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199876+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T15:54:50.199876+0000","last_peered":"2024-04-25T15:54:50.199876+0000","last_clean":"2024-04-25T15:54:50.199876+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T15:54:50.199876+0000","last_undegraded":"2024-04-25T15:54:50.199876+0000","last_fullsized":"2024-04-25T15:54:50.199876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207311+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T15:54:50.207311+0000","last_peered":"2024-04-25T15:54:50.207311+0000","last_clean":"2024-04-25T15:54:50.207311+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T15:54:50.207311+0000","last_undegraded":"2024-04-25T15:54:50.207311+0000","last_fullsized":"2024-04-25T15:54:50.207311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201847+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T15:54:50.201847+0000","last_peered":"2024-04-25T15:54:50.201847+0000","last_clean":"2024-04-25T15:54:50.201847+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T15:54:50.201847+0000","last_undegraded":"2024-04-25T15:54:50.201847+0000","last_fullsized":"2024-04-25T15:54:50.201847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622933+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T15:54:50.622933+0000","last_peered":"2024-04-25T15:54:50.622933+0000","last_clean":"2024-04-25T15:54:50.622933+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T15:54:50.622933+0000","last_undegraded":"2024-04-25T15:54:50.622933+0000","last_fullsized":"2024-04-25T15:54:50.622933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623974+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T15:54:50.623974+0000","last_peered":"2024-04-25T15:54:50.623974+0000","last_clean":"2024-04-25T15:54:50.623974+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T15:54:50.623974+0000","last_undegraded":"2024-04-25T15:54:50.623974+0000","last_fullsized":"2024-04-25T15:54:50.623974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212070+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T15:54:50.212070+0000","last_peered":"2024-04-25T15:54:50.212070+0000","last_clean":"2024-04-25T15:54:50.212070+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T15:54:50.212070+0000","last_undegraded":"2024-04-25T15:54:50.212070+0000","last_fullsized":"2024-04-25T15:54:50.212070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215172+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T15:54:50.215172+0000","last_peered":"2024-04-25T15:54:50.215172+0000","last_clean":"2024-04-25T15:54:50.215172+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T15:54:50.215172+0000","last_undegraded":"2024-04-25T15:54:50.215172+0000","last_fullsized":"2024-04-25T15:54:50.215172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203775+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T15:54:50.203775+0000","last_peered":"2024-04-25T15:54:50.203775+0000","last_clean":"2024-04-25T15:54:50.203775+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T15:54:50.203775+0000","last_undegraded":"2024-04-25T15:54:50.203775+0000","last_fullsized":"2024-04-25T15:54:50.203775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624486+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T15:54:50.624486+0000","last_peered":"2024-04-25T15:54:50.624486+0000","last_clean":"2024-04-25T15:54:50.624486+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T15:54:50.624486+0000","last_undegraded":"2024-04-25T15:54:50.624486+0000","last_fullsized":"2024-04-25T15:54:50.624486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203201+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T15:54:50.203201+0000","last_peered":"2024-04-25T15:54:50.203201+0000","last_clean":"2024-04-25T15:54:50.203201+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T15:54:50.203201+0000","last_undegraded":"2024-04-25T15:54:50.203201+0000","last_fullsized":"2024-04-25T15:54:50.203201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213316+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T15:54:50.213316+0000","last_peered":"2024-04-25T15:54:50.213316+0000","last_clean":"2024-04-25T15:54:50.213316+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T15:54:50.213316+0000","last_undegraded":"2024-04-25T15:54:50.213316+0000","last_fullsized":"2024-04-25T15:54:50.213316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204667+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T15:54:50.204667+0000","last_peered":"2024-04-25T15:54:50.204667+0000","last_clean":"2024-04-25T15:54:50.204667+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T15:54:50.204667+0000","last_undegraded":"2024-04-25T15:54:50.204667+0000","last_fullsized":"2024-04-25T15:54:50.204667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624016+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T15:54:50.624016+0000","last_peered":"2024-04-25T15:54:50.624016+0000","last_clean":"2024-04-25T15:54:50.624016+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T15:54:50.624016+0000","last_undegraded":"2024-04-25T15:54:50.624016+0000","last_fullsized":"2024-04-25T15:54:50.624016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208037+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T15:54:50.208037+0000","last_peered":"2024-04-25T15:54:50.208037+0000","last_clean":"2024-04-25T15:54:50.208037+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T15:54:50.208037+0000","last_undegraded":"2024-04-25T15:54:50.208037+0000","last_fullsized":"2024-04-25T15:54:50.208037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207285+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T15:54:50.207285+0000","last_peered":"2024-04-25T15:54:50.207285+0000","last_clean":"2024-04-25T15:54:50.207285+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T15:54:50.207285+0000","last_undegraded":"2024-04-25T15:54:50.207285+0000","last_fullsized":"2024-04-25T15:54:50.207285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212064+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T15:54:50.212064+0000","last_peered":"2024-04-25T15:54:50.212064+0000","last_clean":"2024-04-25T15:54:50.212064+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T15:54:50.212064+0000","last_undegraded":"2024-04-25T15:54:50.212064+0000","last_fullsized":"2024-04-25T15:54:50.212064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625062+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T15:54:50.625062+0000","last_peered":"2024-04-25T15:54:50.625062+0000","last_clean":"2024-04-25T15:54:50.625062+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T15:54:50.625062+0000","last_undegraded":"2024-04-25T15:54:50.625062+0000","last_fullsized":"2024-04-25T15:54:50.625062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204629+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T15:54:50.204629+0000","last_peered":"2024-04-25T15:54:50.204629+0000","last_clean":"2024-04-25T15:54:50.204629+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T15:54:50.204629+0000","last_undegraded":"2024-04-25T15:54:50.204629+0000","last_fullsized":"2024-04-25T15:54:50.204629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200033+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T15:54:50.200033+0000","last_peered":"2024-04-25T15:54:50.200033+0000","last_clean":"2024-04-25T15:54:50.200033+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T15:54:50.200033+0000","last_undegraded":"2024-04-25T15:54:50.200033+0000","last_fullsized":"2024-04-25T15:54:50.200033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208435+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T15:54:50.208435+0000","last_peered":"2024-04-25T15:54:50.208435+0000","last_clean":"2024-04-25T15:54:50.208435+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T15:54:50.208435+0000","last_undegraded":"2024-04-25T15:54:50.208435+0000","last_fullsized":"2024-04-25T15:54:50.208435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625126+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T15:54:50.625126+0000","last_peered":"2024-04-25T15:54:50.625126+0000","last_clean":"2024-04-25T15:54:50.625126+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T15:54:50.625126+0000","last_undegraded":"2024-04-25T15:54:50.625126+0000","last_fullsized":"2024-04-25T15:54:50.625126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625014+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T15:54:50.625014+0000","last_peered":"2024-04-25T15:54:50.625014+0000","last_clean":"2024-04-25T15:54:50.625014+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T15:54:50.625014+0000","last_undegraded":"2024-04-25T15:54:50.625014+0000","last_fullsized":"2024-04-25T15:54:50.625014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201187+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T15:54:50.201187+0000","last_peered":"2024-04-25T15:54:50.201187+0000","last_clean":"2024-04-25T15:54:50.201187+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T15:54:50.201187+0000","last_undegraded":"2024-04-25T15:54:50.201187+0000","last_fullsized":"2024-04-25T15:54:50.201187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.209227+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T15:54:50.209227+0000","last_peered":"2024-04-25T15:54:50.209227+0000","last_clean":"2024-04-25T15:54:50.209227+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T15:54:50.209227+0000","last_undegraded":"2024-04-25T15:54:50.209227+0000","last_fullsized":"2024-04-25T15:54:50.209227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208644+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T15:54:50.208644+0000","last_peered":"2024-04-25T15:54:50.208644+0000","last_clean":"2024-04-25T15:54:50.208644+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T15:54:50.208644+0000","last_undegraded":"2024-04-25T15:54:50.208644+0000","last_fullsized":"2024-04-25T15:54:50.208644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204363+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T15:54:50.204363+0000","last_peered":"2024-04-25T15:54:50.204363+0000","last_clean":"2024-04-25T15:54:50.204363+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T15:54:50.204363+0000","last_undegraded":"2024-04-25T15:54:50.204363+0000","last_fullsized":"2024-04-25T15:54:50.204363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622545+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T15:54:50.622545+0000","last_peered":"2024-04-25T15:54:50.622545+0000","last_clean":"2024-04-25T15:54:50.622545+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T15:54:50.622545+0000","last_undegraded":"2024-04-25T15:54:50.622545+0000","last_fullsized":"2024-04-25T15:54:50.622545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211334+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T15:54:50.211334+0000","last_peered":"2024-04-25T15:54:50.211334+0000","last_clean":"2024-04-25T15:54:50.211334+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T15:54:50.211334+0000","last_undegraded":"2024-04-25T15:54:50.211334+0000","last_fullsized":"2024-04-25T15:54:50.211334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625243+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T15:54:50.625243+0000","last_peered":"2024-04-25T15:54:50.625243+0000","last_clean":"2024-04-25T15:54:50.625243+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T15:54:50.625243+0000","last_undegraded":"2024-04-25T15:54:50.625243+0000","last_fullsized":"2024-04-25T15:54:50.625243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199497+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T15:54:50.199497+0000","last_peered":"2024-04-25T15:54:50.199497+0000","last_clean":"2024-04-25T15:54:50.199497+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T15:54:50.199497+0000","last_undegraded":"2024-04-25T15:54:50.199497+0000","last_fullsized":"2024-04-25T15:54:50.199497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622635+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T15:54:50.622635+0000","last_peered":"2024-04-25T15:54:50.622635+0000","last_clean":"2024-04-25T15:54:50.622635+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T15:54:50.622635+0000","last_undegraded":"2024-04-25T15:54:50.622635+0000","last_fullsized":"2024-04-25T15:54:50.622635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207014+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T15:54:50.207014+0000","last_peered":"2024-04-25T15:54:50.207014+0000","last_clean":"2024-04-25T15:54:50.207014+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T15:54:50.207014+0000","last_undegraded":"2024-04-25T15:54:50.207014+0000","last_fullsized":"2024-04-25T15:54:50.207014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623518+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T15:54:50.623518+0000","last_peered":"2024-04-25T15:54:50.623518+0000","last_clean":"2024-04-25T15:54:50.623518+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T15:54:50.623518+0000","last_undegraded":"2024-04-25T15:54:50.623518+0000","last_fullsized":"2024-04-25T15:54:50.623518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623247+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T15:54:50.623247+0000","last_peered":"2024-04-25T15:54:50.623247+0000","last_clean":"2024-04-25T15:54:50.623247+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T15:54:50.623247+0000","last_undegraded":"2024-04-25T15:54:50.623247+0000","last_fullsized":"2024-04-25T15:54:50.623247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202126+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T15:54:50.202126+0000","last_peered":"2024-04-25T15:54:50.202126+0000","last_clean":"2024-04-25T15:54:50.202126+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T15:54:50.202126+0000","last_undegraded":"2024-04-25T15:54:50.202126+0000","last_fullsized":"2024-04-25T15:54:50.202126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208896+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T15:54:50.208896+0000","last_peered":"2024-04-25T15:54:50.208896+0000","last_clean":"2024-04-25T15:54:50.208896+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T15:54:50.208896+0000","last_undegraded":"2024-04-25T15:54:50.208896+0000","last_fullsized":"2024-04-25T15:54:50.208896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199497+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T15:54:50.199497+0000","last_peered":"2024-04-25T15:54:50.199497+0000","last_clean":"2024-04-25T15:54:50.199497+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T15:54:50.199497+0000","last_undegraded":"2024-04-25T15:54:50.199497+0000","last_fullsized":"2024-04-25T15:54:50.199497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206872+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T15:54:50.206872+0000","last_peered":"2024-04-25T15:54:50.206872+0000","last_clean":"2024-04-25T15:54:50.206872+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T15:54:50.206872+0000","last_undegraded":"2024-04-25T15:54:50.206872+0000","last_fullsized":"2024-04-25T15:54:50.206872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.209136+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T15:54:50.209136+0000","last_peered":"2024-04-25T15:54:50.209136+0000","last_clean":"2024-04-25T15:54:50.209136+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T15:54:50.209136+0000","last_undegraded":"2024-04-25T15:54:50.209136+0000","last_fullsized":"2024-04-25T15:54:50.209136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215734+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T15:54:50.215734+0000","last_peered":"2024-04-25T15:54:50.215734+0000","last_clean":"2024-04-25T15:54:50.215734+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T15:54:50.215734+0000","last_undegraded":"2024-04-25T15:54:50.215734+0000","last_fullsized":"2024-04-25T15:54:50.215734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623506+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T15:54:50.623506+0000","last_peered":"2024-04-25T15:54:50.623506+0000","last_clean":"2024-04-25T15:54:50.623506+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T15:54:50.623506+0000","last_undegraded":"2024-04-25T15:54:50.623506+0000","last_fullsized":"2024-04-25T15:54:50.623506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623814+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T15:54:50.623814+0000","last_peered":"2024-04-25T15:54:50.623814+0000","last_clean":"2024-04-25T15:54:50.623814+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T15:54:50.623814+0000","last_undegraded":"2024-04-25T15:54:50.623814+0000","last_fullsized":"2024-04-25T15:54:50.623814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214162+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T15:54:50.214162+0000","last_peered":"2024-04-25T15:54:50.214162+0000","last_clean":"2024-04-25T15:54:50.214162+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T15:54:50.214162+0000","last_undegraded":"2024-04-25T15:54:50.214162+0000","last_fullsized":"2024-04-25T15:54:50.214162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208854+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T15:54:50.208854+0000","last_peered":"2024-04-25T15:54:50.208854+0000","last_clean":"2024-04-25T15:54:50.208854+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T15:54:50.208854+0000","last_undegraded":"2024-04-25T15:54:50.208854+0000","last_fullsized":"2024-04-25T15:54:50.208854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207971+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T15:54:50.207971+0000","last_peered":"2024-04-25T15:54:50.207971+0000","last_clean":"2024-04-25T15:54:50.207971+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T15:54:50.207971+0000","last_undegraded":"2024-04-25T15:54:50.207971+0000","last_fullsized":"2024-04-25T15:54:50.207971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623567+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T15:54:50.623567+0000","last_peered":"2024-04-25T15:54:50.623567+0000","last_clean":"2024-04-25T15:54:50.623567+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T15:54:50.623567+0000","last_undegraded":"2024-04-25T15:54:50.623567+0000","last_fullsized":"2024-04-25T15:54:50.623567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625403+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T15:54:50.625403+0000","last_peered":"2024-04-25T15:54:50.625403+0000","last_clean":"2024-04-25T15:54:50.625403+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T15:54:50.625403+0000","last_undegraded":"2024-04-25T15:54:50.625403+0000","last_fullsized":"2024-04-25T15:54:50.625403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203394+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T15:54:50.203394+0000","last_peered":"2024-04-25T15:54:50.203394+0000","last_clean":"2024-04-25T15:54:50.203394+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T15:54:50.203394+0000","last_undegraded":"2024-04-25T15:54:50.203394+0000","last_fullsized":"2024-04-25T15:54:50.203394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208549+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T15:54:50.208549+0000","last_peered":"2024-04-25T15:54:50.208549+0000","last_clean":"2024-04-25T15:54:50.208549+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T15:54:50.208549+0000","last_undegraded":"2024-04-25T15:54:50.208549+0000","last_fullsized":"2024-04-25T15:54:50.208549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204593+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T15:54:50.204593+0000","last_peered":"2024-04-25T15:54:50.204593+0000","last_clean":"2024-04-25T15:54:50.204593+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T15:54:50.204593+0000","last_undegraded":"2024-04-25T15:54:50.204593+0000","last_fullsized":"2024-04-25T15:54:50.204593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207717+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T15:54:50.207717+0000","last_peered":"2024-04-25T15:54:50.207717+0000","last_clean":"2024-04-25T15:54:50.207717+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T15:54:50.207717+0000","last_undegraded":"2024-04-25T15:54:50.207717+0000","last_fullsized":"2024-04-25T15:54:50.207717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205589+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T15:54:50.205589+0000","last_peered":"2024-04-25T15:54:50.205589+0000","last_clean":"2024-04-25T15:54:50.205589+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T15:54:50.205589+0000","last_undegraded":"2024-04-25T15:54:50.205589+0000","last_fullsized":"2024-04-25T15:54:50.205589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208777+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T15:54:50.208777+0000","last_peered":"2024-04-25T15:54:50.208777+0000","last_clean":"2024-04-25T15:54:50.208777+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T15:54:50.208777+0000","last_undegraded":"2024-04-25T15:54:50.208777+0000","last_fullsized":"2024-04-25T15:54:50.208777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204634+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T15:54:50.204634+0000","last_peered":"2024-04-25T15:54:50.204634+0000","last_clean":"2024-04-25T15:54:50.204634+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T15:54:50.204634+0000","last_undegraded":"2024-04-25T15:54:50.204634+0000","last_fullsized":"2024-04-25T15:54:50.204634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623181+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T15:54:50.623181+0000","last_peered":"2024-04-25T15:54:50.623181+0000","last_clean":"2024-04-25T15:54:50.623181+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T15:54:50.623181+0000","last_undegraded":"2024-04-25T15:54:50.623181+0000","last_fullsized":"2024-04-25T15:54:50.623181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211387+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T15:54:50.211387+0000","last_peered":"2024-04-25T15:54:50.211387+0000","last_clean":"2024-04-25T15:54:50.211387+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T15:54:50.211387+0000","last_undegraded":"2024-04-25T15:54:50.211387+0000","last_fullsized":"2024-04-25T15:54:50.211387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623887+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T15:54:50.623887+0000","last_peered":"2024-04-25T15:54:50.623887+0000","last_clean":"2024-04-25T15:54:50.623887+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T15:54:50.623887+0000","last_undegraded":"2024-04-25T15:54:50.623887+0000","last_fullsized":"2024-04-25T15:54:50.623887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211756+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T15:54:50.211756+0000","last_peered":"2024-04-25T15:54:50.211756+0000","last_clean":"2024-04-25T15:54:50.211756+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T15:54:50.211756+0000","last_undegraded":"2024-04-25T15:54:50.211756+0000","last_fullsized":"2024-04-25T15:54:50.211756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200580+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T15:54:50.200580+0000","last_peered":"2024-04-25T15:54:50.200580+0000","last_clean":"2024-04-25T15:54:50.200580+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T15:54:50.200580+0000","last_undegraded":"2024-04-25T15:54:50.200580+0000","last_fullsized":"2024-04-25T15:54:50.200580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203394+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T15:54:50.203394+0000","last_peered":"2024-04-25T15:54:50.203394+0000","last_clean":"2024-04-25T15:54:50.203394+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T15:54:50.203394+0000","last_undegraded":"2024-04-25T15:54:50.203394+0000","last_fullsized":"2024-04-25T15:54:50.203394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211562+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T15:54:50.211562+0000","last_peered":"2024-04-25T15:54:50.211562+0000","last_clean":"2024-04-25T15:54:50.211562+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T15:54:50.211562+0000","last_undegraded":"2024-04-25T15:54:50.211562+0000","last_fullsized":"2024-04-25T15:54:50.211562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206060+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T15:54:50.206060+0000","last_peered":"2024-04-25T15:54:50.206060+0000","last_clean":"2024-04-25T15:54:50.206060+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T15:54:50.206060+0000","last_undegraded":"2024-04-25T15:54:50.206060+0000","last_fullsized":"2024-04-25T15:54:50.206060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205501+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T15:54:50.205501+0000","last_peered":"2024-04-25T15:54:50.205501+0000","last_clean":"2024-04-25T15:54:50.205501+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T15:54:50.205501+0000","last_undegraded":"2024-04-25T15:54:50.205501+0000","last_fullsized":"2024-04-25T15:54:50.205501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.218519+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T15:54:50.218519+0000","last_peered":"2024-04-25T15:54:50.218519+0000","last_clean":"2024-04-25T15:54:50.218519+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T15:54:50.218519+0000","last_undegraded":"2024-04-25T15:54:50.218519+0000","last_fullsized":"2024-04-25T15:54:50.218519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206444+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T15:54:50.206444+0000","last_peered":"2024-04-25T15:54:50.206444+0000","last_clean":"2024-04-25T15:54:50.206444+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T15:54:50.206444+0000","last_undegraded":"2024-04-25T15:54:50.206444+0000","last_fullsized":"2024-04-25T15:54:50.206444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207024+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T15:54:50.207024+0000","last_peered":"2024-04-25T15:54:50.207024+0000","last_clean":"2024-04-25T15:54:50.207024+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T15:54:50.207024+0000","last_undegraded":"2024-04-25T15:54:50.207024+0000","last_fullsized":"2024-04-25T15:54:50.207024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204340+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T15:54:50.204340+0000","last_peered":"2024-04-25T15:54:50.204340+0000","last_clean":"2024-04-25T15:54:50.204340+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T15:54:50.204340+0000","last_undegraded":"2024-04-25T15:54:50.204340+0000","last_fullsized":"2024-04-25T15:54:50.204340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213297+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T15:54:50.213297+0000","last_peered":"2024-04-25T15:54:50.213297+0000","last_clean":"2024-04-25T15:54:50.213297+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T15:54:50.213297+0000","last_undegraded":"2024-04-25T15:54:50.213297+0000","last_fullsized":"2024-04-25T15:54:50.213297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.210895+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T15:54:50.210895+0000","last_peered":"2024-04-25T15:54:50.210895+0000","last_clean":"2024-04-25T15:54:50.210895+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T15:54:50.210895+0000","last_undegraded":"2024-04-25T15:54:50.210895+0000","last_fullsized":"2024-04-25T15:54:50.210895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623154+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T15:54:50.623154+0000","last_peered":"2024-04-25T15:54:50.623154+0000","last_clean":"2024-04-25T15:54:50.623154+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T15:54:50.623154+0000","last_undegraded":"2024-04-25T15:54:50.623154+0000","last_fullsized":"2024-04-25T15:54:50.623154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211197+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T15:54:50.211197+0000","last_peered":"2024-04-25T15:54:50.211197+0000","last_clean":"2024-04-25T15:54:50.211197+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T15:54:50.211197+0000","last_undegraded":"2024-04-25T15:54:50.211197+0000","last_fullsized":"2024-04-25T15:54:50.211197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215210+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T15:54:50.215210+0000","last_peered":"2024-04-25T15:54:50.215210+0000","last_clean":"2024-04-25T15:54:50.215210+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T15:54:50.215210+0000","last_undegraded":"2024-04-25T15:54:50.215210+0000","last_fullsized":"2024-04-25T15:54:50.215210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206081+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T15:54:50.206081+0000","last_peered":"2024-04-25T15:54:50.206081+0000","last_clean":"2024-04-25T15:54:50.206081+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T15:54:50.206081+0000","last_undegraded":"2024-04-25T15:54:50.206081+0000","last_fullsized":"2024-04-25T15:54:50.206081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202416+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T15:54:50.202416+0000","last_peered":"2024-04-25T15:54:50.202416+0000","last_clean":"2024-04-25T15:54:50.202416+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T15:54:50.202416+0000","last_undegraded":"2024-04-25T15:54:50.202416+0000","last_fullsized":"2024-04-25T15:54:50.202416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206112+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T15:54:50.206112+0000","last_peered":"2024-04-25T15:54:50.206112+0000","last_clean":"2024-04-25T15:54:50.206112+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T15:54:50.206112+0000","last_undegraded":"2024-04-25T15:54:50.206112+0000","last_fullsized":"2024-04-25T15:54:50.206112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214705+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T15:54:50.214705+0000","last_peered":"2024-04-25T15:54:50.214705+0000","last_clean":"2024-04-25T15:54:50.214705+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T15:54:50.214705+0000","last_undegraded":"2024-04-25T15:54:50.214705+0000","last_fullsized":"2024-04-25T15:54:50.214705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625685+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T15:54:50.625685+0000","last_peered":"2024-04-25T15:54:50.625685+0000","last_clean":"2024-04-25T15:54:50.625685+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T15:54:50.625685+0000","last_undegraded":"2024-04-25T15:54:50.625685+0000","last_fullsized":"2024-04-25T15:54:50.625685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623390+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T15:54:50.623390+0000","last_peered":"2024-04-25T15:54:50.623390+0000","last_clean":"2024-04-25T15:54:50.623390+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T15:54:50.623390+0000","last_undegraded":"2024-04-25T15:54:50.623390+0000","last_fullsized":"2024-04-25T15:54:50.623390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201524+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T15:54:50.201524+0000","last_peered":"2024-04-25T15:54:50.201524+0000","last_clean":"2024-04-25T15:54:50.201524+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T15:54:50.201524+0000","last_undegraded":"2024-04-25T15:54:50.201524+0000","last_fullsized":"2024-04-25T15:54:50.201524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211861+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T15:54:50.211861+0000","last_peered":"2024-04-25T15:54:50.211861+0000","last_clean":"2024-04-25T15:54:50.211861+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T15:54:50.211861+0000","last_undegraded":"2024-04-25T15:54:50.211861+0000","last_fullsized":"2024-04-25T15:54:50.211861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204497+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T15:54:50.204497+0000","last_peered":"2024-04-25T15:54:50.204497+0000","last_clean":"2024-04-25T15:54:50.204497+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T15:54:50.204497+0000","last_undegraded":"2024-04-25T15:54:50.204497+0000","last_fullsized":"2024-04-25T15:54:50.204497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623838+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T15:54:50.623838+0000","last_peered":"2024-04-25T15:54:50.623838+0000","last_clean":"2024-04-25T15:54:50.623838+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T15:54:50.623838+0000","last_undegraded":"2024-04-25T15:54:50.623838+0000","last_fullsized":"2024-04-25T15:54:50.623838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204798+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T15:54:50.204798+0000","last_peered":"2024-04-25T15:54:50.204798+0000","last_clean":"2024-04-25T15:54:50.204798+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T15:54:50.204798+0000","last_undegraded":"2024-04-25T15:54:50.204798+0000","last_fullsized":"2024-04-25T15:54:50.204798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205220+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T15:54:50.205220+0000","last_peered":"2024-04-25T15:54:50.205220+0000","last_clean":"2024-04-25T15:54:50.205220+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T15:54:50.205220+0000","last_undegraded":"2024-04-25T15:54:50.205220+0000","last_fullsized":"2024-04-25T15:54:50.205220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207350+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T15:54:50.207350+0000","last_peered":"2024-04-25T15:54:50.207350+0000","last_clean":"2024-04-25T15:54:50.207350+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T15:54:50.207350+0000","last_undegraded":"2024-04-25T15:54:50.207350+0000","last_fullsized":"2024-04-25T15:54:50.207350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201801+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T15:54:50.201801+0000","last_peered":"2024-04-25T15:54:50.201801+0000","last_clean":"2024-04-25T15:54:50.201801+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T15:54:50.201801+0000","last_undegraded":"2024-04-25T15:54:50.201801+0000","last_fullsized":"2024-04-25T15:54:50.201801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203781+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T15:54:50.203781+0000","last_peered":"2024-04-25T15:54:50.203781+0000","last_clean":"2024-04-25T15:54:50.203781+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T15:54:50.203781+0000","last_undegraded":"2024-04-25T15:54:50.203781+0000","last_fullsized":"2024-04-25T15:54:50.203781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211910+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T15:54:50.211910+0000","last_peered":"2024-04-25T15:54:50.211910+0000","last_clean":"2024-04-25T15:54:50.211910+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T15:54:50.211910+0000","last_undegraded":"2024-04-25T15:54:50.211910+0000","last_fullsized":"2024-04-25T15:54:50.211910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203500+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T15:54:50.203500+0000","last_peered":"2024-04-25T15:54:50.203500+0000","last_clean":"2024-04-25T15:54:50.203500+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T15:54:50.203500+0000","last_undegraded":"2024-04-25T15:54:50.203500+0000","last_fullsized":"2024-04-25T15:54:50.203500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201268+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T15:54:50.201268+0000","last_peered":"2024-04-25T15:54:50.201268+0000","last_clean":"2024-04-25T15:54:50.201268+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T15:54:50.201268+0000","last_undegraded":"2024-04-25T15:54:50.201268+0000","last_fullsized":"2024-04-25T15:54:50.201268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201169+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T15:54:50.201169+0000","last_peered":"2024-04-25T15:54:50.201169+0000","last_clean":"2024-04-25T15:54:50.201169+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T15:54:50.201169+0000","last_undegraded":"2024-04-25T15:54:50.201169+0000","last_fullsized":"2024-04-25T15:54:50.201169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622255+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T15:54:50.622255+0000","last_peered":"2024-04-25T15:54:50.622255+0000","last_clean":"2024-04-25T15:54:50.622255+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T15:54:50.622255+0000","last_undegraded":"2024-04-25T15:54:50.622255+0000","last_fullsized":"2024-04-25T15:54:50.622255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624036+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T15:54:50.624036+0000","last_peered":"2024-04-25T15:54:50.624036+0000","last_clean":"2024-04-25T15:54:50.624036+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T15:54:50.624036+0000","last_undegraded":"2024-04-25T15:54:50.624036+0000","last_fullsized":"2024-04-25T15:54:50.624036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204545+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T15:54:50.204545+0000","last_peered":"2024-04-25T15:54:50.204545+0000","last_clean":"2024-04-25T15:54:50.204545+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T15:54:50.204545+0000","last_undegraded":"2024-04-25T15:54:50.204545+0000","last_fullsized":"2024-04-25T15:54:50.204545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199925+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T15:54:50.199925+0000","last_peered":"2024-04-25T15:54:50.199925+0000","last_clean":"2024-04-25T15:54:50.199925+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T15:54:50.199925+0000","last_undegraded":"2024-04-25T15:54:50.199925+0000","last_fullsized":"2024-04-25T15:54:50.199925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214847+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T15:54:50.214847+0000","last_peered":"2024-04-25T15:54:50.214847+0000","last_clean":"2024-04-25T15:54:50.214847+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T15:54:50.214847+0000","last_undegraded":"2024-04-25T15:54:50.214847+0000","last_fullsized":"2024-04-25T15:54:50.214847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206537+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T15:54:50.206537+0000","last_peered":"2024-04-25T15:54:50.206537+0000","last_clean":"2024-04-25T15:54:50.206537+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T15:54:50.206537+0000","last_undegraded":"2024-04-25T15:54:50.206537+0000","last_fullsized":"2024-04-25T15:54:50.206537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207810+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T15:54:50.207810+0000","last_peered":"2024-04-25T15:54:50.207810+0000","last_clean":"2024-04-25T15:54:50.207810+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T15:54:50.207810+0000","last_undegraded":"2024-04-25T15:54:50.207810+0000","last_fullsized":"2024-04-25T15:54:50.207810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208232+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T15:54:50.208232+0000","last_peered":"2024-04-25T15:54:50.208232+0000","last_clean":"2024-04-25T15:54:50.208232+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T15:54:50.208232+0000","last_undegraded":"2024-04-25T15:54:50.208232+0000","last_fullsized":"2024-04-25T15:54:50.208232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622677+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T15:54:50.622677+0000","last_peered":"2024-04-25T15:54:50.622677+0000","last_clean":"2024-04-25T15:54:50.622677+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T15:54:50.622677+0000","last_undegraded":"2024-04-25T15:54:50.622677+0000","last_fullsized":"2024-04-25T15:54:50.622677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211211+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T15:54:50.211211+0000","last_peered":"2024-04-25T15:54:50.211211+0000","last_clean":"2024-04-25T15:54:50.211211+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T15:54:50.211211+0000","last_undegraded":"2024-04-25T15:54:50.211211+0000","last_fullsized":"2024-04-25T15:54:50.211211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624862+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T15:54:50.624862+0000","last_peered":"2024-04-25T15:54:50.624862+0000","last_clean":"2024-04-25T15:54:50.624862+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T15:54:50.624862+0000","last_undegraded":"2024-04-25T15:54:50.624862+0000","last_fullsized":"2024-04-25T15:54:50.624862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206075+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T15:54:50.206075+0000","last_peered":"2024-04-25T15:54:50.206075+0000","last_clean":"2024-04-25T15:54:50.206075+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T15:54:50.206075+0000","last_undegraded":"2024-04-25T15:54:50.206075+0000","last_fullsized":"2024-04-25T15:54:50.206075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622623+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T15:54:50.622623+0000","last_peered":"2024-04-25T15:54:50.622623+0000","last_clean":"2024-04-25T15:54:50.622623+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T15:54:50.622623+0000","last_undegraded":"2024-04-25T15:54:50.622623+0000","last_fullsized":"2024-04-25T15:54:50.622623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205087+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T15:54:50.205087+0000","last_peered":"2024-04-25T15:54:50.205087+0000","last_clean":"2024-04-25T15:54:50.205087+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T15:54:50.205087+0000","last_undegraded":"2024-04-25T15:54:50.205087+0000","last_fullsized":"2024-04-25T15:54:50.205087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200482+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T15:54:50.200482+0000","last_peered":"2024-04-25T15:54:50.200482+0000","last_clean":"2024-04-25T15:54:50.200482+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T15:54:50.200482+0000","last_undegraded":"2024-04-25T15:54:50.200482+0000","last_fullsized":"2024-04-25T15:54:50.200482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211241+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T15:54:50.211241+0000","last_peered":"2024-04-25T15:54:50.211241+0000","last_clean":"2024-04-25T15:54:50.211241+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T15:54:50.211241+0000","last_undegraded":"2024-04-25T15:54:50.211241+0000","last_fullsized":"2024-04-25T15:54:50.211241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204976+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T15:54:50.204976+0000","last_peered":"2024-04-25T15:54:50.204976+0000","last_clean":"2024-04-25T15:54:50.204976+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T15:54:50.204976+0000","last_undegraded":"2024-04-25T15:54:50.204976+0000","last_fullsized":"2024-04-25T15:54:50.204976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206918+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T15:54:50.206918+0000","last_peered":"2024-04-25T15:54:50.206918+0000","last_clean":"2024-04-25T15:54:50.206918+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T15:54:50.206918+0000","last_undegraded":"2024-04-25T15:54:50.206918+0000","last_fullsized":"2024-04-25T15:54:50.206918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199525+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T15:54:50.199525+0000","last_peered":"2024-04-25T15:54:50.199525+0000","last_clean":"2024-04-25T15:54:50.199525+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T15:54:50.199525+0000","last_undegraded":"2024-04-25T15:54:50.199525+0000","last_fullsized":"2024-04-25T15:54:50.199525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206303+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T15:54:50.206303+0000","last_peered":"2024-04-25T15:54:50.206303+0000","last_clean":"2024-04-25T15:54:50.206303+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T15:54:50.206303+0000","last_undegraded":"2024-04-25T15:54:50.206303+0000","last_fullsized":"2024-04-25T15:54:50.206303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623709+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T15:54:50.623709+0000","last_peered":"2024-04-25T15:54:50.623709+0000","last_clean":"2024-04-25T15:54:50.623709+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T15:54:50.623709+0000","last_undegraded":"2024-04-25T15:54:50.623709+0000","last_fullsized":"2024-04-25T15:54:50.623709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207631+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T15:54:50.207631+0000","last_peered":"2024-04-25T15:54:50.207631+0000","last_clean":"2024-04-25T15:54:50.207631+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T15:54:50.207631+0000","last_undegraded":"2024-04-25T15:54:50.207631+0000","last_fullsized":"2024-04-25T15:54:50.207631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202699+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T15:54:50.202699+0000","last_peered":"2024-04-25T15:54:50.202699+0000","last_clean":"2024-04-25T15:54:50.202699+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T15:54:50.202699+0000","last_undegraded":"2024-04-25T15:54:50.202699+0000","last_fullsized":"2024-04-25T15:54:50.202699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623675+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T15:54:50.623675+0000","last_peered":"2024-04-25T15:54:50.623675+0000","last_clean":"2024-04-25T15:54:50.623675+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T15:54:50.623675+0000","last_undegraded":"2024-04-25T15:54:50.623675+0000","last_fullsized":"2024-04-25T15:54:50.623675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206577+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T15:54:50.206577+0000","last_peered":"2024-04-25T15:54:50.206577+0000","last_clean":"2024-04-25T15:54:50.206577+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T15:54:50.206577+0000","last_undegraded":"2024-04-25T15:54:50.206577+0000","last_fullsized":"2024-04-25T15:54:50.206577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201097+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T15:54:50.201097+0000","last_peered":"2024-04-25T15:54:50.201097+0000","last_clean":"2024-04-25T15:54:50.201097+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T15:54:50.201097+0000","last_undegraded":"2024-04-25T15:54:50.201097+0000","last_fullsized":"2024-04-25T15:54:50.201097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200563+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T15:54:50.200563+0000","last_peered":"2024-04-25T15:54:50.200563+0000","last_clean":"2024-04-25T15:54:50.200563+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T15:54:50.200563+0000","last_undegraded":"2024-04-25T15:54:50.200563+0000","last_fullsized":"2024-04-25T15:54:50.200563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211960+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T15:54:50.211960+0000","last_peered":"2024-04-25T15:54:50.211960+0000","last_clean":"2024-04-25T15:54:50.211960+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T15:54:50.211960+0000","last_undegraded":"2024-04-25T15:54:50.211960+0000","last_fullsized":"2024-04-25T15:54:50.211960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207471+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T15:54:50.207471+0000","last_peered":"2024-04-25T15:54:50.207471+0000","last_clean":"2024-04-25T15:54:50.207471+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T15:54:50.207471+0000","last_undegraded":"2024-04-25T15:54:50.207471+0000","last_fullsized":"2024-04-25T15:54:50.207471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623908+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T15:54:50.623908+0000","last_peered":"2024-04-25T15:54:50.623908+0000","last_clean":"2024-04-25T15:54:50.623908+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T15:54:50.623908+0000","last_undegraded":"2024-04-25T15:54:50.623908+0000","last_fullsized":"2024-04-25T15:54:50.623908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205752+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T15:54:50.205752+0000","last_peered":"2024-04-25T15:54:50.205752+0000","last_clean":"2024-04-25T15:54:50.205752+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T15:54:50.205752+0000","last_undegraded":"2024-04-25T15:54:50.205752+0000","last_fullsized":"2024-04-25T15:54:50.205752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624560+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T15:54:50.624560+0000","last_peered":"2024-04-25T15:54:50.624560+0000","last_clean":"2024-04-25T15:54:50.624560+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T15:54:50.624560+0000","last_undegraded":"2024-04-25T15:54:50.624560+0000","last_fullsized":"2024-04-25T15:54:50.624560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200941+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T15:54:50.200941+0000","last_peered":"2024-04-25T15:54:50.200941+0000","last_clean":"2024-04-25T15:54:50.200941+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T15:54:50.200941+0000","last_undegraded":"2024-04-25T15:54:50.200941+0000","last_fullsized":"2024-04-25T15:54:50.200941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622596+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T15:54:50.622596+0000","last_peered":"2024-04-25T15:54:50.622596+0000","last_clean":"2024-04-25T15:54:50.622596+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T15:54:50.622596+0000","last_undegraded":"2024-04-25T15:54:50.622596+0000","last_fullsized":"2024-04-25T15:54:50.622596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200870+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T15:54:50.200870+0000","last_peered":"2024-04-25T15:54:50.200870+0000","last_clean":"2024-04-25T15:54:50.200870+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T15:54:50.200870+0000","last_undegraded":"2024-04-25T15:54:50.200870+0000","last_fullsized":"2024-04-25T15:54:50.200870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201579+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T15:54:50.201579+0000","last_peered":"2024-04-25T15:54:50.201579+0000","last_clean":"2024-04-25T15:54:50.201579+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T15:54:50.201579+0000","last_undegraded":"2024-04-25T15:54:50.201579+0000","last_fullsized":"2024-04-25T15:54:50.201579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205057+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T15:54:50.205057+0000","last_peered":"2024-04-25T15:54:50.205057+0000","last_clean":"2024-04-25T15:54:50.205057+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T15:54:50.205057+0000","last_undegraded":"2024-04-25T15:54:50.205057+0000","last_fullsized":"2024-04-25T15:54:50.205057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.208316+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T15:54:50.208316+0000","last_peered":"2024-04-25T15:54:50.208316+0000","last_clean":"2024-04-25T15:54:50.208316+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T15:54:50.208316+0000","last_undegraded":"2024-04-25T15:54:50.208316+0000","last_fullsized":"2024-04-25T15:54:50.208316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204797+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T15:54:50.204797+0000","last_peered":"2024-04-25T15:54:50.204797+0000","last_clean":"2024-04-25T15:54:50.204797+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T15:54:50.204797+0000","last_undegraded":"2024-04-25T15:54:50.204797+0000","last_fullsized":"2024-04-25T15:54:50.204797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203600+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T15:54:50.203600+0000","last_peered":"2024-04-25T15:54:50.203600+0000","last_clean":"2024-04-25T15:54:50.203600+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T15:54:50.203600+0000","last_undegraded":"2024-04-25T15:54:50.203600+0000","last_fullsized":"2024-04-25T15:54:50.203600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203262+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T15:54:50.203262+0000","last_peered":"2024-04-25T15:54:50.203262+0000","last_clean":"2024-04-25T15:54:50.203262+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T15:54:50.203262+0000","last_undegraded":"2024-04-25T15:54:50.203262+0000","last_fullsized":"2024-04-25T15:54:50.203262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.212225+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T15:54:50.212225+0000","last_peered":"2024-04-25T15:54:50.212225+0000","last_clean":"2024-04-25T15:54:50.212225+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T15:54:50.212225+0000","last_undegraded":"2024-04-25T15:54:50.212225+0000","last_fullsized":"2024-04-25T15:54:50.212225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622349+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T15:54:50.622349+0000","last_peered":"2024-04-25T15:54:50.622349+0000","last_clean":"2024-04-25T15:54:50.622349+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T15:54:50.622349+0000","last_undegraded":"2024-04-25T15:54:50.622349+0000","last_fullsized":"2024-04-25T15:54:50.622349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211826+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T15:54:50.211826+0000","last_peered":"2024-04-25T15:54:50.211826+0000","last_clean":"2024-04-25T15:54:50.211826+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T15:54:50.211826+0000","last_undegraded":"2024-04-25T15:54:50.211826+0000","last_fullsized":"2024-04-25T15:54:50.211826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.201505+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T15:54:50.201505+0000","last_peered":"2024-04-25T15:54:50.201505+0000","last_clean":"2024-04-25T15:54:50.201505+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T15:54:50.201505+0000","last_undegraded":"2024-04-25T15:54:50.201505+0000","last_fullsized":"2024-04-25T15:54:50.201505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623379+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T15:54:50.623379+0000","last_peered":"2024-04-25T15:54:50.623379+0000","last_clean":"2024-04-25T15:54:50.623379+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T15:54:50.623379+0000","last_undegraded":"2024-04-25T15:54:50.623379+0000","last_fullsized":"2024-04-25T15:54:50.623379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211500+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T15:54:50.211500+0000","last_peered":"2024-04-25T15:54:50.211500+0000","last_clean":"2024-04-25T15:54:50.211500+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T15:54:50.211500+0000","last_undegraded":"2024-04-25T15:54:50.211500+0000","last_fullsized":"2024-04-25T15:54:50.211500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211157+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T15:54:50.211157+0000","last_peered":"2024-04-25T15:54:50.211157+0000","last_clean":"2024-04-25T15:54:50.211157+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T15:54:50.211157+0000","last_undegraded":"2024-04-25T15:54:50.211157+0000","last_fullsized":"2024-04-25T15:54:50.211157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206300+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T15:54:50.206300+0000","last_peered":"2024-04-25T15:54:50.206300+0000","last_clean":"2024-04-25T15:54:50.206300+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T15:54:50.206300+0000","last_undegraded":"2024-04-25T15:54:50.206300+0000","last_fullsized":"2024-04-25T15:54:50.206300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205814+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T15:54:50.205814+0000","last_peered":"2024-04-25T15:54:50.205814+0000","last_clean":"2024-04-25T15:54:50.205814+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T15:54:50.205814+0000","last_undegraded":"2024-04-25T15:54:50.205814+0000","last_fullsized":"2024-04-25T15:54:50.205814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202059+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T15:54:50.202059+0000","last_peered":"2024-04-25T15:54:50.202059+0000","last_clean":"2024-04-25T15:54:50.202059+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T15:54:50.202059+0000","last_undegraded":"2024-04-25T15:54:50.202059+0000","last_fullsized":"2024-04-25T15:54:50.202059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200450+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T15:54:50.200450+0000","last_peered":"2024-04-25T15:54:50.200450+0000","last_clean":"2024-04-25T15:54:50.200450+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T15:54:50.200450+0000","last_undegraded":"2024-04-25T15:54:50.200450+0000","last_fullsized":"2024-04-25T15:54:50.200450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202891+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T15:54:50.202891+0000","last_peered":"2024-04-25T15:54:50.202891+0000","last_clean":"2024-04-25T15:54:50.202891+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T15:54:50.202891+0000","last_undegraded":"2024-04-25T15:54:50.202891+0000","last_fullsized":"2024-04-25T15:54:50.202891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.214917+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T15:54:50.214917+0000","last_peered":"2024-04-25T15:54:50.214917+0000","last_clean":"2024-04-25T15:54:50.214917+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T15:54:50.214917+0000","last_undegraded":"2024-04-25T15:54:50.214917+0000","last_fullsized":"2024-04-25T15:54:50.214917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200162+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T15:54:50.200162+0000","last_peered":"2024-04-25T15:54:50.200162+0000","last_clean":"2024-04-25T15:54:50.200162+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T15:54:50.200162+0000","last_undegraded":"2024-04-25T15:54:50.200162+0000","last_fullsized":"2024-04-25T15:54:50.200162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205458+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T15:54:50.205458+0000","last_peered":"2024-04-25T15:54:50.205458+0000","last_clean":"2024-04-25T15:54:50.205458+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T15:54:50.205458+0000","last_undegraded":"2024-04-25T15:54:50.205458+0000","last_fullsized":"2024-04-25T15:54:50.205458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203208+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T15:54:50.203208+0000","last_peered":"2024-04-25T15:54:50.203208+0000","last_clean":"2024-04-25T15:54:50.203208+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T15:54:50.203208+0000","last_undegraded":"2024-04-25T15:54:50.203208+0000","last_fullsized":"2024-04-25T15:54:50.203208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200083+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T15:54:50.200083+0000","last_peered":"2024-04-25T15:54:50.200083+0000","last_clean":"2024-04-25T15:54:50.200083+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T15:54:50.200083+0000","last_undegraded":"2024-04-25T15:54:50.200083+0000","last_fullsized":"2024-04-25T15:54:50.200083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.218706+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T15:54:50.218706+0000","last_peered":"2024-04-25T15:54:50.218706+0000","last_clean":"2024-04-25T15:54:50.218706+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T15:54:50.218706+0000","last_undegraded":"2024-04-25T15:54:50.218706+0000","last_fullsized":"2024-04-25T15:54:50.218706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.624450+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T15:54:50.624450+0000","last_peered":"2024-04-25T15:54:50.624450+0000","last_clean":"2024-04-25T15:54:50.624450+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T15:54:50.624450+0000","last_undegraded":"2024-04-25T15:54:50.624450+0000","last_fullsized":"2024-04-25T15:54:50.624450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206216+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T15:54:50.206216+0000","last_peered":"2024-04-25T15:54:50.206216+0000","last_clean":"2024-04-25T15:54:50.206216+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T15:54:50.206216+0000","last_undegraded":"2024-04-25T15:54:50.206216+0000","last_fullsized":"2024-04-25T15:54:50.206216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623282+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T15:54:50.623282+0000","last_peered":"2024-04-25T15:54:50.623282+0000","last_clean":"2024-04-25T15:54:50.623282+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T15:54:50.623282+0000","last_undegraded":"2024-04-25T15:54:50.623282+0000","last_fullsized":"2024-04-25T15:54:50.623282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.223994+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T15:54:50.223994+0000","last_peered":"2024-04-25T15:54:50.223994+0000","last_clean":"2024-04-25T15:54:50.223994+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T15:54:50.223994+0000","last_undegraded":"2024-04-25T15:54:50.223994+0000","last_fullsized":"2024-04-25T15:54:50.223994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202114+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T15:54:50.202114+0000","last_peered":"2024-04-25T15:54:50.202114+0000","last_clean":"2024-04-25T15:54:50.202114+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T15:54:50.202114+0000","last_undegraded":"2024-04-25T15:54:50.202114+0000","last_fullsized":"2024-04-25T15:54:50.202114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205909+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T15:54:50.205909+0000","last_peered":"2024-04-25T15:54:50.205909+0000","last_clean":"2024-04-25T15:54:50.205909+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T15:54:50.205909+0000","last_undegraded":"2024-04-25T15:54:50.205909+0000","last_fullsized":"2024-04-25T15:54:50.205909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623078+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T15:54:50.623078+0000","last_peered":"2024-04-25T15:54:50.623078+0000","last_clean":"2024-04-25T15:54:50.623078+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T15:54:50.623078+0000","last_undegraded":"2024-04-25T15:54:50.623078+0000","last_fullsized":"2024-04-25T15:54:50.623078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.205112+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T15:54:50.205112+0000","last_peered":"2024-04-25T15:54:50.205112+0000","last_clean":"2024-04-25T15:54:50.205112+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T15:54:50.205112+0000","last_undegraded":"2024-04-25T15:54:50.205112+0000","last_fullsized":"2024-04-25T15:54:50.205112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207524+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T15:54:50.207524+0000","last_peered":"2024-04-25T15:54:50.207524+0000","last_clean":"2024-04-25T15:54:50.207524+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T15:54:50.207524+0000","last_undegraded":"2024-04-25T15:54:50.207524+0000","last_fullsized":"2024-04-25T15:54:50.207524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202477+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T15:54:50.202477+0000","last_peered":"2024-04-25T15:54:50.202477+0000","last_clean":"2024-04-25T15:54:50.202477+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T15:54:50.202477+0000","last_undegraded":"2024-04-25T15:54:50.202477+0000","last_fullsized":"2024-04-25T15:54:50.202477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.625039+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T15:54:50.625039+0000","last_peered":"2024-04-25T15:54:50.625039+0000","last_clean":"2024-04-25T15:54:50.625039+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T15:54:50.625039+0000","last_undegraded":"2024-04-25T15:54:50.625039+0000","last_fullsized":"2024-04-25T15:54:50.625039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207721+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T15:54:50.207721+0000","last_peered":"2024-04-25T15:54:50.207721+0000","last_clean":"2024-04-25T15:54:50.207721+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T15:54:50.207721+0000","last_undegraded":"2024-04-25T15:54:50.207721+0000","last_fullsized":"2024-04-25T15:54:50.207721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203453+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T15:54:50.203453+0000","last_peered":"2024-04-25T15:54:50.203453+0000","last_clean":"2024-04-25T15:54:50.203453+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T15:54:50.203453+0000","last_undegraded":"2024-04-25T15:54:50.203453+0000","last_fullsized":"2024-04-25T15:54:50.203453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622280+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T15:54:50.622280+0000","last_peered":"2024-04-25T15:54:50.622280+0000","last_clean":"2024-04-25T15:54:50.622280+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T15:54:50.622280+0000","last_undegraded":"2024-04-25T15:54:50.622280+0000","last_fullsized":"2024-04-25T15:54:50.622280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.213490+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T15:54:50.213490+0000","last_peered":"2024-04-25T15:54:50.213490+0000","last_clean":"2024-04-25T15:54:50.213490+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T15:54:50.213490+0000","last_undegraded":"2024-04-25T15:54:50.213490+0000","last_fullsized":"2024-04-25T15:54:50.213490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200025+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T15:54:50.200025+0000","last_peered":"2024-04-25T15:54:50.200025+0000","last_clean":"2024-04-25T15:54:50.200025+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T15:54:50.200025+0000","last_undegraded":"2024-04-25T15:54:50.200025+0000","last_fullsized":"2024-04-25T15:54:50.200025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200254+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T15:54:50.200254+0000","last_peered":"2024-04-25T15:54:50.200254+0000","last_clean":"2024-04-25T15:54:50.200254+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T15:54:50.200254+0000","last_undegraded":"2024-04-25T15:54:50.200254+0000","last_fullsized":"2024-04-25T15:54:50.200254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.623054+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T15:54:50.623054+0000","last_peered":"2024-04-25T15:54:50.623054+0000","last_clean":"2024-04-25T15:54:50.623054+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T15:54:50.623054+0000","last_undegraded":"2024-04-25T15:54:50.623054+0000","last_fullsized":"2024-04-25T15:54:50.623054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204302+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T15:54:50.204302+0000","last_peered":"2024-04-25T15:54:50.204302+0000","last_clean":"2024-04-25T15:54:50.204302+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T15:54:50.204302+0000","last_undegraded":"2024-04-25T15:54:50.204302+0000","last_fullsized":"2024-04-25T15:54:50.204302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.210919+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T15:54:50.210919+0000","last_peered":"2024-04-25T15:54:50.210919+0000","last_clean":"2024-04-25T15:54:50.210919+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T15:54:50.210919+0000","last_undegraded":"2024-04-25T15:54:50.210919+0000","last_fullsized":"2024-04-25T15:54:50.210919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211448+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T15:54:50.211448+0000","last_peered":"2024-04-25T15:54:50.211448+0000","last_clean":"2024-04-25T15:54:50.211448+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T15:54:50.211448+0000","last_undegraded":"2024-04-25T15:54:50.211448+0000","last_fullsized":"2024-04-25T15:54:50.211448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206135+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T15:54:50.206135+0000","last_peered":"2024-04-25T15:54:50.206135+0000","last_clean":"2024-04-25T15:54:50.206135+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T15:54:50.206135+0000","last_undegraded":"2024-04-25T15:54:50.206135+0000","last_fullsized":"2024-04-25T15:54:50.206135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.202309+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T15:54:50.202309+0000","last_peered":"2024-04-25T15:54:50.202309+0000","last_clean":"2024-04-25T15:54:50.202309+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T15:54:50.202309+0000","last_undegraded":"2024-04-25T15:54:50.202309+0000","last_fullsized":"2024-04-25T15:54:50.202309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215139+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T15:54:50.215139+0000","last_peered":"2024-04-25T15:54:50.215139+0000","last_clean":"2024-04-25T15:54:50.215139+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T15:54:50.215139+0000","last_undegraded":"2024-04-25T15:54:50.215139+0000","last_fullsized":"2024-04-25T15:54:50.215139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200157+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T15:54:50.200157+0000","last_peered":"2024-04-25T15:54:50.200157+0000","last_clean":"2024-04-25T15:54:50.200157+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T15:54:50.200157+0000","last_undegraded":"2024-04-25T15:54:50.200157+0000","last_fullsized":"2024-04-25T15:54:50.200157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.200814+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T15:54:50.200814+0000","last_peered":"2024-04-25T15:54:50.200814+0000","last_clean":"2024-04-25T15:54:50.200814+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T15:54:50.200814+0000","last_undegraded":"2024-04-25T15:54:50.200814+0000","last_fullsized":"2024-04-25T15:54:50.200814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.206016+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T15:54:50.206016+0000","last_peered":"2024-04-25T15:54:50.206016+0000","last_clean":"2024-04-25T15:54:50.206016+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T15:54:50.206016+0000","last_undegraded":"2024-04-25T15:54:50.206016+0000","last_fullsized":"2024-04-25T15:54:50.206016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211786+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T15:54:50.211786+0000","last_peered":"2024-04-25T15:54:50.211786+0000","last_clean":"2024-04-25T15:54:50.211786+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T15:54:50.211786+0000","last_undegraded":"2024-04-25T15:54:50.211786+0000","last_fullsized":"2024-04-25T15:54:50.211786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207802+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T15:54:50.207802+0000","last_peered":"2024-04-25T15:54:50.207802+0000","last_clean":"2024-04-25T15:54:50.207802+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T15:54:50.207802+0000","last_undegraded":"2024-04-25T15:54:50.207802+0000","last_fullsized":"2024-04-25T15:54:50.207802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.203144+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T15:54:50.203144+0000","last_peered":"2024-04-25T15:54:50.203144+0000","last_clean":"2024-04-25T15:54:50.203144+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T15:54:50.203144+0000","last_undegraded":"2024-04-25T15:54:50.203144+0000","last_fullsized":"2024-04-25T15:54:50.203144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204480+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T15:54:50.204480+0000","last_peered":"2024-04-25T15:54:50.204480+0000","last_clean":"2024-04-25T15:54:50.204480+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T15:54:50.204480+0000","last_undegraded":"2024-04-25T15:54:50.204480+0000","last_fullsized":"2024-04-25T15:54:50.204480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211866+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T15:54:50.211866+0000","last_peered":"2024-04-25T15:54:50.211866+0000","last_clean":"2024-04-25T15:54:50.211866+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T15:54:50.211866+0000","last_undegraded":"2024-04-25T15:54:50.211866+0000","last_fullsized":"2024-04-25T15:54:50.211866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.199776+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T15:54:50.199776+0000","last_peered":"2024-04-25T15:54:50.199776+0000","last_clean":"2024-04-25T15:54:50.199776+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T15:54:50.199776+0000","last_undegraded":"2024-04-25T15:54:50.199776+0000","last_fullsized":"2024-04-25T15:54:50.199776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204117+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T15:54:50.204117+0000","last_peered":"2024-04-25T15:54:50.204117+0000","last_clean":"2024-04-25T15:54:50.204117+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T15:54:50.204117+0000","last_undegraded":"2024-04-25T15:54:50.204117+0000","last_fullsized":"2024-04-25T15:54:50.204117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.204155+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T15:54:50.204155+0000","last_peered":"2024-04-25T15:54:50.204155+0000","last_clean":"2024-04-25T15:54:50.204155+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T15:54:50.204155+0000","last_undegraded":"2024-04-25T15:54:50.204155+0000","last_fullsized":"2024-04-25T15:54:50.204155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.622781+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T15:54:50.622781+0000","last_peered":"2024-04-25T15:54:50.622781+0000","last_clean":"2024-04-25T15:54:50.622781+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T15:54:50.622781+0000","last_undegraded":"2024-04-25T15:54:50.622781+0000","last_fullsized":"2024-04-25T15:54:50.622781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211121+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T15:54:50.211121+0000","last_peered":"2024-04-25T15:54:50.211121+0000","last_clean":"2024-04-25T15:54:50.211121+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T15:54:50.211121+0000","last_undegraded":"2024-04-25T15:54:50.211121+0000","last_fullsized":"2024-04-25T15:54:50.211121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.207794+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T15:54:50.207794+0000","last_peered":"2024-04-25T15:54:50.207794+0000","last_clean":"2024-04-25T15:54:50.207794+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T15:54:50.207794+0000","last_undegraded":"2024-04-25T15:54:50.207794+0000","last_fullsized":"2024-04-25T15:54:50.207794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.211544+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T15:54:50.211544+0000","last_peered":"2024-04-25T15:54:50.211544+0000","last_clean":"2024-04-25T15:54:50.211544+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T15:54:50.211544+0000","last_undegraded":"2024-04-25T15:54:50.211544+0000","last_fullsized":"2024-04-25T15:54:50.211544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T15:54:50.215061+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T15:54:50.215061+0000","last_peered":"2024-04-25T15:54:50.215061+0000","last_clean":"2024-04-25T15:54:50.215061+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T15:54:50.215061+0000","last_undegraded":"2024-04-25T15:54:50.215061+0000","last_fullsized":"2024-04-25T15:54:50.215061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":704305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":115934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":113495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":117393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":115500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:54:54.184 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:54.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 Processor -- start 2024-04-25T15:54:54.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 -- start start 2024-04-25T15:54:54.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d54154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6d5415b450 0x7f6d5406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d540c1a00 0x7f6d540c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6d540abe20 con 0x7f6d540c1a00 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6d540ac070 con 0x7f6d5415b450 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5885d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d540ac350 con 0x7f6d540c4730 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d540c1a00 0x7f6d540c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d540c1a00 0x7f6d540c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52578/0 (socket says 172.21.15.87:52578) 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 -- 172.21.15.87:0/883027063 learned_addr learned my addr 172.21.15.87:0/883027063 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d51d9b640 1 --2- 172.21.15.87:0/883027063 >> v2:172.21.15.155:3300/0 conn(0x7f6d5415b450 0x7f6d5406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d5259c640 1 --2- 172.21.15.87:0/883027063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d54154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 -- 172.21.15.87:0/883027063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 msgr2=0x7f6d54154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 --2- 172.21.15.87:0/883027063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d54154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 -- 172.21.15.87:0/883027063 >> v2:172.21.15.155:3300/0 conn(0x7f6d5415b450 msgr2=0x7f6d5406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:54.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 --2- 172.21.15.87:0/883027063 >> v2:172.21.15.155:3300/0 conn(0x7f6d5415b450 0x7f6d5406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.360+0000 7f6d52d9d640 1 -- 172.21.15.87:0/883027063 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5415a970 con 0x7f6d540c1a00 2024-04-25T15:54:54.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d52d9d640 1 --2- 172.21.15.87:0/883027063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c1e10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6d5406fff0 tx=0x7f6d4c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971844f0184d23e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:54.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5159a640 1 -- 172.21.15.87:0/883027063 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0a56b0 con 0x7f6d540c1a00 2024-04-25T15:54:54.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5159a640 1 -- 172.21.15.87:0/883027063 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0a5850 con 0x7f6d540c1a00 2024-04-25T15:54:54.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5159a640 1 -- 172.21.15.87:0/883027063 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0a5c20 con 0x7f6d540c1a00 2024-04-25T15:54:54.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 -- 172.21.15.87:0/883027063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 msgr2=0x7f6d540c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 --2- 172.21.15.87:0/883027063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c1e10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6d5406fff0 tx=0x7f6d4c01c960 comp rx=0 tx=0).stop 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 -- 172.21.15.87:0/883027063 shutdown_connections 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 --2- 172.21.15.87:0/883027063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c1e10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 --2- 172.21.15.87:0/883027063 >> v2:172.21.15.155:3300/0 conn(0x7f6d5415b450 0x7f6d5406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 --2- 172.21.15.87:0/883027063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d54154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 -- 172.21.15.87:0/883027063 >> 172.21.15.87:0/883027063 conn(0x7f6d540c8770 msgr2=0x7f6d540c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 -- 172.21.15.87:0/883027063 shutdown_connections 2024-04-25T15:54:54.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.364+0000 7f6d5885d640 1 -- 172.21.15.87:0/883027063 wait complete. 2024-04-25T15:54:54.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 Processor -- start 2024-04-25T15:54:54.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- start start 2024-04-25T15:54:54.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d5414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415b450 0x7f6d54146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5406f420 con 0x7f6d540c1a00 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5406f2a0 con 0x7f6d5415b450 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d54157bd0 con 0x7f6d540c4730 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52582/0 (socket says 172.21.15.87:52582) 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 -- 172.21.15.87:0/1384270128 learned_addr learned my addr 172.21.15.87:0/1384270128 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 -- 172.21.15.87:0/1384270128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 msgr2=0x7f6d5414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d5414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 -- 172.21.15.87:0/1384270128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415b450 msgr2=0x7f6d54146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415b450 0x7f6d54146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 -- 172.21.15.87:0/1384270128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d54150450 con 0x7f6d540c1a00 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5259c640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c7e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c5c0 tx=0x7f6d3c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c015070 con 0x7f6d540c1a00 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c011800 con 0x7f6d540c1a00 2024-04-25T15:54:54.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d540c6570 con 0x7f6d540c1a00 2024-04-25T15:54:54.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c011bd0 con 0x7f6d540c1a00 2024-04-25T15:54:54.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d540c7490 con 0x7f6d540c1a00 2024-04-25T15:54:54.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d540c7660 con 0x7f6d540c1a00 2024-04-25T15:54:54.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.368+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6d3c018070 con 0x7f6d540c1a00 2024-04-25T15:54:54.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.372+0000 7f6d4affd640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6d3406f400 0x7f6d34071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.372+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f6d3c08f330 con 0x7f6d540c1a00 2024-04-25T15:54:54.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.372+0000 7f6d51d9b640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6d3406f400 0x7f6d34071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.372+0000 7f6d51d9b640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6d3406f400 0x7f6d34071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d54153370 tx=0x7f6d44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:54.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.376+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d3c05bf60 con 0x7f6d540c1a00 2024-04-25T15:54:54.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.524+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d54069bb0 con 0x7f6d540c1a00 2024-04-25T15:54:54.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.528+0000 7f6d4affd640 1 -- 172.21.15.87:0/1384270128 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20684 (secure 0 0 0) 0x7f6d3c05b860 con 0x7f6d540c1a00 2024-04-25T15:54:54.530 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:54.530 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:50.184879+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:54.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.528+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6d3406f400 msgr2=0x7f6d34071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.528+0000 7f6d5885d640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6d3406f400 0x7f6d34071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d54153370 tx=0x7f6d44008040 comp rx=0 tx=0).stop 2024-04-25T15:54:54.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.528+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 msgr2=0x7f6d540c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.528+0000 7f6d5885d640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c7e80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c5c0 tx=0x7f6d3c00ca80 comp rx=0 tx=0).stop 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 shutdown_connections 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6d3406f400 0x7f6d34071910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415b450 0x7f6d54146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d540c4730 0x7f6d5414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 --2- 172.21.15.87:0/1384270128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d540c1a00 0x7f6d540c7e80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 >> 172.21.15.87:0/1384270128 conn(0x7f6d540c8770 msgr2=0x7f6d54155710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 shutdown_connections 2024-04-25T15:54:54.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.532+0000 7f6d5885d640 1 -- 172.21.15.87:0/1384270128 wait complete. 2024-04-25T15:54:54.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:54.550 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:54.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0ca040640 1 Processor -- start 2024-04-25T15:54:54.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0ca040640 1 -- start start 2024-04-25T15:54:54.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0ca040640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0c40ad160 0x7fa0c40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0ca040640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c4154fc0 con 0x7fa0c41518b0 2024-04-25T15:54:54.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0ca040640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c40acb20 con 0x7fa0c40c4620 2024-04-25T15:54:54.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0ca040640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c406ed60 con 0x7fa0c40ad160 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa0c41518b0 0x7fa0c406f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58888/0 (socket says 172.21.15.87:58888) 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 -- 172.21.15.87:0/890066722 learned_addr learned my addr 172.21.15.87:0/890066722 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c2ffd640 1 --2- 172.21.15.87:0/890066722 >> v2:172.21.15.155:3300/0 conn(0x7fa0c40ad160 0x7fa0c40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204049043 0 0) 0x7fa0c4154fc0 con 0x7fa0c41518b0 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0ac003530 con 0x7fa0c41518b0 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 705834383 0 0) 0x7fa0ac003530 con 0x7fa0c41518b0 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 >> v2:172.21.15.155:3300/0 conn(0x7fa0c40ad160 msgr2=0x7fa0c40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 --2- 172.21.15.87:0/890066722 >> v2:172.21.15.155:3300/0 conn(0x7fa0c40ad160 0x7fa0c40c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 >> v1:172.21.15.155:6789/0 conn(0x7fa0c40c4620 legacy=0x7fa0c415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c40ace00 con 0x7fa0c41518b0 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fa0b4001680 con 0x7fa0c41518b0 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 >> v1:172.21.15.87:6789/0 conn(0x7fa0c41518b0 legacy=0x7fa0c406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0ac003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0ac004810 0x7fa0ac004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ac005280 0x7fa0ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c406ed60 con 0x7fa0ac0039c0 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac00c1a0 con 0x7fa0ac005280 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ac00c3a0 con 0x7fa0ac004810 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0ac003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 -- 172.21.15.87:0/890066722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0ac004810 msgr2=0x7fa0ac004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0ac004810 0x7fa0ac004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 -- 172.21.15.87:0/890066722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ac005280 msgr2=0x7fa0ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ac005280 0x7fa0ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c3fff640 1 -- 172.21.15.87:0/890066722 reap_dead start 2024-04-25T15:54:54.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.688+0000 7fa0c37fe640 1 -- 172.21.15.87:0/890066722 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac003530 con 0x7fa0ac0039c0 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0ac003e50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c190 tx=0x7fa0b401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd31c74fc97d0b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4007d00 con 0x7fa0ac0039c0 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b40a9020 con 0x7fa0ac0039c0 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0c27fc640 1 -- 172.21.15.87:0/890066722 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40a5b40 con 0x7fa0ac0039c0 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 -- 172.21.15.87:0/890066722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 msgr2=0x7fa0ac003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0ac003e50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c190 tx=0x7fa0b401cc40 comp rx=0 tx=0).stop 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 -- 172.21.15.87:0/890066722 shutdown_connections 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 --2- 172.21.15.87:0/890066722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0ac003e50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 -- 172.21.15.87:0/890066722 >> 172.21.15.87:0/890066722 conn(0x7fa0c40c8770 msgr2=0x7fa0c40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 -- 172.21.15.87:0/890066722 shutdown_connections 2024-04-25T15:54:54.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.692+0000 7fa0ca040640 1 -- 172.21.15.87:0/890066722 wait complete. 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 Processor -- start 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- start start 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0c4145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c41f4180 0x7fa0c41f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c41530c0 0x7fa0c41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41579d0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4157850 con 0x7fa0c41530c0 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c4157b50 con 0x7fa0c41f4180 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0c4145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0c4145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52592/0 (socket says 172.21.15.87:52592) 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 -- 172.21.15.87:0/2275641155 learned_addr learned my addr 172.21.15.87:0/2275641155 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c2ffd640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c41f4180 0x7fa0c41f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c3fff640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c41530c0 0x7fa0c41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 -- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c41f4180 msgr2=0x7fa0c41f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c41f4180 0x7fa0c41f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 -- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c41530c0 msgr2=0x7fa0c41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c41530c0 0x7fa0c41534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 -- 172.21.15.87:0/2275641155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c40c62c0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0c37fe640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0c4145cb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa0b401ca70 tx=0x7fa0ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4001c40 con 0x7fa0ac0039c0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4000ee0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c40c65a0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4004a30 con 0x7fa0ac0039c0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c40c6b60 con 0x7fa0ac0039c0 2024-04-25T15:54:54.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.696+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c4069bb0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.700+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa0b40070d0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.700+0000 7fa0abfff640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa0b006f340 0x7fa0b0071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:54.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.700+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7fa0b4129310 con 0x7fa0ac0039c0 2024-04-25T15:54:54.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.700+0000 7fa0c2ffd640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa0b006f340 0x7fa0b0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:54.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.700+0000 7fa0c2ffd640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa0b006f340 0x7fa0b0071850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa0c414eb40 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:54.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.704+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0b4016950 con 0x7fa0ac0039c0 2024-04-25T15:54:54.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa0c41510a0 con 0x7fa0ac0039c0 2024-04-25T15:54:54.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0abfff640 1 -- 172.21.15.87:0/2275641155 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fa0b40f6140 con 0x7fa0ac0039c0 2024-04-25T15:54:54.865 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:54.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa0b006f340 msgr2=0x7fa0b0071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa0b006f340 0x7fa0b0071850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa0c414eb40 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:54.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 msgr2=0x7fa0c4145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:54.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0c4145cb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa0b401ca70 tx=0x7fa0ac005840 comp rx=0 tx=0).stop 2024-04-25T15:54:54.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 shutdown_connections 2024-04-25T15:54:54.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa0b006f340 0x7fa0b0071850 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c41530c0 0x7fa0c41534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c41f4180 0x7fa0c41f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 --2- 172.21.15.87:0/2275641155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0039c0 0x7fa0c4145cb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:54.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 >> 172.21.15.87:0/2275641155 conn(0x7fa0c40c8770 msgr2=0x7fa0c4157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:54.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 shutdown_connections 2024-04-25T15:54:54.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:54.864+0000 7fa0ca040640 1 -- 172.21.15.87:0/2275641155 wait complete. 2024-04-25T15:54:54.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:55.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 Processor -- start 2024-04-25T15:54:55.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 -- start start 2024-04-25T15:54:55.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff40155320 0x7eff40155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff40074160 0x7eff40074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff40152d90 con 0x7eff40152980 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7eff400aa290 con 0x7eff40074160 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff46c32640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7eff401598b0 con 0x7eff40155320 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff451cf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff40074160 0x7eff40074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff449ce640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7eff40152980 0x7eff400c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58902/0 (socket says 172.21.15.87:58902) 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff449ce640 1 -- 172.21.15.87:0/1405109471 learned_addr learned my addr 172.21.15.87:0/1405109471 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff3ffff640 1 --2- 172.21.15.87:0/1405109471 >> v2:172.21.15.155:3300/0 conn(0x7eff40155320 0x7eff40155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff3f7fe640 1 -- 172.21.15.87:0/1405109471 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125314069 0 0) 0x7eff40152d90 con 0x7eff40152980 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff3f7fe640 1 -- 172.21.15.87:0/1405109471 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff28003530 con 0x7eff40152980 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff451cf640 1 -- 172.21.15.87:0/1405109471 >> v2:172.21.15.155:3300/0 conn(0x7eff40155320 msgr2=0x7eff40155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff451cf640 1 --2- 172.21.15.87:0/1405109471 >> v2:172.21.15.155:3300/0 conn(0x7eff40155320 0x7eff40155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff451cf640 1 -- 172.21.15.87:0/1405109471 >> v1:172.21.15.87:6789/0 conn(0x7eff40152980 legacy=0x7eff400c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.036+0000 7eff451cf640 1 -- 172.21.15.87:0/1405109471 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff400a9cd0 con 0x7eff40074160 2024-04-25T15:54:55.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff451cf640 1 --2- 172.21.15.87:0/1405109471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40074160 0x7eff40074570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff40069a50 tx=0x7eff3001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8266ab1abb3e5676 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff3f7fe640 1 -- 172.21.15.87:0/1405109471 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300b0070 con 0x7eff40074160 2024-04-25T15:54:55.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff3f7fe640 1 -- 172.21.15.87:0/1405109471 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff300ab600 con 0x7eff40074160 2024-04-25T15:54:55.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff3f7fe640 1 -- 172.21.15.87:0/1405109471 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300ab9d0 con 0x7eff40074160 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 -- 172.21.15.87:0/1405109471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40074160 msgr2=0x7eff40074570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 --2- 172.21.15.87:0/1405109471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40074160 0x7eff40074570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff40069a50 tx=0x7eff3001c3f0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 -- 172.21.15.87:0/1405109471 shutdown_connections 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 --2- 172.21.15.87:0/1405109471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40074160 0x7eff40074570 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 --2- 172.21.15.87:0/1405109471 >> v2:172.21.15.155:3300/0 conn(0x7eff40155320 0x7eff40155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 -- 172.21.15.87:0/1405109471 >> 172.21.15.87:0/1405109471 conn(0x7eff400ac550 msgr2=0x7eff400ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 -- 172.21.15.87:0/1405109471 shutdown_connections 2024-04-25T15:54:55.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.040+0000 7eff46c32640 1 -- 172.21.15.87:0/1405109471 wait complete. 2024-04-25T15:54:55.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 Processor -- start 2024-04-25T15:54:55.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- start start 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff40074160 0x7eff400aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff40152980 0x7eff4014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 0x7eff40149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7eff400729c0 con 0x7eff40155320 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff40158f70 con 0x7eff40074160 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff40072b40 con 0x7eff40152980 2024-04-25T15:54:55.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 0x7eff40149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 0x7eff40149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52610/0 (socket says 172.21.15.87:52610) 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 -- 172.21.15.87:0/3862555098 learned_addr learned my addr 172.21.15.87:0/3862555098 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff3ffff640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff40152980 0x7eff4014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff449ce640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff40074160 0x7eff400aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 -- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff40152980 msgr2=0x7eff4014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff40152980 0x7eff4014e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 -- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff40074160 msgr2=0x7eff400aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff40074160 0x7eff400aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 -- 172.21.15.87:0/3862555098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff40155150 con 0x7eff40155320 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff451cf640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 0x7eff40149c00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7eff300ae040 tx=0x7eff30019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300b8020 con 0x7eff40155320 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff300abe50 con 0x7eff40155320 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4014fa00 con 0x7eff40155320 2024-04-25T15:54:55.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300b0040 con 0x7eff40155320 2024-04-25T15:54:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff401ef7d0 con 0x7eff40155320 2024-04-25T15:54:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.044+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40069bb0 con 0x7eff40155320 2024-04-25T15:54:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.048+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7eff300bb020 con 0x7eff40155320 2024-04-25T15:54:55.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.048+0000 7eff3d7fa640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7eff2c06f400 0x7eff2c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.048+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7eff30129110 con 0x7eff40155320 2024-04-25T15:54:55.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.048+0000 7eff449ce640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7eff2c06f400 0x7eff2c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.048+0000 7eff449ce640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7eff2c06f400 0x7eff2c071910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7eff380012f0 tx=0x7eff38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.052+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff300c2030 con 0x7eff40155320 2024-04-25T15:54:55.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.212+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7eff4015f5a0 con 0x7eff40155320 2024-04-25T15:54:55.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.216+0000 7eff3d7fa640 1 -- 172.21.15.87:0/3862555098 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7eff30016070 con 0x7eff40155320 2024-04-25T15:54:55.219 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:55.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7eff2c06f400 msgr2=0x7eff2c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7eff2c06f400 0x7eff2c071910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7eff380012f0 tx=0x7eff38009040 comp rx=0 tx=0).stop 2024-04-25T15:54:55.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 msgr2=0x7eff40149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 0x7eff40149c00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7eff300ae040 tx=0x7eff30019190 comp rx=0 tx=0).stop 2024-04-25T15:54:55.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 shutdown_connections 2024-04-25T15:54:55.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7eff2c06f400 0x7eff2c071910 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40155320 0x7eff40149c00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff40152980 0x7eff4014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 --2- 172.21.15.87:0/3862555098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff40074160 0x7eff400aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 >> 172.21.15.87:0/3862555098 conn(0x7eff400ac550 msgr2=0x7eff40155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:55.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 shutdown_connections 2024-04-25T15:54:55.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.220+0000 7eff46c32640 1 -- 172.21.15.87:0/3862555098 wait complete. 2024-04-25T15:54:55.241 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:55.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 Processor -- start 2024-04-25T15:54:55.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 -- start start 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc1529a0 0x7f95bc071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95bc0ad990 0x7f95bc0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95bc0c41e0 0x7f95bc0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f95bc072430 con 0x7f95bc0c41e0 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f95bc074730 con 0x7f95bc0ad990 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c29a7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc074a10 con 0x7f95bc1529a0 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95bc0c41e0 0x7f95bc0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95bc0c41e0 0x7f95bc0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52622/0 (socket says 172.21.15.87:52622) 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 -- 172.21.15.87:0/176179160 learned_addr learned my addr 172.21.15.87:0/176179160 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95bb7fe640 1 --2- 172.21.15.87:0/176179160 >> v2:172.21.15.155:3300/0 conn(0x7f95bc0ad990 0x7f95bc0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95bbfff640 1 --2- 172.21.15.87:0/176179160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc1529a0 0x7f95bc071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 -- 172.21.15.87:0/176179160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc1529a0 msgr2=0x7f95bc071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:55.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 --2- 172.21.15.87:0/176179160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc1529a0 0x7f95bc071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 -- 172.21.15.87:0/176179160 >> v2:172.21.15.155:3300/0 conn(0x7f95bc0ad990 msgr2=0x7f95bc0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:55.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 --2- 172.21.15.87:0/176179160 >> v2:172.21.15.155:3300/0 conn(0x7f95bc0ad990 0x7f95bc0adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.384+0000 7f95c0f44640 1 -- 172.21.15.87:0/176179160 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc074cf0 con 0x7f95bc0c41e0 2024-04-25T15:54:55.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c0f44640 1 --2- 172.21.15.87:0/176179160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc0c41e0 0x7f95bc0c45f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ae5a0 tx=0x7f95b401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba08689313f43f81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95baffd640 1 -- 172.21.15.87:0/176179160 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40a55e0 con 0x7f95bc0c41e0 2024-04-25T15:54:55.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95baffd640 1 -- 172.21.15.87:0/176179160 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b40a5780 con 0x7f95bc0c41e0 2024-04-25T15:54:55.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95baffd640 1 -- 172.21.15.87:0/176179160 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40a5b50 con 0x7f95bc0c41e0 2024-04-25T15:54:55.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 -- 172.21.15.87:0/176179160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc0c41e0 msgr2=0x7f95bc0c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 --2- 172.21.15.87:0/176179160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc0c41e0 0x7f95bc0c45f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ae5a0 tx=0x7f95b401c960 comp rx=0 tx=0).stop 2024-04-25T15:54:55.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 -- 172.21.15.87:0/176179160 shutdown_connections 2024-04-25T15:54:55.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 --2- 172.21.15.87:0/176179160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc0c41e0 0x7f95bc0c45f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 --2- 172.21.15.87:0/176179160 >> v2:172.21.15.155:3300/0 conn(0x7f95bc0ad990 0x7f95bc0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 --2- 172.21.15.87:0/176179160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc1529a0 0x7f95bc071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 -- 172.21.15.87:0/176179160 >> 172.21.15.87:0/176179160 conn(0x7f95bc0c8770 msgr2=0x7f95bc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:55.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 -- 172.21.15.87:0/176179160 shutdown_connections 2024-04-25T15:54:55.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.388+0000 7f95c29a7640 1 -- 172.21.15.87:0/176179160 wait complete. 2024-04-25T15:54:55.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 Processor -- start 2024-04-25T15:54:55.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 -- start start 2024-04-25T15:54:55.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc0ad990 0x7f95bc14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95bc0c41e0 0x7f95bc151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 0x7f95bc1448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc159340 con 0x7f95bc1529a0 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc1591c0 con 0x7f95bc0c41e0 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c29a7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc1594c0 con 0x7f95bc0ad990 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 0x7f95bc1448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 0x7f95bc1448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52638/0 (socket says 172.21.15.87:52638) 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 -- 172.21.15.87:0/2222912249 learned_addr learned my addr 172.21.15.87:0/2222912249 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95bb7fe640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95bc0c41e0 0x7f95bc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95bbfff640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc0ad990 0x7f95bc14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 -- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc0ad990 msgr2=0x7f95bc14a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc0ad990 0x7f95bc14a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 -- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95bc0c41e0 msgr2=0x7f95bc151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95bc0c41e0 0x7f95bc151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 -- 172.21.15.87:0/2222912249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc150260 con 0x7f95bc1529a0 2024-04-25T15:54:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.392+0000 7f95c0f44640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 0x7f95bc1448d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f95b401b010 tx=0x7f95b4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40a55e0 con 0x7f95bc1529a0 2024-04-25T15:54:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b40b8470 con 0x7f95bc1529a0 2024-04-25T15:54:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4009510 con 0x7f95bc1529a0 2024-04-25T15:54:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc150540 con 0x7f95bc1529a0 2024-04-25T15:54:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc150b00 con 0x7f95bc1529a0 2024-04-25T15:54:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc069bb0 con 0x7f95bc1529a0 2024-04-25T15:54:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f95b40c0020 con 0x7f95bc1529a0 2024-04-25T15:54:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95b8ff9640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f95a806f400 0x7f95a8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f95b412a7e0 con 0x7f95bc1529a0 2024-04-25T15:54:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95bbfff640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f95a806f400 0x7f95a8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.396+0000 7f95bbfff640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f95a806f400 0x7f95a8071910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f95bc073d40 tx=0x7f95ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.400+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95b40c7020 con 0x7f95bc1529a0 2024-04-25T15:54:55.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.552+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f95bc0c3760 con 0x7f95bc1529a0 2024-04-25T15:54:55.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.552+0000 7f95b8ff9640 1 -- 172.21.15.87:0/2222912249 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f95b40165e0 con 0x7f95bc1529a0 2024-04-25T15:54:55.555 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f95a806f400 msgr2=0x7f95a8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f95a806f400 0x7f95a8071910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f95bc073d40 tx=0x7f95ac009190 comp rx=0 tx=0).stop 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 msgr2=0x7f95bc1448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 0x7f95bc1448d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f95b401b010 tx=0x7f95b4019700 comp rx=0 tx=0).stop 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 shutdown_connections 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f95a806f400 0x7f95a8071910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95bc1529a0 0x7f95bc1448d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95bc0c41e0 0x7f95bc151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 --2- 172.21.15.87:0/2222912249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95bc0ad990 0x7f95bc14a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 >> 172.21.15.87:0/2222912249 conn(0x7f95bc0c8770 msgr2=0x7f95bc15f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:55.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 shutdown_connections 2024-04-25T15:54:55.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.556+0000 7f95c29a7640 1 -- 172.21.15.87:0/2222912249 wait complete. 2024-04-25T15:54:55.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:55.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 Processor -- start 2024-04-25T15:54:55.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 -- start start 2024-04-25T15:54:55.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbdc155320 0x7ffbdc155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffbdc074160 0x7ffbdc074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbdc152d90 con 0x7ffbdc152980 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ffbdc0aa290 con 0x7ffbdc155320 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbe18d1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffbdc1598b0 con 0x7ffbdc074160 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbdaffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffbdc152980 0x7ffbdc0c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58906/0 (socket says 172.21.15.87:58906) 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbdaffd640 1 -- 172.21.15.87:0/367871668 learned_addr learned my addr 172.21.15.87:0/367871668 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbda7fc640 1 --2- 172.21.15.87:0/367871668 >> v2:172.21.15.87:3300/0 conn(0x7ffbdc155320 0x7ffbdc155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbdb7fe640 1 --2- 172.21.15.87:0/367871668 >> v2:172.21.15.155:3300/0 conn(0x7ffbdc074160 0x7ffbdc074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbd9ffb640 1 -- 172.21.15.87:0/367871668 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997319447 0 0) 0x7ffbdc152d90 con 0x7ffbdc152980 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbd9ffb640 1 -- 172.21.15.87:0/367871668 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc4003530 con 0x7ffbdc152980 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.724+0000 7ffbda7fc640 1 -- 172.21.15.87:0/367871668 >> v2:172.21.15.155:3300/0 conn(0x7ffbdc074160 msgr2=0x7ffbdc074570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbda7fc640 1 --2- 172.21.15.87:0/367871668 >> v2:172.21.15.155:3300/0 conn(0x7ffbdc074160 0x7ffbdc074570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbda7fc640 1 -- 172.21.15.87:0/367871668 >> v1:172.21.15.87:6789/0 conn(0x7ffbdc152980 legacy=0x7ffbdc0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbda7fc640 1 -- 172.21.15.87:0/367871668 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc0a9cd0 con 0x7ffbdc155320 2024-04-25T15:54:55.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbdb7fe640 1 --2- 172.21.15.87:0/367871668 >> v2:172.21.15.155:3300/0 conn(0x7ffbdc074160 0x7ffbdc074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:54:55.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbda7fc640 1 --2- 172.21.15.87:0/367871668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc155730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc071130 tx=0x7ffbd001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1331daaf8f515a92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbd9ffb640 1 -- 172.21.15.87:0/367871668 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00b0070 con 0x7ffbdc155320 2024-04-25T15:54:55.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbd9ffb640 1 -- 172.21.15.87:0/367871668 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd00ab600 con 0x7ffbdc155320 2024-04-25T15:54:55.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbd9ffb640 1 -- 172.21.15.87:0/367871668 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00ab9d0 con 0x7ffbdc155320 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 -- 172.21.15.87:0/367871668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 msgr2=0x7ffbdc155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/367871668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc155730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc071130 tx=0x7ffbd001c3f0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 -- 172.21.15.87:0/367871668 shutdown_connections 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/367871668 >> v2:172.21.15.155:3300/0 conn(0x7ffbdc074160 0x7ffbdc074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/367871668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc155730 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 -- 172.21.15.87:0/367871668 >> 172.21.15.87:0/367871668 conn(0x7ffbdc0ac550 msgr2=0x7ffbdc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 -- 172.21.15.87:0/367871668 shutdown_connections 2024-04-25T15:54:55.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.728+0000 7ffbe18d1640 1 -- 172.21.15.87:0/367871668 wait complete. 2024-04-25T15:54:55.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 Processor -- start 2024-04-25T15:54:55.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 -- start start 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbdc074160 0x7ffbdc0abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbdc152980 0x7ffbdc150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc0729c0 con 0x7ffbdc155320 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc158f70 con 0x7ffbdc074160 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbe18d1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffbdc072b40 con 0x7ffbdc152980 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc14af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52662/0 (socket says 172.21.15.87:52662) 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.732+0000 7ffbdb7fe640 1 -- 172.21.15.87:0/3633397092 learned_addr learned my addr 172.21.15.87:0/3633397092 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbda7fc640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbdc152980 0x7ffbdc150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdaffd640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbdc074160 0x7ffbdc0abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdb7fe640 1 -- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbdc152980 msgr2=0x7ffbdc150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdb7fe640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbdc152980 0x7ffbdc150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdb7fe640 1 -- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbdc074160 msgr2=0x7ffbdc0abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdb7fe640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbdc074160 0x7ffbdc0abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdb7fe640 1 -- 172.21.15.87:0/3633397092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc1f4df0 con 0x7ffbdc155320 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdb7fe640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc14af50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00d800 tx=0x7ffbcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc009640 con 0x7ffbdc155320 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc019070 con 0x7ffbdc155320 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc14e040 con 0x7ffbdc155320 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc009a20 con 0x7ffbdc155320 2024-04-25T15:54:55.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc14e600 con 0x7ffbdc155320 2024-04-25T15:54:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc14e840 con 0x7ffbdc155320 2024-04-25T15:54:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffbcc009bc0 con 0x7ffbdc155320 2024-04-25T15:54:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbc3fff640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffbc806f430 0x7ffbc8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdaffd640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffbc806f430 0x7ffbc8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:55.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7ffbcc08fa60 con 0x7ffbdc155320 2024-04-25T15:54:55.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.736+0000 7ffbdaffd640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffbc806f430 0x7ffbc8071940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4005c10 tx=0x7ffbd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:55.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.740+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbcc05c600 con 0x7ffbdc155320 2024-04-25T15:54:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.892+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7ffbdc1f4b50 con 0x7ffbdc155320 2024-04-25T15:54:55.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbc3fff640 1 -- 172.21.15.87:0/3633397092 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7ffbcc05bf00 con 0x7ffbdc155320 2024-04-25T15:54:55.896 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffbc806f430 msgr2=0x7ffbc8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffbc806f430 0x7ffbc8071940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4005c10 tx=0x7ffbd4009040 comp rx=0 tx=0).stop 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 msgr2=0x7ffbdc14af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc14af50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00d800 tx=0x7ffbcc00dcc0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 shutdown_connections 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffbc806f430 0x7ffbc8071940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc155320 0x7ffbdc14af50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbdc152980 0x7ffbdc150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 --2- 172.21.15.87:0/3633397092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbdc074160 0x7ffbdc0abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 >> 172.21.15.87:0/3633397092 conn(0x7ffbdc0ac550 msgr2=0x7ffbdc0c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 shutdown_connections 2024-04-25T15:54:55.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:55.896+0000 7ffbe18d1640 1 -- 172.21.15.87:0/3633397092 wait complete. 2024-04-25T15:54:55.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:56.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 Processor -- start 2024-04-25T15:54:56.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 -- start start 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec00ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efec00cae60 0x7efec00cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efec0157380 0x7efec0157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efec00c7570 con 0x7efec0157380 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efec015b8b0 con 0x7efec00cae60 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec62bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efec015b5d0 con 0x7efec015ad90 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efec0157380 0x7efec0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efec0157380 0x7efec0157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52664/0 (socket says 172.21.15.87:52664) 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 -- 172.21.15.87:0/1291546954 learned_addr learned my addr 172.21.15.87:0/1291546954 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:56.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efebf7fe640 1 --2- 172.21.15.87:0/1291546954 >> v2:172.21.15.155:3300/0 conn(0x7efec00cae60 0x7efec00cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efebffff640 1 --2- 172.21.15.87:0/1291546954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec00ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 -- 172.21.15.87:0/1291546954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 msgr2=0x7efec00ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 --2- 172.21.15.87:0/1291546954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec00ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 -- 172.21.15.87:0/1291546954 >> v2:172.21.15.155:3300/0 conn(0x7efec00cae60 msgr2=0x7efec00cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 --2- 172.21.15.87:0/1291546954 >> v2:172.21.15.155:3300/0 conn(0x7efec00cae60 0x7efec00cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.052+0000 7efec4859640 1 -- 172.21.15.87:0/1291546954 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec00c2290 con 0x7efec0157380 2024-04-25T15:54:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec4859640 1 --2- 172.21.15.87:0/1291546954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec0157790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efec008e690 tx=0x7efeb001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b261c0b195df4bf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efebeffd640 1 -- 172.21.15.87:0/1291546954 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00a5550 con 0x7efec0157380 2024-04-25T15:54:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efebeffd640 1 -- 172.21.15.87:0/1291546954 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb00a56f0 con 0x7efec0157380 2024-04-25T15:54:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efebeffd640 1 -- 172.21.15.87:0/1291546954 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00a5ac0 con 0x7efec0157380 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 -- 172.21.15.87:0/1291546954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 msgr2=0x7efec0157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 --2- 172.21.15.87:0/1291546954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec0157790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efec008e690 tx=0x7efeb001c8d0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 -- 172.21.15.87:0/1291546954 shutdown_connections 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 --2- 172.21.15.87:0/1291546954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec0157790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 --2- 172.21.15.87:0/1291546954 >> v2:172.21.15.155:3300/0 conn(0x7efec00cae60 0x7efec00cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 --2- 172.21.15.87:0/1291546954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec00ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 -- 172.21.15.87:0/1291546954 >> 172.21.15.87:0/1291546954 conn(0x7efec00c9330 msgr2=0x7efec00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 -- 172.21.15.87:0/1291546954 shutdown_connections 2024-04-25T15:54:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.056+0000 7efec62bc640 1 -- 172.21.15.87:0/1291546954 wait complete. 2024-04-25T15:54:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 Processor -- start 2024-04-25T15:54:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- start start 2024-04-25T15:54:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efec00cae60 0x7efec006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec01f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec0145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efec01580e0 con 0x7efec0157380 2024-04-25T15:54:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efec00ca190 con 0x7efec00cae60 2024-04-25T15:54:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efec0158260 con 0x7efec015ad90 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec01f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec01f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52670/0 (socket says 172.21.15.87:52670) 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 -- 172.21.15.87:0/2137874128 learned_addr learned my addr 172.21.15.87:0/2137874128 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebffff640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efec00cae60 0x7efec006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec4859640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 -- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 msgr2=0x7efec0145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec0145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 -- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efec00cae60 msgr2=0x7efec006dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efec00cae60 0x7efec006dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 -- 172.21.15.87:0/2137874128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec014b840 con 0x7efec0157380 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec4859640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec0145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebf7fe640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec01f10b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efea800d7d0 tx=0x7efea800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8018020 con 0x7efec0157380 2024-04-25T15:54:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8009640 con 0x7efec0157380 2024-04-25T15:54:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8009a30 con 0x7efec0157380 2024-04-25T15:54:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec0152be0 con 0x7efec0157380 2024-04-25T15:54:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec014bf10 con 0x7efec0157380 2024-04-25T15:54:56.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.060+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec0069bb0 con 0x7efec0157380 2024-04-25T15:54:56.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.064+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efea801b020 con 0x7efec0157380 2024-04-25T15:54:56.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.064+0000 7efebcff9640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efea006f430 0x7efea0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.064+0000 7efebffff640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efea006f430 0x7efea0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.064+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7efea808fa80 con 0x7efec0157380 2024-04-25T15:54:56.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.064+0000 7efebffff640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efea006f430 0x7efea0071940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efeb800b930 tx=0x7efeb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.068+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efea8022020 con 0x7efec0157380 2024-04-25T15:54:56.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.216+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7efec00c7760 con 0x7efec0157380 2024-04-25T15:54:56.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.216+0000 7efebcff9640 1 -- 172.21.15.87:0/2137874128 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7efea805c620 con 0x7efec0157380 2024-04-25T15:54:56.219 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efea006f430 msgr2=0x7efea0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efea006f430 0x7efea0071940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efeb800b930 tx=0x7efeb8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 msgr2=0x7efec01f10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec01f10b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efea800d7d0 tx=0x7efea800dc90 comp rx=0 tx=0).stop 2024-04-25T15:54:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 shutdown_connections 2024-04-25T15:54:56.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efea006f430 0x7efea0071940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efec015ad90 0x7efec0145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec0157380 0x7efec01f10b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 --2- 172.21.15.87:0/2137874128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efec00cae60 0x7efec006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 >> 172.21.15.87:0/2137874128 conn(0x7efec00c9330 msgr2=0x7efec014df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 shutdown_connections 2024-04-25T15:54:56.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.220+0000 7efec62bc640 1 -- 172.21.15.87:0/2137874128 wait complete. 2024-04-25T15:54:56.240 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:56.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 Processor -- start 2024-04-25T15:54:56.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 -- start start 2024-04-25T15:54:56.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91e81518b0 0x7f91e806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91e806fa10 0x7f91e815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e8154fc0 con 0x7f91e80ad160 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f91e806ed60 con 0x7f91e81518b0 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91eddd7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f91e80acb20 con 0x7f91e806fa10 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e77fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91e81518b0 0x7f91e806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e6ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f91e80ad160 0x7f91e80c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58918/0 (socket says 172.21.15.87:58918) 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e6ffd640 1 -- 172.21.15.87:0/3226019619 learned_addr learned my addr 172.21.15.87:0/3226019619 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e77fe640 1 --2- 172.21.15.87:0/3226019619 >> v2:172.21.15.87:3300/0 conn(0x7f91e81518b0 0x7f91e806f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52680/0 (socket says 172.21.15.87:52680) 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e77fe640 1 -- 172.21.15.87:0/3226019619 >> v2:172.21.15.155:3300/0 conn(0x7f91e806fa10 msgr2=0x7f91e815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:56.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e7fff640 1 --2- 172.21.15.87:0/3226019619 >> v2:172.21.15.155:3300/0 conn(0x7f91e806fa10 0x7f91e815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e77fe640 1 --2- 172.21.15.87:0/3226019619 >> v2:172.21.15.155:3300/0 conn(0x7f91e806fa10 0x7f91e815e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e77fe640 1 -- 172.21.15.87:0/3226019619 >> v1:172.21.15.87:6789/0 conn(0x7f91e80ad160 legacy=0x7f91e80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e67fc640 1 -- 172.21.15.87:0/3226019619 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649971971 0 0) 0x7f91e8154fc0 con 0x7f91e80ad160 2024-04-25T15:54:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.380+0000 7f91e77fe640 1 -- 172.21.15.87:0/3226019619 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e80ace00 con 0x7f91e81518b0 2024-04-25T15:54:56.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91e77fe640 1 --2- 172.21.15.87:0/3226019619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e81518b0 0x7f91e806f4d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f91e80734e0 tx=0x7f91d801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe92f7b64b41d585 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91e67fc640 1 -- 172.21.15.87:0/3226019619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80b2070 con 0x7f91e81518b0 2024-04-25T15:54:56.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91e67fc640 1 -- 172.21.15.87:0/3226019619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d80a5920 con 0x7f91e81518b0 2024-04-25T15:54:56.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91e67fc640 1 -- 172.21.15.87:0/3226019619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80a5cf0 con 0x7f91e81518b0 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 -- 172.21.15.87:0/3226019619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e81518b0 msgr2=0x7f91e806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 --2- 172.21.15.87:0/3226019619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e81518b0 0x7f91e806f4d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f91e80734e0 tx=0x7f91d801c930 comp rx=0 tx=0).stop 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 -- 172.21.15.87:0/3226019619 shutdown_connections 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 --2- 172.21.15.87:0/3226019619 >> v2:172.21.15.155:3300/0 conn(0x7f91e806fa10 0x7f91e815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 --2- 172.21.15.87:0/3226019619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e81518b0 0x7f91e806f4d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 -- 172.21.15.87:0/3226019619 >> 172.21.15.87:0/3226019619 conn(0x7f91e80c8770 msgr2=0x7f91e80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:56.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 -- 172.21.15.87:0/3226019619 shutdown_connections 2024-04-25T15:54:56.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 -- 172.21.15.87:0/3226019619 wait complete. 2024-04-25T15:54:56.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 Processor -- start 2024-04-25T15:54:56.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.384+0000 7f91eddd7640 1 -- start start 2024-04-25T15:54:56.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 0x7f91e814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e80ad160 0x7f91e80bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e81518b0 0x7f91e814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8161710 con 0x7f91e806fa10 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8161890 con 0x7f91e80ad160 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f91e8161a10 con 0x7f91e81518b0 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 0x7f91e814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 0x7f91e814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52688/0 (socket says 172.21.15.87:52688) 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 -- 172.21.15.87:0/2813922538 learned_addr learned my addr 172.21.15.87:0/2813922538 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e7fff640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e81518b0 0x7f91e814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 -- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e81518b0 msgr2=0x7f91e814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e81518b0 0x7f91e814a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 -- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e80ad160 msgr2=0x7f91e80bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e80ad160 0x7f91e80bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 -- 172.21.15.87:0/2813922538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e814d560 con 0x7f91e806fa10 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e77fe640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 0x7f91e814dac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f91d801a560 tx=0x7f91d80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80bd020 con 0x7f91e806fa10 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d80ad7a0 con 0x7f91e806fa10 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80b2040 con 0x7f91e806fa10 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e81f2f10 con 0x7f91e806fa10 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e80bd810 con 0x7f91e806fa10 2024-04-25T15:54:56.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e8069bb0 con 0x7f91e806fa10 2024-04-25T15:54:56.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f91d80c0020 con 0x7f91e806fa10 2024-04-25T15:54:56.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91dffff640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f91c806f430 0x7f91c8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91e6ffd640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f91c806f430 0x7f91c8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.388+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f91d812a590 con 0x7f91e806fa10 2024-04-25T15:54:56.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.392+0000 7f91e6ffd640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f91c806f430 0x7f91c8071940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91e814c920 tx=0x7f91d0007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.396+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91d80c7030 con 0x7f91e806fa10 2024-04-25T15:54:56.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.576+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91e80abfa0 con 0x7f91e806fa10 2024-04-25T15:54:56.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.576+0000 7f91dffff640 1 -- 172.21.15.87:0/2813922538 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f91d8016520 con 0x7f91e806fa10 2024-04-25T15:54:56.579 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:56.579 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:56.579 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f91c806f430 msgr2=0x7f91c8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f91c806f430 0x7f91c8071940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91e814c920 tx=0x7f91d0007970 comp rx=0 tx=0).stop 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 msgr2=0x7f91e814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 0x7f91e814dac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f91d801a560 tx=0x7f91d80196d0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 shutdown_connections 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f91c806f430 0x7f91c8071940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e81518b0 0x7f91e814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e80ad160 0x7f91e80bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 --2- 172.21.15.87:0/2813922538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91e806fa10 0x7f91e814dac0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 >> 172.21.15.87:0/2813922538 conn(0x7f91e80c8770 msgr2=0x7f91e814ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:56.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 shutdown_connections 2024-04-25T15:54:56.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.580+0000 7f91eddd7640 1 -- 172.21.15.87:0/2813922538 wait complete. 2024-04-25T15:54:56.599 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:56.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.728+0000 7f62346be640 1 Processor -- start 2024-04-25T15:54:56.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.728+0000 7f62346be640 1 -- start start 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f62346be640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f622c1518b0 0x7f622c06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f62346be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 0x7f622c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f62346be640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622c154fc0 con 0x7f622c0ad160 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f62346be640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f622c06ed60 con 0x7f622c1518b0 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f62346be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f622c0acb20 con 0x7f622c06fa10 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f6232c5b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 0x7f622c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f623245a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f622c1518b0 0x7f622c06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f6232c5b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 0x7f622c15e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:38610/0 (socket says 172.21.15.87:38610) 2024-04-25T15:54:56.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f6232c5b640 1 -- 172.21.15.87:0/2660858513 learned_addr learned my addr 172.21.15.87:0/2660858513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:56.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f623245a640 1 -- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 msgr2=0x7f622c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:56.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f623245a640 1 --2- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 0x7f622c15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f623245a640 1 -- 172.21.15.87:0/2660858513 >> v1:172.21.15.155:6789/0 conn(0x7f622c0ad160 legacy=0x7f622c0c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f623245a640 1 -- 172.21.15.87:0/2660858513 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c0ace00 con 0x7f622c1518b0 2024-04-25T15:54:56.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.732+0000 7f6232c5b640 1 --2- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 0x7f622c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:54:56.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f623245a640 1 --2- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c1518b0 0x7f622c06f4d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f622c06eee0 tx=0x7f621c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce0a19eb3a3222c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f6231458640 1 -- 172.21.15.87:0/2660858513 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0b1070 con 0x7f622c1518b0 2024-04-25T15:54:56.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f6231458640 1 -- 172.21.15.87:0/2660858513 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c0ac630 con 0x7f622c1518b0 2024-04-25T15:54:56.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f6231458640 1 -- 172.21.15.87:0/2660858513 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0a8050 con 0x7f622c1518b0 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 -- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c1518b0 msgr2=0x7f622c06f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 --2- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c1518b0 0x7f622c06f4d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f622c06eee0 tx=0x7f621c01c4a0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 -- 172.21.15.87:0/2660858513 shutdown_connections 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 --2- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c06fa10 0x7f622c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 --2- 172.21.15.87:0/2660858513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c1518b0 0x7f622c06f4d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 -- 172.21.15.87:0/2660858513 >> 172.21.15.87:0/2660858513 conn(0x7f622c0c8770 msgr2=0x7f622c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:56.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 -- 172.21.15.87:0/2660858513 shutdown_connections 2024-04-25T15:54:56.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 -- 172.21.15.87:0/2660858513 wait complete. 2024-04-25T15:54:56.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 Processor -- start 2024-04-25T15:54:56.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.736+0000 7f62346be640 1 -- start start 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c06fa10 0x7f622c14d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c0ad160 0x7f622c1eede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 0x7f622c149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f622c161710 con 0x7f622c1518b0 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f622c161890 con 0x7f622c06fa10 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f622c161a10 con 0x7f622c0ad160 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 0x7f622c149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 0x7f622c149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52692/0 (socket says 172.21.15.87:52692) 2024-04-25T15:54:56.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 -- 172.21.15.87:0/4216580159 learned_addr learned my addr 172.21.15.87:0/4216580159 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f623245a640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c06fa10 0x7f622c14d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6231c59640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c0ad160 0x7f622c1eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 -- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c0ad160 msgr2=0x7f622c1eede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c0ad160 0x7f622c1eede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 -- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c06fa10 msgr2=0x7f622c14d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c06fa10 0x7f622c14d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 -- 172.21.15.87:0/4216580159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c1f2a60 con 0x7f622c1518b0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6232c5b640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 0x7f622c149f70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f622400efc0 tx=0x7f622400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622400cd20 con 0x7f622c1518b0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62240039a0 con 0x7f622c1518b0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622c1f2d00 con 0x7f622c1518b0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224003d90 con 0x7f622c1518b0 2024-04-25T15:54:56.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622c157a80 con 0x7f622c1518b0 2024-04-25T15:54:56.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f622c069bb0 con 0x7f622c1518b0 2024-04-25T15:54:56.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6224012050 con 0x7f622c1518b0 2024-04-25T15:54:56.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6222ffd640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f621006f400 0x7f6210071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:56.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f622408fb60 con 0x7f622c1518b0 2024-04-25T15:54:56.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.740+0000 7f623245a640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f621006f400 0x7f6210071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:56.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.744+0000 7f623245a640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f621006f400 0x7f6210071910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ae000 tx=0x7f621c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:56.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.748+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6224022020 con 0x7f622c1518b0 2024-04-25T15:54:56.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.904+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f622c06f4d0 con 0x7f622c1518b0 2024-04-25T15:54:56.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.908+0000 7f6222ffd640 1 -- 172.21.15.87:0/4216580159 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20684 (secure 0 0 0) 0x7f622c1f2a60 con 0x7f622c1518b0 2024-04-25T15:54:56.911 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:56.911 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:50.184879+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:56.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f621006f400 msgr2=0x7f6210071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f621006f400 0x7f6210071910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ae000 tx=0x7f621c008040 comp rx=0 tx=0).stop 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 msgr2=0x7f622c149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 0x7f622c149f70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f622400efc0 tx=0x7f622400c490 comp rx=0 tx=0).stop 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 shutdown_connections 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f621006f400 0x7f6210071910 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f622c1518b0 0x7f622c149f70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c0ad160 0x7f622c1eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 --2- 172.21.15.87:0/4216580159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c06fa10 0x7f622c14d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 >> 172.21.15.87:0/4216580159 conn(0x7f622c0c8770 msgr2=0x7f622c0c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 shutdown_connections 2024-04-25T15:54:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:56.912+0000 7f62346be640 1 -- 172.21.15.87:0/4216580159 wait complete. 2024-04-25T15:54:56.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:56.932 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2024-04-25T15:54:56.932 INFO:tasks.mds_thrash.fs.[a]:waiting for 4 secs before thrashing 2024-04-25T15:54:57.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.060+0000 7f9a85cc2640 1 Processor -- start 2024-04-25T15:54:57.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.060+0000 7f9a85cc2640 1 -- start start 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a85cc2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a801518b0 0x7f9a8006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a85cc2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a800ad160 0x7f9a800c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a85cc2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a80154fc0 con 0x7f9a800c4620 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a85cc2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8006ed60 con 0x7f9a800ad160 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a85cc2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a800acb20 con 0x7f9a801518b0 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a800ad160 0x7f9a800c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a800ad160 0x7f9a800c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52708/0 (socket says 172.21.15.87:52708) 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 -- 172.21.15.87:0/3751763208 learned_addr learned my addr 172.21.15.87:0/3751763208 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7f7fe640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a801518b0 0x7f9a8006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 -- 172.21.15.87:0/3751763208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a801518b0 msgr2=0x7f9a8006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a801518b0 0x7f9a8006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 -- 172.21.15.87:0/3751763208 >> v1:172.21.15.155:6789/0 conn(0x7f9a800c4620 legacy=0x7f9a80157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 -- 172.21.15.87:0/3751763208 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a800ace00 con 0x7f9a800ad160 2024-04-25T15:54:57.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7f7fe640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a801518b0 0x7f9a8006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:57.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7effd640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a800c40e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400bb10 tx=0x7f9a7401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2d3c7f55097d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7e7fc640 1 -- 172.21.15.87:0/3751763208 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a740b4070 con 0x7f9a800ad160 2024-04-25T15:54:57.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7e7fc640 1 -- 172.21.15.87:0/3751763208 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a740a7ca0 con 0x7f9a800ad160 2024-04-25T15:54:57.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.064+0000 7f9a7e7fc640 1 -- 172.21.15.87:0/3751763208 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a740af660 con 0x7f9a800ad160 2024-04-25T15:54:57.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- 172.21.15.87:0/3751763208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 msgr2=0x7f9a800c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a800c40e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400bb10 tx=0x7f9a7401ebf0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- 172.21.15.87:0/3751763208 shutdown_connections 2024-04-25T15:54:57.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a800c40e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/3751763208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a801518b0 0x7f9a8006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- 172.21.15.87:0/3751763208 >> 172.21.15.87:0/3751763208 conn(0x7f9a800c8770 msgr2=0x7f9a800c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- 172.21.15.87:0/3751763208 shutdown_connections 2024-04-25T15:54:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- 172.21.15.87:0/3751763208 wait complete. 2024-04-25T15:54:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 Processor -- start 2024-04-25T15:54:57.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- start start 2024-04-25T15:54:57.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a801eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a800c4620 0x7f9a80147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a801518b0 0x7f9a8014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800c3330 con 0x7f9a800ad160 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800c31b0 con 0x7f9a801518b0 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a85cc2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a800c34b0 con 0x7f9a800c4620 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a801eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a801eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52720/0 (socket says 172.21.15.87:52720) 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 -- 172.21.15.87:0/2676262054 learned_addr learned my addr 172.21.15.87:0/2676262054 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7ffff640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a801518b0 0x7f9a8014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7effd640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a800c4620 0x7f9a80147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 -- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a800c4620 msgr2=0x7f9a80147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a800c4620 0x7f9a80147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 -- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a801518b0 msgr2=0x7f9a8014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a801518b0 0x7f9a8014d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7f7fe640 1 -- 172.21.15.87:0/2676262054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a801ecf90 con 0x7f9a800ad160 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.068+0000 7f9a7effd640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a800c4620 0x7f9a80147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a7ffff640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a801518b0 0x7f9a8014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a7f7fe640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a801eca50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c850 tx=0x7f9a7000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70015070 con 0x7f9a800ad160 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a70007830 con 0x7f9a800ad160 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a800c60b0 con 0x7f9a800ad160 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70007be0 con 0x7f9a800ad160 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a80149270 con 0x7f9a800ad160 2024-04-25T15:54:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a80149060 con 0x7f9a800ad160 2024-04-25T15:54:57.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9a70018070 con 0x7f9a800ad160 2024-04-25T15:54:57.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a67fff640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9a6c06f430 0x7f9a6c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a7effd640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9a6c06f430 0x7f9a6c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f9a7008f430 con 0x7f9a800ad160 2024-04-25T15:54:57.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.072+0000 7f9a7effd640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9a6c06f430 0x7f9a6c071940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a740b1000 tx=0x7f9a740a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.076+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a7005c060 con 0x7f9a800ad160 2024-04-25T15:54:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.240+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a80069bb0 con 0x7f9a800ad160 2024-04-25T15:54:57.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a67fff640 1 -- 172.21.15.87:0/2676262054 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20684 (secure 0 0 0) 0x7f9a7005b960 con 0x7f9a800ad160 2024-04-25T15:54:57.245 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:57.245 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:50.184879+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9a6c06f430 msgr2=0x7f9a6c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9a6c06f430 0x7f9a6c071940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a740b1000 tx=0x7f9a740a9070 comp rx=0 tx=0).stop 2024-04-25T15:54:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 msgr2=0x7f9a801eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a801eca50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c850 tx=0x7f9a7000cd10 comp rx=0 tx=0).stop 2024-04-25T15:54:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 shutdown_connections 2024-04-25T15:54:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9a6c06f430 0x7f9a6c071940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a801518b0 0x7f9a8014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a800c4620 0x7f9a80147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 --2- 172.21.15.87:0/2676262054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a800ad160 0x7f9a801eca50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 >> 172.21.15.87:0/2676262054 conn(0x7f9a800c8770 msgr2=0x7f9a800ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 shutdown_connections 2024-04-25T15:54:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.244+0000 7f9a85cc2640 1 -- 172.21.15.87:0/2676262054 wait complete. 2024-04-25T15:54:57.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:54:57.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:54:57.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ec6a26640 1 Processor -- start 2024-04-25T15:54:57.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ec6a26640 1 -- start start 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ec6a26640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 0x7f0ec006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ec6a26640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec0154fc0 con 0x7f0ec00ad160 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ec6a26640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec00acb20 con 0x7f0ec006fa10 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ec6a26640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec006ed60 con 0x7f0ec01518b0 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebf7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0ec00ad160 0x7f0ec00c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58922/0 (socket says 172.21.15.87:58922) 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebf7fe640 1 -- 172.21.15.87:0/924267184 learned_addr learned my addr 172.21.15.87:0/924267184 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598377557 0 0) 0x7f0ec0154fc0 con 0x7f0ec00ad160 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebffff640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 0x7f0ec006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea8003530 con 0x7f0ec00ad160 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2230991740 0 0) 0x7f0ea8003530 con 0x7f0ec00ad160 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 msgr2=0x7f0ec006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 0x7f0ec006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 >> v1:172.21.15.155:6789/0 conn(0x7f0ec006fa10 legacy=0x7f0ec015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec00ace00 con 0x7f0ec00ad160 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f0eb4001680 con 0x7f0ec00ad160 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 >> v1:172.21.15.87:6789/0 conn(0x7f0ec00ad160 legacy=0x7f0ec00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea80039f0 0x7f0ea8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 0x7f0ea8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea8004d50 0x7f0ea8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec006ed60 con 0x7f0ea80039f0 2024-04-25T15:54:57.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea800bb00 con 0x7f0ea8004d50 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea800bd00 con 0x7f0ec01518b0 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.400+0000 7f0ebffff640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea80039f0 0x7f0ea8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec4fc3640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea8004d50 0x7f0ea8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebf7fe640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 0x7f0ea8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebffff640 1 -- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 msgr2=0x7f0ea8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebffff640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01518b0 0x7f0ea8004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebffff640 1 -- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea8004d50 msgr2=0x7f0ea8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebffff640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea8004d50 0x7f0ea8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebffff640 1 -- 172.21.15.87:0/924267184 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea8003530 con 0x7f0ea80039f0 2024-04-25T15:54:57.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec4fc3640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea8004d50 0x7f0ea8005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:57.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebffff640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea80039f0 0x7f0ea8003e60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009ab0 tx=0x7f0eb001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b537aa575e44cade server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00096b0 con 0x7f0ea80039f0 2024-04-25T15:54:57.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb00a64c0 con 0x7f0ea80039f0 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ebeffd640 1 -- 172.21.15.87:0/924267184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00a6870 con 0x7f0ea80039f0 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec6a26640 1 -- 172.21.15.87:0/924267184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea80039f0 msgr2=0x7f0ea8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/924267184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea80039f0 0x7f0ea8003e60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009ab0 tx=0x7f0eb001c9b0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec4fc3640 1 -- 172.21.15.87:0/924267184 reap_dead start 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec6a26640 1 -- 172.21.15.87:0/924267184 shutdown_connections 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec6a26640 1 -- 172.21.15.87:0/924267184 >> 172.21.15.87:0/924267184 conn(0x7f0ec00c8770 msgr2=0x7f0ec00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec6a26640 1 -- 172.21.15.87:0/924267184 shutdown_connections 2024-04-25T15:54:57.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.404+0000 7f0ec6a26640 1 -- 172.21.15.87:0/924267184 wait complete. 2024-04-25T15:54:57.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 Processor -- start 2024-04-25T15:54:57.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- start start 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea80039f0 0x7f0ec01f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 0x7f0ec00c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01434e0 0x7f0ec01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec0160a60 con 0x7f0ec01f1890 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec01608e0 con 0x7f0ea80039f0 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec0160be0 con 0x7f0ec01434e0 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 0x7f0ec00c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 0x7f0ec00c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52738/0 (socket says 172.21.15.87:52738) 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 -- 172.21.15.87:0/3971567890 learned_addr learned my addr 172.21.15.87:0/3971567890 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec4fc3640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01434e0 0x7f0ec01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebffff640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea80039f0 0x7f0ec01f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 -- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01434e0 msgr2=0x7f0ec01438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01434e0 0x7f0ec01438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 -- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea80039f0 msgr2=0x7f0ec01f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea80039f0 0x7f0ec01f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 -- 172.21.15.87:0/3971567890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec00bd810 con 0x7f0ec01f1890 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebf7fe640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 0x7f0ec00c3170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4001000 tx=0x7f0eb400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4019070 con 0x7f0ec01f1890 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb400de50 con 0x7f0ec01f1890 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec00bdaf0 con 0x7f0ec01f1890 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40047f0 con 0x7f0ec01f1890 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec01f1370 con 0x7f0ec01f1890 2024-04-25T15:54:57.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.408+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec01f0ea0 con 0x7f0ec01f1890 2024-04-25T15:54:57.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.412+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0eb401c070 con 0x7f0ec01f1890 2024-04-25T15:54:57.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.412+0000 7f0ebcff9640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0eac06f400 0x7f0eac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.412+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f0eb408f320 con 0x7f0ec01f1890 2024-04-25T15:54:57.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.412+0000 7f0ebffff640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0eac06f400 0x7f0eac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.412+0000 7f0ebffff640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0eac06f400 0x7f0eac071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00af000 tx=0x7f0eb00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.416+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0eb4023020 con 0x7f0ec01f1890 2024-04-25T15:54:57.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.560+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ec0069bb0 con 0x7f0ec01f1890 2024-04-25T15:54:57.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ebcff9640 1 -- 172.21.15.87:0/3971567890 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f0eb405c030 con 0x7f0ec01f1890 2024-04-25T15:54:57.565 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T15:54:57.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0eac06f400 msgr2=0x7f0eac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0eac06f400 0x7f0eac071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00af000 tx=0x7f0eb00046d0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 msgr2=0x7f0ec00c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 0x7f0ec00c3170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4001000 tx=0x7f0eb400dc00 comp rx=0 tx=0).stop 2024-04-25T15:54:57.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 shutdown_connections 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0eac06f400 0x7f0eac071910 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ec01434e0 0x7f0ec01438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec01f1890 0x7f0ec00c3170 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 --2- 172.21.15.87:0/3971567890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea80039f0 0x7f0ec01f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 >> 172.21.15.87:0/3971567890 conn(0x7f0ec00c8770 msgr2=0x7f0ec01538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 shutdown_connections 2024-04-25T15:54:57.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.564+0000 7f0ec6a26640 1 -- 172.21.15.87:0/3971567890 wait complete. 2024-04-25T15:54:57.584 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T15:54:57.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb697ec640 1 Processor -- start 2024-04-25T15:54:57.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb697ec640 1 -- start start 2024-04-25T15:54:57.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb697ec640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb64160e60 0x7feb64163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb697ec640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb640c5120 con 0x7feb640c4250 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb697ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb640c4b60 con 0x7feb6415ac30 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb697ec640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7feb640c3b20 con 0x7feb64160e60 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb62ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feb640c4250 0x7feb6406ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58928/0 (socket says 172.21.15.87:58928) 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb637fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb64160e60 0x7feb64163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb62ffd640 1 -- 172.21.15.87:0/2009201097 learned_addr learned my addr 172.21.15.87:0/2009201097 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb61ffb640 1 -- 172.21.15.87:0/2009201097 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215178449 0 0) 0x7feb54001120 con 0x7feb640c4250 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb61ffb640 1 -- 172.21.15.87:0/2009201097 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb4c003530 con 0x7feb640c4250 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb637fe640 1 -- 172.21.15.87:0/2009201097 >> v1:172.21.15.155:6789/0 conn(0x7feb6415ac30 legacy=0x7feb6415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb637fe640 1 -- 172.21.15.87:0/2009201097 >> v1:172.21.15.87:6789/0 conn(0x7feb640c4250 legacy=0x7feb6406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.728+0000 7feb637fe640 1 -- 172.21.15.87:0/2009201097 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb640c4e40 con 0x7feb64160e60 2024-04-25T15:54:57.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb637fe640 1 --2- 172.21.15.87:0/2009201097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb64160e60 0x7feb64163280 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009d90 tx=0x7feb5c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b7739f5f352027 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb61ffb640 1 -- 172.21.15.87:0/2009201097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0b2070 con 0x7feb64160e60 2024-04-25T15:54:57.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb61ffb640 1 -- 172.21.15.87:0/2009201097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c0a5780 con 0x7feb64160e60 2024-04-25T15:54:57.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb61ffb640 1 -- 172.21.15.87:0/2009201097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0a5b50 con 0x7feb64160e60 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 -- 172.21.15.87:0/2009201097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb64160e60 msgr2=0x7feb64163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 --2- 172.21.15.87:0/2009201097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb64160e60 0x7feb64163280 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009d90 tx=0x7feb5c01c8a0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 -- 172.21.15.87:0/2009201097 shutdown_connections 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 --2- 172.21.15.87:0/2009201097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb64160e60 0x7feb64163280 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 -- 172.21.15.87:0/2009201097 >> 172.21.15.87:0/2009201097 conn(0x7feb6406d780 msgr2=0x7feb6406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 -- 172.21.15.87:0/2009201097 shutdown_connections 2024-04-25T15:54:57.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.732+0000 7feb697ec640 1 -- 172.21.15.87:0/2009201097 wait complete. 2024-04-25T15:54:57.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 Processor -- start 2024-04-25T15:54:57.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- start start 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb640c4250 0x7feb64161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 0x7feb641560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb64160e60 0x7feb6414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feb6415b8d0 con 0x7feb6415ac30 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb6415b750 con 0x7feb64160e60 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb64155100 con 0x7feb640c4250 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 0x7feb641560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 0x7feb641560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52746/0 (socket says 172.21.15.87:52746) 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 -- 172.21.15.87:0/1545473709 learned_addr learned my addr 172.21.15.87:0/1545473709 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:57.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb62ffd640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb640c4250 0x7feb64161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb637fe640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb64160e60 0x7feb6414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 -- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb640c4250 msgr2=0x7feb64161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb640c4250 0x7feb64161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 -- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb64160e60 msgr2=0x7feb6414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb64160e60 0x7feb6414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 -- 172.21.15.87:0/1545473709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6414eb70 con 0x7feb6415ac30 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb637fe640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb64160e60 0x7feb6414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb62ffd640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb640c4250 0x7feb64161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb627fc640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 0x7feb641560b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb5800b440 tx=0x7feb5800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58015020 con 0x7feb6415ac30 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb58011890 con 0x7feb6415ac30 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb641f4c90 con 0x7feb6415ac30 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58011c80 con 0x7feb6415ac30 2024-04-25T15:54:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb640ad730 con 0x7feb6415ac30 2024-04-25T15:54:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb64069bb0 con 0x7feb6415ac30 2024-04-25T15:54:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.736+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7feb58018020 con 0x7feb6415ac30 2024-04-25T15:54:57.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.740+0000 7feb4b7fe640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb5006f400 0x7feb50071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:57.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.740+0000 7feb62ffd640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb5006f400 0x7feb50071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:57.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.740+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7feb5808f4a0 con 0x7feb6415ac30 2024-04-25T15:54:57.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.740+0000 7feb62ffd640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb5006f400 0x7feb50071910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb540012c0 tx=0x7feb54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:57.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.744+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb5801f030 con 0x7feb6415ac30 2024-04-25T15:54:57.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.892+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7feb6414ed40 con 0x7feb6415ac30 2024-04-25T15:54:57.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.892+0000 7feb4b7fe640 1 -- 172.21.15.87:0/1545473709 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7feb5800d040 con 0x7feb6415ac30 2024-04-25T15:54:57.896 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:57.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb5006f400 msgr2=0x7feb50071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb5006f400 0x7feb50071910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb540012c0 tx=0x7feb54009040 comp rx=0 tx=0).stop 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 msgr2=0x7feb641560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 0x7feb641560b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb5800b440 tx=0x7feb5800b900 comp rx=0 tx=0).stop 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 shutdown_connections 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7feb5006f400 0x7feb50071910 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb64160e60 0x7feb6414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb6415ac30 0x7feb641560b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 --2- 172.21.15.87:0/1545473709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb640c4250 0x7feb64161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 >> 172.21.15.87:0/1545473709 conn(0x7feb6406d780 msgr2=0x7feb6415b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 shutdown_connections 2024-04-25T15:54:57.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:57.896+0000 7feb697ec640 1 -- 172.21.15.87:0/1545473709 wait complete. 2024-04-25T15:54:57.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T15:54:58.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 Processor -- start 2024-04-25T15:54:58.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 -- start start 2024-04-25T15:54:58.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f028414d810 0x7f0284157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0284154d00 0x7f0284154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0284157d50 con 0x7f028406f790 2024-04-25T15:54:58.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f02840add10 con 0x7f0284154d00 2024-04-25T15:54:58.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028bfc8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02840adff0 con 0x7f028414d810 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0289563640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0284154d00 0x7f0284154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028a565640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f028406f790 0x7f02840c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58942/0 (socket says 172.21.15.87:58942) 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f028a565640 1 -- 172.21.15.87:0/666459457 learned_addr learned my addr 172.21.15.87:0/666459457 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0289d64640 1 --2- 172.21.15.87:0/666459457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f028414d810 0x7f0284157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0289563640 1 -- 172.21.15.87:0/666459457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f028414d810 msgr2=0x7f0284157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0289563640 1 --2- 172.21.15.87:0/666459457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f028414d810 0x7f0284157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0289563640 1 -- 172.21.15.87:0/666459457 >> v1:172.21.15.87:6789/0 conn(0x7f028406f790 legacy=0x7f02840c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0289563640 1 -- 172.21.15.87:0/666459457 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0284157010 con 0x7f0284154d00 2024-04-25T15:54:58.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.060+0000 7f0288d62640 1 -- 172.21.15.87:0/666459457 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781829114 0 0) 0x7f0284157d50 con 0x7f028406f790 2024-04-25T15:54:58.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f0289563640 1 --2- 172.21.15.87:0/666459457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0284154d00 0x7f0284154200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f02740097c0 tx=0x7f027401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d1a963a64a3ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f0288d62640 1 -- 172.21.15.87:0/666459457 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740b0070 con 0x7f0284154d00 2024-04-25T15:54:58.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f0288d62640 1 -- 172.21.15.87:0/666459457 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02740ab600 con 0x7f0284154d00 2024-04-25T15:54:58.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f0288d62640 1 -- 172.21.15.87:0/666459457 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740ab9d0 con 0x7f0284154d00 2024-04-25T15:54:58.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 -- 172.21.15.87:0/666459457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0284154d00 msgr2=0x7f0284154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 --2- 172.21.15.87:0/666459457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0284154d00 0x7f0284154200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f02740097c0 tx=0x7f027401c380 comp rx=0 tx=0).stop 2024-04-25T15:54:58.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 -- 172.21.15.87:0/666459457 shutdown_connections 2024-04-25T15:54:58.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 --2- 172.21.15.87:0/666459457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0284154d00 0x7f0284154200 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 --2- 172.21.15.87:0/666459457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f028414d810 0x7f0284157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 -- 172.21.15.87:0/666459457 >> 172.21.15.87:0/666459457 conn(0x7f02840c8770 msgr2=0x7f02840c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:58.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 -- 172.21.15.87:0/666459457 shutdown_connections 2024-04-25T15:54:58.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.064+0000 7f028bfc8640 1 -- 172.21.15.87:0/666459457 wait complete. 2024-04-25T15:54:58.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 Processor -- start 2024-04-25T15:54:58.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- start start 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 0x7f02841ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028414d810 0x7f02840c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0284154d00 0x7f02840bde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0284155110 con 0x7f028406f790 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f028406ffb0 con 0x7f028414d810 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0284155290 con 0x7f0284154d00 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 0x7f02841ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 0x7f02841ef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52772/0 (socket says 172.21.15.87:52772) 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 -- 172.21.15.87:0/387317301 learned_addr learned my addr 172.21.15.87:0/387317301 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:58.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028a565640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0284154d00 0x7f02840bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289563640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028414d810 0x7f02840c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 -- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0284154d00 msgr2=0x7f02840bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0284154d00 0x7f02840bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 -- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028414d810 msgr2=0x7f02840c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028414d810 0x7f02840c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 -- 172.21.15.87:0/387317301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0284150ba0 con 0x7f028406f790 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289563640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028414d810 0x7f02840c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f0289d64640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 0x7f02841ef0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0280007e30 tx=0x7f028000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028001a070 con 0x7f028406f790 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0280003ba0 con 0x7f028406f790 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02840be910 con 0x7f028406f790 2024-04-25T15:54:58.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028000ee30 con 0x7f028406f790 2024-04-25T15:54:58.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02840bed80 con 0x7f028406f790 2024-04-25T15:54:58.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.068+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0284069bb0 con 0x7f028406f790 2024-04-25T15:54:58.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.072+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f028001d070 con 0x7f028406f790 2024-04-25T15:54:58.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.072+0000 7f027a7fc640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f026806f400 0x7f0268071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.072+0000 7f0289563640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f026806f400 0x7f0268071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.072+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f028008f800 con 0x7f028406f790 2024-04-25T15:54:58.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.072+0000 7f0289563640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f026806f400 0x7f0268071910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f02740ad000 tx=0x7f02740a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.076+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f028005bcc0 con 0x7f028406f790 2024-04-25T15:54:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f02840c8010 con 0x7f028406f790 2024-04-25T15:54:58.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f027a7fc640 1 -- 172.21.15.87:0/387317301 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f028005ffc0 con 0x7f028406f790 2024-04-25T15:54:58.230 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f026806f400 msgr2=0x7f0268071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f026806f400 0x7f0268071910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f02740ad000 tx=0x7f02740a6000 comp rx=0 tx=0).stop 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 msgr2=0x7f02841ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 0x7f02841ef0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0280007e30 tx=0x7f028000e4b0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 shutdown_connections 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f026806f400 0x7f0268071910 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0284154d00 0x7f02840bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f028414d810 0x7f02840c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 --2- 172.21.15.87:0/387317301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028406f790 0x7f02841ef0a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 >> 172.21.15.87:0/387317301 conn(0x7f02840c8770 msgr2=0x7f02840c2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 shutdown_connections 2024-04-25T15:54:58.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.228+0000 7f028bfc8640 1 -- 172.21.15.87:0/387317301 wait complete. 2024-04-25T15:54:58.252 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T15:54:58.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 Processor -- start 2024-04-25T15:54:58.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 -- start start 2024-04-25T15:54:58.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdf20071e50 0x7fdf200c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 0x7fdf2015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf20072430 con 0x7fdf201529a0 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdf20074730 con 0x7fdf20071e50 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf24d7c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf20074a10 con 0x7fdf200c4720 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1e59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdf201529a0 0x7fdf200ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58944/0 (socket says 172.21.15.87:58944) 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1e59c640 1 -- 172.21.15.87:0/3333217859 learned_addr learned my addr 172.21.15.87:0/3333217859 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1dd9b640 1 --2- 172.21.15.87:0/3333217859 >> v2:172.21.15.155:3300/0 conn(0x7fdf20071e50 0x7fdf200c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 0x7fdf2015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844582540 0 0) 0x7fdf20072430 con 0x7fdf201529a0 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf08003530 con 0x7fdf201529a0 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 609254742 0 0) 0x7fdf08003530 con 0x7fdf201529a0 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 msgr2=0x7fdf2015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 0x7fdf2015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 >> v2:172.21.15.155:3300/0 conn(0x7fdf20071e50 msgr2=0x7fdf200c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 --2- 172.21.15.87:0/3333217859 >> v2:172.21.15.155:3300/0 conn(0x7fdf20071e50 0x7fdf200c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf20074cf0 con 0x7fdf201529a0 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fdf14001680 con 0x7fdf201529a0 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 >> v1:172.21.15.87:6789/0 conn(0x7fdf201529a0 legacy=0x7fdf200ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 0x7fdf080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf08003f60 0x7fdf08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf08005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20074730 con 0x7fdf08004d50 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20074a10 con 0x7fdf08003f60 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0800bb00 con 0x7fdf200c4720 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf08005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1e59c640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 0x7fdf080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1dd9b640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf08003f60 0x7fdf08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 -- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 msgr2=0x7fdf080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf200c4720 0x7fdf080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 -- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf08003f60 msgr2=0x7fdf08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf08003f60 0x7fdf08004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.404+0000 7fdf1ed9d640 1 -- 172.21.15.87:0/3333217859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf08003530 con 0x7fdf08004d50 2024-04-25T15:54:58.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf1ed9d640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf08005160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009f90 tx=0x7fdf1801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573a02bae62bdb20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf180b2070 con 0x7fdf08004d50 2024-04-25T15:54:58.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf180a5b60 con 0x7fdf08004d50 2024-04-25T15:54:58.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf1d59a640 1 -- 172.21.15.87:0/3333217859 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18009c10 con 0x7fdf08004d50 2024-04-25T15:54:58.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf24d7c640 1 -- 172.21.15.87:0/3333217859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 msgr2=0x7fdf08005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/3333217859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf08005160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009f90 tx=0x7fdf1801cc60 comp rx=0 tx=0).stop 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf1ed9d640 1 -- 172.21.15.87:0/3333217859 reap_dead start 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf24d7c640 1 -- 172.21.15.87:0/3333217859 shutdown_connections 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf24d7c640 1 -- 172.21.15.87:0/3333217859 >> 172.21.15.87:0/3333217859 conn(0x7fdf200c8770 msgr2=0x7fdf200c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf24d7c640 1 -- 172.21.15.87:0/3333217859 shutdown_connections 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.408+0000 7fdf24d7c640 1 -- 172.21.15.87:0/3333217859 wait complete. 2024-04-25T15:54:58.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 Processor -- start 2024-04-25T15:54:58.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- start start 2024-04-25T15:54:58.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf201ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf20154380 0x7fdf2014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf2014bc50 0x7fdf20154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200ae0a0 con 0x7fdf08004d50 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf200ab1a0 con 0x7fdf2014bc50 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf200ae220 con 0x7fdf20154380 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf201ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf201ecc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52794/0 (socket says 172.21.15.87:52794) 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 -- 172.21.15.87:0/2210013806 learned_addr learned my addr 172.21.15.87:0/2210013806 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1dd9b640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf20154380 0x7fdf2014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 -- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf20154380 msgr2=0x7fdf2014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1ed9d640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf2014bc50 0x7fdf20154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf20154380 0x7fdf2014b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 -- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf2014bc50 msgr2=0x7fdf20154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf2014bc50 0x7fdf20154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 -- 172.21.15.87:0/2210013806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf201e0580 con 0x7fdf08004d50 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf1e59c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf201ecc80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000fc0 tx=0x7fdf14011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14010040 con 0x7fdf08004d50 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1401a070 con 0x7fdf08004d50 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf201e0860 con 0x7fdf08004d50 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400fdb0 con 0x7fdf08004d50 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201e0e20 con 0x7fdf08004d50 2024-04-25T15:54:58.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.412+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf20069bb0 con 0x7fdf08004d50 2024-04-25T15:54:58.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.416+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf1401f460 con 0x7fdf08004d50 2024-04-25T15:54:58.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.416+0000 7fdf0effd640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf0006f400 0x7fdf00071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.416+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7fdf140932b0 con 0x7fdf08004d50 2024-04-25T15:54:58.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.416+0000 7fdf1dd9b640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf0006f400 0x7fdf00071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.416+0000 7fdf1dd9b640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf0006f400 0x7fdf00071910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf201e1b00 tx=0x7fdf10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.420+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf1405ffc0 con 0x7fdf08004d50 2024-04-25T15:54:58.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.576+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fdf200c8eb0 con 0x7fdf08004d50 2024-04-25T15:54:58.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.576+0000 7fdf0effd640 1 -- 172.21.15.87:0/2210013806 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7fdf1405f8c0 con 0x7fdf08004d50 2024-04-25T15:54:58.578 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T15:54:58.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf0006f400 msgr2=0x7fdf00071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf0006f400 0x7fdf00071910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdf201e1b00 tx=0x7fdf10008040 comp rx=0 tx=0).stop 2024-04-25T15:54:58.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 msgr2=0x7fdf201ecc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf201ecc80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000fc0 tx=0x7fdf14011d70 comp rx=0 tx=0).stop 2024-04-25T15:54:58.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 shutdown_connections 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf0006f400 0x7fdf00071910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf2014bc50 0x7fdf20154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf20154380 0x7fdf2014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 --2- 172.21.15.87:0/2210013806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf08004d50 0x7fdf201ecc80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 >> 172.21.15.87:0/2210013806 conn(0x7fdf200c8770 msgr2=0x7fdf200ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 shutdown_connections 2024-04-25T15:54:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.580+0000 7fdf24d7c640 1 -- 172.21.15.87:0/2210013806 wait complete. 2024-04-25T15:54:58.599 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T15:54:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 Processor -- start 2024-04-25T15:54:58.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 -- start start 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6520071e50 0x7f65200c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65200c4720 0x7f652015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6520072430 con 0x7f65201529a0 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6520074730 con 0x7f65200c4720 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.744+0000 7f6526438640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6520074a10 con 0x7f6520071e50 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f65249d5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65200c4720 0x7f652015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651ffff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f65201529a0 0x7f65200ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58948/0 (socket says 172.21.15.87:58948) 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651ffff640 1 -- 172.21.15.87:0/620053388 learned_addr learned my addr 172.21.15.87:0/620053388 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651f7fe640 1 --2- 172.21.15.87:0/620053388 >> v2:172.21.15.155:3300/0 conn(0x7f6520071e50 0x7f65200c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f65249d5640 1 -- 172.21.15.87:0/620053388 >> v2:172.21.15.155:3300/0 conn(0x7f6520071e50 msgr2=0x7f65200c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f65249d5640 1 --2- 172.21.15.87:0/620053388 >> v2:172.21.15.155:3300/0 conn(0x7f6520071e50 0x7f65200c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f65249d5640 1 -- 172.21.15.87:0/620053388 >> v1:172.21.15.87:6789/0 conn(0x7f65201529a0 legacy=0x7f65200ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651effd640 1 -- 172.21.15.87:0/620053388 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418182255 0 0) 0x7f6520072430 con 0x7f65201529a0 2024-04-25T15:54:58.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f65249d5640 1 -- 172.21.15.87:0/620053388 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6520074cf0 con 0x7f65200c4720 2024-04-25T15:54:58.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f65249d5640 1 --2- 172.21.15.87:0/620053388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f652015fad0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f65200ae690 tx=0x7f651801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9259730993bb7ee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651effd640 1 -- 172.21.15.87:0/620053388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180b2070 con 0x7f65200c4720 2024-04-25T15:54:58.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651effd640 1 -- 172.21.15.87:0/620053388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65180a5760 con 0x7f65200c4720 2024-04-25T15:54:58.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f651effd640 1 -- 172.21.15.87:0/620053388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180a5b30 con 0x7f65200c4720 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 -- 172.21.15.87:0/620053388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 msgr2=0x7f652015fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 --2- 172.21.15.87:0/620053388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f652015fad0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f65200ae690 tx=0x7f651801c8a0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 -- 172.21.15.87:0/620053388 shutdown_connections 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 --2- 172.21.15.87:0/620053388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f652015fad0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 --2- 172.21.15.87:0/620053388 >> v2:172.21.15.155:3300/0 conn(0x7f6520071e50 0x7f65200c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 -- 172.21.15.87:0/620053388 >> 172.21.15.87:0/620053388 conn(0x7f65200c8770 msgr2=0x7f65200c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:58.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 -- 172.21.15.87:0/620053388 shutdown_connections 2024-04-25T15:54:58.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.748+0000 7f6526438640 1 -- 172.21.15.87:0/620053388 wait complete. 2024-04-25T15:54:58.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 Processor -- start 2024-04-25T15:54:58.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 -- start start 2024-04-25T15:54:58.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6520071e50 0x7f652014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f65201f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65201529a0 0x7f65200c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65201629b0 con 0x7f65200c4720 2024-04-25T15:54:58.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6520162830 con 0x7f65201529a0 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6520162b30 con 0x7f6520071e50 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f65201f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f65201f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52806/0 (socket says 172.21.15.87:52806) 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 -- 172.21.15.87:0/2578066355 learned_addr learned my addr 172.21.15.87:0/2578066355 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f65249d5640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65201529a0 0x7f65200c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651ffff640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6520071e50 0x7f652014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 -- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6520071e50 msgr2=0x7f652014bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6520071e50 0x7f652014bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 -- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65201529a0 msgr2=0x7f65200c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65201529a0 0x7f65200c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 -- 172.21.15.87:0/2578066355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65201ee100 con 0x7f65200c4720 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651f7fe640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f65201f1f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f651400d5d0 tx=0x7f651400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140125f0 con 0x7f65200c4720 2024-04-25T15:54:58.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6514019070 con 0x7f65200c4720 2024-04-25T15:54:58.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65200aae10 con 0x7f65200c4720 2024-04-25T15:54:58.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140129b0 con 0x7f65200c4720 2024-04-25T15:54:58.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.752+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65201f19f0 con 0x7f65200c4720 2024-04-25T15:54:58.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.756+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6520069bb0 con 0x7f65200c4720 2024-04-25T15:54:58.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.756+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6514012b50 con 0x7f65200c4720 2024-04-25T15:54:58.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.756+0000 7f651cff9640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f650c06f400 0x7f650c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:58.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.756+0000 7f651ffff640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f650c06f400 0x7f650c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:58.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.756+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f651408f950 con 0x7f65200c4720 2024-04-25T15:54:58.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.756+0000 7f651ffff640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f650c06f400 0x7f650c071910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6510000f70 tx=0x7f6510009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:58.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.760+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f651405c580 con 0x7f65200c4720 2024-04-25T15:54:58.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.924+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f65200c3760 con 0x7f65200c4720 2024-04-25T15:54:58.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.924+0000 7f651cff9640 1 -- 172.21.15.87:0/2578066355 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f651405be80 con 0x7f65200c4720 2024-04-25T15:54:58.928 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T15:54:58.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f650c06f400 msgr2=0x7f650c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f650c06f400 0x7f650c071910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6510000f70 tx=0x7f6510009040 comp rx=0 tx=0).stop 2024-04-25T15:54:58.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 msgr2=0x7f65201f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:58.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f65201f1f10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f651400d5d0 tx=0x7f651400da90 comp rx=0 tx=0).stop 2024-04-25T15:54:58.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 shutdown_connections 2024-04-25T15:54:58.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f650c06f400 0x7f650c071910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65201529a0 0x7f65200c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65200c4720 0x7f65201f1f10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 --2- 172.21.15.87:0/2578066355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6520071e50 0x7f652014bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:58.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 >> 172.21.15.87:0/2578066355 conn(0x7f65200c8770 msgr2=0x7f652014d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:58.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 shutdown_connections 2024-04-25T15:54:58.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:58.928+0000 7f6526438640 1 -- 172.21.15.87:0/2578066355 wait complete. 2024-04-25T15:54:58.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:54:59.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 Processor -- start 2024-04-25T15:54:59.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 -- start start 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2e01529a0 0x7fc2e0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2e00ad990 0x7fc2e00adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e00c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e0072430 con 0x7fc2e00ad990 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e0074730 con 0x7fc2e01529a0 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.092+0000 7fc2e726b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e0074a10 con 0x7fc2e00c41e0 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2e00ad990 0x7fc2e00adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2e00ad990 0x7fc2e00adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52810/0 (socket says 172.21.15.87:52810) 2024-04-25T15:54:59.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 -- 172.21.15.87:0/2722228063 learned_addr learned my addr 172.21.15.87:0/2722228063 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e5007640 1 --2- 172.21.15.87:0/2722228063 >> v2:172.21.15.155:3300/0 conn(0x7fc2e01529a0 0x7fc2e0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e5808640 1 --2- 172.21.15.87:0/2722228063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e00c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 -- 172.21.15.87:0/2722228063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 msgr2=0x7fc2e00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 --2- 172.21.15.87:0/2722228063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e00c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 -- 172.21.15.87:0/2722228063 >> v2:172.21.15.155:3300/0 conn(0x7fc2e01529a0 msgr2=0x7fc2e0071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 --2- 172.21.15.87:0/2722228063 >> v2:172.21.15.155:3300/0 conn(0x7fc2e01529a0 0x7fc2e0071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 -- 172.21.15.87:0/2722228063 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e0074cf0 con 0x7fc2e00ad990 2024-04-25T15:54:59.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e4806640 1 --2- 172.21.15.87:0/2722228063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e00adda0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00ae520 tx=0x7fc2dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ad12f9f2bf2e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:59.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2d7fff640 1 -- 172.21.15.87:0/2722228063 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0b0070 con 0x7fc2e00ad990 2024-04-25T15:54:59.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2d7fff640 1 -- 172.21.15.87:0/2722228063 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0ab600 con 0x7fc2e00ad990 2024-04-25T15:54:59.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2d7fff640 1 -- 172.21.15.87:0/2722228063 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0ab9d0 con 0x7fc2e00ad990 2024-04-25T15:54:59.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 -- 172.21.15.87:0/2722228063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 msgr2=0x7fc2e00adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2722228063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e00adda0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00ae520 tx=0x7fc2dc01c490 comp rx=0 tx=0).stop 2024-04-25T15:54:59.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 -- 172.21.15.87:0/2722228063 shutdown_connections 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2722228063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e00c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2722228063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e00adda0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2722228063 >> v2:172.21.15.155:3300/0 conn(0x7fc2e01529a0 0x7fc2e0071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 -- 172.21.15.87:0/2722228063 >> 172.21.15.87:0/2722228063 conn(0x7fc2e00c8770 msgr2=0x7fc2e00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 -- 172.21.15.87:0/2722228063 shutdown_connections 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.096+0000 7fc2e726b640 1 -- 172.21.15.87:0/2722228063 wait complete. 2024-04-25T15:54:59.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 Processor -- start 2024-04-25T15:54:59.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 -- start start 2024-04-25T15:54:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e01529a0 0x7fc2e0144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e0159340 con 0x7fc2e00ad990 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01591c0 con 0x7fc2e01529a0 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e01594c0 con 0x7fc2e00c41e0 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e014e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52824/0 (socket says 172.21.15.87:52824) 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 -- 172.21.15.87:0/2730845924 learned_addr learned my addr 172.21.15.87:0/2730845924 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5808640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e01529a0 0x7fc2e0144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e4806640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 -- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 msgr2=0x7fc2e0156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e0156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 -- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e01529a0 msgr2=0x7fc2e0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e01529a0 0x7fc2e0144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 -- 172.21.15.87:0/2730845924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e00c7990 con 0x7fc2e00ad990 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e5007640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e014e000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000d600 tx=0x7fc2d000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0004240 con 0x7fc2e00ad990 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d00043e0 con 0x7fc2e00ad990 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e00c7c70 con 0x7fc2e00ad990 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0003840 con 0x7fc2e00ad990 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.100+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e00c8230 con 0x7fc2e00ad990 2024-04-25T15:54:59.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.104+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e0069bb0 con 0x7fc2e00ad990 2024-04-25T15:54:59.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.104+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc2d00039e0 con 0x7fc2e00ad990 2024-04-25T15:54:59.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.104+0000 7fc2d5ffb640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2c406f430 0x7fc2c4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.104+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7fc2d008f7c0 con 0x7fc2e00ad990 2024-04-25T15:54:59.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.104+0000 7fc2e4806640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2c406f430 0x7fc2c4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.104+0000 7fc2e4806640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2c406f430 0x7fc2c4071940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0ad000 tx=0x7fc2dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:59.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.108+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2d005c360 con 0x7fc2e00ad990 2024-04-25T15:54:59.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.296+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2e00c3760 con 0x7fc2e00ad990 2024-04-25T15:54:59.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2d5ffb640 1 -- 172.21.15.87:0/2730845924 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7fc2d005bc60 con 0x7fc2e00ad990 2024-04-25T15:54:59.301 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:59.301 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:54:59.301 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2c406f430 msgr2=0x7fc2c4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2c406f430 0x7fc2c4071940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0ad000 tx=0x7fc2dc008040 comp rx=0 tx=0).stop 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 msgr2=0x7fc2e014e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e014e000 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000d600 tx=0x7fc2d000dac0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 shutdown_connections 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2c406f430 0x7fc2c4071940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e01529a0 0x7fc2e0144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e00c41e0 0x7fc2e0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 --2- 172.21.15.87:0/2730845924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2e00ad990 0x7fc2e014e000 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 >> 172.21.15.87:0/2730845924 conn(0x7fc2e00c8770 msgr2=0x7fc2e0154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:59.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 shutdown_connections 2024-04-25T15:54:59.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.300+0000 7fc2e726b640 1 -- 172.21.15.87:0/2730845924 wait complete. 2024-04-25T15:54:59.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:54:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 Processor -- start 2024-04-25T15:54:59.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 -- start start 2024-04-25T15:54:59.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef0157ea0 0x7f1ef006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ef006cbb0 0x7f1ef015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ef015b0f0 0x7f1ef015b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef00c4250 con 0x7f1ef015b0f0 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef00c4810 con 0x7f1ef006cbb0 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef843d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef00c4bd0 con 0x7f1ef0157ea0 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ef015b0f0 0x7f1ef015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ef015b0f0 0x7f1ef015b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52830/0 (socket says 172.21.15.87:52830) 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 -- 172.21.15.87:0/3363465630 learned_addr learned my addr 172.21.15.87:0/3363465630 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef59d8640 1 --2- 172.21.15.87:0/3363465630 >> v2:172.21.15.155:3300/0 conn(0x7f1ef006cbb0 0x7f1ef015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef61d9640 1 --2- 172.21.15.87:0/3363465630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef0157ea0 0x7f1ef006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 -- 172.21.15.87:0/3363465630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef0157ea0 msgr2=0x7f1ef006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 --2- 172.21.15.87:0/3363465630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef0157ea0 0x7f1ef006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 -- 172.21.15.87:0/3363465630 >> v2:172.21.15.155:3300/0 conn(0x7f1ef006cbb0 msgr2=0x7f1ef015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 --2- 172.21.15.87:0/3363465630 >> v2:172.21.15.155:3300/0 conn(0x7f1ef006cbb0 0x7f1ef015abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.456+0000 7f1ef69da640 1 -- 172.21.15.87:0/3363465630 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00c4eb0 con 0x7f1ef015b0f0 2024-04-25T15:54:59.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef69da640 1 --2- 172.21.15.87:0/3363465630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015b500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00ca6b0 tx=0x7f1ee001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d8576bcd45f5cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:59.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef51d7640 1 -- 172.21.15.87:0/3363465630 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee00b0070 con 0x7f1ef015b0f0 2024-04-25T15:54:59.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef51d7640 1 -- 172.21.15.87:0/3363465630 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee0004230 con 0x7f1ef015b0f0 2024-04-25T15:54:59.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef51d7640 1 -- 172.21.15.87:0/3363465630 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0003620 con 0x7f1ef015b0f0 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 -- 172.21.15.87:0/3363465630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef015b0f0 msgr2=0x7f1ef015b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 --2- 172.21.15.87:0/3363465630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015b500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00ca6b0 tx=0x7f1ee001c400 comp rx=0 tx=0).stop 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 -- 172.21.15.87:0/3363465630 shutdown_connections 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 --2- 172.21.15.87:0/3363465630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015b500 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 --2- 172.21.15.87:0/3363465630 >> v2:172.21.15.155:3300/0 conn(0x7f1ef006cbb0 0x7f1ef015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 --2- 172.21.15.87:0/3363465630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef0157ea0 0x7f1ef006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 -- 172.21.15.87:0/3363465630 >> 172.21.15.87:0/3363465630 conn(0x7f1ef006d780 msgr2=0x7f1ef006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 -- 172.21.15.87:0/3363465630 shutdown_connections 2024-04-25T15:54:59.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 -- 172.21.15.87:0/3363465630 wait complete. 2024-04-25T15:54:59.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.460+0000 7f1ef843d640 1 Processor -- start 2024-04-25T15:54:59.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- start start 2024-04-25T15:54:59.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef006cbb0 0x7f1ef0158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 0x7f1ef0155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef00c9de0 con 0x7f1ef0157ea0 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef00c9f60 con 0x7f1ef015b0f0 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef00ca0e0 con 0x7f1ef006cbb0 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 0x7f1ef0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 0x7f1ef0155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52838/0 (socket says 172.21.15.87:52838) 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 -- 172.21.15.87:0/2073270277 learned_addr learned my addr 172.21.15.87:0/2073270277 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef69da640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef61d9640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef006cbb0 0x7f1ef0158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 -- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef006cbb0 msgr2=0x7f1ef0158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef006cbb0 0x7f1ef0158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 -- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ef015b0f0 msgr2=0x7f1ef015f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 -- 172.21.15.87:0/2073270277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef015cfe0 con 0x7f1ef0157ea0 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef59d8640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 0x7f1ef0155290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007d60 tx=0x7f1ee400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4014420 con 0x7f1ef0157ea0 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee4019070 con 0x7f1ef0157ea0 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40147e0 con 0x7f1ef0157ea0 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef015bf40 con 0x7f1ef0157ea0 2024-04-25T15:54:59.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef015c220 con 0x7f1ef0157ea0 2024-04-25T15:54:59.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef0069bb0 con 0x7f1ef0157ea0 2024-04-25T15:54:59.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.464+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1ee4014980 con 0x7f1ef0157ea0 2024-04-25T15:54:59.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.468+0000 7f1eeeffd640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1edc06f400 0x7f1edc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:54:59.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.468+0000 7f1ef61d9640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1edc06f400 0x7f1edc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:54:59.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.468+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f1ee408fd60 con 0x7f1ef0157ea0 2024-04-25T15:54:59.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.468+0000 7f1ef61d9640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1edc06f400 0x7f1edc071910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0072780 tx=0x7f1ee8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:54:59.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.472+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ee4014c70 con 0x7f1ef0157ea0 2024-04-25T15:54:59.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.632+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ef00c35a0 con 0x7f1ef0157ea0 2024-04-25T15:54:59.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.632+0000 7f1eeeffd640 1 -- 172.21.15.87:0/2073270277 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20684 (secure 0 0 0) 0x7f1ee405c990 con 0x7f1ef0157ea0 2024-04-25T15:54:59.636 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:54:59.636 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T15:54:50.184879+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:54:59.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1edc06f400 msgr2=0x7f1edc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1edc06f400 0x7f1edc071910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0072780 tx=0x7f1ee8008040 comp rx=0 tx=0).stop 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 msgr2=0x7f1ef0155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 0x7f1ef0155290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4007d60 tx=0x7f1ee400e4b0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 shutdown_connections 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1edc06f400 0x7f1edc071910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ef015b0f0 0x7f1ef015f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ef0157ea0 0x7f1ef0155290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 --2- 172.21.15.87:0/2073270277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef006cbb0 0x7f1ef0158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 >> 172.21.15.87:0/2073270277 conn(0x7f1ef006d780 msgr2=0x7f1ef006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 shutdown_connections 2024-04-25T15:54:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:54:59.636+0000 7f1ef843d640 1 -- 172.21.15.87:0/2073270277 wait complete. 2024-04-25T15:54:59.656 DEBUG:tasks.mds_thrash:Yielding 2024-04-25T15:54:59.657 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T15:54:59.669 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:54:59.669 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T15:54:59.669 INFO:tasks.workunit:timeout=6h 2024-04-25T15:54:59.669 INFO:tasks.workunit:cleanup=True 2024-04-25T15:54:59.670 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:59.670 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2024-04-25T15:54:59.670 INFO:tasks.mds_thrash.fs.[b]:waiting for 17 secs before thrashing 2024-04-25T15:54:59.676 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:59.676 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T15:54:59.676 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-25T15:54:59.676 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:54:59.676 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T15:54:59.676 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-25 15:54:10.221666102 +0000 2024-04-25T15:54:59.677 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-25 15:54:48.434556665 +0000 2024-04-25T15:54:59.677 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-04-25T15:54:59.677 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T15:54:59.677 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T15:54:59.741 DEBUG:teuthology.orchestra.run.smithi155:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:59.749 INFO:teuthology.orchestra.run.smithi155.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:54:20.424509474 +0000 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:54:48.496304894 +0000 2024-04-25T15:54:59.750 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2024-04-25T15:54:59.750 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-25T15:54:59.750 DEBUG:teuthology.orchestra.run.smithi155:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-25T15:54:59.812 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:54:59.813 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:54:59.819 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T15:54:59.862 INFO:tasks.workunit.client.1.smithi155.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-25T15:55:00.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:01.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9448db1640 1 Processor -- start 2024-04-25T15:55:01.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9448db1640 1 -- start start 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9448db1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 0x7f944415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9448db1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9444154fc0 con 0x7f94440ad160 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9448db1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94440acb20 con 0x7f94441518b0 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9448db1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f944406ed60 con 0x7f94440ac1c0 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9441d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f94440ad160 0x7f94440c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36180/0 (socket says 172.21.15.87:36180) 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9441d9b640 1 -- 172.21.15.87:0/3192312069 learned_addr learned my addr 172.21.15.87:0/3192312069 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9442d9d640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 0x7f944415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412944191 0 0) 0x7f9444154fc0 con 0x7f94440ad160 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f942c003530 con 0x7f94440ad160 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 85597250 0 0) 0x7f942c003530 con 0x7f94440ad160 2024-04-25T15:55:01.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 msgr2=0x7f944415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 0x7f944415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 >> v1:172.21.15.155:6789/0 conn(0x7f94441518b0 legacy=0x7f944406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440ace00 con 0x7f94440ad160 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f9438001680 con 0x7f94440ad160 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 >> v1:172.21.15.87:6789/0 conn(0x7f94440ad160 legacy=0x7f94440c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 0x7f942c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c003f70 0x7f942c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c004d50 0x7f942c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f944406ed60 con 0x7f942c004d50 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f942c00bb60 con 0x7f942c003f70 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f942c00bd60 con 0x7f94440ac1c0 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f9442d9d640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c004d50 0x7f942c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.088+0000 7f944259c640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 0x7f942c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 -- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 msgr2=0x7f942c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:01.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94440ac1c0 0x7f942c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 -- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c003f70 msgr2=0x7f942c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:01.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9441d9b640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c003f70 0x7f942c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f942c003f70 0x7f942c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 -- 172.21.15.87:0/3192312069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c003530 con 0x7f942c004d50 2024-04-25T15:55:01.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c004d50 0x7f942c005160 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94440ae910 tx=0x7f943c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707833d80548400c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:01.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0b2070 con 0x7f942c004d50 2024-04-25T15:55:01.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c0a5c50 con 0x7f942c004d50 2024-04-25T15:55:01.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f944159a640 1 -- 172.21.15.87:0/3192312069 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c009c10 con 0x7f942c004d50 2024-04-25T15:55:01.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9448db1640 1 -- 172.21.15.87:0/3192312069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c004d50 msgr2=0x7f942c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9448db1640 1 --2- 172.21.15.87:0/3192312069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c004d50 0x7f942c005160 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94440ae910 tx=0x7f943c01cc40 comp rx=0 tx=0).stop 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9442d9d640 1 -- 172.21.15.87:0/3192312069 reap_dead start 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9448db1640 1 -- 172.21.15.87:0/3192312069 shutdown_connections 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9448db1640 1 -- 172.21.15.87:0/3192312069 >> 172.21.15.87:0/3192312069 conn(0x7f94440c8770 msgr2=0x7f94440c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9448db1640 1 -- 172.21.15.87:0/3192312069 shutdown_connections 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.092+0000 7f9448db1640 1 -- 172.21.15.87:0/3192312069 wait complete. 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 Processor -- start 2024-04-25T15:55:01.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- start start 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9444140990 0x7f94440c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 0x7f94440aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94441ee2a0 0x7f94441ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f944406fd60 con 0x7f94440a9fa0 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f944406fbe0 con 0x7f9444140990 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94440c47f0 con 0x7f94441ee2a0 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 0x7f94440aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 0x7f94440aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49090/0 (socket says 172.21.15.87:49090) 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 -- 172.21.15.87:0/2431337181 learned_addr learned my addr 172.21.15.87:0/2431337181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9442d9d640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94441ee2a0 0x7f94441ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f944259c640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9444140990 0x7f94440c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 -- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94441ee2a0 msgr2=0x7f94441ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94441ee2a0 0x7f94441ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 -- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9444140990 msgr2=0x7f94440c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9444140990 0x7f94440c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 -- 172.21.15.87:0/2431337181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9444142ff0 con 0x7f94440a9fa0 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9441d9b640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 0x7f94440aa3b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9438000fc0 tx=0x7f943800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438019070 con 0x7f94440a9fa0 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9438004ce0 con 0x7f94440a9fa0 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9444142750 con 0x7f94440a9fa0 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438007310 con 0x7f94440a9fa0 2024-04-25T15:55:01.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9444142d10 con 0x7f94440a9fa0 2024-04-25T15:55:01.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.096+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444069bb0 con 0x7f94440a9fa0 2024-04-25T15:55:01.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.100+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f943801c070 con 0x7f94440a9fa0 2024-04-25T15:55:01.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.100+0000 7f9432ffd640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942406f400 0x7f9424071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.100+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f943808f130 con 0x7f94440a9fa0 2024-04-25T15:55:01.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.100+0000 7f944259c640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942406f400 0x7f9424071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.100+0000 7f944259c640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942406f400 0x7f9424071910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f94440c25a0 tx=0x7f9434009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:01.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.104+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f943805bcd0 con 0x7f94440a9fa0 2024-04-25T15:55:01.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.300+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9444158260 con 0x7f94440a9fa0 2024-04-25T15:55:01.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.300+0000 7f9432ffd640 1 -- 172.21.15.87:0/2431337181 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f943805b5d0 con 0x7f94440a9fa0 2024-04-25T15:55:01.302 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:01.302 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:01.303 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.300+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942406f400 msgr2=0x7f9424071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.300+0000 7f9448db1640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942406f400 0x7f9424071910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f94440c25a0 tx=0x7f9434009040 comp rx=0 tx=0).stop 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.300+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 msgr2=0x7f94440aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 0x7f94440aa3b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9438000fc0 tx=0x7f943800df70 comp rx=0 tx=0).stop 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 shutdown_connections 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942406f400 0x7f9424071910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94441ee2a0 0x7f94441ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94440a9fa0 0x7f94440aa3b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 --2- 172.21.15.87:0/2431337181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9444140990 0x7f94440c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 >> 172.21.15.87:0/2431337181 conn(0x7f94440c8770 msgr2=0x7f94440c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:01.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 shutdown_connections 2024-04-25T15:55:01.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.304+0000 7f9448db1640 1 -- 172.21.15.87:0/2431337181 wait complete. 2024-04-25T15:55:01.322 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2024-04-25T15:55:01.323 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:55:01.323 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:55:01.335 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:55:01.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:01.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 Processor -- start 2024-04-25T15:55:01.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 -- start start 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2481529a0 0x7fa248071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa2480ad990 0x7fa2480adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa248072430 con 0x7fa2480c41e0 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa248074730 con 0x7fa2481529a0 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa24e082640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa248074a10 con 0x7fa2480ad990 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2481529a0 0x7fa248071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2481529a0 0x7fa248071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49106/0 (socket says 172.21.15.87:49106) 2024-04-25T15:55:01.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 -- 172.21.15.87:0/2288117667 learned_addr learned my addr 172.21.15.87:0/2288117667 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa23ffff640 1 --2- 172.21.15.87:0/2288117667 >> v2:172.21.15.155:3300/0 conn(0x7fa2480ad990 0x7fa2480adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 -- 172.21.15.87:0/2288117667 >> v2:172.21.15.155:3300/0 conn(0x7fa2480ad990 msgr2=0x7fa2480adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 --2- 172.21.15.87:0/2288117667 >> v2:172.21.15.155:3300/0 conn(0x7fa2480ad990 0x7fa2480adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 -- 172.21.15.87:0/2288117667 >> v1:172.21.15.155:6789/0 conn(0x7fa2480c41e0 legacy=0x7fa2480c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa2477fe640 1 -- 172.21.15.87:0/2288117667 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa248074cf0 con 0x7fa2481529a0 2024-04-25T15:55:01.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.520+0000 7fa23ffff640 1 --2- 172.21.15.87:0/2288117667 >> v2:172.21.15.155:3300/0 conn(0x7fa2480ad990 0x7fa2480adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:01.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa2477fe640 1 --2- 172.21.15.87:0/2288117667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2481529a0 0x7fa248071e50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2480ae690 tx=0x7fa23801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a84191663077982 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:01.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa246ffd640 1 -- 172.21.15.87:0/2288117667 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2380b0070 con 0x7fa2481529a0 2024-04-25T15:55:01.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa246ffd640 1 -- 172.21.15.87:0/2288117667 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2380ab600 con 0x7fa2481529a0 2024-04-25T15:55:01.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa246ffd640 1 -- 172.21.15.87:0/2288117667 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2380ab9d0 con 0x7fa2481529a0 2024-04-25T15:55:01.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 -- 172.21.15.87:0/2288117667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2481529a0 msgr2=0x7fa248071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 --2- 172.21.15.87:0/2288117667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2481529a0 0x7fa248071e50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2480ae690 tx=0x7fa23801c450 comp rx=0 tx=0).stop 2024-04-25T15:55:01.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 -- 172.21.15.87:0/2288117667 shutdown_connections 2024-04-25T15:55:01.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 --2- 172.21.15.87:0/2288117667 >> v2:172.21.15.155:3300/0 conn(0x7fa2480ad990 0x7fa2480adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 --2- 172.21.15.87:0/2288117667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2481529a0 0x7fa248071e50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 -- 172.21.15.87:0/2288117667 >> 172.21.15.87:0/2288117667 conn(0x7fa2480c8770 msgr2=0x7fa2480c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:01.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 -- 172.21.15.87:0/2288117667 shutdown_connections 2024-04-25T15:55:01.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.524+0000 7fa24e082640 1 -- 172.21.15.87:0/2288117667 wait complete. 2024-04-25T15:55:01.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 Processor -- start 2024-04-25T15:55:01.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 -- start start 2024-04-25T15:55:01.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2480ad990 0x7fa2481f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 0x7fa24815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2481529a0 0x7fa248149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa248162470 con 0x7fa2480c41e0 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481622f0 con 0x7fa2480ad990 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2481625f0 con 0x7fa2481529a0 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 0x7fa24815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 0x7fa24815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49114/0 (socket says 172.21.15.87:49114) 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 -- 172.21.15.87:0/891652903 learned_addr learned my addr 172.21.15.87:0/891652903 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa2477fe640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2480ad990 0x7fa2481f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa247fff640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2481529a0 0x7fa248149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 -- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2481529a0 msgr2=0x7fa248149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2481529a0 0x7fa248149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 -- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2480ad990 msgr2=0x7fa2481f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2480ad990 0x7fa2481f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 -- 172.21.15.87:0/891652903 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2481f40c0 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa247fff640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2481529a0 0x7fa248149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa23ffff640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 0x7fa24815e080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa23000c7f0 tx=0x7fa23000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230015070 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230007820 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2480ad6f0 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230007c30 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.528+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa248144c90 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.532+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248069bb0 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.532+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa230018070 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.532+0000 7fa244ff9640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa22806f430 0x7fa228071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.532+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7fa23008f4c0 con 0x7fa2480c41e0 2024-04-25T15:55:01.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.532+0000 7fa2477fe640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa22806f430 0x7fa228071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:01.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.532+0000 7fa2477fe640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa22806f430 0x7fa228071940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa2380ad000 tx=0x7fa2380a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:01.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.536+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa23005c060 con 0x7fa2480c41e0 2024-04-25T15:55:01.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2480ad110 con 0x7fa2480c41e0 2024-04-25T15:55:01.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa244ff9640 1 -- 172.21.15.87:0/891652903 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7fa23005b960 con 0x7fa2480c41e0 2024-04-25T15:55:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:01.722 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:01.722 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa22806f430 msgr2=0x7fa228071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa22806f430 0x7fa228071940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa2380ad000 tx=0x7fa2380a6000 comp rx=0 tx=0).stop 2024-04-25T15:55:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 msgr2=0x7fa24815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 0x7fa24815e080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa23000c7f0 tx=0x7fa23000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 shutdown_connections 2024-04-25T15:55:01.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa22806f430 0x7fa228071940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2481529a0 0x7fa248149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2480c41e0 0x7fa24815e080 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 --2- 172.21.15.87:0/891652903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2480ad990 0x7fa2481f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 >> 172.21.15.87:0/891652903 conn(0x7fa2480c8770 msgr2=0x7fa248153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 shutdown_connections 2024-04-25T15:55:01.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:01.720+0000 7fa24e082640 1 -- 172.21.15.87:0/891652903 wait complete. 2024-04-25T15:55:01.743 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:55:03.744 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:03.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 Processor -- start 2024-04-25T15:55:03.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 -- start start 2024-04-25T15:55:03.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60ac158a00 0x7f60ac0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60ac158e10 0x7f60ac152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac0adfb0 0x7f60ac152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac0c5470 con 0x7f60ac158a00 2024-04-25T15:55:03.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac063660 con 0x7f60ac158e10 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b401c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac0ab670 con 0x7f60ac0adfb0 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60ac158a00 0x7f60ac0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60ac158a00 0x7f60ac0ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49126/0 (socket says 172.21.15.87:49126) 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 -- 172.21.15.87:0/2842749170 learned_addr learned my addr 172.21.15.87:0/2842749170 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b15b7640 1 --2- 172.21.15.87:0/2842749170 >> v2:172.21.15.155:3300/0 conn(0x7f60ac158e10 0x7f60ac152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b25b9640 1 --2- 172.21.15.87:0/2842749170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac0adfb0 0x7f60ac152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 -- 172.21.15.87:0/2842749170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac0adfb0 msgr2=0x7f60ac152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2842749170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac0adfb0 0x7f60ac152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 -- 172.21.15.87:0/2842749170 >> v2:172.21.15.155:3300/0 conn(0x7f60ac158e10 msgr2=0x7f60ac152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2842749170 >> v2:172.21.15.155:3300/0 conn(0x7f60ac158e10 0x7f60ac152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b1db8640 1 -- 172.21.15.87:0/2842749170 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac0ab930 con 0x7f60ac158a00 2024-04-25T15:55:03.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.899+0000 7f60b15b7640 1 --2- 172.21.15.87:0/2842749170 >> v2:172.21.15.155:3300/0 conn(0x7f60ac158e10 0x7f60ac152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:03.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2842749170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac0ada70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f60ac071f70 tx=0x7f60a801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4a60b85101d356 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:03.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b0db6640 1 -- 172.21.15.87:0/2842749170 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a7070 con 0x7f60ac158a00 2024-04-25T15:55:03.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b0db6640 1 -- 172.21.15.87:0/2842749170 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a80b0070 con 0x7f60ac158a00 2024-04-25T15:55:03.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b0db6640 1 -- 172.21.15.87:0/2842749170 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a80ab890 con 0x7f60ac158a00 2024-04-25T15:55:03.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 -- 172.21.15.87:0/2842749170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 msgr2=0x7f60ac0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:03.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 --2- 172.21.15.87:0/2842749170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac0ada70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f60ac071f70 tx=0x7f60a801c4f0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 -- 172.21.15.87:0/2842749170 shutdown_connections 2024-04-25T15:55:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 --2- 172.21.15.87:0/2842749170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac0adfb0 0x7f60ac152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 --2- 172.21.15.87:0/2842749170 >> v2:172.21.15.155:3300/0 conn(0x7f60ac158e10 0x7f60ac152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 --2- 172.21.15.87:0/2842749170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac0ada70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 -- 172.21.15.87:0/2842749170 >> 172.21.15.87:0/2842749170 conn(0x7f60ac06d650 msgr2=0x7f60ac0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 -- 172.21.15.87:0/2842749170 shutdown_connections 2024-04-25T15:55:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.903+0000 7f60b401c640 1 -- 172.21.15.87:0/2842749170 wait complete. 2024-04-25T15:55:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 Processor -- start 2024-04-25T15:55:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 -- start start 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60ac0adfb0 0x7f60ac152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac1efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac158e10 0x7f60ac15df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac0af0f0 con 0x7f60ac158a00 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac0aef70 con 0x7f60ac0adfb0 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac0749b0 con 0x7f60ac158e10 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac1efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac1efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49132/0 (socket says 172.21.15.87:49132) 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 -- 172.21.15.87:0/2016570426 learned_addr learned my addr 172.21.15.87:0/2016570426 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60ac0adfb0 0x7f60ac152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b25b9640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac158e10 0x7f60ac15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 -- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac158e10 msgr2=0x7f60ac15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:03.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac158e10 0x7f60ac15df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 -- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60ac0adfb0 msgr2=0x7f60ac152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60ac0adfb0 0x7f60ac152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 -- 172.21.15.87:0/2016570426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac0acd00 con 0x7f60ac158a00 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60ac0adfb0 0x7f60ac152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b25b9640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac158e10 0x7f60ac15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b15b7640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac1efdd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c820 tx=0x7f609c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c015070 con 0x7f60ac158a00 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c007a30 con 0x7f60ac158a00 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c007e00 con 0x7f60ac158a00 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac149860 con 0x7f60ac158a00 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.907+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac14b320 con 0x7f60ac158a00 2024-04-25T15:55:03.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.911+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac069bb0 con 0x7f60ac158a00 2024-04-25T15:55:03.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.911+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f609c018070 con 0x7f60ac158a00 2024-04-25T15:55:03.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.911+0000 7f60a27fc640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f609006f400 0x7f6090071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:03.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.911+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f609c08f560 con 0x7f60ac158a00 2024-04-25T15:55:03.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.911+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f609006f400 0x7f6090071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:03.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.911+0000 7f60b1db8640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f609006f400 0x7f6090071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f60a80af000 tx=0x7f60a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:03.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:03.915+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f609c05c190 con 0x7f60ac158a00 2024-04-25T15:55:04.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.095+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60ac1550a0 con 0x7f60ac158a00 2024-04-25T15:55:04.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60a27fc640 1 -- 172.21.15.87:0/2016570426 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f609c05ba90 con 0x7f60ac158a00 2024-04-25T15:55:04.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:04.101 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:04.101 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f609006f400 msgr2=0x7f6090071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f609006f400 0x7f6090071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f60a80af000 tx=0x7f60a8008040 comp rx=0 tx=0).stop 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 msgr2=0x7f60ac1efdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac1efdd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c820 tx=0x7f609c00cce0 comp rx=0 tx=0).stop 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 shutdown_connections 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f609006f400 0x7f6090071910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60ac158e10 0x7f60ac15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:04.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac158a00 0x7f60ac1efdd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:04.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 --2- 172.21.15.87:0/2016570426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60ac0adfb0 0x7f60ac152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:04.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 >> 172.21.15.87:0/2016570426 conn(0x7f60ac06d650 msgr2=0x7f60ac15f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:04.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 shutdown_connections 2024-04-25T15:55:04.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:04.099+0000 7f60b401c640 1 -- 172.21.15.87:0/2016570426 wait complete. 2024-04-25T15:55:04.122 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:55:06.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:06.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 Processor -- start 2024-04-25T15:55:06.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 -- start start 2024-04-25T15:55:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2d41518b0 0x7fc2d406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2d40ad160 0x7fc2d40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d4154fc0 con 0x7fc2d40c4620 2024-04-25T15:55:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d406ed60 con 0x7fc2d40ad160 2024-04-25T15:55:06.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d9b64640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d40acb20 con 0x7fc2d41518b0 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2d40ad160 0x7fc2d40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2d40ad160 0x7fc2d40c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49138/0 (socket says 172.21.15.87:49138) 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 -- 172.21.15.87:0/86208944 learned_addr learned my addr 172.21.15.87:0/86208944 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2d37fe640 1 --2- 172.21.15.87:0/86208944 >> v2:172.21.15.155:3300/0 conn(0x7fc2d41518b0 0x7fc2d406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 -- 172.21.15.87:0/86208944 >> v2:172.21.15.155:3300/0 conn(0x7fc2d41518b0 msgr2=0x7fc2d406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 --2- 172.21.15.87:0/86208944 >> v2:172.21.15.155:3300/0 conn(0x7fc2d41518b0 0x7fc2d406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 -- 172.21.15.87:0/86208944 >> v1:172.21.15.155:6789/0 conn(0x7fc2d40c4620 legacy=0x7fc2d4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:06.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.283+0000 7fc2caffd640 1 -- 172.21.15.87:0/86208944 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d40ace00 con 0x7fc2d40ad160 2024-04-25T15:55:06.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2caffd640 1 --2- 172.21.15.87:0/86208944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d40ad160 0x7fc2d40c40e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40c4c70 tx=0x7fc2bc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9739ffd5e4b0dc86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:06.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d2ffd640 1 -- 172.21.15.87:0/86208944 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0aa660 con 0x7fc2d40ad160 2024-04-25T15:55:06.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d2ffd640 1 -- 172.21.15.87:0/86208944 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0af070 con 0x7fc2d40ad160 2024-04-25T15:55:06.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d2ffd640 1 -- 172.21.15.87:0/86208944 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0aaa20 con 0x7fc2d40ad160 2024-04-25T15:55:06.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 -- 172.21.15.87:0/86208944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d40ad160 msgr2=0x7fc2d40c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:06.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/86208944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d40ad160 0x7fc2d40c40e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40c4c70 tx=0x7fc2bc01c4e0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 -- 172.21.15.87:0/86208944 shutdown_connections 2024-04-25T15:55:06.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/86208944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d40ad160 0x7fc2d40c40e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/86208944 >> v2:172.21.15.155:3300/0 conn(0x7fc2d41518b0 0x7fc2d406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 -- 172.21.15.87:0/86208944 >> 172.21.15.87:0/86208944 conn(0x7fc2d40c8770 msgr2=0x7fc2d40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:06.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 -- 172.21.15.87:0/86208944 shutdown_connections 2024-04-25T15:55:06.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 -- 172.21.15.87:0/86208944 wait complete. 2024-04-25T15:55:06.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.287+0000 7fc2d9b64640 1 Processor -- start 2024-04-25T15:55:06.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 -- start start 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2d40ad160 0x7fc2d41f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2d40c4620 0x7fc2d4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 0x7fc2d40c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4161d60 con 0x7fc2d41518b0 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4161be0 con 0x7fc2d40ad160 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d4161ee0 con 0x7fc2d40c4620 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 0x7fc2d40c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:06.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 0x7fc2d40c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49148/0 (socket says 172.21.15.87:49148) 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 -- 172.21.15.87:0/2473059901 learned_addr learned my addr 172.21.15.87:0/2473059901 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d37fe640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2d40ad160 0x7fc2d41f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2caffd640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2d40c4620 0x7fc2d4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 -- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2d40c4620 msgr2=0x7fc2d4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2d40c4620 0x7fc2d4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 -- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2d40ad160 msgr2=0x7fc2d41f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2d40ad160 0x7fc2d41f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 -- 172.21.15.87:0/2473059901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d40c28f0 con 0x7fc2d41518b0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d3fff640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 0x7fc2d40c6ef0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00be90 tx=0x7fc2cc00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc019070 con 0x7fc2d41518b0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc014440 con 0x7fc2d41518b0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc014870 con 0x7fc2d41518b0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d4150d70 con 0x7fc2d41518b0 2024-04-25T15:55:06.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.291+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d41f52f0 con 0x7fc2d41518b0 2024-04-25T15:55:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.295+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d4069bb0 con 0x7fc2d41518b0 2024-04-25T15:55:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.295+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc2cc01c070 con 0x7fc2d41518b0 2024-04-25T15:55:06.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.295+0000 7fc2d0ff9640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2b406f400 0x7fc2b4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.295+0000 7fc2d37fe640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2b406f400 0x7fc2b4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.295+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7fc2cc08f570 con 0x7fc2d41518b0 2024-04-25T15:55:06.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.295+0000 7fc2d37fe640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2b406f400 0x7fc2b4071910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40aad60 tx=0x7fc2c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:06.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.299+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2cc05c1a0 con 0x7fc2d41518b0 2024-04-25T15:55:06.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.495+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2d4063bf0 con 0x7fc2d41518b0 2024-04-25T15:55:06.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.495+0000 7fc2d0ff9640 1 -- 172.21.15.87:0/2473059901 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7fc2cc05baa0 con 0x7fc2d41518b0 2024-04-25T15:55:06.500 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:06.500 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:06.500 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2b406f400 msgr2=0x7fc2b4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2b406f400 0x7fc2b4071910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40aad60 tx=0x7fc2c4008040 comp rx=0 tx=0).stop 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 msgr2=0x7fc2d40c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 0x7fc2d40c6ef0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00be90 tx=0x7fc2cc00bf80 comp rx=0 tx=0).stop 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 shutdown_connections 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc2b406f400 0x7fc2b4071910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2d41518b0 0x7fc2d40c6ef0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2d40c4620 0x7fc2d4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 --2- 172.21.15.87:0/2473059901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2d40ad160 0x7fc2d41f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 >> 172.21.15.87:0/2473059901 conn(0x7fc2d40c8770 msgr2=0x7fc2d4157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:06.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 shutdown_connections 2024-04-25T15:55:06.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:06.499+0000 7fc2d9b64640 1 -- 172.21.15.87:0/2473059901 wait complete. 2024-04-25T15:55:06.522 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:55:08.285 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:08.288 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:08.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:08.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.679+0000 7efdaaa3c640 1 Processor -- start 2024-04-25T15:55:08.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 -- start start 2024-04-25T15:55:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda4071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efda40ad990 0x7efda40adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efda40c41e0 0x7efda40c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efda4072430 con 0x7efda40c41e0 2024-04-25T15:55:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efda4074730 con 0x7efda40ad990 2024-04-25T15:55:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efdaaa3c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efda4074a10 con 0x7efda41529a0 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efda40c41e0 0x7efda40c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efda40c41e0 0x7efda40c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49162/0 (socket says 172.21.15.87:49162) 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 -- 172.21.15.87:0/369540628 learned_addr learned my addr 172.21.15.87:0/369540628 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda3fff640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda4071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda37fe640 1 --2- 172.21.15.87:0/369540628 >> v2:172.21.15.155:3300/0 conn(0x7efda40ad990 0x7efda40adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 -- 172.21.15.87:0/369540628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 msgr2=0x7efda4071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda4071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 -- 172.21.15.87:0/369540628 >> v2:172.21.15.155:3300/0 conn(0x7efda40ad990 msgr2=0x7efda40adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 --2- 172.21.15.87:0/369540628 >> v2:172.21.15.155:3300/0 conn(0x7efda40ad990 0x7efda40adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda8fd9640 1 -- 172.21.15.87:0/369540628 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda4074cf0 con 0x7efda40c41e0 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda37fe640 1 --2- 172.21.15.87:0/369540628 >> v2:172.21.15.155:3300/0 conn(0x7efda40ad990 0x7efda40adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.683+0000 7efda3fff640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda4071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:08.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efda8fd9640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda40c45f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efda40ae5a0 tx=0x7efd9c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb528154be0b6371 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:08.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efda2ffd640 1 -- 172.21.15.87:0/369540628 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0a55e0 con 0x7efda40c41e0 2024-04-25T15:55:08.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efda2ffd640 1 -- 172.21.15.87:0/369540628 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9c0a5780 con 0x7efda40c41e0 2024-04-25T15:55:08.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efda2ffd640 1 -- 172.21.15.87:0/369540628 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0a5b50 con 0x7efda40c41e0 2024-04-25T15:55:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 -- 172.21.15.87:0/369540628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 msgr2=0x7efda40c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda40c45f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efda40ae5a0 tx=0x7efd9c01c960 comp rx=0 tx=0).stop 2024-04-25T15:55:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 -- 172.21.15.87:0/369540628 shutdown_connections 2024-04-25T15:55:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda40c45f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/369540628 >> v2:172.21.15.155:3300/0 conn(0x7efda40ad990 0x7efda40adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/369540628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda4071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 -- 172.21.15.87:0/369540628 >> 172.21.15.87:0/369540628 conn(0x7efda40c8770 msgr2=0x7efda40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 -- 172.21.15.87:0/369540628 shutdown_connections 2024-04-25T15:55:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 -- 172.21.15.87:0/369540628 wait complete. 2024-04-25T15:55:08.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 Processor -- start 2024-04-25T15:55:08.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.687+0000 7efdaaa3c640 1 -- start start 2024-04-25T15:55:08.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda40ad990 0x7efda4157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda414bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efda4159340 con 0x7efda40c41e0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efda41591c0 con 0x7efda40ad990 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efda41594c0 con 0x7efda41529a0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda415aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49178/0 (socket says 172.21.15.87:49178) 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 -- 172.21.15.87:0/4187625517 learned_addr learned my addr 172.21.15.87:0/4187625517 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda3fff640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda40ad990 0x7efda4157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda8fd9640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda414bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 -- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 msgr2=0x7efda414bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda414bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 -- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda40ad990 msgr2=0x7efda4157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda40ad990 0x7efda4157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 -- 172.21.15.87:0/4187625517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda415e900 con 0x7efda40c41e0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda37fe640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda415aa30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c7f0 tx=0x7efd9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98015070 con 0x7efda40c41e0 2024-04-25T15:55:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98004220 con 0x7efda40c41e0 2024-04-25T15:55:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda4159f90 con 0x7efda40c41e0 2024-04-25T15:55:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98003620 con 0x7efda40c41e0 2024-04-25T15:55:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda415a230 con 0x7efda40c41e0 2024-04-25T15:55:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda4069bb0 con 0x7efda40c41e0 2024-04-25T15:55:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.691+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efd980039d0 con 0x7efda40c41e0 2024-04-25T15:55:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.695+0000 7efda0ff9640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd9006f400 0x7efd90071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.695+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7efd9808f6e0 con 0x7efda40c41e0 2024-04-25T15:55:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.695+0000 7efda3fff640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd9006f400 0x7efd90071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.695+0000 7efda3fff640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd9006f400 0x7efd90071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:08.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.699+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd9805c280 con 0x7efda40c41e0 2024-04-25T15:55:08.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.895+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efda40c3760 con 0x7efda40c41e0 2024-04-25T15:55:08.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.895+0000 7efda0ff9640 1 -- 172.21.15.87:0/4187625517 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7efd9805bb80 con 0x7efda40c41e0 2024-04-25T15:55:08.899 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:08.899 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:08.899 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd9006f400 msgr2=0x7efd90071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd9006f400 0x7efd90071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd94008040 comp rx=0 tx=0).stop 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 msgr2=0x7efda415aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda415aa30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c7f0 tx=0x7efd9800ccb0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 shutdown_connections 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd9006f400 0x7efd90071910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda41529a0 0x7efda414bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40c41e0 0x7efda415aa30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 --2- 172.21.15.87:0/4187625517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda40ad990 0x7efda4157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:08.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 >> 172.21.15.87:0/4187625517 conn(0x7efda40c8770 msgr2=0x7efda414fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:08.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 shutdown_connections 2024-04-25T15:55:08.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:08.899+0000 7efdaaa3c640 1 -- 172.21.15.87:0/4187625517 wait complete. 2024-04-25T15:55:08.921 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:55:10.922 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:11.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 Processor -- start 2024-04-25T15:55:11.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 -- start start 2024-04-25T15:55:11.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c301518b0 0x7f4c3006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:11.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c3006fa10 0x7f4c3015e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:11.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c30154fc0 con 0x7f4c300ad160 2024-04-25T15:55:11.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4c3006ed60 con 0x7f4c301518b0 2024-04-25T15:55:11.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c379ea640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4c300acb20 con 0x7f4c3006fa10 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c301518b0 0x7f4c3006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c301518b0 0x7f4c3006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33712/0 (socket says 172.21.15.87:33712) 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 -- 172.21.15.87:0/445687215 learned_addr learned my addr 172.21.15.87:0/445687215 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35f87640 1 --2- 172.21.15.87:0/445687215 >> v2:172.21.15.155:3300/0 conn(0x7f4c3006fa10 0x7f4c3015e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 -- 172.21.15.87:0/445687215 >> v2:172.21.15.155:3300/0 conn(0x7f4c3006fa10 msgr2=0x7f4c3015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 --2- 172.21.15.87:0/445687215 >> v2:172.21.15.155:3300/0 conn(0x7f4c3006fa10 0x7f4c3015e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 -- 172.21.15.87:0/445687215 >> v1:172.21.15.155:6789/0 conn(0x7f4c300ad160 legacy=0x7f4c300c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:11.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.079+0000 7f4c35786640 1 -- 172.21.15.87:0/445687215 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c300ace00 con 0x7f4c301518b0 2024-04-25T15:55:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c35786640 1 --2- 172.21.15.87:0/445687215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c3006f4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c300734e0 tx=0x7f4c2c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d788ccc5508678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:11.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c27fff640 1 -- 172.21.15.87:0/445687215 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0ab610 con 0x7f4c301518b0 2024-04-25T15:55:11.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c27fff640 1 -- 172.21.15.87:0/445687215 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0b0070 con 0x7f4c301518b0 2024-04-25T15:55:11.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c27fff640 1 -- 172.21.15.87:0/445687215 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0ab9d0 con 0x7f4c301518b0 2024-04-25T15:55:11.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 -- 172.21.15.87:0/445687215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 msgr2=0x7f4c3006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 --2- 172.21.15.87:0/445687215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c3006f4d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4c300734e0 tx=0x7f4c2c01c4e0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 -- 172.21.15.87:0/445687215 shutdown_connections 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 --2- 172.21.15.87:0/445687215 >> v2:172.21.15.155:3300/0 conn(0x7f4c3006fa10 0x7f4c3015e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 --2- 172.21.15.87:0/445687215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c3006f4d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 -- 172.21.15.87:0/445687215 >> 172.21.15.87:0/445687215 conn(0x7f4c300c8770 msgr2=0x7f4c300c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 -- 172.21.15.87:0/445687215 shutdown_connections 2024-04-25T15:55:11.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.083+0000 7f4c379ea640 1 -- 172.21.15.87:0/445687215 wait complete. 2024-04-25T15:55:11.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 Processor -- start 2024-04-25T15:55:11.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- start start 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3006fa10 0x7f4c3014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c300ad160 0x7f4c300c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c300c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30161710 con 0x7f4c301518b0 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c30161890 con 0x7f4c3006fa10 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c30161a10 con 0x7f4c300ad160 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c300c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c300c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33720/0 (socket says 172.21.15.87:33720) 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 -- 172.21.15.87:0/283959246 learned_addr learned my addr 172.21.15.87:0/283959246 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35786640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3006fa10 0x7f4c3014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:11.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c34f85640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c300ad160 0x7f4c300c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 -- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c300ad160 msgr2=0x7f4c300c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c300ad160 0x7f4c300c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 -- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3006fa10 msgr2=0x7f4c3014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3006fa10 0x7f4c3014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 -- 172.21.15.87:0/283959246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c301ef440 con 0x7f4c301518b0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c34f85640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c300ad160 0x7f4c300c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c35f87640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c300c1fb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c28007d70 tx=0x7f4c2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28014420 con 0x7f4c301518b0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c28019070 con 0x7f4c301518b0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c301ef720 con 0x7f4c301518b0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28014820 con 0x7f4c301518b0 2024-04-25T15:55:11.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c300be3e0 con 0x7f4c301518b0 2024-04-25T15:55:11.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.087+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c30069bb0 con 0x7f4c301518b0 2024-04-25T15:55:11.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.091+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4c280149c0 con 0x7f4c301518b0 2024-04-25T15:55:11.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.091+0000 7f4c25ffb640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c1406f430 0x7f4c14071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:11.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.091+0000 7f4c35786640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c1406f430 0x7f4c14071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:11.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.091+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f4c28090840 con 0x7f4c301518b0 2024-04-25T15:55:11.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.091+0000 7f4c35786640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c1406f430 0x7f4c14071940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0af000 tx=0x7f4c2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:11.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.095+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c2805d4c0 con 0x7f4c301518b0 2024-04-25T15:55:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.279+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c300abfa0 con 0x7f4c301518b0 2024-04-25T15:55:11.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.279+0000 7f4c25ffb640 1 -- 172.21.15.87:0/283959246 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f4c2805cdc0 con 0x7f4c301518b0 2024-04-25T15:55:11.284 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:11.284 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:11.284 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:11.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c1406f430 msgr2=0x7f4c14071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:11.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c1406f430 0x7f4c14071940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0af000 tx=0x7f4c2c008040 comp rx=0 tx=0).stop 2024-04-25T15:55:11.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 msgr2=0x7f4c300c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:11.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c300c1fb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c28007d70 tx=0x7f4c2800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 shutdown_connections 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4c1406f430 0x7f4c14071940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c301518b0 0x7f4c300c1fb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c300ad160 0x7f4c300c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 --2- 172.21.15.87:0/283959246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c3006fa10 0x7f4c3014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 >> 172.21.15.87:0/283959246 conn(0x7f4c300c8770 msgr2=0x7f4c30150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 shutdown_connections 2024-04-25T15:55:11.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:11.283+0000 7f4c379ea640 1 -- 172.21.15.87:0/283959246 wait complete. 2024-04-25T15:55:11.305 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:55:13.307 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:13.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7ec17640 1 Processor -- start 2024-04-25T15:55:13.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7ec17640 1 -- start start 2024-04-25T15:55:13.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7ec17640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f780c48f0 0x7f6f78160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7ec17640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f78072430 con 0x7f6f781529a0 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7ec17640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f78074730 con 0x7f6f78071e50 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7ec17640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6f78074a10 con 0x7f6f780c48f0 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7c9b3640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6f781529a0 0x7f6f780ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52678/0 (socket says 172.21.15.87:52678) 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/3379198824 learned_addr learned my addr 172.21.15.87:0/3379198824 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f7d1b4640 1 --2- 172.21.15.87:0/3379198824 >> v2:172.21.15.155:3300/0 conn(0x7f6f780c48f0 0x7f6f78160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294683327 0 0) 0x7f6f78072430 con 0x7f6f781529a0 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f64003530 con 0x7f6f781529a0 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1739864056 0 0) 0x7f6f64003530 con 0x7f6f781529a0 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 >> v2:172.21.15.155:3300/0 conn(0x7f6f780c48f0 msgr2=0x7f6f78160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 --2- 172.21.15.87:0/3379198824 >> v2:172.21.15.155:3300/0 conn(0x7f6f780c48f0 0x7f6f78160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 >> v1:172.21.15.155:6789/0 conn(0x7f6f78071e50 legacy=0x7f6f780c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f78074cf0 con 0x7f6f781529a0 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f6f60001680 con 0x7f6f781529a0 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 >> v1:172.21.15.87:6789/0 conn(0x7f6f781529a0 legacy=0x7f6f780ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f64003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f64004810 0x7f6f64004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f64005260 0x7f6f6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f78074a10 con 0x7f6f640039c0 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6400c1f0 con 0x7f6f64004810 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.463+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6400c3f0 con 0x7f6f64005260 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f64003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f77fff640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f64004810 0x7f6f64004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7d1b4640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f64005260 0x7f6f6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f64005260 msgr2=0x7f6f6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f64005260 0x7f6f6400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f64004810 msgr2=0x7f6f64004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:13.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f64004810 0x7f6f64004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7d1b4640 1 -- 172.21.15.87:0/3379198824 reap_dead start 2024-04-25T15:55:13.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/3379198824 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f64003530 con 0x7f6f640039c0 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f64003e30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c190 tx=0x7f6f6001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0411188decc88f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60007d00 con 0x7f6f640039c0 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f600a9020 con 0x7f6f640039c0 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f777fe640 1 -- 172.21.15.87:0/3379198824 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f600058e0 con 0x7f6f640039c0 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 -- 172.21.15.87:0/3379198824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 msgr2=0x7f6f64003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f64003e30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000c190 tx=0x7f6f6001cb80 comp rx=0 tx=0).stop 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 -- 172.21.15.87:0/3379198824 shutdown_connections 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/3379198824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f64003e30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 -- 172.21.15.87:0/3379198824 >> 172.21.15.87:0/3379198824 conn(0x7f6f780c8770 msgr2=0x7f6f780c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:13.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 -- 172.21.15.87:0/3379198824 shutdown_connections 2024-04-25T15:55:13.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.467+0000 7f6f7ec17640 1 -- 172.21.15.87:0/3379198824 wait complete. 2024-04-25T15:55:13.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 Processor -- start 2024-04-25T15:55:13.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 -- start start 2024-04-25T15:55:13.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f7806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f781f2510 0x7f6f781f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f781f08e0 0x7f6f781540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f780c4d00 con 0x7f6f640039c0 2024-04-25T15:55:13.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781587a0 con 0x7f6f781f08e0 2024-04-25T15:55:13.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f781f10c0 con 0x7f6f781f2510 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f7806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f7806efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33736/0 (socket says 172.21.15.87:33736) 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/4086191985 learned_addr learned my addr 172.21.15.87:0/4086191985 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7d1b4640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f781f08e0 0x7f6f781540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f77fff640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f781f2510 0x7f6f781f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f781f2510 msgr2=0x7f6f781f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f781f2510 0x7f6f781f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f781f08e0 msgr2=0x7f6f781540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f781f08e0 0x7f6f781540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 -- 172.21.15.87:0/4086191985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f781495d0 con 0x7f6f640039c0 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7c9b3640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f7806efd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ab040 tx=0x7f6f64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f600049f0 con 0x7f6f640039c0 2024-04-25T15:55:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f600b2070 con 0x7f6f640039c0 2024-04-25T15:55:13.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f781498b0 con 0x7f6f640039c0 2024-04-25T15:55:13.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60004d90 con 0x7f6f640039c0 2024-04-25T15:55:13.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.471+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f781efe80 con 0x7f6f640039c0 2024-04-25T15:55:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.475+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f78069bb0 con 0x7f6f640039c0 2024-04-25T15:55:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.475+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6f600a5620 con 0x7f6f640039c0 2024-04-25T15:55:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.475+0000 7f6f757fa640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f5806f430 0x7f6f58071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.475+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6695+0+0 (secure 0 0 0) 0x7f6f60128720 con 0x7f6f640039c0 2024-04-25T15:55:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.475+0000 7f6f77fff640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f5806f430 0x7f6f58071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:13.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.475+0000 7f6f77fff640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f5806f430 0x7f6f58071940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f78156280 tx=0x7f6f68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:13.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.479+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f600168d0 con 0x7f6f640039c0 2024-04-25T15:55:13.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.675+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f78149a80 con 0x7f6f640039c0 2024-04-25T15:55:13.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f757fa640 1 -- 172.21.15.87:0/4086191985 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6486 (secure 0 0 0) 0x7f6f600f5230 con 0x7f6f640039c0 2024-04-25T15:55:13.681 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:13.681 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4246,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:54:13.695809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6837/2324940240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":2324940240},{"type":"v1","addr":"172.21.15.87:6837","nonce":2324940240}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:13.682 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 15 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f5806f430 msgr2=0x7f6f58071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f5806f430 0x7f6f58071940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f78156280 tx=0x7f6f68009040 comp rx=0 tx=0).stop 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 msgr2=0x7f6f7806efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f7806efd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ab040 tx=0x7f6f64005840 comp rx=0 tx=0).stop 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 shutdown_connections 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f5806f430 0x7f6f58071940 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f781f08e0 0x7f6f781540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f781f2510 0x7f6f781f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 --2- 172.21.15.87:0/4086191985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f640039c0 0x7f6f7806efd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 >> 172.21.15.87:0/4086191985 conn(0x7f6f780c8770 msgr2=0x7f6f781509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 shutdown_connections 2024-04-25T15:55:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:13.679+0000 7f6f7ec17640 1 -- 172.21.15.87:0/4086191985 wait complete. 2024-04-25T15:55:13.703 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:55:15.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:15.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a3e16640 1 Processor -- start 2024-04-25T15:55:15.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a3e16640 1 -- start start 2024-04-25T15:55:15.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a3e16640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f469c0c48f0 0x7f469c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:15.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a3e16640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c072430 con 0x7f469c1529a0 2024-04-25T15:55:15.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a3e16640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c074730 con 0x7f469c071e50 2024-04-25T15:55:15.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a3e16640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f469c074a10 con 0x7f469c0c48f0 2024-04-25T15:55:15.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a23b3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f469c0c48f0 0x7f469c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:15.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a1bb2640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f469c1529a0 0x7f469c0ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52686/0 (socket says 172.21.15.87:52686) 2024-04-25T15:55:15.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a1bb2640 1 -- 172.21.15.87:0/3456517251 learned_addr learned my addr 172.21.15.87:0/3456517251 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:15.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a23b3640 1 -- 172.21.15.87:0/3456517251 >> v1:172.21.15.155:6789/0 conn(0x7f469c071e50 legacy=0x7f469c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:15.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a23b3640 1 -- 172.21.15.87:0/3456517251 >> v1:172.21.15.87:6789/0 conn(0x7f469c1529a0 legacy=0x7f469c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:15.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a23b3640 1 -- 172.21.15.87:0/3456517251 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c074cf0 con 0x7f469c0c48f0 2024-04-25T15:55:15.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.863+0000 7f46a0bb0640 1 -- 172.21.15.87:0/3456517251 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693309431 0 0) 0x7f469c072430 con 0x7f469c1529a0 2024-04-25T15:55:15.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a23b3640 1 --2- 172.21.15.87:0/3456517251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c0c48f0 0x7f469c160ae0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46980097c0 tx=0x7f469801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39546fa4c7c7fe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:15.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a0bb0640 1 -- 172.21.15.87:0/3456517251 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980b0070 con 0x7f469c0c48f0 2024-04-25T15:55:15.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a0bb0640 1 -- 172.21.15.87:0/3456517251 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46980ab600 con 0x7f469c0c48f0 2024-04-25T15:55:15.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a0bb0640 1 -- 172.21.15.87:0/3456517251 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46980a4e60 con 0x7f469c0c48f0 2024-04-25T15:55:15.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 -- 172.21.15.87:0/3456517251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c0c48f0 msgr2=0x7f469c160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:15.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 --2- 172.21.15.87:0/3456517251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c0c48f0 0x7f469c160ae0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46980097c0 tx=0x7f469801c3d0 comp rx=0 tx=0).stop 2024-04-25T15:55:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 -- 172.21.15.87:0/3456517251 shutdown_connections 2024-04-25T15:55:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 --2- 172.21.15.87:0/3456517251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c0c48f0 0x7f469c160ae0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 -- 172.21.15.87:0/3456517251 >> 172.21.15.87:0/3456517251 conn(0x7f469c0c8770 msgr2=0x7f469c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 -- 172.21.15.87:0/3456517251 shutdown_connections 2024-04-25T15:55:15.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 -- 172.21.15.87:0/3456517251 wait complete. 2024-04-25T15:55:15.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 Processor -- start 2024-04-25T15:55:15.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.867+0000 7f46a3e16640 1 -- start start 2024-04-25T15:55:15.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 0x7f469c146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0c48f0 0x7f469c0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c1529a0 0x7f469c14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f469c0c4d00 con 0x7f469c071e50 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f469c163840 con 0x7f469c0c48f0 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f469c0c64e0 con 0x7f469c1529a0 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 0x7f469c146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 0x7f469c146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33754/0 (socket says 172.21.15.87:33754) 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 -- 172.21.15.87:0/1820485401 learned_addr learned my addr 172.21.15.87:0/1820485401 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a23b3640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c1529a0 0x7f469c14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a13b1640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0c48f0 0x7f469c0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 -- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c1529a0 msgr2=0x7f469c14f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c1529a0 0x7f469c14f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:15.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 -- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0c48f0 msgr2=0x7f469c0acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0c48f0 0x7f469c0acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 -- 172.21.15.87:0/1820485401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c1f4230 con 0x7f469c071e50 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a1bb2640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 0x7f469c146ac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4694002240 tx=0x7f469400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694018070 con 0x7f469c071e50 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469400a640 con 0x7f469c071e50 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469400a9f0 con 0x7f469c071e50 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c0ac0c0 con 0x7f469c071e50 2024-04-25T15:55:15.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c0ac680 con 0x7f469c071e50 2024-04-25T15:55:15.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c069bb0 con 0x7f469c071e50 2024-04-25T15:55:15.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.871+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f469401b070 con 0x7f469c071e50 2024-04-25T15:55:15.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.875+0000 7f46927fc640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468006f430 0x7f4680071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:15.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.875+0000 7f46a13b1640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468006f430 0x7f4680071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:15.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.875+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f469408ed60 con 0x7f469c071e50 2024-04-25T15:55:15.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.875+0000 7f46a13b1640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468006f430 0x7f4680071940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f469c160ff0 tx=0x7f468c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:15.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:15.879+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f469405b8b0 con 0x7f469c071e50 2024-04-25T15:55:16.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.075+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f469c0c3760 con 0x7f469c071e50 2024-04-25T15:55:16.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.075+0000 7f46927fc640 1 -- 172.21.15.87:0/1820485401 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5662 (secure 0 0 0) 0x7f469405b1b0 con 0x7f469c071e50 2024-04-25T15:55:16.079 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:16.079 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:14.265908+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:16.079 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2024-04-25T15:55:16.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468006f430 msgr2=0x7f4680071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468006f430 0x7f4680071940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f469c160ff0 tx=0x7f468c008040 comp rx=0 tx=0).stop 2024-04-25T15:55:16.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 msgr2=0x7f469c146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 0x7f469c146ac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4694002240 tx=0x7f469400cc50 comp rx=0 tx=0).stop 2024-04-25T15:55:16.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 shutdown_connections 2024-04-25T15:55:16.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468006f430 0x7f4680071940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c1529a0 0x7f469c14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0c48f0 0x7f469c0acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 --2- 172.21.15.87:0/1820485401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c071e50 0x7f469c146ac0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 >> 172.21.15.87:0/1820485401 conn(0x7f469c0c8770 msgr2=0x7f469c147cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 shutdown_connections 2024-04-25T15:55:16.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.079+0000 7f46a3e16640 1 -- 172.21.15.87:0/1820485401 wait complete. 2024-04-25T15:55:16.101 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2024-04-25T15:55:16.101 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T15:55:16.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:16.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0ab5a6640 1 Processor -- start 2024-04-25T15:55:16.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0ab5a6640 1 -- start start 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0ab5a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0a415ac30 0x7fb0a415b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0ab5a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a40c5120 con 0x7fb0a415b580 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0ab5a6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a40c4b60 con 0x7fb0a40c4250 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0ab5a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a40c3b20 con 0x7fb0a415ac30 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0a8b41640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0a415ac30 0x7fb0a415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0a9b43640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb0a415b580 0x7fb0a4161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52696/0 (socket says 172.21.15.87:52696) 2024-04-25T15:55:16.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0a9b43640 1 -- 172.21.15.87:0/1844573934 learned_addr learned my addr 172.21.15.87:0/1844573934 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:16.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0a8b41640 1 -- 172.21.15.87:0/1844573934 >> v1:172.21.15.155:6789/0 conn(0x7fb0a40c4250 legacy=0x7fb0a406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0a8b41640 1 -- 172.21.15.87:0/1844573934 >> v1:172.21.15.87:6789/0 conn(0x7fb0a415b580 legacy=0x7fb0a4161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.247+0000 7fb0a8b41640 1 -- 172.21.15.87:0/1844573934 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a40c4e40 con 0x7fb0a415ac30 2024-04-25T15:55:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0a8b41640 1 --2- 172.21.15.87:0/1844573934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415ac30 0x7fb0a415b040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb0940097c0 tx=0x7fb09401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63543136cb86cb62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb09bfff640 1 -- 172.21.15.87:0/1844573934 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0940b0070 con 0x7fb0a415ac30 2024-04-25T15:55:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb09bfff640 1 -- 172.21.15.87:0/1844573934 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0940ab600 con 0x7fb0a415ac30 2024-04-25T15:55:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb09bfff640 1 -- 172.21.15.87:0/1844573934 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0940ab9d0 con 0x7fb0a415ac30 2024-04-25T15:55:16.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/1844573934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415ac30 msgr2=0x7fb0a415b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/1844573934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415ac30 0x7fb0a415b040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb0940097c0 tx=0x7fb09401c410 comp rx=0 tx=0).stop 2024-04-25T15:55:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/1844573934 shutdown_connections 2024-04-25T15:55:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/1844573934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415ac30 0x7fb0a415b040 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/1844573934 >> 172.21.15.87:0/1844573934 conn(0x7fb0a406d780 msgr2=0x7fb0a406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/1844573934 shutdown_connections 2024-04-25T15:55:16.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.251+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/1844573934 wait complete. 2024-04-25T15:55:16.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 Processor -- start 2024-04-25T15:55:16.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 -- start start 2024-04-25T15:55:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a40c4250 0x7fb0a414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0a415ac30 0x7fb0a41f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 0x7fb0a4146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4155280 con 0x7fb0a415b580 2024-04-25T15:55:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a4155100 con 0x7fb0a40c4250 2024-04-25T15:55:16.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a4165da0 con 0x7fb0a415ac30 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 0x7fb0a4146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 0x7fb0a4146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33770/0 (socket says 172.21.15.87:33770) 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 -- 172.21.15.87:0/2435580273 learned_addr learned my addr 172.21.15.87:0/2435580273 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9342640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a40c4250 0x7fb0a414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a8b41640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0a415ac30 0x7fb0a41f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 -- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0a415ac30 msgr2=0x7fb0a41f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0a415ac30 0x7fb0a41f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 -- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a40c4250 msgr2=0x7fb0a414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a40c4250 0x7fb0a414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 -- 172.21.15.87:0/2435580273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a40c7bb0 con 0x7fb0a415b580 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0a9b43640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 0x7fb0a4146b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ca80 tx=0x7fb09c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c017070 con 0x7fb0a415b580 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c00ac30 con 0x7fb0a415b580 2024-04-25T15:55:16.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a40c7e90 con 0x7fb0a415b580 2024-04-25T15:55:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c012600 con 0x7fb0a415b580 2024-04-25T15:55:16.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.255+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a4151b20 con 0x7fb0a415b580 2024-04-25T15:55:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.259+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a40c80d0 con 0x7fb0a415b580 2024-04-25T15:55:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.259+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb09c01a070 con 0x7fb0a415b580 2024-04-25T15:55:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.259+0000 7fb099ffb640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb08806f400 0x7fb088071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.259+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7fb09c08f340 con 0x7fb0a415b580 2024-04-25T15:55:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.259+0000 7fb0a9342640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb08806f400 0x7fb088071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.259+0000 7fb0a9342640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb08806f400 0x7fb088071910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0007fd0 tx=0x7fb0a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:16.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.263+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0a40c80d0 con 0x7fb0a415b580 2024-04-25T15:55:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.459+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0a4069bb0 con 0x7fb0a415b580 2024-04-25T15:55:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb099ffb640 1 -- 172.21.15.87:0/2435580273 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5659 (secure 0 0 0) 0x7fb0a40c5120 con 0x7fb0a415b580 2024-04-25T15:55:16.465 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:16.465 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:15.251312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:16.466 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 18 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb08806f400 msgr2=0x7fb088071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb08806f400 0x7fb088071910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0007fd0 tx=0x7fb0a0009040 comp rx=0 tx=0).stop 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 msgr2=0x7fb0a4146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 0x7fb0a4146b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ca80 tx=0x7fb09c00cf40 comp rx=0 tx=0).stop 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 shutdown_connections 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb08806f400 0x7fb088071910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0a415b580 0x7fb0a4146b30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0a415ac30 0x7fb0a41f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 --2- 172.21.15.87:0/2435580273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0a40c4250 0x7fb0a414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 >> 172.21.15.87:0/2435580273 conn(0x7fb0a406d780 msgr2=0x7fb0a4153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 shutdown_connections 2024-04-25T15:55:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.463+0000 7fb0ab5a6640 1 -- 172.21.15.87:0/2435580273 wait complete. 2024-04-25T15:55:16.486 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 18, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4246": { "addr": "172.21.15.155:6833/1039729746", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 1039729746, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 1039729746, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4246, "incarnation": 16, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 20 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:55:15.251312+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4246 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 15, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4263": { "addr": "172.21.15.87:6836/2742361177", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 2742361177, "type": "v2" }, { "addr": "172.21.15.87:6836", "nonce": 2742361177, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4263, "incarnation": 10, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 6 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:54:23.848714+0000", "qdb_cluster": [ 4263 ], "qdb_leader": 4263, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4263 } } } ], "standbys": [ { "addr": "172.21.15.155:6835/630698588", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 630698588, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 630698588, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T15:55:16.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:16.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac63382640 1 Processor -- start 2024-04-25T15:55:16.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac63382640 1 -- start start 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac63382640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac5c15ac30 0x7fac5c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac63382640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0c5120 con 0x7fac5c0c4250 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac63382640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0c4b60 con 0x7fac5c15b580 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac63382640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0c3b20 con 0x7fac5c15ac30 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6091d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac5c15ac30 0x7fac5c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6111e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fac5c0c4250 0x7fac5c06ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52708/0 (socket says 172.21.15.87:52708) 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6091d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac5c15ac30 0x7fac5c15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33780/0 (socket says 172.21.15.87:33780) 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6111e640 1 -- 172.21.15.87:0/96825733 learned_addr learned my addr 172.21.15.87:0/96825733 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:16.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6091d640 1 -- 172.21.15.87:0/96825733 >> v1:172.21.15.155:6789/0 conn(0x7fac5c15b580 legacy=0x7fac5c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:16.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6091d640 1 -- 172.21.15.87:0/96825733 >> v1:172.21.15.87:6789/0 conn(0x7fac5c0c4250 legacy=0x7fac5c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.823+0000 7fac6091d640 1 -- 172.21.15.87:0/96825733 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0c4e40 con 0x7fac5c15ac30 2024-04-25T15:55:16.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac6091d640 1 --2- 172.21.15.87:0/96825733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c15b040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac500097c0 tx=0x7fac5001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb3f71be17b8383 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:16.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac4ffff640 1 -- 172.21.15.87:0/96825733 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac500b0070 con 0x7fac5c15ac30 2024-04-25T15:55:16.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac4ffff640 1 -- 172.21.15.87:0/96825733 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac500ab600 con 0x7fac5c15ac30 2024-04-25T15:55:16.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac4ffff640 1 -- 172.21.15.87:0/96825733 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac500a4e60 con 0x7fac5c15ac30 2024-04-25T15:55:16.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 -- 172.21.15.87:0/96825733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 msgr2=0x7fac5c15b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 --2- 172.21.15.87:0/96825733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c15b040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac500097c0 tx=0x7fac5001c3d0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 -- 172.21.15.87:0/96825733 shutdown_connections 2024-04-25T15:55:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 --2- 172.21.15.87:0/96825733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c15b040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 -- 172.21.15.87:0/96825733 >> 172.21.15.87:0/96825733 conn(0x7fac5c06d780 msgr2=0x7fac5c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 -- 172.21.15.87:0/96825733 shutdown_connections 2024-04-25T15:55:16.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 -- 172.21.15.87:0/96825733 wait complete. 2024-04-25T15:55:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 Processor -- start 2024-04-25T15:55:16.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.827+0000 7fac63382640 1 -- start start 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac5c0c4250 0x7fac5c1f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac5c15b580 0x7fac5c0ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c155280 con 0x7fac5c15ac30 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c155100 con 0x7fac5c15b580 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c165da0 con 0x7fac5c0c4250 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33792/0 (socket says 172.21.15.87:33792) 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 -- 172.21.15.87:0/815587151 learned_addr learned my addr 172.21.15.87:0/815587151 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 -- 172.21.15.87:0/815587151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac5c0c4250 msgr2=0x7fac5c1f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac5c0c4250 0x7fac5c1f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 -- 172.21.15.87:0/815587151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac5c15b580 msgr2=0x7fac5c0ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac5c15b580 0x7fac5c0ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 -- 172.21.15.87:0/815587151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c151260 con 0x7fac5c15ac30 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac6091d640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c159b50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac50018fe0 tx=0x7fac50019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac500b8070 con 0x7fac5c15ac30 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac500b4410 con 0x7fac5c15ac30 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c151540 con 0x7fac5c15ac30 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac500b0040 con 0x7fac5c15ac30 2024-04-25T15:55:16.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0adca0 con 0x7fac5c15ac30 2024-04-25T15:55:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.831+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c069bb0 con 0x7fac5c15ac30 2024-04-25T15:55:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.835+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fac500bb070 con 0x7fac5c15ac30 2024-04-25T15:55:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.835+0000 7fac4dffb640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fac4006f400 0x7fac40071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.835+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7fac50129470 con 0x7fac5c15ac30 2024-04-25T15:55:16.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.835+0000 7fac6111e640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fac4006f400 0x7fac40071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:16.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.835+0000 7fac6111e640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fac4006f400 0x7fac40071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac540012f0 tx=0x7fac540015a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:16.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:16.839+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac50016050 con 0x7fac5c15ac30 2024-04-25T15:55:17.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.019+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac5c0acb80 con 0x7fac5c15ac30 2024-04-25T15:55:17.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.019+0000 7fac4dffb640 1 -- 172.21.15.87:0/815587151 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5659 (secure 0 0 0) 0x7fac500f60a0 con 0x7fac5c15ac30 2024-04-25T15:55:17.025 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:17.025 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:15.251312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:17.025 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 18 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fac4006f400 msgr2=0x7fac40071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fac4006f400 0x7fac40071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac540012f0 tx=0x7fac540015a0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 msgr2=0x7fac5c159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c159b50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac50018fe0 tx=0x7fac50019170 comp rx=0 tx=0).stop 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 shutdown_connections 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fac4006f400 0x7fac40071910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac5c15b580 0x7fac5c0ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac5c15ac30 0x7fac5c159b50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 --2- 172.21.15.87:0/815587151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac5c0c4250 0x7fac5c1f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 >> 172.21.15.87:0/815587151 conn(0x7fac5c06d780 msgr2=0x7fac5c151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 shutdown_connections 2024-04-25T15:55:17.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.023+0000 7fac63382640 1 -- 172.21.15.87:0/815587151 wait complete. 2024-04-25T15:55:17.045 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2024-04-25T15:55:17.045 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:55:17.045 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:55:17.059 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:55:17.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 Processor -- start 2024-04-25T15:55:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 -- start start 2024-04-25T15:55:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94440aeca0 0x7f9444074930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f9444154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f944406f8a0 0x7f944406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9444070440 con 0x7f944406f8a0 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9444063710 con 0x7f94440aeca0 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f944b7f7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f944406dbd0 con 0x7f9444151700 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f944406f8a0 0x7f944406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f944406f8a0 0x7f944406fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33794/0 (socket says 172.21.15.87:33794) 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 -- 172.21.15.87:0/79086041 learned_addr learned my addr 172.21.15.87:0/79086041 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9448d92640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f9444154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449593640 1 --2- 172.21.15.87:0/79086041 >> v2:172.21.15.155:3300/0 conn(0x7f94440aeca0 0x7f9444074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 -- 172.21.15.87:0/79086041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 msgr2=0x7f9444154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f9444154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 -- 172.21.15.87:0/79086041 >> v2:172.21.15.155:3300/0 conn(0x7f94440aeca0 msgr2=0x7f9444074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 --2- 172.21.15.87:0/79086041 >> v2:172.21.15.155:3300/0 conn(0x7f94440aeca0 0x7f9444074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449d94640 1 -- 172.21.15.87:0/79086041 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9444070690 con 0x7f944406f8a0 2024-04-25T15:55:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9448d92640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f9444154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.251+0000 7f9449593640 1 --2- 172.21.15.87:0/79086041 >> v2:172.21.15.155:3300/0 conn(0x7f94440aeca0 0x7f9444074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f9449d94640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f944406fcb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9444063890 tx=0x7f943c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4cc5ca8d6b2d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:17.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f943bfff640 1 -- 172.21.15.87:0/79086041 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0a5720 con 0x7f944406f8a0 2024-04-25T15:55:17.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f943bfff640 1 -- 172.21.15.87:0/79086041 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c0a58c0 con 0x7f944406f8a0 2024-04-25T15:55:17.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f943bfff640 1 -- 172.21.15.87:0/79086041 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0a5c90 con 0x7f944406f8a0 2024-04-25T15:55:17.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 -- 172.21.15.87:0/79086041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 msgr2=0x7f944406fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f944406fcb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9444063890 tx=0x7f943c01c8a0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 -- 172.21.15.87:0/79086041 shutdown_connections 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f944406fcb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 --2- 172.21.15.87:0/79086041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f9444154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 --2- 172.21.15.87:0/79086041 >> v2:172.21.15.155:3300/0 conn(0x7f94440aeca0 0x7f9444074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 -- 172.21.15.87:0/79086041 >> 172.21.15.87:0/79086041 conn(0x7f944406d650 msgr2=0x7f94440c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 -- 172.21.15.87:0/79086041 shutdown_connections 2024-04-25T15:55:17.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.255+0000 7f944b7f7640 1 -- 172.21.15.87:0/79086041 wait complete. 2024-04-25T15:55:17.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 Processor -- start 2024-04-25T15:55:17.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 -- start start 2024-04-25T15:55:17.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f94441477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94440aeca0 0x7f94440c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f944415d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9444154820 con 0x7f944406f8a0 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94441546a0 con 0x7f94440aeca0 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f944b7f7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9444072fb0 con 0x7f9444151700 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f94441477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f94441477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33800/0 (socket says 172.21.15.87:33800) 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 -- 172.21.15.87:0/4251424852 learned_addr learned my addr 172.21.15.87:0/4251424852 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9448d92640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94440aeca0 0x7f94440c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449d94640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f944415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 -- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 msgr2=0x7f944415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f944415d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 -- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94440aeca0 msgr2=0x7f94440c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94440aeca0 0x7f94440c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 -- 172.21.15.87:0/4251424852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440c8660 con 0x7f944406f8a0 2024-04-25T15:55:17.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.259+0000 7f9449593640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f94441477d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f944000c820 tx=0x7f944000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:17.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440015070 con 0x7f944406f8a0 2024-04-25T15:55:17.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9440007a30 con 0x7f944406f8a0 2024-04-25T15:55:17.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440007e20 con 0x7f944406f8a0 2024-04-25T15:55:17.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94441f3af0 con 0x7f944406f8a0 2024-04-25T15:55:17.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94441495f0 con 0x7f944406f8a0 2024-04-25T15:55:17.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444069bb0 con 0x7f944406f8a0 2024-04-25T15:55:17.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9440018070 con 0x7f944406f8a0 2024-04-25T15:55:17.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9439ffb640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942806f400 0x7f9428071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:17.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9448d92640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942806f400 0x7f9428071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:17.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f944008f550 con 0x7f944406f8a0 2024-04-25T15:55:17.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.263+0000 7f9448d92640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942806f400 0x7f9428071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9434006fd0 tx=0x7f9434008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:17.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.267+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f944005c0a0 con 0x7f944406f8a0 2024-04-25T15:55:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.459+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9444151db0 con 0x7f944406f8a0 2024-04-25T15:55:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.459+0000 7f9439ffb640 1 -- 172.21.15.87:0/4251424852 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7f944005b9a0 con 0x7f944406f8a0 2024-04-25T15:55:17.465 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:17.465 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:17.465 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942806f400 msgr2=0x7f9428071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942806f400 0x7f9428071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9434006fd0 tx=0x7f9434008040 comp rx=0 tx=0).stop 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 msgr2=0x7f94441477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f94441477d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f944000c820 tx=0x7f944000cce0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 shutdown_connections 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f942806f400 0x7f9428071910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9444151700 0x7f944415d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94440aeca0 0x7f94440c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 --2- 172.21.15.87:0/4251424852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f944406f8a0 0x7f94441477d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 >> 172.21.15.87:0/4251424852 conn(0x7f944406d650 msgr2=0x7f94440acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:17.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 shutdown_connections 2024-04-25T15:55:17.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:17.463+0000 7f944b7f7640 1 -- 172.21.15.87:0/4251424852 wait complete. 2024-04-25T15:55:17.485 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:18.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:18.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 Processor -- start 2024-04-25T15:55:18.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 -- start start 2024-04-25T15:55:18.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81500c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:18.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 0x7f815015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:18.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81500c5290 con 0x7f81500c9ae0 2024-04-25T15:55:18.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f81500c5e80 con 0x7f8150157fc0 2024-04-25T15:55:18.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8156fca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8150154fd0 con 0x7f81501517d0 2024-04-25T15:55:18.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8154d66640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81500c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:18.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8155567640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 0x7f815015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:18.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8155567640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 0x7f815015ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:43602/0 (socket says 172.21.15.87:43602) 2024-04-25T15:55:18.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f814ffff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f81500c9ae0 0x7f81501578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:45832/0 (socket says 172.21.15.87:45832) 2024-04-25T15:55:18.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.639+0000 7f8155567640 1 -- 172.21.15.87:0/1446864625 learned_addr learned my addr 172.21.15.87:0/1446864625 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:18.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8154d66640 1 -- 172.21.15.87:0/1446864625 >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 msgr2=0x7f815015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:18.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8154d66640 1 --2- 172.21.15.87:0/1446864625 >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 0x7f815015ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8154d66640 1 -- 172.21.15.87:0/1446864625 >> v1:172.21.15.155:6789/0 conn(0x7f81500c9ae0 legacy=0x7f81501578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:18.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8154d66640 1 -- 172.21.15.87:0/1446864625 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81500c5550 con 0x7f81501517d0 2024-04-25T15:55:18.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f814f7fe640 1 -- 172.21.15.87:0/1446864625 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011161358 0 0) 0x7f81500c5290 con 0x7f81500c9ae0 2024-04-25T15:55:18.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8155567640 1 --2- 172.21.15.87:0/1446864625 >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 0x7f815015ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:55:18.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8154d66640 1 --2- 172.21.15.87:0/1446864625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81500c95a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f81480097c0 tx=0x7f814801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d0c8aaf90b4593 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:18.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f814f7fe640 1 -- 172.21.15.87:0/1446864625 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81480b1070 con 0x7f81501517d0 2024-04-25T15:55:18.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f814f7fe640 1 -- 172.21.15.87:0/1446864625 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81480ac410 con 0x7f81501517d0 2024-04-25T15:55:18.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f814f7fe640 1 -- 172.21.15.87:0/1446864625 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81480ac7e0 con 0x7f81501517d0 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8156fca640 1 -- 172.21.15.87:0/1446864625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 msgr2=0x7f81500c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.643+0000 7f8156fca640 1 --2- 172.21.15.87:0/1446864625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81500c95a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f81480097c0 tx=0x7f814801c4c0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- 172.21.15.87:0/1446864625 shutdown_connections 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 --2- 172.21.15.87:0/1446864625 >> v2:172.21.15.155:3300/0 conn(0x7f8150157fc0 0x7f815015ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 --2- 172.21.15.87:0/1446864625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81500c95a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- 172.21.15.87:0/1446864625 >> 172.21.15.87:0/1446864625 conn(0x7f815006d780 msgr2=0x7f815006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- 172.21.15.87:0/1446864625 shutdown_connections 2024-04-25T15:55:18.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- 172.21.15.87:0/1446864625 wait complete. 2024-04-25T15:55:18.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 Processor -- start 2024-04-25T15:55:18.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- start start 2024-04-25T15:55:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81500c9ae0 0x7f81500ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81501ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 0x7f8150145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8150158550 con 0x7f8150157fc0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81501583d0 con 0x7f81500c9ae0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8156fca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81500a8f70 con 0x7f81501517d0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 0x7f8150145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 0x7f8150145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33806/0 (socket says 172.21.15.87:33806) 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 -- 172.21.15.87:0/1362600470 learned_addr learned my addr 172.21.15.87:0/1362600470 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8154d66640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81500c9ae0 0x7f81500ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f814ffff640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81501ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 -- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 msgr2=0x7f81501ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81501ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 -- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81500c9ae0 msgr2=0x7f81500ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81500c9ae0 0x7f81500ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 -- 172.21.15.87:0/1362600470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81500ae980 con 0x7f8150157fc0 2024-04-25T15:55:18.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8154d66640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81500c9ae0 0x7f81500ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f8155567640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 0x7f8150145760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8140006e10 tx=0x7f814000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140004030 con 0x7f8150157fc0 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81400041d0 con 0x7f8150157fc0 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.647+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814000c940 con 0x7f8150157fc0 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815014fff0 con 0x7f8150157fc0 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81500c7d20 con 0x7f8150157fc0 2024-04-25T15:55:18.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8150069bb0 con 0x7f8150157fc0 2024-04-25T15:55:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f814000cae0 con 0x7f8150157fc0 2024-04-25T15:55:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f814d7fa640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f813006f400 0x7f8130071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f8154d66640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f813006f400 0x7f8130071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f814008f7a0 con 0x7f8150157fc0 2024-04-25T15:55:18.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.651+0000 7f8154d66640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f813006f400 0x7f8130071910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81480ae000 tx=0x7f8148008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:18.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.659+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8140017020 con 0x7f8150157fc0 2024-04-25T15:55:18.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.851+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f815006d050 con 0x7f8150157fc0 2024-04-25T15:55:18.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.851+0000 7f814d7fa640 1 -- 172.21.15.87:0/1362600470 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7f814005c1c0 con 0x7f8150157fc0 2024-04-25T15:55:18.856 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:18.857 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:18.857 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f813006f400 msgr2=0x7f8130071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f813006f400 0x7f8130071910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81480ae000 tx=0x7f8148008040 comp rx=0 tx=0).stop 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 msgr2=0x7f8150145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 0x7f8150145760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8140006e10 tx=0x7f814000ed20 comp rx=0 tx=0).stop 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 shutdown_connections 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f813006f400 0x7f8130071910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8150157fc0 0x7f8150145760 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81501517d0 0x7f81501ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 --2- 172.21.15.87:0/1362600470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81500c9ae0 0x7f81500ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:18.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 >> 172.21.15.87:0/1362600470 conn(0x7f815006d780 msgr2=0x7f8150073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:18.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 shutdown_connections 2024-04-25T15:55:18.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:18.855+0000 7f8156fca640 1 -- 172.21.15.87:0/1362600470 wait complete. 2024-04-25T15:55:18.877 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=4266 2024-04-25T15:55:18.877 INFO:tasks.mds_thrash.fs.[a]:waiting for 9 secs before reviving mds.c 2024-04-25T15:55:18.937 INFO:tasks.ceph.mds.d.smithi155.stderr:2024-04-25T15:55:18.934+0000 7ffae0256640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:55:19.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:19.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 Processor -- start 2024-04-25T15:55:19.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 -- start start 2024-04-25T15:55:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15f40744e0 0x7f15f4154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15f4154ac0 0x7f15f4161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f4063220 con 0x7f15f40740d0 2024-04-25T15:55:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f15f40c5570 con 0x7f15f4154ac0 2024-04-25T15:55:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15fa31b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f15f4074a90 con 0x7f15f40744e0 2024-04-25T15:55:19.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f3fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f15f40740d0 0x7f15f40c2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52724/0 (socket says 172.21.15.87:52724) 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f88b8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15f4154ac0 0x7f15f4161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f3fff640 1 -- 172.21.15.87:0/167191920 learned_addr learned my addr 172.21.15.87:0/167191920 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f37fe640 1 --2- 172.21.15.87:0/167191920 >> v2:172.21.15.155:3300/0 conn(0x7f15f40744e0 0x7f15f4154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f88b8640 1 -- 172.21.15.87:0/167191920 >> v2:172.21.15.155:3300/0 conn(0x7f15f40744e0 msgr2=0x7f15f4154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f88b8640 1 --2- 172.21.15.87:0/167191920 >> v2:172.21.15.155:3300/0 conn(0x7f15f40744e0 0x7f15f4154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f88b8640 1 -- 172.21.15.87:0/167191920 >> v1:172.21.15.87:6789/0 conn(0x7f15f40740d0 legacy=0x7f15f40c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:19.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.643+0000 7f15f88b8640 1 -- 172.21.15.87:0/167191920 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40634c0 con 0x7f15f4154ac0 2024-04-25T15:55:19.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15f88b8640 1 --2- 172.21.15.87:0/167191920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f4161e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15f4155330 tx=0x7f15e401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99497f74eb79de0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15f2ffd640 1 -- 172.21.15.87:0/167191920 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e40b0070 con 0x7f15f4154ac0 2024-04-25T15:55:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15f2ffd640 1 -- 172.21.15.87:0/167191920 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e40ab600 con 0x7f15f4154ac0 2024-04-25T15:55:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15f2ffd640 1 -- 172.21.15.87:0/167191920 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e40ab9d0 con 0x7f15f4154ac0 2024-04-25T15:55:19.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 -- 172.21.15.87:0/167191920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 msgr2=0x7f15f4161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 --2- 172.21.15.87:0/167191920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f4161e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15f4155330 tx=0x7f15e401c3f0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 -- 172.21.15.87:0/167191920 shutdown_connections 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 --2- 172.21.15.87:0/167191920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f4161e70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 --2- 172.21.15.87:0/167191920 >> v2:172.21.15.155:3300/0 conn(0x7f15f40744e0 0x7f15f4154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 -- 172.21.15.87:0/167191920 >> 172.21.15.87:0/167191920 conn(0x7f15f406d650 msgr2=0x7f15f40c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 -- 172.21.15.87:0/167191920 shutdown_connections 2024-04-25T15:55:19.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.647+0000 7f15fa31b640 1 -- 172.21.15.87:0/167191920 wait complete. 2024-04-25T15:55:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 Processor -- start 2024-04-25T15:55:19.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- start start 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40740d0 0x7f15f40ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40744e0 0x7f15f4143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f15f406dbe0 con 0x7f15f4154ac0 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15f406da60 con 0x7f15f40740d0 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15f40c2a80 con 0x7f15f40744e0 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33832/0 (socket says 172.21.15.87:33832) 2024-04-25T15:55:19.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 -- 172.21.15.87:0/2295221027 learned_addr learned my addr 172.21.15.87:0/2295221027 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f3fff640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40740d0 0x7f15f40ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f37fe640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40744e0 0x7f15f4143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 -- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40744e0 msgr2=0x7f15f4143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40744e0 0x7f15f4143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 -- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40740d0 msgr2=0x7f15f40ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40740d0 0x7f15f40ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 -- 172.21.15.87:0/2295221027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40ae2a0 con 0x7f15f4154ac0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f88b8640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f406ed80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f15e40ae040 tx=0x7f15e4019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e40b0040 con 0x7f15f4154ac0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e40b9070 con 0x7f15f4154ac0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f4150380 con 0x7f15f4154ac0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e40b4630 con 0x7f15f4154ac0 2024-04-25T15:55:19.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f40ac0e0 con 0x7f15f4154ac0 2024-04-25T15:55:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.651+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f4147de0 con 0x7f15f4154ac0 2024-04-25T15:55:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.655+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f15e40b47d0 con 0x7f15f4154ac0 2024-04-25T15:55:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.655+0000 7f15f0ff9640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f15d406f400 0x7f15d4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.655+0000 7f15f3fff640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f15d406f400 0x7f15d4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:19.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.655+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f15e4129de0 con 0x7f15f4154ac0 2024-04-25T15:55:19.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.655+0000 7f15f3fff640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f15d406f400 0x7f15d4071910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15ec000f70 tx=0x7f15ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:19.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.659+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f15f40ae2a0 con 0x7f15f4154ac0 2024-04-25T15:55:19.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15f4072360 con 0x7f15f4154ac0 2024-04-25T15:55:19.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15f0ff9640 1 -- 172.21.15.87:0/2295221027 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7f15e4016070 con 0x7f15f4154ac0 2024-04-25T15:55:19.858 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:19.858 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:19.859 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f15d406f400 msgr2=0x7f15d4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f15d406f400 0x7f15d4071910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15ec000f70 tx=0x7f15ec009040 comp rx=0 tx=0).stop 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 msgr2=0x7f15f406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f406ed80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f15e40ae040 tx=0x7f15e4019190 comp rx=0 tx=0).stop 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 shutdown_connections 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f15d406f400 0x7f15d4071910 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15f4154ac0 0x7f15f406ed80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40744e0 0x7f15f4143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 --2- 172.21.15.87:0/2295221027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40740d0 0x7f15f40ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 >> 172.21.15.87:0/2295221027 conn(0x7f15f406d650 msgr2=0x7f15f41538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 shutdown_connections 2024-04-25T15:55:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:19.855+0000 7f15fa31b640 1 -- 172.21.15.87:0/2295221027 wait complete. 2024-04-25T15:55:19.881 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:21.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:22.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 Processor -- start 2024-04-25T15:55:22.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 -- start start 2024-04-25T15:55:22.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c00aeca0 0x7f01c0074930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01c0151700 0x7f01c0154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f01c006f8a0 0x7f01c006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f01c0070440 con 0x7f01c0151700 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f01c0063710 con 0x7f01c006f8a0 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c87e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01c006dbd0 con 0x7f01c00aeca0 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01c0151700 0x7f01c0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01c0151700 0x7f01c0154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59778/0 (socket says 172.21.15.87:59778) 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 -- 172.21.15.87:0/566103263 learned_addr learned my addr 172.21.15.87:0/566103263 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c6d83640 1 --2- 172.21.15.87:0/566103263 >> v2:172.21.15.155:3300/0 conn(0x7f01c006f8a0 0x7f01c006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c6582640 1 --2- 172.21.15.87:0/566103263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c00aeca0 0x7f01c0074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 -- 172.21.15.87:0/566103263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c00aeca0 msgr2=0x7f01c0074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 --2- 172.21.15.87:0/566103263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c00aeca0 0x7f01c0074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 -- 172.21.15.87:0/566103263 >> v2:172.21.15.155:3300/0 conn(0x7f01c006f8a0 msgr2=0x7f01c006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 --2- 172.21.15.87:0/566103263 >> v2:172.21.15.155:3300/0 conn(0x7f01c006f8a0 0x7f01c006fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.039+0000 7f01c5d81640 1 -- 172.21.15.87:0/566103263 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c0070690 con 0x7f01c0151700 2024-04-25T15:55:22.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c5d81640 1 --2- 172.21.15.87:0/566103263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c0154160 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f01c0063890 tx=0x7f01b401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2144b3ddc65583 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:22.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c5580640 1 -- 172.21.15.87:0/566103263 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a5720 con 0x7f01c0151700 2024-04-25T15:55:22.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c5580640 1 -- 172.21.15.87:0/566103263 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b40a58c0 con 0x7f01c0151700 2024-04-25T15:55:22.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c5580640 1 -- 172.21.15.87:0/566103263 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a5c90 con 0x7f01c0151700 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 -- 172.21.15.87:0/566103263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 msgr2=0x7f01c0154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 --2- 172.21.15.87:0/566103263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c0154160 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f01c0063890 tx=0x7f01b401c8a0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 -- 172.21.15.87:0/566103263 shutdown_connections 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 --2- 172.21.15.87:0/566103263 >> v2:172.21.15.155:3300/0 conn(0x7f01c006f8a0 0x7f01c006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 --2- 172.21.15.87:0/566103263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c0154160 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 --2- 172.21.15.87:0/566103263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c00aeca0 0x7f01c0074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 -- 172.21.15.87:0/566103263 >> 172.21.15.87:0/566103263 conn(0x7f01c006d650 msgr2=0x7f01c00c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 -- 172.21.15.87:0/566103263 shutdown_connections 2024-04-25T15:55:22.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.043+0000 7f01c87e6640 1 -- 172.21.15.87:0/566103263 wait complete. 2024-04-25T15:55:22.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 Processor -- start 2024-04-25T15:55:22.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- start start 2024-04-25T15:55:22.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c006f8a0 0x7f01c00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01c00aeca0 0x7f01c00c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c01437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01c0154820 con 0x7f01c0151700 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01c01546a0 con 0x7f01c00aeca0 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01c0072fb0 con 0x7f01c006f8a0 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c01437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c01437b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59782/0 (socket says 172.21.15.87:59782) 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 -- 172.21.15.87:0/4034523513 learned_addr learned my addr 172.21.15.87:0/4034523513 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c5d81640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01c00aeca0 0x7f01c00c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6582640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c006f8a0 0x7f01c00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 -- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c006f8a0 msgr2=0x7f01c00c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c006f8a0 0x7f01c00c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 -- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01c00aeca0 msgr2=0x7f01c00c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01c00aeca0 0x7f01c00c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 -- 172.21.15.87:0/4034523513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c01f1bc0 con 0x7f01c0151700 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6582640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c006f8a0 0x7f01c00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c5d81640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01c00aeca0 0x7f01c00c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c6d83640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c01437b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d5a0 tx=0x7f01bc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc018020 con 0x7f01c0151700 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01bc014620 con 0x7f01c0151700 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c01f1ea0 con 0x7f01c0151700 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc014a10 con 0x7f01c0151700 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c01f2460 con 0x7f01c0151700 2024-04-25T15:55:22.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.047+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c0069bb0 con 0x7f01c0151700 2024-04-25T15:55:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.051+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f01bc01b020 con 0x7f01c0151700 2024-04-25T15:55:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.051+0000 7f01b2ffd640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f01a406f430 0x7f01a4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.051+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f01bc08fb10 con 0x7f01c0151700 2024-04-25T15:55:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.051+0000 7f01c6582640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f01a406f430 0x7f01a4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:22.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.051+0000 7f01c6582640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f01a406f430 0x7f01a4071940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097a0 tx=0x7f01b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:22.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.055+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01bc022020 con 0x7f01c0151700 2024-04-25T15:55:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01c0063090 con 0x7f01c0151700 2024-04-25T15:55:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01b2ffd640 1 -- 172.21.15.87:0/4034523513 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7f01bc05c660 con 0x7f01c0151700 2024-04-25T15:55:22.255 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:22.255 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:22.255 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:22.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f01a406f430 msgr2=0x7f01a4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f01a406f430 0x7f01a4071940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097a0 tx=0x7f01b8008040 comp rx=0 tx=0).stop 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 msgr2=0x7f01c01437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c01437b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d5a0 tx=0x7f01bc00da60 comp rx=0 tx=0).stop 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 shutdown_connections 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f01a406f430 0x7f01a4071940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01c0151700 0x7f01c01437b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01c00aeca0 0x7f01c00c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 --2- 172.21.15.87:0/4034523513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01c006f8a0 0x7f01c00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 >> 172.21.15.87:0/4034523513 conn(0x7f01c006d650 msgr2=0x7f01c0074830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 shutdown_connections 2024-04-25T15:55:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:22.251+0000 7f01c87e6640 1 -- 172.21.15.87:0/4034523513 wait complete. 2024-04-25T15:55:22.275 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:24.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 Processor -- start 2024-04-25T15:55:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 -- start start 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19d80c9b60 0x7f19d8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80740a0 0x7f19d80744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d80a9e00 con 0x7f19d8152820 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f19d8155900 con 0x7f19d80c9b60 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19df4c1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19d80c8e20 con 0x7f19d80740a0 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19d80c9b60 0x7f19d8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19d80c9b60 0x7f19d8155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59784/0 (socket says 172.21.15.87:59784) 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 -- 172.21.15.87:0/2925774696 learned_addr learned my addr 172.21.15.87:0/2925774696 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dda5e640 1 --2- 172.21.15.87:0/2925774696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80740a0 0x7f19d80744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 -- 172.21.15.87:0/2925774696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80740a0 msgr2=0x7f19d80744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 --2- 172.21.15.87:0/2925774696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80740a0 0x7f19d80744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 -- 172.21.15.87:0/2925774696 >> v1:172.21.15.155:6789/0 conn(0x7f19d8152820 legacy=0x7f19d80c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.431+0000 7f19dd25d640 1 -- 172.21.15.87:0/2925774696 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81552b0 con 0x7f19d80c9b60 2024-04-25T15:55:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19dd25d640 1 --2- 172.21.15.87:0/2925774696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d80c9b60 0x7f19d8155d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009e50 tx=0x7f19d401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49969a2bd66e2527 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19cffff640 1 -- 172.21.15.87:0/2925774696 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d40a5600 con 0x7f19d80c9b60 2024-04-25T15:55:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19cffff640 1 -- 172.21.15.87:0/2925774696 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d40a57a0 con 0x7f19d80c9b60 2024-04-25T15:55:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19cffff640 1 -- 172.21.15.87:0/2925774696 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d40a5b70 con 0x7f19d80c9b60 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 -- 172.21.15.87:0/2925774696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d80c9b60 msgr2=0x7f19d8155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 --2- 172.21.15.87:0/2925774696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d80c9b60 0x7f19d8155d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009e50 tx=0x7f19d401c8d0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 -- 172.21.15.87:0/2925774696 shutdown_connections 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 --2- 172.21.15.87:0/2925774696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80740a0 0x7f19d80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 --2- 172.21.15.87:0/2925774696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d80c9b60 0x7f19d8155d90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 -- 172.21.15.87:0/2925774696 >> 172.21.15.87:0/2925774696 conn(0x7f19d80ac5c0 msgr2=0x7f19d80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 -- 172.21.15.87:0/2925774696 shutdown_connections 2024-04-25T15:55:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.435+0000 7f19df4c1640 1 -- 172.21.15.87:0/2925774696 wait complete. 2024-04-25T15:55:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 Processor -- start 2024-04-25T15:55:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 -- start start 2024-04-25T15:55:24.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d80740a0 0x7f19d814e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:24.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80c9b60 0x7f19d8158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:24.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 0x7f19d81ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:24.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81624c0 con 0x7f19d8152820 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8162340 con 0x7f19d80740a0 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19d8162640 con 0x7f19d80c9b60 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 0x7f19d81ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 0x7f19d81ef3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59786/0 (socket says 172.21.15.87:59786) 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 -- 172.21.15.87:0/1233384537 learned_addr learned my addr 172.21.15.87:0/1233384537 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dca5c640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80c9b60 0x7f19d8158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dd25d640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d80740a0 0x7f19d814e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 -- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80c9b60 msgr2=0x7f19d8158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80c9b60 0x7f19d8158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 -- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d80740a0 msgr2=0x7f19d814e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d80740a0 0x7f19d814e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 -- 172.21.15.87:0/1233384537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81f28a0 con 0x7f19d8152820 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19dda5e640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 0x7f19d81ef3a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f19d000d560 tx=0x7f19d000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d00125f0 con 0x7f19d8152820 2024-04-25T15:55:24.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81f2b80 con 0x7f19d8152820 2024-04-25T15:55:24.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0019070 con 0x7f19d8152820 2024-04-25T15:55:24.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d00129f0 con 0x7f19d8152820 2024-04-25T15:55:24.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.439+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81f3140 con 0x7f19d8152820 2024-04-25T15:55:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.443+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d8069bb0 con 0x7f19d8152820 2024-04-25T15:55:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.443+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19d0012b90 con 0x7f19d8152820 2024-04-25T15:55:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.443+0000 7f19cdffb640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19bc06f430 0x7f19bc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.443+0000 7f19dd25d640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19bc06f430 0x7f19bc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.443+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f19d008fa80 con 0x7f19d8152820 2024-04-25T15:55:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.443+0000 7f19dd25d640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19bc06f430 0x7f19bc071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19d40ae000 tx=0x7f19d40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:24.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.447+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19d005c5e0 con 0x7f19d8152820 2024-04-25T15:55:24.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.643+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19d81543b0 con 0x7f19d8152820 2024-04-25T15:55:24.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.643+0000 7f19cdffb640 1 -- 172.21.15.87:0/1233384537 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7f19d005bee0 con 0x7f19d8152820 2024-04-25T15:55:24.649 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:24.649 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:24.649 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19bc06f430 msgr2=0x7f19bc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19bc06f430 0x7f19bc071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f19d40ae000 tx=0x7f19d40a7070 comp rx=0 tx=0).stop 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 msgr2=0x7f19d81ef3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 0x7f19d81ef3a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f19d000d560 tx=0x7f19d000da20 comp rx=0 tx=0).stop 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 shutdown_connections 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19bc06f430 0x7f19bc071940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19d8152820 0x7f19d81ef3a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19d80c9b60 0x7f19d8158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 --2- 172.21.15.87:0/1233384537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d80740a0 0x7f19d814e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 >> 172.21.15.87:0/1233384537 conn(0x7f19d80ac5c0 msgr2=0x7f19d8153280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 shutdown_connections 2024-04-25T15:55:24.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:24.647+0000 7f19df4c1640 1 -- 172.21.15.87:0/1233384537 wait complete. 2024-04-25T15:55:24.671 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:26.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:26.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 Processor -- start 2024-04-25T15:55:26.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 -- start start 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3341578b0 0x7ff334157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff334158200 0x7ff33415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3340c5290 con 0x7ff3341517d0 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff3340c5e80 con 0x7ff334158200 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff338c6b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff334154fd0 con 0x7ff3341578b0 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff334158200 0x7ff33415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff334158200 0x7ff33415ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59788/0 (socket says 172.21.15.87:59788) 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 -- 172.21.15.87:0/2721024549 learned_addr learned my addr 172.21.15.87:0/2721024549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:26.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff331d9b640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3341578b0 0x7ff334157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:26.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 -- 172.21.15.87:0/2721024549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3341578b0 msgr2=0x7ff334157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:26.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3341578b0 0x7ff334157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:26.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 -- 172.21.15.87:0/2721024549 >> v1:172.21.15.155:6789/0 conn(0x7ff3341517d0 legacy=0x7ff3340c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:26.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff332d9d640 1 -- 172.21.15.87:0/2721024549 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3340c5550 con 0x7ff334158200 2024-04-25T15:55:26.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.827+0000 7ff331d9b640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3341578b0 0x7ff334157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:26.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff332d9d640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff334158200 0x7ff33415ea90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff324009870 tx=0x7ff32401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24ee8474bae2d33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:26.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff33159a640 1 -- 172.21.15.87:0/2721024549 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3240b0070 con 0x7ff334158200 2024-04-25T15:55:26.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff33159a640 1 -- 172.21.15.87:0/2721024549 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3240ab600 con 0x7ff334158200 2024-04-25T15:55:26.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff33159a640 1 -- 172.21.15.87:0/2721024549 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3240ab9d0 con 0x7ff334158200 2024-04-25T15:55:26.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 -- 172.21.15.87:0/2721024549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff334158200 msgr2=0x7ff33415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:26.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff334158200 0x7ff33415ea90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff324009870 tx=0x7ff32401c520 comp rx=0 tx=0).stop 2024-04-25T15:55:26.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 -- 172.21.15.87:0/2721024549 shutdown_connections 2024-04-25T15:55:26.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3341578b0 0x7ff334157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:26.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 --2- 172.21.15.87:0/2721024549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff334158200 0x7ff33415ea90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:26.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 -- 172.21.15.87:0/2721024549 >> 172.21.15.87:0/2721024549 conn(0x7ff33406d780 msgr2=0x7ff33406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:26.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 -- 172.21.15.87:0/2721024549 shutdown_connections 2024-04-25T15:55:26.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.831+0000 7ff338c6b640 1 -- 172.21.15.87:0/2721024549 wait complete. 2024-04-25T15:55:26.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 Processor -- start 2024-04-25T15:55:26.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- start start 2024-04-25T15:55:26.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 0x7ff334149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3341578b0 0x7ff3341f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff334158200 0x7ff3341438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340ac870 con 0x7ff3341517d0 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340ac6f0 con 0x7ff3341578b0 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340a8f70 con 0x7ff334158200 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 0x7ff334149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 0x7ff334149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59798/0 (socket says 172.21.15.87:59798) 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 -- 172.21.15.87:0/3203372921 learned_addr learned my addr 172.21.15.87:0/3203372921 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff331d9b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3341578b0 0x7ff3341f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff332d9d640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff334158200 0x7ff3341438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 -- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff334158200 msgr2=0x7ff3341438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff334158200 0x7ff3341438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 -- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3341578b0 msgr2=0x7ff3341f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:26.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3341578b0 0x7ff3341f2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 -- 172.21.15.87:0/3203372921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3341558a0 con 0x7ff3341517d0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff33259c640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 0x7ff334149900 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00b9f0 tx=0x7ff32c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00cbd0 con 0x7ff3341517d0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c00cd70 con 0x7ff3341517d0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff334155b80 con 0x7ff3341517d0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c003bc0 con 0x7ff3341517d0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3341f1e10 con 0x7ff3341517d0 2024-04-25T15:55:26.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.835+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff334069bb0 con 0x7ff3341517d0 2024-04-25T15:55:26.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.839+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff32c006d10 con 0x7ff3341517d0 2024-04-25T15:55:26.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.839+0000 7ff32affd640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:26.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.839+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7ff32c08f9c0 con 0x7ff3341517d0 2024-04-25T15:55:26.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.839+0000 7ff331d9b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:26.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.839+0000 7ff331d9b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff31c006fd0 tx=0x7ff31c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:26.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:26.843+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff32c05c5f0 con 0x7ff3341517d0 2024-04-25T15:55:27.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.035+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3340c4910 con 0x7ff3341517d0 2024-04-25T15:55:27.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.035+0000 7ff32affd640 1 -- 172.21.15.87:0/3203372921 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7ff32c05bef0 con 0x7ff3341517d0 2024-04-25T15:55:27.041 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:27.041 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:27.041 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:27.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 msgr2=0x7ff314071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:27.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff31c006fd0 tx=0x7ff31c008040 comp rx=0 tx=0).stop 2024-04-25T15:55:27.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 msgr2=0x7ff334149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:27.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 0x7ff334149900 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00b9f0 tx=0x7ff32c00beb0 comp rx=0 tx=0).stop 2024-04-25T15:55:27.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 shutdown_connections 2024-04-25T15:55:27.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff31406f430 0x7ff314071940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:27.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff334158200 0x7ff3341438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:27.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3341578b0 0x7ff3341f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:27.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 --2- 172.21.15.87:0/3203372921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3341517d0 0x7ff334149900 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:27.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 >> 172.21.15.87:0/3203372921 conn(0x7ff33406d780 msgr2=0x7ff33406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:27.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 shutdown_connections 2024-04-25T15:55:27.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:27.039+0000 7ff338c6b640 1 -- 172.21.15.87:0/3203372921 wait complete. 2024-04-25T15:55:27.063 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:27.877 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2024-04-25T15:55:27.878 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:55:27.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:55:27.880 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:55:27.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:27.987 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-04-25T15:55:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.019+0000 7ff02f769640 1 Processor -- start 2024-04-25T15:55:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.019+0000 7ff02f769640 1 -- start start 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02f769640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0281578b0 0x7ff028157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02f769640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff028158200 0x7ff02815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02f769640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0280c5290 con 0x7ff0281517d0 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02f769640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff0280c5e80 con 0x7ff028158200 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02f769640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff028154fd0 con 0x7ff0281578b0 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff028158200 0x7ff02815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff028158200 0x7ff02815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59816/0 (socket says 172.21.15.87:59816) 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 -- 172.21.15.87:0/1623214983 learned_addr learned my addr 172.21.15.87:0/1623214983 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 -- 172.21.15.87:0/1623214983 >> v2:172.21.15.155:3300/0 conn(0x7ff0281578b0 msgr2=0x7ff028157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02cd04640 1 --2- 172.21.15.87:0/1623214983 >> v2:172.21.15.155:3300/0 conn(0x7ff0281578b0 0x7ff028157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 --2- 172.21.15.87:0/1623214983 >> v2:172.21.15.155:3300/0 conn(0x7ff0281578b0 0x7ff028157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 -- 172.21.15.87:0/1623214983 >> v1:172.21.15.155:6789/0 conn(0x7ff0281517d0 legacy=0x7ff0280c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:28.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 -- 172.21.15.87:0/1623214983 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0280c5550 con 0x7ff028158200 2024-04-25T15:55:28.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff02dd06640 1 --2- 172.21.15.87:0/1623214983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff028158200 0x7ff02815ea90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff028074ca0 tx=0x7ff02001ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c32f4b2bb323a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:28.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff01ffff640 1 -- 172.21.15.87:0/1623214983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02000b2d0 con 0x7ff028158200 2024-04-25T15:55:28.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff01ffff640 1 -- 172.21.15.87:0/1623214983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02000b470 con 0x7ff028158200 2024-04-25T15:55:28.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.023+0000 7ff01ffff640 1 -- 172.21.15.87:0/1623214983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0200a79a0 con 0x7ff028158200 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- 172.21.15.87:0/1623214983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff028158200 msgr2=0x7ff02815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 --2- 172.21.15.87:0/1623214983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff028158200 0x7ff02815ea90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff028074ca0 tx=0x7ff02001ebb0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- 172.21.15.87:0/1623214983 shutdown_connections 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 --2- 172.21.15.87:0/1623214983 >> v2:172.21.15.155:3300/0 conn(0x7ff0281578b0 0x7ff028157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 --2- 172.21.15.87:0/1623214983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff028158200 0x7ff02815ea90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- 172.21.15.87:0/1623214983 >> 172.21.15.87:0/1623214983 conn(0x7ff02806d780 msgr2=0x7ff02806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- 172.21.15.87:0/1623214983 shutdown_connections 2024-04-25T15:55:28.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- 172.21.15.87:0/1623214983 wait complete. 2024-04-25T15:55:28.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 Processor -- start 2024-04-25T15:55:28.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- start start 2024-04-25T15:55:28.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0281517d0 0x7ff0280aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 0x7ff02814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff028158200 0x7ff0281efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0280ac870 con 0x7ff0281578b0 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0280ac6f0 con 0x7ff0281517d0 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02f769640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0280a8f70 con 0x7ff028158200 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 0x7ff02814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 0x7ff02814c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59828/0 (socket says 172.21.15.87:59828) 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 -- 172.21.15.87:0/3198849911 learned_addr learned my addr 172.21.15.87:0/3198849911 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02dd06640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff028158200 0x7ff0281efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:28.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02d505640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0281517d0 0x7ff0280aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 -- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff028158200 msgr2=0x7ff0281efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff028158200 0x7ff0281efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 -- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0281517d0 msgr2=0x7ff0280aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0281517d0 0x7ff0280aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.027+0000 7ff02cd04640 1 -- 172.21.15.87:0/3198849911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02814d750 con 0x7ff0281578b0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff02cd04640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 0x7ff02814c5c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff01800c820 tx=0x7ff01800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018015070 con 0x7ff0281578b0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff018007a30 con 0x7ff0281578b0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02814da30 con 0x7ff0281578b0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018007e20 con 0x7ff0281578b0 2024-04-25T15:55:28.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02814dff0 con 0x7ff0281578b0 2024-04-25T15:55:28.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff02814d4e0 con 0x7ff0281578b0 2024-04-25T15:55:28.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff018018070 con 0x7ff0281578b0 2024-04-25T15:55:28.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff01dffb640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff00c06f400 0x7ff00c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:28.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7ff01808f580 con 0x7ff0281578b0 2024-04-25T15:55:28.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff02d505640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff00c06f400 0x7ff00c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:28.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.031+0000 7ff02d505640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff00c06f400 0x7ff00c071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff0280c3c00 tx=0x7ff024008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:28.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.035+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff01805c0d0 con 0x7ff0281578b0 2024-04-25T15:55:28.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.219+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff028069bb0 con 0x7ff0281578b0 2024-04-25T15:55:28.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.219+0000 7ff01dffb640 1 -- 172.21.15.87:0/3198849911 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5666 (secure 0 0 0) 0x7ff0180640c0 con 0x7ff0281578b0 2024-04-25T15:55:28.223 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:28.223 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:28.224 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.219+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff00c06f400 msgr2=0x7ff00c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.219+0000 7ff02f769640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff00c06f400 0x7ff00c071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff0280c3c00 tx=0x7ff024008040 comp rx=0 tx=0).stop 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.219+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 msgr2=0x7ff02814c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.219+0000 7ff02f769640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 0x7ff02814c5c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff01800c820 tx=0x7ff01800cce0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 shutdown_connections 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff00c06f400 0x7ff00c071910 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff028158200 0x7ff0281efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0281578b0 0x7ff02814c5c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 --2- 172.21.15.87:0/3198849911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0281517d0 0x7ff0280aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:28.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 >> 172.21.15.87:0/3198849911 conn(0x7ff02806d780 msgr2=0x7ff028073bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:28.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 shutdown_connections 2024-04-25T15:55:28.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:28.223+0000 7ff02f769640 1 -- 172.21.15.87:0/3198849911 wait complete. 2024-04-25T15:55:28.243 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T15:55:29.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:29.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.218+0000 7fedb0697640 1 Processor -- start 2024-04-25T15:55:29.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedb0697640 1 -- start start 2024-04-25T15:55:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedb0697640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda815ab10 0x7feda815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedb0697640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feda815fe30 0x7feda8162250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedb0697640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda80c45a0 con 0x7feda8154ca0 2024-04-25T15:55:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedb0697640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7feda80c9f30 con 0x7feda815fe30 2024-04-25T15:55:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedb0697640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feda80c3fe0 con 0x7feda815ab10 2024-04-25T15:55:29.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedae433640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feda8154ca0 0x7feda80c5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44254/0 (socket says 172.21.15.87:44254) 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedae433640 1 -- 172.21.15.87:0/3265443364 learned_addr learned my addr 172.21.15.87:0/3265443364 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedaec34640 1 --2- 172.21.15.87:0/3265443364 >> v2:172.21.15.87:3300/0 conn(0x7feda815fe30 0x7feda8162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedadc32640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda815ab10 0x7feda815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedad431640 1 -- 172.21.15.87:0/3265443364 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255829540 0 0) 0x7feda80c45a0 con 0x7feda8154ca0 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedad431640 1 -- 172.21.15.87:0/3265443364 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed94003530 con 0x7feda8154ca0 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedaec34640 1 -- 172.21.15.87:0/3265443364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda815ab10 msgr2=0x7feda815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedaec34640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda815ab10 0x7feda815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedaec34640 1 -- 172.21.15.87:0/3265443364 >> v1:172.21.15.87:6789/0 conn(0x7feda8154ca0 legacy=0x7feda80c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedaec34640 1 -- 172.21.15.87:0/3265443364 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda80c42c0 con 0x7feda815fe30 2024-04-25T15:55:29.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.222+0000 7fedadc32640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda815ab10 0x7feda815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:55:29.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedaec34640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815fe30 0x7feda8162250 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feda0009d90 tx=0x7feda001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a853230933012d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:29.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedad431640 1 -- 172.21.15.87:0/3265443364 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00b2070 con 0x7feda815fe30 2024-04-25T15:55:29.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedad431640 1 -- 172.21.15.87:0/3265443364 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda00a5890 con 0x7feda815fe30 2024-04-25T15:55:29.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedad431640 1 -- 172.21.15.87:0/3265443364 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00a5c60 con 0x7feda815fe30 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 -- 172.21.15.87:0/3265443364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815fe30 msgr2=0x7feda8162250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815fe30 0x7feda8162250 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feda0009d90 tx=0x7feda001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 -- 172.21.15.87:0/3265443364 shutdown_connections 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815fe30 0x7feda8162250 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 --2- 172.21.15.87:0/3265443364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda815ab10 0x7feda815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 -- 172.21.15.87:0/3265443364 >> 172.21.15.87:0/3265443364 conn(0x7feda80ac5c0 msgr2=0x7feda80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:29.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 -- 172.21.15.87:0/3265443364 shutdown_connections 2024-04-25T15:55:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 -- 172.21.15.87:0/3265443364 wait complete. 2024-04-25T15:55:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 Processor -- start 2024-04-25T15:55:29.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.226+0000 7fedb0697640 1 -- start start 2024-04-25T15:55:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda8154ca0 0x7feda8147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 0x7feda8071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feda815fe30 0x7feda81f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feda80c3dc0 con 0x7feda815ab10 2024-04-25T15:55:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feda80c3c40 con 0x7feda815fe30 2024-04-25T15:55:29.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feda815b460 con 0x7feda8154ca0 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 0x7feda8071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 0x7feda8071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59854/0 (socket says 172.21.15.87:59854) 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 -- 172.21.15.87:0/4076003854 learned_addr learned my addr 172.21.15.87:0/4076003854 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedae433640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda8154ca0 0x7feda8147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedaec34640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feda815fe30 0x7feda81f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 -- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda8154ca0 msgr2=0x7feda8147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda8154ca0 0x7feda8147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 -- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feda815fe30 msgr2=0x7feda81f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feda815fe30 0x7feda81f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 -- 172.21.15.87:0/4076003854 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda806ef70 con 0x7feda815ab10 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedaec34640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feda815fe30 0x7feda81f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:29.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedadc32640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 0x7feda8071dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feda400d830 tx=0x7feda400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:29.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4018020 con 0x7feda815ab10 2024-04-25T15:55:29.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda40096c0 con 0x7feda815ab10 2024-04-25T15:55:29.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda806f250 con 0x7feda815ab10 2024-04-25T15:55:29.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4009ab0 con 0x7feda815ab10 2024-04-25T15:55:29.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda8143d60 con 0x7feda815ab10 2024-04-25T15:55:29.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda8069bb0 con 0x7feda815ab10 2024-04-25T15:55:29.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7feda401b020 con 0x7feda815ab10 2024-04-25T15:55:29.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fed9effd640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed8c06f400 0x7fed8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:29.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fedae433640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed8c06f400 0x7fed8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:29.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.230+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7feda408fc20 con 0x7feda815ab10 2024-04-25T15:55:29.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.234+0000 7fedae433640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed8c06f400 0x7fed8c071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed98005890 tx=0x7fed98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:29.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.238+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feda4022020 con 0x7feda815ab10 2024-04-25T15:55:29.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feda8162570 con 0x7feda815ab10 2024-04-25T15:55:29.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fed9effd640 1 -- 172.21.15.87:0/4076003854 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6491 (secure 0 0 0) 0x7feda405c770 con 0x7feda815ab10 2024-04-25T15:55:29.435 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:29.435 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:29.435 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed8c06f400 msgr2=0x7fed8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed8c06f400 0x7fed8c071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fed98005890 tx=0x7fed98009040 comp rx=0 tx=0).stop 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 msgr2=0x7feda8071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 0x7feda8071dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feda400d830 tx=0x7feda400dcf0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 shutdown_connections 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed8c06f400 0x7fed8c071910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feda815fe30 0x7feda81f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feda815ab10 0x7feda8071dd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 --2- 172.21.15.87:0/4076003854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feda8154ca0 0x7feda8147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 >> 172.21.15.87:0/4076003854 conn(0x7feda80ac5c0 msgr2=0x7feda80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 shutdown_connections 2024-04-25T15:55:29.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:29.430+0000 7fedb0697640 1 -- 172.21.15.87:0/4076003854 wait complete. 2024-04-25T15:55:29.455 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:30.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:30.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.394+0000 7f9817cbc640 1 Processor -- start 2024-04-25T15:55:30.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.394+0000 7f9817cbc640 1 -- start start 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9817cbc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 0x7f981006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9817cbc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f98100ad160 0x7f98100c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9817cbc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9810154fc0 con 0x7f98100c4620 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9817cbc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f981006ed60 con 0x7f98100ad160 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9817cbc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f98100acb20 con 0x7f98101518b0 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9816259640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f98100c4620 0x7f9810157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44266/0 (socket says 172.21.15.87:44266) 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9816259640 1 -- 172.21.15.87:0/3082227672 learned_addr learned my addr 172.21.15.87:0/3082227672 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 0x7f981006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795584429 0 0) 0x7f9810154fc0 con 0x7f98100c4620 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815257640 1 --2- 172.21.15.87:0/3082227672 >> v2:172.21.15.155:3300/0 conn(0x7f98100ad160 0x7f98100c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97fc003530 con 0x7f98100c4620 2024-04-25T15:55:30.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 608148736 0 0) 0x7f97fc003530 con 0x7f98100c4620 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 msgr2=0x7f981006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 0x7f981006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 >> v2:172.21.15.155:3300/0 conn(0x7f98100ad160 msgr2=0x7f98100c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 --2- 172.21.15.87:0/3082227672 >> v2:172.21.15.155:3300/0 conn(0x7f98100ad160 0x7f98100c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98100ace00 con 0x7f98100c4620 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f9808001a00 con 0x7f98100c4620 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815257640 1 --2- 172.21.15.87:0/3082227672 >> v2:172.21.15.155:3300/0 conn(0x7f98100ad160 0x7f98100c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 >> v1:172.21.15.87:6789/0 conn(0x7f98100c4620 legacy=0x7f9810157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97fc0039c0 0x7f97fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 0x7f97fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc004d50 0x7f97fc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f981006ed60 con 0x7f97fc0039c0 2024-04-25T15:55:30.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98100acb20 con 0x7f97fc004d50 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc00ba80 con 0x7f98101518b0 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97fc0039c0 0x7f97fc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9816259640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc004d50 0x7f97fc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815257640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 0x7f97fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 -- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 msgr2=0x7f97fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98101518b0 0x7f97fc004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 -- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc004d50 msgr2=0x7f97fc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc004d50 0x7f97fc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9815a58640 1 -- 172.21.15.87:0/3082227672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc003530 con 0x7f97fc0039c0 2024-04-25T15:55:30.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.398+0000 7f9816259640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc004d50 0x7f97fc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:30.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9815a58640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97fc0039c0 0x7f97fc003e30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9800009ab0 tx=0x7f980001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7397a7000602c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000b2070 con 0x7f97fc0039c0 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98000a5660 con 0x7f97fc0039c0 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9814a56640 1 -- 172.21.15.87:0/3082227672 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000096b0 con 0x7f97fc0039c0 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 -- 172.21.15.87:0/3082227672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97fc0039c0 msgr2=0x7f97fc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 --2- 172.21.15.87:0/3082227672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97fc0039c0 0x7f97fc003e30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9800009ab0 tx=0x7f980001ca70 comp rx=0 tx=0).stop 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9816259640 1 -- 172.21.15.87:0/3082227672 reap_dead start 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 -- 172.21.15.87:0/3082227672 shutdown_connections 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 -- 172.21.15.87:0/3082227672 >> 172.21.15.87:0/3082227672 conn(0x7f98100c8770 msgr2=0x7f98100c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 -- 172.21.15.87:0/3082227672 shutdown_connections 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 -- 172.21.15.87:0/3082227672 wait complete. 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 Processor -- start 2024-04-25T15:55:30.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.402+0000 7f9817cbc640 1 -- start start 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc0039c0 0x7f98101df6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98100c7b20 0x7f98101554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 0x7f98101f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f981006f860 con 0x7f98101f41d0 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f981006f6e0 con 0x7f97fc0039c0 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f981006f9e0 con 0x7f98100c7b20 2024-04-25T15:55:30.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 0x7f98101f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 0x7f98101f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59886/0 (socket says 172.21.15.87:59886) 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 -- 172.21.15.87:0/1816615180 learned_addr learned my addr 172.21.15.87:0/1816615180 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9815257640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98100c7b20 0x7f98101554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9815a58640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc0039c0 0x7f98101df6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 -- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98100c7b20 msgr2=0x7f98101554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98100c7b20 0x7f98101554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 -- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc0039c0 msgr2=0x7f98101df6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc0039c0 0x7f98101df6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 -- 172.21.15.87:0/1816615180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98101f0c50 con 0x7f98101f41d0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9816259640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 0x7f98101f45e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f98100ae910 tx=0x7f980800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808004d70 con 0x7f98101f41d0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980800bb20 con 0x7f98101f41d0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98101f0f30 con 0x7f98101f41d0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808007070 con 0x7f98101f41d0 2024-04-25T15:55:30.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101f14f0 con 0x7f98101f41d0 2024-04-25T15:55:30.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.406+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9810069bb0 con 0x7f98101f41d0 2024-04-25T15:55:30.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.410+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f980801b020 con 0x7f98101f41d0 2024-04-25T15:55:30.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.410+0000 7f98067fc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f97f406f400 0x7f97f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:30.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.410+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f980808fe60 con 0x7f98101f41d0 2024-04-25T15:55:30.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.410+0000 7f9815a58640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f97f406f400 0x7f97f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:30.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.410+0000 7f9815a58640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f97f406f400 0x7f97f4071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f98000af000 tx=0x7f98000046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:30.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.414+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9808022070 con 0x7f98101f41d0 2024-04-25T15:55:30.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.610+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98100c4210 con 0x7f98101f41d0 2024-04-25T15:55:30.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.610+0000 7f98067fc640 1 -- 172.21.15.87:0/1816615180 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6491 (secure 0 0 0) 0x7f980805c9b0 con 0x7f98101f41d0 2024-04-25T15:55:30.616 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:30.616 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:30.616 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-04-25T15:55:30.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f97f406f400 msgr2=0x7f97f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:30.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f97f406f400 0x7f97f4071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f98000af000 tx=0x7f98000046d0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 msgr2=0x7f98101f45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 0x7f98101f45e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f98100ae910 tx=0x7f980800b4a0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 shutdown_connections 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f97f406f400 0x7f97f4071910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98101f41d0 0x7f98101f45e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98100c7b20 0x7f98101554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 --2- 172.21.15.87:0/1816615180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc0039c0 0x7f98101df6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 >> 172.21.15.87:0/1816615180 conn(0x7f98100c8770 msgr2=0x7f98100ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 shutdown_connections 2024-04-25T15:55:30.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:30.614+0000 7f9817cbc640 1 -- 172.21.15.87:0/1816615180 wait complete. 2024-04-25T15:55:30.637 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2024-04-25T15:55:30.638 INFO:tasks.mds_thrash.fs.[a]:waiting for 73 secs before thrashing 2024-04-25T15:55:31.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:31.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b36557640 1 Processor -- start 2024-04-25T15:55:31.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b36557640 1 -- start start 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b36557640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b301517d0 0x7f0b300c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b36557640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b300c5290 con 0x7f0b300c9ae0 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b36557640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b300c5550 con 0x7f0b30157fc0 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b36557640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0b300c5e80 con 0x7f0b301517d0 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b301517d0 0x7f0b300c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2f7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0b300c9ae0 0x7f0b301578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44758/0 (socket says 172.21.15.87:44758) 2024-04-25T15:55:31.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2f7fe640 1 -- 172.21.15.87:0/218197197 learned_addr learned my addr 172.21.15.87:0/218197197 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:31.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2ffff640 1 -- 172.21.15.87:0/218197197 >> v1:172.21.15.155:6789/0 conn(0x7f0b30157fc0 legacy=0x7f0b3015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:31.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2ffff640 1 -- 172.21.15.87:0/218197197 >> v1:172.21.15.87:6789/0 conn(0x7f0b300c9ae0 legacy=0x7f0b301578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:31.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2ffff640 1 -- 172.21.15.87:0/218197197 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b300c5830 con 0x7f0b301517d0 2024-04-25T15:55:31.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.610+0000 7f0b2effd640 1 -- 172.21.15.87:0/218197197 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787687961 0 0) 0x7f0b300c5290 con 0x7f0b300c9ae0 2024-04-25T15:55:31.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b2ffff640 1 --2- 172.21.15.87:0/218197197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b301517d0 0x7f0b300c95a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b2801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53af0ef6c57f100 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:31.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b2effd640 1 -- 172.21.15.87:0/218197197 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280b2070 con 0x7f0b301517d0 2024-04-25T15:55:31.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b2effd640 1 -- 172.21.15.87:0/218197197 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b280a57f0 con 0x7f0b301517d0 2024-04-25T15:55:31.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b2effd640 1 -- 172.21.15.87:0/218197197 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280a5bc0 con 0x7f0b301517d0 2024-04-25T15:55:31.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 -- 172.21.15.87:0/218197197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b301517d0 msgr2=0x7f0b300c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:31.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 --2- 172.21.15.87:0/218197197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b301517d0 0x7f0b300c95a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b2801c930 comp rx=0 tx=0).stop 2024-04-25T15:55:31.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 -- 172.21.15.87:0/218197197 shutdown_connections 2024-04-25T15:55:31.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 --2- 172.21.15.87:0/218197197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b301517d0 0x7f0b300c95a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 -- 172.21.15.87:0/218197197 >> 172.21.15.87:0/218197197 conn(0x7f0b3006d780 msgr2=0x7f0b3006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:31.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 -- 172.21.15.87:0/218197197 shutdown_connections 2024-04-25T15:55:31.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.614+0000 7f0b36557640 1 -- 172.21.15.87:0/218197197 wait complete. 2024-04-25T15:55:31.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 Processor -- start 2024-04-25T15:55:31.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 -- start start 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300c9ae0 0x7f0b301473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b301517d0 0x7f0b300acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 0x7f0b30141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0b300a90f0 con 0x7f0b30157fc0 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b300a8f70 con 0x7f0b300c9ae0 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b301629d0 con 0x7f0b301517d0 2024-04-25T15:55:31.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 0x7f0b30141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 0x7f0b30141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51486/0 (socket says 172.21.15.87:51486) 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 -- 172.21.15.87:0/1734321118 learned_addr learned my addr 172.21.15.87:0/1734321118 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b2ffff640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300c9ae0 0x7f0b301473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b2f7fe640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b301517d0 0x7f0b300acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 -- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b301517d0 msgr2=0x7f0b300acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b301517d0 0x7f0b300acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 -- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300c9ae0 msgr2=0x7f0b301473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300c9ae0 0x7f0b301473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 -- 172.21.15.87:0/1734321118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b301454d0 con 0x7f0b30157fc0 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b2ffff640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300c9ae0 0x7f0b301473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:31.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b34af4640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 0x7f0b30141d00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b410 tx=0x7f0b2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20015020 con 0x7f0b30157fc0 2024-04-25T15:55:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b20011870 con 0x7f0b30157fc0 2024-04-25T15:55:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b301ef9e0 con 0x7f0b30157fc0 2024-04-25T15:55:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011c60 con 0x7f0b30157fc0 2024-04-25T15:55:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.618+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b300aea20 con 0x7f0b30157fc0 2024-04-25T15:55:31.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.622+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b30069bb0 con 0x7f0b30157fc0 2024-04-25T15:55:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.622+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b20018020 con 0x7f0b30157fc0 2024-04-25T15:55:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.622+0000 7f0b2cff9640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b1006f400 0x7f0b10071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.622+0000 7f0b2ffff640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b1006f400 0x7f0b10071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.622+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f0b2008fa30 con 0x7f0b30157fc0 2024-04-25T15:55:31.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.622+0000 7f0b2ffff640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b1006f400 0x7f0b10071910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b280af000 tx=0x7f0b280a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:31.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.626+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b2001f020 con 0x7f0b30157fc0 2024-04-25T15:55:31.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.822+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b300c4910 con 0x7f0b30157fc0 2024-04-25T15:55:31.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.822+0000 7f0b2cff9640 1 -- 172.21.15.87:0/1734321118 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6491 (secure 0 0 0) 0x7f0b301454d0 con 0x7f0b30157fc0 2024-04-25T15:55:31.828 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:31.828 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:31.828 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-04-25T15:55:31.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b1006f400 msgr2=0x7f0b10071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:31.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b1006f400 0x7f0b10071910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b280af000 tx=0x7f0b280a7070 comp rx=0 tx=0).stop 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 msgr2=0x7f0b30141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 0x7f0b30141d00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b410 tx=0x7f0b2000b8d0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 shutdown_connections 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b1006f400 0x7f0b10071910 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b30157fc0 0x7f0b30141d00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b301517d0 0x7f0b300acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 --2- 172.21.15.87:0/1734321118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b300c9ae0 0x7f0b301473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 >> 172.21.15.87:0/1734321118 conn(0x7f0b3006d780 msgr2=0x7f0b300abe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 shutdown_connections 2024-04-25T15:55:31.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:31.826+0000 7f0b36557640 1 -- 172.21.15.87:0/1734321118 wait complete. 2024-04-25T15:55:31.850 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:33.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:34.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 Processor -- start 2024-04-25T15:55:34.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 -- start start 2024-04-25T15:55:34.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f20157530 0x7f1f20074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200746a0 0x7f1f200c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f200c9100 0x7f1f2015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1f20157940 con 0x7f1f200c9100 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1f200c53b0 con 0x7f1f20157530 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f2547e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f20157b60 con 0x7f1f200746a0 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f200c9100 0x7f1f2015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f200c9100 0x7f1f2015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51498/0 (socket says 172.21.15.87:51498) 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1953745057 learned_addr learned my addr 172.21.15.87:0/1953745057 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1effd640 1 --2- 172.21.15.87:0/1953745057 >> v2:172.21.15.155:3300/0 conn(0x7f1f20157530 0x7f1f20074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1e7fc640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200746a0 0x7f1f200c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1953745057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200746a0 msgr2=0x7f1f200c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200746a0 0x7f1f200c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1953745057 >> v2:172.21.15.155:3300/0 conn(0x7f1f20157530 msgr2=0x7f1f20074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 --2- 172.21.15.87:0/1953745057 >> v2:172.21.15.155:3300/0 conn(0x7f1f20157530 0x7f1f20074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1953745057 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f20157e40 con 0x7f1f200c9100 2024-04-25T15:55:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.006+0000 7f1f1e7fc640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200746a0 0x7f1f200c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:34.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f1f7fe640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f200c9100 0x7f1f2015ab20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1f2006bb90 tx=0x7f1f1801c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d2be1aa833ce4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f1dffb640 1 -- 172.21.15.87:0/1953745057 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180ac020 con 0x7f1f200c9100 2024-04-25T15:55:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f1dffb640 1 -- 172.21.15.87:0/1953745057 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f180a6470 con 0x7f1f200c9100 2024-04-25T15:55:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f1dffb640 1 -- 172.21.15.87:0/1953745057 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180a6840 con 0x7f1f200c9100 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 -- 172.21.15.87:0/1953745057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f200c9100 msgr2=0x7f1f2015ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f200c9100 0x7f1f2015ab20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1f2006bb90 tx=0x7f1f1801c5e0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 -- 172.21.15.87:0/1953745057 shutdown_connections 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f200c9100 0x7f1f2015ab20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1953745057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200746a0 0x7f1f200c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1953745057 >> v2:172.21.15.155:3300/0 conn(0x7f1f20157530 0x7f1f20074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 -- 172.21.15.87:0/1953745057 >> 172.21.15.87:0/1953745057 conn(0x7f1f200ac550 msgr2=0x7f1f200ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 -- 172.21.15.87:0/1953745057 shutdown_connections 2024-04-25T15:55:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 -- 172.21.15.87:0/1953745057 wait complete. 2024-04-25T15:55:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 Processor -- start 2024-04-25T15:55:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.010+0000 7f1f2547e640 1 -- start start 2024-04-25T15:55:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f200746a0 0x7f1f2015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200c9100 0x7f1f2014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 0x7f1f20151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1f20154df0 con 0x7f1f20157530 2024-04-25T15:55:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f200aa230 con 0x7f1f200746a0 2024-04-25T15:55:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f20154f70 con 0x7f1f200c9100 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 0x7f1f20151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 0x7f1f20151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51514/0 (socket says 172.21.15.87:51514) 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1605902507 learned_addr learned my addr 172.21.15.87:0/1605902507 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1effd640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f200746a0 0x7f1f2015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1e7fc640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200c9100 0x7f1f2014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200c9100 msgr2=0x7f1f2014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200c9100 0x7f1f2014e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f200746a0 msgr2=0x7f1f2015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f200746a0 0x7f1f2015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 -- 172.21.15.87:0/1605902507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f20150e80 con 0x7f1f20157530 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1effd640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f200746a0 0x7f1f2015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1e7fc640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200c9100 0x7f1f2014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f1f7fe640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 0x7f1f20151640 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1f180ab040 tx=0x7f1f18019380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180ac040 con 0x7f1f20157530 2024-04-25T15:55:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f180a7670 con 0x7f1f20157530 2024-04-25T15:55:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2014cab0 con 0x7f1f20157530 2024-04-25T15:55:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18009510 con 0x7f1f20157530 2024-04-25T15:55:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f201f1f40 con 0x7f1f20157530 2024-04-25T15:55:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f20069bb0 con 0x7f1f20157530 2024-04-25T15:55:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1f180af020 con 0x7f1f20157530 2024-04-25T15:55:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.014+0000 7f1f177fe640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1f0006f400 0x7f1f00071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.018+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6781+0+0 (secure 0 0 0) 0x7f1f18129640 con 0x7f1f20157530 2024-04-25T15:55:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.018+0000 7f1f1effd640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1f0006f400 0x7f1f00071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.018+0000 7f1f1effd640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1f0006f400 0x7f1f00071910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f20072d10 tx=0x7f1f10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.022+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f180c1060 con 0x7f1f20157530 2024-04-25T15:55:34.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.206+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f200c5fa0 con 0x7f1f20157530 2024-04-25T15:55:34.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.206+0000 7f1f177fe640 1 -- 172.21.15.87:0/1605902507 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6491 (secure 0 0 0) 0x7f1f180165e0 con 0x7f1f20157530 2024-04-25T15:55:34.213 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5262,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:54:23.848714+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6836/2742361177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2742361177},{"type":"v1","addr":"172.21.15.87:6836","nonce":2742361177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4263,"qdb_cluster":[4263]},"id":2}]} 2024-04-25T15:55:34.213 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-04-25T15:55:34.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1f0006f400 msgr2=0x7f1f00071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:34.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1f0006f400 0x7f1f00071910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f20072d10 tx=0x7f1f10008040 comp rx=0 tx=0).stop 2024-04-25T15:55:34.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 msgr2=0x7f1f20151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:34.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 0x7f1f20151640 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1f180ab040 tx=0x7f1f18019380 comp rx=0 tx=0).stop 2024-04-25T15:55:34.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 shutdown_connections 2024-04-25T15:55:34.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1f0006f400 0x7f1f00071910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f20157530 0x7f1f20151640 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f200c9100 0x7f1f2014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 --2- 172.21.15.87:0/1605902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f200746a0 0x7f1f2015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 >> 172.21.15.87:0/1605902507 conn(0x7f1f200ac550 msgr2=0x7f1f200c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 shutdown_connections 2024-04-25T15:55:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:34.210+0000 7f1f2547e640 1 -- 172.21.15.87:0/1605902507 wait complete. 2024-04-25T15:55:34.233 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:55:36.234 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:36.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbff85640 1 Processor -- start 2024-04-25T15:55:36.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbff85640 1 -- start start 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbff85640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bb80c9b60 0x7f0bb8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbff85640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb80a9e00 con 0x7f0bb8152820 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbff85640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb81552b0 con 0x7f0bb80740a0 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbff85640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb8155900 con 0x7f0bb80c9b60 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbd520640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0bb8152820 0x7f0bb80c8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44762/0 (socket says 172.21.15.87:44762) 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbd520640 1 -- 172.21.15.87:0/2048735591 learned_addr learned my addr 172.21.15.87:0/2048735591 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbdd21640 1 --2- 172.21.15.87:0/2048735591 >> v2:172.21.15.87:3300/0 conn(0x7f0bb80c9b60 0x7f0bb8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbdd21640 1 -- 172.21.15.87:0/2048735591 >> v1:172.21.15.155:6789/0 conn(0x7f0bb80740a0 legacy=0x7f0bb815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbdd21640 1 -- 172.21.15.87:0/2048735591 >> v1:172.21.15.87:6789/0 conn(0x7f0bb8152820 legacy=0x7f0bb80c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.390+0000 7f0bbdd21640 1 -- 172.21.15.87:0/2048735591 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb8155590 con 0x7f0bb80c9b60 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbdd21640 1 --2- 172.21.15.87:0/2048735591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80c9b60 0x7f0bb8155d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40097c0 tx=0x7f0bb401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ec4e3c0a57ffa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbcd1f640 1 -- 172.21.15.87:0/2048735591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40b0070 con 0x7f0bb80c9b60 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbcd1f640 1 -- 172.21.15.87:0/2048735591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb40ab600 con 0x7f0bb80c9b60 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbcd1f640 1 -- 172.21.15.87:0/2048735591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40ab9d0 con 0x7f0bb80c9b60 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 -- 172.21.15.87:0/2048735591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80c9b60 msgr2=0x7f0bb8155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 --2- 172.21.15.87:0/2048735591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80c9b60 0x7f0bb8155d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40097c0 tx=0x7f0bb401c340 comp rx=0 tx=0).stop 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 -- 172.21.15.87:0/2048735591 shutdown_connections 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 --2- 172.21.15.87:0/2048735591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80c9b60 0x7f0bb8155d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 -- 172.21.15.87:0/2048735591 >> 172.21.15.87:0/2048735591 conn(0x7f0bb80ac5c0 msgr2=0x7f0bb80ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 -- 172.21.15.87:0/2048735591 shutdown_connections 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.394+0000 7f0bbff85640 1 -- 172.21.15.87:0/2048735591 wait complete. 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 Processor -- start 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- start start 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 0x7f0bb80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80c9b60 0x7f0bb80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb8152820 0x7f0bb814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb8163c70 con 0x7f0bb80740a0 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80748c0 con 0x7f0bb80c9b60 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb8163df0 con 0x7f0bb8152820 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 0x7f0bb80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 0x7f0bb80ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51518/0 (socket says 172.21.15.87:51518) 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 -- 172.21.15.87:0/592033664 learned_addr learned my addr 172.21.15.87:0/592033664 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 -- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb8152820 msgr2=0x7f0bb814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb8152820 0x7f0bb814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbd520640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80c9b60 0x7f0bb80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 -- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80c9b60 msgr2=0x7f0bb80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80c9b60 0x7f0bb80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 -- 172.21.15.87:0/592033664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80b02c0 con 0x7f0bb80740a0 2024-04-25T15:55:36.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbdd21640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 0x7f0bb80ad930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4018f50 tx=0x7f0bb401ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40b0050 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb40bc070 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb8147870 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40b5a70 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb81585d0 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.398+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb8069bb0 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.402+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0bb40ab4c0 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.402+0000 7f0bae7fc640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b9c06f430 0x7f0b9c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.402+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7f0bb412aa10 con 0x7f0bb80740a0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.402+0000 7f0bbd520640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b9c06f430 0x7f0b9c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.402+0000 7f0bbd520640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b9c06f430 0x7f0b9c071940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bb814e3f0 tx=0x7f0ba8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:36.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.406+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0bb4016050 con 0x7f0bb80740a0 2024-04-25T15:55:36.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.598+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bb80ab6e0 con 0x7f0bb80740a0 2024-04-25T15:55:36.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bae7fc640 1 -- 172.21.15.87:0/592033664 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5660 (secure 0 0 0) 0x7f0bb40f7670 con 0x7f0bb80740a0 2024-04-25T15:55:36.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:36.606 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:35.253426+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:55:36.607 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-04-25T15:55:36.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b9c06f430 msgr2=0x7f0b9c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b9c06f430 0x7f0b9c071940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bb814e3f0 tx=0x7f0ba8009040 comp rx=0 tx=0).stop 2024-04-25T15:55:36.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 msgr2=0x7f0bb80ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 0x7f0bb80ad930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4018f50 tx=0x7f0bb401ab80 comp rx=0 tx=0).stop 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 shutdown_connections 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0b9c06f430 0x7f0b9c071940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb8152820 0x7f0bb814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb80c9b60 0x7f0bb80afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 --2- 172.21.15.87:0/592033664 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb80740a0 0x7f0bb80ad930 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 >> 172.21.15.87:0/592033664 conn(0x7f0bb80ac5c0 msgr2=0x7f0bb80aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 shutdown_connections 2024-04-25T15:55:36.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.602+0000 7f0bbff85640 1 -- 172.21.15.87:0/592033664 wait complete. 2024-04-25T15:55:36.627 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2024-04-25T15:55:36.627 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T15:55:36.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:36.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 Processor -- start 2024-04-25T15:55:36.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 -- start start 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4152980 0x7f0db40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0db4155320 0x7f0db4155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db4152d90 con 0x7f0db4074160 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0db40aa290 con 0x7f0db4155320 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbc5e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0db41598b0 con 0x7f0db4152980 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9b81640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0db4155320 0x7f0db4155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbab83640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0db4074160 0x7f0db40c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44778/0 (socket says 172.21.15.87:44778) 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dbab83640 1 -- 172.21.15.87:0/3025350285 learned_addr learned my addr 172.21.15.87:0/3025350285 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0dba382640 1 --2- 172.21.15.87:0/3025350285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4152980 0x7f0db40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9380640 1 -- 172.21.15.87:0/3025350285 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506199848 0 0) 0x7f0db4152d90 con 0x7f0db4074160 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9380640 1 -- 172.21.15.87:0/3025350285 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0da0003530 con 0x7f0db4074160 2024-04-25T15:55:36.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9b81640 1 -- 172.21.15.87:0/3025350285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4152980 msgr2=0x7f0db40c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9b81640 1 --2- 172.21.15.87:0/3025350285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4152980 0x7f0db40c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9b81640 1 -- 172.21.15.87:0/3025350285 >> v1:172.21.15.87:6789/0 conn(0x7f0db4074160 legacy=0x7f0db40c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.758+0000 7f0db9b81640 1 -- 172.21.15.87:0/3025350285 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db40ca2f0 con 0x7f0db4155320 2024-04-25T15:55:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0db9b81640 1 --2- 172.21.15.87:0/3025350285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4155320 0x7f0db4155730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0da40097c0 tx=0x7f0da401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590d54290fecb0cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0db9380640 1 -- 172.21.15.87:0/3025350285 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40b0070 con 0x7f0db4155320 2024-04-25T15:55:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0db9380640 1 -- 172.21.15.87:0/3025350285 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da40ab600 con 0x7f0db4155320 2024-04-25T15:55:36.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0db9380640 1 -- 172.21.15.87:0/3025350285 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40ab9d0 con 0x7f0db4155320 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3025350285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4155320 msgr2=0x7f0db4155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3025350285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4155320 0x7f0db4155730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0da40097c0 tx=0x7f0da401c410 comp rx=0 tx=0).stop 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3025350285 shutdown_connections 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3025350285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4155320 0x7f0db4155730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3025350285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4152980 0x7f0db40c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3025350285 >> 172.21.15.87:0/3025350285 conn(0x7f0db40ac550 msgr2=0x7f0db40ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3025350285 shutdown_connections 2024-04-25T15:55:36.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3025350285 wait complete. 2024-04-25T15:55:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 Processor -- start 2024-04-25T15:55:36.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.762+0000 7f0dbc5e6640 1 -- start start 2024-04-25T15:55:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4074160 0x7f0db4157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 0x7f0db4156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0db4155320 0x7f0db4151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4158f70 con 0x7f0db4152980 2024-04-25T15:55:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4158c90 con 0x7f0db4155320 2024-04-25T15:55:36.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0db40729c0 con 0x7f0db4074160 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 0x7f0db4156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 0x7f0db4156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51538/0 (socket says 172.21.15.87:51538) 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 -- 172.21.15.87:0/3304122759 learned_addr learned my addr 172.21.15.87:0/3304122759 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbab83640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0db4155320 0x7f0db4151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 -- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4074160 msgr2=0x7f0db4157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dba382640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4074160 0x7f0db4157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4074160 0x7f0db4157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 -- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0db4155320 msgr2=0x7f0db4151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0db4155320 0x7f0db4151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 -- 172.21.15.87:0/3304122759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db4149c00 con 0x7f0db4152980 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0db9b81640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 0x7f0db4156710 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0da401a040 tx=0x7f0da40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40ba070 con 0x7f0db4152980 2024-04-25T15:55:36.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da40b5460 con 0x7f0db4152980 2024-04-25T15:55:36.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db4149920 con 0x7f0db4152980 2024-04-25T15:55:36.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40b0040 con 0x7f0db4152980 2024-04-25T15:55:36.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db414fa10 con 0x7f0db4152980 2024-04-25T15:55:36.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db414fbe0 con 0x7f0db4152980 2024-04-25T15:55:36.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0da40bd070 con 0x7f0db4152980 2024-04-25T15:55:36.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.766+0000 7f0daaffd640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d9806f400 0x7f0d98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:36.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.770+0000 7f0dba382640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d9806f400 0x7f0d98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:36.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.770+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7f0da4129780 con 0x7f0db4152980 2024-04-25T15:55:36.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.770+0000 7f0dba382640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d9806f400 0x7f0d98071910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0db00096f0 tx=0x7f0db0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:36.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.774+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0da4016090 con 0x7f0db4152980 2024-04-25T15:55:36.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.954+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0db4069bb0 con 0x7f0db4152980 2024-04-25T15:55:36.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.954+0000 7f0daaffd640 1 -- 172.21.15.87:0/3304122759 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5660 (secure 0 0 0) 0x7f0da40f6300 con 0x7f0db4152980 2024-04-25T15:55:36.959 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:36.959 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:35.253426+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:55:36.960 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-04-25T15:55:36.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d9806f400 msgr2=0x7f0d98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d9806f400 0x7f0d98071910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0db00096f0 tx=0x7f0db0008040 comp rx=0 tx=0).stop 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 msgr2=0x7f0db4156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 0x7f0db4156710 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0da401a040 tx=0x7f0da40191b0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 shutdown_connections 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0d9806f400 0x7f0d98071910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0db4155320 0x7f0db4151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db4152980 0x7f0db4156710 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 --2- 172.21.15.87:0/3304122759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0db4074160 0x7f0db4157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 >> 172.21.15.87:0/3304122759 conn(0x7f0db40ac550 msgr2=0x7f0db4155730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 shutdown_connections 2024-04-25T15:55:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:36.958+0000 7f0dbc5e6640 1 -- 172.21.15.87:0/3304122759 wait complete. 2024-04-25T15:55:36.980 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4246": { "addr": "172.21.15.155:6833/1039729746", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 1039729746, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 1039729746, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4246, "incarnation": 16, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 21 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:55:17.253786+0000", "qdb_cluster": [ 4246 ], "qdb_leader": 4246, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4246 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5262": { "addr": "172.21.15.87:6835/1293807006", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 1293807006, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 1293807006, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5262, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:55:35.253426+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5262 } } } ], "standbys": [ { "addr": "172.21.15.155:6835/630698588", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 630698588, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 630698588, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T15:55:38.322 INFO:tasks.ceph.mds.c.smithi087.stderr:2024-04-25T15:55:38.318+0000 7f2748b74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:55:38.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:38.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:38.982 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:39.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.134+0000 7fa1ba311640 1 Processor -- start 2024-04-25T15:55:39.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.134+0000 7fa1ba311640 1 -- start start 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1ba311640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1b414d810 0x7fa1b4157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1ba311640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b4157d50 con 0x7fa1b406ee80 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1ba311640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b40add10 con 0x7fa1b4154d00 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1ba311640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b40adff0 con 0x7fa1b414d810 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1b414d810 0x7fa1b4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b88ae640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa1b406ee80 0x7fa1b406f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44792/0 (socket says 172.21.15.87:44792) 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b88ae640 1 -- 172.21.15.87:0/3464304237 learned_addr learned my addr 172.21.15.87:0/3464304237 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b3fff640 1 -- 172.21.15.87:0/3464304237 >> v1:172.21.15.155:6789/0 conn(0x7fa1b4154d00 legacy=0x7fa1b4154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b3fff640 1 -- 172.21.15.87:0/3464304237 >> v1:172.21.15.87:6789/0 conn(0x7fa1b406ee80 legacy=0x7fa1b406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b3fff640 1 -- 172.21.15.87:0/3464304237 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b4157010 con 0x7fa1b414d810 2024-04-25T15:55:39.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.138+0000 7fa1b2ffd640 1 -- 172.21.15.87:0/3464304237 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736640127 0 0) 0x7fa1b4157d50 con 0x7fa1b406ee80 2024-04-25T15:55:39.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1b3fff640 1 --2- 172.21.15.87:0/3464304237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b414d810 0x7fa1b4157810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40097c0 tx=0x7fa1a401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebe463880f206ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:39.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1b2ffd640 1 -- 172.21.15.87:0/3464304237 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40b0070 con 0x7fa1b414d810 2024-04-25T15:55:39.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1b2ffd640 1 -- 172.21.15.87:0/3464304237 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a40ab600 con 0x7fa1b414d810 2024-04-25T15:55:39.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1b2ffd640 1 -- 172.21.15.87:0/3464304237 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40ab9d0 con 0x7fa1b414d810 2024-04-25T15:55:39.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 -- 172.21.15.87:0/3464304237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b414d810 msgr2=0x7fa1b4157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:39.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 --2- 172.21.15.87:0/3464304237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b414d810 0x7fa1b4157810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40097c0 tx=0x7fa1a401c340 comp rx=0 tx=0).stop 2024-04-25T15:55:39.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 -- 172.21.15.87:0/3464304237 shutdown_connections 2024-04-25T15:55:39.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 --2- 172.21.15.87:0/3464304237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b414d810 0x7fa1b4157810 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 -- 172.21.15.87:0/3464304237 >> 172.21.15.87:0/3464304237 conn(0x7fa1b40c8770 msgr2=0x7fa1b40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:39.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 -- 172.21.15.87:0/3464304237 shutdown_connections 2024-04-25T15:55:39.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 -- 172.21.15.87:0/3464304237 wait complete. 2024-04-25T15:55:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 Processor -- start 2024-04-25T15:55:39.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.142+0000 7fa1ba311640 1 -- start start 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b406ee80 0x7fa1b4072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1b414d810 0x7fa1b41f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 0x7fa1b4149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4155290 con 0x7fa1b4154d00 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4155110 con 0x7fa1b406ee80 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b4162ad0 con 0x7fa1b414d810 2024-04-25T15:55:39.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 0x7fa1b4149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 0x7fa1b4149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51550/0 (socket says 172.21.15.87:51550) 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 -- 172.21.15.87:0/1291774209 learned_addr learned my addr 172.21.15.87:0/1291774209 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b3fff640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b406ee80 0x7fa1b4072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b37fe640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1b414d810 0x7fa1b41f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 -- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1b414d810 msgr2=0x7fa1b41f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1b414d810 0x7fa1b41f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 -- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b406ee80 msgr2=0x7fa1b4072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b406ee80 0x7fa1b4072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 -- 172.21.15.87:0/1291774209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b41f51c0 con 0x7fa1b4154d00 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b37fe640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1b414d810 0x7fa1b41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b3fff640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b406ee80 0x7fa1b4072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b88ae640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 0x7fa1b4149eb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c440 tx=0x7fa1ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:39.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac017070 con 0x7fa1b4154d00 2024-04-25T15:55:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ac005d10 con 0x7fa1b4154d00 2024-04-25T15:55:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac007310 con 0x7fa1b4154d00 2024-04-25T15:55:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b414d300 con 0x7fa1b4154d00 2024-04-25T15:55:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b414b080 con 0x7fa1b4154d00 2024-04-25T15:55:39.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.146+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b4069bb0 con 0x7fa1b4154d00 2024-04-25T15:55:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.150+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa1ac01a070 con 0x7fa1b4154d00 2024-04-25T15:55:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.150+0000 7fa1b0ff9640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19406f400 0x7fa194071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.150+0000 7fa1b3fff640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19406f400 0x7fa194071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:39.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.150+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7fa1ac08ea90 con 0x7fa1b4154d00 2024-04-25T15:55:39.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.150+0000 7fa1b3fff640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19406f400 0x7fa194071910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40ad000 tx=0x7fa1a40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:39.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.154+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1ac05b4f0 con 0x7fa1b4154d00 2024-04-25T15:55:39.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.350+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1b40731f0 con 0x7fa1b4154d00 2024-04-25T15:55:39.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.350+0000 7fa1b0ff9640 1 -- 172.21.15.87:0/1291774209 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5667 (secure 0 0 0) 0x7fa1ac05adf0 con 0x7fa1b4154d00 2024-04-25T15:55:39.357 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:39.357 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:55:39.357 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19406f400 msgr2=0x7fa194071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19406f400 0x7fa194071910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40ad000 tx=0x7fa1a40a6000 comp rx=0 tx=0).stop 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 msgr2=0x7fa1b4149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 0x7fa1b4149eb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c440 tx=0x7fa1ac00c840 comp rx=0 tx=0).stop 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 shutdown_connections 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19406f400 0x7fa194071910 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b4154d00 0x7fa1b4149eb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1b414d810 0x7fa1b41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 --2- 172.21.15.87:0/1291774209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b406ee80 0x7fa1b4072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:39.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 >> 172.21.15.87:0/1291774209 conn(0x7fa1b40c8770 msgr2=0x7fa1b4155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 shutdown_connections 2024-04-25T15:55:39.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:39.354+0000 7fa1ba311640 1 -- 172.21.15.87:0/1291774209 wait complete. 2024-04-25T15:55:39.378 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=4263 2024-04-25T15:55:39.378 INFO:tasks.mds_thrash.fs.[b]:waiting for 8 secs before reviving mds.a 2024-04-25T15:55:47.379 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2024-04-25T15:55:47.380 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:55:47.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:55:47.383 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:55:47.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:47.474 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-04-25T15:55:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 Processor -- start 2024-04-25T15:55:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 -- start start 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9bc152980 0x7fb9bc0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc155320 0x7fb9bc155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9bc152d90 con 0x7fb9bc074160 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc0aa290 con 0x7fb9bc152980 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c3cfb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc1598b0 con 0x7fb9bc155320 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c1a97640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9bc152980 0x7fb9bc0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c2298640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb9bc074160 0x7fb9bc0c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:37984/0 (socket says 172.21.15.87:37984) 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c2298640 1 -- 172.21.15.87:0/770479013 learned_addr learned my addr 172.21.15.87:0/770479013 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c1296640 1 --2- 172.21.15.87:0/770479013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc155320 0x7fb9bc155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c1a97640 1 -- 172.21.15.87:0/770479013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc155320 msgr2=0x7fb9bc155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c1a97640 1 --2- 172.21.15.87:0/770479013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc155320 0x7fb9bc155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c1a97640 1 -- 172.21.15.87:0/770479013 >> v1:172.21.15.87:6789/0 conn(0x7fb9bc074160 legacy=0x7fb9bc0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c0a95640 1 -- 172.21.15.87:0/770479013 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015204300 0 0) 0x7fb9bc152d90 con 0x7fb9bc074160 2024-04-25T15:55:47.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.530+0000 7fb9c1a97640 1 -- 172.21.15.87:0/770479013 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0ca2f0 con 0x7fb9bc152980 2024-04-25T15:55:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c1a97640 1 --2- 172.21.15.87:0/770479013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc152980 0x7fb9bc0c9db0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80097c0 tx=0x7fb9b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7641642fa52d05c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c0a95640 1 -- 172.21.15.87:0/770479013 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b0070 con 0x7fb9bc152980 2024-04-25T15:55:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c0a95640 1 -- 172.21.15.87:0/770479013 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b80ab600 con 0x7fb9bc152980 2024-04-25T15:55:47.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c0a95640 1 -- 172.21.15.87:0/770479013 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80ab9d0 con 0x7fb9bc152980 2024-04-25T15:55:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/770479013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc152980 msgr2=0x7fb9bc0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/770479013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc152980 0x7fb9bc0c9db0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80097c0 tx=0x7fb9b801c410 comp rx=0 tx=0).stop 2024-04-25T15:55:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/770479013 shutdown_connections 2024-04-25T15:55:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/770479013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc155320 0x7fb9bc155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/770479013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc152980 0x7fb9bc0c9db0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/770479013 >> 172.21.15.87:0/770479013 conn(0x7fb9bc0ac550 msgr2=0x7fb9bc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:47.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/770479013 shutdown_connections 2024-04-25T15:55:47.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/770479013 wait complete. 2024-04-25T15:55:47.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 Processor -- start 2024-04-25T15:55:47.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.534+0000 7fb9c3cfb640 1 -- start start 2024-04-25T15:55:47.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9bc074160 0x7fb9bc151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:47.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc152980 0x7fb9bc14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:47.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 0x7fb9bc1494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:47.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc158f70 con 0x7fb9bc155320 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc158c90 con 0x7fb9bc074160 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc0729c0 con 0x7fb9bc152980 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 0x7fb9bc1494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 0x7fb9bc1494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36070/0 (socket says 172.21.15.87:36070) 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 -- 172.21.15.87:0/93332635 learned_addr learned my addr 172.21.15.87:0/93332635 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c1a97640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9bc074160 0x7fb9bc151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c1296640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc152980 0x7fb9bc14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 -- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc152980 msgr2=0x7fb9bc14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc152980 0x7fb9bc14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 -- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9bc074160 msgr2=0x7fb9bc151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9bc074160 0x7fb9bc151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 -- 172.21.15.87:0/93332635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0c02b0 con 0x7fb9bc155320 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c2298640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 0x7fb9bc1494d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c700 tx=0x7fb9b400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4018070 con 0x7fb9bc155320 2024-04-25T15:55:47.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b4004d70 con 0x7fb9bc155320 2024-04-25T15:55:47.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400a820 con 0x7fb9bc155320 2024-04-25T15:55:47.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc0c0b80 con 0x7fb9bc155320 2024-04-25T15:55:47.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc14e330 con 0x7fb9bc155320 2024-04-25T15:55:47.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc14de40 con 0x7fb9bc155320 2024-04-25T15:55:47.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9b401b070 con 0x7fb9bc155320 2024-04-25T15:55:47.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.538+0000 7fb9b27fc640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9a006f430 0x7fb9a0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:47.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.542+0000 7fb9c1a97640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9a006f430 0x7fb9a0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:47.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.542+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7fb9b408edf0 con 0x7fb9bc155320 2024-04-25T15:55:47.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.542+0000 7fb9c1a97640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9a006f430 0x7fb9a0071940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80ad000 tx=0x7fb9b80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:47.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.542+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9b405ba50 con 0x7fb9bc155320 2024-04-25T15:55:47.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.746+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9bc069bb0 con 0x7fb9bc155320 2024-04-25T15:55:47.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9b27fc640 1 -- 172.21.15.87:0/93332635 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5667 (secure 0 0 0) 0x7fb9b405b350 con 0x7fb9bc155320 2024-04-25T15:55:47.750 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:47.750 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:55:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9a006f430 msgr2=0x7fb9a0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9a006f430 0x7fb9a0071940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80ad000 tx=0x7fb9b80a6000 comp rx=0 tx=0).stop 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 msgr2=0x7fb9bc1494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 0x7fb9bc1494d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c700 tx=0x7fb9b400cbc0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 shutdown_connections 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9a006f430 0x7fb9a0071940 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9bc155320 0x7fb9bc1494d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9bc152980 0x7fb9bc14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 --2- 172.21.15.87:0/93332635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9bc074160 0x7fb9bc151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:47.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 >> 172.21.15.87:0/93332635 conn(0x7fb9bc0ac550 msgr2=0x7fb9bc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:47.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 shutdown_connections 2024-04-25T15:55:47.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:47.750+0000 7fb9c3cfb640 1 -- 172.21.15.87:0/93332635 wait complete. 2024-04-25T15:55:47.770 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-04-25T15:55:49.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:55:49.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.922+0000 7fb53d3be640 1 Processor -- start 2024-04-25T15:55:49.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.922+0000 7fb53d3be640 1 -- start start 2024-04-25T15:55:49.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb53d3be640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb538152870 0x7fb538159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb53d3be640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5381558d0 con 0x7fb53806c670 2024-04-25T15:55:49.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb53d3be640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb538070cb0 con 0x7fb5380c9fe0 2024-04-25T15:55:49.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb53d3be640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb538152c80 con 0x7fb538152870 2024-04-25T15:55:49.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb5377fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb53806c670 0x7fb53815fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:37992/0 (socket says 172.21.15.87:37992) 2024-04-25T15:55:49.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb5377fe640 1 -- 172.21.15.87:0/3706330663 learned_addr learned my addr 172.21.15.87:0/3706330663 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:55:49.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3706330663 >> v2:172.21.15.155:3300/0 conn(0x7fb538152870 0x7fb538159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093442081 0 0) 0x7fb5381558d0 con 0x7fb53806c670 2024-04-25T15:55:49.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb520003530 con 0x7fb53806c670 2024-04-25T15:55:49.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1556518402 0 0) 0x7fb520003530 con 0x7fb53806c670 2024-04-25T15:55:49.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 >> v2:172.21.15.155:3300/0 conn(0x7fb538152870 msgr2=0x7fb538159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 --2- 172.21.15.87:0/3706330663 >> v2:172.21.15.155:3300/0 conn(0x7fb538152870 0x7fb538159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 >> v1:172.21.15.155:6789/0 conn(0x7fb5380c9fe0 legacy=0x7fb5381551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb538070f90 con 0x7fb53806c670 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb530001a00 con 0x7fb53806c670 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 >> v1:172.21.15.87:6789/0 conn(0x7fb53806c670 legacy=0x7fb53815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5200039c0 0x7fb520003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb520004810 0x7fb520004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb520005260 0x7fb52000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb538152c80 con 0x7fb5200039c0 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb52000c1f0 con 0x7fb520004810 2024-04-25T15:55:49.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb52000c3f0 con 0x7fb520005260 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5200039c0 0x7fb520003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb5367fc640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb520004810 0x7fb520004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb5377fe640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb520005260 0x7fb52000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 -- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb520005260 msgr2=0x7fb52000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb520005260 0x7fb52000b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 -- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb520004810 msgr2=0x7fb520004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb520004810 0x7fb520004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb536ffd640 1 -- 172.21.15.87:0/3706330663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb520003530 con 0x7fb5200039c0 2024-04-25T15:55:49.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.926+0000 7fb5377fe640 1 -- 172.21.15.87:0/3706330663 reap_dead start 2024-04-25T15:55:49.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5200039c0 0x7fb520003e30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ae0 tx=0x7fb52801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf6762909b8e600 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:49.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280096b0 con 0x7fb5200039c0 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5280a6470 con 0x7fb5200039c0 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb535ffb640 1 -- 172.21.15.87:0/3706330663 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280a6860 con 0x7fb5200039c0 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 -- 172.21.15.87:0/3706330663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5200039c0 msgr2=0x7fb520003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5200039c0 0x7fb520003e30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ae0 tx=0x7fb52801ca90 comp rx=0 tx=0).stop 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 -- 172.21.15.87:0/3706330663 shutdown_connections 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3706330663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5200039c0 0x7fb520003e30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 -- 172.21.15.87:0/3706330663 >> 172.21.15.87:0/3706330663 conn(0x7fb53806d780 msgr2=0x7fb53806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 -- 172.21.15.87:0/3706330663 shutdown_connections 2024-04-25T15:55:49.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.930+0000 7fb53d3be640 1 -- 172.21.15.87:0/3706330663 wait complete. 2024-04-25T15:55:49.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 Processor -- start 2024-04-25T15:55:49.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 -- start start 2024-04-25T15:55:49.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5200039c0 0x7fb5380c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb538074d60 0x7fb538073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 0x7fb53814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb538158d70 con 0x7fb5380736a0 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb53806ce90 con 0x7fb5200039c0 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb5380ca3f0 con 0x7fb538074d60 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 0x7fb53814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 0x7fb53814c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36094/0 (socket says 172.21.15.87:36094) 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 -- 172.21.15.87:0/3147754849 learned_addr learned my addr 172.21.15.87:0/3147754849 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5200039c0 0x7fb5380c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5367fc640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb538074d60 0x7fb538073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 -- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb538074d60 msgr2=0x7fb538073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb538074d60 0x7fb538073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 -- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5200039c0 msgr2=0x7fb5380c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5200039c0 0x7fb5380c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 -- 172.21.15.87:0/3147754849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5381f5010 con 0x7fb5380736a0 2024-04-25T15:55:49.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5367fc640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb538074d60 0x7fb538073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb5377fe640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 0x7fb53814c7d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb538069660 tx=0x7fb53000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530004d70 con 0x7fb5380736a0 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53000bb80 con 0x7fb5380736a0 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5381f52f0 con 0x7fb5380736a0 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530007070 con 0x7fb5380736a0 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.934+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5381e4080 con 0x7fb5380736a0 2024-04-25T15:55:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.938+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb538069bb0 con 0x7fb5380736a0 2024-04-25T15:55:49.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.938+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb530007210 con 0x7fb5380736a0 2024-04-25T15:55:49.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.938+0000 7fb51f7fe640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:55:49.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.938+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7fb53008f580 con 0x7fb5380736a0 2024-04-25T15:55:49.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.938+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:55:49.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.938+0000 7fb536ffd640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5280ad000 tx=0x7fb5280046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:55:49.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:49.942+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb53005c070 con 0x7fb5380736a0 2024-04-25T15:55:50.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.170+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb538158590 con 0x7fb5380736a0 2024-04-25T15:55:50.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.170+0000 7fb51f7fe640 1 -- 172.21.15.87:0/3147754849 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7fb53005b970 con 0x7fb5380736a0 2024-04-25T15:55:50.171 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:55:50.171 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:55:50.172 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:55:50.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 msgr2=0x7fb524071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:50.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5280ad000 tx=0x7fb5280046d0 comp rx=0 tx=0).stop 2024-04-25T15:55:50.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 msgr2=0x7fb53814c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 0x7fb53814c7d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb538069660 tx=0x7fb53000b4a0 comp rx=0 tx=0).stop 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 shutdown_connections 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb52406f400 0x7fb524071910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5380736a0 0x7fb53814c7d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb538074d60 0x7fb538073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 --2- 172.21.15.87:0/3147754849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5200039c0 0x7fb5380c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 >> 172.21.15.87:0/3147754849 conn(0x7fb53806d780 msgr2=0x7fb538154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 shutdown_connections 2024-04-25T15:55:50.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:55:50.174+0000 7fb53d3be640 1 -- 172.21.15.87:0/3147754849 wait complete. 2024-04-25T15:55:50.191 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2024-04-25T15:55:50.191 INFO:tasks.mds_thrash.fs.[b]:waiting for 119 secs before thrashing 2024-04-25T15:56:08.573 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:08.575 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:20.874 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T15:56:20.874 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.874 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.875 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T15:56:20.876 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-04-25T15:56:20.877 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:56:20.881 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T15:56:20.888 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T15:56:20.890 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:56:20.891 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T15:56:21.942 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T15:56:22.024 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T15:56:22.081 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:56:22.082 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:56:22.082 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T15:56:22.129 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:56:22.132 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T15:56:22.132 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T15:56:22.178 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T15:56:22.179 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T15:56:22.180 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T15:56:22.238 INFO:tasks.workunit.client.0.smithi087.stderr:+ mkdir -p fsstress 2024-04-25T15:56:22.242 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd fsstress 2024-04-25T15:56:22.244 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T15:56:22.244 INFO:tasks.workunit.client.0.smithi087.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T15:56:23.136 INFO:tasks.workunit.client.1.smithi155.stderr:Updating files: 97% (11994/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T15:56:23.509 INFO:tasks.workunit.client.1.smithi155.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T15:56:23.509 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: git switch -c 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:Or undo this operation with: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: git switch - 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr: 2024-04-25T15:56:23.510 INFO:tasks.workunit.client.1.smithi155.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:56:23.516 DEBUG:teuthology.orchestra.run.smithi155:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-25T15:56:23.523 INFO:tasks.workunit.client.1.smithi155.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T15:56:23.526 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T15:56:23.526 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T15:56:23.540 INFO:tasks.workunit.client.0.smithi087.stderr:+ tar xzf ltp-full.tgz 2024-04-25T15:56:24.260 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T15:56:24.362 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T15:56:24.422 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T15:56:24.424 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T15:56:24.424 INFO:tasks.workunit.client.1.smithi155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T15:56:24.473 INFO:tasks.workunit.client.1.smithi155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T15:56:24.476 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:56:24.477 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-25T15:56:24.523 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-25T15:56:24.525 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T15:56:24.525 DEBUG:teuthology.orchestra.run.smithi155:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-25T15:56:24.586 INFO:tasks.workunit.client.1.smithi155.stderr:+ mkdir -p fsstress 2024-04-25T15:56:24.589 INFO:tasks.workunit.client.1.smithi155.stderr:+ pushd fsstress 2024-04-25T15:56:24.591 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T15:56:24.591 INFO:tasks.workunit.client.1.smithi155.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T15:56:25.369 INFO:tasks.workunit.client.1.smithi155.stderr:+ tar xzf ltp-full.tgz 2024-04-25T15:56:38.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:38.690 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:43.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:43.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0eb96640 1 Processor -- start 2024-04-25T15:56:43.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0eb96640 1 -- start start 2024-04-25T15:56:43.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0eb96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08152870 0x7fbb08159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:43.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0eb96640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb081558d0 con 0x7fbb0806c670 2024-04-25T15:56:43.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0eb96640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb08070cb0 con 0x7fbb080c9fe0 2024-04-25T15:56:43.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0eb96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb08152c80 con 0x7fbb08152870 2024-04-25T15:56:43.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0d133640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbb0806c670 0x7fbb0815fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:54240/0 (socket says 172.21.15.87:54240) 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0d133640 1 -- 172.21.15.87:0/4024320193 learned_addr learned my addr 172.21.15.87:0/4024320193 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0c932640 1 --2- 172.21.15.87:0/4024320193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08152870 0x7fbb08159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470362791 0 0) 0x7fbb081558d0 con 0x7fbb0806c670 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf8003530 con 0x7fbb0806c670 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539735085 0 0) 0x7fbb08070cb0 con 0x7fbb080c9fe0 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb081558d0 con 0x7fbb080c9fe0 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0c932640 1 -- 172.21.15.87:0/4024320193 >> v1:172.21.15.155:6789/0 conn(0x7fbb080c9fe0 legacy=0x7fbb081551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0c932640 1 -- 172.21.15.87:0/4024320193 >> v1:172.21.15.87:6789/0 conn(0x7fbb0806c670 legacy=0x7fbb0815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:43.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.792+0000 7fbb0c932640 1 -- 172.21.15.87:0/4024320193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb08070f90 con 0x7fbb08152870 2024-04-25T15:56:43.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0c932640 1 --2- 172.21.15.87:0/4024320193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08152870 0x7fbb08159290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097f0 tx=0x7fbafc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39ed836d491bc66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:43.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0b0070 con 0x7fbb08152870 2024-04-25T15:56:43.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbafc0ab600 con 0x7fbb08152870 2024-04-25T15:56:43.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb077fe640 1 -- 172.21.15.87:0/4024320193 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ab9d0 con 0x7fbb08152870 2024-04-25T15:56:43.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4024320193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08152870 msgr2=0x7fbb08159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:43.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4024320193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08152870 0x7fbb08159290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097f0 tx=0x7fbafc01c470 comp rx=0 tx=0).stop 2024-04-25T15:56:43.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4024320193 shutdown_connections 2024-04-25T15:56:43.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4024320193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb08152870 0x7fbb08159290 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:43.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4024320193 >> 172.21.15.87:0/4024320193 conn(0x7fbb0806d780 msgr2=0x7fbb0806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:43.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4024320193 shutdown_connections 2024-04-25T15:56:43.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.796+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4024320193 wait complete. 2024-04-25T15:56:43.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 Processor -- start 2024-04-25T15:56:43.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 -- start start 2024-04-25T15:56:43.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806c670 0x7fbb081f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:43.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb080c9fe0 0x7fbb0814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:43.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 0x7fbb08147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:43.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb080ca3f0 con 0x7fbb08152870 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0806ce90 con 0x7fbb0806c670 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0eb96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb08163a80 con 0x7fbb080c9fe0 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 0x7fbb08147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 0x7fbb08147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44906/0 (socket says 172.21.15.87:44906) 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 -- 172.21.15.87:0/4204897859 learned_addr learned my addr 172.21.15.87:0/4204897859 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb07fff640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb080c9fe0 0x7fbb0814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0c932640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806c670 0x7fbb081f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 -- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb080c9fe0 msgr2=0x7fbb0814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb080c9fe0 0x7fbb0814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 -- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806c670 msgr2=0x7fbb081f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806c670 0x7fbb081f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 -- 172.21.15.87:0/4204897859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb081501d0 con 0x7fbb08152870 2024-04-25T15:56:43.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0c932640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806c670 0x7fbb081f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:56:43.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.800+0000 7fbb0d133640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 0x7fbb08147880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000caa0 tx=0x7fbb0000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:43.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00017070 con 0x7fbb08152870 2024-04-25T15:56:43.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb0000ac20 con 0x7fbb08152870 2024-04-25T15:56:43.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00012640 con 0x7fbb08152870 2024-04-25T15:56:43.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb081f2fd0 con 0x7fbb08152870 2024-04-25T15:56:43.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0814e900 con 0x7fbb08152870 2024-04-25T15:56:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb081503a0 con 0x7fbb08152870 2024-04-25T15:56:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbb0001a070 con 0x7fbb08152870 2024-04-25T15:56:43.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.804+0000 7fbb057fa640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbaec06f430 0x7fbaec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:43.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.808+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7fbb0008f3b0 con 0x7fbb08152870 2024-04-25T15:56:43.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.812+0000 7fbb0c932640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbaec06f430 0x7fbaec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.812+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb0005b850 con 0x7fbb08152870 2024-04-25T15:56:43.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:43.812+0000 7fbb0c932640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbaec06f430 0x7fbaec071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ad000 tx=0x7fbafc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.052+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb08069bb0 con 0x7fbb08152870 2024-04-25T15:56:44.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.052+0000 7fbb057fa640 1 -- 172.21.15.87:0/4204897859 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7fbb0005fb50 con 0x7fbb08152870 2024-04-25T15:56:44.056 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:44.057 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:44.057 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbaec06f430 msgr2=0x7fbaec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbaec06f430 0x7fbaec071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ad000 tx=0x7fbafc008040 comp rx=0 tx=0).stop 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 msgr2=0x7fbb08147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 0x7fbb08147880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000caa0 tx=0x7fbb0000cf60 comp rx=0 tx=0).stop 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 shutdown_connections 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbaec06f430 0x7fbaec071940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb08152870 0x7fbb08147880 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb080c9fe0 0x7fbb0814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 --2- 172.21.15.87:0/4204897859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb0806c670 0x7fbb081f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 >> 172.21.15.87:0/4204897859 conn(0x7fbb0806d780 msgr2=0x7fbb08157810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:44.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 shutdown_connections 2024-04-25T15:56:44.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.056+0000 7fbb0eb96640 1 -- 172.21.15.87:0/4204897859 wait complete. 2024-04-25T15:56:44.076 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-04-25T15:56:44.076 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:56:44.076 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:56:44.091 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:56:44.091 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:44.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 Processor -- start 2024-04-25T15:56:44.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 -- start start 2024-04-25T15:56:44.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:44.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a880744e0 0x7f3a88154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:44.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a88063220 con 0x7f3a880c28b0 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3a880c5570 con 0x7f3a880744e0 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8f10d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a88074a90 con 0x7f3a880740d0 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a880744e0 0x7f3a88154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a880744e0 0x7f3a88154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44918/0 (socket says 172.21.15.87:44918) 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 -- 172.21.15.87:0/861747857 learned_addr learned my addr 172.21.15.87:0/861747857 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a8cea9640 1 --2- 172.21.15.87:0/861747857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 -- 172.21.15.87:0/861747857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880740d0 msgr2=0x7f3a880c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 --2- 172.21.15.87:0/861747857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 -- 172.21.15.87:0/861747857 >> v1:172.21.15.155:6789/0 conn(0x7f3a880c28b0 legacy=0x7f3a8815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.224+0000 7f3a87fff640 1 -- 172.21.15.87:0/861747857 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a880634c0 con 0x7f3a880744e0 2024-04-25T15:56:44.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a87fff640 1 --2- 172.21.15.87:0/861747857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a88154580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009870 tx=0x7f3a7401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7009822d4303a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:44.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a877fe640 1 -- 172.21.15.87:0/861747857 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a740b1070 con 0x7f3a880744e0 2024-04-25T15:56:44.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a877fe640 1 -- 172.21.15.87:0/861747857 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a740a8050 con 0x7f3a880744e0 2024-04-25T15:56:44.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a877fe640 1 -- 172.21.15.87:0/861747857 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a740ac860 con 0x7f3a880744e0 2024-04-25T15:56:44.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 -- 172.21.15.87:0/861747857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 msgr2=0x7f3a88154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/861747857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a88154580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009870 tx=0x7f3a7401c4d0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 -- 172.21.15.87:0/861747857 shutdown_connections 2024-04-25T15:56:44.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/861747857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a88154580 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/861747857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 -- 172.21.15.87:0/861747857 >> 172.21.15.87:0/861747857 conn(0x7f3a8806d650 msgr2=0x7f3a880c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:44.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 -- 172.21.15.87:0/861747857 shutdown_connections 2024-04-25T15:56:44.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.228+0000 7f3a8f10d640 1 -- 172.21.15.87:0/861747857 wait complete. 2024-04-25T15:56:44.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 Processor -- start 2024-04-25T15:56:44.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- start start 2024-04-25T15:56:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a880c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880744e0 0x7f3a88159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 0x7f3a88143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8806dbe0 con 0x7f3a880c28b0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8806da60 con 0x7f3a880740d0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a880c5060 con 0x7f3a880744e0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 0x7f3a88143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 0x7f3a88143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44926/0 (socket says 172.21.15.87:44926) 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 -- 172.21.15.87:0/1825634198 learned_addr learned my addr 172.21.15.87:0/1825634198 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a87fff640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880744e0 0x7f3a88159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8cea9640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a880c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 -- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880744e0 msgr2=0x7f3a88159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880744e0 0x7f3a88159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 -- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 msgr2=0x7f3a880c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a880c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 -- 172.21.15.87:0/1825634198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a88145970 con 0x7f3a880c28b0 2024-04-25T15:56:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8d6aa640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 0x7f3a88143620 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c760 tx=0x7f3a8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80003ba0 con 0x7f3a880c28b0 2024-04-25T15:56:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80003d40 con 0x7f3a880c28b0 2024-04-25T15:56:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a88145690 con 0x7f3a880c28b0 2024-04-25T15:56:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000aa90 con 0x7f3a880c28b0 2024-04-25T15:56:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8815a9c0 con 0x7f3a880c28b0 2024-04-25T15:56:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.232+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8815a170 con 0x7f3a880c28b0 2024-04-25T15:56:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.236+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a8000ac30 con 0x7f3a880c28b0 2024-04-25T15:56:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.236+0000 7f3a857fa640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a6c06f400 0x7f3a6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.236+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7f3a8008f4f0 con 0x7f3a880c28b0 2024-04-25T15:56:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.236+0000 7f3a8cea9640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a6c06f400 0x7f3a6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.236+0000 7f3a8cea9640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a6c06f400 0x7f3a6c071910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b930 tx=0x7f3a7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:44.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.240+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a8005c070 con 0x7f3a880c28b0 2024-04-25T15:56:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.448+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a88069bb0 con 0x7f3a880c28b0 2024-04-25T15:56:44.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.448+0000 7f3a857fa640 1 -- 172.21.15.87:0/1825634198 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7f3a80064060 con 0x7f3a880c28b0 2024-04-25T15:56:44.452 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:44.452 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:44.452 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a6c06f400 msgr2=0x7f3a6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a6c06f400 0x7f3a6c071910 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b930 tx=0x7f3a7c008040 comp rx=0 tx=0).stop 2024-04-25T15:56:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 msgr2=0x7f3a88143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 0x7f3a88143620 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c760 tx=0x7f3a8000cc20 comp rx=0 tx=0).stop 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 shutdown_connections 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a6c06f400 0x7f3a6c071910 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880c28b0 0x7f3a88143620 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a880744e0 0x7f3a88159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 --2- 172.21.15.87:0/1825634198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a880c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 >> 172.21.15.87:0/1825634198 conn(0x7f3a8806d650 msgr2=0x7f3a880c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 shutdown_connections 2024-04-25T15:56:44.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:44.452+0000 7f3a8f10d640 1 -- 172.21.15.87:0/1825634198 wait complete. 2024-04-25T15:56:44.472 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:56:46.473 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:46.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 Processor -- start 2024-04-25T15:56:46.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 -- start start 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b0015b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b0015b580 0x7f2b00161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b000c5120 con 0x7f2b000c4250 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2b000c3b20 con 0x7f2b0015b580 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b0720f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b00070e20 con 0x7f2b0015ac30 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b057ac640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b0015b580 0x7f2b00161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b057ac640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2b0015b580 0x7f2b00161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44940/0 (socket says 172.21.15.87:44940) 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.636+0000 7f2b057ac640 1 -- 172.21.15.87:0/2774242812 learned_addr learned my addr 172.21.15.87:0/2774242812 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2afffff640 1 --2- 172.21.15.87:0/2774242812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b0015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b057ac640 1 -- 172.21.15.87:0/2774242812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 msgr2=0x7f2b0015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b057ac640 1 --2- 172.21.15.87:0/2774242812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b0015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b057ac640 1 -- 172.21.15.87:0/2774242812 >> v1:172.21.15.155:6789/0 conn(0x7f2b000c4250 legacy=0x7f2b0006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b057ac640 1 -- 172.21.15.87:0/2774242812 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b000c4b60 con 0x7f2b0015b580 2024-04-25T15:56:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b057ac640 1 --2- 172.21.15.87:0/2774242812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b00161e60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496373e81b108af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2aff7fe640 1 -- 172.21.15.87:0/2774242812 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a5750 con 0x7f2b0015b580 2024-04-25T15:56:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2aff7fe640 1 -- 172.21.15.87:0/2774242812 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80a58f0 con 0x7f2b0015b580 2024-04-25T15:56:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2aff7fe640 1 -- 172.21.15.87:0/2774242812 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a5cc0 con 0x7f2b0015b580 2024-04-25T15:56:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 -- 172.21.15.87:0/2774242812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 msgr2=0x7f2b00161e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 --2- 172.21.15.87:0/2774242812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b00161e60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af801c9a0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 -- 172.21.15.87:0/2774242812 shutdown_connections 2024-04-25T15:56:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 --2- 172.21.15.87:0/2774242812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b0015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 --2- 172.21.15.87:0/2774242812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b00161e60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 -- 172.21.15.87:0/2774242812 >> 172.21.15.87:0/2774242812 conn(0x7f2b0006d780 msgr2=0x7f2b0006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 -- 172.21.15.87:0/2774242812 shutdown_connections 2024-04-25T15:56:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.640+0000 7f2b0720f640 1 -- 172.21.15.87:0/2774242812 wait complete. 2024-04-25T15:56:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 Processor -- start 2024-04-25T15:56:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 -- start start 2024-04-25T15:56:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000c4250 0x7f2b00150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b000ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b001f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2b000c47e0 con 0x7f2b0015b580 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b000c4660 con 0x7f2b000c4250 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b0720f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b00155100 con 0x7f2b0015ac30 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b057ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b001f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b057ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b001f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44954/0 (socket says 172.21.15.87:44954) 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.644+0000 7f2b057ac640 1 -- 172.21.15.87:0/3262624099 learned_addr learned my addr 172.21.15.87:0/3262624099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b04fab640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000c4250 0x7f2b00150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afffff640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b000ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b057ac640 1 -- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 msgr2=0x7f2b000ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b057ac640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b000ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b057ac640 1 -- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000c4250 msgr2=0x7f2b00150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b057ac640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000c4250 0x7f2b00150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b057ac640 1 -- 172.21.15.87:0/3262624099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b00158660 con 0x7f2b0015b580 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b04fab640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000c4250 0x7f2b00150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:56:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b057ac640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b001f3cf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80bc020 con 0x7f2b0015b580 2024-04-25T15:56:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80b8670 con 0x7f2b0015b580 2024-04-25T15:56:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b000abe20 con 0x7f2b0015b580 2024-04-25T15:56:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80b8a60 con 0x7f2b0015b580 2024-04-25T15:56:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b00153ab0 con 0x7f2b0015b580 2024-04-25T15:56:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b00069bb0 con 0x7f2b0015b580 2024-04-25T15:56:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2af80bf020 con 0x7f2b0015b580 2024-04-25T15:56:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afd7fa640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2ae406f430 0x7f2ae4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7f2af812a030 con 0x7f2b0015b580 2024-04-25T15:56:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b04fab640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2ae406f430 0x7f2ae4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.648+0000 7f2b04fab640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2ae406f430 0x7f2ae4071940 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2af4000f70 tx=0x7f2af4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.656+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2af80c7020 con 0x7f2b0015b580 2024-04-25T15:56:46.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.880+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b000c3540 con 0x7f2b0015b580 2024-04-25T15:56:46.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.880+0000 7f2afd7fa640 1 -- 172.21.15.87:0/3262624099 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7f2af8016620 con 0x7f2b0015b580 2024-04-25T15:56:46.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:46.884 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:46.885 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:46.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2ae406f430 msgr2=0x7f2ae4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2ae406f430 0x7f2ae4071940 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2af4000f70 tx=0x7f2af4009040 comp rx=0 tx=0).stop 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 msgr2=0x7f2b001f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b001f3cf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af8019740 comp rx=0 tx=0).stop 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 shutdown_connections 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2ae406f430 0x7f2ae4071940 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b0015b580 0x7f2b001f3cf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015ac30 0x7f2b000ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 --2- 172.21.15.87:0/3262624099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000c4250 0x7f2b00150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 >> 172.21.15.87:0/3262624099 conn(0x7f2b0006d780 msgr2=0x7f2b00157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 shutdown_connections 2024-04-25T15:56:46.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:46.884+0000 7f2b0720f640 1 -- 172.21.15.87:0/3262624099 wait complete. 2024-04-25T15:56:46.906 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:56:48.907 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:49.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 Processor -- start 2024-04-25T15:56:49.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 -- start start 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d300a8cc0 0x7f8d301593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d3006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d30152c80 con 0x7f8d30152870 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8d300aebc0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d3657b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d30158f20 con 0x7f8d3006c670 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d2ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d300a8cc0 0x7f8d301593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d34b18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d3006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d2f7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8d30152870 0x7f8d30155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:42458/0 (socket says 172.21.15.87:42458) 2024-04-25T15:56:49.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.076+0000 7f8d2f7fe640 1 -- 172.21.15.87:0/499000254 learned_addr learned my addr 172.21.15.87:0/499000254 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:56:49.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2ffff640 1 -- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 msgr2=0x7f8d3006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:49.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2ffff640 1 --2- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d3006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2ffff640 1 -- 172.21.15.87:0/499000254 >> v1:172.21.15.155:6789/0 conn(0x7f8d30152870 legacy=0x7f8d30155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:49.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2effd640 1 -- 172.21.15.87:0/499000254 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001912165 0 0) 0x7f8d30152c80 con 0x7f8d30152870 2024-04-25T15:56:49.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2ffff640 1 -- 172.21.15.87:0/499000254 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300ae8e0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d34b18640 1 --2- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d3006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:56:49.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2ffff640 1 --2- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300a8cc0 0x7f8d301593b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8d200097c0 tx=0x7f8d2001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5474559b7170aead server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:49.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2effd640 1 -- 172.21.15.87:0/499000254 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d200b0070 con 0x7f8d300a8cc0 2024-04-25T15:56:49.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2effd640 1 -- 172.21.15.87:0/499000254 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d20004230 con 0x7f8d300a8cc0 2024-04-25T15:56:49.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.080+0000 7f8d2effd640 1 -- 172.21.15.87:0/499000254 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20003620 con 0x7f8d300a8cc0 2024-04-25T15:56:49.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300a8cc0 msgr2=0x7f8d301593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 --2- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300a8cc0 0x7f8d301593b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8d200097c0 tx=0x7f8d2001c350 comp rx=0 tx=0).stop 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- 172.21.15.87:0/499000254 shutdown_connections 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 --2- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d3006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 --2- 172.21.15.87:0/499000254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300a8cc0 0x7f8d301593b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- 172.21.15.87:0/499000254 >> 172.21.15.87:0/499000254 conn(0x7f8d3006d780 msgr2=0x7f8d3006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- 172.21.15.87:0/499000254 shutdown_connections 2024-04-25T15:56:49.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- 172.21.15.87:0/499000254 wait complete. 2024-04-25T15:56:49.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 Processor -- start 2024-04-25T15:56:49.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- start start 2024-04-25T15:56:49.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d300a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:49.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 0x7f8d3014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:49.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d30152870 0x7f8d300ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d300ac870 con 0x7f8d300a8cc0 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d300ac6f0 con 0x7f8d30152870 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.084+0000 7f8d3657b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d301623e0 con 0x7f8d3006c670 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 0x7f8d3014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 0x7f8d3014c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44968/0 (socket says 172.21.15.87:44968) 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 -- 172.21.15.87:0/4173565958 learned_addr learned my addr 172.21.15.87:0/4173565958 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2ffff640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d300a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d34b18640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d30152870 0x7f8d300ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 -- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 msgr2=0x7f8d300a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d300a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 -- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d30152870 msgr2=0x7f8d300ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d30152870 0x7f8d300ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 -- 172.21.15.87:0/4173565958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300c3df0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2f7fe640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 0x7f8d3014c6e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c490 tx=0x7f8d2400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:49.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24017070 con 0x7f8d300a8cc0 2024-04-25T15:56:49.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d24005cf0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d300c3b10 con 0x7f8d300a8cc0 2024-04-25T15:56:49.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240072f0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3014db10 con 0x7f8d300a8cc0 2024-04-25T15:56:49.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d30069bb0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d2401a070 con 0x7f8d300a8cc0 2024-04-25T15:56:49.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2cff9640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1c06f400 0x7f8d1c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:49.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2ffff640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1c06f400 0x7f8d1c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:49.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.088+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7f8d2408e8a0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.092+0000 7f8d2ffff640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1c06f400 0x7f8d1c071910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ad000 tx=0x7f8d20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:49.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.096+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d2405add0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.320+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d30070890 con 0x7f8d300a8cc0 2024-04-25T15:56:49.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d2cff9640 1 -- 172.21.15.87:0/4173565958 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7f8d2405f0d0 con 0x7f8d300a8cc0 2024-04-25T15:56:49.327 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:49.327 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:49.327 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:49.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1c06f400 msgr2=0x7f8d1c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:49.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1c06f400 0x7f8d1c071910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ad000 tx=0x7f8d20008040 comp rx=0 tx=0).stop 2024-04-25T15:56:49.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 msgr2=0x7f8d3014c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:49.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 0x7f8d3014c6e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c490 tx=0x7f8d2400c890 comp rx=0 tx=0).stop 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 shutdown_connections 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1c06f400 0x7f8d1c071910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d30152870 0x7f8d300ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300a8cc0 0x7f8d3014c6e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 --2- 172.21.15.87:0/4173565958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3006c670 0x7f8d300a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 >> 172.21.15.87:0/4173565958 conn(0x7f8d3006d780 msgr2=0x7f8d30157eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:49.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 shutdown_connections 2024-04-25T15:56:49.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:49.324+0000 7f8d3657b640 1 -- 172.21.15.87:0/4173565958 wait complete. 2024-04-25T15:56:49.347 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:56:51.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:51.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 Processor -- start 2024-04-25T15:56:51.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 -- start start 2024-04-25T15:56:51.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1768152980 0x7f17680c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:51.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1768155320 0x7f1768155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1768152d90 con 0x7f1768074160 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f17680aa290 con 0x7f1768155320 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176c884640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f17681598b0 con 0x7f1768152980 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f1765d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1768155320 0x7f1768155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f1765d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1768155320 0x7f1768155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58280/0 (socket says 172.21.15.87:58280) 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f1765d9b640 1 -- 172.21.15.87:0/1724547218 learned_addr learned my addr 172.21.15.87:0/1724547218 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.524+0000 7f176659c640 1 --2- 172.21.15.87:0/1724547218 >> v2:172.21.15.155:3300/0 conn(0x7f1768152980 0x7f17680c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f1765d9b640 1 -- 172.21.15.87:0/1724547218 >> v2:172.21.15.155:3300/0 conn(0x7f1768152980 msgr2=0x7f17680c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f1765d9b640 1 --2- 172.21.15.87:0/1724547218 >> v2:172.21.15.155:3300/0 conn(0x7f1768152980 0x7f17680c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f1765d9b640 1 -- 172.21.15.87:0/1724547218 >> v1:172.21.15.155:6789/0 conn(0x7f1768074160 legacy=0x7f17680c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:51.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f1765d9b640 1 -- 172.21.15.87:0/1724547218 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17680ca2f0 con 0x7f1768155320 2024-04-25T15:56:51.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f1765d9b640 1 --2- 172.21.15.87:0/1724547218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f1768155730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1768073c10 tx=0x7f175801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ff83fa3067bd5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:51.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f176559a640 1 -- 172.21.15.87:0/1724547218 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17580b0070 con 0x7f1768155320 2024-04-25T15:56:51.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f176559a640 1 -- 172.21.15.87:0/1724547218 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17580ab600 con 0x7f1768155320 2024-04-25T15:56:51.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.528+0000 7f176559a640 1 -- 172.21.15.87:0/1724547218 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17580ab9d0 con 0x7f1768155320 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- 172.21.15.87:0/1724547218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 msgr2=0x7f1768155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 --2- 172.21.15.87:0/1724547218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f1768155730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1768073c10 tx=0x7f175801c450 comp rx=0 tx=0).stop 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- 172.21.15.87:0/1724547218 shutdown_connections 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 --2- 172.21.15.87:0/1724547218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f1768155730 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 --2- 172.21.15.87:0/1724547218 >> v2:172.21.15.155:3300/0 conn(0x7f1768152980 0x7f17680c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- 172.21.15.87:0/1724547218 >> 172.21.15.87:0/1724547218 conn(0x7f17680ac550 msgr2=0x7f17680ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- 172.21.15.87:0/1724547218 shutdown_connections 2024-04-25T15:56:51.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- 172.21.15.87:0/1724547218 wait complete. 2024-04-25T15:56:51.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 Processor -- start 2024-04-25T15:56:51.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- start start 2024-04-25T15:56:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1768074160 0x7f17680c1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1768152980 0x7f176814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f17681f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1768158f70 con 0x7f1768155320 2024-04-25T15:56:51.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1768158c90 con 0x7f1768152980 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176c884640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f17680729c0 con 0x7f1768074160 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f1766d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f17681f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f1766d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f17681f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58288/0 (socket says 172.21.15.87:58288) 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f1766d9d640 1 -- 172.21.15.87:0/1640261485 learned_addr learned my addr 172.21.15.87:0/1640261485 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f176659c640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1768074160 0x7f17680c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.532+0000 7f1765d9b640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1768152980 0x7f176814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1766d9d640 1 -- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1768074160 msgr2=0x7f17680c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1766d9d640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1768074160 0x7f17680c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1766d9d640 1 -- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1768152980 msgr2=0x7f176814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1766d9d640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1768152980 0x7f176814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1766d9d640 1 -- 172.21.15.87:0/1640261485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176814bd80 con 0x7f1768155320 2024-04-25T15:56:51.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1766d9d640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f17681f20a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f176000b9a0 tx=0x7f176000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760019070 con 0x7f1768155320 2024-04-25T15:56:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176000cba0 con 0x7f1768155320 2024-04-25T15:56:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760014440 con 0x7f1768155320 2024-04-25T15:56:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17680c0ed0 con 0x7f1768155320 2024-04-25T15:56:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176814d9b0 con 0x7f1768155320 2024-04-25T15:56:51.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1768069bb0 con 0x7f1768155320 2024-04-25T15:56:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f176001c070 con 0x7f1768155320 2024-04-25T15:56:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1756ffd640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f174806f400 0x7f1748071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7f176008f330 con 0x7f1768155320 2024-04-25T15:56:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f176659c640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f174806f400 0x7f1748071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:51.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.536+0000 7f176659c640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f174806f400 0x7f1748071910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f175c00b930 tx=0x7f175c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:51.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.540+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f176005beb0 con 0x7f1768155320 2024-04-25T15:56:51.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.752+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f176814eb80 con 0x7f1768155320 2024-04-25T15:56:51.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.752+0000 7f1756ffd640 1 -- 172.21.15.87:0/1640261485 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7f176005b7b0 con 0x7f1768155320 2024-04-25T15:56:51.755 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:51.755 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:51.755 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:51.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f174806f400 msgr2=0x7f1748071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:51.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f174806f400 0x7f1748071910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f175c00b930 tx=0x7f175c008040 comp rx=0 tx=0).stop 2024-04-25T15:56:51.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 msgr2=0x7f17681f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:51.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f17681f20a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f176000b9a0 tx=0x7f176000be60 comp rx=0 tx=0).stop 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 shutdown_connections 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f174806f400 0x7f1748071910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1768155320 0x7f17681f20a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1768152980 0x7f176814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 --2- 172.21.15.87:0/1640261485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1768074160 0x7f17680c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 >> 172.21.15.87:0/1640261485 conn(0x7f17680ac550 msgr2=0x7f1768155960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 shutdown_connections 2024-04-25T15:56:51.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:51.756+0000 7f176c884640 1 -- 172.21.15.87:0/1640261485 wait complete. 2024-04-25T15:56:51.777 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:56:53.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:53.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 Processor -- start 2024-04-25T15:56:53.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 -- start start 2024-04-25T15:56:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3c00c7bd0 0x7fe3c0157680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c0154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3c00c7970 con 0x7fe3c00c7150 2024-04-25T15:56:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c0151b30 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3c6240640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c00c4080 con 0x7fe3c00c7560 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3bf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3c00c7bd0 0x7fe3c0157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3beffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe3c00c7150 0x7fe3c01540f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52196/0 (socket says 172.21.15.87:52196) 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3beffd640 1 -- 172.21.15.87:0/3294052894 learned_addr learned my addr 172.21.15.87:0/3294052894 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3bf7fe640 1 -- 172.21.15.87:0/3294052894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 msgr2=0x7fe3c0154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3bffff640 1 --2- 172.21.15.87:0/3294052894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c0154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3bf7fe640 1 --2- 172.21.15.87:0/3294052894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c0154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3bf7fe640 1 -- 172.21.15.87:0/3294052894 >> v1:172.21.15.87:6789/0 conn(0x7fe3c00c7150 legacy=0x7fe3c01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3bf7fe640 1 -- 172.21.15.87:0/3294052894 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c00c4360 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.948+0000 7fe3be7fc640 1 -- 172.21.15.87:0/3294052894 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567786457 0 0) 0x7fe3c00c7970 con 0x7fe3c00c7150 2024-04-25T15:56:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3bf7fe640 1 --2- 172.21.15.87:0/3294052894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c0157680 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80097c0 tx=0x7fe3a801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9e999af875877f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3be7fc640 1 -- 172.21.15.87:0/3294052894 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80b0070 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3be7fc640 1 -- 172.21.15.87:0/3294052894 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a8004230 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3be7fc640 1 -- 172.21.15.87:0/3294052894 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8003620 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 -- 172.21.15.87:0/3294052894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 msgr2=0x7fe3c0157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 --2- 172.21.15.87:0/3294052894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c0157680 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80097c0 tx=0x7fe3a801c350 comp rx=0 tx=0).stop 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 -- 172.21.15.87:0/3294052894 shutdown_connections 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 --2- 172.21.15.87:0/3294052894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c0154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 --2- 172.21.15.87:0/3294052894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c0157680 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 -- 172.21.15.87:0/3294052894 >> 172.21.15.87:0/3294052894 conn(0x7fe3c006c670 msgr2=0x7fe3c006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 -- 172.21.15.87:0/3294052894 shutdown_connections 2024-04-25T15:56:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.952+0000 7fe3c6240640 1 -- 172.21.15.87:0/3294052894 wait complete. 2024-04-25T15:56:53.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 Processor -- start 2024-04-25T15:56:53.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- start start 2024-04-25T15:56:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c00c7150 0x7fe3c00746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c01eead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c00c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0157bc0 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c00c3d50 con 0x7fe3c00c7150 2024-04-25T15:56:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c00c6190 con 0x7fe3c00c7560 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c00c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c00c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58308/0 (socket says 172.21.15.87:58308) 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 -- 172.21.15.87:0/496257212 learned_addr learned my addr 172.21.15.87:0/496257212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3beffd640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c01eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bf7fe640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c00c7150 0x7fe3c00746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 -- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 msgr2=0x7fe3c01eead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c01eead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 -- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c00c7150 msgr2=0x7fe3c00746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c00c7150 0x7fe3c00746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 -- 172.21.15.87:0/496257212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c0150980 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bf7fe640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c00c7150 0x7fe3c00746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3bffff640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c00c1c60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800cc00 tx=0x7fe3b800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800ce10 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b80039a0 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c0150c60 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8003d70 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c0075170 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.956+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c0069bb0 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.960+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe3b8003f10 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.960+0000 7fe3b7fff640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe3a006f400 0x7fe3a0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.960+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7fe3b808ff10 con 0x7fe3c00c7bd0 2024-04-25T15:56:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.960+0000 7fe3bf7fe640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe3a006f400 0x7fe3a0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.960+0000 7fe3bf7fe640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe3a006f400 0x7fe3a0071910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80ad000 tx=0x7fe3a80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:53.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:53.964+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe3b8014030 con 0x7fe3c00c7bd0 2024-04-25T15:56:54.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3c0150e30 con 0x7fe3c00c7bd0 2024-04-25T15:56:54.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3b7fff640 1 -- 172.21.15.87:0/496257212 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7fe3b805ca00 con 0x7fe3c00c7bd0 2024-04-25T15:56:54.179 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:54.179 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:54.179 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:54.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe3a006f400 msgr2=0x7fe3a0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:54.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe3a006f400 0x7fe3a0071910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80ad000 tx=0x7fe3a80a6000 comp rx=0 tx=0).stop 2024-04-25T15:56:54.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 msgr2=0x7fe3c00c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:54.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c00c1c60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800cc00 tx=0x7fe3b800a5c0 comp rx=0 tx=0).stop 2024-04-25T15:56:54.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 shutdown_connections 2024-04-25T15:56:54.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe3a006f400 0x7fe3a0071910 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:54.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c00c7bd0 0x7fe3c00c1c60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:54.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3c00c7560 0x7fe3c01eead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:54.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 --2- 172.21.15.87:0/496257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3c00c7150 0x7fe3c00746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:54.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 >> 172.21.15.87:0/496257212 conn(0x7fe3c006c670 msgr2=0x7fe3c0155460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:54.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 shutdown_connections 2024-04-25T15:56:54.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:54.176+0000 7fe3c6240640 1 -- 172.21.15.87:0/496257212 wait complete. 2024-04-25T15:56:54.200 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:56:56.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:56.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.364+0000 7fd3c4293640 1 Processor -- start 2024-04-25T15:56:56.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.364+0000 7fd3c4293640 1 -- start start 2024-04-25T15:56:56.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c4293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:56.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c4293640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3bc157410 0x7fd3bc157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c4293640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3bc06f240 con 0x7fd3bc13ccb0 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c4293640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd3bc06fb70 con 0x7fd3bc157410 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c4293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc13d0c0 con 0x7fd3bc072eb0 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3bc157410 0x7fd3bc157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3bc157410 0x7fd3bc157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58314/0 (socket says 172.21.15.87:58314) 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 -- 172.21.15.87:0/1045305865 learned_addr learned my addr 172.21.15.87:0/1045305865 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c182e640 1 --2- 172.21.15.87:0/1045305865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 -- 172.21.15.87:0/1045305865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 msgr2=0x7fd3bc156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 --2- 172.21.15.87:0/1045305865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 -- 172.21.15.87:0/1045305865 >> v1:172.21.15.155:6789/0 conn(0x7fd3bc13ccb0 legacy=0x7fd3bc0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:56.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.368+0000 7fd3c2830640 1 -- 172.21.15.87:0/1045305865 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc06f520 con 0x7fd3bc157410 2024-04-25T15:56:56.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c2830640 1 --2- 172.21.15.87:0/1045305865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc157820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400d150 tx=0x7fd3b401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990a84cd9f023613 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:56.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c102d640 1 -- 172.21.15.87:0/1045305865 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400b2d0 con 0x7fd3bc157410 2024-04-25T15:56:56.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c102d640 1 -- 172.21.15.87:0/1045305865 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b400b470 con 0x7fd3bc157410 2024-04-25T15:56:56.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c102d640 1 -- 172.21.15.87:0/1045305865 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40a7a60 con 0x7fd3bc157410 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 -- 172.21.15.87:0/1045305865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 msgr2=0x7fd3bc157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 --2- 172.21.15.87:0/1045305865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc157820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400d150 tx=0x7fd3b401eba0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 -- 172.21.15.87:0/1045305865 shutdown_connections 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 --2- 172.21.15.87:0/1045305865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 --2- 172.21.15.87:0/1045305865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc157820 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 -- 172.21.15.87:0/1045305865 >> 172.21.15.87:0/1045305865 conn(0x7fd3bc06d650 msgr2=0x7fd3bc0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 -- 172.21.15.87:0/1045305865 shutdown_connections 2024-04-25T15:56:56.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 -- 172.21.15.87:0/1045305865 wait complete. 2024-04-25T15:56:56.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 Processor -- start 2024-04-25T15:56:56.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.372+0000 7fd3c4293640 1 -- start start 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc1f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3bc13ccb0 0x7fd3bc15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc06dbe0 con 0x7fd3bc157410 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc06da60 con 0x7fd3bc13ccb0 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc160210 con 0x7fd3bc072eb0 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:56.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc1f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58316/0 (socket says 172.21.15.87:58316) 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 -- 172.21.15.87:0/2443098304 learned_addr learned my addr 172.21.15.87:0/2443098304 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c202f640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc1f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c182e640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3bc13ccb0 0x7fd3bc15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 -- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 msgr2=0x7fd3bc1f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc1f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 -- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3bc13ccb0 msgr2=0x7fd3bc15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3bc13ccb0 0x7fd3bc15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 -- 172.21.15.87:0/2443098304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc1f08a0 con 0x7fd3bc157410 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c182e640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3bc13ccb0 0x7fd3bc15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c2830640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc1f41d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3b401c7d0 tx=0x7fd3b401b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400b720 con 0x7fd3bc157410 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b4009600 con 0x7fd3bc157410 2024-04-25T15:56:56.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc133990 con 0x7fd3bc157410 2024-04-25T15:56:56.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40099f0 con 0x7fd3bc157410 2024-04-25T15:56:56.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc133f50 con 0x7fd3bc157410 2024-04-25T15:56:56.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc069bb0 con 0x7fd3bc157410 2024-04-25T15:56:56.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd3b40c0020 con 0x7fd3bc157410 2024-04-25T15:56:56.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3b2ffd640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3a006f400 0x7fd3a0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:56.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7fd3b412a1d0 con 0x7fd3bc157410 2024-04-25T15:56:56.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.376+0000 7fd3c202f640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3a006f400 0x7fd3a0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:56.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.380+0000 7fd3c202f640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3a006f400 0x7fd3a0071910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0c6b00 tx=0x7fd3b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:56.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.384+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3b40c7020 con 0x7fd3bc157410 2024-04-25T15:56:56.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.624+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3bc0705a0 con 0x7fd3bc157410 2024-04-25T15:56:56.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3b2ffd640 1 -- 172.21.15.87:0/2443098304 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7fd3b4018820 con 0x7fd3bc157410 2024-04-25T15:56:56.631 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:56.631 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:56.631 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3a006f400 msgr2=0x7fd3a0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3a006f400 0x7fd3a0071910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0c6b00 tx=0x7fd3b8009040 comp rx=0 tx=0).stop 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 msgr2=0x7fd3bc1f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc1f41d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3b401c7d0 tx=0x7fd3b401b940 comp rx=0 tx=0).stop 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 shutdown_connections 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3a006f400 0x7fd3a0071910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3bc157410 0x7fd3bc1f41d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3bc13ccb0 0x7fd3bc15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 --2- 172.21.15.87:0/2443098304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3bc072eb0 0x7fd3bc1f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:56.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 >> 172.21.15.87:0/2443098304 conn(0x7fd3bc06d650 msgr2=0x7fd3bc137e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 shutdown_connections 2024-04-25T15:56:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:56.628+0000 7fd3c4293640 1 -- 172.21.15.87:0/2443098304 wait complete. 2024-04-25T15:56:56.651 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:56:58.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:56:58.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.816+0000 7ffa72b9e640 1 Processor -- start 2024-04-25T15:56:58.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.816+0000 7ffa72b9e640 1 -- start start 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa72b9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa6c156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa72b9e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa6c157410 0x7ffa6c157820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa72b9e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c06f240 con 0x7ffa6c13ccb0 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa72b9e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6c06fb70 con 0x7ffa6c157410 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa72b9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c13d0c0 con 0x7ffa6c072eb0 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa7093a640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffa6c13ccb0 0x7ffa6c0727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52210/0 (socket says 172.21.15.87:52210) 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa7093a640 1 -- 172.21.15.87:0/2886690079 learned_addr learned my addr 172.21.15.87:0/2886690079 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:56:58.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa7113b640 1 --2- 172.21.15.87:0/2886690079 >> v2:172.21.15.155:3300/0 conn(0x7ffa6c157410 0x7ffa6c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa6c156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894372819 0 0) 0x7ffa6c06f240 con 0x7ffa6c13ccb0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa5c003530 con 0x7ffa6c13ccb0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2399139480 0 0) 0x7ffa5c003530 con 0x7ffa6c13ccb0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 msgr2=0x7ffa6c156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa6c156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 >> v2:172.21.15.155:3300/0 conn(0x7ffa6c157410 msgr2=0x7ffa6c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 --2- 172.21.15.87:0/2886690079 >> v2:172.21.15.155:3300/0 conn(0x7ffa6c157410 0x7ffa6c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c06f520 con 0x7ffa6c13ccb0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ffa60001680 con 0x7ffa6c13ccb0 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 >> v1:172.21.15.87:6789/0 conn(0x7ffa6c13ccb0 legacy=0x7ffa6c0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa5c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c003f40 0x7ffa5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa5c004d50 0x7ffa5c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c06fb70 con 0x7ffa5c003f40 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c13d0c0 con 0x7ffa5c004d50 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c00bad0 con 0x7ffa6c072eb0 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c003f40 0x7ffa5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa7093a640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa5c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa7113b640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa5c004d50 0x7ffa5c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 -- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 msgr2=0x7ffa5c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa5c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 -- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa5c004d50 msgr2=0x7ffa5c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa5c004d50 0x7ffa5c005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa6bfff640 1 -- 172.21.15.87:0/2886690079 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c003530 con 0x7ffa5c003f40 2024-04-25T15:56:58.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.820+0000 7ffa7093a640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c072eb0 0x7ffa5c0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa6bfff640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c003f40 0x7ffa5c004810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009ae0 tx=0x7ffa5801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a35f9d6528fdf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580096b0 con 0x7ffa5c003f40 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa580a8450 con 0x7ffa5c003f40 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa6b7fe640 1 -- 172.21.15.87:0/2886690079 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580a8840 con 0x7ffa5c003f40 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa72b9e640 1 -- 172.21.15.87:0/2886690079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c003f40 msgr2=0x7ffa5c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/2886690079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c003f40 0x7ffa5c004810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009ae0 tx=0x7ffa5801ca90 comp rx=0 tx=0).stop 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa7113b640 1 -- 172.21.15.87:0/2886690079 reap_dead start 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa72b9e640 1 -- 172.21.15.87:0/2886690079 shutdown_connections 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa72b9e640 1 -- 172.21.15.87:0/2886690079 >> 172.21.15.87:0/2886690079 conn(0x7ffa6c06d650 msgr2=0x7ffa6c0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa72b9e640 1 -- 172.21.15.87:0/2886690079 shutdown_connections 2024-04-25T15:56:58.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.824+0000 7ffa72b9e640 1 -- 172.21.15.87:0/2886690079 wait complete. 2024-04-25T15:56:58.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 Processor -- start 2024-04-25T15:56:58.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 -- start start 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa6c1f1850 0x7ffa6c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c1ed820 0x7ffa6c1335b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 0x7ffa6c154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c06dbe0 con 0x7ffa6c133af0 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c06da60 con 0x7ffa6c1f1850 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c15e200 con 0x7ffa6c1ed820 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 0x7ffa6c154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 0x7ffa6c154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58334/0 (socket says 172.21.15.87:58334) 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 -- 172.21.15.87:0/4049984705 learned_addr learned my addr 172.21.15.87:0/4049984705 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa6bfff640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c1ed820 0x7ffa6c1335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7093a640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa6c1f1850 0x7ffa6c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 -- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c1ed820 msgr2=0x7ffa6c1335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c1ed820 0x7ffa6c1335b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 -- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa6c1f1850 msgr2=0x7ffa6c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa6c1f1850 0x7ffa6c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 -- 172.21.15.87:0/4049984705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c1f0d90 con 0x7ffa6c133af0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa7113b640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 0x7ffa6c154cd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c070540 tx=0x7ffa6400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64016420 con 0x7ffa6c133af0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6401b070 con 0x7ffa6c133af0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64016800 con 0x7ffa6c133af0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c1f1c60 con 0x7ffa6c133af0 2024-04-25T15:56:58.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.828+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c130d60 con 0x7ffa6c133af0 2024-04-25T15:56:58.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.832+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c069bb0 con 0x7ffa6c133af0 2024-04-25T15:56:58.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.832+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffa640169a0 con 0x7ffa6c133af0 2024-04-25T15:56:58.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.832+0000 7ffa697fa640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffa5006f400 0x7ffa50071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:56:58.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.832+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6867+0+0 (secure 0 0 0) 0x7ffa64090380 con 0x7ffa6c133af0 2024-04-25T15:56:58.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.832+0000 7ffa7093a640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffa5006f400 0x7ffa50071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:56:58.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.832+0000 7ffa7093a640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffa5006f400 0x7ffa50071910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c156e30 tx=0x7ffa60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:56:58.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:58.836+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa6405cde0 con 0x7ffa6c133af0 2024-04-25T15:56:59.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.048+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa6c0c4e40 con 0x7ffa6c133af0 2024-04-25T15:56:59.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.048+0000 7ffa697fa640 1 -- 172.21.15.87:0/4049984705 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6492 (secure 0 0 0) 0x7ffa6405c6e0 con 0x7ffa6c133af0 2024-04-25T15:56:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:56:59.054 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:55:17.253786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4246},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4246":{"gid":4246,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":21,"addr":"172.21.15.155:6833/1039729746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":1039729746},{"type":"v1","addr":"172.21.15.155:6833","nonce":1039729746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffa5006f400 msgr2=0x7ffa50071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffa5006f400 0x7ffa50071910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c156e30 tx=0x7ffa60009040 comp rx=0 tx=0).stop 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 msgr2=0x7ffa6c154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 0x7ffa6c154cd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c070540 tx=0x7ffa6400f520 comp rx=0 tx=0).stop 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 shutdown_connections 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffa5006f400 0x7ffa50071910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c133af0 0x7ffa6c154cd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa6c1ed820 0x7ffa6c1335b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 --2- 172.21.15.87:0/4049984705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa6c1f1850 0x7ffa6c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:56:59.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 >> 172.21.15.87:0/4049984705 conn(0x7ffa6c06d650 msgr2=0x7ffa6c1359c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:56:59.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 shutdown_connections 2024-04-25T15:56:59.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:56:59.052+0000 7ffa72b9e640 1 -- 172.21.15.87:0/4049984705 wait complete. 2024-04-25T15:56:59.075 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:57:01.076 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.232+0000 7f1b151df640 1 Processor -- start 2024-04-25T15:57:01.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.232+0000 7f1b151df640 1 -- start start 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b151df640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b101518b0 0x7f1b1006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b151df640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b151df640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b10154fc0 con 0x7f1b100c4620 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b151df640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1006ed60 con 0x7f1b101518b0 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b151df640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b100acb20 con 0x7f1b100ad160 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0f59e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1b100c4620 0x7f1b10157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46684/0 (socket says 172.21.15.87:46684) 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0ed9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b101518b0 0x7f1b1006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0f59e640 1 -- 172.21.15.87:0/3577761317 learned_addr learned my addr 172.21.15.87:0/3577761317 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0dd9b640 1 -- 172.21.15.87:0/3577761317 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910621529 0 0) 0x7f1b10154fc0 con 0x7f1b100c4620 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0dd9b640 1 -- 172.21.15.87:0/3577761317 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af8003530 con 0x7f1b100c4620 2024-04-25T15:57:01.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0e59c640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0ed9d640 1 -- 172.21.15.87:0/3577761317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 msgr2=0x7f1b100c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0ed9d640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0ed9d640 1 -- 172.21.15.87:0/3577761317 >> v1:172.21.15.87:6789/0 conn(0x7f1b100c4620 legacy=0x7f1b10157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0ed9d640 1 -- 172.21.15.87:0/3577761317 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b100ace00 con 0x7f1b101518b0 2024-04-25T15:57:01.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.236+0000 7f1b0e59c640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:57:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b0ed9d640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b101518b0 0x7f1b1006f4d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009d90 tx=0x7f1b0001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37436c2279d3a575 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b0dd9b640 1 -- 172.21.15.87:0/3577761317 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000b2070 con 0x7f1b101518b0 2024-04-25T15:57:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b0dd9b640 1 -- 172.21.15.87:0/3577761317 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b000a5a50 con 0x7f1b101518b0 2024-04-25T15:57:01.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b0dd9b640 1 -- 172.21.15.87:0/3577761317 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000a5e00 con 0x7f1b101518b0 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 -- 172.21.15.87:0/3577761317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b101518b0 msgr2=0x7f1b1006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b101518b0 0x7f1b1006f4d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009d90 tx=0x7f1b0001c970 comp rx=0 tx=0).stop 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 -- 172.21.15.87:0/3577761317 shutdown_connections 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 --2- 172.21.15.87:0/3577761317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b101518b0 0x7f1b1006f4d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 -- 172.21.15.87:0/3577761317 >> 172.21.15.87:0/3577761317 conn(0x7f1b100c8770 msgr2=0x7f1b100c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 -- 172.21.15.87:0/3577761317 shutdown_connections 2024-04-25T15:57:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 -- 172.21.15.87:0/3577761317 wait complete. 2024-04-25T15:57:01.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 Processor -- start 2024-04-25T15:57:01.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.240+0000 7f1b151df640 1 -- start start 2024-04-25T15:57:01.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 0x7f1b101f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b101518b0 0x7f1b1014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10161d60 con 0x7f1b100c4620 2024-04-25T15:57:01.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10161be0 con 0x7f1b101518b0 2024-04-25T15:57:01.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b10161ee0 con 0x7f1b100ad160 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 0x7f1b101f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 0x7f1b101f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35280/0 (socket says 172.21.15.87:35280) 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 -- 172.21.15.87:0/3966714278 learned_addr learned my addr 172.21.15.87:0/3966714278 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0ed9d640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0f59e640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b101518b0 0x7f1b1014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 -- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 msgr2=0x7f1b100c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 -- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b101518b0 msgr2=0x7f1b1014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b101518b0 0x7f1b1014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 -- 172.21.15.87:0/3966714278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1015eaf0 con 0x7f1b100c4620 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b0e59c640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 0x7f1b101f2290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c820 tx=0x7f1b0400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04015070 con 0x7f1b100c4620 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04007a30 con 0x7f1b100c4620 2024-04-25T15:57:01.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04007e40 con 0x7f1b100c4620 2024-04-25T15:57:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b101f2cc0 con 0x7f1b100c4620 2024-04-25T15:57:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b100c24d0 con 0x7f1b100c4620 2024-04-25T15:57:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b10069bb0 con 0x7f1b100c4620 2024-04-25T15:57:01.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.244+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1b04018070 con 0x7f1b100c4620 2024-04-25T15:57:01.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.248+0000 7f1af77fe640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1afc06f430 0x7f1afc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.248+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f1b0408f9b0 con 0x7f1b100c4620 2024-04-25T15:57:01.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.248+0000 7f1b0ed9d640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1afc06f430 0x7f1afc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.248+0000 7f1b0ed9d640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1afc06f430 0x7f1afc071940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1b000af000 tx=0x7f1b000a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:01.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.248+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b0405c530 con 0x7f1b100c4620 2024-04-25T15:57:01.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.452+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b100abfa0 con 0x7f1b100c4620 2024-04-25T15:57:01.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.452+0000 7f1af77fe640 1 -- 172.21.15.87:0/3966714278 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5660 (secure 0 0 0) 0x7f1b0405be30 con 0x7f1b100c4620 2024-04-25T15:57:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:01.457 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:56:59.886552+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:01.457 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1afc06f430 msgr2=0x7f1afc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1afc06f430 0x7f1afc071940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1b000af000 tx=0x7f1b000a7070 comp rx=0 tx=0).stop 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 msgr2=0x7f1b101f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 0x7f1b101f2290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c820 tx=0x7f1b0400cce0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 shutdown_connections 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1afc06f430 0x7f1afc071940 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b101518b0 0x7f1b1014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b100c4620 0x7f1b101f2290 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 --2- 172.21.15.87:0/3966714278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b100ad160 0x7f1b100c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 >> 172.21.15.87:0/3966714278 conn(0x7f1b100c8770 msgr2=0x7f1b1015f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:01.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 shutdown_connections 2024-04-25T15:57:01.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.456+0000 7f1b151df640 1 -- 172.21.15.87:0/3966714278 wait complete. 2024-04-25T15:57:01.477 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-04-25T15:57:01.477 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T15:57:01.478 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:01.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.640+0000 7f764d64a640 1 Processor -- start 2024-04-25T15:57:01.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.640+0000 7f764d64a640 1 -- start start 2024-04-25T15:57:01.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f764d64a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7648071e50 0x7f76480c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f764d64a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76480c4720 0x7f764815fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f764d64a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7648072430 con 0x7f76481529a0 2024-04-25T15:57:01.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f764d64a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7648074730 con 0x7f76480c4720 2024-04-25T15:57:01.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f764d64a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7648074a10 con 0x7f7648071e50 2024-04-25T15:57:01.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76477fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76480c4720 0x7f764815fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76467fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7648071e50 0x7f76480c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f7646ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f76481529a0 0x7f76480ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:52194/0 (socket says 172.21.15.87:52194) 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f7646ffd640 1 -- 172.21.15.87:0/1860492096 learned_addr learned my addr 172.21.15.87:0/1860492096 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76477fe640 1 -- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7648071e50 msgr2=0x7f76480c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76477fe640 1 --2- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7648071e50 0x7f76480c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76477fe640 1 -- 172.21.15.87:0/1860492096 >> v1:172.21.15.155:6789/0 conn(0x7f76481529a0 legacy=0x7f76480ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76477fe640 1 -- 172.21.15.87:0/1860492096 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7648074cf0 con 0x7f76480c4720 2024-04-25T15:57:01.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.644+0000 7f76467fc640 1 --2- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7648071e50 0x7f76480c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:57:01.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f76477fe640 1 --2- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76480c4720 0x7f764815fad0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7640009d90 tx=0x7f764001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddcaa82e50a7dcef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:01.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f7645ffb640 1 -- 172.21.15.87:0/1860492096 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400b2070 con 0x7f76480c4720 2024-04-25T15:57:01.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f7645ffb640 1 -- 172.21.15.87:0/1860492096 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76400a57a0 con 0x7f76480c4720 2024-04-25T15:57:01.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f7645ffb640 1 -- 172.21.15.87:0/1860492096 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400a5b70 con 0x7f76480c4720 2024-04-25T15:57:01.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 -- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76480c4720 msgr2=0x7f764815fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 --2- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76480c4720 0x7f764815fad0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7640009d90 tx=0x7f764001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 -- 172.21.15.87:0/1860492096 shutdown_connections 2024-04-25T15:57:01.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 --2- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76480c4720 0x7f764815fad0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 --2- 172.21.15.87:0/1860492096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7648071e50 0x7f76480c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 -- 172.21.15.87:0/1860492096 >> 172.21.15.87:0/1860492096 conn(0x7f76480c8770 msgr2=0x7f76480c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:01.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 -- 172.21.15.87:0/1860492096 shutdown_connections 2024-04-25T15:57:01.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 -- 172.21.15.87:0/1860492096 wait complete. 2024-04-25T15:57:01.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 Processor -- start 2024-04-25T15:57:01.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.648+0000 7f764d64a640 1 -- start start 2024-04-25T15:57:01.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7648071e50 0x7f76481eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 0x7f76480c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76481529a0 0x7f76480c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f76481629b0 con 0x7f76480c4720 2024-04-25T15:57:01.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7648162830 con 0x7f7648071e50 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7648162b30 con 0x7f76481529a0 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 0x7f76480c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 0x7f76480c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35290/0 (socket says 172.21.15.87:35290) 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 -- 172.21.15.87:0/2851287379 learned_addr learned my addr 172.21.15.87:0/2851287379 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f7646ffd640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7648071e50 0x7f76481eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76477fe640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76481529a0 0x7f76480c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 -- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76481529a0 msgr2=0x7f76480c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76481529a0 0x7f76480c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 -- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7648071e50 msgr2=0x7f76481eecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7648071e50 0x7f76481eecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 -- 172.21.15.87:0/2851287379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7648150460 con 0x7f76480c4720 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f76467fc640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 0x7f76480c75f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e9b0 tx=0x7f763c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c017070 con 0x7f76480c4720 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c00c9a0 con 0x7f76480c4720 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76481579a0 con 0x7f76480c4720 2024-04-25T15:57:01.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00cd90 con 0x7f76480c4720 2024-04-25T15:57:01.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76481ef710 con 0x7f76480c4720 2024-04-25T15:57:01.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7648143dc0 con 0x7f76480c4720 2024-04-25T15:57:01.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.652+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f763c01a070 con 0x7f76480c4720 2024-04-25T15:57:01.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.656+0000 7f762f7fe640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f763406f400 0x7f7634071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:01.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.656+0000 7f7646ffd640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f763406f400 0x7f7634071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:01.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.656+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f763c08f8b0 con 0x7f76480c4720 2024-04-25T15:57:01.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.656+0000 7f7646ffd640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f763406f400 0x7f7634071910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7638000f70 tx=0x7f7638007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:01.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.660+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f763c05bde0 con 0x7f76480c4720 2024-04-25T15:57:01.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.860+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7648069bb0 con 0x7f76480c4720 2024-04-25T15:57:01.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.860+0000 7f762f7fe640 1 -- 172.21.15.87:0/2851287379 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5657 (secure 0 0 0) 0x7f763c0600e0 con 0x7f76480c4720 2024-04-25T15:57:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:01.864 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:00.566719+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:01.864 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 28 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f763406f400 msgr2=0x7f7634071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f763406f400 0x7f7634071910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7638000f70 tx=0x7f7638007e90 comp rx=0 tx=0).stop 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 msgr2=0x7f76480c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 0x7f76480c75f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e9b0 tx=0x7f763c00ee70 comp rx=0 tx=0).stop 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 shutdown_connections 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f763406f400 0x7f7634071910 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76481529a0 0x7f76480c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76480c4720 0x7f76480c75f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 --2- 172.21.15.87:0/2851287379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7648071e50 0x7f76481eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:01.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 >> 172.21.15.87:0/2851287379 conn(0x7f76480c8770 msgr2=0x7f764814e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:01.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 shutdown_connections 2024-04-25T15:57:01.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:01.864+0000 7f764d64a640 1 -- 172.21.15.87:0/2851287379 wait complete. 2024-04-25T15:57:01.885 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5331": { "addr": "172.21.15.87:6837/4061291849", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6836", "nonce": 4061291849, "type": "v2" }, { "addr": "172.21.15.87:6837", "nonce": 4061291849, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5331, "incarnation": 26, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:rejoin", "state_seq": 21 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:57:00.566719+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5331 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 24, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5262": { "addr": "172.21.15.87:6835/1293807006", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 1293807006, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 1293807006, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5262, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:55:37.257991+0000", "qdb_cluster": [ 5262 ], "qdb_leader": 5262, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5262 } } } ], "standbys": [ { "addr": "172.21.15.155:6835/630698588", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 630698588, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 630698588, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T15:57:03.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:04.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.044+0000 7fe5044c0640 1 Processor -- start 2024-04-25T15:57:04.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.044+0000 7fe5044c0640 1 -- start start 2024-04-25T15:57:04.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe5044c0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe4fc152980 0x7fe4fc0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:04.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe5044c0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4fc155730 0x7fe4fc15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe5044c0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4fc152d90 con 0x7fe4fc155320 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe5044c0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe4fc0aa290 con 0x7fe4fc152980 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe5044c0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe4fc1598b0 con 0x7fe4fc155730 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe4fc152980 0x7fe4fc0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe4fc152980 0x7fe4fc0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35292/0 (socket says 172.21.15.87:35292) 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe501a5b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe4fc155320 0x7fe4fc074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46688/0 (socket says 172.21.15.87:46688) 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 -- 172.21.15.87:0/344566237 learned_addr learned my addr 172.21.15.87:0/344566237 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe502a5d640 1 --2- 172.21.15.87:0/344566237 >> v2:172.21.15.155:3300/0 conn(0x7fe4fc155730 0x7fe4fc15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50125a640 1 -- 172.21.15.87:0/344566237 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153767483 0 0) 0x7fe4fc152d90 con 0x7fe4fc155320 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 -- 172.21.15.87:0/344566237 >> v2:172.21.15.155:3300/0 conn(0x7fe4fc155730 msgr2=0x7fe4fc15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 --2- 172.21.15.87:0/344566237 >> v2:172.21.15.155:3300/0 conn(0x7fe4fc155730 0x7fe4fc15fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 -- 172.21.15.87:0/344566237 >> v1:172.21.15.87:6789/0 conn(0x7fe4fc155320 legacy=0x7fe4fc074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 -- 172.21.15.87:0/344566237 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc0ca2f0 con 0x7fe4fc152980 2024-04-25T15:57:04.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe502a5d640 1 --2- 172.21.15.87:0/344566237 >> v2:172.21.15.155:3300/0 conn(0x7fe4fc155730 0x7fe4fc15fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:04.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.048+0000 7fe50225c640 1 --2- 172.21.15.87:0/344566237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc152980 0x7fe4fc0c9db0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc050c70 tx=0x7fe4f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef696dca27b144c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:04.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe50125a640 1 -- 172.21.15.87:0/344566237 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80b0070 con 0x7fe4fc152980 2024-04-25T15:57:04.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe50125a640 1 -- 172.21.15.87:0/344566237 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f80ab600 con 0x7fe4fc152980 2024-04-25T15:57:04.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe50125a640 1 -- 172.21.15.87:0/344566237 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80ab9d0 con 0x7fe4fc152980 2024-04-25T15:57:04.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 -- 172.21.15.87:0/344566237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc152980 msgr2=0x7fe4fc0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:04.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 --2- 172.21.15.87:0/344566237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc152980 0x7fe4fc0c9db0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc050c70 tx=0x7fe4f801c490 comp rx=0 tx=0).stop 2024-04-25T15:57:04.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 -- 172.21.15.87:0/344566237 shutdown_connections 2024-04-25T15:57:04.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 --2- 172.21.15.87:0/344566237 >> v2:172.21.15.155:3300/0 conn(0x7fe4fc155730 0x7fe4fc15fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 --2- 172.21.15.87:0/344566237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc152980 0x7fe4fc0c9db0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 -- 172.21.15.87:0/344566237 >> 172.21.15.87:0/344566237 conn(0x7fe4fc0ac550 msgr2=0x7fe4fc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:04.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 -- 172.21.15.87:0/344566237 shutdown_connections 2024-04-25T15:57:04.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 -- 172.21.15.87:0/344566237 wait complete. 2024-04-25T15:57:04.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 Processor -- start 2024-04-25T15:57:04.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.052+0000 7fe5044c0640 1 -- start start 2024-04-25T15:57:04.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4fc152980 0x7fe4fc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:04.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4fc155320 0x7fe4fc146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:04.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 0x7fe4fc149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc158f70 con 0x7fe4fc155730 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc158c90 con 0x7fe4fc152980 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe4fc074870 con 0x7fe4fc155320 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 0x7fe4fc149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 0x7fe4fc149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35300/0 (socket says 172.21.15.87:35300) 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 -- 172.21.15.87:0/4230246348 learned_addr learned my addr 172.21.15.87:0/4230246348 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe50225c640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4fc152980 0x7fe4fc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe501a5b640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4fc155320 0x7fe4fc146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 -- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4fc155320 msgr2=0x7fe4fc146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4fc155320 0x7fe4fc146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 -- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4fc152980 msgr2=0x7fe4fc1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4fc152980 0x7fe4fc1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 -- 172.21.15.87:0/4230246348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc152450 con 0x7fe4fc155730 2024-04-25T15:57:04.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe502a5d640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 0x7fe4fc149d10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4007e20 tx=0x7fe4f400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:04.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f401a070 con 0x7fe4fc155730 2024-04-25T15:57:04.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f4003ba0 con 0x7fe4fc155730 2024-04-25T15:57:04.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400de80 con 0x7fe4fc155730 2024-04-25T15:57:04.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4fc1491e0 con 0x7fe4fc155730 2024-04-25T15:57:04.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4fc1582d0 con 0x7fe4fc155730 2024-04-25T15:57:04.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e40052a0 con 0x7fe4fc155730 2024-04-25T15:57:04.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.056+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe4f401d070 con 0x7fe4fc155730 2024-04-25T15:57:04.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.060+0000 7fe4f2ffd640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe4e0073890 0x7fe4e0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:04.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.060+0000 7fe50225c640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe4e0073890 0x7fe4e0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:04.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.060+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7fe4f408f7a0 con 0x7fe4fc155730 2024-04-25T15:57:04.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.060+0000 7fe50225c640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe4e0073890 0x7fe4e0075da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80ad000 tx=0x7fe4f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:04.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.064+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4f4010070 con 0x7fe4fc155730 2024-04-25T15:57:04.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.344+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4e4005860 con 0x7fe4fc155730 2024-04-25T15:57:04.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.344+0000 7fe4f2ffd640 1 -- 172.21.15.87:0/4230246348 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5663 (secure 0 0 0) 0x7fe4f405bcd0 con 0x7fe4fc155730 2024-04-25T15:57:04.351 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:04.351 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:01.562202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:clientreplay","state_seq":22,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 29 2024-04-25T15:57:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe4e0073890 msgr2=0x7fe4e0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:04.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe4e0073890 0x7fe4e0075da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80ad000 tx=0x7fe4f8008040 comp rx=0 tx=0).stop 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 msgr2=0x7fe4fc149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 0x7fe4fc149d10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4007e20 tx=0x7fe4f400d4a0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 shutdown_connections 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe4e0073890 0x7fe4e0075da0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc155730 0x7fe4fc149d10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4fc155320 0x7fe4fc146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 --2- 172.21.15.87:0/4230246348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4fc152980 0x7fe4fc1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 >> 172.21.15.87:0/4230246348 conn(0x7fe4fc0ac550 msgr2=0x7fe4fc154830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 shutdown_connections 2024-04-25T15:57:04.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:04.348+0000 7fe5044c0640 1 -- 172.21.15.87:0/4230246348 wait complete. 2024-04-25T15:57:04.374 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T15:57:06.374 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:06.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.556+0000 7ff358363640 1 Processor -- start 2024-04-25T15:57:06.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.556+0000 7ff358363640 1 -- start start 2024-04-25T15:57:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff358363640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 0x7ff3500c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff358363640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3500744e0 0x7ff350154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff358363640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff350063220 con 0x7ff3500c28b0 2024-04-25T15:57:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff358363640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff3500c5570 con 0x7ff3500744e0 2024-04-25T15:57:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff358363640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff350074a90 con 0x7ff3500740d0 2024-04-25T15:57:06.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 0x7ff3500c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3558fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3500744e0 0x7ff350154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 0x7ff3500c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:45262/0 (socket says 172.21.15.87:45262) 2024-04-25T15:57:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 -- 172.21.15.87:0/2071394625 learned_addr learned my addr 172.21.15.87:0/2071394625 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 -- 172.21.15.87:0/2071394625 >> v2:172.21.15.155:3300/0 conn(0x7ff3500744e0 msgr2=0x7ff350154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:06.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 --2- 172.21.15.87:0/2071394625 >> v2:172.21.15.155:3300/0 conn(0x7ff3500744e0 0x7ff350154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 -- 172.21.15.87:0/2071394625 >> v1:172.21.15.155:6789/0 conn(0x7ff3500c28b0 legacy=0x7ff35015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:06.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3560ff640 1 -- 172.21.15.87:0/2071394625 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3500634c0 con 0x7ff3500740d0 2024-04-25T15:57:06.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.560+0000 7ff3558fe640 1 --2- 172.21.15.87:0/2071394625 >> v2:172.21.15.155:3300/0 conn(0x7ff3500744e0 0x7ff350154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:57:06.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff3560ff640 1 --2- 172.21.15.87:0/2071394625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 0x7ff3500c2370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=309dc9b24bd35a44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:06.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff3550fd640 1 -- 172.21.15.87:0/2071394625 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0b1070 con 0x7ff3500740d0 2024-04-25T15:57:06.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff3550fd640 1 -- 172.21.15.87:0/2071394625 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c0a8050 con 0x7ff3500740d0 2024-04-25T15:57:06.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff3550fd640 1 -- 172.21.15.87:0/2071394625 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0ac860 con 0x7ff3500740d0 2024-04-25T15:57:06.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 -- 172.21.15.87:0/2071394625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 msgr2=0x7ff3500c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:06.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 --2- 172.21.15.87:0/2071394625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 0x7ff3500c2370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c01c4d0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 -- 172.21.15.87:0/2071394625 shutdown_connections 2024-04-25T15:57:06.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 --2- 172.21.15.87:0/2071394625 >> v2:172.21.15.155:3300/0 conn(0x7ff3500744e0 0x7ff350154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 --2- 172.21.15.87:0/2071394625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500740d0 0x7ff3500c2370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 -- 172.21.15.87:0/2071394625 >> 172.21.15.87:0/2071394625 conn(0x7ff35006d650 msgr2=0x7ff3500c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:06.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 -- 172.21.15.87:0/2071394625 shutdown_connections 2024-04-25T15:57:06.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.564+0000 7ff358363640 1 -- 172.21.15.87:0/2071394625 wait complete. 2024-04-25T15:57:06.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 Processor -- start 2024-04-25T15:57:06.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 -- start start 2024-04-25T15:57:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500740d0 0x7ff350070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500744e0 0x7ff3500c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 0x7ff3501f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff35006dbe0 con 0x7ff3500c28b0 2024-04-25T15:57:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.568+0000 7ff358363640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff35006da60 con 0x7ff3500740d0 2024-04-25T15:57:06.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff358363640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3500c5060 con 0x7ff3500744e0 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 0x7ff3501f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 0x7ff3501f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35306/0 (socket says 172.21.15.87:35306) 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 -- 172.21.15.87:0/1512959113 learned_addr learned my addr 172.21.15.87:0/1512959113 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff3560ff640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500740d0 0x7ff350070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff3558fe640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500744e0 0x7ff3500c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 -- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500744e0 msgr2=0x7ff3500c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500744e0 0x7ff3500c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 -- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500740d0 msgr2=0x7ff350070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500740d0 0x7ff350070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 -- 172.21.15.87:0/1512959113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35014fa30 con 0x7ff3500c28b0 2024-04-25T15:57:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff356900640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 0x7ff3501f4330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c730 tx=0x7ff34800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348003ba0 con 0x7ff3500c28b0 2024-04-25T15:57:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff348003d40 con 0x7ff3500c28b0 2024-04-25T15:57:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3501501f0 con 0x7ff3500c28b0 2024-04-25T15:57:06.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348005310 con 0x7ff3500c28b0 2024-04-25T15:57:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.572+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35014fcd0 con 0x7ff3500c28b0 2024-04-25T15:57:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.576+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff350069bb0 con 0x7ff3500c28b0 2024-04-25T15:57:06.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.576+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3480056c0 con 0x7ff3500c28b0 2024-04-25T15:57:06.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.576+0000 7ff346ffd640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f450 0x7ff334071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:06.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.576+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7ff34808f670 con 0x7ff3500c28b0 2024-04-25T15:57:06.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.576+0000 7ff3560ff640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f450 0x7ff334071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:06.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.576+0000 7ff3560ff640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f450 0x7ff334071960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0ae000 tx=0x7ff34c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.584+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff34805c160 con 0x7ff3500c28b0 2024-04-25T15:57:06.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.844+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff350068b30 con 0x7ff3500c28b0 2024-04-25T15:57:06.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff346ffd640 1 -- 172.21.15.87:0/1512959113 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5664 (secure 0 0 0) 0x7ff3480641e0 con 0x7ff3500c28b0 2024-04-25T15:57:06.850 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:06.850 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:06.850 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-04-25T15:57:06.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f450 msgr2=0x7ff334071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f450 0x7ff334071960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0ae000 tx=0x7ff34c0a7000 comp rx=0 tx=0).stop 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 msgr2=0x7ff3501f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 0x7ff3501f4330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c730 tx=0x7ff34800cbf0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 shutdown_connections 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff33406f450 0x7ff334071960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3500c28b0 0x7ff3501f4330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3500744e0 0x7ff3500c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 --2- 172.21.15.87:0/1512959113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3500740d0 0x7ff350070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 >> 172.21.15.87:0/1512959113 conn(0x7ff35006d650 msgr2=0x7ff350156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 shutdown_connections 2024-04-25T15:57:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:06.848+0000 7ff358363640 1 -- 172.21.15.87:0/1512959113 wait complete. 2024-04-25T15:57:06.873 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4246 2024-04-25T15:57:06.873 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.d 2024-04-25T15:57:08.312 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-04-25T15:57:08.308+0000 7feeea2b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:57:08.819 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:08.821 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:09.874 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-04-25T15:57:09.874 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:57:09.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:57:09.877 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:57:09.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:09.994 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-04-25T15:57:10.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 Processor -- start 2024-04-25T15:57:10.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 -- start start 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b400cb030 0x7f6b4015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b40160230 0x7f6b40162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b400c7570 con 0x7f6b4015ad90 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4015b8b0 con 0x7f6b400cb030 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b44cd2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4015b5d0 con 0x7f6b40160230 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b3dd9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b400cb030 0x7f6b4015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b3dd9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b400cb030 0x7f6b4015fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35316/0 (socket says 172.21.15.87:35316) 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b3dd9b640 1 -- 172.21.15.87:0/3472178916 learned_addr learned my addr 172.21.15.87:0/3472178916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.040+0000 7f6b3ed9d640 1 --2- 172.21.15.87:0/3472178916 >> v2:172.21.15.155:3300/0 conn(0x7f6b40160230 0x7f6b40162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3dd9b640 1 -- 172.21.15.87:0/3472178916 >> v2:172.21.15.155:3300/0 conn(0x7f6b40160230 msgr2=0x7f6b40162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3dd9b640 1 --2- 172.21.15.87:0/3472178916 >> v2:172.21.15.155:3300/0 conn(0x7f6b40160230 0x7f6b40162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3dd9b640 1 -- 172.21.15.87:0/3472178916 >> v1:172.21.15.155:6789/0 conn(0x7f6b4015ad90 legacy=0x7f6b400ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:10.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3dd9b640 1 -- 172.21.15.87:0/3472178916 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b400c2290 con 0x7f6b400cb030 2024-04-25T15:57:10.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3dd9b640 1 --2- 172.21.15.87:0/3472178916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cb030 0x7f6b4015fcf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b400c7470 tx=0x7f6b3401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95848d240c8c9d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:10.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3d59a640 1 -- 172.21.15.87:0/3472178916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340b0070 con 0x7f6b400cb030 2024-04-25T15:57:10.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3d59a640 1 -- 172.21.15.87:0/3472178916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b340ab600 con 0x7f6b400cb030 2024-04-25T15:57:10.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.044+0000 7f6b3d59a640 1 -- 172.21.15.87:0/3472178916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340ab9d0 con 0x7f6b400cb030 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- 172.21.15.87:0/3472178916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cb030 msgr2=0x7f6b4015fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/3472178916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cb030 0x7f6b4015fcf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b400c7470 tx=0x7f6b3401c400 comp rx=0 tx=0).stop 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- 172.21.15.87:0/3472178916 shutdown_connections 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/3472178916 >> v2:172.21.15.155:3300/0 conn(0x7f6b40160230 0x7f6b40162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/3472178916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cb030 0x7f6b4015fcf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- 172.21.15.87:0/3472178916 >> 172.21.15.87:0/3472178916 conn(0x7f6b400c9330 msgr2=0x7f6b400c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:10.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- 172.21.15.87:0/3472178916 shutdown_connections 2024-04-25T15:57:10.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- 172.21.15.87:0/3472178916 wait complete. 2024-04-25T15:57:10.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 Processor -- start 2024-04-25T15:57:10.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- start start 2024-04-25T15:57:10.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b400cb030 0x7f6b401510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:10.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b4015ad90 0x7f6b400b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:10.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 0x7f6b400b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:10.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4015b1a0 con 0x7f6b40160230 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400ca190 con 0x7f6b400cb030 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.048+0000 7f6b44cd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4015b320 con 0x7f6b4015ad90 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 0x7f6b400b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 0x7f6b400b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35328/0 (socket says 172.21.15.87:35328) 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 -- 172.21.15.87:0/544911001 learned_addr learned my addr 172.21.15.87:0/544911001 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3dd9b640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b4015ad90 0x7f6b400b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3e59c640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b400cb030 0x7f6b401510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 -- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b4015ad90 msgr2=0x7f6b400b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b4015ad90 0x7f6b400b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 -- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b400cb030 msgr2=0x7f6b401510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b400cb030 0x7f6b401510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 -- 172.21.15.87:0/544911001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b400b2480 con 0x7f6b40160230 2024-04-25T15:57:10.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b3ed9d640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 0x7f6b400b1c00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800efc0 tx=0x7f6b3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:10.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38018020 con 0x7f6b40160230 2024-04-25T15:57:10.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b38014480 con 0x7f6b40160230 2024-04-25T15:57:10.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b40161690 con 0x7f6b40160230 2024-04-25T15:57:10.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38014870 con 0x7f6b40160230 2024-04-25T15:57:10.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40161c50 con 0x7f6b40160230 2024-04-25T15:57:10.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.052+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b40069bb0 con 0x7f6b40160230 2024-04-25T15:57:10.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.056+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6b3801b020 con 0x7f6b40160230 2024-04-25T15:57:10.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.056+0000 7f6b2effd640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6b2006f430 0x7f6b20071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:10.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.056+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f6b38090100 con 0x7f6b40160230 2024-04-25T15:57:10.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.056+0000 7f6b3e59c640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6b2006f430 0x7f6b20071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:10.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.056+0000 7f6b3e59c640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6b2006f430 0x7f6b20071940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b30001770 tx=0x7f6b30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:10.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.060+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b38022030 con 0x7f6b40160230 2024-04-25T15:57:10.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.288+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b400c7db0 con 0x7f6b40160230 2024-04-25T15:57:10.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.288+0000 7f6b2effd640 1 -- 172.21.15.87:0/544911001 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5664 (secure 0 0 0) 0x7f6b38010040 con 0x7f6b40160230 2024-04-25T15:57:10.291 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:10.292 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:10.292 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-04-25T15:57:10.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6b2006f430 msgr2=0x7f6b20071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:10.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6b2006f430 0x7f6b20071940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b30001770 tx=0x7f6b30009040 comp rx=0 tx=0).stop 2024-04-25T15:57:10.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 msgr2=0x7f6b400b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:10.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 0x7f6b400b1c00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800efc0 tx=0x7f6b3800c490 comp rx=0 tx=0).stop 2024-04-25T15:57:10.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 shutdown_connections 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6b2006f430 0x7f6b20071940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b40160230 0x7f6b400b1c00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b4015ad90 0x7f6b400b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 --2- 172.21.15.87:0/544911001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b400cb030 0x7f6b401510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 >> 172.21.15.87:0/544911001 conn(0x7f6b400c9330 msgr2=0x7f6b400c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 shutdown_connections 2024-04-25T15:57:10.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:10.292+0000 7f6b44cd2640 1 -- 172.21.15.87:0/544911001 wait complete. 2024-04-25T15:57:10.316 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-04-25T15:57:12.317 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5357cd2640 1 Processor -- start 2024-04-25T15:57:12.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5357cd2640 1 -- start start 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5357cd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 0x7f535006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5357cd2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53500c5120 con 0x7f5350070490 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5357cd2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53500c4b60 con 0x7f535015b340 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5357cd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f53500c3b20 con 0x7f53500c4250 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f535526d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5350070490 0x7f535015ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:39288/0 (socket says 172.21.15.87:39288) 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f535526d640 1 -- 172.21.15.87:0/239789028 learned_addr learned my addr 172.21.15.87:0/239789028 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:12.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5355a6e640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 0x7f535006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713464843 0 0) 0x7f5340001120 con 0x7f5350070490 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f533c003530 con 0x7f5350070490 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 520017085 0 0) 0x7f533c003530 con 0x7f5350070490 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 msgr2=0x7f535006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 0x7f535006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 >> v1:172.21.15.155:6789/0 conn(0x7f535015b340 legacy=0x7f5350161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53500c4e40 con 0x7f5350070490 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f5340001850 con 0x7f5350070490 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 >> v1:172.21.15.87:6789/0 conn(0x7f5350070490 legacy=0x7f535015ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f533c0039f0 0x7f533c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 0x7f533c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c004d50 0x7f533c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f533c00bb60 con 0x7f533c004d50 2024-04-25T15:57:12.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f533c00bd10 con 0x7f533c0039f0 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f533c00bf10 con 0x7f53500c4250 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.476+0000 7f535626f640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c004d50 0x7f533c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535526d640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 0x7f533c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f5355a6e640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f533c0039f0 0x7f533c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535626f640 1 -- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 msgr2=0x7f533c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535626f640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53500c4250 0x7f533c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535626f640 1 -- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f533c0039f0 msgr2=0x7f533c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535626f640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f533c0039f0 0x7f533c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535626f640 1 -- 172.21.15.87:0/239789028 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c003530 con 0x7f533c004d50 2024-04-25T15:57:12.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.480+0000 7f535626f640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c004d50 0x7f533c005160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5348001e40 tx=0x7f534801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa20a517e1edbca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:12.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348001a90 con 0x7f533c004d50 2024-04-25T15:57:12.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348003b80 con 0x7f533c004d50 2024-04-25T15:57:12.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5354a6c640 1 -- 172.21.15.87:0/239789028 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348005080 con 0x7f533c004d50 2024-04-25T15:57:12.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5357cd2640 1 -- 172.21.15.87:0/239789028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c004d50 msgr2=0x7f533c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5357cd2640 1 --2- 172.21.15.87:0/239789028 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f533c004d50 0x7f533c005160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5348001e40 tx=0x7f534801c760 comp rx=0 tx=0).stop 2024-04-25T15:57:12.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f535626f640 1 -- 172.21.15.87:0/239789028 reap_dead start 2024-04-25T15:57:12.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5357cd2640 1 -- 172.21.15.87:0/239789028 shutdown_connections 2024-04-25T15:57:12.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5357cd2640 1 -- 172.21.15.87:0/239789028 >> 172.21.15.87:0/239789028 conn(0x7f535006d780 msgr2=0x7f535006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:12.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5357cd2640 1 -- 172.21.15.87:0/239789028 shutdown_connections 2024-04-25T15:57:12.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.484+0000 7f5357cd2640 1 -- 172.21.15.87:0/239789028 wait complete. 2024-04-25T15:57:12.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 Processor -- start 2024-04-25T15:57:12.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 -- start start 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53501e0b40 0x7f535014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 0x7f535014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f535014a930 0x7f53501ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f53500c4660 con 0x7f535014eea0 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5350070e20 con 0x7f53501e0b40 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5357cd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f53500c47e0 con 0x7f535014a930 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f535526d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 0x7f535014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f535526d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 0x7f535014a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49728/0 (socket says 172.21.15.87:49728) 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f535526d640 1 -- 172.21.15.87:0/535932899 learned_addr learned my addr 172.21.15.87:0/535932899 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f535626f640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f535014a930 0x7f53501ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.488+0000 7f5355a6e640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53501e0b40 0x7f535014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535526d640 1 -- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f535014a930 msgr2=0x7f53501ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535526d640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f535014a930 0x7f53501ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535526d640 1 -- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53501e0b40 msgr2=0x7f535014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535526d640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53501e0b40 0x7f535014e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535526d640 1 -- 172.21.15.87:0/535932899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501e31f0 con 0x7f535014eea0 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535626f640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f535014a930 0x7f53501ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f535526d640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 0x7f535014a3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5340011810 tx=0x7f5340011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:12.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340010040 con 0x7f535014eea0 2024-04-25T15:57:12.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534001a070 con 0x7f535014eea0 2024-04-25T15:57:12.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534000fb80 con 0x7f535014eea0 2024-04-25T15:57:12.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5350152a70 con 0x7f535014eea0 2024-04-25T15:57:12.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53501e2ec0 con 0x7f535014eea0 2024-04-25T15:57:12.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5350069bb0 con 0x7f535014eea0 2024-04-25T15:57:12.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.492+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f534001f460 con 0x7f535014eea0 2024-04-25T15:57:12.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.496+0000 7f53467fc640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f533406f450 0x7f5334071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:12.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.496+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f5340092620 con 0x7f535014eea0 2024-04-25T15:57:12.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.496+0000 7f5355a6e640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f533406f450 0x7f5334071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:12.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.496+0000 7f5355a6e640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f533406f450 0x7f5334071960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f53500721c0 tx=0x7f534c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:12.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.500+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f53500c5120 con 0x7f535014eea0 2024-04-25T15:57:12.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.804+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53500c3540 con 0x7f535014eea0 2024-04-25T15:57:12.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.804+0000 7f53467fc640 1 -- 172.21.15.87:0/535932899 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f534005f230 con 0x7f535014eea0 2024-04-25T15:57:12.808 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:12.808 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:12.809 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f533406f450 msgr2=0x7f5334071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f533406f450 0x7f5334071960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f53500721c0 tx=0x7f534c008040 comp rx=0 tx=0).stop 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 msgr2=0x7f535014a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 0x7f535014a3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5340011810 tx=0x7f5340011cd0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 shutdown_connections 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f533406f450 0x7f5334071960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f535014a930 0x7f53501ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f535014eea0 0x7f535014a3f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 --2- 172.21.15.87:0/535932899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53501e0b40 0x7f535014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 >> 172.21.15.87:0/535932899 conn(0x7f535006d780 msgr2=0x7f5350074260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 shutdown_connections 2024-04-25T15:57:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:12.808+0000 7f5357cd2640 1 -- 172.21.15.87:0/535932899 wait complete. 2024-04-25T15:57:12.836 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-04-25T15:57:12.836 INFO:tasks.mds_thrash.fs.[a]:waiting for 24 secs before thrashing 2024-04-25T15:57:27.879 INFO:tasks.workunit.client.1.smithi155.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T15:57:27.886 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T15:57:27.887 INFO:tasks.workunit.client.1.smithi155.stderr:+ make 2024-04-25T15:57:28.309 INFO:tasks.workunit.client.1.smithi155.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T15:57:30.825 INFO:tasks.workunit.client.1.smithi155.stderr:++ readlink -f fsstress 2024-04-25T15:57:30.827 INFO:tasks.workunit.client.1.smithi155.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T15:57:30.827 INFO:tasks.workunit.client.1.smithi155.stderr:+ popd 2024-04-25T15:57:30.828 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T15:57:30.828 INFO:tasks.workunit.client.1.smithi155.stderr:+ popd 2024-04-25T15:57:30.829 INFO:tasks.workunit.client.1.smithi155.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-25T15:57:30.830 INFO:tasks.workunit.client.1.smithi155.stderr:++ mktemp -d -p . 2024-04-25T15:57:30.832 INFO:tasks.workunit.client.1.smithi155.stderr:+ T=./tmp.srjGEwqATC 2024-04-25T15:57:30.832 INFO:tasks.workunit.client.1.smithi155.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.srjGEwqATC -l 1 -n 1000 -p 10 -v 2024-04-25T15:57:30.836 INFO:tasks.workunit.client.1.smithi155.stdout:seed = 1713812803 2024-04-25T15:57:30.840 INFO:tasks.workunit.client.1.smithi155.stdout:0/0: dwrite - no filename 2024-04-25T15:57:30.842 INFO:tasks.workunit.client.1.smithi155.stdout:0/1: creat f0 x:0 0 0 2024-04-25T15:57:30.844 INFO:tasks.workunit.client.1.smithi155.stdout:2/0: chown . 1693 1 2024-04-25T15:57:30.844 INFO:tasks.workunit.client.1.smithi155.stdout:2/1: dread - no filename 2024-04-25T15:57:30.844 INFO:tasks.workunit.client.1.smithi155.stdout:2/2: truncate - no filename 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/3: dwrite - no filename 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/4: unlink - no file 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/5: write - no filename 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:1/0: creat f0 x:0 0 0 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/6: chown . 306 1 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/7: chown . 20932 1 2024-04-25T15:57:30.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/8: dwrite - no filename 2024-04-25T15:57:30.846 INFO:tasks.workunit.client.1.smithi155.stdout:1/1: mkdir d1 0 2024-04-25T15:57:30.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/0: dwrite - no filename 2024-04-25T15:57:30.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/1: dread - no filename 2024-04-25T15:57:30.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/2: read - no filename 2024-04-25T15:57:30.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/3: rename - no filename 2024-04-25T15:57:30.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/4: link - no file 2024-04-25T15:57:30.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/5: write - no filename 2024-04-25T15:57:30.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/6: stat - no entries 2024-04-25T15:57:30.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/7: chown . 1361822656 1 2024-04-25T15:57:30.847 INFO:tasks.workunit.client.1.smithi155.stdout:2/9: mknod c0 0 2024-04-25T15:57:30.848 INFO:tasks.workunit.client.1.smithi155.stdout:2/10: dwrite - no filename 2024-04-25T15:57:30.848 INFO:tasks.workunit.client.1.smithi155.stdout:2/11: write - no filename 2024-04-25T15:57:30.848 INFO:tasks.workunit.client.1.smithi155.stdout:4/0: dwrite - no filename 2024-04-25T15:57:30.849 INFO:tasks.workunit.client.1.smithi155.stdout:1/2: truncate f0 1043830 0 2024-04-25T15:57:30.850 INFO:tasks.workunit.client.1.smithi155.stdout:2/12: creat f1 x:0 0 0 2024-04-25T15:57:30.851 INFO:tasks.workunit.client.1.smithi155.stdout:1/3: rename d1 to d1/d2 22 2024-04-25T15:57:30.851 INFO:tasks.workunit.client.1.smithi155.stdout:5/0: stat - no entries 2024-04-25T15:57:30.853 INFO:tasks.workunit.client.1.smithi155.stdout:3/8: mknod c0 0 2024-04-25T15:57:30.853 INFO:tasks.workunit.client.1.smithi155.stdout:3/9: write - no filename 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/1: mknod c0 0 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/2: rmdir - no directory 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/3: dread - no filename 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/4: dwrite - no filename 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/5: readlink - no filename 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/6: truncate - no filename 2024-04-25T15:57:30.854 INFO:tasks.workunit.client.1.smithi155.stdout:2/13: truncate f1 37252 0 2024-04-25T15:57:30.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/1: mkdir d0 0 2024-04-25T15:57:30.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/2: link - no file 2024-04-25T15:57:30.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/3: write - no filename 2024-04-25T15:57:30.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/4: dread - no filename 2024-04-25T15:57:30.857 INFO:tasks.workunit.client.1.smithi155.stdout:5/5: write - no filename 2024-04-25T15:57:30.857 INFO:tasks.workunit.client.1.smithi155.stdout:5/6: fsync - no filename 2024-04-25T15:57:30.857 INFO:tasks.workunit.client.1.smithi155.stdout:3/10: mkdir d1 0 2024-04-25T15:57:30.857 INFO:tasks.workunit.client.1.smithi155.stdout:3/11: read - no filename 2024-04-25T15:57:30.858 INFO:tasks.workunit.client.1.smithi155.stdout:7/0: readlink - no filename 2024-04-25T15:57:30.858 INFO:tasks.workunit.client.1.smithi155.stdout:3/12: chown d1 81 1 2024-04-25T15:57:30.859 INFO:tasks.workunit.client.1.smithi155.stdout:3/13: dread - no filename 2024-04-25T15:57:30.859 INFO:tasks.workunit.client.1.smithi155.stdout:4/7: creat f1 x:0 0 0 2024-04-25T15:57:30.861 INFO:tasks.workunit.client.1.smithi155.stdout:1/4: dread f0 [0,4194304] 0 2024-04-25T15:57:30.861 INFO:tasks.workunit.client.1.smithi155.stdout:0/2: dwrite f0 [0,4194304] 0 2024-04-25T15:57:30.861 INFO:tasks.workunit.client.1.smithi155.stdout:6/0: mkdir d0 0 2024-04-25T15:57:30.861 INFO:tasks.workunit.client.1.smithi155.stdout:6/1: dwrite - no filename 2024-04-25T15:57:30.862 INFO:tasks.workunit.client.1.smithi155.stdout:6/2: read - no filename 2024-04-25T15:57:30.862 INFO:tasks.workunit.client.1.smithi155.stdout:2/14: creat f2 x:0 0 0 2024-04-25T15:57:30.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/7: mkdir d0/d1 0 2024-04-25T15:57:30.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/8: dread - no filename 2024-04-25T15:57:30.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/9: dwrite - no filename 2024-04-25T15:57:30.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/10: dread - no filename 2024-04-25T15:57:30.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/11: dread - no filename 2024-04-25T15:57:30.866 INFO:tasks.workunit.client.1.smithi155.stdout:7/1: symlink l0 0 2024-04-25T15:57:30.866 INFO:tasks.workunit.client.1.smithi155.stdout:7/2: write - no filename 2024-04-25T15:57:30.900 INFO:tasks.workunit.client.1.smithi155.stdout:8/0: fdatasync - no filename 2024-04-25T15:57:30.902 INFO:tasks.workunit.client.1.smithi155.stdout:0/3: mkdir d1 0 2024-04-25T15:57:30.906 INFO:tasks.workunit.client.1.smithi155.stdout:5/12: creat d0/f2 x:0 0 0 2024-04-25T15:57:30.907 INFO:tasks.workunit.client.1.smithi155.stdout:2/15: creat f3 x:0 0 0 2024-04-25T15:57:30.908 INFO:tasks.workunit.client.1.smithi155.stdout:5/13: write d0/f2 [325255,122290] 0 2024-04-25T15:57:30.908 INFO:tasks.workunit.client.1.smithi155.stdout:3/14: rename c0 to d1/c2 0 2024-04-25T15:57:30.909 INFO:tasks.workunit.client.1.smithi155.stdout:3/15: write - no filename 2024-04-25T15:57:30.910 INFO:tasks.workunit.client.1.smithi155.stdout:2/16: write f2 [388220,57631] 0 2024-04-25T15:57:30.910 INFO:tasks.workunit.client.1.smithi155.stdout:0/4: rename d1 to d1/d2 22 2024-04-25T15:57:30.912 INFO:tasks.workunit.client.1.smithi155.stdout:6/3: creat d0/f1 x:0 0 0 2024-04-25T15:57:30.914 INFO:tasks.workunit.client.1.smithi155.stdout:8/1: mknod c0 0 2024-04-25T15:57:30.914 INFO:tasks.workunit.client.1.smithi155.stdout:6/4: dread - d0/f1 zero size 2024-04-25T15:57:30.914 INFO:tasks.workunit.client.1.smithi155.stdout:9/0: creat f0 x:0 0 0 2024-04-25T15:57:30.915 INFO:tasks.workunit.client.1.smithi155.stdout:5/14: mkdir d0/d3 0 2024-04-25T15:57:30.916 INFO:tasks.workunit.client.1.smithi155.stdout:5/15: readlink - no filename 2024-04-25T15:57:30.916 INFO:tasks.workunit.client.1.smithi155.stdout:1/5: dwrite f0 [0,4194304] 0 2024-04-25T15:57:30.916 INFO:tasks.workunit.client.1.smithi155.stdout:3/16: symlink d1/l3 0 2024-04-25T15:57:30.919 INFO:tasks.workunit.client.1.smithi155.stdout:2/17: symlink l4 0 2024-04-25T15:57:30.921 INFO:tasks.workunit.client.1.smithi155.stdout:2/18: read f1 [32534,86656] 0 2024-04-25T15:57:30.922 INFO:tasks.workunit.client.1.smithi155.stdout:2/19: rmdir - no directory 2024-04-25T15:57:30.922 INFO:tasks.workunit.client.1.smithi155.stdout:5/16: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:30.924 INFO:tasks.workunit.client.1.smithi155.stdout:9/1: symlink l1 0 2024-04-25T15:57:30.924 INFO:tasks.workunit.client.1.smithi155.stdout:3/17: unlink d1/l3 0 2024-04-25T15:57:30.924 INFO:tasks.workunit.client.1.smithi155.stdout:3/18: truncate - no filename 2024-04-25T15:57:30.924 INFO:tasks.workunit.client.1.smithi155.stdout:3/19: dread - no filename 2024-04-25T15:57:30.925 INFO:tasks.workunit.client.1.smithi155.stdout:3/20: dread - no filename 2024-04-25T15:57:30.926 INFO:tasks.workunit.client.1.smithi155.stdout:9/2: chown f0 11475701 1 2024-04-25T15:57:30.926 INFO:tasks.workunit.client.1.smithi155.stdout:0/5: mkdir d1/d3 0 2024-04-25T15:57:30.929 INFO:tasks.workunit.client.1.smithi155.stdout:2/20: symlink l5 0 2024-04-25T15:57:30.929 INFO:tasks.workunit.client.1.smithi155.stdout:9/3: dread - f0 zero size 2024-04-25T15:57:30.929 INFO:tasks.workunit.client.1.smithi155.stdout:1/6: mknod d1/c3 0 2024-04-25T15:57:30.930 INFO:tasks.workunit.client.1.smithi155.stdout:3/21: mkdir d1/d4 0 2024-04-25T15:57:30.930 INFO:tasks.workunit.client.1.smithi155.stdout:9/4: fdatasync f0 0 2024-04-25T15:57:30.931 INFO:tasks.workunit.client.1.smithi155.stdout:1/7: chown f0 193489 1 2024-04-25T15:57:30.932 INFO:tasks.workunit.client.1.smithi155.stdout:6/5: dwrite d0/f1 [0,4194304] 0 2024-04-25T15:57:30.932 INFO:tasks.workunit.client.1.smithi155.stdout:0/6: rmdir d1 39 2024-04-25T15:57:30.936 INFO:tasks.workunit.client.1.smithi155.stdout:1/8: mknod d1/c4 0 2024-04-25T15:57:30.949 INFO:tasks.workunit.client.1.smithi155.stdout:6/6: dwrite d0/f1 [0,4194304] 0 2024-04-25T15:57:30.951 INFO:tasks.workunit.client.1.smithi155.stdout:2/21: dwrite f1 [0,4194304] 0 2024-04-25T15:57:30.954 INFO:tasks.workunit.client.1.smithi155.stdout:1/9: dwrite f0 [0,4194304] 0 2024-04-25T15:57:30.956 INFO:tasks.workunit.client.1.smithi155.stdout:1/10: truncate f0 4331584 0 2024-04-25T15:57:30.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/22: symlink l6 0 2024-04-25T15:57:30.958 INFO:tasks.workunit.client.1.smithi155.stdout:1/11: chown d1/c3 29 1 2024-04-25T15:57:30.961 INFO:tasks.workunit.client.1.smithi155.stdout:2/23: mkdir d7 0 2024-04-25T15:57:30.963 INFO:tasks.workunit.client.1.smithi155.stdout:2/24: write f2 [1164461,47831] 0 2024-04-25T15:57:30.965 INFO:tasks.workunit.client.1.smithi155.stdout:6/7: dwrite d0/f1 [0,4194304] 0 2024-04-25T15:57:30.967 INFO:tasks.workunit.client.1.smithi155.stdout:2/25: getdents d7 0 2024-04-25T15:57:30.967 INFO:tasks.workunit.client.1.smithi155.stdout:2/26: write f3 [546372,128784] 0 2024-04-25T15:57:30.969 INFO:tasks.workunit.client.1.smithi155.stdout:6/8: symlink d0/l2 0 2024-04-25T15:57:30.970 INFO:tasks.workunit.client.1.smithi155.stdout:1/12: fsync f0 0 2024-04-25T15:57:30.974 INFO:tasks.workunit.client.1.smithi155.stdout:1/13: rmdir d1 39 2024-04-25T15:57:30.979 INFO:tasks.workunit.client.1.smithi155.stdout:1/14: symlink d1/l5 0 2024-04-25T15:57:30.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/15: mkdir d1/d6 0 2024-04-25T15:57:30.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/16: fsync f0 0 2024-04-25T15:57:30.982 INFO:tasks.workunit.client.1.smithi155.stdout:4/8: getdents . 0 2024-04-25T15:57:30.983 INFO:tasks.workunit.client.1.smithi155.stdout:4/9: mknod c2 0 2024-04-25T15:57:30.983 INFO:tasks.workunit.client.1.smithi155.stdout:4/10: rmdir - no directory 2024-04-25T15:57:30.986 INFO:tasks.workunit.client.1.smithi155.stdout:4/11: rename c0 to c3 0 2024-04-25T15:57:30.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/7: chown d1/d3 55405 1 2024-04-25T15:57:30.988 INFO:tasks.workunit.client.1.smithi155.stdout:4/12: mknod c4 0 2024-04-25T15:57:30.989 INFO:tasks.workunit.client.1.smithi155.stdout:0/8: stat d1/d3 0 2024-04-25T15:57:30.989 INFO:tasks.workunit.client.1.smithi155.stdout:1/17: dwrite f0 [0,4194304] 0 2024-04-25T15:57:30.990 INFO:tasks.workunit.client.1.smithi155.stdout:4/13: write f1 [480844,64277] 0 2024-04-25T15:57:30.996 INFO:tasks.workunit.client.1.smithi155.stdout:3/22: chown d1/c2 78134197 1 2024-04-25T15:57:30.996 INFO:tasks.workunit.client.1.smithi155.stdout:9/5: getdents . 0 2024-04-25T15:57:30.998 INFO:tasks.workunit.client.1.smithi155.stdout:5/17: truncate d0/f2 136949 0 2024-04-25T15:57:30.998 INFO:tasks.workunit.client.1.smithi155.stdout:5/18: readlink - no filename 2024-04-25T15:57:30.999 INFO:tasks.workunit.client.1.smithi155.stdout:0/9: creat d1/d3/f4 x:0 0 0 2024-04-25T15:57:31.000 INFO:tasks.workunit.client.1.smithi155.stdout:5/19: chown d0/d3 839 1 2024-04-25T15:57:31.000 INFO:tasks.workunit.client.1.smithi155.stdout:1/18: creat d1/d6/f7 x:0 0 0 2024-04-25T15:57:31.000 INFO:tasks.workunit.client.1.smithi155.stdout:3/23: unlink d1/c2 0 2024-04-25T15:57:31.000 INFO:tasks.workunit.client.1.smithi155.stdout:3/24: fdatasync - no filename 2024-04-25T15:57:31.000 INFO:tasks.workunit.client.1.smithi155.stdout:3/25: read - no filename 2024-04-25T15:57:31.001 INFO:tasks.workunit.client.1.smithi155.stdout:3/26: write - no filename 2024-04-25T15:57:31.001 INFO:tasks.workunit.client.1.smithi155.stdout:9/6: symlink l2 0 2024-04-25T15:57:31.003 INFO:tasks.workunit.client.1.smithi155.stdout:0/10: write d1/d3/f4 [279793,116571] 0 2024-04-25T15:57:31.003 INFO:tasks.workunit.client.1.smithi155.stdout:9/7: readlink l1 0 2024-04-25T15:57:31.004 INFO:tasks.workunit.client.1.smithi155.stdout:1/19: truncate d1/d6/f7 361881 0 2024-04-25T15:57:31.006 INFO:tasks.workunit.client.1.smithi155.stdout:4/14: dwrite f1 [0,4194304] 0 2024-04-25T15:57:31.007 INFO:tasks.workunit.client.1.smithi155.stdout:2/27: truncate f1 3911147 0 2024-04-25T15:57:31.007 INFO:tasks.workunit.client.1.smithi155.stdout:0/11: mkdir d1/d3/d5 0 2024-04-25T15:57:31.008 INFO:tasks.workunit.client.1.smithi155.stdout:2/28: stat c0 0 2024-04-25T15:57:31.008 INFO:tasks.workunit.client.1.smithi155.stdout:0/12: chown d1/d3/d5 1819 1 2024-04-25T15:57:31.008 INFO:tasks.workunit.client.1.smithi155.stdout:6/9: truncate d0/f1 764087 0 2024-04-25T15:57:31.009 INFO:tasks.workunit.client.1.smithi155.stdout:1/20: creat d1/f8 x:0 0 0 2024-04-25T15:57:31.009 INFO:tasks.workunit.client.1.smithi155.stdout:6/10: chown d0 14 1 2024-04-25T15:57:31.009 INFO:tasks.workunit.client.1.smithi155.stdout:3/27: creat d1/d4/f5 x:0 0 0 2024-04-25T15:57:31.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/15: unlink f1 0 2024-04-25T15:57:31.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/16: dwrite - no filename 2024-04-25T15:57:31.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/17: truncate - no filename 2024-04-25T15:57:31.015 INFO:tasks.workunit.client.1.smithi155.stdout:5/20: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:31.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/21: symlink d1/l9 0 2024-04-25T15:57:31.018 INFO:tasks.workunit.client.1.smithi155.stdout:3/28: rmdir d1/d4 39 2024-04-25T15:57:31.018 INFO:tasks.workunit.client.1.smithi155.stdout:0/13: dwrite f0 [0,4194304] 0 2024-04-25T15:57:31.021 INFO:tasks.workunit.client.1.smithi155.stdout:4/18: mknod c5 0 2024-04-25T15:57:31.021 INFO:tasks.workunit.client.1.smithi155.stdout:2/29: mknod d7/c8 0 2024-04-25T15:57:31.022 INFO:tasks.workunit.client.1.smithi155.stdout:1/22: symlink d1/la 0 2024-04-25T15:57:31.023 INFO:tasks.workunit.client.1.smithi155.stdout:4/19: chown c5 6 1 2024-04-25T15:57:31.026 INFO:tasks.workunit.client.1.smithi155.stdout:3/29: dread - d1/d4/f5 zero size 2024-04-25T15:57:31.027 INFO:tasks.workunit.client.1.smithi155.stdout:2/30: read f3 [238714,69538] 0 2024-04-25T15:57:31.027 INFO:tasks.workunit.client.1.smithi155.stdout:1/23: write f0 [1318607,4769] 0 2024-04-25T15:57:31.027 INFO:tasks.workunit.client.1.smithi155.stdout:6/11: write d0/f1 [898125,39394] 0 2024-04-25T15:57:31.027 INFO:tasks.workunit.client.1.smithi155.stdout:4/20: symlink l6 0 2024-04-25T15:57:31.028 INFO:tasks.workunit.client.1.smithi155.stdout:3/30: chown d1/d4 53595 1 2024-04-25T15:57:31.030 INFO:tasks.workunit.client.1.smithi155.stdout:6/12: write d0/f1 [1206640,23736] 0 2024-04-25T15:57:31.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/24: unlink d1/c4 0 2024-04-25T15:57:31.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/25: chown d1 31650 1 2024-04-25T15:57:31.033 INFO:tasks.workunit.client.1.smithi155.stdout:0/14: dwrite f0 [4194304,4194304] 0 2024-04-25T15:57:31.034 INFO:tasks.workunit.client.1.smithi155.stdout:4/21: creat f7 x:0 0 0 2024-04-25T15:57:31.037 INFO:tasks.workunit.client.1.smithi155.stdout:1/26: creat d1/fb x:0 0 0 2024-04-25T15:57:31.037 INFO:tasks.workunit.client.1.smithi155.stdout:6/13: read d0/f1 [543634,130427] 0 2024-04-25T15:57:31.049 INFO:tasks.workunit.client.1.smithi155.stdout:4/22: symlink l8 0 2024-04-25T15:57:31.049 INFO:tasks.workunit.client.1.smithi155.stdout:1/27: readlink d1/l5 0 2024-04-25T15:57:31.054 INFO:tasks.workunit.client.1.smithi155.stdout:2/31: truncate f3 122627 0 2024-04-25T15:57:31.055 INFO:tasks.workunit.client.1.smithi155.stdout:1/28: dread d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:31.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/31: dwrite d1/d4/f5 [0,4194304] 0 2024-04-25T15:57:31.058 INFO:tasks.workunit.client.1.smithi155.stdout:0/15: dwrite f0 [0,4194304] 0 2024-04-25T15:57:31.062 INFO:tasks.workunit.client.1.smithi155.stdout:0/16: write d1/d3/f4 [48809,76311] 0 2024-04-25T15:57:31.132 INFO:tasks.workunit.client.1.smithi155.stdout:6/14: write d0/f1 [1454520,7511] 0 2024-04-25T15:57:31.134 INFO:tasks.workunit.client.1.smithi155.stdout:4/23: rename l8 to l9 0 2024-04-25T15:57:31.135 INFO:tasks.workunit.client.1.smithi155.stdout:2/32: creat d7/f9 x:0 0 0 2024-04-25T15:57:31.136 INFO:tasks.workunit.client.1.smithi155.stdout:1/29: creat d1/d6/fc x:0 0 0 2024-04-25T15:57:31.137 INFO:tasks.workunit.client.1.smithi155.stdout:3/32: unlink d1/d4/f5 0 2024-04-25T15:57:31.137 INFO:tasks.workunit.client.1.smithi155.stdout:2/33: fdatasync f2 0 2024-04-25T15:57:31.138 INFO:tasks.workunit.client.1.smithi155.stdout:2/34: write f2 [1536590,18397] 0 2024-04-25T15:57:31.139 INFO:tasks.workunit.client.1.smithi155.stdout:6/15: creat d0/f3 x:0 0 0 2024-04-25T15:57:31.141 INFO:tasks.workunit.client.1.smithi155.stdout:4/24: mkdir da 0 2024-04-25T15:57:31.141 INFO:tasks.workunit.client.1.smithi155.stdout:4/25: chown l6 904354 1 2024-04-25T15:57:31.142 INFO:tasks.workunit.client.1.smithi155.stdout:4/26: dread - f7 zero size 2024-04-25T15:57:31.144 INFO:tasks.workunit.client.1.smithi155.stdout:1/30: dread d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:31.146 INFO:tasks.workunit.client.1.smithi155.stdout:2/35: mknod d7/ca 0 2024-04-25T15:57:31.146 INFO:tasks.workunit.client.1.smithi155.stdout:2/36: read - d7/f9 zero size 2024-04-25T15:57:31.148 INFO:tasks.workunit.client.1.smithi155.stdout:6/16: rename d0/l2 to d0/l4 0 2024-04-25T15:57:31.148 INFO:tasks.workunit.client.1.smithi155.stdout:2/37: write d7/f9 [763149,87855] 0 2024-04-25T15:57:31.149 INFO:tasks.workunit.client.1.smithi155.stdout:3/33: mknod d1/c6 0 2024-04-25T15:57:31.149 INFO:tasks.workunit.client.1.smithi155.stdout:3/34: dwrite - no filename 2024-04-25T15:57:31.149 INFO:tasks.workunit.client.1.smithi155.stdout:3/35: dwrite - no filename 2024-04-25T15:57:31.149 INFO:tasks.workunit.client.1.smithi155.stdout:3/36: dwrite - no filename 2024-04-25T15:57:31.150 INFO:tasks.workunit.client.1.smithi155.stdout:3/37: write - no filename 2024-04-25T15:57:31.150 INFO:tasks.workunit.client.1.smithi155.stdout:3/38: write - no filename 2024-04-25T15:57:31.150 INFO:tasks.workunit.client.1.smithi155.stdout:6/17: chown d0/f3 27654121 1 2024-04-25T15:57:31.151 INFO:tasks.workunit.client.1.smithi155.stdout:1/31: mknod d1/cd 0 2024-04-25T15:57:31.154 INFO:tasks.workunit.client.1.smithi155.stdout:4/27: symlink da/lb 0 2024-04-25T15:57:31.157 INFO:tasks.workunit.client.1.smithi155.stdout:6/18: mknod d0/c5 0 2024-04-25T15:57:31.158 INFO:tasks.workunit.client.1.smithi155.stdout:3/39: rename d1/c6 to d1/d4/c7 0 2024-04-25T15:57:31.158 INFO:tasks.workunit.client.1.smithi155.stdout:3/40: write - no filename 2024-04-25T15:57:31.158 INFO:tasks.workunit.client.1.smithi155.stdout:3/41: dread - no filename 2024-04-25T15:57:31.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/42: write - no filename 2024-04-25T15:57:31.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/43: truncate - no filename 2024-04-25T15:57:31.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/44: fdatasync - no filename 2024-04-25T15:57:31.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/45: dread - no filename 2024-04-25T15:57:31.159 INFO:tasks.workunit.client.1.smithi155.stdout:1/32: symlink d1/d6/le 0 2024-04-25T15:57:31.160 INFO:tasks.workunit.client.1.smithi155.stdout:4/28: mkdir da/dc 0 2024-04-25T15:57:31.163 INFO:tasks.workunit.client.1.smithi155.stdout:6/19: creat d0/f6 x:0 0 0 2024-04-25T15:57:31.164 INFO:tasks.workunit.client.1.smithi155.stdout:3/46: creat d1/d4/f8 x:0 0 0 2024-04-25T15:57:31.165 INFO:tasks.workunit.client.1.smithi155.stdout:1/33: fdatasync d1/d6/f7 0 2024-04-25T15:57:31.166 INFO:tasks.workunit.client.1.smithi155.stdout:3/47: write d1/d4/f8 [307021,81841] 0 2024-04-25T15:57:31.167 INFO:tasks.workunit.client.1.smithi155.stdout:6/20: creat d0/f7 x:0 0 0 2024-04-25T15:57:31.168 INFO:tasks.workunit.client.1.smithi155.stdout:4/29: creat da/dc/fd x:0 0 0 2024-04-25T15:57:31.171 INFO:tasks.workunit.client.1.smithi155.stdout:1/34: creat d1/d6/ff x:0 0 0 2024-04-25T15:57:31.172 INFO:tasks.workunit.client.1.smithi155.stdout:6/21: creat d0/f8 x:0 0 0 2024-04-25T15:57:31.173 INFO:tasks.workunit.client.1.smithi155.stdout:4/30: mknod da/ce 0 2024-04-25T15:57:31.175 INFO:tasks.workunit.client.1.smithi155.stdout:4/31: write f7 [698749,125038] 0 2024-04-25T15:57:31.178 INFO:tasks.workunit.client.1.smithi155.stdout:4/32: creat da/dc/ff x:0 0 0 2024-04-25T15:57:31.181 INFO:tasks.workunit.client.1.smithi155.stdout:4/33: dread - da/dc/fd zero size 2024-04-25T15:57:31.184 INFO:tasks.workunit.client.1.smithi155.stdout:4/34: mknod da/c10 0 2024-04-25T15:57:31.189 INFO:tasks.workunit.client.1.smithi155.stdout:1/35: dwrite d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:31.200 INFO:tasks.workunit.client.1.smithi155.stdout:3/48: dread d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:31.201 INFO:tasks.workunit.client.1.smithi155.stdout:4/35: dread f7 [0,4194304] 0 2024-04-25T15:57:31.206 INFO:tasks.workunit.client.1.smithi155.stdout:3/49: dread d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:31.209 INFO:tasks.workunit.client.1.smithi155.stdout:3/50: rmdir d1 39 2024-04-25T15:57:31.211 INFO:tasks.workunit.client.1.smithi155.stdout:1/36: dwrite d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:31.215 INFO:tasks.workunit.client.1.smithi155.stdout:1/37: symlink d1/d6/l10 0 2024-04-25T15:57:31.216 INFO:tasks.workunit.client.1.smithi155.stdout:1/38: stat d1/l9 0 2024-04-25T15:57:31.220 INFO:tasks.workunit.client.1.smithi155.stdout:4/36: dwrite f7 [0,4194304] 0 2024-04-25T15:57:31.222 INFO:tasks.workunit.client.1.smithi155.stdout:0/17: truncate f0 5030221 0 2024-04-25T15:57:31.223 INFO:tasks.workunit.client.1.smithi155.stdout:4/37: creat da/f11 x:0 0 0 2024-04-25T15:57:31.224 INFO:tasks.workunit.client.1.smithi155.stdout:4/38: stat da/dc/ff 0 2024-04-25T15:57:31.226 INFO:tasks.workunit.client.1.smithi155.stdout:4/39: dread - da/dc/ff zero size 2024-04-25T15:57:31.226 INFO:tasks.workunit.client.1.smithi155.stdout:6/22: readlink d0/l4 0 2024-04-25T15:57:31.227 INFO:tasks.workunit.client.1.smithi155.stdout:4/40: dread - da/f11 zero size 2024-04-25T15:57:31.227 INFO:tasks.workunit.client.1.smithi155.stdout:0/18: dread d1/d3/f4 [0,4194304] 0 2024-04-25T15:57:31.228 INFO:tasks.workunit.client.1.smithi155.stdout:4/41: chown da/lb 38423 1 2024-04-25T15:57:31.229 INFO:tasks.workunit.client.1.smithi155.stdout:6/23: creat d0/f9 x:0 0 0 2024-04-25T15:57:31.230 INFO:tasks.workunit.client.1.smithi155.stdout:0/19: mkdir d1/d6 0 2024-04-25T15:57:31.233 INFO:tasks.workunit.client.1.smithi155.stdout:6/24: rmdir d0 39 2024-04-25T15:57:31.237 INFO:tasks.workunit.client.1.smithi155.stdout:6/25: write d0/f6 [33492,64919] 0 2024-04-25T15:57:31.240 INFO:tasks.workunit.client.1.smithi155.stdout:3/51: rename d1/d4/c7 to d1/c9 0 2024-04-25T15:57:31.242 INFO:tasks.workunit.client.1.smithi155.stdout:6/26: readlink d0/l4 0 2024-04-25T15:57:31.244 INFO:tasks.workunit.client.1.smithi155.stdout:4/42: getdents da/dc 0 2024-04-25T15:57:31.245 INFO:tasks.workunit.client.1.smithi155.stdout:2/38: dwrite f1 [0,4194304] 0 2024-04-25T15:57:31.248 INFO:tasks.workunit.client.1.smithi155.stdout:4/43: rmdir da 39 2024-04-25T15:57:31.248 INFO:tasks.workunit.client.1.smithi155.stdout:1/39: dwrite d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:31.256 INFO:tasks.workunit.client.1.smithi155.stdout:2/39: mkdir d7/db 0 2024-04-25T15:57:31.256 INFO:tasks.workunit.client.1.smithi155.stdout:0/20: rename f0 to d1/d3/f7 0 2024-04-25T15:57:31.256 INFO:tasks.workunit.client.1.smithi155.stdout:6/27: link d0/f1 d0/fa 0 2024-04-25T15:57:31.257 INFO:tasks.workunit.client.1.smithi155.stdout:6/28: truncate d0/f7 437176 0 2024-04-25T15:57:31.260 INFO:tasks.workunit.client.1.smithi155.stdout:1/40: creat d1/f11 x:0 0 0 2024-04-25T15:57:31.263 INFO:tasks.workunit.client.1.smithi155.stdout:6/29: rename d0/l4 to d0/lb 0 2024-04-25T15:57:31.265 INFO:tasks.workunit.client.1.smithi155.stdout:4/44: creat da/dc/f12 x:0 0 0 2024-04-25T15:57:31.265 INFO:tasks.workunit.client.1.smithi155.stdout:2/40: dwrite d7/f9 [0,4194304] 0 2024-04-25T15:57:31.266 INFO:tasks.workunit.client.1.smithi155.stdout:1/41: creat d1/f12 x:0 0 0 2024-04-25T15:57:31.267 INFO:tasks.workunit.client.1.smithi155.stdout:3/52: truncate d1/d4/f8 305414 0 2024-04-25T15:57:31.268 INFO:tasks.workunit.client.1.smithi155.stdout:0/21: creat d1/d3/d5/f8 x:0 0 0 2024-04-25T15:57:31.270 INFO:tasks.workunit.client.1.smithi155.stdout:6/30: dread d0/fa [0,4194304] 0 2024-04-25T15:57:31.270 INFO:tasks.workunit.client.1.smithi155.stdout:6/31: chown d0/c5 28 1 2024-04-25T15:57:31.270 INFO:tasks.workunit.client.1.smithi155.stdout:4/45: creat da/dc/f13 x:0 0 0 2024-04-25T15:57:31.275 INFO:tasks.workunit.client.1.smithi155.stdout:0/22: symlink d1/l9 0 2024-04-25T15:57:31.275 INFO:tasks.workunit.client.1.smithi155.stdout:6/32: rmdir d0 39 2024-04-25T15:57:31.276 INFO:tasks.workunit.client.1.smithi155.stdout:4/46: rmdir da 39 2024-04-25T15:57:31.276 INFO:tasks.workunit.client.1.smithi155.stdout:0/23: chown d1 7503 1 2024-04-25T15:57:31.280 INFO:tasks.workunit.client.1.smithi155.stdout:1/42: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:57:31.280 INFO:tasks.workunit.client.1.smithi155.stdout:6/33: fsync d0/f7 0 2024-04-25T15:57:31.281 INFO:tasks.workunit.client.1.smithi155.stdout:4/47: read - da/dc/fd zero size 2024-04-25T15:57:31.282 INFO:tasks.workunit.client.1.smithi155.stdout:0/24: mkdir d1/d3/d5/da 0 2024-04-25T15:57:31.283 INFO:tasks.workunit.client.1.smithi155.stdout:0/25: fdatasync d1/d3/d5/f8 0 2024-04-25T15:57:31.283 INFO:tasks.workunit.client.1.smithi155.stdout:6/34: mkdir d0/dc 0 2024-04-25T15:57:31.283 INFO:tasks.workunit.client.1.smithi155.stdout:4/48: truncate da/f11 694323 0 2024-04-25T15:57:31.285 INFO:tasks.workunit.client.1.smithi155.stdout:6/35: symlink d0/ld 0 2024-04-25T15:57:31.286 INFO:tasks.workunit.client.1.smithi155.stdout:6/36: stat d0/dc 0 2024-04-25T15:57:31.288 INFO:tasks.workunit.client.1.smithi155.stdout:6/37: write d0/f6 [506752,6992] 0 2024-04-25T15:57:31.290 INFO:tasks.workunit.client.1.smithi155.stdout:4/49: creat da/f14 x:0 0 0 2024-04-25T15:57:31.292 INFO:tasks.workunit.client.1.smithi155.stdout:4/50: truncate da/dc/f12 457952 0 2024-04-25T15:57:31.292 INFO:tasks.workunit.client.1.smithi155.stdout:0/26: creat d1/d6/fb x:0 0 0 2024-04-25T15:57:31.293 INFO:tasks.workunit.client.1.smithi155.stdout:4/51: truncate da/dc/f13 752210 0 2024-04-25T15:57:31.294 INFO:tasks.workunit.client.1.smithi155.stdout:6/38: symlink d0/le 0 2024-04-25T15:57:31.294 INFO:tasks.workunit.client.1.smithi155.stdout:2/41: write f3 [292427,81552] 0 2024-04-25T15:57:31.295 INFO:tasks.workunit.client.1.smithi155.stdout:1/43: link d1/l9 d1/l13 0 2024-04-25T15:57:31.295 INFO:tasks.workunit.client.1.smithi155.stdout:6/39: dread - d0/f9 zero size 2024-04-25T15:57:31.297 INFO:tasks.workunit.client.1.smithi155.stdout:0/27: unlink d1/d3/d5/f8 0 2024-04-25T15:57:31.299 INFO:tasks.workunit.client.1.smithi155.stdout:4/52: symlink da/l15 0 2024-04-25T15:57:31.303 INFO:tasks.workunit.client.1.smithi155.stdout:6/40: creat d0/ff x:0 0 0 2024-04-25T15:57:31.304 INFO:tasks.workunit.client.1.smithi155.stdout:4/53: dread da/dc/f13 [0,4194304] 0 2024-04-25T15:57:31.304 INFO:tasks.workunit.client.1.smithi155.stdout:2/42: symlink d7/db/lc 0 2024-04-25T15:57:31.305 INFO:tasks.workunit.client.1.smithi155.stdout:1/44: dwrite f0 [0,4194304] 0 2024-04-25T15:57:31.306 INFO:tasks.workunit.client.1.smithi155.stdout:3/53: write d1/d4/f8 [641879,129346] 0 2024-04-25T15:57:31.310 INFO:tasks.workunit.client.1.smithi155.stdout:6/41: chown d0/lb 219298 1 2024-04-25T15:57:31.310 INFO:tasks.workunit.client.1.smithi155.stdout:6/42: stat d0/c5 0 2024-04-25T15:57:31.310 INFO:tasks.workunit.client.1.smithi155.stdout:0/28: creat d1/d3/d5/da/fc x:0 0 0 2024-04-25T15:57:31.313 INFO:tasks.workunit.client.1.smithi155.stdout:0/29: creat d1/d3/fd x:0 0 0 2024-04-25T15:57:31.317 INFO:tasks.workunit.client.1.smithi155.stdout:6/43: link d0/f6 d0/f10 0 2024-04-25T15:57:31.317 INFO:tasks.workunit.client.1.smithi155.stdout:4/54: dwrite da/f14 [0,4194304] 0 2024-04-25T15:57:31.319 INFO:tasks.workunit.client.1.smithi155.stdout:4/55: write da/dc/fd [250374,83037] 0 2024-04-25T15:57:31.320 INFO:tasks.workunit.client.1.smithi155.stdout:0/30: unlink d1/l9 0 2024-04-25T15:57:31.322 INFO:tasks.workunit.client.1.smithi155.stdout:6/44: dread d0/f7 [0,4194304] 0 2024-04-25T15:57:31.322 INFO:tasks.workunit.client.1.smithi155.stdout:4/56: read da/dc/f13 [29883,124603] 0 2024-04-25T15:57:31.322 INFO:tasks.workunit.client.1.smithi155.stdout:0/31: chown d1/d3/fd 134 1 2024-04-25T15:57:31.326 INFO:tasks.workunit.client.1.smithi155.stdout:0/32: stat d1/d3/d5/da/fc 0 2024-04-25T15:57:31.327 INFO:tasks.workunit.client.1.smithi155.stdout:2/43: truncate d7/f9 3813976 0 2024-04-25T15:57:31.327 INFO:tasks.workunit.client.1.smithi155.stdout:4/57: write da/dc/ff [223787,13578] 0 2024-04-25T15:57:31.327 INFO:tasks.workunit.client.1.smithi155.stdout:3/54: fsync d1/d4/f8 0 2024-04-25T15:57:31.327 INFO:tasks.workunit.client.1.smithi155.stdout:1/45: truncate f0 813341 0 2024-04-25T15:57:31.329 INFO:tasks.workunit.client.1.smithi155.stdout:0/33: mknod d1/d3/ce 0 2024-04-25T15:57:31.329 INFO:tasks.workunit.client.1.smithi155.stdout:0/34: readlink - no filename 2024-04-25T15:57:31.332 INFO:tasks.workunit.client.1.smithi155.stdout:1/46: creat d1/d6/f14 x:0 0 0 2024-04-25T15:57:31.333 INFO:tasks.workunit.client.1.smithi155.stdout:0/35: rename d1/d3/d5 to d1/d3/d5/df 22 2024-04-25T15:57:31.333 INFO:tasks.workunit.client.1.smithi155.stdout:3/55: symlink d1/la 0 2024-04-25T15:57:31.334 INFO:tasks.workunit.client.1.smithi155.stdout:1/47: stat d1/d6/l10 0 2024-04-25T15:57:31.335 INFO:tasks.workunit.client.1.smithi155.stdout:4/58: dread f7 [0,4194304] 0 2024-04-25T15:57:31.335 INFO:tasks.workunit.client.1.smithi155.stdout:6/45: getdents d0 0 2024-04-25T15:57:31.335 INFO:tasks.workunit.client.1.smithi155.stdout:0/36: stat d1/d3/ce 0 2024-04-25T15:57:31.337 INFO:tasks.workunit.client.1.smithi155.stdout:6/46: fsync d0/f3 0 2024-04-25T15:57:31.340 INFO:tasks.workunit.client.1.smithi155.stdout:2/44: dwrite f1 [4194304,4194304] 0 2024-04-25T15:57:31.343 INFO:tasks.workunit.client.1.smithi155.stdout:2/45: write f1 [3948657,12889] 0 2024-04-25T15:57:31.343 INFO:tasks.workunit.client.1.smithi155.stdout:0/37: rename d1/d3/f7 to d1/d3/d5/f10 0 2024-04-25T15:57:31.344 INFO:tasks.workunit.client.1.smithi155.stdout:4/59: getdents da 0 2024-04-25T15:57:31.350 INFO:tasks.workunit.client.1.smithi155.stdout:4/60: creat da/f16 x:0 0 0 2024-04-25T15:57:31.353 INFO:tasks.workunit.client.1.smithi155.stdout:0/38: mknod d1/d3/d5/c11 0 2024-04-25T15:57:31.353 INFO:tasks.workunit.client.1.smithi155.stdout:1/48: dwrite d1/f12 [0,4194304] 0 2024-04-25T15:57:31.354 INFO:tasks.workunit.client.1.smithi155.stdout:4/61: fdatasync da/dc/fd 0 2024-04-25T15:57:31.355 INFO:tasks.workunit.client.1.smithi155.stdout:6/47: dwrite d0/f7 [0,4194304] 0 2024-04-25T15:57:31.357 INFO:tasks.workunit.client.1.smithi155.stdout:4/62: read da/f11 [595704,3007] 0 2024-04-25T15:57:31.360 INFO:tasks.workunit.client.1.smithi155.stdout:2/46: dread f1 [4194304,4194304] 0 2024-04-25T15:57:31.363 INFO:tasks.workunit.client.1.smithi155.stdout:1/49: link d1/fb d1/f15 0 2024-04-25T15:57:31.364 INFO:tasks.workunit.client.1.smithi155.stdout:6/48: dread d0/fa [0,4194304] 0 2024-04-25T15:57:31.366 INFO:tasks.workunit.client.1.smithi155.stdout:2/47: rmdir d7/db 39 2024-04-25T15:57:31.366 INFO:tasks.workunit.client.1.smithi155.stdout:1/50: dread - d1/d6/fc zero size 2024-04-25T15:57:31.366 INFO:tasks.workunit.client.1.smithi155.stdout:2/48: fsync f2 0 2024-04-25T15:57:31.369 INFO:tasks.workunit.client.1.smithi155.stdout:6/49: symlink d0/l11 0 2024-04-25T15:57:31.370 INFO:tasks.workunit.client.1.smithi155.stdout:1/51: mkdir d1/d16 0 2024-04-25T15:57:31.371 INFO:tasks.workunit.client.1.smithi155.stdout:0/39: dwrite d1/d3/d5/da/fc [0,4194304] 0 2024-04-25T15:57:31.373 INFO:tasks.workunit.client.1.smithi155.stdout:6/50: mkdir d0/d12 0 2024-04-25T15:57:31.377 INFO:tasks.workunit.client.1.smithi155.stdout:1/52: mknod d1/d16/c17 0 2024-04-25T15:57:31.378 INFO:tasks.workunit.client.1.smithi155.stdout:6/51: fsync d0/f7 0 2024-04-25T15:57:31.379 INFO:tasks.workunit.client.1.smithi155.stdout:0/40: getdents d1/d3/d5 0 2024-04-25T15:57:31.380 INFO:tasks.workunit.client.1.smithi155.stdout:6/52: getdents d0/d12 0 2024-04-25T15:57:31.380 INFO:tasks.workunit.client.1.smithi155.stdout:6/53: truncate d0/f3 57302 0 2024-04-25T15:57:31.381 INFO:tasks.workunit.client.1.smithi155.stdout:0/41: mkdir d1/d3/d12 0 2024-04-25T15:57:31.381 INFO:tasks.workunit.client.1.smithi155.stdout:0/42: stat d1/d3/d5/f10 0 2024-04-25T15:57:31.383 INFO:tasks.workunit.client.1.smithi155.stdout:6/54: dread d0/fa [0,4194304] 0 2024-04-25T15:57:31.387 INFO:tasks.workunit.client.1.smithi155.stdout:6/55: rename d0/d12 to d0/d13 0 2024-04-25T15:57:31.388 INFO:tasks.workunit.client.1.smithi155.stdout:6/56: chown d0/f8 41695629 1 2024-04-25T15:57:31.388 INFO:tasks.workunit.client.1.smithi155.stdout:0/43: write d1/d3/d5/f10 [3300295,117317] 0 2024-04-25T15:57:31.390 INFO:tasks.workunit.client.1.smithi155.stdout:6/57: mknod d0/d13/c14 0 2024-04-25T15:57:31.391 INFO:tasks.workunit.client.1.smithi155.stdout:6/58: readlink d0/le 0 2024-04-25T15:57:31.392 INFO:tasks.workunit.client.1.smithi155.stdout:0/44: write d1/d3/fd [323768,119977] 0 2024-04-25T15:57:31.392 INFO:tasks.workunit.client.1.smithi155.stdout:2/49: dwrite d7/f9 [0,4194304] 0 2024-04-25T15:57:31.397 INFO:tasks.workunit.client.1.smithi155.stdout:0/45: rename d1/d3/f4 to d1/d3/d5/f13 0 2024-04-25T15:57:31.397 INFO:tasks.workunit.client.1.smithi155.stdout:0/46: fdatasync d1/d3/fd 0 2024-04-25T15:57:31.398 INFO:tasks.workunit.client.1.smithi155.stdout:6/59: rmdir d0/dc 0 2024-04-25T15:57:31.402 INFO:tasks.workunit.client.1.smithi155.stdout:2/50: mkdir d7/db/dd 0 2024-04-25T15:57:31.404 INFO:tasks.workunit.client.1.smithi155.stdout:0/47: creat d1/d6/f14 x:0 0 0 2024-04-25T15:57:31.408 INFO:tasks.workunit.client.1.smithi155.stdout:6/60: write d0/fa [327190,89720] 0 2024-04-25T15:57:31.409 INFO:tasks.workunit.client.1.smithi155.stdout:0/48: symlink d1/d3/d12/l15 0 2024-04-25T15:57:31.410 INFO:tasks.workunit.client.1.smithi155.stdout:6/61: rename d0/f8 to d0/f15 0 2024-04-25T15:57:31.415 INFO:tasks.workunit.client.1.smithi155.stdout:6/62: rename d0/d13/c14 to d0/c16 0 2024-04-25T15:57:31.415 INFO:tasks.workunit.client.1.smithi155.stdout:6/63: dread - d0/f15 zero size 2024-04-25T15:57:31.416 INFO:tasks.workunit.client.1.smithi155.stdout:2/51: truncate d7/f9 3703463 0 2024-04-25T15:57:31.416 INFO:tasks.workunit.client.1.smithi155.stdout:2/52: readlink l6 0 2024-04-25T15:57:31.416 INFO:tasks.workunit.client.1.smithi155.stdout:6/64: truncate d0/f9 937652 0 2024-04-25T15:57:31.417 INFO:tasks.workunit.client.1.smithi155.stdout:2/53: rmdir d7/db 39 2024-04-25T15:57:31.418 INFO:tasks.workunit.client.1.smithi155.stdout:0/49: truncate d1/d3/d5/da/fc 1990583 0 2024-04-25T15:57:31.425 INFO:tasks.workunit.client.1.smithi155.stdout:6/65: dwrite d0/f7 [0,4194304] 0 2024-04-25T15:57:31.427 INFO:tasks.workunit.client.1.smithi155.stdout:6/66: fdatasync d0/f3 0 2024-04-25T15:57:31.428 INFO:tasks.workunit.client.1.smithi155.stdout:2/54: dwrite f1 [4194304,4194304] 0 2024-04-25T15:57:31.430 INFO:tasks.workunit.client.1.smithi155.stdout:6/67: chown d0/fa 278826 1 2024-04-25T15:57:31.433 INFO:tasks.workunit.client.1.smithi155.stdout:6/68: creat d0/d13/f17 x:0 0 0 2024-04-25T15:57:31.435 INFO:tasks.workunit.client.1.smithi155.stdout:6/69: chown d0/l11 384 1 2024-04-25T15:57:31.435 INFO:tasks.workunit.client.1.smithi155.stdout:0/50: dwrite d1/d3/d5/da/fc [0,4194304] 0 2024-04-25T15:57:31.436 INFO:tasks.workunit.client.1.smithi155.stdout:6/70: dread - d0/d13/f17 zero size 2024-04-25T15:57:31.438 INFO:tasks.workunit.client.1.smithi155.stdout:6/71: write d0/f7 [1415314,13197] 0 2024-04-25T15:57:31.438 INFO:tasks.workunit.client.1.smithi155.stdout:2/55: dread f1 [4194304,4194304] 0 2024-04-25T15:57:31.442 INFO:tasks.workunit.client.1.smithi155.stdout:6/72: mkdir d0/d18 0 2024-04-25T15:57:31.447 INFO:tasks.workunit.client.1.smithi155.stdout:2/56: symlink d7/db/dd/le 0 2024-04-25T15:57:31.448 INFO:tasks.workunit.client.1.smithi155.stdout:0/51: dwrite d1/d3/fd [0,4194304] 0 2024-04-25T15:57:31.448 INFO:tasks.workunit.client.1.smithi155.stdout:0/52: chown d1/d3/d5/c11 5172 1 2024-04-25T15:57:31.451 INFO:tasks.workunit.client.1.smithi155.stdout:2/57: creat d7/db/ff x:0 0 0 2024-04-25T15:57:31.451 INFO:tasks.workunit.client.1.smithi155.stdout:0/53: mkdir d1/d6/d16 0 2024-04-25T15:57:31.453 INFO:tasks.workunit.client.1.smithi155.stdout:0/54: creat d1/d3/f17 x:0 0 0 2024-04-25T15:57:31.455 INFO:tasks.workunit.client.1.smithi155.stdout:0/55: write d1/d3/fd [4551357,116368] 0 2024-04-25T15:57:31.457 INFO:tasks.workunit.client.1.smithi155.stdout:2/58: dread f1 [4194304,4194304] 0 2024-04-25T15:57:31.458 INFO:tasks.workunit.client.1.smithi155.stdout:0/56: mknod d1/d3/d12/c18 0 2024-04-25T15:57:31.458 INFO:tasks.workunit.client.1.smithi155.stdout:2/59: dread - d7/db/ff zero size 2024-04-25T15:57:31.459 INFO:tasks.workunit.client.1.smithi155.stdout:0/57: stat d1/d3/d5/f13 0 2024-04-25T15:57:31.460 INFO:tasks.workunit.client.1.smithi155.stdout:2/60: symlink d7/db/dd/l10 0 2024-04-25T15:57:31.461 INFO:tasks.workunit.client.1.smithi155.stdout:2/61: read f2 [861959,98314] 0 2024-04-25T15:57:31.462 INFO:tasks.workunit.client.1.smithi155.stdout:2/62: fdatasync d7/db/ff 0 2024-04-25T15:57:31.464 INFO:tasks.workunit.client.1.smithi155.stdout:2/63: creat d7/db/dd/f11 x:0 0 0 2024-04-25T15:57:31.464 INFO:tasks.workunit.client.1.smithi155.stdout:2/64: dread - d7/db/ff zero size 2024-04-25T15:57:31.466 INFO:tasks.workunit.client.1.smithi155.stdout:2/65: symlink d7/db/l12 0 2024-04-25T15:57:31.469 INFO:tasks.workunit.client.1.smithi155.stdout:2/66: dread f3 [0,4194304] 0 2024-04-25T15:57:31.478 INFO:tasks.workunit.client.1.smithi155.stdout:2/67: dwrite f3 [0,4194304] 0 2024-04-25T15:57:31.479 INFO:tasks.workunit.client.1.smithi155.stdout:2/68: stat d7/db/dd/le 0 2024-04-25T15:57:31.481 INFO:tasks.workunit.client.1.smithi155.stdout:2/69: symlink d7/db/l13 0 2024-04-25T15:57:31.483 INFO:tasks.workunit.client.1.smithi155.stdout:2/70: mknod d7/db/dd/c14 0 2024-04-25T15:57:31.489 INFO:tasks.workunit.client.1.smithi155.stdout:2/71: dread f2 [0,4194304] 0 2024-04-25T15:57:31.497 INFO:tasks.workunit.client.1.smithi155.stdout:2/72: truncate f1 8004789 0 2024-04-25T15:57:31.499 INFO:tasks.workunit.client.1.smithi155.stdout:2/73: mkdir d7/db/dd/d15 0 2024-04-25T15:57:31.501 INFO:tasks.workunit.client.1.smithi155.stdout:2/74: creat d7/f16 x:0 0 0 2024-04-25T15:57:31.502 INFO:tasks.workunit.client.1.smithi155.stdout:2/75: dread - d7/db/ff zero size 2024-04-25T15:57:31.505 INFO:tasks.workunit.client.1.smithi155.stdout:2/76: creat d7/f17 x:0 0 0 2024-04-25T15:57:31.515 INFO:tasks.workunit.client.1.smithi155.stdout:2/77: dwrite d7/db/ff [0,4194304] 0 2024-04-25T15:57:31.519 INFO:tasks.workunit.client.1.smithi155.stdout:2/78: mkdir d7/db/dd/d15/d18 0 2024-04-25T15:57:31.523 INFO:tasks.workunit.client.1.smithi155.stdout:2/79: creat d7/f19 x:0 0 0 2024-04-25T15:57:31.530 INFO:tasks.workunit.client.1.smithi155.stdout:2/80: write f1 [8988743,72649] 0 2024-04-25T15:57:31.531 INFO:tasks.workunit.client.1.smithi155.stdout:2/81: rmdir d7/db 39 2024-04-25T15:57:31.540 INFO:tasks.workunit.client.1.smithi155.stdout:2/82: dwrite d7/f16 [0,4194304] 0 2024-04-25T15:57:31.549 INFO:tasks.workunit.client.1.smithi155.stdout:2/83: rename d7/f17 to d7/db/dd/d15/f1a 0 2024-04-25T15:57:31.553 INFO:tasks.workunit.client.1.smithi155.stdout:2/84: dread d7/f16 [0,4194304] 0 2024-04-25T15:57:31.555 INFO:tasks.workunit.client.1.smithi155.stdout:2/85: fdatasync d7/f9 0 2024-04-25T15:57:31.556 INFO:tasks.workunit.client.1.smithi155.stdout:2/86: write d7/f9 [3497472,32086] 0 2024-04-25T15:57:31.556 INFO:tasks.workunit.client.1.smithi155.stdout:2/87: chown l5 3447822 1 2024-04-25T15:57:31.565 INFO:tasks.workunit.client.1.smithi155.stdout:2/88: dwrite d7/db/ff [4194304,4194304] 0 2024-04-25T15:57:31.566 INFO:tasks.workunit.client.1.smithi155.stdout:2/89: write f1 [522482,116889] 0 2024-04-25T15:57:31.569 INFO:tasks.workunit.client.1.smithi155.stdout:2/90: creat d7/db/dd/d15/f1b x:0 0 0 2024-04-25T15:57:31.577 INFO:tasks.workunit.client.1.smithi155.stdout:2/91: dwrite f1 [0,4194304] 0 2024-04-25T15:57:31.578 INFO:tasks.workunit.client.1.smithi155.stdout:2/92: write f1 [8898570,84867] 0 2024-04-25T15:57:31.581 INFO:tasks.workunit.client.1.smithi155.stdout:2/93: write d7/db/dd/d15/f1a [523640,108106] 0 2024-04-25T15:57:31.588 INFO:tasks.workunit.client.1.smithi155.stdout:2/94: dwrite d7/f16 [0,4194304] 0 2024-04-25T15:57:31.592 INFO:tasks.workunit.client.1.smithi155.stdout:2/95: rename d7/db/lc to d7/l1c 0 2024-04-25T15:57:31.593 INFO:tasks.workunit.client.1.smithi155.stdout:2/96: read f2 [1017202,115182] 0 2024-04-25T15:57:31.595 INFO:tasks.workunit.client.1.smithi155.stdout:2/97: dread f2 [0,4194304] 0 2024-04-25T15:57:31.595 INFO:tasks.workunit.client.1.smithi155.stdout:2/98: chown d7/db/dd/f11 107143 1 2024-04-25T15:57:31.596 INFO:tasks.workunit.client.1.smithi155.stdout:2/99: stat d7/c8 0 2024-04-25T15:57:31.618 INFO:tasks.workunit.client.1.smithi155.stdout:2/100: truncate d7/f9 1857684 0 2024-04-25T15:57:31.620 INFO:tasks.workunit.client.1.smithi155.stdout:2/101: creat d7/db/dd/d15/f1d x:0 0 0 2024-04-25T15:57:31.623 INFO:tasks.workunit.client.1.smithi155.stdout:2/102: rename d7/f19 to d7/db/f1e 0 2024-04-25T15:57:31.625 INFO:tasks.workunit.client.1.smithi155.stdout:2/103: rename d7/db/dd/le to d7/db/dd/l1f 0 2024-04-25T15:57:31.626 INFO:tasks.workunit.client.1.smithi155.stdout:2/104: chown d7/db/dd/c14 6063 1 2024-04-25T15:57:31.626 INFO:tasks.workunit.client.1.smithi155.stdout:2/105: chown l5 4 1 2024-04-25T15:57:31.628 INFO:tasks.workunit.client.1.smithi155.stdout:2/106: unlink l5 0 2024-04-25T15:57:31.630 INFO:tasks.workunit.client.1.smithi155.stdout:2/107: creat d7/db/dd/d15/d18/f20 x:0 0 0 2024-04-25T15:57:31.635 INFO:tasks.workunit.client.1.smithi155.stdout:2/108: unlink d7/db/f1e 0 2024-04-25T15:57:31.639 INFO:tasks.workunit.client.1.smithi155.stdout:2/109: dread f1 [0,4194304] 0 2024-04-25T15:57:31.641 INFO:tasks.workunit.client.1.smithi155.stdout:2/110: creat d7/db/dd/d15/d18/f21 x:0 0 0 2024-04-25T15:57:31.643 INFO:tasks.workunit.client.1.smithi155.stdout:2/111: symlink d7/db/dd/d15/l22 0 2024-04-25T15:57:31.650 INFO:tasks.workunit.client.1.smithi155.stdout:2/112: rename d7/db/dd/d15/d18 to d7/d23 0 2024-04-25T15:57:31.651 INFO:tasks.workunit.client.1.smithi155.stdout:2/113: mknod d7/db/dd/c24 0 2024-04-25T15:57:31.652 INFO:tasks.workunit.client.1.smithi155.stdout:2/114: dread - d7/db/dd/d15/f1b zero size 2024-04-25T15:57:31.660 INFO:tasks.workunit.client.1.smithi155.stdout:2/115: dwrite d7/db/dd/f11 [0,4194304] 0 2024-04-25T15:57:31.661 INFO:tasks.workunit.client.1.smithi155.stdout:2/116: read d7/f16 [2139833,103016] 0 2024-04-25T15:57:31.663 INFO:tasks.workunit.client.1.smithi155.stdout:2/117: symlink d7/db/dd/l25 0 2024-04-25T15:57:31.674 INFO:tasks.workunit.client.1.smithi155.stdout:2/118: dwrite f1 [8388608,4194304] 0 2024-04-25T15:57:31.676 INFO:tasks.workunit.client.1.smithi155.stdout:2/119: truncate d7/d23/f20 307505 0 2024-04-25T15:57:31.678 INFO:tasks.workunit.client.1.smithi155.stdout:2/120: creat d7/db/dd/f26 x:0 0 0 2024-04-25T15:57:31.679 INFO:tasks.workunit.client.1.smithi155.stdout:2/121: chown d7/db/dd/d15/f1d 324 1 2024-04-25T15:57:31.687 INFO:tasks.workunit.client.1.smithi155.stdout:2/122: dwrite f1 [0,4194304] 0 2024-04-25T15:57:31.690 INFO:tasks.workunit.client.1.smithi155.stdout:2/123: mknod d7/c27 0 2024-04-25T15:57:31.692 INFO:tasks.workunit.client.1.smithi155.stdout:2/124: unlink d7/c27 0 2024-04-25T15:57:31.694 INFO:tasks.workunit.client.1.smithi155.stdout:2/125: truncate d7/f16 3133333 0 2024-04-25T15:57:31.701 INFO:tasks.workunit.client.1.smithi155.stdout:2/126: dwrite d7/d23/f20 [0,4194304] 0 2024-04-25T15:57:31.703 INFO:tasks.workunit.client.1.smithi155.stdout:2/127: write d7/db/dd/f11 [2692598,71635] 0 2024-04-25T15:57:31.712 INFO:tasks.workunit.client.1.smithi155.stdout:2/128: dwrite d7/db/dd/f11 [4194304,4194304] 0 2024-04-25T15:57:31.713 INFO:tasks.workunit.client.1.smithi155.stdout:2/129: write f1 [5806599,63089] 0 2024-04-25T15:57:31.714 INFO:tasks.workunit.client.1.smithi155.stdout:2/130: chown d7/db/dd/d15/f1a 8868956 1 2024-04-25T15:57:31.719 INFO:tasks.workunit.client.1.smithi155.stdout:2/131: dread f1 [0,4194304] 0 2024-04-25T15:57:31.750 INFO:tasks.workunit.client.1.smithi155.stdout:5/21: sync 2024-04-25T15:57:31.750 INFO:tasks.workunit.client.1.smithi155.stdout:7/3: sync 2024-04-25T15:57:31.750 INFO:tasks.workunit.client.1.smithi155.stdout:8/2: sync 2024-04-25T15:57:31.750 INFO:tasks.workunit.client.1.smithi155.stdout:8/3: truncate - no filename 2024-04-25T15:57:31.751 INFO:tasks.workunit.client.1.smithi155.stdout:8/4: dread - no filename 2024-04-25T15:57:31.751 INFO:tasks.workunit.client.1.smithi155.stdout:9/8: sync 2024-04-25T15:57:31.751 INFO:tasks.workunit.client.1.smithi155.stdout:7/4: chown l0 7 1 2024-04-25T15:57:31.752 INFO:tasks.workunit.client.1.smithi155.stdout:5/22: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:31.753 INFO:tasks.workunit.client.1.smithi155.stdout:8/5: mknod c1 0 2024-04-25T15:57:31.753 INFO:tasks.workunit.client.1.smithi155.stdout:8/6: write - no filename 2024-04-25T15:57:31.753 INFO:tasks.workunit.client.1.smithi155.stdout:8/7: fsync - no filename 2024-04-25T15:57:31.753 INFO:tasks.workunit.client.1.smithi155.stdout:8/8: dread - no filename 2024-04-25T15:57:31.753 INFO:tasks.workunit.client.1.smithi155.stdout:8/9: truncate - no filename 2024-04-25T15:57:31.757 INFO:tasks.workunit.client.1.smithi155.stdout:7/5: rename l0 to l1 0 2024-04-25T15:57:31.757 INFO:tasks.workunit.client.1.smithi155.stdout:7/6: dwrite - no filename 2024-04-25T15:57:31.757 INFO:tasks.workunit.client.1.smithi155.stdout:9/9: link l1 l3 0 2024-04-25T15:57:31.759 INFO:tasks.workunit.client.1.smithi155.stdout:7/7: mkdir d2 0 2024-04-25T15:57:31.760 INFO:tasks.workunit.client.1.smithi155.stdout:9/10: symlink l4 0 2024-04-25T15:57:31.761 INFO:tasks.workunit.client.1.smithi155.stdout:9/11: fdatasync f0 0 2024-04-25T15:57:31.762 INFO:tasks.workunit.client.1.smithi155.stdout:5/23: getdents d0 0 2024-04-25T15:57:31.762 INFO:tasks.workunit.client.1.smithi155.stdout:7/8: creat d2/f3 x:0 0 0 2024-04-25T15:57:31.763 INFO:tasks.workunit.client.1.smithi155.stdout:9/12: readlink l3 0 2024-04-25T15:57:31.764 INFO:tasks.workunit.client.1.smithi155.stdout:5/24: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:31.765 INFO:tasks.workunit.client.1.smithi155.stdout:7/9: symlink d2/l4 0 2024-04-25T15:57:31.766 INFO:tasks.workunit.client.1.smithi155.stdout:9/13: creat f5 x:0 0 0 2024-04-25T15:57:31.766 INFO:tasks.workunit.client.1.smithi155.stdout:7/10: read - d2/f3 zero size 2024-04-25T15:57:31.767 INFO:tasks.workunit.client.1.smithi155.stdout:7/11: fdatasync d2/f3 0 2024-04-25T15:57:31.768 INFO:tasks.workunit.client.1.smithi155.stdout:9/14: creat f6 x:0 0 0 2024-04-25T15:57:31.770 INFO:tasks.workunit.client.1.smithi155.stdout:7/12: mknod d2/c5 0 2024-04-25T15:57:31.771 INFO:tasks.workunit.client.1.smithi155.stdout:9/15: creat f7 x:0 0 0 2024-04-25T15:57:31.775 INFO:tasks.workunit.client.1.smithi155.stdout:7/13: rename d2/f3 to d2/f6 0 2024-04-25T15:57:31.776 INFO:tasks.workunit.client.1.smithi155.stdout:7/14: dread - d2/f6 zero size 2024-04-25T15:57:31.779 INFO:tasks.workunit.client.1.smithi155.stdout:7/15: read - d2/f6 zero size 2024-04-25T15:57:31.781 INFO:tasks.workunit.client.1.smithi155.stdout:7/16: stat d2 0 2024-04-25T15:57:31.790 INFO:tasks.workunit.client.1.smithi155.stdout:5/25: dwrite d0/f2 [0,4194304] 0 2024-04-25T15:57:31.790 INFO:tasks.workunit.client.1.smithi155.stdout:9/16: dwrite f5 [0,4194304] 0 2024-04-25T15:57:31.793 INFO:tasks.workunit.client.1.smithi155.stdout:9/17: dread - f0 zero size 2024-04-25T15:57:31.794 INFO:tasks.workunit.client.1.smithi155.stdout:5/26: mknod d0/c4 0 2024-04-25T15:57:31.804 INFO:tasks.workunit.client.1.smithi155.stdout:7/17: dwrite d2/f6 [0,4194304] 0 2024-04-25T15:57:31.805 INFO:tasks.workunit.client.1.smithi155.stdout:5/27: truncate d0/f2 2674505 0 2024-04-25T15:57:31.808 INFO:tasks.workunit.client.1.smithi155.stdout:5/28: symlink d0/l5 0 2024-04-25T15:57:31.810 INFO:tasks.workunit.client.1.smithi155.stdout:9/18: dwrite f5 [0,4194304] 0 2024-04-25T15:57:31.812 INFO:tasks.workunit.client.1.smithi155.stdout:9/19: truncate f7 970198 0 2024-04-25T15:57:31.813 INFO:tasks.workunit.client.1.smithi155.stdout:9/20: write f6 [550033,2951] 0 2024-04-25T15:57:31.816 INFO:tasks.workunit.client.1.smithi155.stdout:9/21: write f5 [2717087,123109] 0 2024-04-25T15:57:31.817 INFO:tasks.workunit.client.1.smithi155.stdout:5/29: symlink d0/d1/l6 0 2024-04-25T15:57:31.817 INFO:tasks.workunit.client.1.smithi155.stdout:7/18: dread d2/f6 [0,4194304] 0 2024-04-25T15:57:31.818 INFO:tasks.workunit.client.1.smithi155.stdout:9/22: mknod c8 0 2024-04-25T15:57:31.819 INFO:tasks.workunit.client.1.smithi155.stdout:5/30: mknod d0/c7 0 2024-04-25T15:57:31.820 INFO:tasks.workunit.client.1.smithi155.stdout:7/19: write d2/f6 [3746860,93896] 0 2024-04-25T15:57:31.820 INFO:tasks.workunit.client.1.smithi155.stdout:9/23: symlink l9 0 2024-04-25T15:57:31.821 INFO:tasks.workunit.client.1.smithi155.stdout:5/31: creat d0/f8 x:0 0 0 2024-04-25T15:57:31.823 INFO:tasks.workunit.client.1.smithi155.stdout:9/24: unlink l9 0 2024-04-25T15:57:31.825 INFO:tasks.workunit.client.1.smithi155.stdout:9/25: creat fa x:0 0 0 2024-04-25T15:57:31.825 INFO:tasks.workunit.client.1.smithi155.stdout:9/26: rmdir - no directory 2024-04-25T15:57:31.825 INFO:tasks.workunit.client.1.smithi155.stdout:5/32: mknod d0/d3/c9 0 2024-04-25T15:57:31.825 INFO:tasks.workunit.client.1.smithi155.stdout:7/20: dread d2/f6 [0,4194304] 0 2024-04-25T15:57:31.826 INFO:tasks.workunit.client.1.smithi155.stdout:5/33: fdatasync d0/f8 0 2024-04-25T15:57:31.826 INFO:tasks.workunit.client.1.smithi155.stdout:9/27: mknod cb 0 2024-04-25T15:57:31.827 INFO:tasks.workunit.client.1.smithi155.stdout:7/21: read d2/f6 [1718701,22079] 0 2024-04-25T15:57:31.830 INFO:tasks.workunit.client.1.smithi155.stdout:7/22: rename d2/c5 to d2/c7 0 2024-04-25T15:57:31.833 INFO:tasks.workunit.client.1.smithi155.stdout:7/23: write d2/f6 [1787741,54608] 0 2024-04-25T15:57:31.834 INFO:tasks.workunit.client.1.smithi155.stdout:9/28: dwrite f5 [0,4194304] 0 2024-04-25T15:57:31.835 INFO:tasks.workunit.client.1.smithi155.stdout:9/29: stat f7 0 2024-04-25T15:57:31.836 INFO:tasks.workunit.client.1.smithi155.stdout:7/24: creat d2/f8 x:0 0 0 2024-04-25T15:57:31.837 INFO:tasks.workunit.client.1.smithi155.stdout:5/34: getdents d0 0 2024-04-25T15:57:31.838 INFO:tasks.workunit.client.1.smithi155.stdout:9/30: readlink l1 0 2024-04-25T15:57:31.838 INFO:tasks.workunit.client.1.smithi155.stdout:9/31: rmdir - no directory 2024-04-25T15:57:31.839 INFO:tasks.workunit.client.1.smithi155.stdout:9/32: write f7 [1759117,13459] 0 2024-04-25T15:57:31.840 INFO:tasks.workunit.client.1.smithi155.stdout:7/25: creat d2/f9 x:0 0 0 2024-04-25T15:57:31.840 INFO:tasks.workunit.client.1.smithi155.stdout:7/26: read - d2/f8 zero size 2024-04-25T15:57:31.841 INFO:tasks.workunit.client.1.smithi155.stdout:7/27: chown d2 110 1 2024-04-25T15:57:31.843 INFO:tasks.workunit.client.1.smithi155.stdout:9/33: dread f5 [0,4194304] 0 2024-04-25T15:57:31.844 INFO:tasks.workunit.client.1.smithi155.stdout:9/34: fsync fa 0 2024-04-25T15:57:31.844 INFO:tasks.workunit.client.1.smithi155.stdout:3/56: sync 2024-04-25T15:57:31.845 INFO:tasks.workunit.client.1.smithi155.stdout:7/28: creat d2/fa x:0 0 0 2024-04-25T15:57:31.846 INFO:tasks.workunit.client.1.smithi155.stdout:5/35: link d0/c4 d0/d3/ca 0 2024-04-25T15:57:31.848 INFO:tasks.workunit.client.1.smithi155.stdout:9/35: mkdir dc 0 2024-04-25T15:57:31.848 INFO:tasks.workunit.client.1.smithi155.stdout:3/57: mkdir d1/d4/db 0 2024-04-25T15:57:31.849 INFO:tasks.workunit.client.1.smithi155.stdout:7/29: symlink d2/lb 0 2024-04-25T15:57:31.850 INFO:tasks.workunit.client.1.smithi155.stdout:5/36: write d0/f2 [908143,16579] 0 2024-04-25T15:57:31.851 INFO:tasks.workunit.client.1.smithi155.stdout:5/37: write d0/f8 [199080,116382] 0 2024-04-25T15:57:31.851 INFO:tasks.workunit.client.1.smithi155.stdout:9/36: mknod dc/cd 0 2024-04-25T15:57:31.853 INFO:tasks.workunit.client.1.smithi155.stdout:5/38: chown d0/f2 1267486 1 2024-04-25T15:57:31.896 INFO:tasks.workunit.client.1.smithi155.stdout:5/39: stat d0/f8 0 2024-04-25T15:57:31.896 INFO:tasks.workunit.client.1.smithi155.stdout:9/37: link f7 dc/fe 0 2024-04-25T15:57:31.899 INFO:tasks.workunit.client.1.smithi155.stdout:5/40: mknod d0/cb 0 2024-04-25T15:57:31.900 INFO:tasks.workunit.client.1.smithi155.stdout:3/58: dwrite d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:31.900 INFO:tasks.workunit.client.1.smithi155.stdout:9/38: creat dc/ff x:0 0 0 2024-04-25T15:57:31.901 INFO:tasks.workunit.client.1.smithi155.stdout:3/59: chown d1/d4 5194 1 2024-04-25T15:57:31.906 INFO:tasks.workunit.client.1.smithi155.stdout:3/60: rmdir d1 39 2024-04-25T15:57:31.906 INFO:tasks.workunit.client.1.smithi155.stdout:9/39: write f7 [1854452,27018] 0 2024-04-25T15:57:31.907 INFO:tasks.workunit.client.1.smithi155.stdout:9/40: chown l1 3309 1 2024-04-25T15:57:31.910 INFO:tasks.workunit.client.1.smithi155.stdout:9/41: symlink dc/l10 0 2024-04-25T15:57:31.912 INFO:tasks.workunit.client.1.smithi155.stdout:3/61: stat d1/c9 0 2024-04-25T15:57:31.912 INFO:tasks.workunit.client.1.smithi155.stdout:9/42: mkdir dc/d11 0 2024-04-25T15:57:31.912 INFO:tasks.workunit.client.1.smithi155.stdout:3/62: chown d1/d4/db 0 1 2024-04-25T15:57:31.913 INFO:tasks.workunit.client.1.smithi155.stdout:5/41: dwrite d0/f2 [0,4194304] 0 2024-04-25T15:57:31.916 INFO:tasks.workunit.client.1.smithi155.stdout:3/63: mknod d1/cc 0 2024-04-25T15:57:31.918 INFO:tasks.workunit.client.1.smithi155.stdout:9/43: link l4 dc/d11/l12 0 2024-04-25T15:57:31.919 INFO:tasks.workunit.client.1.smithi155.stdout:3/64: symlink d1/d4/db/ld 0 2024-04-25T15:57:31.921 INFO:tasks.workunit.client.1.smithi155.stdout:9/44: mkdir dc/d13 0 2024-04-25T15:57:31.924 INFO:tasks.workunit.client.1.smithi155.stdout:9/45: creat dc/f14 x:0 0 0 2024-04-25T15:57:31.925 INFO:tasks.workunit.client.1.smithi155.stdout:9/46: chown f0 2043406 1 2024-04-25T15:57:31.926 INFO:tasks.workunit.client.1.smithi155.stdout:5/42: dwrite d0/f2 [4194304,4194304] 0 2024-04-25T15:57:31.928 INFO:tasks.workunit.client.1.smithi155.stdout:9/47: rmdir dc/d11 39 2024-04-25T15:57:31.930 INFO:tasks.workunit.client.1.smithi155.stdout:3/65: dread d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:31.931 INFO:tasks.workunit.client.1.smithi155.stdout:9/48: unlink f0 0 2024-04-25T15:57:31.932 INFO:tasks.workunit.client.1.smithi155.stdout:3/66: rmdir d1 39 2024-04-25T15:57:31.934 INFO:tasks.workunit.client.1.smithi155.stdout:3/67: chown d1/d4/db 0 1 2024-04-25T15:57:31.935 INFO:tasks.workunit.client.1.smithi155.stdout:4/63: sync 2024-04-25T15:57:31.935 INFO:tasks.workunit.client.1.smithi155.stdout:9/49: getdents dc/d13 0 2024-04-25T15:57:31.936 INFO:tasks.workunit.client.1.smithi155.stdout:9/50: readlink dc/l10 0 2024-04-25T15:57:31.938 INFO:tasks.workunit.client.1.smithi155.stdout:3/68: creat d1/d4/db/fe x:0 0 0 2024-04-25T15:57:31.938 INFO:tasks.workunit.client.1.smithi155.stdout:5/43: dwrite d0/f8 [0,4194304] 0 2024-04-25T15:57:31.939 INFO:tasks.workunit.client.1.smithi155.stdout:4/64: rename c4 to da/dc/c17 0 2024-04-25T15:57:31.941 INFO:tasks.workunit.client.1.smithi155.stdout:3/69: write d1/d4/f8 [5164115,60030] 0 2024-04-25T15:57:31.943 INFO:tasks.workunit.client.1.smithi155.stdout:5/44: write d0/f2 [6576632,104678] 0 2024-04-25T15:57:31.944 INFO:tasks.workunit.client.1.smithi155.stdout:4/65: dread da/dc/f12 [0,4194304] 0 2024-04-25T15:57:31.944 INFO:tasks.workunit.client.1.smithi155.stdout:9/51: getdents dc/d11 0 2024-04-25T15:57:31.944 INFO:tasks.workunit.client.1.smithi155.stdout:5/45: readlink d0/l5 0 2024-04-25T15:57:31.945 INFO:tasks.workunit.client.1.smithi155.stdout:5/46: read d0/f2 [5682848,127763] 0 2024-04-25T15:57:31.953 INFO:tasks.workunit.client.1.smithi155.stdout:3/70: dwrite d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:31.953 INFO:tasks.workunit.client.1.smithi155.stdout:5/47: dread d0/f8 [0,4194304] 0 2024-04-25T15:57:31.957 INFO:tasks.workunit.client.1.smithi155.stdout:5/48: write d0/f2 [2249590,81969] 0 2024-04-25T15:57:31.959 INFO:tasks.workunit.client.1.smithi155.stdout:4/66: write da/f11 [1414514,89845] 0 2024-04-25T15:57:31.959 INFO:tasks.workunit.client.1.smithi155.stdout:5/49: mknod d0/d3/cc 0 2024-04-25T15:57:31.961 INFO:tasks.workunit.client.1.smithi155.stdout:9/52: truncate dc/fe 707150 0 2024-04-25T15:57:31.962 INFO:tasks.workunit.client.1.smithi155.stdout:5/50: symlink d0/d1/ld 0 2024-04-25T15:57:31.963 INFO:tasks.workunit.client.1.smithi155.stdout:9/53: mknod dc/c15 0 2024-04-25T15:57:31.964 INFO:tasks.workunit.client.1.smithi155.stdout:5/51: creat d0/d1/fe x:0 0 0 2024-04-25T15:57:31.965 INFO:tasks.workunit.client.1.smithi155.stdout:9/54: rmdir dc/d11 39 2024-04-25T15:57:31.967 INFO:tasks.workunit.client.1.smithi155.stdout:5/52: creat d0/ff x:0 0 0 2024-04-25T15:57:31.967 INFO:tasks.workunit.client.1.smithi155.stdout:3/71: fdatasync d1/d4/f8 0 2024-04-25T15:57:31.970 INFO:tasks.workunit.client.1.smithi155.stdout:5/53: write d0/f2 [2721961,10427] 0 2024-04-25T15:57:31.970 INFO:tasks.workunit.client.1.smithi155.stdout:9/55: chown dc/d11/l12 1471708 1 2024-04-25T15:57:31.970 INFO:tasks.workunit.client.1.smithi155.stdout:4/67: dwrite da/f16 [0,4194304] 0 2024-04-25T15:57:31.971 INFO:tasks.workunit.client.1.smithi155.stdout:3/72: symlink d1/d4/lf 0 2024-04-25T15:57:31.972 INFO:tasks.workunit.client.1.smithi155.stdout:9/56: truncate dc/ff 857576 0 2024-04-25T15:57:31.972 INFO:tasks.workunit.client.1.smithi155.stdout:5/54: symlink d0/l10 0 2024-04-25T15:57:31.973 INFO:tasks.workunit.client.1.smithi155.stdout:5/55: fsync d0/f2 0 2024-04-25T15:57:31.974 INFO:tasks.workunit.client.1.smithi155.stdout:3/73: mkdir d1/d4/d10 0 2024-04-25T15:57:31.974 INFO:tasks.workunit.client.1.smithi155.stdout:3/74: fsync d1/d4/f8 0 2024-04-25T15:57:31.975 INFO:tasks.workunit.client.1.smithi155.stdout:4/68: mkdir da/dc/d18 0 2024-04-25T15:57:31.980 INFO:tasks.workunit.client.1.smithi155.stdout:4/69: creat da/f19 x:0 0 0 2024-04-25T15:57:31.980 INFO:tasks.workunit.client.1.smithi155.stdout:9/57: mknod dc/d13/c16 0 2024-04-25T15:57:31.983 INFO:tasks.workunit.client.1.smithi155.stdout:5/56: rename d0/ff to d0/d3/f11 0 2024-04-25T15:57:31.983 INFO:tasks.workunit.client.1.smithi155.stdout:3/75: dwrite d1/d4/db/fe [0,4194304] 0 2024-04-25T15:57:31.984 INFO:tasks.workunit.client.1.smithi155.stdout:5/57: read d0/f8 [1399658,121447] 0 2024-04-25T15:57:31.986 INFO:tasks.workunit.client.1.smithi155.stdout:5/58: chown d0/c7 29 1 2024-04-25T15:57:31.989 INFO:tasks.workunit.client.1.smithi155.stdout:5/59: creat d0/f12 x:0 0 0 2024-04-25T15:57:31.990 INFO:tasks.workunit.client.1.smithi155.stdout:5/60: chown d0/d3/cc 43 1 2024-04-25T15:57:31.991 INFO:tasks.workunit.client.1.smithi155.stdout:5/61: readlink d0/d1/ld 0 2024-04-25T15:57:31.991 INFO:tasks.workunit.client.1.smithi155.stdout:5/62: dread - d0/d3/f11 zero size 2024-04-25T15:57:31.992 INFO:tasks.workunit.client.1.smithi155.stdout:5/63: readlink d0/l10 0 2024-04-25T15:57:31.996 INFO:tasks.workunit.client.1.smithi155.stdout:5/64: mkdir d0/d1/d13 0 2024-04-25T15:57:31.998 INFO:tasks.workunit.client.1.smithi155.stdout:5/65: unlink d0/cb 0 2024-04-25T15:57:32.000 INFO:tasks.workunit.client.1.smithi155.stdout:4/70: truncate f7 3967933 0 2024-04-25T15:57:32.001 INFO:tasks.workunit.client.1.smithi155.stdout:3/76: fdatasync d1/d4/db/fe 0 2024-04-25T15:57:32.005 INFO:tasks.workunit.client.1.smithi155.stdout:9/58: write dc/fe [685195,97943] 0 2024-04-25T15:57:32.010 INFO:tasks.workunit.client.1.smithi155.stdout:5/66: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T15:57:32.014 INFO:tasks.workunit.client.1.smithi155.stdout:4/71: dwrite da/f14 [0,4194304] 0 2024-04-25T15:57:32.014 INFO:tasks.workunit.client.1.smithi155.stdout:3/77: dread d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:32.015 INFO:tasks.workunit.client.1.smithi155.stdout:4/72: chown da/dc 77114 1 2024-04-25T15:57:32.019 INFO:tasks.workunit.client.1.smithi155.stdout:3/78: creat d1/d4/db/f11 x:0 0 0 2024-04-25T15:57:32.024 INFO:tasks.workunit.client.1.smithi155.stdout:9/59: dwrite fa [0,4194304] 0 2024-04-25T15:57:32.024 INFO:tasks.workunit.client.1.smithi155.stdout:5/67: truncate d0/f8 837183 0 2024-04-25T15:57:32.025 INFO:tasks.workunit.client.1.smithi155.stdout:1/53: sync 2024-04-25T15:57:32.028 INFO:tasks.workunit.client.1.smithi155.stdout:4/73: rename l9 to da/l1a 0 2024-04-25T15:57:32.028 INFO:tasks.workunit.client.1.smithi155.stdout:3/79: mknod d1/c12 0 2024-04-25T15:57:32.028 INFO:tasks.workunit.client.1.smithi155.stdout:5/68: mknod d0/d1/c14 0 2024-04-25T15:57:32.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/54: symlink d1/d16/l18 0 2024-04-25T15:57:32.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/55: dread - d1/d6/f14 zero size 2024-04-25T15:57:32.032 INFO:tasks.workunit.client.1.smithi155.stdout:1/56: dread - d1/f11 zero size 2024-04-25T15:57:32.033 INFO:tasks.workunit.client.1.smithi155.stdout:4/74: truncate da/dc/f12 948385 0 2024-04-25T15:57:32.033 INFO:tasks.workunit.client.1.smithi155.stdout:4/75: readlink l6 0 2024-04-25T15:57:32.034 INFO:tasks.workunit.client.1.smithi155.stdout:9/60: mkdir dc/d17 0 2024-04-25T15:57:32.035 INFO:tasks.workunit.client.1.smithi155.stdout:6/73: sync 2024-04-25T15:57:32.037 INFO:tasks.workunit.client.1.smithi155.stdout:4/76: dread da/dc/fd [0,4194304] 0 2024-04-25T15:57:32.037 INFO:tasks.workunit.client.1.smithi155.stdout:3/80: dwrite d1/d4/f8 [0,4194304] 0 2024-04-25T15:57:32.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/57: link d1/c3 d1/d16/c19 0 2024-04-25T15:57:32.041 INFO:tasks.workunit.client.1.smithi155.stdout:6/74: dread d0/fa [0,4194304] 0 2024-04-25T15:57:32.043 INFO:tasks.workunit.client.1.smithi155.stdout:9/61: dread fa [0,4194304] 0 2024-04-25T15:57:32.044 INFO:tasks.workunit.client.1.smithi155.stdout:1/58: write d1/f12 [3935500,72821] 0 2024-04-25T15:57:32.044 INFO:tasks.workunit.client.1.smithi155.stdout:9/62: stat dc/fe 0 2024-04-25T15:57:32.046 INFO:tasks.workunit.client.1.smithi155.stdout:2/132: sync 2024-04-25T15:57:32.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/58: sync 2024-04-25T15:57:32.046 INFO:tasks.workunit.client.1.smithi155.stdout:8/10: sync 2024-04-25T15:57:32.046 INFO:tasks.workunit.client.1.smithi155.stdout:8/11: truncate - no filename 2024-04-25T15:57:32.046 INFO:tasks.workunit.client.1.smithi155.stdout:6/75: read - d0/d13/f17 zero size 2024-04-25T15:57:32.047 INFO:tasks.workunit.client.1.smithi155.stdout:5/69: rename d0/d1 to d0/d3/d15 0 2024-04-25T15:57:32.048 INFO:tasks.workunit.client.1.smithi155.stdout:1/59: symlink d1/l1a 0 2024-04-25T15:57:32.051 INFO:tasks.workunit.client.1.smithi155.stdout:7/30: sync 2024-04-25T15:57:32.058 INFO:tasks.workunit.client.1.smithi155.stdout:8/12: mkdir d2 0 2024-04-25T15:57:32.059 INFO:tasks.workunit.client.1.smithi155.stdout:0/59: mknod d1/d6/c19 0 2024-04-25T15:57:32.059 INFO:tasks.workunit.client.1.smithi155.stdout:6/76: unlink d0/f6 0 2024-04-25T15:57:32.059 INFO:tasks.workunit.client.1.smithi155.stdout:8/13: chown c1 1407258 1 2024-04-25T15:57:32.060 INFO:tasks.workunit.client.1.smithi155.stdout:7/31: write d2/f9 [38734,33328] 0 2024-04-25T15:57:32.060 INFO:tasks.workunit.client.1.smithi155.stdout:3/81: rename d1/la to d1/d4/l13 0 2024-04-25T15:57:32.062 INFO:tasks.workunit.client.1.smithi155.stdout:4/77: truncate da/f11 1142836 0 2024-04-25T15:57:32.065 INFO:tasks.workunit.client.1.smithi155.stdout:9/63: dwrite dc/ff [0,4194304] 0 2024-04-25T15:57:32.066 INFO:tasks.workunit.client.1.smithi155.stdout:1/60: dread d1/f8 [0,4194304] 0 2024-04-25T15:57:32.068 INFO:tasks.workunit.client.1.smithi155.stdout:1/61: chown d1/la 2679 1 2024-04-25T15:57:32.068 INFO:tasks.workunit.client.1.smithi155.stdout:1/62: readlink d1/l5 0 2024-04-25T15:57:32.070 INFO:tasks.workunit.client.1.smithi155.stdout:1/63: truncate d1/d6/f7 5118471 0 2024-04-25T15:57:32.071 INFO:tasks.workunit.client.1.smithi155.stdout:5/70: write d0/d3/f11 [741949,19920] 0 2024-04-25T15:57:32.073 INFO:tasks.workunit.client.1.smithi155.stdout:9/64: dread f5 [0,4194304] 0 2024-04-25T15:57:32.073 INFO:tasks.workunit.client.1.smithi155.stdout:4/78: dwrite da/f19 [0,4194304] 0 2024-04-25T15:57:32.073 INFO:tasks.workunit.client.1.smithi155.stdout:9/65: dread - dc/f14 zero size 2024-04-25T15:57:32.073 INFO:tasks.workunit.client.1.smithi155.stdout:4/79: chown da/dc/f13 2946818 1 2024-04-25T15:57:32.075 INFO:tasks.workunit.client.1.smithi155.stdout:4/80: dread da/dc/f13 [0,4194304] 0 2024-04-25T15:57:32.083 INFO:tasks.workunit.client.1.smithi155.stdout:4/81: dwrite da/dc/fd [0,4194304] 0 2024-04-25T15:57:32.174 INFO:tasks.workunit.client.1.smithi155.stdout:0/60: mkdir d1/d1a 0 2024-04-25T15:57:32.176 INFO:tasks.workunit.client.1.smithi155.stdout:7/32: readlink l1 0 2024-04-25T15:57:32.180 INFO:tasks.workunit.client.1.smithi155.stdout:6/77: creat d0/f19 x:0 0 0 2024-04-25T15:57:32.181 INFO:tasks.workunit.client.1.smithi155.stdout:1/64: mkdir d1/d6/d1b 0 2024-04-25T15:57:32.182 INFO:tasks.workunit.client.1.smithi155.stdout:1/65: stat d1/d6 0 2024-04-25T15:57:32.184 INFO:tasks.workunit.client.1.smithi155.stdout:5/71: creat d0/d3/d15/f16 x:0 0 0 2024-04-25T15:57:32.188 INFO:tasks.workunit.client.1.smithi155.stdout:0/61: dread d1/d3/d5/da/fc [0,4194304] 0 2024-04-25T15:57:32.189 INFO:tasks.workunit.client.1.smithi155.stdout:3/82: creat d1/d4/d10/f14 x:0 0 0 2024-04-25T15:57:32.192 INFO:tasks.workunit.client.1.smithi155.stdout:7/33: rename d2/f9 to d2/fc 0 2024-04-25T15:57:32.194 INFO:tasks.workunit.client.1.smithi155.stdout:1/66: creat d1/d16/f1c x:0 0 0 2024-04-25T15:57:32.195 INFO:tasks.workunit.client.1.smithi155.stdout:9/66: mkdir dc/d17/d18 0 2024-04-25T15:57:32.195 INFO:tasks.workunit.client.1.smithi155.stdout:0/62: write d1/d3/d5/f10 [4310310,28423] 0 2024-04-25T15:57:32.197 INFO:tasks.workunit.client.1.smithi155.stdout:4/82: getdents da/dc/d18 0 2024-04-25T15:57:32.198 INFO:tasks.workunit.client.1.smithi155.stdout:5/72: creat d0/d3/d15/f17 x:0 0 0 2024-04-25T15:57:32.199 INFO:tasks.workunit.client.1.smithi155.stdout:8/14: link c0 d2/c3 0 2024-04-25T15:57:32.202 INFO:tasks.workunit.client.1.smithi155.stdout:7/34: mkdir d2/dd 0 2024-04-25T15:57:32.205 INFO:tasks.workunit.client.1.smithi155.stdout:0/63: creat d1/f1b x:0 0 0 2024-04-25T15:57:32.206 INFO:tasks.workunit.client.1.smithi155.stdout:7/35: write d2/f6 [2401483,3375] 0 2024-04-25T15:57:32.208 INFO:tasks.workunit.client.1.smithi155.stdout:9/67: creat dc/d17/f19 x:0 0 0 2024-04-25T15:57:32.209 INFO:tasks.workunit.client.1.smithi155.stdout:4/83: creat da/dc/f1b x:0 0 0 2024-04-25T15:57:32.210 INFO:tasks.workunit.client.1.smithi155.stdout:5/73: unlink d0/d3/f11 0 2024-04-25T15:57:32.212 INFO:tasks.workunit.client.1.smithi155.stdout:3/83: mknod d1/c15 0 2024-04-25T15:57:32.212 INFO:tasks.workunit.client.1.smithi155.stdout:5/74: write d0/d3/d15/f16 [50714,62669] 0 2024-04-25T15:57:32.214 INFO:tasks.workunit.client.1.smithi155.stdout:0/64: mknod d1/d3/d12/c1c 0 2024-04-25T15:57:32.216 INFO:tasks.workunit.client.1.smithi155.stdout:5/75: write d0/d3/d15/f17 [114991,43674] 0 2024-04-25T15:57:32.218 INFO:tasks.workunit.client.1.smithi155.stdout:0/65: fsync d1/d6/fb 0 2024-04-25T15:57:32.218 INFO:tasks.workunit.client.1.smithi155.stdout:8/15: symlink d2/l4 0 2024-04-25T15:57:32.220 INFO:tasks.workunit.client.1.smithi155.stdout:7/36: creat d2/dd/fe x:0 0 0 2024-04-25T15:57:32.221 INFO:tasks.workunit.client.1.smithi155.stdout:9/68: mknod dc/c1a 0 2024-04-25T15:57:32.227 INFO:tasks.workunit.client.1.smithi155.stdout:0/66: unlink d1/d6/fb 0 2024-04-25T15:57:32.228 INFO:tasks.workunit.client.1.smithi155.stdout:7/37: chown d2/fa 421 1 2024-04-25T15:57:32.231 INFO:tasks.workunit.client.1.smithi155.stdout:8/16: unlink c0 0 2024-04-25T15:57:32.234 INFO:tasks.workunit.client.1.smithi155.stdout:7/38: dread - d2/dd/fe zero size 2024-04-25T15:57:32.236 INFO:tasks.workunit.client.1.smithi155.stdout:0/67: write d1/f1b [147315,116821] 0 2024-04-25T15:57:32.241 INFO:tasks.workunit.client.1.smithi155.stdout:3/84: dwrite d1/d4/d10/f14 [0,4194304] 0 2024-04-25T15:57:32.242 INFO:tasks.workunit.client.1.smithi155.stdout:8/17: mkdir d2/d5 0 2024-04-25T15:57:32.242 INFO:tasks.workunit.client.1.smithi155.stdout:5/76: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:32.247 INFO:tasks.workunit.client.1.smithi155.stdout:8/18: symlink d2/l6 0 2024-04-25T15:57:32.247 INFO:tasks.workunit.client.1.smithi155.stdout:3/85: write d1/d4/db/f11 [1012026,114382] 0 2024-04-25T15:57:32.250 INFO:tasks.workunit.client.1.smithi155.stdout:3/86: fdatasync d1/d4/db/fe 0 2024-04-25T15:57:32.250 INFO:tasks.workunit.client.1.smithi155.stdout:0/68: creat d1/d1a/f1d x:0 0 0 2024-04-25T15:57:32.251 INFO:tasks.workunit.client.1.smithi155.stdout:7/39: write d2/fc [121174,111662] 0 2024-04-25T15:57:32.253 INFO:tasks.workunit.client.1.smithi155.stdout:3/87: chown d1/cc 1267380076 1 2024-04-25T15:57:32.254 INFO:tasks.workunit.client.1.smithi155.stdout:7/40: dread - d2/f8 zero size 2024-04-25T15:57:32.256 INFO:tasks.workunit.client.1.smithi155.stdout:5/77: link d0/d3/d15/l6 d0/d3/d15/l18 0 2024-04-25T15:57:32.257 INFO:tasks.workunit.client.1.smithi155.stdout:5/78: readlink d0/d3/d15/ld 0 2024-04-25T15:57:32.258 INFO:tasks.workunit.client.1.smithi155.stdout:7/41: unlink l1 0 2024-04-25T15:57:32.259 INFO:tasks.workunit.client.1.smithi155.stdout:5/79: chown d0/d3/c9 1016 1 2024-04-25T15:57:32.260 INFO:tasks.workunit.client.1.smithi155.stdout:0/69: mknod d1/d6/d16/c1e 0 2024-04-25T15:57:32.261 INFO:tasks.workunit.client.1.smithi155.stdout:8/19: link d2/l6 d2/d5/l7 0 2024-04-25T15:57:32.263 INFO:tasks.workunit.client.1.smithi155.stdout:5/80: creat d0/d3/d15/d13/f19 x:0 0 0 2024-04-25T15:57:32.266 INFO:tasks.workunit.client.1.smithi155.stdout:8/20: stat d2/c3 0 2024-04-25T15:57:32.270 INFO:tasks.workunit.client.1.smithi155.stdout:8/21: symlink d2/d5/l8 0 2024-04-25T15:57:32.270 INFO:tasks.workunit.client.1.smithi155.stdout:8/22: dwrite - no filename 2024-04-25T15:57:32.271 INFO:tasks.workunit.client.1.smithi155.stdout:0/70: getdents d1/d3/d5/da 0 2024-04-25T15:57:32.273 INFO:tasks.workunit.client.1.smithi155.stdout:8/23: symlink d2/l9 0 2024-04-25T15:57:32.277 INFO:tasks.workunit.client.1.smithi155.stdout:8/24: chown d2/c3 624889 1 2024-04-25T15:57:32.278 INFO:tasks.workunit.client.1.smithi155.stdout:8/25: chown d2/l4 1642844 1 2024-04-25T15:57:32.278 INFO:tasks.workunit.client.1.smithi155.stdout:8/26: fsync - no filename 2024-04-25T15:57:32.280 INFO:tasks.workunit.client.1.smithi155.stdout:8/27: creat d2/fa x:0 0 0 2024-04-25T15:57:32.281 INFO:tasks.workunit.client.1.smithi155.stdout:8/28: chown d2 325 1 2024-04-25T15:57:32.285 INFO:tasks.workunit.client.1.smithi155.stdout:8/29: rename d2/d5/l7 to d2/d5/lb 0 2024-04-25T15:57:32.286 INFO:tasks.workunit.client.1.smithi155.stdout:8/30: dread - d2/fa zero size 2024-04-25T15:57:32.301 INFO:tasks.workunit.client.1.smithi155.stdout:2/133: write d7/f9 [87700,130281] 0 2024-04-25T15:57:32.303 INFO:tasks.workunit.client.1.smithi155.stdout:5/81: fdatasync d0/f8 0 2024-04-25T15:57:32.306 INFO:tasks.workunit.client.1.smithi155.stdout:2/134: write d7/db/dd/f11 [5422341,111891] 0 2024-04-25T15:57:32.310 INFO:tasks.workunit.client.1.smithi155.stdout:2/135: creat d7/db/dd/d15/f28 x:0 0 0 2024-04-25T15:57:32.317 INFO:tasks.workunit.client.1.smithi155.stdout:1/67: write d1/f15 [592096,71025] 0 2024-04-25T15:57:32.319 INFO:tasks.workunit.client.1.smithi155.stdout:1/68: chown d1 327 1 2024-04-25T15:57:32.320 INFO:tasks.workunit.client.1.smithi155.stdout:5/82: dwrite d0/f2 [0,4194304] 0 2024-04-25T15:57:32.328 INFO:tasks.workunit.client.1.smithi155.stdout:9/69: truncate dc/ff 1763787 0 2024-04-25T15:57:32.328 INFO:tasks.workunit.client.1.smithi155.stdout:6/78: dwrite d0/ff [0,4194304] 0 2024-04-25T15:57:32.333 INFO:tasks.workunit.client.1.smithi155.stdout:2/136: dwrite d7/d23/f20 [0,4194304] 0 2024-04-25T15:57:32.333 INFO:tasks.workunit.client.1.smithi155.stdout:5/83: creat d0/d3/d15/d13/f1a x:0 0 0 2024-04-25T15:57:32.336 INFO:tasks.workunit.client.1.smithi155.stdout:2/137: read f1 [6017741,79662] 0 2024-04-25T15:57:32.339 INFO:tasks.workunit.client.1.smithi155.stdout:4/84: dwrite f7 [0,4194304] 0 2024-04-25T15:57:32.339 INFO:tasks.workunit.client.1.smithi155.stdout:1/69: dread d1/f15 [0,4194304] 0 2024-04-25T15:57:32.341 INFO:tasks.workunit.client.1.smithi155.stdout:2/138: write d7/db/dd/d15/f1a [730557,128479] 0 2024-04-25T15:57:32.343 INFO:tasks.workunit.client.1.smithi155.stdout:0/71: truncate d1/d3/fd 1600322 0 2024-04-25T15:57:32.344 INFO:tasks.workunit.client.1.smithi155.stdout:8/31: getdents d2/d5 0 2024-04-25T15:57:32.345 INFO:tasks.workunit.client.1.smithi155.stdout:2/139: truncate d7/d23/f21 341800 0 2024-04-25T15:57:32.346 INFO:tasks.workunit.client.1.smithi155.stdout:6/79: dwrite d0/ff [0,4194304] 0 2024-04-25T15:57:32.346 INFO:tasks.workunit.client.1.smithi155.stdout:5/84: mknod d0/d3/c1b 0 2024-04-25T15:57:32.348 INFO:tasks.workunit.client.1.smithi155.stdout:4/85: readlink da/l1a 0 2024-04-25T15:57:32.349 INFO:tasks.workunit.client.1.smithi155.stdout:1/70: mkdir d1/d16/d1d 0 2024-04-25T15:57:32.350 INFO:tasks.workunit.client.1.smithi155.stdout:0/72: creat d1/d6/f1f x:0 0 0 2024-04-25T15:57:32.352 INFO:tasks.workunit.client.1.smithi155.stdout:0/73: write d1/d6/f1f [259076,105026] 0 2024-04-25T15:57:32.353 INFO:tasks.workunit.client.1.smithi155.stdout:6/80: chown d0/f15 23 1 2024-04-25T15:57:32.356 INFO:tasks.workunit.client.1.smithi155.stdout:2/140: mkdir d7/db/d29 0 2024-04-25T15:57:32.357 INFO:tasks.workunit.client.1.smithi155.stdout:5/85: dwrite d0/d3/d15/f16 [0,4194304] 0 2024-04-25T15:57:32.369 INFO:tasks.workunit.client.1.smithi155.stdout:4/86: rename l6 to da/dc/d18/l1c 0 2024-04-25T15:57:32.373 INFO:tasks.workunit.client.1.smithi155.stdout:1/71: write d1/fb [1639902,40857] 0 2024-04-25T15:57:32.376 INFO:tasks.workunit.client.1.smithi155.stdout:4/87: creat da/dc/f1d x:0 0 0 2024-04-25T15:57:32.383 INFO:tasks.workunit.client.1.smithi155.stdout:2/141: dwrite d7/db/dd/f26 [0,4194304] 0 2024-04-25T15:57:32.386 INFO:tasks.workunit.client.1.smithi155.stdout:5/86: dwrite d0/d3/d15/d13/f19 [0,4194304] 0 2024-04-25T15:57:32.386 INFO:tasks.workunit.client.1.smithi155.stdout:2/142: chown f3 63 1 2024-04-25T15:57:32.386 INFO:tasks.workunit.client.1.smithi155.stdout:9/70: truncate dc/ff 957663 0 2024-04-25T15:57:32.390 INFO:tasks.workunit.client.1.smithi155.stdout:8/32: getdents d2 0 2024-04-25T15:57:32.393 INFO:tasks.workunit.client.1.smithi155.stdout:4/88: symlink da/dc/d18/l1e 0 2024-04-25T15:57:32.393 INFO:tasks.workunit.client.1.smithi155.stdout:9/71: creat dc/d17/f1b x:0 0 0 2024-04-25T15:57:32.394 INFO:tasks.workunit.client.1.smithi155.stdout:2/143: creat d7/db/dd/f2a x:0 0 0 2024-04-25T15:57:32.394 INFO:tasks.workunit.client.1.smithi155.stdout:1/72: dread d1/f12 [0,4194304] 0 2024-04-25T15:57:32.395 INFO:tasks.workunit.client.1.smithi155.stdout:5/87: creat d0/d3/d15/d13/f1c x:0 0 0 2024-04-25T15:57:32.396 INFO:tasks.workunit.client.1.smithi155.stdout:8/33: write d2/fa [920050,26019] 0 2024-04-25T15:57:32.397 INFO:tasks.workunit.client.1.smithi155.stdout:6/81: dwrite d0/f9 [0,4194304] 0 2024-04-25T15:57:32.399 INFO:tasks.workunit.client.1.smithi155.stdout:2/144: write d7/db/dd/d15/f28 [898727,95401] 0 2024-04-25T15:57:32.400 INFO:tasks.workunit.client.1.smithi155.stdout:8/34: write d2/fa [1505105,62081] 0 2024-04-25T15:57:32.403 INFO:tasks.workunit.client.1.smithi155.stdout:4/89: rename da/dc/f12 to da/dc/f1f 0 2024-04-25T15:57:32.404 INFO:tasks.workunit.client.1.smithi155.stdout:1/73: symlink d1/d6/d1b/l1e 0 2024-04-25T15:57:32.405 INFO:tasks.workunit.client.1.smithi155.stdout:1/74: truncate d1/f15 1976168 0 2024-04-25T15:57:32.405 INFO:tasks.workunit.client.1.smithi155.stdout:6/82: mkdir d0/d1a 0 2024-04-25T15:57:32.407 INFO:tasks.workunit.client.1.smithi155.stdout:8/35: creat d2/fc x:0 0 0 2024-04-25T15:57:32.409 INFO:tasks.workunit.client.1.smithi155.stdout:4/90: rename c5 to da/dc/d18/c20 0 2024-04-25T15:57:32.413 INFO:tasks.workunit.client.1.smithi155.stdout:5/88: link d0/c4 d0/c1d 0 2024-04-25T15:57:32.415 INFO:tasks.workunit.client.1.smithi155.stdout:2/145: creat d7/f2b x:0 0 0 2024-04-25T15:57:32.417 INFO:tasks.workunit.client.1.smithi155.stdout:1/75: dwrite d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:32.419 INFO:tasks.workunit.client.1.smithi155.stdout:5/89: creat d0/d3/d15/f1e x:0 0 0 2024-04-25T15:57:32.422 INFO:tasks.workunit.client.1.smithi155.stdout:6/83: dread d0/f9 [0,4194304] 0 2024-04-25T15:57:32.423 INFO:tasks.workunit.client.1.smithi155.stdout:2/146: dread d7/db/ff [0,4194304] 0 2024-04-25T15:57:32.423 INFO:tasks.workunit.client.1.smithi155.stdout:1/76: creat d1/d16/f1f x:0 0 0 2024-04-25T15:57:32.424 INFO:tasks.workunit.client.1.smithi155.stdout:2/147: chown d7/d23/f21 871533592 1 2024-04-25T15:57:32.424 INFO:tasks.workunit.client.1.smithi155.stdout:3/88: sync 2024-04-25T15:57:32.425 INFO:tasks.workunit.client.1.smithi155.stdout:5/90: readlink d0/d3/d15/l18 0 2024-04-25T15:57:32.427 INFO:tasks.workunit.client.1.smithi155.stdout:1/77: mknod d1/c20 0 2024-04-25T15:57:32.428 INFO:tasks.workunit.client.1.smithi155.stdout:8/36: write d2/fa [543326,56295] 0 2024-04-25T15:57:32.428 INFO:tasks.workunit.client.1.smithi155.stdout:5/91: chown d0/d3/d15/d13/f1c 2 1 2024-04-25T15:57:32.433 INFO:tasks.workunit.client.1.smithi155.stdout:8/37: dread - d2/fc zero size 2024-04-25T15:57:32.434 INFO:tasks.workunit.client.1.smithi155.stdout:2/148: creat d7/f2c x:0 0 0 2024-04-25T15:57:32.436 INFO:tasks.workunit.client.1.smithi155.stdout:3/89: creat d1/f16 x:0 0 0 2024-04-25T15:57:32.436 INFO:tasks.workunit.client.1.smithi155.stdout:5/92: write d0/d3/d15/f17 [558979,123027] 0 2024-04-25T15:57:32.442 INFO:tasks.workunit.client.1.smithi155.stdout:6/84: dwrite d0/f19 [0,4194304] 0 2024-04-25T15:57:32.442 INFO:tasks.workunit.client.1.smithi155.stdout:2/149: truncate d7/f2b 793479 0 2024-04-25T15:57:32.443 INFO:tasks.workunit.client.1.smithi155.stdout:4/91: dwrite da/dc/f13 [0,4194304] 0 2024-04-25T15:57:32.445 INFO:tasks.workunit.client.1.smithi155.stdout:1/78: rename d1/l13 to d1/d6/d1b/l21 0 2024-04-25T15:57:32.448 INFO:tasks.workunit.client.1.smithi155.stdout:4/92: write da/dc/f1d [767862,15500] 0 2024-04-25T15:57:32.451 INFO:tasks.workunit.client.1.smithi155.stdout:4/93: fsync da/dc/ff 0 2024-04-25T15:57:32.453 INFO:tasks.workunit.client.1.smithi155.stdout:1/79: write d1/f12 [3804048,52707] 0 2024-04-25T15:57:32.455 INFO:tasks.workunit.client.1.smithi155.stdout:4/94: chown da/dc/f1d 2063301850 1 2024-04-25T15:57:32.457 INFO:tasks.workunit.client.1.smithi155.stdout:3/90: dread d1/d4/db/fe [0,4194304] 0 2024-04-25T15:57:32.457 INFO:tasks.workunit.client.1.smithi155.stdout:2/150: creat d7/f2d x:0 0 0 2024-04-25T15:57:32.458 INFO:tasks.workunit.client.1.smithi155.stdout:5/93: dread d0/d3/d15/fe [0,4194304] 0 2024-04-25T15:57:32.459 INFO:tasks.workunit.client.1.smithi155.stdout:8/38: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:32.461 INFO:tasks.workunit.client.1.smithi155.stdout:6/85: mkdir d0/d18/d1b 0 2024-04-25T15:57:32.465 INFO:tasks.workunit.client.1.smithi155.stdout:8/39: mkdir d2/dd 0 2024-04-25T15:57:32.465 INFO:tasks.workunit.client.1.smithi155.stdout:6/86: write d0/f19 [2726404,58443] 0 2024-04-25T15:57:32.476 INFO:tasks.workunit.client.1.smithi155.stdout:4/95: dread da/dc/f13 [0,4194304] 0 2024-04-25T15:57:32.490 INFO:tasks.workunit.client.1.smithi155.stdout:1/80: dwrite d1/d6/ff [0,4194304] 0 2024-04-25T15:57:32.493 INFO:tasks.workunit.client.1.smithi155.stdout:3/91: dread d1/d4/d10/f14 [0,4194304] 0 2024-04-25T15:57:32.494 INFO:tasks.workunit.client.1.smithi155.stdout:6/87: rename d0/fa to d0/d1a/f1c 0 2024-04-25T15:57:32.499 INFO:tasks.workunit.client.1.smithi155.stdout:4/96: creat da/f21 x:0 0 0 2024-04-25T15:57:32.500 INFO:tasks.workunit.client.1.smithi155.stdout:2/151: dwrite d7/f2d [0,4194304] 0 2024-04-25T15:57:32.503 INFO:tasks.workunit.client.1.smithi155.stdout:7/42: sync 2024-04-25T15:57:32.504 INFO:tasks.workunit.client.1.smithi155.stdout:5/94: dwrite d0/f12 [0,4194304] 0 2024-04-25T15:57:32.505 INFO:tasks.workunit.client.1.smithi155.stdout:8/40: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:32.506 INFO:tasks.workunit.client.1.smithi155.stdout:7/43: read - d2/dd/fe zero size 2024-04-25T15:57:32.507 INFO:tasks.workunit.client.1.smithi155.stdout:2/152: mkdir d7/db/d2e 0 2024-04-25T15:57:32.508 INFO:tasks.workunit.client.1.smithi155.stdout:2/153: fsync d7/f2b 0 2024-04-25T15:57:32.512 INFO:tasks.workunit.client.1.smithi155.stdout:8/41: unlink c1 0 2024-04-25T15:57:32.518 INFO:tasks.workunit.client.1.smithi155.stdout:2/154: write d7/db/dd/f11 [313119,74440] 0 2024-04-25T15:57:32.521 INFO:tasks.workunit.client.1.smithi155.stdout:1/81: dread d1/f15 [0,4194304] 0 2024-04-25T15:57:32.521 INFO:tasks.workunit.client.1.smithi155.stdout:0/74: sync 2024-04-25T15:57:32.521 INFO:tasks.workunit.client.1.smithi155.stdout:9/72: sync 2024-04-25T15:57:32.522 INFO:tasks.workunit.client.1.smithi155.stdout:3/92: dread d1/d4/db/fe [0,4194304] 0 2024-04-25T15:57:32.522 INFO:tasks.workunit.client.1.smithi155.stdout:2/155: fsync d7/db/dd/f2a 0 2024-04-25T15:57:32.523 INFO:tasks.workunit.client.1.smithi155.stdout:4/97: write da/dc/f1f [833624,19436] 0 2024-04-25T15:57:32.525 INFO:tasks.workunit.client.1.smithi155.stdout:8/42: readlink d2/l6 0 2024-04-25T15:57:32.525 INFO:tasks.workunit.client.1.smithi155.stdout:0/75: stat d1/d1a/f1d 0 2024-04-25T15:57:32.528 INFO:tasks.workunit.client.1.smithi155.stdout:6/88: getdents d0/d18 0 2024-04-25T15:57:32.528 INFO:tasks.workunit.client.1.smithi155.stdout:3/93: creat d1/d4/d10/f17 x:0 0 0 2024-04-25T15:57:32.534 INFO:tasks.workunit.client.1.smithi155.stdout:2/156: creat d7/db/d2e/f2f x:0 0 0 2024-04-25T15:57:32.535 INFO:tasks.workunit.client.1.smithi155.stdout:6/89: symlink d0/d18/l1d 0 2024-04-25T15:57:32.535 INFO:tasks.workunit.client.1.smithi155.stdout:0/76: chown d1/d1a/f1d 486162929 1 2024-04-25T15:57:32.535 INFO:tasks.workunit.client.1.smithi155.stdout:5/95: dwrite d0/d3/d15/f1e [0,4194304] 0 2024-04-25T15:57:32.535 INFO:tasks.workunit.client.1.smithi155.stdout:9/73: truncate dc/ff 770537 0 2024-04-25T15:57:32.536 INFO:tasks.workunit.client.1.smithi155.stdout:3/94: chown d1/d4/d10/f14 204933 1 2024-04-25T15:57:32.538 INFO:tasks.workunit.client.1.smithi155.stdout:7/44: truncate d2/fc 96060 0 2024-04-25T15:57:32.538 INFO:tasks.workunit.client.1.smithi155.stdout:9/74: read f7 [774861,6105] 0 2024-04-25T15:57:32.539 INFO:tasks.workunit.client.1.smithi155.stdout:8/43: rename d2/dd to d2/de 0 2024-04-25T15:57:32.540 INFO:tasks.workunit.client.1.smithi155.stdout:5/96: write d0/f12 [1443077,81388] 0 2024-04-25T15:57:32.540 INFO:tasks.workunit.client.1.smithi155.stdout:2/157: write d7/db/dd/d15/f1d [313031,91573] 0 2024-04-25T15:57:32.542 INFO:tasks.workunit.client.1.smithi155.stdout:3/95: write d1/d4/db/f11 [895723,115107] 0 2024-04-25T15:57:32.542 INFO:tasks.workunit.client.1.smithi155.stdout:1/82: dread d1/f12 [0,4194304] 0 2024-04-25T15:57:32.542 INFO:tasks.workunit.client.1.smithi155.stdout:0/77: mkdir d1/d3/d20 0 2024-04-25T15:57:32.543 INFO:tasks.workunit.client.1.smithi155.stdout:7/45: write d2/f8 [107319,76936] 0 2024-04-25T15:57:32.544 INFO:tasks.workunit.client.1.smithi155.stdout:5/97: write d0/f2 [8137311,122425] 0 2024-04-25T15:57:32.547 INFO:tasks.workunit.client.1.smithi155.stdout:2/158: write d7/f9 [2664829,18700] 0 2024-04-25T15:57:32.547 INFO:tasks.workunit.client.1.smithi155.stdout:1/83: fdatasync d1/d6/ff 0 2024-04-25T15:57:32.548 INFO:tasks.workunit.client.1.smithi155.stdout:0/78: write d1/d1a/f1d [151116,36648] 0 2024-04-25T15:57:32.549 INFO:tasks.workunit.client.1.smithi155.stdout:9/75: rename l1 to dc/d17/d18/l1c 0 2024-04-25T15:57:32.550 INFO:tasks.workunit.client.1.smithi155.stdout:1/84: stat d1/d6/le 0 2024-04-25T15:57:32.555 INFO:tasks.workunit.client.1.smithi155.stdout:3/96: rename d1/d4/f8 to d1/d4/f18 0 2024-04-25T15:57:32.560 INFO:tasks.workunit.client.1.smithi155.stdout:0/79: mknod d1/d1a/c21 0 2024-04-25T15:57:32.560 INFO:tasks.workunit.client.1.smithi155.stdout:0/80: readlink d1/d3/d12/l15 0 2024-04-25T15:57:32.561 INFO:tasks.workunit.client.1.smithi155.stdout:1/85: symlink d1/d6/d1b/l22 0 2024-04-25T15:57:32.563 INFO:tasks.workunit.client.1.smithi155.stdout:9/76: rename cb to dc/d17/d18/c1d 0 2024-04-25T15:57:32.567 INFO:tasks.workunit.client.1.smithi155.stdout:3/97: symlink d1/d4/l19 0 2024-04-25T15:57:32.569 INFO:tasks.workunit.client.1.smithi155.stdout:2/159: creat d7/db/d29/f30 x:0 0 0 2024-04-25T15:57:32.571 INFO:tasks.workunit.client.1.smithi155.stdout:0/81: creat d1/d6/f22 x:0 0 0 2024-04-25T15:57:32.574 INFO:tasks.workunit.client.1.smithi155.stdout:1/86: write d1/fb [1710407,11436] 0 2024-04-25T15:57:32.574 INFO:tasks.workunit.client.1.smithi155.stdout:6/90: truncate d0/f1 858982 0 2024-04-25T15:57:32.574 INFO:tasks.workunit.client.1.smithi155.stdout:3/98: symlink d1/d4/db/l1a 0 2024-04-25T15:57:32.575 INFO:tasks.workunit.client.1.smithi155.stdout:1/87: stat d1/l1a 0 2024-04-25T15:57:32.577 INFO:tasks.workunit.client.1.smithi155.stdout:0/82: creat d1/d3/d5/f23 x:0 0 0 2024-04-25T15:57:32.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/77: symlink dc/l1e 0 2024-04-25T15:57:32.579 INFO:tasks.workunit.client.1.smithi155.stdout:6/91: creat d0/d18/f1e x:0 0 0 2024-04-25T15:57:32.584 INFO:tasks.workunit.client.1.smithi155.stdout:9/78: unlink dc/l1e 0 2024-04-25T15:57:32.587 INFO:tasks.workunit.client.1.smithi155.stdout:6/92: unlink d0/f19 0 2024-04-25T15:57:32.589 INFO:tasks.workunit.client.1.smithi155.stdout:1/88: creat d1/d16/d1d/f23 x:0 0 0 2024-04-25T15:57:32.590 INFO:tasks.workunit.client.1.smithi155.stdout:1/89: chown d1/d6/d1b/l22 390 1 2024-04-25T15:57:32.590 INFO:tasks.workunit.client.1.smithi155.stdout:2/160: creat d7/f31 x:0 0 0 2024-04-25T15:57:32.591 INFO:tasks.workunit.client.1.smithi155.stdout:1/90: write d1/d6/f14 [691645,38996] 0 2024-04-25T15:57:32.592 INFO:tasks.workunit.client.1.smithi155.stdout:1/91: dread - d1/d16/f1f zero size 2024-04-25T15:57:32.596 INFO:tasks.workunit.client.1.smithi155.stdout:2/161: rmdir d7 39 2024-04-25T15:57:32.597 INFO:tasks.workunit.client.1.smithi155.stdout:7/46: write d2/fc [936467,116943] 0 2024-04-25T15:57:32.597 INFO:tasks.workunit.client.1.smithi155.stdout:7/47: dread - d2/dd/fe zero size 2024-04-25T15:57:32.598 INFO:tasks.workunit.client.1.smithi155.stdout:1/92: creat d1/f24 x:0 0 0 2024-04-25T15:57:32.599 INFO:tasks.workunit.client.1.smithi155.stdout:1/93: dread - d1/d16/f1f zero size 2024-04-25T15:57:32.599 INFO:tasks.workunit.client.1.smithi155.stdout:6/93: symlink d0/l1f 0 2024-04-25T15:57:32.600 INFO:tasks.workunit.client.1.smithi155.stdout:3/99: getdents d1/d4 0 2024-04-25T15:57:32.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/94: chown d1/d16/c17 2202 1 2024-04-25T15:57:32.601 INFO:tasks.workunit.client.1.smithi155.stdout:3/100: write d1/d4/db/fe [1667961,129079] 0 2024-04-25T15:57:32.603 INFO:tasks.workunit.client.1.smithi155.stdout:7/48: rename d2/lb to d2/lf 0 2024-04-25T15:57:32.604 INFO:tasks.workunit.client.1.smithi155.stdout:6/94: chown d0/lb 22366350 1 2024-04-25T15:57:32.606 INFO:tasks.workunit.client.1.smithi155.stdout:9/79: link dc/d17/d18/c1d dc/d11/c1f 0 2024-04-25T15:57:32.607 INFO:tasks.workunit.client.1.smithi155.stdout:7/49: rename d2/fc to d2/f10 0 2024-04-25T15:57:32.609 INFO:tasks.workunit.client.1.smithi155.stdout:1/95: link f0 d1/d16/d1d/f25 0 2024-04-25T15:57:32.610 INFO:tasks.workunit.client.1.smithi155.stdout:1/96: fdatasync d1/d16/f1c 0 2024-04-25T15:57:32.612 INFO:tasks.workunit.client.1.smithi155.stdout:2/162: link d7/f31 d7/db/f32 0 2024-04-25T15:57:32.614 INFO:tasks.workunit.client.1.smithi155.stdout:7/50: creat d2/f11 x:0 0 0 2024-04-25T15:57:32.614 INFO:tasks.workunit.client.1.smithi155.stdout:6/95: creat d0/d13/f20 x:0 0 0 2024-04-25T15:57:32.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/101: creat d1/f1b x:0 0 0 2024-04-25T15:57:32.618 INFO:tasks.workunit.client.1.smithi155.stdout:9/80: dwrite dc/d17/f1b [0,4194304] 0 2024-04-25T15:57:32.618 INFO:tasks.workunit.client.1.smithi155.stdout:1/97: mknod d1/d6/d1b/c26 0 2024-04-25T15:57:32.618 INFO:tasks.workunit.client.1.smithi155.stdout:2/163: write f1 [290647,73264] 0 2024-04-25T15:57:32.618 INFO:tasks.workunit.client.1.smithi155.stdout:3/102: dread - d1/d4/d10/f17 zero size 2024-04-25T15:57:32.620 INFO:tasks.workunit.client.1.smithi155.stdout:7/51: mkdir d2/dd/d12 0 2024-04-25T15:57:32.622 INFO:tasks.workunit.client.1.smithi155.stdout:7/52: truncate d2/dd/fe 7246 0 2024-04-25T15:57:32.624 INFO:tasks.workunit.client.1.smithi155.stdout:9/81: creat dc/d17/f20 x:0 0 0 2024-04-25T15:57:32.624 INFO:tasks.workunit.client.1.smithi155.stdout:2/164: creat d7/db/dd/d15/f33 x:0 0 0 2024-04-25T15:57:32.625 INFO:tasks.workunit.client.1.smithi155.stdout:2/165: readlink l4 0 2024-04-25T15:57:32.626 INFO:tasks.workunit.client.1.smithi155.stdout:7/53: mkdir d2/dd/d13 0 2024-04-25T15:57:32.631 INFO:tasks.workunit.client.1.smithi155.stdout:2/166: creat d7/d23/f34 x:0 0 0 2024-04-25T15:57:32.636 INFO:tasks.workunit.client.1.smithi155.stdout:6/96: dwrite d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:32.636 INFO:tasks.workunit.client.1.smithi155.stdout:3/103: dwrite d1/d4/db/fe [0,4194304] 0 2024-04-25T15:57:32.636 INFO:tasks.workunit.client.1.smithi155.stdout:2/167: unlink l4 0 2024-04-25T15:57:32.640 INFO:tasks.workunit.client.1.smithi155.stdout:9/82: write dc/fe [717671,49201] 0 2024-04-25T15:57:32.641 INFO:tasks.workunit.client.1.smithi155.stdout:2/168: creat d7/d23/f35 x:0 0 0 2024-04-25T15:57:32.644 INFO:tasks.workunit.client.1.smithi155.stdout:7/54: dwrite d2/f10 [0,4194304] 0 2024-04-25T15:57:32.648 INFO:tasks.workunit.client.1.smithi155.stdout:7/55: truncate d2/f11 80777 0 2024-04-25T15:57:32.654 INFO:tasks.workunit.client.1.smithi155.stdout:7/56: mknod d2/dd/c14 0 2024-04-25T15:57:32.657 INFO:tasks.workunit.client.1.smithi155.stdout:9/83: link dc/d17/d18/c1d dc/d17/d18/c21 0 2024-04-25T15:57:32.660 INFO:tasks.workunit.client.1.smithi155.stdout:7/57: creat d2/f15 x:0 0 0 2024-04-25T15:57:32.663 INFO:tasks.workunit.client.1.smithi155.stdout:3/104: dwrite d1/d4/d10/f14 [0,4194304] 0 2024-04-25T15:57:32.665 INFO:tasks.workunit.client.1.smithi155.stdout:6/97: dwrite d0/f9 [0,4194304] 0 2024-04-25T15:57:32.666 INFO:tasks.workunit.client.1.smithi155.stdout:2/169: dwrite d7/db/d29/f30 [0,4194304] 0 2024-04-25T15:57:32.666 INFO:tasks.workunit.client.1.smithi155.stdout:7/58: truncate d2/dd/fe 920426 0 2024-04-25T15:57:32.674 INFO:tasks.workunit.client.1.smithi155.stdout:3/105: write d1/d4/db/fe [748465,20739] 0 2024-04-25T15:57:32.674 INFO:tasks.workunit.client.1.smithi155.stdout:6/98: mkdir d0/d1a/d21 0 2024-04-25T15:57:32.675 INFO:tasks.workunit.client.1.smithi155.stdout:2/170: symlink d7/l36 0 2024-04-25T15:57:32.678 INFO:tasks.workunit.client.1.smithi155.stdout:3/106: truncate d1/f1b 37077 0 2024-04-25T15:57:32.678 INFO:tasks.workunit.client.1.smithi155.stdout:6/99: chown d0/ld 23 1 2024-04-25T15:57:32.680 INFO:tasks.workunit.client.1.smithi155.stdout:7/59: link d2/f6 d2/dd/f16 0 2024-04-25T15:57:32.682 INFO:tasks.workunit.client.1.smithi155.stdout:9/84: dwrite dc/fe [0,4194304] 0 2024-04-25T15:57:32.682 INFO:tasks.workunit.client.1.smithi155.stdout:2/171: rename d7/f9 to d7/db/dd/d15/f37 0 2024-04-25T15:57:32.685 INFO:tasks.workunit.client.1.smithi155.stdout:7/60: mkdir d2/d17 0 2024-04-25T15:57:32.686 INFO:tasks.workunit.client.1.smithi155.stdout:7/61: readlink d2/l4 0 2024-04-25T15:57:32.687 INFO:tasks.workunit.client.1.smithi155.stdout:3/107: rename d1/f1b to d1/d4/db/f1c 0 2024-04-25T15:57:32.687 INFO:tasks.workunit.client.1.smithi155.stdout:3/108: read - d1/d4/d10/f17 zero size 2024-04-25T15:57:32.688 INFO:tasks.workunit.client.1.smithi155.stdout:2/172: creat d7/db/dd/f38 x:0 0 0 2024-04-25T15:57:32.690 INFO:tasks.workunit.client.1.smithi155.stdout:2/173: write d7/d23/f34 [273780,11758] 0 2024-04-25T15:57:32.697 INFO:tasks.workunit.client.1.smithi155.stdout:3/109: dwrite d1/f16 [0,4194304] 0 2024-04-25T15:57:32.700 INFO:tasks.workunit.client.1.smithi155.stdout:2/174: mknod d7/db/d2e/c39 0 2024-04-25T15:57:32.700 INFO:tasks.workunit.client.1.smithi155.stdout:7/62: mknod d2/dd/d12/c18 0 2024-04-25T15:57:32.701 INFO:tasks.workunit.client.1.smithi155.stdout:2/175: write d7/f2b [49868,78773] 0 2024-04-25T15:57:32.701 INFO:tasks.workunit.client.1.smithi155.stdout:9/85: truncate dc/fe 2259401 0 2024-04-25T15:57:32.703 INFO:tasks.workunit.client.1.smithi155.stdout:6/100: getdents d0/d13 0 2024-04-25T15:57:32.706 INFO:tasks.workunit.client.1.smithi155.stdout:9/86: stat dc/d17/d18/c1d 0 2024-04-25T15:57:32.706 INFO:tasks.workunit.client.1.smithi155.stdout:7/63: symlink d2/dd/d12/l19 0 2024-04-25T15:57:32.706 INFO:tasks.workunit.client.1.smithi155.stdout:7/64: chown d2/d17 99036 1 2024-04-25T15:57:32.709 INFO:tasks.workunit.client.1.smithi155.stdout:9/87: write dc/fe [1995766,61475] 0 2024-04-25T15:57:32.711 INFO:tasks.workunit.client.1.smithi155.stdout:7/65: write d2/f6 [2230982,78365] 0 2024-04-25T15:57:32.714 INFO:tasks.workunit.client.1.smithi155.stdout:9/88: symlink dc/d17/l22 0 2024-04-25T15:57:32.717 INFO:tasks.workunit.client.1.smithi155.stdout:2/176: dwrite d7/db/d2e/f2f [0,4194304] 0 2024-04-25T15:57:32.717 INFO:tasks.workunit.client.1.smithi155.stdout:7/66: symlink d2/dd/d13/l1a 0 2024-04-25T15:57:32.719 INFO:tasks.workunit.client.1.smithi155.stdout:6/101: dwrite d0/ff [0,4194304] 0 2024-04-25T15:57:32.721 INFO:tasks.workunit.client.1.smithi155.stdout:9/89: rename dc/d17/f19 to dc/d17/d18/f23 0 2024-04-25T15:57:32.726 INFO:tasks.workunit.client.1.smithi155.stdout:7/67: rename d2/dd/fe to d2/f1b 0 2024-04-25T15:57:32.727 INFO:tasks.workunit.client.1.smithi155.stdout:2/177: write d7/db/f32 [500680,80722] 0 2024-04-25T15:57:32.730 INFO:tasks.workunit.client.1.smithi155.stdout:2/178: write d7/db/d29/f30 [108097,39745] 0 2024-04-25T15:57:32.731 INFO:tasks.workunit.client.1.smithi155.stdout:7/68: mkdir d2/dd/d13/d1c 0 2024-04-25T15:57:32.733 INFO:tasks.workunit.client.1.smithi155.stdout:2/179: fdatasync d7/db/dd/d15/f28 0 2024-04-25T15:57:32.733 INFO:tasks.workunit.client.1.smithi155.stdout:7/69: write d2/f6 [2842400,40830] 0 2024-04-25T15:57:32.734 INFO:tasks.workunit.client.1.smithi155.stdout:6/102: rename d0/f7 to d0/f22 0 2024-04-25T15:57:32.734 INFO:tasks.workunit.client.1.smithi155.stdout:9/90: dwrite f5 [0,4194304] 0 2024-04-25T15:57:32.735 INFO:tasks.workunit.client.1.smithi155.stdout:2/180: readlink d7/db/dd/l10 0 2024-04-25T15:57:32.736 INFO:tasks.workunit.client.1.smithi155.stdout:9/91: read - dc/f14 zero size 2024-04-25T15:57:32.737 INFO:tasks.workunit.client.1.smithi155.stdout:7/70: dread d2/f11 [0,4194304] 0 2024-04-25T15:57:32.740 INFO:tasks.workunit.client.1.smithi155.stdout:6/103: creat d0/d18/f23 x:0 0 0 2024-04-25T15:57:32.741 INFO:tasks.workunit.client.1.smithi155.stdout:9/92: mknod dc/d17/c24 0 2024-04-25T15:57:32.741 INFO:tasks.workunit.client.1.smithi155.stdout:6/104: chown d0/l1f 15673 1 2024-04-25T15:57:32.742 INFO:tasks.workunit.client.1.smithi155.stdout:9/93: fsync dc/d17/f20 0 2024-04-25T15:57:32.743 INFO:tasks.workunit.client.1.smithi155.stdout:7/71: rename d2/f6 to d2/f1d 0 2024-04-25T15:57:32.746 INFO:tasks.workunit.client.1.smithi155.stdout:9/94: mknod dc/d17/d18/c25 0 2024-04-25T15:57:32.748 INFO:tasks.workunit.client.1.smithi155.stdout:7/72: dread d2/f1b [0,4194304] 0 2024-04-25T15:57:32.749 INFO:tasks.workunit.client.1.smithi155.stdout:9/95: dread - dc/f14 zero size 2024-04-25T15:57:32.749 INFO:tasks.workunit.client.1.smithi155.stdout:2/181: dwrite d7/db/dd/d15/f1a [0,4194304] 0 2024-04-25T15:57:32.750 INFO:tasks.workunit.client.1.smithi155.stdout:2/182: chown d7/db/d2e/c39 723 1 2024-04-25T15:57:32.751 INFO:tasks.workunit.client.1.smithi155.stdout:7/73: stat d2/lf 0 2024-04-25T15:57:32.755 INFO:tasks.workunit.client.1.smithi155.stdout:6/105: dwrite d0/f3 [0,4194304] 0 2024-04-25T15:57:32.755 INFO:tasks.workunit.client.1.smithi155.stdout:6/106: chown d0/ff 354 1 2024-04-25T15:57:32.757 INFO:tasks.workunit.client.1.smithi155.stdout:2/183: dread d7/f2b [0,4194304] 0 2024-04-25T15:57:32.758 INFO:tasks.workunit.client.1.smithi155.stdout:6/107: mknod d0/d13/c24 0 2024-04-25T15:57:32.759 INFO:tasks.workunit.client.1.smithi155.stdout:6/108: chown d0/d18/f23 104211 1 2024-04-25T15:57:32.759 INFO:tasks.workunit.client.1.smithi155.stdout:2/184: rmdir d7/db/dd 39 2024-04-25T15:57:32.762 INFO:tasks.workunit.client.1.smithi155.stdout:2/185: creat d7/db/d29/f3a x:0 0 0 2024-04-25T15:57:32.763 INFO:tasks.workunit.client.1.smithi155.stdout:2/186: write d7/db/f32 [1292056,55787] 0 2024-04-25T15:57:32.764 INFO:tasks.workunit.client.1.smithi155.stdout:7/74: fsync d2/f1d 0 2024-04-25T15:57:32.765 INFO:tasks.workunit.client.1.smithi155.stdout:7/75: write d2/fa [140605,39376] 0 2024-04-25T15:57:32.767 INFO:tasks.workunit.client.1.smithi155.stdout:2/187: dread - d7/db/dd/d15/f1b zero size 2024-04-25T15:57:32.768 INFO:tasks.workunit.client.1.smithi155.stdout:7/76: write d2/dd/f16 [4725586,17174] 0 2024-04-25T15:57:32.769 INFO:tasks.workunit.client.1.smithi155.stdout:2/188: read d7/db/dd/f11 [5669332,57552] 0 2024-04-25T15:57:32.771 INFO:tasks.workunit.client.1.smithi155.stdout:7/77: truncate d2/f1b 1029337 0 2024-04-25T15:57:32.772 INFO:tasks.workunit.client.1.smithi155.stdout:4/98: sync 2024-04-25T15:57:32.773 INFO:tasks.workunit.client.1.smithi155.stdout:6/109: dwrite d0/f15 [0,4194304] 0 2024-04-25T15:57:32.773 INFO:tasks.workunit.client.1.smithi155.stdout:4/99: fdatasync da/f16 0 2024-04-25T15:57:32.774 INFO:tasks.workunit.client.1.smithi155.stdout:4/100: stat da/dc/fd 0 2024-04-25T15:57:32.777 INFO:tasks.workunit.client.1.smithi155.stdout:7/78: creat d2/dd/d13/d1c/f1e x:0 0 0 2024-04-25T15:57:32.778 INFO:tasks.workunit.client.1.smithi155.stdout:7/79: write d2/f15 [245889,102562] 0 2024-04-25T15:57:32.779 INFO:tasks.workunit.client.1.smithi155.stdout:2/189: getdents d7/db/d29 0 2024-04-25T15:57:32.780 INFO:tasks.workunit.client.1.smithi155.stdout:6/110: dread d0/f1 [0,4194304] 0 2024-04-25T15:57:32.780 INFO:tasks.workunit.client.1.smithi155.stdout:7/80: chown d2/f10 13797722 1 2024-04-25T15:57:32.780 INFO:tasks.workunit.client.1.smithi155.stdout:7/81: readlink d2/l4 0 2024-04-25T15:57:32.782 INFO:tasks.workunit.client.1.smithi155.stdout:7/82: read d2/f8 [108773,58461] 0 2024-04-25T15:57:32.782 INFO:tasks.workunit.client.1.smithi155.stdout:4/101: link da/l15 da/dc/l22 0 2024-04-25T15:57:32.782 INFO:tasks.workunit.client.1.smithi155.stdout:2/190: write d7/f2b [326881,8867] 0 2024-04-25T15:57:32.783 INFO:tasks.workunit.client.1.smithi155.stdout:4/102: dread - da/dc/f1b zero size 2024-04-25T15:57:32.783 INFO:tasks.workunit.client.1.smithi155.stdout:6/111: mkdir d0/d1a/d25 0 2024-04-25T15:57:32.784 INFO:tasks.workunit.client.1.smithi155.stdout:7/83: creat d2/f1f x:0 0 0 2024-04-25T15:57:32.785 INFO:tasks.workunit.client.1.smithi155.stdout:7/84: truncate d2/f1f 26780 0 2024-04-25T15:57:32.786 INFO:tasks.workunit.client.1.smithi155.stdout:6/112: chown d0/c5 0 1 2024-04-25T15:57:32.787 INFO:tasks.workunit.client.1.smithi155.stdout:2/191: dread d7/db/dd/d15/f1d [0,4194304] 0 2024-04-25T15:57:32.789 INFO:tasks.workunit.client.1.smithi155.stdout:6/113: truncate d0/d1a/f1c 297409 0 2024-04-25T15:57:32.791 INFO:tasks.workunit.client.1.smithi155.stdout:7/85: link d2/dd/d13/d1c/f1e d2/dd/d12/f20 0 2024-04-25T15:57:32.792 INFO:tasks.workunit.client.1.smithi155.stdout:4/103: dwrite da/f14 [0,4194304] 0 2024-04-25T15:57:32.792 INFO:tasks.workunit.client.1.smithi155.stdout:4/104: dread - da/dc/f1b zero size 2024-04-25T15:57:32.794 INFO:tasks.workunit.client.1.smithi155.stdout:2/192: unlink d7/db/dd/f26 0 2024-04-25T15:57:32.794 INFO:tasks.workunit.client.1.smithi155.stdout:6/114: symlink d0/d13/l26 0 2024-04-25T15:57:32.797 INFO:tasks.workunit.client.1.smithi155.stdout:2/193: rmdir d7/d23 39 2024-04-25T15:57:32.800 INFO:tasks.workunit.client.1.smithi155.stdout:4/105: dread da/f19 [0,4194304] 0 2024-04-25T15:57:32.802 INFO:tasks.workunit.client.1.smithi155.stdout:2/194: rename f2 to d7/f3b 0 2024-04-25T15:57:32.805 INFO:tasks.workunit.client.1.smithi155.stdout:4/106: truncate da/dc/f1b 734600 0 2024-04-25T15:57:32.808 INFO:tasks.workunit.client.1.smithi155.stdout:6/115: dwrite d0/d13/f20 [0,4194304] 0 2024-04-25T15:57:32.809 INFO:tasks.workunit.client.1.smithi155.stdout:4/107: mkdir da/d23 0 2024-04-25T15:57:32.810 INFO:tasks.workunit.client.1.smithi155.stdout:7/86: dwrite d2/f1b [0,4194304] 0 2024-04-25T15:57:32.813 INFO:tasks.workunit.client.1.smithi155.stdout:6/116: creat d0/d13/f27 x:0 0 0 2024-04-25T15:57:32.814 INFO:tasks.workunit.client.1.smithi155.stdout:7/87: creat d2/dd/d13/f21 x:0 0 0 2024-04-25T15:57:32.818 INFO:tasks.workunit.client.1.smithi155.stdout:2/195: dwrite d7/db/dd/d15/f33 [0,4194304] 0 2024-04-25T15:57:32.819 INFO:tasks.workunit.client.1.smithi155.stdout:2/196: dread - d7/db/d29/f3a zero size 2024-04-25T15:57:32.819 INFO:tasks.workunit.client.1.smithi155.stdout:7/88: creat d2/dd/d13/d1c/f22 x:0 0 0 2024-04-25T15:57:32.821 INFO:tasks.workunit.client.1.smithi155.stdout:2/197: dread - d7/db/d29/f3a zero size 2024-04-25T15:57:32.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/117: unlink d0/le 0 2024-04-25T15:57:32.824 INFO:tasks.workunit.client.1.smithi155.stdout:7/89: creat d2/dd/f23 x:0 0 0 2024-04-25T15:57:32.824 INFO:tasks.workunit.client.1.smithi155.stdout:4/108: write da/f11 [1212938,179] 0 2024-04-25T15:57:32.825 INFO:tasks.workunit.client.1.smithi155.stdout:2/198: rmdir d7/db/dd/d15 39 2024-04-25T15:57:32.829 INFO:tasks.workunit.client.1.smithi155.stdout:6/118: dread d0/d1a/f1c [0,4194304] 0 2024-04-25T15:57:32.830 INFO:tasks.workunit.client.1.smithi155.stdout:2/199: creat d7/db/d29/f3c x:0 0 0 2024-04-25T15:57:32.831 INFO:tasks.workunit.client.1.smithi155.stdout:6/119: write d0/d13/f17 [35839,48176] 0 2024-04-25T15:57:32.832 INFO:tasks.workunit.client.1.smithi155.stdout:4/109: rename da/dc/d18/c20 to da/c24 0 2024-04-25T15:57:32.834 INFO:tasks.workunit.client.1.smithi155.stdout:2/200: symlink d7/l3d 0 2024-04-25T15:57:32.836 INFO:tasks.workunit.client.1.smithi155.stdout:4/110: creat da/dc/f25 x:0 0 0 2024-04-25T15:57:32.836 INFO:tasks.workunit.client.1.smithi155.stdout:7/90: dwrite d2/f15 [0,4194304] 0 2024-04-25T15:57:32.839 INFO:tasks.workunit.client.1.smithi155.stdout:6/120: mknod d0/d1a/d21/c28 0 2024-04-25T15:57:32.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/201: dwrite d7/f2d [0,4194304] 0 2024-04-25T15:57:32.849 INFO:tasks.workunit.client.1.smithi155.stdout:2/202: creat d7/db/d29/f3e x:0 0 0 2024-04-25T15:57:32.852 INFO:tasks.workunit.client.1.smithi155.stdout:2/203: readlink d7/db/dd/l1f 0 2024-04-25T15:57:32.853 INFO:tasks.workunit.client.1.smithi155.stdout:7/91: truncate d2/dd/f16 3231473 0 2024-04-25T15:57:32.854 INFO:tasks.workunit.client.1.smithi155.stdout:7/92: mkdir d2/dd/d13/d24 0 2024-04-25T15:57:32.855 INFO:tasks.workunit.client.1.smithi155.stdout:2/204: mknod d7/c3f 0 2024-04-25T15:57:32.857 INFO:tasks.workunit.client.1.smithi155.stdout:7/93: rmdir d2/d17 0 2024-04-25T15:57:32.858 INFO:tasks.workunit.client.1.smithi155.stdout:7/94: readlink d2/dd/d13/l1a 0 2024-04-25T15:57:32.858 INFO:tasks.workunit.client.1.smithi155.stdout:8/44: sync 2024-04-25T15:57:32.858 INFO:tasks.workunit.client.1.smithi155.stdout:5/98: sync 2024-04-25T15:57:32.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/99: dread d0/d3/d15/f17 [0,4194304] 0 2024-04-25T15:57:32.866 INFO:tasks.workunit.client.1.smithi155.stdout:2/205: dwrite d7/d23/f34 [0,4194304] 0 2024-04-25T15:57:32.868 INFO:tasks.workunit.client.1.smithi155.stdout:8/45: rename d2/l4 to d2/d5/lf 0 2024-04-25T15:57:32.869 INFO:tasks.workunit.client.1.smithi155.stdout:5/100: mkdir d0/d3/d15/d1f 0 2024-04-25T15:57:32.870 INFO:tasks.workunit.client.1.smithi155.stdout:2/206: creat d7/d23/f40 x:0 0 0 2024-04-25T15:57:32.872 INFO:tasks.workunit.client.1.smithi155.stdout:8/46: mknod d2/d5/c10 0 2024-04-25T15:57:32.873 INFO:tasks.workunit.client.1.smithi155.stdout:5/101: fdatasync d0/d3/d15/f17 0 2024-04-25T15:57:32.874 INFO:tasks.workunit.client.1.smithi155.stdout:8/47: chown d2/d5/c10 28493595 1 2024-04-25T15:57:32.875 INFO:tasks.workunit.client.1.smithi155.stdout:5/102: read - d0/d3/d15/d13/f1a zero size 2024-04-25T15:57:32.876 INFO:tasks.workunit.client.1.smithi155.stdout:7/95: dwrite d2/f8 [0,4194304] 0 2024-04-25T15:57:32.876 INFO:tasks.workunit.client.1.smithi155.stdout:8/48: fdatasync d2/fa 0 2024-04-25T15:57:32.880 INFO:tasks.workunit.client.1.smithi155.stdout:8/49: chown d2/c3 2678 1 2024-04-25T15:57:32.881 INFO:tasks.workunit.client.1.smithi155.stdout:2/207: dread d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:32.881 INFO:tasks.workunit.client.1.smithi155.stdout:7/96: rename d2/dd/d13/l1a to d2/dd/d13/d1c/l25 0 2024-04-25T15:57:32.882 INFO:tasks.workunit.client.1.smithi155.stdout:5/103: truncate d0/d3/d15/f17 61545 0 2024-04-25T15:57:32.884 INFO:tasks.workunit.client.1.smithi155.stdout:5/104: chown d0/d3/d15/ld 15057061 1 2024-04-25T15:57:32.884 INFO:tasks.workunit.client.1.smithi155.stdout:5/105: readlink d0/l10 0 2024-04-25T15:57:32.884 INFO:tasks.workunit.client.1.smithi155.stdout:2/208: rename d7/db/dd/c14 to d7/db/d2e/c41 0 2024-04-25T15:57:32.886 INFO:tasks.workunit.client.1.smithi155.stdout:2/209: stat d7/db/d2e/c39 0 2024-04-25T15:57:32.886 INFO:tasks.workunit.client.1.smithi155.stdout:5/106: mkdir d0/d3/d20 0 2024-04-25T15:57:32.888 INFO:tasks.workunit.client.1.smithi155.stdout:8/50: creat d2/f11 x:0 0 0 2024-04-25T15:57:32.889 INFO:tasks.workunit.client.1.smithi155.stdout:2/210: write d7/db/f32 [2011641,93012] 0 2024-04-25T15:57:32.889 INFO:tasks.workunit.client.1.smithi155.stdout:8/51: fdatasync d2/fa 0 2024-04-25T15:57:32.891 INFO:tasks.workunit.client.1.smithi155.stdout:5/107: symlink d0/d3/d15/l21 0 2024-04-25T15:57:32.893 INFO:tasks.workunit.client.1.smithi155.stdout:7/97: dwrite d2/dd/d13/f21 [0,4194304] 0 2024-04-25T15:57:32.894 INFO:tasks.workunit.client.1.smithi155.stdout:2/211: creat d7/db/dd/d15/f42 x:0 0 0 2024-04-25T15:57:32.894 INFO:tasks.workunit.client.1.smithi155.stdout:7/98: dread - d2/dd/d13/d1c/f22 zero size 2024-04-25T15:57:32.896 INFO:tasks.workunit.client.1.smithi155.stdout:5/108: getdents d0/d3/d15/d1f 0 2024-04-25T15:57:32.898 INFO:tasks.workunit.client.1.smithi155.stdout:8/52: dread d2/fa [0,4194304] 0 2024-04-25T15:57:32.902 INFO:tasks.workunit.client.1.smithi155.stdout:5/109: link d0/d3/cc d0/d3/c22 0 2024-04-25T15:57:32.904 INFO:tasks.workunit.client.1.smithi155.stdout:5/110: fsync d0/d3/d15/f16 0 2024-04-25T15:57:32.906 INFO:tasks.workunit.client.1.smithi155.stdout:2/212: dread d7/f2d [0,4194304] 0 2024-04-25T15:57:32.906 INFO:tasks.workunit.client.1.smithi155.stdout:7/99: dwrite d2/f1b [0,4194304] 0 2024-04-25T15:57:32.907 INFO:tasks.workunit.client.1.smithi155.stdout:8/53: dread d2/fc [0,4194304] 0 2024-04-25T15:57:32.910 INFO:tasks.workunit.client.1.smithi155.stdout:8/54: dread - d2/f11 zero size 2024-04-25T15:57:32.910 INFO:tasks.workunit.client.1.smithi155.stdout:7/100: truncate d2/f1b 4834674 0 2024-04-25T15:57:32.910 INFO:tasks.workunit.client.1.smithi155.stdout:2/213: symlink d7/l43 0 2024-04-25T15:57:32.910 INFO:tasks.workunit.client.1.smithi155.stdout:2/214: fsync f1 0 2024-04-25T15:57:32.911 INFO:tasks.workunit.client.1.smithi155.stdout:2/215: chown d7/db/dd/c24 20629 1 2024-04-25T15:57:32.912 INFO:tasks.workunit.client.1.smithi155.stdout:2/216: readlink d7/db/dd/l1f 0 2024-04-25T15:57:32.913 INFO:tasks.workunit.client.1.smithi155.stdout:2/217: write d7/db/dd/f38 [889779,91439] 0 2024-04-25T15:57:32.914 INFO:tasks.workunit.client.1.smithi155.stdout:5/111: link d0/l5 d0/d3/d15/d13/l23 0 2024-04-25T15:57:32.915 INFO:tasks.workunit.client.1.smithi155.stdout:5/112: write d0/d3/d15/f16 [115303,110128] 0 2024-04-25T15:57:32.916 INFO:tasks.workunit.client.1.smithi155.stdout:2/218: mkdir d7/db/d2e/d44 0 2024-04-25T15:57:32.916 INFO:tasks.workunit.client.1.smithi155.stdout:2/219: chown d7/db/l12 207 1 2024-04-25T15:57:32.917 INFO:tasks.workunit.client.1.smithi155.stdout:8/55: creat d2/f12 x:0 0 0 2024-04-25T15:57:32.918 INFO:tasks.workunit.client.1.smithi155.stdout:5/113: read d0/d3/d15/f17 [52498,33235] 0 2024-04-25T15:57:32.919 INFO:tasks.workunit.client.1.smithi155.stdout:2/220: chown d7/l1c 915967554 1 2024-04-25T15:57:32.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/101: getdents d2 0 2024-04-25T15:57:32.921 INFO:tasks.workunit.client.1.smithi155.stdout:2/221: dread d7/d23/f21 [0,4194304] 0 2024-04-25T15:57:32.924 INFO:tasks.workunit.client.1.smithi155.stdout:2/222: truncate d7/d23/f40 863455 0 2024-04-25T15:57:32.926 INFO:tasks.workunit.client.1.smithi155.stdout:8/56: dwrite d2/f12 [0,4194304] 0 2024-04-25T15:57:32.927 INFO:tasks.workunit.client.1.smithi155.stdout:2/223: write d7/db/d2e/f2f [2775335,43625] 0 2024-04-25T15:57:32.931 INFO:tasks.workunit.client.1.smithi155.stdout:7/102: write d2/f1d [2672364,52684] 0 2024-04-25T15:57:32.933 INFO:tasks.workunit.client.1.smithi155.stdout:8/57: rmdir d2/de 0 2024-04-25T15:57:32.933 INFO:tasks.workunit.client.1.smithi155.stdout:5/114: dread d0/f8 [0,4194304] 0 2024-04-25T15:57:32.934 INFO:tasks.workunit.client.1.smithi155.stdout:8/58: chown d2/fc 267943 1 2024-04-25T15:57:32.936 INFO:tasks.workunit.client.1.smithi155.stdout:5/115: dread d0/f8 [0,4194304] 0 2024-04-25T15:57:32.939 INFO:tasks.workunit.client.1.smithi155.stdout:2/224: dwrite d7/db/dd/d15/f1b [0,4194304] 0 2024-04-25T15:57:32.940 INFO:tasks.workunit.client.1.smithi155.stdout:2/225: chown d7/db/d2e 804562 1 2024-04-25T15:57:32.941 INFO:tasks.workunit.client.1.smithi155.stdout:5/116: rename d0/d3/d15/l18 to d0/d3/l24 0 2024-04-25T15:57:32.942 INFO:tasks.workunit.client.1.smithi155.stdout:8/59: truncate d2/f12 3877584 0 2024-04-25T15:57:32.945 INFO:tasks.workunit.client.1.smithi155.stdout:8/60: dread d2/fa [0,4194304] 0 2024-04-25T15:57:32.946 INFO:tasks.workunit.client.1.smithi155.stdout:8/61: rmdir d2/d5 39 2024-04-25T15:57:32.947 INFO:tasks.workunit.client.1.smithi155.stdout:5/117: truncate d0/d3/d15/d13/f19 2445397 0 2024-04-25T15:57:32.947 INFO:tasks.workunit.client.1.smithi155.stdout:8/62: dread - d2/f11 zero size 2024-04-25T15:57:32.949 INFO:tasks.workunit.client.1.smithi155.stdout:5/118: symlink d0/d3/d15/l25 0 2024-04-25T15:57:32.951 INFO:tasks.workunit.client.1.smithi155.stdout:5/119: unlink d0/f8 0 2024-04-25T15:57:32.953 INFO:tasks.workunit.client.1.smithi155.stdout:5/120: chown d0/d3/d15/l6 117 1 2024-04-25T15:57:32.955 INFO:tasks.workunit.client.1.smithi155.stdout:2/226: fsync d7/db/dd/d15/f1b 0 2024-04-25T15:57:32.957 INFO:tasks.workunit.client.1.smithi155.stdout:5/121: rmdir d0/d3/d20 0 2024-04-25T15:57:32.957 INFO:tasks.workunit.client.1.smithi155.stdout:8/63: dwrite d2/f12 [0,4194304] 0 2024-04-25T15:57:32.959 INFO:tasks.workunit.client.1.smithi155.stdout:2/227: unlink d7/c8 0 2024-04-25T15:57:32.962 INFO:tasks.workunit.client.1.smithi155.stdout:2/228: write d7/f2b [524358,102495] 0 2024-04-25T15:57:32.965 INFO:tasks.workunit.client.1.smithi155.stdout:8/64: rename d2/l9 to d2/l13 0 2024-04-25T15:57:32.968 INFO:tasks.workunit.client.1.smithi155.stdout:5/122: dwrite d0/f2 [0,4194304] 0 2024-04-25T15:57:32.969 INFO:tasks.workunit.client.1.smithi155.stdout:8/65: creat d2/f14 x:0 0 0 2024-04-25T15:57:32.969 INFO:tasks.workunit.client.1.smithi155.stdout:5/123: chown d0/d3/d15/d1f 79 1 2024-04-25T15:57:32.973 INFO:tasks.workunit.client.1.smithi155.stdout:2/229: dwrite d7/d23/f20 [0,4194304] 0 2024-04-25T15:57:32.975 INFO:tasks.workunit.client.1.smithi155.stdout:2/230: write d7/db/d29/f3a [707922,45923] 0 2024-04-25T15:57:32.980 INFO:tasks.workunit.client.1.smithi155.stdout:5/124: dwrite d0/f12 [0,4194304] 0 2024-04-25T15:57:32.980 INFO:tasks.workunit.client.1.smithi155.stdout:2/231: link d7/d23/f20 d7/db/dd/d15/f45 0 2024-04-25T15:57:32.985 INFO:tasks.workunit.client.1.smithi155.stdout:2/232: symlink d7/db/d29/l46 0 2024-04-25T15:57:32.986 INFO:tasks.workunit.client.1.smithi155.stdout:2/233: write d7/db/dd/d15/f1a [160622,96651] 0 2024-04-25T15:57:32.988 INFO:tasks.workunit.client.1.smithi155.stdout:5/125: link d0/d3/d15/l25 d0/d3/l26 0 2024-04-25T15:57:32.989 INFO:tasks.workunit.client.1.smithi155.stdout:2/234: creat d7/db/d2e/f47 x:0 0 0 2024-04-25T15:57:32.998 INFO:tasks.workunit.client.1.smithi155.stdout:2/235: dread d7/db/dd/d15/f1a [0,4194304] 0 2024-04-25T15:57:32.998 INFO:tasks.workunit.client.1.smithi155.stdout:5/126: dwrite d0/d3/d15/d13/f1c [0,4194304] 0 2024-04-25T15:57:33.000 INFO:tasks.workunit.client.1.smithi155.stdout:2/236: chown d7/l1c 2128853262 1 2024-04-25T15:57:33.000 INFO:tasks.workunit.client.1.smithi155.stdout:2/237: fdatasync f3 0 2024-04-25T15:57:33.013 INFO:tasks.workunit.client.1.smithi155.stdout:5/127: unlink d0/d3/d15/l6 0 2024-04-25T15:57:33.015 INFO:tasks.workunit.client.1.smithi155.stdout:5/128: mkdir d0/d27 0 2024-04-25T15:57:33.016 INFO:tasks.workunit.client.1.smithi155.stdout:0/83: sync 2024-04-25T15:57:33.019 INFO:tasks.workunit.client.1.smithi155.stdout:2/238: rename d7/db/f32 to d7/db/dd/f48 0 2024-04-25T15:57:33.025 INFO:tasks.workunit.client.1.smithi155.stdout:2/239: dread d7/db/dd/d15/f33 [0,4194304] 0 2024-04-25T15:57:33.026 INFO:tasks.workunit.client.1.smithi155.stdout:5/129: symlink d0/d3/d15/d1f/l28 0 2024-04-25T15:57:33.028 INFO:tasks.workunit.client.1.smithi155.stdout:2/240: write d7/db/d29/f30 [2670780,20135] 0 2024-04-25T15:57:33.029 INFO:tasks.workunit.client.1.smithi155.stdout:2/241: read d7/f31 [1412325,93439] 0 2024-04-25T15:57:33.030 INFO:tasks.workunit.client.1.smithi155.stdout:0/84: dread d1/d3/fd [0,4194304] 0 2024-04-25T15:57:33.033 INFO:tasks.workunit.client.1.smithi155.stdout:5/130: creat d0/d3/d15/d13/f29 x:0 0 0 2024-04-25T15:57:33.034 INFO:tasks.workunit.client.1.smithi155.stdout:2/242: rmdir d7/db/d29 39 2024-04-25T15:57:33.037 INFO:tasks.workunit.client.1.smithi155.stdout:5/131: creat d0/d3/d15/d13/f2a x:0 0 0 2024-04-25T15:57:33.038 INFO:tasks.workunit.client.1.smithi155.stdout:2/243: rmdir d7 39 2024-04-25T15:57:33.039 INFO:tasks.workunit.client.1.smithi155.stdout:0/85: creat d1/d3/d20/f24 x:0 0 0 2024-04-25T15:57:33.040 INFO:tasks.workunit.client.1.smithi155.stdout:5/132: symlink d0/d3/d15/d13/l2b 0 2024-04-25T15:57:33.050 INFO:tasks.workunit.client.1.smithi155.stdout:2/244: dwrite d7/db/dd/d15/f1d [0,4194304] 0 2024-04-25T15:57:33.054 INFO:tasks.workunit.client.1.smithi155.stdout:2/245: creat d7/f49 x:0 0 0 2024-04-25T15:57:33.068 INFO:tasks.workunit.client.1.smithi155.stdout:2/246: creat d7/db/f4a x:0 0 0 2024-04-25T15:57:33.114 INFO:tasks.workunit.client.1.smithi155.stdout:1/98: sync 2024-04-25T15:57:33.114 INFO:tasks.workunit.client.1.smithi155.stdout:3/110: sync 2024-04-25T15:57:33.114 INFO:tasks.workunit.client.1.smithi155.stdout:6/121: sync 2024-04-25T15:57:33.114 INFO:tasks.workunit.client.1.smithi155.stdout:4/111: sync 2024-04-25T15:57:33.115 INFO:tasks.workunit.client.1.smithi155.stdout:9/96: sync 2024-04-25T15:57:33.115 INFO:tasks.workunit.client.1.smithi155.stdout:3/111: dread - d1/d4/d10/f17 zero size 2024-04-25T15:57:33.117 INFO:tasks.workunit.client.1.smithi155.stdout:3/112: fdatasync d1/f16 0 2024-04-25T15:57:33.119 INFO:tasks.workunit.client.1.smithi155.stdout:6/122: read d0/f3 [3092097,20419] 0 2024-04-25T15:57:33.121 INFO:tasks.workunit.client.1.smithi155.stdout:6/123: write d0/f9 [4403046,69566] 0 2024-04-25T15:57:33.144 INFO:tasks.workunit.client.1.smithi155.stdout:5/133: truncate d0/d3/d15/f1e 491157 0 2024-04-25T15:57:33.169 INFO:tasks.workunit.client.1.smithi155.stdout:9/97: creat dc/d13/f26 x:0 0 0 2024-04-25T15:57:33.170 INFO:tasks.workunit.client.1.smithi155.stdout:3/113: mknod d1/d4/c1d 0 2024-04-25T15:57:33.172 INFO:tasks.workunit.client.1.smithi155.stdout:6/124: mknod d0/d13/c29 0 2024-04-25T15:57:33.176 INFO:tasks.workunit.client.1.smithi155.stdout:2/247: creat d7/db/d2e/d44/f4b x:0 0 0 2024-04-25T15:57:33.177 INFO:tasks.workunit.client.1.smithi155.stdout:4/112: creat da/d23/f26 x:0 0 0 2024-04-25T15:57:33.179 INFO:tasks.workunit.client.1.smithi155.stdout:9/98: creat dc/d11/f27 x:0 0 0 2024-04-25T15:57:33.180 INFO:tasks.workunit.client.1.smithi155.stdout:2/248: write d7/f2c [956185,112155] 0 2024-04-25T15:57:33.184 INFO:tasks.workunit.client.1.smithi155.stdout:2/249: fsync f3 0 2024-04-25T15:57:33.189 INFO:tasks.workunit.client.1.smithi155.stdout:3/114: dwrite d1/f16 [0,4194304] 0 2024-04-25T15:57:33.189 INFO:tasks.workunit.client.1.smithi155.stdout:6/125: dread d0/f9 [0,4194304] 0 2024-04-25T15:57:33.190 INFO:tasks.workunit.client.1.smithi155.stdout:4/113: creat da/dc/d18/f27 x:0 0 0 2024-04-25T15:57:33.190 INFO:tasks.workunit.client.1.smithi155.stdout:2/250: write d7/db/dd/d15/f42 [1046324,113515] 0 2024-04-25T15:57:33.195 INFO:tasks.workunit.client.1.smithi155.stdout:6/126: unlink d0/f22 0 2024-04-25T15:57:33.196 INFO:tasks.workunit.client.1.smithi155.stdout:4/114: symlink da/dc/l28 0 2024-04-25T15:57:33.198 INFO:tasks.workunit.client.1.smithi155.stdout:2/251: mknod d7/db/c4c 0 2024-04-25T15:57:33.203 INFO:tasks.workunit.client.1.smithi155.stdout:2/252: mknod d7/db/d2e/c4d 0 2024-04-25T15:57:33.204 INFO:tasks.workunit.client.1.smithi155.stdout:4/115: link da/dc/l28 da/l29 0 2024-04-25T15:57:33.206 INFO:tasks.workunit.client.1.smithi155.stdout:6/127: dwrite d0/ff [0,4194304] 0 2024-04-25T15:57:33.207 INFO:tasks.workunit.client.1.smithi155.stdout:4/116: mkdir da/d23/d2a 0 2024-04-25T15:57:33.207 INFO:tasks.workunit.client.1.smithi155.stdout:6/128: stat d0/d1a/d25 0 2024-04-25T15:57:33.208 INFO:tasks.workunit.client.1.smithi155.stdout:7/103: sync 2024-04-25T15:57:33.211 INFO:tasks.workunit.client.1.smithi155.stdout:6/129: write d0/f9 [2612041,123127] 0 2024-04-25T15:57:33.212 INFO:tasks.workunit.client.1.smithi155.stdout:7/104: readlink d2/dd/d13/d1c/l25 0 2024-04-25T15:57:33.212 INFO:tasks.workunit.client.1.smithi155.stdout:7/105: chown d2/dd/d13/d1c/l25 21 1 2024-04-25T15:57:33.213 INFO:tasks.workunit.client.1.smithi155.stdout:4/117: rename da/dc/l22 to da/dc/d18/l2b 0 2024-04-25T15:57:33.213 INFO:tasks.workunit.client.1.smithi155.stdout:7/106: chown d2/dd/d12/f20 223611 1 2024-04-25T15:57:33.214 INFO:tasks.workunit.client.1.smithi155.stdout:6/130: symlink d0/d18/l2a 0 2024-04-25T15:57:33.215 INFO:tasks.workunit.client.1.smithi155.stdout:4/118: symlink da/dc/d18/l2c 0 2024-04-25T15:57:33.217 INFO:tasks.workunit.client.1.smithi155.stdout:7/107: mkdir d2/d26 0 2024-04-25T15:57:33.217 INFO:tasks.workunit.client.1.smithi155.stdout:7/108: read d2/f11 [35102,22786] 0 2024-04-25T15:57:33.219 INFO:tasks.workunit.client.1.smithi155.stdout:4/119: symlink da/d23/l2d 0 2024-04-25T15:57:33.221 INFO:tasks.workunit.client.1.smithi155.stdout:6/131: link d0/d13/f17 d0/d1a/d25/f2b 0 2024-04-25T15:57:33.222 INFO:tasks.workunit.client.1.smithi155.stdout:6/132: readlink d0/l11 0 2024-04-25T15:57:33.225 INFO:tasks.workunit.client.1.smithi155.stdout:6/133: mknod d0/d18/c2c 0 2024-04-25T15:57:33.228 INFO:tasks.workunit.client.1.smithi155.stdout:6/134: getdents d0/d1a/d21 0 2024-04-25T15:57:33.231 INFO:tasks.workunit.client.1.smithi155.stdout:6/135: creat d0/d1a/d25/f2d x:0 0 0 2024-04-25T15:57:33.239 INFO:tasks.workunit.client.1.smithi155.stdout:6/136: dwrite d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:33.240 INFO:tasks.workunit.client.1.smithi155.stdout:6/137: read d0/f1 [62709,105844] 0 2024-04-25T15:57:33.246 INFO:tasks.workunit.client.1.smithi155.stdout:6/138: dread d0/d13/f20 [0,4194304] 0 2024-04-25T15:57:33.248 INFO:tasks.workunit.client.1.smithi155.stdout:6/139: mkdir d0/d1a/d25/d2e 0 2024-04-25T15:57:33.250 INFO:tasks.workunit.client.1.smithi155.stdout:6/140: write d0/d1a/d25/f2d [684530,27076] 0 2024-04-25T15:57:33.252 INFO:tasks.workunit.client.1.smithi155.stdout:6/141: write d0/f3 [3789858,16114] 0 2024-04-25T15:57:33.255 INFO:tasks.workunit.client.1.smithi155.stdout:6/142: write d0/d13/f17 [994691,87185] 0 2024-04-25T15:57:33.261 INFO:tasks.workunit.client.1.smithi155.stdout:6/143: mkdir d0/d18/d1b/d2f 0 2024-04-25T15:57:33.265 INFO:tasks.workunit.client.1.smithi155.stdout:6/144: symlink d0/d1a/d25/d2e/l30 0 2024-04-25T15:57:33.267 INFO:tasks.workunit.client.1.smithi155.stdout:3/115: truncate d1/d4/db/fe 165009 0 2024-04-25T15:57:33.269 INFO:tasks.workunit.client.1.smithi155.stdout:2/253: getdents d7/db/d2e 0 2024-04-25T15:57:33.271 INFO:tasks.workunit.client.1.smithi155.stdout:5/134: dwrite d0/d3/d15/d13/f1c [0,4194304] 0 2024-04-25T15:57:33.273 INFO:tasks.workunit.client.1.smithi155.stdout:9/99: dwrite dc/ff [0,4194304] 0 2024-04-25T15:57:33.274 INFO:tasks.workunit.client.1.smithi155.stdout:6/145: dread d0/f10 [0,4194304] 0 2024-04-25T15:57:33.274 INFO:tasks.workunit.client.1.smithi155.stdout:5/135: read d0/d3/d15/f17 [18368,122737] 0 2024-04-25T15:57:33.277 INFO:tasks.workunit.client.1.smithi155.stdout:3/116: mknod d1/c1e 0 2024-04-25T15:57:33.277 INFO:tasks.workunit.client.1.smithi155.stdout:7/109: truncate d2/f1d 1769515 0 2024-04-25T15:57:33.278 INFO:tasks.workunit.client.1.smithi155.stdout:6/146: chown d0/d1a/d25/f2d 112732 1 2024-04-25T15:57:33.279 INFO:tasks.workunit.client.1.smithi155.stdout:9/100: unlink c8 0 2024-04-25T15:57:33.279 INFO:tasks.workunit.client.1.smithi155.stdout:6/147: dread - d0/d13/f27 zero size 2024-04-25T15:57:33.279 INFO:tasks.workunit.client.1.smithi155.stdout:7/110: readlink d2/dd/d12/l19 0 2024-04-25T15:57:33.280 INFO:tasks.workunit.client.1.smithi155.stdout:7/111: read d2/f8 [2600995,109434] 0 2024-04-25T15:57:33.282 INFO:tasks.workunit.client.1.smithi155.stdout:2/254: mkdir d7/db/d4e 0 2024-04-25T15:57:33.283 INFO:tasks.workunit.client.1.smithi155.stdout:9/101: fdatasync fa 0 2024-04-25T15:57:33.285 INFO:tasks.workunit.client.1.smithi155.stdout:2/255: dread - d7/f49 zero size 2024-04-25T15:57:33.285 INFO:tasks.workunit.client.1.smithi155.stdout:7/112: truncate d2/dd/f23 301562 0 2024-04-25T15:57:33.285 INFO:tasks.workunit.client.1.smithi155.stdout:5/136: mkdir d0/d3/d2c 0 2024-04-25T15:57:33.290 INFO:tasks.workunit.client.1.smithi155.stdout:9/102: rename dc/d17/l22 to dc/d17/l28 0 2024-04-25T15:57:33.291 INFO:tasks.workunit.client.1.smithi155.stdout:3/117: dwrite d1/f16 [0,4194304] 0 2024-04-25T15:57:33.291 INFO:tasks.workunit.client.1.smithi155.stdout:6/148: dread d0/d13/f20 [0,4194304] 0 2024-04-25T15:57:33.291 INFO:tasks.workunit.client.1.smithi155.stdout:5/137: chown d0/d3/d15/d13/f2a 1450904080 1 2024-04-25T15:57:33.292 INFO:tasks.workunit.client.1.smithi155.stdout:9/103: chown dc/c15 164 1 2024-04-25T15:57:33.292 INFO:tasks.workunit.client.1.smithi155.stdout:7/113: creat d2/dd/d13/d24/f27 x:0 0 0 2024-04-25T15:57:33.292 INFO:tasks.workunit.client.1.smithi155.stdout:2/256: read d7/db/dd/f48 [180110,58006] 0 2024-04-25T15:57:33.294 INFO:tasks.workunit.client.1.smithi155.stdout:3/118: rmdir d1/d4/d10 39 2024-04-25T15:57:33.297 INFO:tasks.workunit.client.1.smithi155.stdout:9/104: creat dc/d17/f29 x:0 0 0 2024-04-25T15:57:33.300 INFO:tasks.workunit.client.1.smithi155.stdout:6/149: creat d0/d1a/d25/d2e/f31 x:0 0 0 2024-04-25T15:57:33.304 INFO:tasks.workunit.client.1.smithi155.stdout:9/105: mkdir dc/d17/d2a 0 2024-04-25T15:57:33.306 INFO:tasks.workunit.client.1.smithi155.stdout:6/150: creat d0/d1a/d21/f32 x:0 0 0 2024-04-25T15:57:33.307 INFO:tasks.workunit.client.1.smithi155.stdout:3/119: dread d1/d4/d10/f14 [0,4194304] 0 2024-04-25T15:57:33.307 INFO:tasks.workunit.client.1.smithi155.stdout:3/120: chown d1 3163 1 2024-04-25T15:57:33.311 INFO:tasks.workunit.client.1.smithi155.stdout:9/106: creat dc/d17/f2b x:0 0 0 2024-04-25T15:57:33.311 INFO:tasks.workunit.client.1.smithi155.stdout:9/107: fdatasync dc/d11/f27 0 2024-04-25T15:57:33.313 INFO:tasks.workunit.client.1.smithi155.stdout:2/257: rename d7/db/dd/d15/f1b to d7/f4f 0 2024-04-25T15:57:33.314 INFO:tasks.workunit.client.1.smithi155.stdout:2/258: fsync d7/db/dd/f2a 0 2024-04-25T15:57:33.318 INFO:tasks.workunit.client.1.smithi155.stdout:5/138: rename d0/d3/cc to d0/d3/c2d 0 2024-04-25T15:57:33.318 INFO:tasks.workunit.client.1.smithi155.stdout:7/114: getdents d2 0 2024-04-25T15:57:33.319 INFO:tasks.workunit.client.1.smithi155.stdout:6/151: creat d0/d18/d1b/d2f/f33 x:0 0 0 2024-04-25T15:57:33.320 INFO:tasks.workunit.client.1.smithi155.stdout:7/115: rmdir d2 39 2024-04-25T15:57:33.322 INFO:tasks.workunit.client.1.smithi155.stdout:8/66: sync 2024-04-25T15:57:33.322 INFO:tasks.workunit.client.1.smithi155.stdout:9/108: unlink dc/d17/l28 0 2024-04-25T15:57:33.323 INFO:tasks.workunit.client.1.smithi155.stdout:3/121: creat d1/f1f x:0 0 0 2024-04-25T15:57:33.323 INFO:tasks.workunit.client.1.smithi155.stdout:2/259: dwrite d7/db/d2e/f2f [0,4194304] 0 2024-04-25T15:57:33.324 INFO:tasks.workunit.client.1.smithi155.stdout:7/116: stat d2/fa 0 2024-04-25T15:57:33.324 INFO:tasks.workunit.client.1.smithi155.stdout:3/122: chown d1/d4/d10/f14 373594 1 2024-04-25T15:57:33.325 INFO:tasks.workunit.client.1.smithi155.stdout:7/117: write d2/f1b [2499363,107676] 0 2024-04-25T15:57:33.328 INFO:tasks.workunit.client.1.smithi155.stdout:8/67: mkdir d2/d15 0 2024-04-25T15:57:33.332 INFO:tasks.workunit.client.1.smithi155.stdout:3/123: mkdir d1/d4/db/d20 0 2024-04-25T15:57:33.335 INFO:tasks.workunit.client.1.smithi155.stdout:9/109: creat dc/d17/d2a/f2c x:0 0 0 2024-04-25T15:57:33.336 INFO:tasks.workunit.client.1.smithi155.stdout:5/139: link d0/d3/c9 d0/d3/c2e 0 2024-04-25T15:57:33.337 INFO:tasks.workunit.client.1.smithi155.stdout:5/140: read - d0/d3/d15/d13/f29 zero size 2024-04-25T15:57:33.338 INFO:tasks.workunit.client.1.smithi155.stdout:3/124: mkdir d1/d4/d10/d21 0 2024-04-25T15:57:33.338 INFO:tasks.workunit.client.1.smithi155.stdout:5/141: chown d0/d3 4809533 1 2024-04-25T15:57:33.339 INFO:tasks.workunit.client.1.smithi155.stdout:9/110: creat dc/d17/d18/f2d x:0 0 0 2024-04-25T15:57:33.340 INFO:tasks.workunit.client.1.smithi155.stdout:3/125: rmdir d1 39 2024-04-25T15:57:33.341 INFO:tasks.workunit.client.1.smithi155.stdout:5/142: chown d0/d3/l26 33441261 1 2024-04-25T15:57:33.343 INFO:tasks.workunit.client.1.smithi155.stdout:8/68: creat d2/f16 x:0 0 0 2024-04-25T15:57:33.344 INFO:tasks.workunit.client.1.smithi155.stdout:9/111: mkdir dc/d13/d2e 0 2024-04-25T15:57:33.345 INFO:tasks.workunit.client.1.smithi155.stdout:3/126: stat d1 0 2024-04-25T15:57:33.348 INFO:tasks.workunit.client.1.smithi155.stdout:6/152: truncate d0/d1a/d25/f2b 806724 0 2024-04-25T15:57:33.351 INFO:tasks.workunit.client.1.smithi155.stdout:6/153: write d0/d1a/d25/f2d [638381,39336] 0 2024-04-25T15:57:33.351 INFO:tasks.workunit.client.1.smithi155.stdout:9/112: mkdir dc/d2f 0 2024-04-25T15:57:33.353 INFO:tasks.workunit.client.1.smithi155.stdout:3/127: creat d1/d4/d10/d21/f22 x:0 0 0 2024-04-25T15:57:33.354 INFO:tasks.workunit.client.1.smithi155.stdout:7/118: write d2/f11 [349624,130915] 0 2024-04-25T15:57:33.355 INFO:tasks.workunit.client.1.smithi155.stdout:9/113: mkdir dc/d11/d30 0 2024-04-25T15:57:33.356 INFO:tasks.workunit.client.1.smithi155.stdout:8/69: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:33.357 INFO:tasks.workunit.client.1.smithi155.stdout:6/154: rmdir d0/d1a/d25/d2e 39 2024-04-25T15:57:33.361 INFO:tasks.workunit.client.1.smithi155.stdout:6/155: mkdir d0/d13/d34 0 2024-04-25T15:57:33.364 INFO:tasks.workunit.client.1.smithi155.stdout:6/156: stat d0/d1a/d25/f2d 0 2024-04-25T15:57:33.364 INFO:tasks.workunit.client.1.smithi155.stdout:7/119: link d2/f11 d2/dd/f28 0 2024-04-25T15:57:33.367 INFO:tasks.workunit.client.1.smithi155.stdout:5/143: write d0/d3/d15/f1e [1205018,119341] 0 2024-04-25T15:57:33.368 INFO:tasks.workunit.client.1.smithi155.stdout:3/128: dwrite d1/f1f [0,4194304] 0 2024-04-25T15:57:33.369 INFO:tasks.workunit.client.1.smithi155.stdout:8/70: creat d2/d5/f17 x:0 0 0 2024-04-25T15:57:33.371 INFO:tasks.workunit.client.1.smithi155.stdout:8/71: readlink d2/l6 0 2024-04-25T15:57:33.371 INFO:tasks.workunit.client.1.smithi155.stdout:3/129: chown d1/c15 69243 1 2024-04-25T15:57:33.373 INFO:tasks.workunit.client.1.smithi155.stdout:6/157: symlink d0/d1a/d21/l35 0 2024-04-25T15:57:33.373 INFO:tasks.workunit.client.1.smithi155.stdout:9/114: dwrite dc/d11/f27 [0,4194304] 0 2024-04-25T15:57:33.375 INFO:tasks.workunit.client.1.smithi155.stdout:3/130: read - d1/d4/d10/f17 zero size 2024-04-25T15:57:33.379 INFO:tasks.workunit.client.1.smithi155.stdout:5/144: rmdir d0/d3/d15 39 2024-04-25T15:57:33.381 INFO:tasks.workunit.client.1.smithi155.stdout:3/131: readlink d1/d4/db/l1a 0 2024-04-25T15:57:33.381 INFO:tasks.workunit.client.1.smithi155.stdout:7/120: dread d2/f1b [0,4194304] 0 2024-04-25T15:57:33.384 INFO:tasks.workunit.client.1.smithi155.stdout:6/158: symlink d0/d1a/d21/l36 0 2024-04-25T15:57:33.386 INFO:tasks.workunit.client.1.smithi155.stdout:8/72: mkdir d2/d15/d18 0 2024-04-25T15:57:33.387 INFO:tasks.workunit.client.1.smithi155.stdout:6/159: chown d0/d18/d1b 17071594 1 2024-04-25T15:57:33.387 INFO:tasks.workunit.client.1.smithi155.stdout:5/145: chown d0/d3/c2e 60436 1 2024-04-25T15:57:33.387 INFO:tasks.workunit.client.1.smithi155.stdout:7/121: mknod d2/dd/d12/c29 0 2024-04-25T15:57:33.390 INFO:tasks.workunit.client.1.smithi155.stdout:6/160: mkdir d0/d1a/d37 0 2024-04-25T15:57:33.392 INFO:tasks.workunit.client.1.smithi155.stdout:5/146: unlink d0/d3/l26 0 2024-04-25T15:57:33.392 INFO:tasks.workunit.client.1.smithi155.stdout:9/115: dwrite dc/d17/d2a/f2c [0,4194304] 0 2024-04-25T15:57:33.396 INFO:tasks.workunit.client.1.smithi155.stdout:7/122: creat d2/d26/f2a x:0 0 0 2024-04-25T15:57:33.396 INFO:tasks.workunit.client.1.smithi155.stdout:3/132: dwrite d1/f16 [0,4194304] 0 2024-04-25T15:57:33.398 INFO:tasks.workunit.client.1.smithi155.stdout:5/147: read - d0/d3/d15/d13/f2a zero size 2024-04-25T15:57:33.398 INFO:tasks.workunit.client.1.smithi155.stdout:6/161: mkdir d0/d13/d34/d38 0 2024-04-25T15:57:33.402 INFO:tasks.workunit.client.1.smithi155.stdout:7/123: chown d2/dd/d12/c18 1447026 1 2024-04-25T15:57:33.403 INFO:tasks.workunit.client.1.smithi155.stdout:3/133: mknod d1/d4/d10/c23 0 2024-04-25T15:57:33.404 INFO:tasks.workunit.client.1.smithi155.stdout:6/162: rmdir d0/d1a/d25/d2e 39 2024-04-25T15:57:33.404 INFO:tasks.workunit.client.1.smithi155.stdout:7/124: stat d2/dd/d12/c18 0 2024-04-25T15:57:33.405 INFO:tasks.workunit.client.1.smithi155.stdout:8/73: dwrite d2/f16 [0,4194304] 0 2024-04-25T15:57:33.408 INFO:tasks.workunit.client.1.smithi155.stdout:6/163: fdatasync d0/d13/f27 0 2024-04-25T15:57:33.410 INFO:tasks.workunit.client.1.smithi155.stdout:3/134: dread - d1/d4/d10/d21/f22 zero size 2024-04-25T15:57:33.411 INFO:tasks.workunit.client.1.smithi155.stdout:6/164: dread - d0/d18/d1b/d2f/f33 zero size 2024-04-25T15:57:33.412 INFO:tasks.workunit.client.1.smithi155.stdout:9/116: dwrite dc/f14 [0,4194304] 0 2024-04-25T15:57:33.412 INFO:tasks.workunit.client.1.smithi155.stdout:8/74: creat d2/d5/f19 x:0 0 0 2024-04-25T15:57:33.413 INFO:tasks.workunit.client.1.smithi155.stdout:8/75: chown d2/d5/f17 54 1 2024-04-25T15:57:33.413 INFO:tasks.workunit.client.1.smithi155.stdout:6/165: fsync d0/d1a/d25/f2d 0 2024-04-25T15:57:33.414 INFO:tasks.workunit.client.1.smithi155.stdout:7/125: fsync d2/dd/d13/d1c/f1e 0 2024-04-25T15:57:33.420 INFO:tasks.workunit.client.1.smithi155.stdout:9/117: unlink dc/fe 0 2024-04-25T15:57:33.420 INFO:tasks.workunit.client.1.smithi155.stdout:6/166: read d0/d1a/d25/f2d [204857,74398] 0 2024-04-25T15:57:33.420 INFO:tasks.workunit.client.1.smithi155.stdout:7/126: rename d2/d26/f2a to d2/dd/f2b 0 2024-04-25T15:57:33.421 INFO:tasks.workunit.client.1.smithi155.stdout:3/135: symlink d1/d4/l24 0 2024-04-25T15:57:33.422 INFO:tasks.workunit.client.1.smithi155.stdout:8/76: creat d2/d15/d18/f1a x:0 0 0 2024-04-25T15:57:33.423 INFO:tasks.workunit.client.1.smithi155.stdout:9/118: write dc/d17/f29 [953941,69075] 0 2024-04-25T15:57:33.423 INFO:tasks.workunit.client.1.smithi155.stdout:8/77: stat d2/f14 0 2024-04-25T15:57:33.423 INFO:tasks.workunit.client.1.smithi155.stdout:6/167: chown d0/d1a/d25/d2e 14 1 2024-04-25T15:57:33.424 INFO:tasks.workunit.client.1.smithi155.stdout:8/78: dread - d2/d5/f17 zero size 2024-04-25T15:57:33.425 INFO:tasks.workunit.client.1.smithi155.stdout:9/119: read dc/ff [1829198,23342] 0 2024-04-25T15:57:33.428 INFO:tasks.workunit.client.1.smithi155.stdout:8/79: dread d2/fa [0,4194304] 0 2024-04-25T15:57:33.429 INFO:tasks.workunit.client.1.smithi155.stdout:7/127: getdents d2/dd/d13 0 2024-04-25T15:57:33.429 INFO:tasks.workunit.client.1.smithi155.stdout:6/168: dread d0/ff [0,4194304] 0 2024-04-25T15:57:33.430 INFO:tasks.workunit.client.1.smithi155.stdout:3/136: getdents d1/d4/db 0 2024-04-25T15:57:33.430 INFO:tasks.workunit.client.1.smithi155.stdout:8/80: symlink d2/d15/l1b 0 2024-04-25T15:57:33.430 INFO:tasks.workunit.client.1.smithi155.stdout:7/128: write d2/f1f [786542,67610] 0 2024-04-25T15:57:33.431 INFO:tasks.workunit.client.1.smithi155.stdout:7/129: chown d2/dd/d12 965136202 1 2024-04-25T15:57:33.433 INFO:tasks.workunit.client.1.smithi155.stdout:6/169: unlink d0/ld 0 2024-04-25T15:57:33.435 INFO:tasks.workunit.client.1.smithi155.stdout:8/81: mknod d2/d15/c1c 0 2024-04-25T15:57:33.435 INFO:tasks.workunit.client.1.smithi155.stdout:8/82: readlink d2/d15/l1b 0 2024-04-25T15:57:33.436 INFO:tasks.workunit.client.1.smithi155.stdout:8/83: dread - d2/f11 zero size 2024-04-25T15:57:33.438 INFO:tasks.workunit.client.1.smithi155.stdout:7/130: dread d2/dd/d13/f21 [0,4194304] 0 2024-04-25T15:57:33.438 INFO:tasks.workunit.client.1.smithi155.stdout:3/137: mkdir d1/d4/d25 0 2024-04-25T15:57:33.438 INFO:tasks.workunit.client.1.smithi155.stdout:6/170: mkdir d0/d1a/d25/d2e/d39 0 2024-04-25T15:57:33.440 INFO:tasks.workunit.client.1.smithi155.stdout:7/131: fsync d2/f1b 0 2024-04-25T15:57:33.441 INFO:tasks.workunit.client.1.smithi155.stdout:6/171: chown d0/d1a/f1c 1566932 1 2024-04-25T15:57:33.443 INFO:tasks.workunit.client.1.smithi155.stdout:7/132: dread d2/dd/f28 [0,4194304] 0 2024-04-25T15:57:33.444 INFO:tasks.workunit.client.1.smithi155.stdout:6/172: mknod d0/d18/d1b/c3a 0 2024-04-25T15:57:33.450 INFO:tasks.workunit.client.1.smithi155.stdout:0/86: sync 2024-04-25T15:57:33.453 INFO:tasks.workunit.client.1.smithi155.stdout:8/84: dwrite d2/f14 [0,4194304] 0 2024-04-25T15:57:33.456 INFO:tasks.workunit.client.1.smithi155.stdout:0/87: read - d1/d3/d20/f24 zero size 2024-04-25T15:57:33.459 INFO:tasks.workunit.client.1.smithi155.stdout:8/85: symlink d2/l1d 0 2024-04-25T15:57:33.459 INFO:tasks.workunit.client.1.smithi155.stdout:9/120: dwrite f7 [0,4194304] 0 2024-04-25T15:57:33.461 INFO:tasks.workunit.client.1.smithi155.stdout:3/138: dwrite d1/d4/f18 [0,4194304] 0 2024-04-25T15:57:33.461 INFO:tasks.workunit.client.1.smithi155.stdout:0/88: rmdir d1/d1a 39 2024-04-25T15:57:33.462 INFO:tasks.workunit.client.1.smithi155.stdout:6/173: dread d0/f15 [0,4194304] 0 2024-04-25T15:57:33.463 INFO:tasks.workunit.client.1.smithi155.stdout:7/133: dwrite d2/f10 [0,4194304] 0 2024-04-25T15:57:33.465 INFO:tasks.workunit.client.1.smithi155.stdout:7/134: chown d2/dd/d13/d24 1488386 1 2024-04-25T15:57:33.466 INFO:tasks.workunit.client.1.smithi155.stdout:6/174: chown d0/d1a/d21/c28 4 1 2024-04-25T15:57:33.470 INFO:tasks.workunit.client.1.smithi155.stdout:7/135: creat d2/dd/d13/f2c x:0 0 0 2024-04-25T15:57:33.476 INFO:tasks.workunit.client.1.smithi155.stdout:0/89: getdents d1/d3/d5/da 0 2024-04-25T15:57:33.478 INFO:tasks.workunit.client.1.smithi155.stdout:8/86: dread d2/fa [0,4194304] 0 2024-04-25T15:57:33.479 INFO:tasks.workunit.client.1.smithi155.stdout:3/139: rename d1/d4/db/f1c to d1/f26 0 2024-04-25T15:57:33.479 INFO:tasks.workunit.client.1.smithi155.stdout:9/121: dwrite f6 [0,4194304] 0 2024-04-25T15:57:33.480 INFO:tasks.workunit.client.1.smithi155.stdout:6/175: creat d0/d18/d1b/f3b x:0 0 0 2024-04-25T15:57:33.480 INFO:tasks.workunit.client.1.smithi155.stdout:7/136: mknod d2/dd/c2d 0 2024-04-25T15:57:33.481 INFO:tasks.workunit.client.1.smithi155.stdout:8/87: fdatasync d2/d15/d18/f1a 0 2024-04-25T15:57:33.482 INFO:tasks.workunit.client.1.smithi155.stdout:7/137: chown d2/c7 6 1 2024-04-25T15:57:33.482 INFO:tasks.workunit.client.1.smithi155.stdout:8/88: fsync d2/fc 0 2024-04-25T15:57:33.482 INFO:tasks.workunit.client.1.smithi155.stdout:9/122: mknod dc/d17/d18/c31 0 2024-04-25T15:57:33.484 INFO:tasks.workunit.client.1.smithi155.stdout:8/89: chown d2/l6 0 1 2024-04-25T15:57:33.484 INFO:tasks.workunit.client.1.smithi155.stdout:0/90: mknod d1/d1a/c25 0 2024-04-25T15:57:33.484 INFO:tasks.workunit.client.1.smithi155.stdout:7/138: chown d2/dd/d13/d24/f27 17 1 2024-04-25T15:57:33.488 INFO:tasks.workunit.client.1.smithi155.stdout:6/176: rename d0/d13/c29 to d0/d18/d1b/d2f/c3c 0 2024-04-25T15:57:33.489 INFO:tasks.workunit.client.1.smithi155.stdout:7/139: creat d2/f2e x:0 0 0 2024-04-25T15:57:33.490 INFO:tasks.workunit.client.1.smithi155.stdout:0/91: creat d1/d3/d5/f26 x:0 0 0 2024-04-25T15:57:33.490 INFO:tasks.workunit.client.1.smithi155.stdout:6/177: fdatasync d0/d1a/d21/f32 0 2024-04-25T15:57:33.491 INFO:tasks.workunit.client.1.smithi155.stdout:9/123: symlink dc/d13/d2e/l32 0 2024-04-25T15:57:33.494 INFO:tasks.workunit.client.1.smithi155.stdout:7/140: creat d2/dd/f2f x:0 0 0 2024-04-25T15:57:33.494 INFO:tasks.workunit.client.1.smithi155.stdout:0/92: truncate d1/d3/f17 619807 0 2024-04-25T15:57:33.495 INFO:tasks.workunit.client.1.smithi155.stdout:6/178: symlink d0/d1a/d37/l3d 0 2024-04-25T15:57:33.496 INFO:tasks.workunit.client.1.smithi155.stdout:8/90: dwrite d2/f12 [0,4194304] 0 2024-04-25T15:57:33.496 INFO:tasks.workunit.client.1.smithi155.stdout:0/93: symlink d1/d6/d16/l27 0 2024-04-25T15:57:33.497 INFO:tasks.workunit.client.1.smithi155.stdout:7/141: write d2/dd/d13/d24/f27 [47784,94150] 0 2024-04-25T15:57:33.499 INFO:tasks.workunit.client.1.smithi155.stdout:0/94: write d1/d1a/f1d [992168,68776] 0 2024-04-25T15:57:33.500 INFO:tasks.workunit.client.1.smithi155.stdout:6/179: rmdir d0/d1a 39 2024-04-25T15:57:33.502 INFO:tasks.workunit.client.1.smithi155.stdout:3/140: write d1/d4/d10/f14 [1019379,45168] 0 2024-04-25T15:57:33.502 INFO:tasks.workunit.client.1.smithi155.stdout:8/91: mknod d2/d15/d18/c1e 0 2024-04-25T15:57:33.503 INFO:tasks.workunit.client.1.smithi155.stdout:7/142: mkdir d2/dd/d30 0 2024-04-25T15:57:33.507 INFO:tasks.workunit.client.1.smithi155.stdout:8/92: mknod d2/d5/c1f 0 2024-04-25T15:57:33.508 INFO:tasks.workunit.client.1.smithi155.stdout:9/124: dwrite dc/d17/d18/f2d [0,4194304] 0 2024-04-25T15:57:33.511 INFO:tasks.workunit.client.1.smithi155.stdout:3/141: creat d1/d4/d10/d21/f27 x:0 0 0 2024-04-25T15:57:33.512 INFO:tasks.workunit.client.1.smithi155.stdout:3/142: readlink d1/d4/l13 0 2024-04-25T15:57:33.513 INFO:tasks.workunit.client.1.smithi155.stdout:3/143: read - d1/d4/d10/d21/f27 zero size 2024-04-25T15:57:33.514 INFO:tasks.workunit.client.1.smithi155.stdout:8/93: rmdir d2/d15/d18 39 2024-04-25T15:57:33.514 INFO:tasks.workunit.client.1.smithi155.stdout:3/144: write d1/d4/f18 [3438567,9077] 0 2024-04-25T15:57:33.515 INFO:tasks.workunit.client.1.smithi155.stdout:0/95: link d1/d3/d12/c18 d1/d3/d12/c28 0 2024-04-25T15:57:33.518 INFO:tasks.workunit.client.1.smithi155.stdout:6/180: link d0/d13/f27 d0/d1a/d37/f3e 0 2024-04-25T15:57:33.520 INFO:tasks.workunit.client.1.smithi155.stdout:7/143: link d2/dd/f23 d2/dd/d13/d1c/f31 0 2024-04-25T15:57:33.522 INFO:tasks.workunit.client.1.smithi155.stdout:3/145: mkdir d1/d4/db/d28 0 2024-04-25T15:57:33.523 INFO:tasks.workunit.client.1.smithi155.stdout:9/125: symlink dc/l33 0 2024-04-25T15:57:33.524 INFO:tasks.workunit.client.1.smithi155.stdout:8/94: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:33.525 INFO:tasks.workunit.client.1.smithi155.stdout:9/126: write fa [4727273,125770] 0 2024-04-25T15:57:33.526 INFO:tasks.workunit.client.1.smithi155.stdout:6/181: symlink d0/d1a/d25/d2e/l3f 0 2024-04-25T15:57:33.526 INFO:tasks.workunit.client.1.smithi155.stdout:7/144: mkdir d2/dd/d13/d1c/d32 0 2024-04-25T15:57:33.527 INFO:tasks.workunit.client.1.smithi155.stdout:8/95: symlink d2/d5/l20 0 2024-04-25T15:57:33.529 INFO:tasks.workunit.client.1.smithi155.stdout:3/146: mkdir d1/d4/db/d28/d29 0 2024-04-25T15:57:33.529 INFO:tasks.workunit.client.1.smithi155.stdout:7/145: write d2/f1f [321411,2407] 0 2024-04-25T15:57:33.530 INFO:tasks.workunit.client.1.smithi155.stdout:6/182: mknod d0/d18/d1b/c40 0 2024-04-25T15:57:33.531 INFO:tasks.workunit.client.1.smithi155.stdout:9/127: symlink dc/d2f/l34 0 2024-04-25T15:57:33.533 INFO:tasks.workunit.client.1.smithi155.stdout:3/147: mkdir d1/d4/d10/d2a 0 2024-04-25T15:57:33.533 INFO:tasks.workunit.client.1.smithi155.stdout:8/96: chown d2/d5/lf 47745831 1 2024-04-25T15:57:33.534 INFO:tasks.workunit.client.1.smithi155.stdout:7/146: mknod d2/dd/d13/d1c/c33 0 2024-04-25T15:57:33.535 INFO:tasks.workunit.client.1.smithi155.stdout:7/147: write d2/f1f [689634,103881] 0 2024-04-25T15:57:33.535 INFO:tasks.workunit.client.1.smithi155.stdout:0/96: dread d1/d3/d5/f10 [0,4194304] 0 2024-04-25T15:57:33.535 INFO:tasks.workunit.client.1.smithi155.stdout:6/183: write d0/d1a/d37/f3e [489917,44268] 0 2024-04-25T15:57:33.536 INFO:tasks.workunit.client.1.smithi155.stdout:9/128: creat dc/d17/d2a/f35 x:0 0 0 2024-04-25T15:57:33.537 INFO:tasks.workunit.client.1.smithi155.stdout:8/97: creat d2/d5/f21 x:0 0 0 2024-04-25T15:57:33.538 INFO:tasks.workunit.client.1.smithi155.stdout:3/148: creat d1/d4/d25/f2b x:0 0 0 2024-04-25T15:57:33.540 INFO:tasks.workunit.client.1.smithi155.stdout:9/129: write dc/d17/f2b [813751,96688] 0 2024-04-25T15:57:33.545 INFO:tasks.workunit.client.1.smithi155.stdout:0/97: rename d1/d3/d20 to d1/d6/d29 0 2024-04-25T15:57:33.548 INFO:tasks.workunit.client.1.smithi155.stdout:9/130: symlink dc/d11/l36 0 2024-04-25T15:57:33.549 INFO:tasks.workunit.client.1.smithi155.stdout:8/98: dwrite d2/f14 [4194304,4194304] 0 2024-04-25T15:57:33.550 INFO:tasks.workunit.client.1.smithi155.stdout:6/184: unlink d0/d18/d1b/d2f/c3c 0 2024-04-25T15:57:33.550 INFO:tasks.workunit.client.1.smithi155.stdout:3/149: dwrite d1/f1f [0,4194304] 0 2024-04-25T15:57:33.552 INFO:tasks.workunit.client.1.smithi155.stdout:3/150: read d1/d4/d10/f14 [2528046,4763] 0 2024-04-25T15:57:33.553 INFO:tasks.workunit.client.1.smithi155.stdout:7/148: rmdir d2/dd/d13/d1c/d32 0 2024-04-25T15:57:33.554 INFO:tasks.workunit.client.1.smithi155.stdout:0/98: creat d1/d6/d16/f2a x:0 0 0 2024-04-25T15:57:33.557 INFO:tasks.workunit.client.1.smithi155.stdout:6/185: symlink d0/d18/d1b/l41 0 2024-04-25T15:57:33.560 INFO:tasks.workunit.client.1.smithi155.stdout:9/131: dwrite f7 [0,4194304] 0 2024-04-25T15:57:33.561 INFO:tasks.workunit.client.1.smithi155.stdout:8/99: mknod d2/c22 0 2024-04-25T15:57:33.562 INFO:tasks.workunit.client.1.smithi155.stdout:7/149: creat d2/dd/d12/f34 x:0 0 0 2024-04-25T15:57:33.563 INFO:tasks.workunit.client.1.smithi155.stdout:7/150: dread - d2/f2e zero size 2024-04-25T15:57:33.564 INFO:tasks.workunit.client.1.smithi155.stdout:6/186: creat d0/d18/d1b/d2f/f42 x:0 0 0 2024-04-25T15:57:33.572 INFO:tasks.workunit.client.1.smithi155.stdout:8/100: unlink d2/f12 0 2024-04-25T15:57:33.573 INFO:tasks.workunit.client.1.smithi155.stdout:3/151: creat d1/d4/f2c x:0 0 0 2024-04-25T15:57:33.574 INFO:tasks.workunit.client.1.smithi155.stdout:9/132: dwrite dc/d17/d18/f23 [0,4194304] 0 2024-04-25T15:57:33.574 INFO:tasks.workunit.client.1.smithi155.stdout:3/152: dread - d1/d4/d25/f2b zero size 2024-04-25T15:57:33.576 INFO:tasks.workunit.client.1.smithi155.stdout:0/99: creat d1/f2b x:0 0 0 2024-04-25T15:57:33.579 INFO:tasks.workunit.client.1.smithi155.stdout:8/101: chown d2/d15/d18 25220646 1 2024-04-25T15:57:33.580 INFO:tasks.workunit.client.1.smithi155.stdout:9/133: dread dc/f14 [0,4194304] 0 2024-04-25T15:57:33.581 INFO:tasks.workunit.client.1.smithi155.stdout:9/134: write dc/d17/f2b [846744,99062] 0 2024-04-25T15:57:33.583 INFO:tasks.workunit.client.1.smithi155.stdout:0/100: creat d1/d3/d5/f2c x:0 0 0 2024-04-25T15:57:33.585 INFO:tasks.workunit.client.1.smithi155.stdout:6/187: rename d0/d18/d1b/d2f to d0/d13/d43 0 2024-04-25T15:57:33.586 INFO:tasks.workunit.client.1.smithi155.stdout:8/102: mkdir d2/d15/d18/d23 0 2024-04-25T15:57:33.586 INFO:tasks.workunit.client.1.smithi155.stdout:8/103: fsync d2/fa 0 2024-04-25T15:57:33.589 INFO:tasks.workunit.client.1.smithi155.stdout:9/135: creat dc/d13/d2e/f37 x:0 0 0 2024-04-25T15:57:33.590 INFO:tasks.workunit.client.1.smithi155.stdout:0/101: creat d1/d6/d29/f2d x:0 0 0 2024-04-25T15:57:33.591 INFO:tasks.workunit.client.1.smithi155.stdout:9/136: chown dc/d17/f1b 5 1 2024-04-25T15:57:33.592 INFO:tasks.workunit.client.1.smithi155.stdout:8/104: mkdir d2/d5/d24 0 2024-04-25T15:57:33.593 INFO:tasks.workunit.client.1.smithi155.stdout:6/188: dread d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:33.595 INFO:tasks.workunit.client.1.smithi155.stdout:7/151: dwrite d2/f11 [0,4194304] 0 2024-04-25T15:57:33.595 INFO:tasks.workunit.client.1.smithi155.stdout:0/102: truncate d1/d6/d29/f24 282541 0 2024-04-25T15:57:33.597 INFO:tasks.workunit.client.1.smithi155.stdout:7/152: write d2/f1f [218371,39923] 0 2024-04-25T15:57:33.597 INFO:tasks.workunit.client.1.smithi155.stdout:3/153: rename d1/d4/db/fe to d1/d4/f2d 0 2024-04-25T15:57:33.598 INFO:tasks.workunit.client.1.smithi155.stdout:6/189: mkdir d0/d18/d44 0 2024-04-25T15:57:33.598 INFO:tasks.workunit.client.1.smithi155.stdout:6/190: stat d0/d1a/d37 0 2024-04-25T15:57:33.601 INFO:tasks.workunit.client.1.smithi155.stdout:0/103: symlink d1/d6/d29/l2e 0 2024-04-25T15:57:33.602 INFO:tasks.workunit.client.1.smithi155.stdout:3/154: dread d1/d4/f18 [4194304,4194304] 0 2024-04-25T15:57:33.604 INFO:tasks.workunit.client.1.smithi155.stdout:9/137: rename dc/d11/c1f to dc/d13/d2e/c38 0 2024-04-25T15:57:33.604 INFO:tasks.workunit.client.1.smithi155.stdout:9/138: fsync dc/d17/f2b 0 2024-04-25T15:57:33.606 INFO:tasks.workunit.client.1.smithi155.stdout:7/153: mkdir d2/dd/d13/d24/d35 0 2024-04-25T15:57:33.606 INFO:tasks.workunit.client.1.smithi155.stdout:8/105: mknod d2/d15/d18/d23/c25 0 2024-04-25T15:57:33.608 INFO:tasks.workunit.client.1.smithi155.stdout:6/191: mkdir d0/d1a/d45 0 2024-04-25T15:57:33.609 INFO:tasks.workunit.client.1.smithi155.stdout:6/192: fsync d0/d1a/d21/f32 0 2024-04-25T15:57:33.610 INFO:tasks.workunit.client.1.smithi155.stdout:1/99: sync 2024-04-25T15:57:33.610 INFO:tasks.workunit.client.1.smithi155.stdout:4/120: sync 2024-04-25T15:57:33.610 INFO:tasks.workunit.client.1.smithi155.stdout:9/139: fdatasync dc/ff 0 2024-04-25T15:57:33.611 INFO:tasks.workunit.client.1.smithi155.stdout:7/154: mkdir d2/dd/d36 0 2024-04-25T15:57:33.612 INFO:tasks.workunit.client.1.smithi155.stdout:8/106: unlink d2/d15/l1b 0 2024-04-25T15:57:33.615 INFO:tasks.workunit.client.1.smithi155.stdout:4/121: readlink da/dc/d18/l1c 0 2024-04-25T15:57:33.618 INFO:tasks.workunit.client.1.smithi155.stdout:9/140: mknod dc/d17/d18/c39 0 2024-04-25T15:57:33.623 INFO:tasks.workunit.client.1.smithi155.stdout:0/104: getdents d1/d3 0 2024-04-25T15:57:33.623 INFO:tasks.workunit.client.1.smithi155.stdout:1/100: dwrite d1/fb [0,4194304] 0 2024-04-25T15:57:33.625 INFO:tasks.workunit.client.1.smithi155.stdout:0/105: chown d1/d1a 3036082 1 2024-04-25T15:57:33.625 INFO:tasks.workunit.client.1.smithi155.stdout:7/155: dwrite d2/f11 [0,4194304] 0 2024-04-25T15:57:33.626 INFO:tasks.workunit.client.1.smithi155.stdout:6/193: creat d0/f46 x:0 0 0 2024-04-25T15:57:33.627 INFO:tasks.workunit.client.1.smithi155.stdout:4/122: rename da/dc/f25 to da/d23/d2a/f2e 0 2024-04-25T15:57:33.629 INFO:tasks.workunit.client.1.smithi155.stdout:9/141: creat dc/d13/f3a x:0 0 0 2024-04-25T15:57:33.630 INFO:tasks.workunit.client.1.smithi155.stdout:4/123: dread - da/d23/f26 zero size 2024-04-25T15:57:33.630 INFO:tasks.workunit.client.1.smithi155.stdout:7/156: dread d2/fa [0,4194304] 0 2024-04-25T15:57:33.631 INFO:tasks.workunit.client.1.smithi155.stdout:8/107: dwrite d2/f14 [4194304,4194304] 0 2024-04-25T15:57:33.631 INFO:tasks.workunit.client.1.smithi155.stdout:0/106: unlink d1/d6/d16/f2a 0 2024-04-25T15:57:33.631 INFO:tasks.workunit.client.1.smithi155.stdout:7/157: chown d2/d26 0 1 2024-04-25T15:57:33.637 INFO:tasks.workunit.client.1.smithi155.stdout:7/158: dread d2/dd/d13/f21 [0,4194304] 0 2024-04-25T15:57:33.637 INFO:tasks.workunit.client.1.smithi155.stdout:1/101: rename d1/d6/ff to d1/d16/f27 0 2024-04-25T15:57:33.640 INFO:tasks.workunit.client.1.smithi155.stdout:9/142: creat dc/d13/f3b x:0 0 0 2024-04-25T15:57:33.642 INFO:tasks.workunit.client.1.smithi155.stdout:8/108: dwrite d2/d15/d18/f1a [0,4194304] 0 2024-04-25T15:57:33.642 INFO:tasks.workunit.client.1.smithi155.stdout:0/107: creat d1/d6/f2f x:0 0 0 2024-04-25T15:57:33.642 INFO:tasks.workunit.client.1.smithi155.stdout:6/194: truncate d0/d13/f17 508675 0 2024-04-25T15:57:33.647 INFO:tasks.workunit.client.1.smithi155.stdout:3/155: dwrite d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:33.649 INFO:tasks.workunit.client.1.smithi155.stdout:6/195: fdatasync d0/f46 0 2024-04-25T15:57:33.654 INFO:tasks.workunit.client.1.smithi155.stdout:8/109: truncate d2/d5/f21 817605 0 2024-04-25T15:57:33.657 INFO:tasks.workunit.client.1.smithi155.stdout:0/108: symlink d1/d3/d5/l30 0 2024-04-25T15:57:33.658 INFO:tasks.workunit.client.1.smithi155.stdout:3/156: mknod d1/d4/c2e 0 2024-04-25T15:57:33.660 INFO:tasks.workunit.client.1.smithi155.stdout:7/159: dread d2/f15 [0,4194304] 0 2024-04-25T15:57:33.660 INFO:tasks.workunit.client.1.smithi155.stdout:6/196: creat d0/d1a/d21/f47 x:0 0 0 2024-04-25T15:57:33.661 INFO:tasks.workunit.client.1.smithi155.stdout:8/110: rmdir d2/d15/d18 39 2024-04-25T15:57:33.661 INFO:tasks.workunit.client.1.smithi155.stdout:3/157: dread - d1/d4/d10/d21/f22 zero size 2024-04-25T15:57:33.664 INFO:tasks.workunit.client.1.smithi155.stdout:4/124: dwrite da/f19 [0,4194304] 0 2024-04-25T15:57:33.664 INFO:tasks.workunit.client.1.smithi155.stdout:1/102: dwrite d1/d6/f14 [0,4194304] 0 2024-04-25T15:57:33.668 INFO:tasks.workunit.client.1.smithi155.stdout:6/197: write d0/f15 [3788912,84678] 0 2024-04-25T15:57:33.669 INFO:tasks.workunit.client.1.smithi155.stdout:3/158: truncate d1/d4/d10/f17 897785 0 2024-04-25T15:57:33.669 INFO:tasks.workunit.client.1.smithi155.stdout:9/143: write dc/ff [2130176,101859] 0 2024-04-25T15:57:33.669 INFO:tasks.workunit.client.1.smithi155.stdout:7/160: rename d2/dd/f2b to d2/f37 0 2024-04-25T15:57:33.671 INFO:tasks.workunit.client.1.smithi155.stdout:6/198: chown d0/d18/d1b/f3b 78881 1 2024-04-25T15:57:33.673 INFO:tasks.workunit.client.1.smithi155.stdout:1/103: symlink d1/l28 0 2024-04-25T15:57:33.674 INFO:tasks.workunit.client.1.smithi155.stdout:6/199: write d0/d1a/d25/f2d [1166524,104727] 0 2024-04-25T15:57:33.674 INFO:tasks.workunit.client.1.smithi155.stdout:8/111: mknod d2/d15/d18/c26 0 2024-04-25T15:57:33.674 INFO:tasks.workunit.client.1.smithi155.stdout:0/109: getdents d1/d3/d5 0 2024-04-25T15:57:33.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/161: creat d2/dd/d12/f38 x:0 0 0 2024-04-25T15:57:33.677 INFO:tasks.workunit.client.1.smithi155.stdout:7/162: chown d2/f1f 31650294 1 2024-04-25T15:57:33.678 INFO:tasks.workunit.client.1.smithi155.stdout:4/125: dwrite da/dc/fd [0,4194304] 0 2024-04-25T15:57:33.680 INFO:tasks.workunit.client.1.smithi155.stdout:4/126: truncate da/d23/d2a/f2e 82971 0 2024-04-25T15:57:33.681 INFO:tasks.workunit.client.1.smithi155.stdout:1/104: mkdir d1/d16/d1d/d29 0 2024-04-25T15:57:33.681 INFO:tasks.workunit.client.1.smithi155.stdout:1/105: chown d1/d16 33152 1 2024-04-25T15:57:33.682 INFO:tasks.workunit.client.1.smithi155.stdout:1/106: chown d1/d6/l10 0 1 2024-04-25T15:57:33.682 INFO:tasks.workunit.client.1.smithi155.stdout:9/144: mkdir dc/d3c 0 2024-04-25T15:57:33.683 INFO:tasks.workunit.client.1.smithi155.stdout:6/200: creat d0/d18/f48 x:0 0 0 2024-04-25T15:57:33.684 INFO:tasks.workunit.client.1.smithi155.stdout:8/112: symlink d2/d5/l27 0 2024-04-25T15:57:33.684 INFO:tasks.workunit.client.1.smithi155.stdout:3/159: mknod d1/d4/d10/d2a/c2f 0 2024-04-25T15:57:33.684 INFO:tasks.workunit.client.1.smithi155.stdout:7/163: symlink d2/dd/d13/l39 0 2024-04-25T15:57:33.684 INFO:tasks.workunit.client.1.smithi155.stdout:6/201: chown d0/d18/f1e 1979194545 1 2024-04-25T15:57:33.685 INFO:tasks.workunit.client.1.smithi155.stdout:7/164: chown d2/dd/d12/c18 104 1 2024-04-25T15:57:33.686 INFO:tasks.workunit.client.1.smithi155.stdout:6/202: stat d0/d1a/d21 0 2024-04-25T15:57:33.688 INFO:tasks.workunit.client.1.smithi155.stdout:4/127: creat da/dc/f2f x:0 0 0 2024-04-25T15:57:33.689 INFO:tasks.workunit.client.1.smithi155.stdout:3/160: mknod d1/d4/d10/d2a/c30 0 2024-04-25T15:57:33.690 INFO:tasks.workunit.client.1.smithi155.stdout:9/145: chown dc/d17/d18/c21 61009241 1 2024-04-25T15:57:33.690 INFO:tasks.workunit.client.1.smithi155.stdout:4/128: chown f7 4911 1 2024-04-25T15:57:33.691 INFO:tasks.workunit.client.1.smithi155.stdout:6/203: truncate d0/f1 82733 0 2024-04-25T15:57:33.691 INFO:tasks.workunit.client.1.smithi155.stdout:0/110: link d1/d3/d12/c1c d1/d6/d16/c31 0 2024-04-25T15:57:33.692 INFO:tasks.workunit.client.1.smithi155.stdout:7/165: mknod d2/dd/d30/c3a 0 2024-04-25T15:57:33.693 INFO:tasks.workunit.client.1.smithi155.stdout:3/161: stat d1/d4/f2c 0 2024-04-25T15:57:33.694 INFO:tasks.workunit.client.1.smithi155.stdout:4/129: mkdir da/d30 0 2024-04-25T15:57:33.695 INFO:tasks.workunit.client.1.smithi155.stdout:1/107: dwrite d1/d6/f7 [4194304,4194304] 0 2024-04-25T15:57:33.695 INFO:tasks.workunit.client.1.smithi155.stdout:6/204: mknod d0/d13/d43/c49 0 2024-04-25T15:57:33.696 INFO:tasks.workunit.client.1.smithi155.stdout:8/113: dread d2/d15/d18/f1a [0,4194304] 0 2024-04-25T15:57:33.697 INFO:tasks.workunit.client.1.smithi155.stdout:7/166: creat d2/dd/d13/d1c/f3b x:0 0 0 2024-04-25T15:57:33.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/108: write d1/fb [3748566,116208] 0 2024-04-25T15:57:33.700 INFO:tasks.workunit.client.1.smithi155.stdout:3/162: creat d1/d4/db/d28/f31 x:0 0 0 2024-04-25T15:57:33.710 INFO:tasks.workunit.client.1.smithi155.stdout:9/146: dwrite dc/d17/f2b [0,4194304] 0 2024-04-25T15:57:33.712 INFO:tasks.workunit.client.1.smithi155.stdout:0/111: dwrite d1/d3/d5/f23 [0,4194304] 0 2024-04-25T15:57:33.714 INFO:tasks.workunit.client.1.smithi155.stdout:4/130: dwrite da/dc/f1b [0,4194304] 0 2024-04-25T15:57:33.714 INFO:tasks.workunit.client.1.smithi155.stdout:0/112: write d1/d6/d29/f24 [1254276,76679] 0 2024-04-25T15:57:33.718 INFO:tasks.workunit.client.1.smithi155.stdout:3/163: symlink d1/d4/l32 0 2024-04-25T15:57:33.719 INFO:tasks.workunit.client.1.smithi155.stdout:9/147: symlink dc/d2f/l3d 0 2024-04-25T15:57:33.719 INFO:tasks.workunit.client.1.smithi155.stdout:6/205: link d0/d1a/d21/l36 d0/d1a/l4a 0 2024-04-25T15:57:33.721 INFO:tasks.workunit.client.1.smithi155.stdout:0/113: unlink d1/d1a/f1d 0 2024-04-25T15:57:33.721 INFO:tasks.workunit.client.1.smithi155.stdout:3/164: chown d1/d4/db/f11 0 1 2024-04-25T15:57:33.723 INFO:tasks.workunit.client.1.smithi155.stdout:7/167: getdents d2 0 2024-04-25T15:57:33.724 INFO:tasks.workunit.client.1.smithi155.stdout:0/114: readlink d1/d3/d5/l30 0 2024-04-25T15:57:33.725 INFO:tasks.workunit.client.1.smithi155.stdout:1/109: write d1/d6/f14 [4868358,92215] 0 2024-04-25T15:57:33.727 INFO:tasks.workunit.client.1.smithi155.stdout:4/131: dwrite da/dc/f1d [0,4194304] 0 2024-04-25T15:57:33.729 INFO:tasks.workunit.client.1.smithi155.stdout:3/165: rmdir d1/d4/d10 39 2024-04-25T15:57:33.729 INFO:tasks.workunit.client.1.smithi155.stdout:6/206: creat d0/d1a/d25/d2e/d39/f4b x:0 0 0 2024-04-25T15:57:33.732 INFO:tasks.workunit.client.1.smithi155.stdout:0/115: truncate d1/d3/fd 1792474 0 2024-04-25T15:57:33.734 INFO:tasks.workunit.client.1.smithi155.stdout:4/132: creat da/d23/d2a/f31 x:0 0 0 2024-04-25T15:57:33.737 INFO:tasks.workunit.client.1.smithi155.stdout:0/116: rename d1/d6/d29/f24 to d1/d3/d5/f32 0 2024-04-25T15:57:33.738 INFO:tasks.workunit.client.1.smithi155.stdout:4/133: symlink da/d30/l32 0 2024-04-25T15:57:33.738 INFO:tasks.workunit.client.1.smithi155.stdout:4/134: stat da/f16 0 2024-04-25T15:57:33.739 INFO:tasks.workunit.client.1.smithi155.stdout:4/135: stat da/d23/f26 0 2024-04-25T15:57:33.739 INFO:tasks.workunit.client.1.smithi155.stdout:3/166: rename d1/d4/d10/c23 to d1/d4/db/d28/d29/c33 0 2024-04-25T15:57:33.740 INFO:tasks.workunit.client.1.smithi155.stdout:4/136: truncate da/f16 4979515 0 2024-04-25T15:57:33.740 INFO:tasks.workunit.client.1.smithi155.stdout:3/167: stat d1/d4/f18 0 2024-04-25T15:57:33.740 INFO:tasks.workunit.client.1.smithi155.stdout:0/117: mknod d1/d6/d16/c33 0 2024-04-25T15:57:33.740 INFO:tasks.workunit.client.1.smithi155.stdout:4/137: readlink da/dc/d18/l1c 0 2024-04-25T15:57:33.741 INFO:tasks.workunit.client.1.smithi155.stdout:0/118: truncate d1/d6/f14 85679 0 2024-04-25T15:57:33.742 INFO:tasks.workunit.client.1.smithi155.stdout:4/138: truncate da/dc/d18/f27 225563 0 2024-04-25T15:57:33.742 INFO:tasks.workunit.client.1.smithi155.stdout:3/168: mknod d1/c34 0 2024-04-25T15:57:33.742 INFO:tasks.workunit.client.1.smithi155.stdout:0/119: write d1/d6/f1f [333280,69416] 0 2024-04-25T15:57:33.747 INFO:tasks.workunit.client.1.smithi155.stdout:3/169: creat d1/d4/db/f35 x:0 0 0 2024-04-25T15:57:33.747 INFO:tasks.workunit.client.1.smithi155.stdout:6/207: chown d0/f1 26 1 2024-04-25T15:57:33.747 INFO:tasks.workunit.client.1.smithi155.stdout:3/170: chown d1/d4 84 1 2024-04-25T15:57:33.748 INFO:tasks.workunit.client.1.smithi155.stdout:0/120: dread d1/d3/d5/f13 [0,4194304] 0 2024-04-25T15:57:33.748 INFO:tasks.workunit.client.1.smithi155.stdout:7/168: write d2/dd/d12/f20 [247115,114522] 0 2024-04-25T15:57:33.749 INFO:tasks.workunit.client.1.smithi155.stdout:6/208: chown d0/d1a/d21/c28 312 1 2024-04-25T15:57:33.749 INFO:tasks.workunit.client.1.smithi155.stdout:3/171: rmdir d1/d4 39 2024-04-25T15:57:33.750 INFO:tasks.workunit.client.1.smithi155.stdout:1/110: truncate d1/d6/f7 1961522 0 2024-04-25T15:57:33.750 INFO:tasks.workunit.client.1.smithi155.stdout:0/121: readlink d1/d3/d5/l30 0 2024-04-25T15:57:33.750 INFO:tasks.workunit.client.1.smithi155.stdout:6/209: readlink d0/l1f 0 2024-04-25T15:57:33.751 INFO:tasks.workunit.client.1.smithi155.stdout:6/210: chown d0/d1a/d45 45106 1 2024-04-25T15:57:33.753 INFO:tasks.workunit.client.1.smithi155.stdout:3/172: write d1/d4/db/f35 [68374,47417] 0 2024-04-25T15:57:33.754 INFO:tasks.workunit.client.1.smithi155.stdout:1/111: rename f0 to d1/d16/d1d/f2a 0 2024-04-25T15:57:33.758 INFO:tasks.workunit.client.1.smithi155.stdout:0/122: rename d1/d3/d5/f10 to d1/d1a/f34 0 2024-04-25T15:57:33.759 INFO:tasks.workunit.client.1.smithi155.stdout:7/169: link d2/dd/d13/f21 d2/dd/d13/d24/d35/f3c 0 2024-04-25T15:57:33.761 INFO:tasks.workunit.client.1.smithi155.stdout:6/211: rmdir d0/d18/d44 0 2024-04-25T15:57:33.762 INFO:tasks.workunit.client.1.smithi155.stdout:3/173: dwrite d1/d4/f2c [0,4194304] 0 2024-04-25T15:57:33.762 INFO:tasks.workunit.client.1.smithi155.stdout:0/123: creat d1/d6/f35 x:0 0 0 2024-04-25T15:57:33.763 INFO:tasks.workunit.client.1.smithi155.stdout:4/139: dread f7 [0,4194304] 0 2024-04-25T15:57:33.765 INFO:tasks.workunit.client.1.smithi155.stdout:7/170: read d2/f1d [1403603,3512] 0 2024-04-25T15:57:33.767 INFO:tasks.workunit.client.1.smithi155.stdout:1/112: dwrite d1/f15 [0,4194304] 0 2024-04-25T15:57:33.768 INFO:tasks.workunit.client.1.smithi155.stdout:6/212: write d0/ff [2005347,49839] 0 2024-04-25T15:57:33.770 INFO:tasks.workunit.client.1.smithi155.stdout:4/140: chown da/dc/d18/f27 17524 1 2024-04-25T15:57:33.772 INFO:tasks.workunit.client.1.smithi155.stdout:4/141: read f7 [2302970,34657] 0 2024-04-25T15:57:33.779 INFO:tasks.workunit.client.1.smithi155.stdout:7/171: getdents d2/dd 0 2024-04-25T15:57:33.780 INFO:tasks.workunit.client.1.smithi155.stdout:4/142: truncate da/dc/ff 707646 0 2024-04-25T15:57:33.781 INFO:tasks.workunit.client.1.smithi155.stdout:0/124: dwrite d1/d6/f22 [0,4194304] 0 2024-04-25T15:57:33.783 INFO:tasks.workunit.client.1.smithi155.stdout:3/174: dwrite d1/d4/db/d28/f31 [0,4194304] 0 2024-04-25T15:57:33.783 INFO:tasks.workunit.client.1.smithi155.stdout:7/172: mkdir d2/d26/d3d 0 2024-04-25T15:57:33.785 INFO:tasks.workunit.client.1.smithi155.stdout:6/213: dwrite d0/d18/d1b/f3b [0,4194304] 0 2024-04-25T15:57:33.787 INFO:tasks.workunit.client.1.smithi155.stdout:0/125: mknod d1/c36 0 2024-04-25T15:57:33.787 INFO:tasks.workunit.client.1.smithi155.stdout:6/214: readlink d0/d1a/d25/d2e/l3f 0 2024-04-25T15:57:33.791 INFO:tasks.workunit.client.1.smithi155.stdout:0/126: mknod d1/d3/c37 0 2024-04-25T15:57:33.793 INFO:tasks.workunit.client.1.smithi155.stdout:7/173: symlink d2/dd/d36/l3e 0 2024-04-25T15:57:33.794 INFO:tasks.workunit.client.1.smithi155.stdout:7/174: fsync d2/f1b 0 2024-04-25T15:57:33.795 INFO:tasks.workunit.client.1.smithi155.stdout:3/175: rename d1/d4/d10/d2a/c2f to d1/d4/d10/c36 0 2024-04-25T15:57:33.799 INFO:tasks.workunit.client.1.smithi155.stdout:6/215: dread d0/d13/f17 [0,4194304] 0 2024-04-25T15:57:33.800 INFO:tasks.workunit.client.1.smithi155.stdout:4/143: dwrite da/f14 [0,4194304] 0 2024-04-25T15:57:33.802 INFO:tasks.workunit.client.1.smithi155.stdout:7/175: rename d2/f10 to d2/dd/d13/d24/d35/f3f 0 2024-04-25T15:57:33.802 INFO:tasks.workunit.client.1.smithi155.stdout:0/127: dwrite d1/f2b [0,4194304] 0 2024-04-25T15:57:33.803 INFO:tasks.workunit.client.1.smithi155.stdout:3/176: creat d1/d4/f37 x:0 0 0 2024-04-25T15:57:33.805 INFO:tasks.workunit.client.1.smithi155.stdout:3/177: fdatasync d1/d4/d25/f2b 0 2024-04-25T15:57:33.807 INFO:tasks.workunit.client.1.smithi155.stdout:3/178: chown d1/d4/db/f35 2 1 2024-04-25T15:57:33.808 INFO:tasks.workunit.client.1.smithi155.stdout:4/144: creat da/f33 x:0 0 0 2024-04-25T15:57:33.809 INFO:tasks.workunit.client.1.smithi155.stdout:1/113: dread d1/f8 [0,4194304] 0 2024-04-25T15:57:33.811 INFO:tasks.workunit.client.1.smithi155.stdout:0/128: rename d1/d3/d5/c11 to d1/d1a/c38 0 2024-04-25T15:57:33.813 INFO:tasks.workunit.client.1.smithi155.stdout:3/179: creat d1/d4/d25/f38 x:0 0 0 2024-04-25T15:57:33.813 INFO:tasks.workunit.client.1.smithi155.stdout:6/216: mkdir d0/d13/d34/d38/d4c 0 2024-04-25T15:57:33.814 INFO:tasks.workunit.client.1.smithi155.stdout:1/114: mknod d1/c2b 0 2024-04-25T15:57:33.815 INFO:tasks.workunit.client.1.smithi155.stdout:0/129: mknod d1/d3/c39 0 2024-04-25T15:57:33.816 INFO:tasks.workunit.client.1.smithi155.stdout:0/130: read d1/d6/f22 [2003862,71536] 0 2024-04-25T15:57:33.816 INFO:tasks.workunit.client.1.smithi155.stdout:3/180: mkdir d1/d4/db/d28/d39 0 2024-04-25T15:57:33.818 INFO:tasks.workunit.client.1.smithi155.stdout:6/217: creat d0/d1a/d37/f4d x:0 0 0 2024-04-25T15:57:33.819 INFO:tasks.workunit.client.1.smithi155.stdout:3/181: write d1/d4/db/d28/f31 [2750852,51060] 0 2024-04-25T15:57:33.823 INFO:tasks.workunit.client.1.smithi155.stdout:6/218: truncate d0/d13/d43/f42 539539 0 2024-04-25T15:57:33.825 INFO:tasks.workunit.client.1.smithi155.stdout:3/182: mknod d1/d4/d10/c3a 0 2024-04-25T15:57:33.825 INFO:tasks.workunit.client.1.smithi155.stdout:1/115: dwrite d1/f11 [0,4194304] 0 2024-04-25T15:57:33.826 INFO:tasks.workunit.client.1.smithi155.stdout:6/219: read d0/d1a/d37/f3e [312864,76705] 0 2024-04-25T15:57:33.828 INFO:tasks.workunit.client.1.smithi155.stdout:7/176: write d2/f1d [2687070,62511] 0 2024-04-25T15:57:33.829 INFO:tasks.workunit.client.1.smithi155.stdout:7/177: chown d2/f2e 0 1 2024-04-25T15:57:33.831 INFO:tasks.workunit.client.1.smithi155.stdout:3/183: stat d1/d4/d10/c36 0 2024-04-25T15:57:33.831 INFO:tasks.workunit.client.1.smithi155.stdout:1/116: creat d1/d16/f2c x:0 0 0 2024-04-25T15:57:33.832 INFO:tasks.workunit.client.1.smithi155.stdout:1/117: chown d1/d16/d1d 23707552 1 2024-04-25T15:57:33.832 INFO:tasks.workunit.client.1.smithi155.stdout:7/178: creat d2/dd/d13/d1c/f40 x:0 0 0 2024-04-25T15:57:33.833 INFO:tasks.workunit.client.1.smithi155.stdout:0/131: dread d1/d3/fd [0,4194304] 0 2024-04-25T15:57:33.835 INFO:tasks.workunit.client.1.smithi155.stdout:0/132: chown d1/d6/d16/l27 7685299 1 2024-04-25T15:57:33.835 INFO:tasks.workunit.client.1.smithi155.stdout:3/184: creat d1/d4/db/d20/f3b x:0 0 0 2024-04-25T15:57:33.835 INFO:tasks.workunit.client.1.smithi155.stdout:7/179: rmdir d2/dd/d13 39 2024-04-25T15:57:33.836 INFO:tasks.workunit.client.1.smithi155.stdout:3/185: write d1/f16 [104431,54172] 0 2024-04-25T15:57:33.842 INFO:tasks.workunit.client.1.smithi155.stdout:3/186: creat d1/d4/d10/d2a/f3c x:0 0 0 2024-04-25T15:57:33.842 INFO:tasks.workunit.client.1.smithi155.stdout:6/220: truncate d0/d13/f20 1351714 0 2024-04-25T15:57:33.844 INFO:tasks.workunit.client.1.smithi155.stdout:0/133: dwrite d1/d6/f14 [0,4194304] 0 2024-04-25T15:57:33.844 INFO:tasks.workunit.client.1.smithi155.stdout:1/118: truncate d1/d6/f14 4770935 0 2024-04-25T15:57:33.845 INFO:tasks.workunit.client.1.smithi155.stdout:0/134: truncate d1/d6/f35 697453 0 2024-04-25T15:57:33.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/187: truncate d1/d4/d10/d21/f22 884220 0 2024-04-25T15:57:33.851 INFO:tasks.workunit.client.1.smithi155.stdout:6/221: mknod d0/d18/c4e 0 2024-04-25T15:57:33.853 INFO:tasks.workunit.client.1.smithi155.stdout:0/135: creat d1/d6/d29/f3a x:0 0 0 2024-04-25T15:57:33.854 INFO:tasks.workunit.client.1.smithi155.stdout:3/188: mknod d1/d4/db/d28/c3d 0 2024-04-25T15:57:33.854 INFO:tasks.workunit.client.1.smithi155.stdout:7/180: dwrite d2/f8 [4194304,4194304] 0 2024-04-25T15:57:33.856 INFO:tasks.workunit.client.1.smithi155.stdout:1/119: dwrite d1/d16/d1d/f23 [0,4194304] 0 2024-04-25T15:57:33.856 INFO:tasks.workunit.client.1.smithi155.stdout:3/189: fdatasync d1/d4/f37 0 2024-04-25T15:57:33.862 INFO:tasks.workunit.client.1.smithi155.stdout:6/222: creat d0/f4f x:0 0 0 2024-04-25T15:57:33.864 INFO:tasks.workunit.client.1.smithi155.stdout:7/181: mknod d2/dd/c41 0 2024-04-25T15:57:33.865 INFO:tasks.workunit.client.1.smithi155.stdout:2/260: sync 2024-04-25T15:57:33.867 INFO:tasks.workunit.client.1.smithi155.stdout:3/190: link d1/d4/db/d28/c3d d1/d4/d10/d2a/c3e 0 2024-04-25T15:57:33.868 INFO:tasks.workunit.client.1.smithi155.stdout:1/120: dwrite d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:33.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/261: creat d7/db/d2e/f50 x:0 0 0 2024-04-25T15:57:33.870 INFO:tasks.workunit.client.1.smithi155.stdout:3/191: rename d1/d4/d10 to d1/d4/d10/d21/d3f 22 2024-04-25T15:57:33.871 INFO:tasks.workunit.client.1.smithi155.stdout:2/262: chown d7/db/f4a 11677524 1 2024-04-25T15:57:33.873 INFO:tasks.workunit.client.1.smithi155.stdout:1/121: creat d1/d6/f2d x:0 0 0 2024-04-25T15:57:33.873 INFO:tasks.workunit.client.1.smithi155.stdout:2/263: chown d7/f2c 1498 1 2024-04-25T15:57:33.874 INFO:tasks.workunit.client.1.smithi155.stdout:6/223: dwrite d0/f3 [0,4194304] 0 2024-04-25T15:57:33.875 INFO:tasks.workunit.client.1.smithi155.stdout:3/192: truncate d1/d4/db/f11 1899325 0 2024-04-25T15:57:33.876 INFO:tasks.workunit.client.1.smithi155.stdout:0/136: dwrite d1/d6/f22 [0,4194304] 0 2024-04-25T15:57:33.879 INFO:tasks.workunit.client.1.smithi155.stdout:1/122: rename d1/c2b to d1/c2e 0 2024-04-25T15:57:33.883 INFO:tasks.workunit.client.1.smithi155.stdout:0/137: unlink d1/d6/d29/f2d 0 2024-04-25T15:57:33.884 INFO:tasks.workunit.client.1.smithi155.stdout:0/138: dread - d1/d3/d5/f26 zero size 2024-04-25T15:57:33.886 INFO:tasks.workunit.client.1.smithi155.stdout:2/264: creat d7/db/f51 x:0 0 0 2024-04-25T15:57:33.890 INFO:tasks.workunit.client.1.smithi155.stdout:0/139: rename d1/f2b to d1/d3/d12/f3b 0 2024-04-25T15:57:33.892 INFO:tasks.workunit.client.1.smithi155.stdout:2/265: mknod d7/c52 0 2024-04-25T15:57:33.892 INFO:tasks.workunit.client.1.smithi155.stdout:1/123: link d1/f8 d1/d6/f2f 0 2024-04-25T15:57:33.894 INFO:tasks.workunit.client.1.smithi155.stdout:0/140: creat d1/f3c x:0 0 0 2024-04-25T15:57:33.896 INFO:tasks.workunit.client.1.smithi155.stdout:2/266: symlink d7/db/l53 0 2024-04-25T15:57:33.897 INFO:tasks.workunit.client.1.smithi155.stdout:6/224: dwrite d0/d13/f17 [0,4194304] 0 2024-04-25T15:57:33.898 INFO:tasks.workunit.client.1.smithi155.stdout:0/141: mkdir d1/d3/d3d 0 2024-04-25T15:57:33.902 INFO:tasks.workunit.client.1.smithi155.stdout:1/124: dread d1/d6/f2f [0,4194304] 0 2024-04-25T15:57:33.902 INFO:tasks.workunit.client.1.smithi155.stdout:2/267: write d7/d23/f20 [537649,80861] 0 2024-04-25T15:57:33.903 INFO:tasks.workunit.client.1.smithi155.stdout:6/225: mknod d0/d1a/c50 0 2024-04-25T15:57:33.907 INFO:tasks.workunit.client.1.smithi155.stdout:0/142: symlink d1/d3/l3e 0 2024-04-25T15:57:33.908 INFO:tasks.workunit.client.1.smithi155.stdout:2/268: write d7/f4f [4031420,38136] 0 2024-04-25T15:57:33.909 INFO:tasks.workunit.client.1.smithi155.stdout:1/125: mkdir d1/d16/d1d/d30 0 2024-04-25T15:57:33.910 INFO:tasks.workunit.client.1.smithi155.stdout:1/126: dread - d1/d16/f1f zero size 2024-04-25T15:57:33.911 INFO:tasks.workunit.client.1.smithi155.stdout:6/226: dwrite d0/d1a/d37/f4d [0,4194304] 0 2024-04-25T15:57:33.913 INFO:tasks.workunit.client.1.smithi155.stdout:2/269: chown d7/f16 16677646 1 2024-04-25T15:57:33.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/227: dread - d0/d1a/d21/f47 zero size 2024-04-25T15:57:33.913 INFO:tasks.workunit.client.1.smithi155.stdout:0/143: mkdir d1/d3f 0 2024-04-25T15:57:33.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/228: fdatasync d0/d1a/d21/f47 0 2024-04-25T15:57:33.914 INFO:tasks.workunit.client.1.smithi155.stdout:1/127: unlink d1/l28 0 2024-04-25T15:57:33.921 INFO:tasks.workunit.client.1.smithi155.stdout:2/270: creat d7/db/d29/f54 x:0 0 0 2024-04-25T15:57:33.923 INFO:tasks.workunit.client.1.smithi155.stdout:1/128: link d1/d16/f2c d1/d6/f31 0 2024-04-25T15:57:33.925 INFO:tasks.workunit.client.1.smithi155.stdout:0/144: dwrite d1/d3/f17 [0,4194304] 0 2024-04-25T15:57:33.926 INFO:tasks.workunit.client.1.smithi155.stdout:6/229: dwrite d0/f15 [0,4194304] 0 2024-04-25T15:57:33.930 INFO:tasks.workunit.client.1.smithi155.stdout:6/230: dread d0/d1a/f1c [0,4194304] 0 2024-04-25T15:57:33.936 INFO:tasks.workunit.client.1.smithi155.stdout:6/231: rename d0/d18/d1b to d0/d1a/d25/d51 0 2024-04-25T15:57:33.937 INFO:tasks.workunit.client.1.smithi155.stdout:0/145: dwrite d1/d3/d5/f26 [0,4194304] 0 2024-04-25T15:57:33.938 INFO:tasks.workunit.client.1.smithi155.stdout:0/146: write d1/d3/d5/f2c [171876,50847] 0 2024-04-25T15:57:33.940 INFO:tasks.workunit.client.1.smithi155.stdout:0/147: write d1/f3c [317489,77734] 0 2024-04-25T15:57:33.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/232: dwrite d0/d1a/d25/d2e/d39/f4b [0,4194304] 0 2024-04-25T15:57:33.947 INFO:tasks.workunit.client.1.smithi155.stdout:6/233: dread d0/d1a/f1c [0,4194304] 0 2024-04-25T15:57:33.950 INFO:tasks.workunit.client.1.smithi155.stdout:6/234: creat d0/d1a/d45/f52 x:0 0 0 2024-04-25T15:57:33.951 INFO:tasks.workunit.client.1.smithi155.stdout:6/235: write d0/f46 [183979,129406] 0 2024-04-25T15:57:33.954 INFO:tasks.workunit.client.1.smithi155.stdout:2/271: dread d7/f2d [0,4194304] 0 2024-04-25T15:57:33.955 INFO:tasks.workunit.client.1.smithi155.stdout:6/236: creat d0/f53 x:0 0 0 2024-04-25T15:57:33.957 INFO:tasks.workunit.client.1.smithi155.stdout:6/237: unlink d0/d18/c2c 0 2024-04-25T15:57:33.959 INFO:tasks.workunit.client.1.smithi155.stdout:6/238: mkdir d0/d18/d54 0 2024-04-25T15:57:33.962 INFO:tasks.workunit.client.1.smithi155.stdout:2/272: dwrite d7/db/dd/f38 [0,4194304] 0 2024-04-25T15:57:33.963 INFO:tasks.workunit.client.1.smithi155.stdout:6/239: creat d0/d1a/d25/d2e/d39/f55 x:0 0 0 2024-04-25T15:57:33.965 INFO:tasks.workunit.client.1.smithi155.stdout:6/240: mkdir d0/d13/d43/d56 0 2024-04-25T15:57:33.967 INFO:tasks.workunit.client.1.smithi155.stdout:6/241: mkdir d0/d1a/d45/d57 0 2024-04-25T15:57:33.968 INFO:tasks.workunit.client.1.smithi155.stdout:6/242: dread - d0/f4f zero size 2024-04-25T15:57:33.968 INFO:tasks.workunit.client.1.smithi155.stdout:6/243: write d0/d13/d43/f33 [768069,107395] 0 2024-04-25T15:57:33.971 INFO:tasks.workunit.client.1.smithi155.stdout:6/244: symlink d0/d13/d43/l58 0 2024-04-25T15:57:33.971 INFO:tasks.workunit.client.1.smithi155.stdout:6/245: chown d0/d1a/d25/d2e/f31 2 1 2024-04-25T15:57:33.972 INFO:tasks.workunit.client.1.smithi155.stdout:6/246: truncate d0/f4f 552705 0 2024-04-25T15:57:33.972 INFO:tasks.workunit.client.1.smithi155.stdout:6/247: stat d0/d1a/d25/d51/f3b 0 2024-04-25T15:57:33.973 INFO:tasks.workunit.client.1.smithi155.stdout:6/248: truncate d0/d1a/d21/f47 386883 0 2024-04-25T15:57:33.973 INFO:tasks.workunit.client.1.smithi155.stdout:6/249: stat d0/f15 0 2024-04-25T15:57:33.978 INFO:tasks.workunit.client.1.smithi155.stdout:6/250: dread d0/d1a/d25/d51/f3b [0,4194304] 0 2024-04-25T15:57:33.986 INFO:tasks.workunit.client.1.smithi155.stdout:6/251: dwrite d0/d1a/d25/d2e/d39/f55 [0,4194304] 0 2024-04-25T15:57:33.989 INFO:tasks.workunit.client.1.smithi155.stdout:6/252: symlink d0/d13/l59 0 2024-04-25T15:57:33.989 INFO:tasks.workunit.client.1.smithi155.stdout:6/253: stat d0/f1 0 2024-04-25T15:57:33.999 INFO:tasks.workunit.client.1.smithi155.stdout:6/254: dwrite d0/f1 [0,4194304] 0 2024-04-25T15:57:34.008 INFO:tasks.workunit.client.1.smithi155.stdout:6/255: dwrite d0/d1a/d25/d2e/f31 [0,4194304] 0 2024-04-25T15:57:34.013 INFO:tasks.workunit.client.1.smithi155.stdout:6/256: rename d0/f53 to d0/d1a/d45/d57/f5a 0 2024-04-25T15:57:34.014 INFO:tasks.workunit.client.1.smithi155.stdout:6/257: rmdir d0/d13/d34 39 2024-04-25T15:57:34.016 INFO:tasks.workunit.client.1.smithi155.stdout:6/258: creat d0/d1a/d21/f5b x:0 0 0 2024-04-25T15:57:34.017 INFO:tasks.workunit.client.1.smithi155.stdout:6/259: stat d0/d1a/d21/c28 0 2024-04-25T15:57:34.018 INFO:tasks.workunit.client.1.smithi155.stdout:6/260: chown d0/d13/d34/d38 2474021 1 2024-04-25T15:57:34.020 INFO:tasks.workunit.client.1.smithi155.stdout:6/261: symlink d0/d13/d34/d38/l5c 0 2024-04-25T15:57:34.022 INFO:tasks.workunit.client.1.smithi155.stdout:6/262: mknod d0/d13/d43/c5d 0 2024-04-25T15:57:34.025 INFO:tasks.workunit.client.1.smithi155.stdout:6/263: link d0/d13/d34/d38/l5c d0/d1a/d25/d2e/d39/l5e 0 2024-04-25T15:57:34.027 INFO:tasks.workunit.client.1.smithi155.stdout:6/264: mkdir d0/d1a/d45/d57/d5f 0 2024-04-25T15:57:34.040 INFO:tasks.workunit.client.1.smithi155.stdout:6/265: dwrite d0/d1a/d37/f3e [0,4194304] 0 2024-04-25T15:57:34.042 INFO:tasks.workunit.client.1.smithi155.stdout:6/266: write d0/d1a/d45/d57/f5a [297000,43531] 0 2024-04-25T15:57:34.046 INFO:tasks.workunit.client.1.smithi155.stdout:6/267: unlink d0/c16 0 2024-04-25T15:57:34.046 INFO:tasks.workunit.client.1.smithi155.stdout:6/268: write d0/d13/f17 [2401053,83801] 0 2024-04-25T15:57:34.049 INFO:tasks.workunit.client.1.smithi155.stdout:6/269: symlink d0/d18/l60 0 2024-04-25T15:57:34.053 INFO:tasks.workunit.client.1.smithi155.stdout:6/270: write d0/f10 [991736,100366] 0 2024-04-25T15:57:34.053 INFO:tasks.workunit.client.1.smithi155.stdout:6/271: chown d0/d1a/d25/d51/f3b 0 1 2024-04-25T15:57:34.054 INFO:tasks.workunit.client.1.smithi155.stdout:6/272: read - d0/d18/f23 zero size 2024-04-25T15:57:34.058 INFO:tasks.workunit.client.1.smithi155.stdout:6/273: dread d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:34.060 INFO:tasks.workunit.client.1.smithi155.stdout:6/274: mkdir d0/d1a/d45/d61 0 2024-04-25T15:57:34.063 INFO:tasks.workunit.client.1.smithi155.stdout:6/275: dread d0/d13/f17 [0,4194304] 0 2024-04-25T15:57:34.066 INFO:tasks.workunit.client.1.smithi155.stdout:6/276: mknod d0/d1a/d45/d57/d5f/c62 0 2024-04-25T15:57:34.067 INFO:tasks.workunit.client.1.smithi155.stdout:6/277: write d0/d1a/d45/d57/f5a [391145,119097] 0 2024-04-25T15:57:34.071 INFO:tasks.workunit.client.1.smithi155.stdout:6/278: rmdir d0/d1a/d21 39 2024-04-25T15:57:34.073 INFO:tasks.workunit.client.1.smithi155.stdout:6/279: stat d0/d13/d34/d38/l5c 0 2024-04-25T15:57:34.079 INFO:tasks.workunit.client.1.smithi155.stdout:6/280: dwrite d0/f9 [0,4194304] 0 2024-04-25T15:57:34.089 INFO:tasks.workunit.client.1.smithi155.stdout:6/281: rename d0/d1a/d45/d57/d5f to d0/d18/d63 0 2024-04-25T15:57:34.091 INFO:tasks.workunit.client.1.smithi155.stdout:6/282: rename d0/f9 to d0/d13/d43/f64 0 2024-04-25T15:57:34.092 INFO:tasks.workunit.client.1.smithi155.stdout:6/283: chown d0/f15 8345 1 2024-04-25T15:57:34.093 INFO:tasks.workunit.client.1.smithi155.stdout:6/284: rmdir d0/d1a/d45/d57 39 2024-04-25T15:57:34.095 INFO:tasks.workunit.client.1.smithi155.stdout:6/285: mknod d0/d1a/c65 0 2024-04-25T15:57:34.098 INFO:tasks.workunit.client.1.smithi155.stdout:6/286: link d0/l1f d0/d13/l66 0 2024-04-25T15:57:34.104 INFO:tasks.workunit.client.1.smithi155.stdout:6/287: getdents d0/d1a/d45/d57 0 2024-04-25T15:57:34.110 INFO:tasks.workunit.client.1.smithi155.stdout:6/288: dwrite d0/d1a/d25/f2d [0,4194304] 0 2024-04-25T15:57:34.116 INFO:tasks.workunit.client.1.smithi155.stdout:6/289: truncate d0/d1a/d37/f4d 1476872 0 2024-04-25T15:57:34.118 INFO:tasks.workunit.client.1.smithi155.stdout:6/290: creat d0/d1a/d25/d2e/f67 x:0 0 0 2024-04-25T15:57:34.128 INFO:tasks.workunit.client.1.smithi155.stdout:6/291: truncate d0/ff 1189514 0 2024-04-25T15:57:34.129 INFO:tasks.workunit.client.1.smithi155.stdout:6/292: dread - d0/d1a/d45/f52 zero size 2024-04-25T15:57:34.131 INFO:tasks.workunit.client.1.smithi155.stdout:6/293: symlink d0/d1a/l68 0 2024-04-25T15:57:34.133 INFO:tasks.workunit.client.1.smithi155.stdout:6/294: symlink d0/d1a/d21/l69 0 2024-04-25T15:57:34.133 INFO:tasks.workunit.client.1.smithi155.stdout:6/295: chown d0/d1a/d25/d51 276 1 2024-04-25T15:57:34.137 INFO:tasks.workunit.client.1.smithi155.stdout:6/296: dread d0/d13/d43/f33 [0,4194304] 0 2024-04-25T15:57:34.140 INFO:tasks.workunit.client.1.smithi155.stdout:6/297: creat d0/d13/f6a x:0 0 0 2024-04-25T15:57:34.141 INFO:tasks.workunit.client.1.smithi155.stdout:6/298: truncate d0/d1a/d21/f32 433860 0 2024-04-25T15:57:34.141 INFO:tasks.workunit.client.1.smithi155.stdout:6/299: fdatasync d0/f10 0 2024-04-25T15:57:34.144 INFO:tasks.workunit.client.1.smithi155.stdout:6/300: creat d0/d1a/f6b x:0 0 0 2024-04-25T15:57:34.144 INFO:tasks.workunit.client.1.smithi155.stdout:6/301: read - d0/d1a/d45/f52 zero size 2024-04-25T15:57:34.146 INFO:tasks.workunit.client.1.smithi155.stdout:6/302: mkdir d0/d13/d34/d6c 0 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:4/145: sync 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:5/148: sync 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:7/182: sync 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:6/303: dread d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:3/193: sync 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:9/148: sync 2024-04-25T15:57:34.150 INFO:tasks.workunit.client.1.smithi155.stdout:8/114: sync 2024-04-25T15:57:34.152 INFO:tasks.workunit.client.1.smithi155.stdout:9/149: write dc/d13/f3b [24827,35655] 0 2024-04-25T15:57:34.153 INFO:tasks.workunit.client.1.smithi155.stdout:4/146: truncate da/f33 991084 0 2024-04-25T15:57:34.153 INFO:tasks.workunit.client.1.smithi155.stdout:8/115: chown d2/l13 245897 1 2024-04-25T15:57:34.154 INFO:tasks.workunit.client.1.smithi155.stdout:6/304: mknod d0/d13/d43/c6d 0 2024-04-25T15:57:34.155 INFO:tasks.workunit.client.1.smithi155.stdout:3/194: truncate d1/d4/d10/f17 1658862 0 2024-04-25T15:57:34.155 INFO:tasks.workunit.client.1.smithi155.stdout:7/183: symlink d2/dd/d13/d1c/l42 0 2024-04-25T15:57:34.156 INFO:tasks.workunit.client.1.smithi155.stdout:9/150: mknod dc/d17/d2a/c3e 0 2024-04-25T15:57:34.157 INFO:tasks.workunit.client.1.smithi155.stdout:4/147: mkdir da/dc/d18/d34 0 2024-04-25T15:57:34.160 INFO:tasks.workunit.client.1.smithi155.stdout:7/184: creat d2/dd/d36/f43 x:0 0 0 2024-04-25T15:57:34.161 INFO:tasks.workunit.client.1.smithi155.stdout:8/116: dread d2/fa [0,4194304] 0 2024-04-25T15:57:34.163 INFO:tasks.workunit.client.1.smithi155.stdout:4/148: symlink da/l35 0 2024-04-25T15:57:34.167 INFO:tasks.workunit.client.1.smithi155.stdout:6/305: dwrite d0/f1 [0,4194304] 0 2024-04-25T15:57:34.168 INFO:tasks.workunit.client.1.smithi155.stdout:4/149: mknod da/d30/c36 0 2024-04-25T15:57:34.170 INFO:tasks.workunit.client.1.smithi155.stdout:4/150: chown da/d30 1770005954 1 2024-04-25T15:57:34.170 INFO:tasks.workunit.client.1.smithi155.stdout:7/185: getdents d2/d26/d3d 0 2024-04-25T15:57:34.173 INFO:tasks.workunit.client.1.smithi155.stdout:3/195: dwrite d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:34.174 INFO:tasks.workunit.client.1.smithi155.stdout:9/151: dwrite dc/d11/f27 [0,4194304] 0 2024-04-25T15:57:34.176 INFO:tasks.workunit.client.1.smithi155.stdout:5/149: truncate d0/d3/d15/f16 2622946 0 2024-04-25T15:57:34.178 INFO:tasks.workunit.client.1.smithi155.stdout:9/152: truncate dc/d13/f3a 476318 0 2024-04-25T15:57:34.181 INFO:tasks.workunit.client.1.smithi155.stdout:8/117: dwrite d2/d15/d18/f1a [0,4194304] 0 2024-04-25T15:57:34.181 INFO:tasks.workunit.client.1.smithi155.stdout:6/306: rename d0/d1a/d21/l35 to d0/d1a/d21/l6e 0 2024-04-25T15:57:34.185 INFO:tasks.workunit.client.1.smithi155.stdout:9/153: dwrite dc/d17/f1b [4194304,4194304] 0 2024-04-25T15:57:34.187 INFO:tasks.workunit.client.1.smithi155.stdout:4/151: mknod da/dc/d18/d34/c37 0 2024-04-25T15:57:34.190 INFO:tasks.workunit.client.1.smithi155.stdout:3/196: read d1/f16 [72732,110672] 0 2024-04-25T15:57:34.193 INFO:tasks.workunit.client.1.smithi155.stdout:9/154: mknod dc/d11/d30/c3f 0 2024-04-25T15:57:34.195 INFO:tasks.workunit.client.1.smithi155.stdout:4/152: rename da/f33 to da/d30/f38 0 2024-04-25T15:57:34.200 INFO:tasks.workunit.client.1.smithi155.stdout:8/118: creat d2/f28 x:0 0 0 2024-04-25T15:57:34.200 INFO:tasks.workunit.client.1.smithi155.stdout:6/307: getdents d0/d1a/d25/d51 0 2024-04-25T15:57:34.202 INFO:tasks.workunit.client.1.smithi155.stdout:9/155: link dc/d2f/l34 dc/d13/d2e/l40 0 2024-04-25T15:57:34.203 INFO:tasks.workunit.client.1.smithi155.stdout:8/119: dread d2/fa [0,4194304] 0 2024-04-25T15:57:34.204 INFO:tasks.workunit.client.1.smithi155.stdout:3/197: getdents d1/d4/db 0 2024-04-25T15:57:34.205 INFO:tasks.workunit.client.1.smithi155.stdout:6/308: mkdir d0/d13/d6f 0 2024-04-25T15:57:34.207 INFO:tasks.workunit.client.1.smithi155.stdout:9/156: write dc/f14 [2381489,106335] 0 2024-04-25T15:57:34.207 INFO:tasks.workunit.client.1.smithi155.stdout:3/198: mknod d1/d4/db/d20/c40 0 2024-04-25T15:57:34.209 INFO:tasks.workunit.client.1.smithi155.stdout:1/129: sync 2024-04-25T15:57:34.209 INFO:tasks.workunit.client.1.smithi155.stdout:0/148: sync 2024-04-25T15:57:34.211 INFO:tasks.workunit.client.1.smithi155.stdout:6/309: rename d0/d13/d43/c49 to d0/d1a/d25/d51/c70 0 2024-04-25T15:57:34.213 INFO:tasks.workunit.client.1.smithi155.stdout:1/130: truncate d1/d16/d1d/f25 1778580 0 2024-04-25T15:57:34.213 INFO:tasks.workunit.client.1.smithi155.stdout:6/310: readlink d0/d1a/d25/d2e/l3f 0 2024-04-25T15:57:34.213 INFO:tasks.workunit.client.1.smithi155.stdout:8/120: dwrite d2/f14 [8388608,4194304] 0 2024-04-25T15:57:34.234 INFO:tasks.workunit.client.1.smithi155.stdout:0/149: link d1/d3/d12/f3b d1/d1a/f40 0 2024-04-25T15:57:34.234 INFO:tasks.workunit.client.1.smithi155.stdout:1/131: mkdir d1/d32 0 2024-04-25T15:57:34.236 INFO:tasks.workunit.client.1.smithi155.stdout:4/153: truncate da/f16 4811709 0 2024-04-25T15:57:34.237 INFO:tasks.workunit.client.1.smithi155.stdout:6/311: mknod d0/d13/d34/d38/c71 0 2024-04-25T15:57:34.238 INFO:tasks.workunit.client.1.smithi155.stdout:8/121: rename d2/d5/f19 to d2/d5/f29 0 2024-04-25T15:57:34.240 INFO:tasks.workunit.client.1.smithi155.stdout:1/132: rename d1/d16/d1d/d30 to d1/d16/d1d/d33 0 2024-04-25T15:57:34.240 INFO:tasks.workunit.client.1.smithi155.stdout:7/186: dwrite d2/dd/d13/d24/d35/f3c [0,4194304] 0 2024-04-25T15:57:34.242 INFO:tasks.workunit.client.1.smithi155.stdout:3/199: getdents d1 0 2024-04-25T15:57:34.243 INFO:tasks.workunit.client.1.smithi155.stdout:0/150: mkdir d1/d41 0 2024-04-25T15:57:34.247 INFO:tasks.workunit.client.1.smithi155.stdout:4/154: rename da/dc/f13 to da/d23/d2a/f39 0 2024-04-25T15:57:34.247 INFO:tasks.workunit.client.1.smithi155.stdout:5/150: dwrite d0/d3/d15/d13/f19 [0,4194304] 0 2024-04-25T15:57:34.248 INFO:tasks.workunit.client.1.smithi155.stdout:3/200: chown d1/d4/c2e 24 1 2024-04-25T15:57:34.249 INFO:tasks.workunit.client.1.smithi155.stdout:0/151: symlink d1/d3/d12/l42 0 2024-04-25T15:57:34.249 INFO:tasks.workunit.client.1.smithi155.stdout:3/201: fdatasync d1/d4/db/d20/f3b 0 2024-04-25T15:57:34.255 INFO:tasks.workunit.client.1.smithi155.stdout:4/155: mkdir da/d23/d3a 0 2024-04-25T15:57:34.255 INFO:tasks.workunit.client.1.smithi155.stdout:6/312: dwrite d0/f3 [0,4194304] 0 2024-04-25T15:57:34.256 INFO:tasks.workunit.client.1.smithi155.stdout:0/152: creat d1/d3/f43 x:0 0 0 2024-04-25T15:57:34.258 INFO:tasks.workunit.client.1.smithi155.stdout:7/187: getdents d2/dd/d13 0 2024-04-25T15:57:34.259 INFO:tasks.workunit.client.1.smithi155.stdout:4/156: dread - da/dc/f2f zero size 2024-04-25T15:57:34.268 INFO:tasks.workunit.client.1.smithi155.stdout:7/188: write d2/dd/d13/f2c [485538,92865] 0 2024-04-25T15:57:34.268 INFO:tasks.workunit.client.1.smithi155.stdout:5/151: dwrite d0/f12 [0,4194304] 0 2024-04-25T15:57:34.269 INFO:tasks.workunit.client.1.smithi155.stdout:6/313: symlink d0/d13/l72 0 2024-04-25T15:57:34.269 INFO:tasks.workunit.client.1.smithi155.stdout:4/157: creat da/f3b x:0 0 0 2024-04-25T15:57:34.270 INFO:tasks.workunit.client.1.smithi155.stdout:0/153: rename d1/d1a/f40 to d1/d41/f44 0 2024-04-25T15:57:34.273 INFO:tasks.workunit.client.1.smithi155.stdout:4/158: fsync da/f11 0 2024-04-25T15:57:34.274 INFO:tasks.workunit.client.1.smithi155.stdout:3/202: dwrite d1/d4/d25/f2b [0,4194304] 0 2024-04-25T15:57:34.276 INFO:tasks.workunit.client.1.smithi155.stdout:0/154: rmdir d1/d6/d16 39 2024-04-25T15:57:34.276 INFO:tasks.workunit.client.1.smithi155.stdout:4/159: write da/f21 [655868,90007] 0 2024-04-25T15:57:34.280 INFO:tasks.workunit.client.1.smithi155.stdout:5/152: rename d0/d3/d15/d13/f2a to d0/d3/d2c/f2f 0 2024-04-25T15:57:34.282 INFO:tasks.workunit.client.1.smithi155.stdout:0/155: readlink d1/d6/d16/l27 0 2024-04-25T15:57:34.287 INFO:tasks.workunit.client.1.smithi155.stdout:6/314: rename d0/d1a/d45/d57 to d0/d1a/d21/d73 0 2024-04-25T15:57:34.288 INFO:tasks.workunit.client.1.smithi155.stdout:1/133: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:57:34.290 INFO:tasks.workunit.client.1.smithi155.stdout:7/189: dwrite d2/dd/d13/d1c/f22 [0,4194304] 0 2024-04-25T15:57:34.293 INFO:tasks.workunit.client.1.smithi155.stdout:8/122: dread d2/f16 [0,4194304] 0 2024-04-25T15:57:34.296 INFO:tasks.workunit.client.1.smithi155.stdout:1/134: mkdir d1/d6/d1b/d34 0 2024-04-25T15:57:34.298 INFO:tasks.workunit.client.1.smithi155.stdout:7/190: mkdir d2/dd/d30/d44 0 2024-04-25T15:57:34.300 INFO:tasks.workunit.client.1.smithi155.stdout:3/203: rename d1/d4/d10/d21/f27 to d1/d4/f41 0 2024-04-25T15:57:34.302 INFO:tasks.workunit.client.1.smithi155.stdout:4/160: dwrite da/f11 [0,4194304] 0 2024-04-25T15:57:34.302 INFO:tasks.workunit.client.1.smithi155.stdout:6/315: fdatasync d0/ff 0 2024-04-25T15:57:34.302 INFO:tasks.workunit.client.1.smithi155.stdout:8/123: mknod d2/d15/d18/d23/c2a 0 2024-04-25T15:57:34.305 INFO:tasks.workunit.client.1.smithi155.stdout:1/135: chown d1/d6/d1b/l21 26040 1 2024-04-25T15:57:34.310 INFO:tasks.workunit.client.1.smithi155.stdout:0/156: dwrite d1/d6/f2f [0,4194304] 0 2024-04-25T15:57:34.310 INFO:tasks.workunit.client.1.smithi155.stdout:1/136: dread - d1/d16/f1c zero size 2024-04-25T15:57:34.310 INFO:tasks.workunit.client.1.smithi155.stdout:4/161: fsync da/d23/d2a/f39 0 2024-04-25T15:57:34.310 INFO:tasks.workunit.client.1.smithi155.stdout:3/204: chown d1/d4/d10/c3a 290 1 2024-04-25T15:57:34.312 INFO:tasks.workunit.client.1.smithi155.stdout:6/316: truncate d0/d13/f20 2305531 0 2024-04-25T15:57:34.314 INFO:tasks.workunit.client.1.smithi155.stdout:4/162: symlink da/dc/l3c 0 2024-04-25T15:57:34.316 INFO:tasks.workunit.client.1.smithi155.stdout:4/163: chown da/d30/f38 544196931 1 2024-04-25T15:57:34.317 INFO:tasks.workunit.client.1.smithi155.stdout:3/205: creat d1/d4/db/d28/d29/f42 x:0 0 0 2024-04-25T15:57:34.318 INFO:tasks.workunit.client.1.smithi155.stdout:8/124: dread d2/f14 [4194304,4194304] 0 2024-04-25T15:57:34.318 INFO:tasks.workunit.client.1.smithi155.stdout:1/137: rename d1/d16/d1d/f25 to d1/d6/d1b/f35 0 2024-04-25T15:57:34.320 INFO:tasks.workunit.client.1.smithi155.stdout:6/317: creat d0/d1a/d21/f74 x:0 0 0 2024-04-25T15:57:34.320 INFO:tasks.workunit.client.1.smithi155.stdout:8/125: stat d2/d5/lf 0 2024-04-25T15:57:34.321 INFO:tasks.workunit.client.1.smithi155.stdout:5/153: dwrite d0/d3/d15/f16 [0,4194304] 0 2024-04-25T15:57:34.321 INFO:tasks.workunit.client.1.smithi155.stdout:4/164: unlink da/d23/f26 0 2024-04-25T15:57:34.322 INFO:tasks.workunit.client.1.smithi155.stdout:8/126: write d2/f28 [948119,266] 0 2024-04-25T15:57:34.324 INFO:tasks.workunit.client.1.smithi155.stdout:2/273: sync 2024-04-25T15:57:34.325 INFO:tasks.workunit.client.1.smithi155.stdout:3/206: creat d1/d4/d10/f43 x:0 0 0 2024-04-25T15:57:34.325 INFO:tasks.workunit.client.1.smithi155.stdout:6/318: write d0/d1a/d45/f52 [537142,104719] 0 2024-04-25T15:57:34.328 INFO:tasks.workunit.client.1.smithi155.stdout:8/127: truncate d2/f28 1990260 0 2024-04-25T15:57:34.328 INFO:tasks.workunit.client.1.smithi155.stdout:4/165: creat da/d23/f3d x:0 0 0 2024-04-25T15:57:34.330 INFO:tasks.workunit.client.1.smithi155.stdout:5/154: mkdir d0/d3/d15/d30 0 2024-04-25T15:57:34.330 INFO:tasks.workunit.client.1.smithi155.stdout:3/207: dread - d1/d4/d10/f43 zero size 2024-04-25T15:57:34.332 INFO:tasks.workunit.client.1.smithi155.stdout:2/274: creat d7/db/dd/d15/f55 x:0 0 0 2024-04-25T15:57:34.334 INFO:tasks.workunit.client.1.smithi155.stdout:2/275: dread - d7/d23/f35 zero size 2024-04-25T15:57:34.335 INFO:tasks.workunit.client.1.smithi155.stdout:8/128: rename d2/d5/c10 to d2/d15/d18/c2b 0 2024-04-25T15:57:34.335 INFO:tasks.workunit.client.1.smithi155.stdout:3/208: mkdir d1/d4/db/d20/d44 0 2024-04-25T15:57:34.337 INFO:tasks.workunit.client.1.smithi155.stdout:9/157: sync 2024-04-25T15:57:34.338 INFO:tasks.workunit.client.1.smithi155.stdout:1/138: dwrite d1/fb [0,4194304] 0 2024-04-25T15:57:34.339 INFO:tasks.workunit.client.1.smithi155.stdout:8/129: write d2/fc [4497578,3341] 0 2024-04-25T15:57:34.340 INFO:tasks.workunit.client.1.smithi155.stdout:5/155: rename d0/d3/ca to d0/d27/c31 0 2024-04-25T15:57:34.345 INFO:tasks.workunit.client.1.smithi155.stdout:9/158: creat dc/d17/d18/f41 x:0 0 0 2024-04-25T15:57:34.345 INFO:tasks.workunit.client.1.smithi155.stdout:1/139: write d1/d6/fc [664491,89080] 0 2024-04-25T15:57:34.348 INFO:tasks.workunit.client.1.smithi155.stdout:6/319: rename d0/d13/d43/c6d to d0/d1a/d21/c75 0 2024-04-25T15:57:34.348 INFO:tasks.workunit.client.1.smithi155.stdout:0/157: dwrite d1/d3/d5/da/fc [0,4194304] 0 2024-04-25T15:57:34.348 INFO:tasks.workunit.client.1.smithi155.stdout:8/130: truncate d2/f11 447733 0 2024-04-25T15:57:34.350 INFO:tasks.workunit.client.1.smithi155.stdout:7/191: dread d2/dd/d13/d24/d35/f3f [0,4194304] 0 2024-04-25T15:57:34.351 INFO:tasks.workunit.client.1.smithi155.stdout:4/166: dwrite da/f3b [0,4194304] 0 2024-04-25T15:57:34.353 INFO:tasks.workunit.client.1.smithi155.stdout:6/320: chown d0/d13/d34 36423 1 2024-04-25T15:57:34.356 INFO:tasks.workunit.client.1.smithi155.stdout:8/131: fsync d2/d5/f21 0 2024-04-25T15:57:34.356 INFO:tasks.workunit.client.1.smithi155.stdout:4/167: stat da/f21 0 2024-04-25T15:57:34.357 INFO:tasks.workunit.client.1.smithi155.stdout:6/321: dread - d0/d18/f23 zero size 2024-04-25T15:57:34.360 INFO:tasks.workunit.client.1.smithi155.stdout:7/192: chown d2/dd/d13/d1c/l42 31428232 1 2024-04-25T15:57:34.360 INFO:tasks.workunit.client.1.smithi155.stdout:0/158: creat d1/d41/f45 x:0 0 0 2024-04-25T15:57:34.362 INFO:tasks.workunit.client.1.smithi155.stdout:2/276: dwrite d7/db/dd/d15/f45 [4194304,4194304] 0 2024-04-25T15:57:34.363 INFO:tasks.workunit.client.1.smithi155.stdout:3/209: getdents d1/d4/db/d28/d29 0 2024-04-25T15:57:34.364 INFO:tasks.workunit.client.1.smithi155.stdout:4/168: mknod da/d23/c3e 0 2024-04-25T15:57:34.364 INFO:tasks.workunit.client.1.smithi155.stdout:0/159: dread - d1/d6/d29/f3a zero size 2024-04-25T15:57:34.366 INFO:tasks.workunit.client.1.smithi155.stdout:1/140: dread d1/f15 [0,4194304] 0 2024-04-25T15:57:34.366 INFO:tasks.workunit.client.1.smithi155.stdout:0/160: truncate d1/f1b 630295 0 2024-04-25T15:57:34.367 INFO:tasks.workunit.client.1.smithi155.stdout:5/156: write d0/d3/d15/f17 [234138,38111] 0 2024-04-25T15:57:34.368 INFO:tasks.workunit.client.1.smithi155.stdout:0/161: stat d1/d6/d16 0 2024-04-25T15:57:34.368 INFO:tasks.workunit.client.1.smithi155.stdout:7/193: symlink d2/dd/d13/d24/l45 0 2024-04-25T15:57:34.373 INFO:tasks.workunit.client.1.smithi155.stdout:3/210: dread d1/d4/db/d28/f31 [0,4194304] 0 2024-04-25T15:57:34.374 INFO:tasks.workunit.client.1.smithi155.stdout:2/277: mknod d7/db/d2e/d44/c56 0 2024-04-25T15:57:34.375 INFO:tasks.workunit.client.1.smithi155.stdout:4/169: mkdir da/d23/d3f 0 2024-04-25T15:57:34.378 INFO:tasks.workunit.client.1.smithi155.stdout:5/157: mkdir d0/d3/d15/d13/d32 0 2024-04-25T15:57:34.380 INFO:tasks.workunit.client.1.smithi155.stdout:5/158: fsync d0/f2 0 2024-04-25T15:57:34.380 INFO:tasks.workunit.client.1.smithi155.stdout:3/211: read d1/f16 [50326,43090] 0 2024-04-25T15:57:34.381 INFO:tasks.workunit.client.1.smithi155.stdout:1/141: dwrite d1/d16/f1c [0,4194304] 0 2024-04-25T15:57:34.381 INFO:tasks.workunit.client.1.smithi155.stdout:3/212: write d1/d4/db/f11 [1653817,59454] 0 2024-04-25T15:57:34.382 INFO:tasks.workunit.client.1.smithi155.stdout:8/132: rmdir d2/d5/d24 0 2024-04-25T15:57:34.384 INFO:tasks.workunit.client.1.smithi155.stdout:8/133: write d2/f28 [228840,31800] 0 2024-04-25T15:57:34.385 INFO:tasks.workunit.client.1.smithi155.stdout:5/159: rename d0/d3/d15/d13/d32 to d0/d3/d15/d13/d32/d33 22 2024-04-25T15:57:34.386 INFO:tasks.workunit.client.1.smithi155.stdout:4/170: symlink da/d23/l40 0 2024-04-25T15:57:34.387 INFO:tasks.workunit.client.1.smithi155.stdout:5/160: dread - d0/d3/d2c/f2f zero size 2024-04-25T15:57:34.387 INFO:tasks.workunit.client.1.smithi155.stdout:0/162: mkdir d1/d3/d3d/d46 0 2024-04-25T15:57:34.388 INFO:tasks.workunit.client.1.smithi155.stdout:9/159: dread dc/d17/d2a/f2c [0,4194304] 0 2024-04-25T15:57:34.389 INFO:tasks.workunit.client.1.smithi155.stdout:0/163: truncate d1/d6/f1f 1290367 0 2024-04-25T15:57:34.390 INFO:tasks.workunit.client.1.smithi155.stdout:3/213: unlink d1/c34 0 2024-04-25T15:57:34.390 INFO:tasks.workunit.client.1.smithi155.stdout:1/142: rmdir d1/d6/d1b 39 2024-04-25T15:57:34.391 INFO:tasks.workunit.client.1.smithi155.stdout:1/143: chown d1/f24 189226445 1 2024-04-25T15:57:34.391 INFO:tasks.workunit.client.1.smithi155.stdout:6/322: write d0/d13/f20 [2504301,67374] 0 2024-04-25T15:57:34.392 INFO:tasks.workunit.client.1.smithi155.stdout:6/323: write d0/f4f [789303,76192] 0 2024-04-25T15:57:34.393 INFO:tasks.workunit.client.1.smithi155.stdout:6/324: truncate d0/d1a/f1c 4780258 0 2024-04-25T15:57:34.394 INFO:tasks.workunit.client.1.smithi155.stdout:4/171: mknod da/dc/d18/d34/c41 0 2024-04-25T15:57:34.395 INFO:tasks.workunit.client.1.smithi155.stdout:8/134: write d2/d5/f29 [83509,39072] 0 2024-04-25T15:57:34.395 INFO:tasks.workunit.client.1.smithi155.stdout:9/160: creat dc/d11/f42 x:0 0 0 2024-04-25T15:57:34.398 INFO:tasks.workunit.client.1.smithi155.stdout:0/164: unlink d1/d3/d5/f23 0 2024-04-25T15:57:34.400 INFO:tasks.workunit.client.1.smithi155.stdout:2/278: rmdir d7/db/d4e 0 2024-04-25T15:57:34.402 INFO:tasks.workunit.client.1.smithi155.stdout:4/172: creat da/d23/f42 x:0 0 0 2024-04-25T15:57:34.404 INFO:tasks.workunit.client.1.smithi155.stdout:5/161: truncate d0/f2 1084659 0 2024-04-25T15:57:34.405 INFO:tasks.workunit.client.1.smithi155.stdout:1/144: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:57:34.408 INFO:tasks.workunit.client.1.smithi155.stdout:8/135: unlink d2/d5/lb 0 2024-04-25T15:57:34.409 INFO:tasks.workunit.client.1.smithi155.stdout:0/165: mkdir d1/d6/d29/d47 0 2024-04-25T15:57:34.410 INFO:tasks.workunit.client.1.smithi155.stdout:6/325: dwrite d0/f3 [4194304,4194304] 0 2024-04-25T15:57:34.410 INFO:tasks.workunit.client.1.smithi155.stdout:9/161: dwrite f5 [0,4194304] 0 2024-04-25T15:57:34.411 INFO:tasks.workunit.client.1.smithi155.stdout:6/326: chown d0/d13/d34 430822 1 2024-04-25T15:57:34.420 INFO:tasks.workunit.client.1.smithi155.stdout:4/173: creat da/d23/f43 x:0 0 0 2024-04-25T15:57:34.422 INFO:tasks.workunit.client.1.smithi155.stdout:1/145: chown d1/d16/c19 249200 1 2024-04-25T15:57:34.423 INFO:tasks.workunit.client.1.smithi155.stdout:6/327: symlink d0/d1a/d25/d2e/l76 0 2024-04-25T15:57:34.426 INFO:tasks.workunit.client.1.smithi155.stdout:4/174: read da/f19 [2895422,16301] 0 2024-04-25T15:57:34.426 INFO:tasks.workunit.client.1.smithi155.stdout:1/146: dread - d1/d16/f2c zero size 2024-04-25T15:57:34.427 INFO:tasks.workunit.client.1.smithi155.stdout:5/162: dwrite d0/d3/d15/d13/f1c [0,4194304] 0 2024-04-25T15:57:34.428 INFO:tasks.workunit.client.1.smithi155.stdout:2/279: getdents d7/db 0 2024-04-25T15:57:34.431 INFO:tasks.workunit.client.1.smithi155.stdout:4/175: chown da/ce 595 1 2024-04-25T15:57:34.433 INFO:tasks.workunit.client.1.smithi155.stdout:0/166: dwrite d1/d3/f43 [0,4194304] 0 2024-04-25T15:57:34.435 INFO:tasks.workunit.client.1.smithi155.stdout:3/214: link d1/f1f d1/d4/d10/d2a/f45 0 2024-04-25T15:57:34.435 INFO:tasks.workunit.client.1.smithi155.stdout:5/163: fsync d0/d3/d15/f16 0 2024-04-25T15:57:34.437 INFO:tasks.workunit.client.1.smithi155.stdout:6/328: rename d0/d1a/d25/d2e/l3f to d0/d1a/d21/l77 0 2024-04-25T15:57:34.442 INFO:tasks.workunit.client.1.smithi155.stdout:2/280: rmdir d7/db/d29 39 2024-04-25T15:57:34.444 INFO:tasks.workunit.client.1.smithi155.stdout:9/162: dwrite dc/d17/d2a/f2c [0,4194304] 0 2024-04-25T15:57:34.445 INFO:tasks.workunit.client.1.smithi155.stdout:3/215: write d1/d4/db/d28/f31 [826589,101916] 0 2024-04-25T15:57:34.446 INFO:tasks.workunit.client.1.smithi155.stdout:5/164: symlink d0/d3/d15/d13/d32/l34 0 2024-04-25T15:57:34.453 INFO:tasks.workunit.client.1.smithi155.stdout:9/163: mknod dc/d2f/c43 0 2024-04-25T15:57:34.454 INFO:tasks.workunit.client.1.smithi155.stdout:8/136: dread d2/f14 [0,4194304] 0 2024-04-25T15:57:34.454 INFO:tasks.workunit.client.1.smithi155.stdout:3/216: rename d1/d4/f37 to d1/d4/db/d20/f46 0 2024-04-25T15:57:34.456 INFO:tasks.workunit.client.1.smithi155.stdout:2/281: truncate d7/db/d2e/f47 216109 0 2024-04-25T15:57:34.458 INFO:tasks.workunit.client.1.smithi155.stdout:5/165: creat d0/d3/d15/d1f/f35 x:0 0 0 2024-04-25T15:57:34.461 INFO:tasks.workunit.client.1.smithi155.stdout:3/217: creat d1/d4/d10/d21/f47 x:0 0 0 2024-04-25T15:57:34.463 INFO:tasks.workunit.client.1.smithi155.stdout:9/164: mkdir dc/d44 0 2024-04-25T15:57:34.464 INFO:tasks.workunit.client.1.smithi155.stdout:1/147: write d1/d16/d1d/f2a [2139394,90874] 0 2024-04-25T15:57:34.465 INFO:tasks.workunit.client.1.smithi155.stdout:9/165: fdatasync f5 0 2024-04-25T15:57:34.466 INFO:tasks.workunit.client.1.smithi155.stdout:8/137: dwrite d2/f11 [0,4194304] 0 2024-04-25T15:57:34.469 INFO:tasks.workunit.client.1.smithi155.stdout:0/167: truncate d1/d3/d5/da/fc 3083145 0 2024-04-25T15:57:34.469 INFO:tasks.workunit.client.1.smithi155.stdout:2/282: dread d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:34.469 INFO:tasks.workunit.client.1.smithi155.stdout:6/329: truncate d0/f1 3146465 0 2024-04-25T15:57:34.474 INFO:tasks.workunit.client.1.smithi155.stdout:2/283: chown d7/f2d 90354 1 2024-04-25T15:57:34.477 INFO:tasks.workunit.client.1.smithi155.stdout:9/166: symlink dc/d11/l45 0 2024-04-25T15:57:34.477 INFO:tasks.workunit.client.1.smithi155.stdout:1/148: dread d1/fb [0,4194304] 0 2024-04-25T15:57:34.478 INFO:tasks.workunit.client.1.smithi155.stdout:6/330: unlink d0/ff 0 2024-04-25T15:57:34.479 INFO:tasks.workunit.client.1.smithi155.stdout:0/168: creat d1/d3/f48 x:0 0 0 2024-04-25T15:57:34.479 INFO:tasks.workunit.client.1.smithi155.stdout:2/284: read d7/db/dd/d15/f1a [644989,122906] 0 2024-04-25T15:57:34.481 INFO:tasks.workunit.client.1.smithi155.stdout:5/166: getdents d0/d3 0 2024-04-25T15:57:34.482 INFO:tasks.workunit.client.1.smithi155.stdout:1/149: chown d1/d16/d1d 53344508 1 2024-04-25T15:57:34.483 INFO:tasks.workunit.client.1.smithi155.stdout:9/167: chown dc/d11/f42 30833133 1 2024-04-25T15:57:34.483 INFO:tasks.workunit.client.1.smithi155.stdout:3/218: dwrite d1/d4/db/d28/d29/f42 [0,4194304] 0 2024-04-25T15:57:34.483 INFO:tasks.workunit.client.1.smithi155.stdout:6/331: write d0/d13/f6a [593143,97658] 0 2024-04-25T15:57:34.483 INFO:tasks.workunit.client.1.smithi155.stdout:2/285: read - d7/db/dd/f2a zero size 2024-04-25T15:57:34.484 INFO:tasks.workunit.client.1.smithi155.stdout:9/168: fsync f5 0 2024-04-25T15:57:34.486 INFO:tasks.workunit.client.1.smithi155.stdout:2/286: read - d7/f49 zero size 2024-04-25T15:57:34.487 INFO:tasks.workunit.client.1.smithi155.stdout:9/169: read dc/d17/f1b [7195612,63427] 0 2024-04-25T15:57:34.488 INFO:tasks.workunit.client.1.smithi155.stdout:5/167: symlink d0/d3/d15/d13/l36 0 2024-04-25T15:57:34.488 INFO:tasks.workunit.client.1.smithi155.stdout:8/138: dwrite d2/d15/d18/f1a [0,4194304] 0 2024-04-25T15:57:34.491 INFO:tasks.workunit.client.1.smithi155.stdout:8/139: dread d2/fa [0,4194304] 0 2024-04-25T15:57:34.496 INFO:tasks.workunit.client.1.smithi155.stdout:3/219: dwrite d1/d4/db/d28/d29/f42 [4194304,4194304] 0 2024-04-25T15:57:34.499 INFO:tasks.workunit.client.1.smithi155.stdout:9/170: mkdir dc/d11/d30/d46 0 2024-04-25T15:57:34.499 INFO:tasks.workunit.client.1.smithi155.stdout:8/140: mknod d2/d15/d18/c2c 0 2024-04-25T15:57:34.502 INFO:tasks.workunit.client.1.smithi155.stdout:1/150: creat d1/d6/d1b/d34/f36 x:0 0 0 2024-04-25T15:57:34.505 INFO:tasks.workunit.client.1.smithi155.stdout:1/151: stat d1/la 0 2024-04-25T15:57:34.505 INFO:tasks.workunit.client.1.smithi155.stdout:1/152: chown d1/d6/f31 209550581 1 2024-04-25T15:57:34.505 INFO:tasks.workunit.client.1.smithi155.stdout:1/153: read - d1/d16/f1f zero size 2024-04-25T15:57:34.509 INFO:tasks.workunit.client.1.smithi155.stdout:8/141: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:34.535 INFO:tasks.workunit.client.1.smithi155.stdout:7/194: sync 2024-04-25T15:57:34.536 INFO:tasks.workunit.client.1.smithi155.stdout:7/195: write d2/dd/d13/d24/d35/f3c [1591841,747] 0 2024-04-25T15:57:34.537 INFO:tasks.workunit.client.1.smithi155.stdout:7/196: fdatasync d2/dd/d13/d24/d35/f3f 0 2024-04-25T15:57:34.540 INFO:tasks.workunit.client.1.smithi155.stdout:7/197: mkdir d2/dd/d36/d46 0 2024-04-25T15:57:34.544 INFO:tasks.workunit.client.1.smithi155.stdout:7/198: readlink d2/dd/d12/l19 0 2024-04-25T15:57:34.545 INFO:tasks.workunit.client.1.smithi155.stdout:7/199: mkdir d2/d26/d47 0 2024-04-25T15:57:34.546 INFO:tasks.workunit.client.1.smithi155.stdout:1/154: getdents d1/d6/d1b/d34 0 2024-04-25T15:57:34.547 INFO:tasks.workunit.client.1.smithi155.stdout:1/155: dread - d1/d6/f31 zero size 2024-04-25T15:57:34.549 INFO:tasks.workunit.client.1.smithi155.stdout:7/200: rename d2/c7 to d2/d26/c48 0 2024-04-25T15:57:34.549 INFO:tasks.workunit.client.1.smithi155.stdout:1/156: stat d1/c2e 0 2024-04-25T15:57:34.550 INFO:tasks.workunit.client.1.smithi155.stdout:3/220: write d1/f1f [143883,101478] 0 2024-04-25T15:57:34.553 INFO:tasks.workunit.client.1.smithi155.stdout:6/332: write d0/f1 [3423193,120688] 0 2024-04-25T15:57:34.555 INFO:tasks.workunit.client.1.smithi155.stdout:3/221: unlink d1/d4/d10/d21/f47 0 2024-04-25T15:57:34.556 INFO:tasks.workunit.client.1.smithi155.stdout:3/222: write d1/d4/f2c [4244077,39122] 0 2024-04-25T15:57:34.556 INFO:tasks.workunit.client.1.smithi155.stdout:8/142: truncate d2/f11 1407003 0 2024-04-25T15:57:34.557 INFO:tasks.workunit.client.1.smithi155.stdout:3/223: dread - d1/d4/f41 zero size 2024-04-25T15:57:34.557 INFO:tasks.workunit.client.1.smithi155.stdout:6/333: symlink d0/d1a/d21/d73/l78 0 2024-04-25T15:57:34.560 INFO:tasks.workunit.client.1.smithi155.stdout:6/334: symlink d0/d13/d34/d38/l79 0 2024-04-25T15:57:34.561 INFO:tasks.workunit.client.1.smithi155.stdout:1/157: write d1/d6/f7 [1331393,86068] 0 2024-04-25T15:57:34.562 INFO:tasks.workunit.client.1.smithi155.stdout:3/224: creat d1/d4/db/d20/d44/f48 x:0 0 0 2024-04-25T15:57:34.563 INFO:tasks.workunit.client.1.smithi155.stdout:8/143: dread d2/f14 [4194304,4194304] 0 2024-04-25T15:57:34.565 INFO:tasks.workunit.client.1.smithi155.stdout:1/158: mkdir d1/d16/d37 0 2024-04-25T15:57:34.567 INFO:tasks.workunit.client.1.smithi155.stdout:8/144: truncate d2/fa 2083286 0 2024-04-25T15:57:34.567 INFO:tasks.workunit.client.1.smithi155.stdout:3/225: symlink d1/d4/d25/l49 0 2024-04-25T15:57:34.568 INFO:tasks.workunit.client.1.smithi155.stdout:1/159: dread - d1/d6/f31 zero size 2024-04-25T15:57:34.570 INFO:tasks.workunit.client.1.smithi155.stdout:1/160: write d1/f24 [961010,50714] 0 2024-04-25T15:57:34.571 INFO:tasks.workunit.client.1.smithi155.stdout:8/145: mkdir d2/d15/d18/d23/d2d 0 2024-04-25T15:57:34.572 INFO:tasks.workunit.client.1.smithi155.stdout:3/226: mknod d1/d4/db/d20/d44/c4a 0 2024-04-25T15:57:34.572 INFO:tasks.workunit.client.1.smithi155.stdout:7/201: dread d2/dd/f28 [0,4194304] 0 2024-04-25T15:57:34.573 INFO:tasks.workunit.client.1.smithi155.stdout:6/335: dwrite d0/d1a/d25/f2d [0,4194304] 0 2024-04-25T15:57:34.575 INFO:tasks.workunit.client.1.smithi155.stdout:6/336: stat d0/d1a/d37/f3e 0 2024-04-25T15:57:34.577 INFO:tasks.workunit.client.1.smithi155.stdout:7/202: rename d2/dd/c41 to d2/dd/d13/d24/d35/c49 0 2024-04-25T15:57:34.578 INFO:tasks.workunit.client.1.smithi155.stdout:6/337: mkdir d0/d13/d34/d38/d7a 0 2024-04-25T15:57:34.580 INFO:tasks.workunit.client.1.smithi155.stdout:3/227: rename d1/d4/d10/f17 to d1/d4/d10/d2a/f4b 0 2024-04-25T15:57:34.585 INFO:tasks.workunit.client.1.smithi155.stdout:3/228: creat d1/d4/db/d20/f4c x:0 0 0 2024-04-25T15:57:34.585 INFO:tasks.workunit.client.1.smithi155.stdout:1/161: dwrite d1/d6/fc [0,4194304] 0 2024-04-25T15:57:34.589 INFO:tasks.workunit.client.1.smithi155.stdout:1/162: chown d1/d6/le 44 1 2024-04-25T15:57:34.590 INFO:tasks.workunit.client.1.smithi155.stdout:3/229: chown d1/d4/d10/d21/f22 2287 1 2024-04-25T15:57:34.591 INFO:tasks.workunit.client.1.smithi155.stdout:8/146: dwrite d2/f16 [4194304,4194304] 0 2024-04-25T15:57:34.597 INFO:tasks.workunit.client.1.smithi155.stdout:7/203: dread d2/f1d [0,4194304] 0 2024-04-25T15:57:34.597 INFO:tasks.workunit.client.1.smithi155.stdout:3/230: write d1/d4/db/d20/d44/f48 [894634,123639] 0 2024-04-25T15:57:34.599 INFO:tasks.workunit.client.1.smithi155.stdout:1/163: link d1/d16/f1c d1/d16/d1d/f38 0 2024-04-25T15:57:34.600 INFO:tasks.workunit.client.1.smithi155.stdout:6/338: dwrite d0/f4f [0,4194304] 0 2024-04-25T15:57:34.600 INFO:tasks.workunit.client.1.smithi155.stdout:7/204: fdatasync d2/f1b 0 2024-04-25T15:57:34.606 INFO:tasks.workunit.client.1.smithi155.stdout:7/205: write d2/f1d [585040,62705] 0 2024-04-25T15:57:34.606 INFO:tasks.workunit.client.1.smithi155.stdout:1/164: truncate d1/d6/f31 987969 0 2024-04-25T15:57:34.607 INFO:tasks.workunit.client.1.smithi155.stdout:8/147: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:34.608 INFO:tasks.workunit.client.1.smithi155.stdout:3/231: getdents d1/d4/db/d20 0 2024-04-25T15:57:34.609 INFO:tasks.workunit.client.1.smithi155.stdout:8/148: chown d2/d15/d18/d23/c2a 127 1 2024-04-25T15:57:34.611 INFO:tasks.workunit.client.1.smithi155.stdout:6/339: dread d0/d13/f6a [0,4194304] 0 2024-04-25T15:57:34.613 INFO:tasks.workunit.client.1.smithi155.stdout:7/206: dread d2/dd/d13/d1c/f22 [0,4194304] 0 2024-04-25T15:57:34.613 INFO:tasks.workunit.client.1.smithi155.stdout:8/149: read d2/fa [1619028,33737] 0 2024-04-25T15:57:34.615 INFO:tasks.workunit.client.1.smithi155.stdout:8/150: read d2/f14 [11155677,114238] 0 2024-04-25T15:57:34.616 INFO:tasks.workunit.client.1.smithi155.stdout:7/207: dread - d2/dd/d13/d1c/f3b zero size 2024-04-25T15:57:34.617 INFO:tasks.workunit.client.1.smithi155.stdout:1/165: write d1/d6/f14 [1890021,61702] 0 2024-04-25T15:57:34.620 INFO:tasks.workunit.client.1.smithi155.stdout:7/208: mkdir d2/dd/d13/d4a 0 2024-04-25T15:57:34.620 INFO:tasks.workunit.client.1.smithi155.stdout:1/166: dread - d1/d6/d1b/d34/f36 zero size 2024-04-25T15:57:34.624 INFO:tasks.workunit.client.1.smithi155.stdout:6/340: dwrite d0/d13/d43/f42 [0,4194304] 0 2024-04-25T15:57:34.624 INFO:tasks.workunit.client.1.smithi155.stdout:1/167: write d1/d16/d1d/f23 [4754656,14414] 0 2024-04-25T15:57:34.626 INFO:tasks.workunit.client.1.smithi155.stdout:8/151: dread d2/f14 [0,4194304] 0 2024-04-25T15:57:34.627 INFO:tasks.workunit.client.1.smithi155.stdout:1/168: write d1/d6/fc [3546751,77876] 0 2024-04-25T15:57:34.629 INFO:tasks.workunit.client.1.smithi155.stdout:1/169: creat d1/d16/f39 x:0 0 0 2024-04-25T15:57:34.630 INFO:tasks.workunit.client.1.smithi155.stdout:6/341: mkdir d0/d13/d43/d56/d7b 0 2024-04-25T15:57:34.630 INFO:tasks.workunit.client.1.smithi155.stdout:1/170: chown d1/d16/f1f 911589 1 2024-04-25T15:57:34.631 INFO:tasks.workunit.client.1.smithi155.stdout:8/152: creat d2/d15/d18/d23/f2e x:0 0 0 2024-04-25T15:57:34.631 INFO:tasks.workunit.client.1.smithi155.stdout:6/342: write d0/f1 [2329830,83250] 0 2024-04-25T15:57:34.632 INFO:tasks.workunit.client.1.smithi155.stdout:1/171: chown d1/d6/f7 145071 1 2024-04-25T15:57:34.637 INFO:tasks.workunit.client.1.smithi155.stdout:1/172: rename d1/d6/d1b/l1e to d1/d6/l3a 0 2024-04-25T15:57:34.640 INFO:tasks.workunit.client.1.smithi155.stdout:8/153: dread d2/f16 [4194304,4194304] 0 2024-04-25T15:57:34.643 INFO:tasks.workunit.client.1.smithi155.stdout:6/343: dwrite d0/f1 [0,4194304] 0 2024-04-25T15:57:34.643 INFO:tasks.workunit.client.1.smithi155.stdout:1/173: rename d1/d16/l18 to d1/d16/d37/l3b 0 2024-04-25T15:57:34.644 INFO:tasks.workunit.client.1.smithi155.stdout:8/154: mkdir d2/d15/d18/d23/d2f 0 2024-04-25T15:57:34.644 INFO:tasks.workunit.client.1.smithi155.stdout:1/174: chown d1/d6/l10 0 1 2024-04-25T15:57:34.646 INFO:tasks.workunit.client.1.smithi155.stdout:7/209: dread d2/f8 [4194304,4194304] 0 2024-04-25T15:57:34.647 INFO:tasks.workunit.client.1.smithi155.stdout:8/155: symlink d2/d15/d18/l30 0 2024-04-25T15:57:34.654 INFO:tasks.workunit.client.1.smithi155.stdout:4/176: sync 2024-04-25T15:57:34.654 INFO:tasks.workunit.client.1.smithi155.stdout:6/344: dwrite d0/d13/f6a [0,4194304] 0 2024-04-25T15:57:34.657 INFO:tasks.workunit.client.1.smithi155.stdout:7/210: dwrite d2/f37 [0,4194304] 0 2024-04-25T15:57:34.659 INFO:tasks.workunit.client.1.smithi155.stdout:6/345: mkdir d0/d13/d7c 0 2024-04-25T15:57:34.662 INFO:tasks.workunit.client.1.smithi155.stdout:7/211: symlink d2/dd/d36/d46/l4b 0 2024-04-25T15:57:34.665 INFO:tasks.workunit.client.1.smithi155.stdout:7/212: symlink d2/dd/d36/d46/l4c 0 2024-04-25T15:57:34.666 INFO:tasks.workunit.client.1.smithi155.stdout:1/175: truncate d1/f15 452084 0 2024-04-25T15:57:34.667 INFO:tasks.workunit.client.1.smithi155.stdout:1/176: chown d1/d16/c19 314 1 2024-04-25T15:57:34.669 INFO:tasks.workunit.client.1.smithi155.stdout:7/213: creat d2/dd/d13/d4a/f4d x:0 0 0 2024-04-25T15:57:34.672 INFO:tasks.workunit.client.1.smithi155.stdout:4/177: dread da/dc/f1d [0,4194304] 0 2024-04-25T15:57:34.674 INFO:tasks.workunit.client.1.smithi155.stdout:7/214: read d2/dd/d13/d24/f27 [31356,32591] 0 2024-04-25T15:57:34.675 INFO:tasks.workunit.client.1.smithi155.stdout:7/215: write d2/dd/d13/d24/d35/f3c [188088,99874] 0 2024-04-25T15:57:34.675 INFO:tasks.workunit.client.1.smithi155.stdout:4/178: creat da/dc/d18/d34/f44 x:0 0 0 2024-04-25T15:57:34.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/216: fsync d2/dd/d12/f38 0 2024-04-25T15:57:34.678 INFO:tasks.workunit.client.1.smithi155.stdout:4/179: symlink da/d23/d3a/l45 0 2024-04-25T15:57:34.679 INFO:tasks.workunit.client.1.smithi155.stdout:7/217: write d2/dd/f28 [3540255,69808] 0 2024-04-25T15:57:34.679 INFO:tasks.workunit.client.1.smithi155.stdout:4/180: chown da/dc/c17 4489 1 2024-04-25T15:57:34.681 INFO:tasks.workunit.client.1.smithi155.stdout:4/181: read f7 [3743560,58010] 0 2024-04-25T15:57:34.682 INFO:tasks.workunit.client.1.smithi155.stdout:4/182: rmdir da 39 2024-04-25T15:57:34.692 INFO:tasks.workunit.client.1.smithi155.stdout:4/183: creat da/dc/d18/f46 x:0 0 0 2024-04-25T15:57:34.692 INFO:tasks.workunit.client.1.smithi155.stdout:6/346: dwrite d0/d1a/d37/f4d [0,4194304] 0 2024-04-25T15:57:34.693 INFO:tasks.workunit.client.1.smithi155.stdout:1/177: dwrite d1/d16/d1d/f38 [0,4194304] 0 2024-04-25T15:57:34.693 INFO:tasks.workunit.client.1.smithi155.stdout:7/218: dwrite d2/dd/d13/d24/d35/f3f [4194304,4194304] 0 2024-04-25T15:57:34.696 INFO:tasks.workunit.client.1.smithi155.stdout:4/184: creat da/dc/f47 x:0 0 0 2024-04-25T15:57:34.701 INFO:tasks.workunit.client.1.smithi155.stdout:1/178: unlink d1/l1a 0 2024-04-25T15:57:34.701 INFO:tasks.workunit.client.1.smithi155.stdout:6/347: symlink d0/d1a/d25/l7d 0 2024-04-25T15:57:34.701 INFO:tasks.workunit.client.1.smithi155.stdout:6/348: fdatasync d0/d18/f23 0 2024-04-25T15:57:34.703 INFO:tasks.workunit.client.1.smithi155.stdout:7/219: creat d2/dd/f4e x:0 0 0 2024-04-25T15:57:34.707 INFO:tasks.workunit.client.1.smithi155.stdout:6/349: write d0/d1a/d25/f2b [1038021,101910] 0 2024-04-25T15:57:34.709 INFO:tasks.workunit.client.1.smithi155.stdout:6/350: stat d0/d1a/d21 0 2024-04-25T15:57:34.709 INFO:tasks.workunit.client.1.smithi155.stdout:7/220: rename d2/dd/d12/l19 to d2/dd/d30/d44/l4f 0 2024-04-25T15:57:34.711 INFO:tasks.workunit.client.1.smithi155.stdout:4/185: dwrite da/f19 [0,4194304] 0 2024-04-25T15:57:34.711 INFO:tasks.workunit.client.1.smithi155.stdout:1/179: dwrite d1/d6/f14 [4194304,4194304] 0 2024-04-25T15:57:34.714 INFO:tasks.workunit.client.1.smithi155.stdout:7/221: symlink d2/d26/l50 0 2024-04-25T15:57:34.719 INFO:tasks.workunit.client.1.smithi155.stdout:1/180: fsync d1/d16/f1c 0 2024-04-25T15:57:34.719 INFO:tasks.workunit.client.1.smithi155.stdout:1/181: write d1/d6/f7 [1024909,111447] 0 2024-04-25T15:57:34.720 INFO:tasks.workunit.client.1.smithi155.stdout:4/186: getdents da 0 2024-04-25T15:57:34.722 INFO:tasks.workunit.client.1.smithi155.stdout:6/351: dwrite d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:34.726 INFO:tasks.workunit.client.1.smithi155.stdout:1/182: dread d1/f24 [0,4194304] 0 2024-04-25T15:57:34.727 INFO:tasks.workunit.client.1.smithi155.stdout:6/352: mknod d0/d1a/d45/d61/c7e 0 2024-04-25T15:57:34.736 INFO:tasks.workunit.client.1.smithi155.stdout:7/222: dread d2/f1f [0,4194304] 0 2024-04-25T15:57:34.736 INFO:tasks.workunit.client.1.smithi155.stdout:6/353: dwrite d0/d18/f48 [0,4194304] 0 2024-04-25T15:57:34.737 INFO:tasks.workunit.client.1.smithi155.stdout:6/354: readlink d0/d18/l2a 0 2024-04-25T15:57:34.737 INFO:tasks.workunit.client.1.smithi155.stdout:7/223: read d2/dd/d13/f21 [3949844,7498] 0 2024-04-25T15:57:34.742 INFO:tasks.workunit.client.1.smithi155.stdout:1/183: dread d1/d16/d1d/f23 [0,4194304] 0 2024-04-25T15:57:34.744 INFO:tasks.workunit.client.1.smithi155.stdout:6/355: unlink d0/d1a/d21/f74 0 2024-04-25T15:57:34.746 INFO:tasks.workunit.client.1.smithi155.stdout:1/184: fdatasync d1/d16/d1d/f23 0 2024-04-25T15:57:34.747 INFO:tasks.workunit.client.1.smithi155.stdout:6/356: mknod d0/d13/d43/d56/d7b/c7f 0 2024-04-25T15:57:34.749 INFO:tasks.workunit.client.1.smithi155.stdout:1/185: mknod d1/d6/c3c 0 2024-04-25T15:57:34.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/357: unlink d0/d1a/d21/l77 0 2024-04-25T15:57:34.754 INFO:tasks.workunit.client.1.smithi155.stdout:1/186: mkdir d1/d16/d1d/d29/d3d 0 2024-04-25T15:57:34.755 INFO:tasks.workunit.client.1.smithi155.stdout:4/187: dread da/dc/fd [0,4194304] 0 2024-04-25T15:57:34.759 INFO:tasks.workunit.client.1.smithi155.stdout:1/187: link d1/d16/d1d/f2a d1/d16/f3e 0 2024-04-25T15:57:34.760 INFO:tasks.workunit.client.1.smithi155.stdout:4/188: unlink da/dc/l28 0 2024-04-25T15:57:34.761 INFO:tasks.workunit.client.1.smithi155.stdout:1/188: symlink d1/d6/d1b/l3f 0 2024-04-25T15:57:34.763 INFO:tasks.workunit.client.1.smithi155.stdout:1/189: mknod d1/d32/c40 0 2024-04-25T15:57:34.766 INFO:tasks.workunit.client.1.smithi155.stdout:1/190: creat d1/d6/d1b/f41 x:0 0 0 2024-04-25T15:57:34.767 INFO:tasks.workunit.client.1.smithi155.stdout:6/358: dread d0/d1a/d25/d51/f3b [0,4194304] 0 2024-04-25T15:57:34.767 INFO:tasks.workunit.client.1.smithi155.stdout:1/191: chown d1/d16/d37 46680 1 2024-04-25T15:57:34.768 INFO:tasks.workunit.client.1.smithi155.stdout:4/189: dwrite da/dc/f1b [0,4194304] 0 2024-04-25T15:57:34.768 INFO:tasks.workunit.client.1.smithi155.stdout:1/192: rmdir d1/d6 39 2024-04-25T15:57:34.769 INFO:tasks.workunit.client.1.smithi155.stdout:6/359: write d0/d1a/d25/f2b [3297233,30783] 0 2024-04-25T15:57:34.769 INFO:tasks.workunit.client.1.smithi155.stdout:4/190: chown da/d23/d3a 822 1 2024-04-25T15:57:34.776 INFO:tasks.workunit.client.1.smithi155.stdout:1/193: mkdir d1/d6/d1b/d34/d42 0 2024-04-25T15:57:34.779 INFO:tasks.workunit.client.1.smithi155.stdout:4/191: creat da/d23/d3f/f48 x:0 0 0 2024-04-25T15:57:34.781 INFO:tasks.workunit.client.1.smithi155.stdout:1/194: rename d1/d6/d1b/d34/d42 to d1/d16/d1d/d29/d3d/d43 0 2024-04-25T15:57:34.782 INFO:tasks.workunit.client.1.smithi155.stdout:1/195: chown d1/d32/c40 105592 1 2024-04-25T15:57:34.783 INFO:tasks.workunit.client.1.smithi155.stdout:6/360: link d0/d1a/d25/d2e/d39/l5e d0/d13/d34/l80 0 2024-04-25T15:57:34.786 INFO:tasks.workunit.client.1.smithi155.stdout:6/361: mknod d0/d13/d34/d38/c81 0 2024-04-25T15:57:34.789 INFO:tasks.workunit.client.1.smithi155.stdout:1/196: mkdir d1/d44 0 2024-04-25T15:57:34.789 INFO:tasks.workunit.client.1.smithi155.stdout:0/169: sync 2024-04-25T15:57:34.789 INFO:tasks.workunit.client.1.smithi155.stdout:4/192: write da/dc/f1f [1893622,15387] 0 2024-04-25T15:57:34.790 INFO:tasks.workunit.client.1.smithi155.stdout:1/197: write d1/d16/f1c [4624977,116535] 0 2024-04-25T15:57:34.791 INFO:tasks.workunit.client.1.smithi155.stdout:6/362: unlink d0/d1a/d21/c75 0 2024-04-25T15:57:34.791 INFO:tasks.workunit.client.1.smithi155.stdout:1/198: write d1/d16/d1d/f38 [777460,65175] 0 2024-04-25T15:57:34.793 INFO:tasks.workunit.client.1.smithi155.stdout:6/363: chown d0/d18/f48 116171 1 2024-04-25T15:57:34.793 INFO:tasks.workunit.client.1.smithi155.stdout:4/193: mkdir da/dc/d49 0 2024-04-25T15:57:34.794 INFO:tasks.workunit.client.1.smithi155.stdout:1/199: symlink d1/d32/l45 0 2024-04-25T15:57:34.796 INFO:tasks.workunit.client.1.smithi155.stdout:6/364: mknod d0/d1a/d21/d73/c82 0 2024-04-25T15:57:34.796 INFO:tasks.workunit.client.1.smithi155.stdout:6/365: stat d0/c5 0 2024-04-25T15:57:34.797 INFO:tasks.workunit.client.1.smithi155.stdout:6/366: chown d0/d18/f48 14610 1 2024-04-25T15:57:34.797 INFO:tasks.workunit.client.1.smithi155.stdout:0/170: dwrite d1/d3/f17 [0,4194304] 0 2024-04-25T15:57:34.800 INFO:tasks.workunit.client.1.smithi155.stdout:4/194: mkdir da/dc/d18/d34/d4a 0 2024-04-25T15:57:34.802 INFO:tasks.workunit.client.1.smithi155.stdout:4/195: write da/dc/f2f [817233,26817] 0 2024-04-25T15:57:34.803 INFO:tasks.workunit.client.1.smithi155.stdout:0/171: symlink d1/d6/l49 0 2024-04-25T15:57:34.804 INFO:tasks.workunit.client.1.smithi155.stdout:1/200: getdents d1/d6/d1b/d34 0 2024-04-25T15:57:34.813 INFO:tasks.workunit.client.1.smithi155.stdout:4/196: dwrite da/dc/fd [0,4194304] 0 2024-04-25T15:57:34.816 INFO:tasks.workunit.client.1.smithi155.stdout:1/201: dwrite d1/d16/f39 [0,4194304] 0 2024-04-25T15:57:34.819 INFO:tasks.workunit.client.1.smithi155.stdout:1/202: chown d1/d6/f14 793476 1 2024-04-25T15:57:34.819 INFO:tasks.workunit.client.1.smithi155.stdout:0/172: dwrite d1/d3/d5/f13 [0,4194304] 0 2024-04-25T15:57:34.824 INFO:tasks.workunit.client.1.smithi155.stdout:6/367: dread d0/d1a/d25/d2e/d39/f4b [0,4194304] 0 2024-04-25T15:57:34.825 INFO:tasks.workunit.client.1.smithi155.stdout:1/203: link d1/la d1/d16/l46 0 2024-04-25T15:57:34.826 INFO:tasks.workunit.client.1.smithi155.stdout:6/368: read d0/f4f [2412400,9614] 0 2024-04-25T15:57:34.828 INFO:tasks.workunit.client.1.smithi155.stdout:6/369: read d0/d1a/d21/f32 [155719,75634] 0 2024-04-25T15:57:34.829 INFO:tasks.workunit.client.1.smithi155.stdout:0/173: link d1/d3/d12/c18 d1/c4a 0 2024-04-25T15:57:34.831 INFO:tasks.workunit.client.1.smithi155.stdout:4/197: dwrite da/dc/d18/f27 [0,4194304] 0 2024-04-25T15:57:34.832 INFO:tasks.workunit.client.1.smithi155.stdout:6/370: write d0/d1a/d21/f32 [1141869,35346] 0 2024-04-25T15:57:34.833 INFO:tasks.workunit.client.1.smithi155.stdout:0/174: rename d1/d1a/c21 to d1/d3/c4b 0 2024-04-25T15:57:34.835 INFO:tasks.workunit.client.1.smithi155.stdout:6/371: symlink d0/d13/d43/d56/d7b/l83 0 2024-04-25T15:57:34.836 INFO:tasks.workunit.client.1.smithi155.stdout:6/372: chown d0/d18/d63 43 1 2024-04-25T15:57:34.836 INFO:tasks.workunit.client.1.smithi155.stdout:6/373: dread - d0/d18/f23 zero size 2024-04-25T15:57:34.839 INFO:tasks.workunit.client.1.smithi155.stdout:4/198: rename da/f19 to da/f4b 0 2024-04-25T15:57:34.842 INFO:tasks.workunit.client.1.smithi155.stdout:6/374: creat d0/d1a/d25/d51/f84 x:0 0 0 2024-04-25T15:57:34.844 INFO:tasks.workunit.client.1.smithi155.stdout:0/175: dread d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:34.845 INFO:tasks.workunit.client.1.smithi155.stdout:6/375: dread d0/d1a/d21/f32 [0,4194304] 0 2024-04-25T15:57:34.847 INFO:tasks.workunit.client.1.smithi155.stdout:0/176: creat d1/d3/d12/f4c x:0 0 0 2024-04-25T15:57:34.848 INFO:tasks.workunit.client.1.smithi155.stdout:0/177: write d1/d6/f14 [3134835,57088] 0 2024-04-25T15:57:34.849 INFO:tasks.workunit.client.1.smithi155.stdout:4/199: read da/f16 [4293269,34653] 0 2024-04-25T15:57:34.853 INFO:tasks.workunit.client.1.smithi155.stdout:4/200: creat da/dc/d18/f4c x:0 0 0 2024-04-25T15:57:34.854 INFO:tasks.workunit.client.1.smithi155.stdout:1/204: dread d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:34.855 INFO:tasks.workunit.client.1.smithi155.stdout:6/376: truncate d0/d13/f27 697350 0 2024-04-25T15:57:34.856 INFO:tasks.workunit.client.1.smithi155.stdout:0/178: write d1/d3/fd [2193103,76467] 0 2024-04-25T15:57:34.859 INFO:tasks.workunit.client.1.smithi155.stdout:0/179: write d1/d3/f17 [2883410,125728] 0 2024-04-25T15:57:34.862 INFO:tasks.workunit.client.1.smithi155.stdout:1/205: truncate d1/d16/d1d/f38 1032974 0 2024-04-25T15:57:34.863 INFO:tasks.workunit.client.1.smithi155.stdout:0/180: fsync d1/d3/d5/f2c 0 2024-04-25T15:57:34.863 INFO:tasks.workunit.client.1.smithi155.stdout:6/377: dread d0/d18/f1e [0,4194304] 0 2024-04-25T15:57:34.863 INFO:tasks.workunit.client.1.smithi155.stdout:4/201: dwrite da/f14 [0,4194304] 0 2024-04-25T15:57:34.866 INFO:tasks.workunit.client.1.smithi155.stdout:0/181: symlink d1/d3/l4d 0 2024-04-25T15:57:34.867 INFO:tasks.workunit.client.1.smithi155.stdout:1/206: creat d1/d6/d1b/d34/f47 x:0 0 0 2024-04-25T15:57:34.867 INFO:tasks.workunit.client.1.smithi155.stdout:6/378: creat d0/d13/d43/d56/d7b/f85 x:0 0 0 2024-04-25T15:57:34.870 INFO:tasks.workunit.client.1.smithi155.stdout:4/202: rename da/dc/f1b to da/f4d 0 2024-04-25T15:57:34.871 INFO:tasks.workunit.client.1.smithi155.stdout:6/379: creat d0/d1a/d25/d2e/d39/f86 x:0 0 0 2024-04-25T15:57:34.873 INFO:tasks.workunit.client.1.smithi155.stdout:6/380: write d0/d1a/d45/f52 [1405050,54475] 0 2024-04-25T15:57:34.873 INFO:tasks.workunit.client.1.smithi155.stdout:4/203: creat da/dc/d49/f4e x:0 0 0 2024-04-25T15:57:34.919 INFO:tasks.workunit.client.1.smithi155.stdout:2/287: sync 2024-04-25T15:57:34.919 INFO:tasks.workunit.client.1.smithi155.stdout:9/171: sync 2024-04-25T15:57:34.920 INFO:tasks.workunit.client.1.smithi155.stdout:5/168: sync 2024-04-25T15:57:34.936 INFO:tasks.workunit.client.1.smithi155.stdout:5/169: chown d0/c7 43559529 1 2024-04-25T15:57:34.936 INFO:tasks.workunit.client.1.smithi155.stdout:0/182: dwrite d1/d6/f1f [0,4194304] 0 2024-04-25T15:57:34.937 INFO:tasks.workunit.client.1.smithi155.stdout:6/381: mkdir d0/d1a/d87 0 2024-04-25T15:57:34.938 INFO:tasks.workunit.client.1.smithi155.stdout:2/288: mknod d7/c57 0 2024-04-25T15:57:34.939 INFO:tasks.workunit.client.1.smithi155.stdout:2/289: dread - d7/db/dd/d15/f55 zero size 2024-04-25T15:57:34.940 INFO:tasks.workunit.client.1.smithi155.stdout:9/172: rename f6 to dc/d17/d2a/f47 0 2024-04-25T15:57:34.941 INFO:tasks.workunit.client.1.smithi155.stdout:9/173: fsync dc/d17/d2a/f35 0 2024-04-25T15:57:34.943 INFO:tasks.workunit.client.1.smithi155.stdout:2/290: write d7/db/d29/f54 [567669,55497] 0 2024-04-25T15:57:34.944 INFO:tasks.workunit.client.1.smithi155.stdout:5/170: truncate d0/d3/d15/f16 2619371 0 2024-04-25T15:57:34.945 INFO:tasks.workunit.client.1.smithi155.stdout:0/183: creat d1/f4e x:0 0 0 2024-04-25T15:57:34.950 INFO:tasks.workunit.client.1.smithi155.stdout:6/382: getdents d0/d13/d34/d38 0 2024-04-25T15:57:34.951 INFO:tasks.workunit.client.1.smithi155.stdout:2/291: write d7/f3b [1250666,64882] 0 2024-04-25T15:57:34.952 INFO:tasks.workunit.client.1.smithi155.stdout:5/171: rename d0/f12 to d0/f37 0 2024-04-25T15:57:34.952 INFO:tasks.workunit.client.1.smithi155.stdout:2/292: chown d7/db/d2e 16 1 2024-04-25T15:57:34.954 INFO:tasks.workunit.client.1.smithi155.stdout:0/184: dread d1/d3/d5/f13 [0,4194304] 0 2024-04-25T15:57:34.958 INFO:tasks.workunit.client.1.smithi155.stdout:0/185: write d1/d3/f43 [1701714,52685] 0 2024-04-25T15:57:34.958 INFO:tasks.workunit.client.1.smithi155.stdout:0/186: readlink d1/d3/l4d 0 2024-04-25T15:57:34.958 INFO:tasks.workunit.client.1.smithi155.stdout:0/187: fsync d1/d6/d29/f3a 0 2024-04-25T15:57:34.961 INFO:tasks.workunit.client.1.smithi155.stdout:2/293: mknod d7/db/c58 0 2024-04-25T15:57:34.962 INFO:tasks.workunit.client.1.smithi155.stdout:6/383: truncate d0/d1a/d37/f3e 170196 0 2024-04-25T15:57:34.962 INFO:tasks.workunit.client.1.smithi155.stdout:2/294: fsync d7/db/dd/d15/f45 0 2024-04-25T15:57:34.965 INFO:tasks.workunit.client.1.smithi155.stdout:9/174: dread dc/d17/f2b [0,4194304] 0 2024-04-25T15:57:34.966 INFO:tasks.workunit.client.1.smithi155.stdout:9/175: stat dc/ff 0 2024-04-25T15:57:34.967 INFO:tasks.workunit.client.1.smithi155.stdout:5/172: dread d0/d3/d15/f1e [0,4194304] 0 2024-04-25T15:57:34.968 INFO:tasks.workunit.client.1.smithi155.stdout:0/188: getdents d1/d3/d5/da 0 2024-04-25T15:57:34.968 INFO:tasks.workunit.client.1.smithi155.stdout:9/176: chown dc/d17/d2a/f47 1805 1 2024-04-25T15:57:34.972 INFO:tasks.workunit.client.1.smithi155.stdout:5/173: symlink d0/d27/l38 0 2024-04-25T15:57:34.973 INFO:tasks.workunit.client.1.smithi155.stdout:9/177: dread f5 [0,4194304] 0 2024-04-25T15:57:34.974 INFO:tasks.workunit.client.1.smithi155.stdout:2/295: creat d7/db/f59 x:0 0 0 2024-04-25T15:57:34.974 INFO:tasks.workunit.client.1.smithi155.stdout:9/178: write dc/d17/f20 [189252,45424] 0 2024-04-25T15:57:34.975 INFO:tasks.workunit.client.1.smithi155.stdout:0/189: unlink d1/d3/d5/da/fc 0 2024-04-25T15:57:34.977 INFO:tasks.workunit.client.1.smithi155.stdout:5/174: mknod d0/d3/d15/d1f/c39 0 2024-04-25T15:57:34.978 INFO:tasks.workunit.client.1.smithi155.stdout:9/179: mkdir dc/d13/d48 0 2024-04-25T15:57:34.979 INFO:tasks.workunit.client.1.smithi155.stdout:0/190: chown d1/d3/d12/c1c 6876260 1 2024-04-25T15:57:34.980 INFO:tasks.workunit.client.1.smithi155.stdout:9/180: dread dc/d13/f3b [0,4194304] 0 2024-04-25T15:57:34.981 INFO:tasks.workunit.client.1.smithi155.stdout:9/181: truncate dc/d17/f20 447072 0 2024-04-25T15:57:34.982 INFO:tasks.workunit.client.1.smithi155.stdout:5/175: link d0/d3/d15/d13/f1c d0/d3/d2c/f3a 0 2024-04-25T15:57:34.983 INFO:tasks.workunit.client.1.smithi155.stdout:5/176: write d0/d3/d15/d13/f1a [694620,14952] 0 2024-04-25T15:57:34.985 INFO:tasks.workunit.client.1.smithi155.stdout:0/191: rename d1/d6/d16/c31 to d1/d6/d16/c4f 0 2024-04-25T15:57:34.987 INFO:tasks.workunit.client.1.smithi155.stdout:9/182: link dc/d11/l45 dc/d11/l49 0 2024-04-25T15:57:34.992 INFO:tasks.workunit.client.1.smithi155.stdout:0/192: rename d1/d6/f1f to d1/d3f/f50 0 2024-04-25T15:57:34.993 INFO:tasks.workunit.client.1.smithi155.stdout:9/183: creat dc/d13/d2e/f4a x:0 0 0 2024-04-25T15:57:34.994 INFO:tasks.workunit.client.1.smithi155.stdout:9/184: fsync dc/f14 0 2024-04-25T15:57:34.995 INFO:tasks.workunit.client.1.smithi155.stdout:9/185: chown dc/d3c 31724748 1 2024-04-25T15:57:34.995 INFO:tasks.workunit.client.1.smithi155.stdout:6/384: dwrite d0/d1a/d37/f3e [0,4194304] 0 2024-04-25T15:57:34.997 INFO:tasks.workunit.client.1.smithi155.stdout:9/186: write dc/d11/f27 [5070909,72847] 0 2024-04-25T15:57:34.998 INFO:tasks.workunit.client.1.smithi155.stdout:9/187: fsync dc/d17/d2a/f2c 0 2024-04-25T15:57:35.000 INFO:tasks.workunit.client.1.smithi155.stdout:6/385: creat d0/d13/d34/d38/f88 x:0 0 0 2024-04-25T15:57:35.002 INFO:tasks.workunit.client.1.smithi155.stdout:0/193: write d1/d3f/f50 [5125627,64600] 0 2024-04-25T15:57:35.005 INFO:tasks.workunit.client.1.smithi155.stdout:5/177: dread d0/d3/d15/fe [0,4194304] 0 2024-04-25T15:57:35.005 INFO:tasks.workunit.client.1.smithi155.stdout:6/386: rename d0/d13/c24 to d0/d1a/d25/d2e/c89 0 2024-04-25T15:57:35.006 INFO:tasks.workunit.client.1.smithi155.stdout:9/188: creat dc/d11/d30/d46/f4b x:0 0 0 2024-04-25T15:57:35.007 INFO:tasks.workunit.client.1.smithi155.stdout:6/387: truncate d0/f46 983589 0 2024-04-25T15:57:35.008 INFO:tasks.workunit.client.1.smithi155.stdout:9/189: chown dc/cd 1062844 1 2024-04-25T15:57:35.010 INFO:tasks.workunit.client.1.smithi155.stdout:9/190: mkdir dc/d13/d2e/d4c 0 2024-04-25T15:57:35.011 INFO:tasks.workunit.client.1.smithi155.stdout:6/388: truncate d0/d1a/d25/d2e/d39/f86 1042988 0 2024-04-25T15:57:35.011 INFO:tasks.workunit.client.1.smithi155.stdout:9/191: chown dc/d11/f42 9 1 2024-04-25T15:57:35.015 INFO:tasks.workunit.client.1.smithi155.stdout:5/178: dwrite d0/d3/d15/fe [0,4194304] 0 2024-04-25T15:57:35.019 INFO:tasks.workunit.client.1.smithi155.stdout:9/192: dread dc/d17/f29 [0,4194304] 0 2024-04-25T15:57:35.019 INFO:tasks.workunit.client.1.smithi155.stdout:0/194: write d1/d3/d5/f32 [2208015,19284] 0 2024-04-25T15:57:35.022 INFO:tasks.workunit.client.1.smithi155.stdout:0/195: symlink d1/d6/d29/l51 0 2024-04-25T15:57:35.026 INFO:tasks.workunit.client.1.smithi155.stdout:5/179: dwrite d0/d3/d15/d1f/f35 [0,4194304] 0 2024-04-25T15:57:35.030 INFO:tasks.workunit.client.1.smithi155.stdout:5/180: mknod d0/d3/d15/d13/c3b 0 2024-04-25T15:57:35.031 INFO:tasks.workunit.client.1.smithi155.stdout:0/196: dwrite d1/d6/d29/f3a [0,4194304] 0 2024-04-25T15:57:35.032 INFO:tasks.workunit.client.1.smithi155.stdout:5/181: chown d0/d3/d2c/f3a 3229 1 2024-04-25T15:57:35.034 INFO:tasks.workunit.client.1.smithi155.stdout:0/197: read d1/d3/d5/f2c [220046,14094] 0 2024-04-25T15:57:35.037 INFO:tasks.workunit.client.1.smithi155.stdout:5/182: readlink d0/l5 0 2024-04-25T15:57:35.039 INFO:tasks.workunit.client.1.smithi155.stdout:0/198: read d1/d6/f14 [3430324,53690] 0 2024-04-25T15:57:35.043 INFO:tasks.workunit.client.1.smithi155.stdout:5/183: dread d0/d3/d15/fe [0,4194304] 0 2024-04-25T15:57:35.044 INFO:tasks.workunit.client.1.smithi155.stdout:5/184: chown d0/f37 94 1 2024-04-25T15:57:35.047 INFO:tasks.workunit.client.1.smithi155.stdout:5/185: dread d0/d3/d15/f1e [0,4194304] 0 2024-04-25T15:57:35.047 INFO:tasks.workunit.client.1.smithi155.stdout:0/199: dwrite d1/f1b [0,4194304] 0 2024-04-25T15:57:35.048 INFO:tasks.workunit.client.1.smithi155.stdout:0/200: chown d1/d3/l4d 2133 1 2024-04-25T15:57:35.048 INFO:tasks.workunit.client.1.smithi155.stdout:5/186: chown d0/d3/d15/d13/f1c 123 1 2024-04-25T15:57:35.048 INFO:tasks.workunit.client.1.smithi155.stdout:0/201: fdatasync d1/d6/f22 0 2024-04-25T15:57:35.049 INFO:tasks.workunit.client.1.smithi155.stdout:0/202: read d1/f1b [2613493,43242] 0 2024-04-25T15:57:35.052 INFO:tasks.workunit.client.1.smithi155.stdout:5/187: rename d0/d3/d15/f17 to d0/d3/d2c/f3c 0 2024-04-25T15:57:35.054 INFO:tasks.workunit.client.1.smithi155.stdout:5/188: write d0/d3/d15/d13/f1a [864798,71889] 0 2024-04-25T15:57:35.055 INFO:tasks.workunit.client.1.smithi155.stdout:0/203: rename d1/d3/d5/l30 to d1/d3/d5/da/l52 0 2024-04-25T15:57:35.056 INFO:tasks.workunit.client.1.smithi155.stdout:0/204: chown d1/d3/d12 2745578 1 2024-04-25T15:57:35.058 INFO:tasks.workunit.client.1.smithi155.stdout:5/189: rename d0/l10 to d0/d3/d15/l3d 0 2024-04-25T15:57:35.059 INFO:tasks.workunit.client.1.smithi155.stdout:0/205: creat d1/d6/d29/f53 x:0 0 0 2024-04-25T15:57:35.061 INFO:tasks.workunit.client.1.smithi155.stdout:0/206: fdatasync d1/d3/d5/f13 0 2024-04-25T15:57:35.061 INFO:tasks.workunit.client.1.smithi155.stdout:5/190: dread d0/d3/d2c/f3c [0,4194304] 0 2024-04-25T15:57:35.061 INFO:tasks.workunit.client.1.smithi155.stdout:0/207: chown d1/d3/d5/da 422663907 1 2024-04-25T15:57:35.064 INFO:tasks.workunit.client.1.smithi155.stdout:0/208: creat d1/d3/d5/f54 x:0 0 0 2024-04-25T15:57:35.065 INFO:tasks.workunit.client.1.smithi155.stdout:0/209: dread - d1/d3/d5/f54 zero size 2024-04-25T15:57:35.065 INFO:tasks.workunit.client.1.smithi155.stdout:5/191: link d0/l5 d0/d3/l3e 0 2024-04-25T15:57:35.074 INFO:tasks.workunit.client.1.smithi155.stdout:0/210: truncate d1/d6/d29/f3a 3331335 0 2024-04-25T15:57:35.075 INFO:tasks.workunit.client.1.smithi155.stdout:0/211: readlink d1/d6/d16/l27 0 2024-04-25T15:57:35.076 INFO:tasks.workunit.client.1.smithi155.stdout:0/212: rmdir d1/d6/d16 39 2024-04-25T15:57:35.077 INFO:tasks.workunit.client.1.smithi155.stdout:0/213: truncate d1/d3/f48 707130 0 2024-04-25T15:57:35.078 INFO:tasks.workunit.client.1.smithi155.stdout:5/192: rename d0/d27/c31 to d0/d3/d15/d30/c3f 0 2024-04-25T15:57:35.079 INFO:tasks.workunit.client.1.smithi155.stdout:5/193: write d0/d3/d15/d13/f1a [920525,41630] 0 2024-04-25T15:57:35.080 INFO:tasks.workunit.client.1.smithi155.stdout:5/194: fdatasync d0/d3/d15/f1e 0 2024-04-25T15:57:35.082 INFO:tasks.workunit.client.1.smithi155.stdout:5/195: creat d0/f40 x:0 0 0 2024-04-25T15:57:35.083 INFO:tasks.workunit.client.1.smithi155.stdout:5/196: chown d0/d3/d15/l25 78 1 2024-04-25T15:57:35.084 INFO:tasks.workunit.client.1.smithi155.stdout:5/197: chown d0/d3/d15/d13/c3b 7838 1 2024-04-25T15:57:35.085 INFO:tasks.workunit.client.1.smithi155.stdout:0/214: dwrite d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:35.086 INFO:tasks.workunit.client.1.smithi155.stdout:5/198: rename d0/d3/d15/d13 to d0/d3/d15/d13/d32/d41 22 2024-04-25T15:57:35.092 INFO:tasks.workunit.client.1.smithi155.stdout:5/199: rename d0/c4 to d0/d3/d15/d30/c42 0 2024-04-25T15:57:35.093 INFO:tasks.workunit.client.1.smithi155.stdout:5/200: rmdir d0 39 2024-04-25T15:57:35.094 INFO:tasks.workunit.client.1.smithi155.stdout:0/215: dwrite d1/d3/d12/f4c [0,4194304] 0 2024-04-25T15:57:35.095 INFO:tasks.workunit.client.1.smithi155.stdout:5/201: chown d0/d3/d15/d13/l23 5022 1 2024-04-25T15:57:35.096 INFO:tasks.workunit.client.1.smithi155.stdout:0/216: chown d1/d1a/f34 50 1 2024-04-25T15:57:35.098 INFO:tasks.workunit.client.1.smithi155.stdout:5/202: creat d0/d27/f43 x:0 0 0 2024-04-25T15:57:35.098 INFO:tasks.workunit.client.1.smithi155.stdout:0/217: read d1/d6/f14 [2019664,75397] 0 2024-04-25T15:57:35.107 INFO:tasks.workunit.client.1.smithi155.stdout:5/203: dwrite d0/f40 [0,4194304] 0 2024-04-25T15:57:35.109 INFO:tasks.workunit.client.1.smithi155.stdout:0/218: dwrite d1/d6/f14 [0,4194304] 0 2024-04-25T15:57:35.114 INFO:tasks.workunit.client.1.smithi155.stdout:0/219: creat d1/d6/d29/d47/f55 x:0 0 0 2024-04-25T15:57:35.120 INFO:tasks.workunit.client.1.smithi155.stdout:5/204: dwrite d0/d3/d15/f16 [0,4194304] 0 2024-04-25T15:57:35.122 INFO:tasks.workunit.client.1.smithi155.stdout:0/220: dwrite d1/d6/f22 [0,4194304] 0 2024-04-25T15:57:35.125 INFO:tasks.workunit.client.1.smithi155.stdout:8/156: sync 2024-04-25T15:57:35.125 INFO:tasks.workunit.client.1.smithi155.stdout:3/232: sync 2024-04-25T15:57:35.126 INFO:tasks.workunit.client.1.smithi155.stdout:8/157: stat d2/d15/d18/d23/f2e 0 2024-04-25T15:57:35.128 INFO:tasks.workunit.client.1.smithi155.stdout:3/233: chown d1/c1e 17640 1 2024-04-25T15:57:35.132 INFO:tasks.workunit.client.1.smithi155.stdout:5/205: dwrite d0/f40 [0,4194304] 0 2024-04-25T15:57:35.133 INFO:tasks.workunit.client.1.smithi155.stdout:0/221: rename d1/d3/ce to d1/d6/c56 0 2024-04-25T15:57:35.135 INFO:tasks.workunit.client.1.smithi155.stdout:5/206: symlink d0/d3/d15/d30/l44 0 2024-04-25T15:57:35.135 INFO:tasks.workunit.client.1.smithi155.stdout:8/158: link d2/fa d2/d15/d18/d23/d2d/f31 0 2024-04-25T15:57:35.137 INFO:tasks.workunit.client.1.smithi155.stdout:8/159: chown d2/d5/l8 39045789 1 2024-04-25T15:57:35.138 INFO:tasks.workunit.client.1.smithi155.stdout:5/207: unlink d0/d3/d15/f1e 0 2024-04-25T15:57:35.141 INFO:tasks.workunit.client.1.smithi155.stdout:3/234: dwrite d1/d4/db/d20/f3b [0,4194304] 0 2024-04-25T15:57:35.143 INFO:tasks.workunit.client.1.smithi155.stdout:5/208: symlink d0/d3/l45 0 2024-04-25T15:57:35.146 INFO:tasks.workunit.client.1.smithi155.stdout:3/235: mknod d1/d4/db/d28/d39/c4d 0 2024-04-25T15:57:35.146 INFO:tasks.workunit.client.1.smithi155.stdout:8/160: dread d2/d15/d18/d23/d2d/f31 [0,4194304] 0 2024-04-25T15:57:35.149 INFO:tasks.workunit.client.1.smithi155.stdout:3/236: symlink d1/d4/d10/l4e 0 2024-04-25T15:57:35.153 INFO:tasks.workunit.client.1.smithi155.stdout:5/209: getdents d0 0 2024-04-25T15:57:35.155 INFO:tasks.workunit.client.1.smithi155.stdout:5/210: write d0/d3/d15/d13/f19 [1822518,72275] 0 2024-04-25T15:57:35.158 INFO:tasks.workunit.client.1.smithi155.stdout:3/237: dwrite d1/d4/db/d28/d29/f42 [4194304,4194304] 0 2024-04-25T15:57:35.162 INFO:tasks.workunit.client.1.smithi155.stdout:3/238: chown d1/d4/db/d28/f31 40 1 2024-04-25T15:57:35.162 INFO:tasks.workunit.client.1.smithi155.stdout:3/239: write d1/d4/db/d20/f3b [4060922,22536] 0 2024-04-25T15:57:35.162 INFO:tasks.workunit.client.1.smithi155.stdout:3/240: stat d1/d4/db/d20/c40 0 2024-04-25T15:57:35.165 INFO:tasks.workunit.client.1.smithi155.stdout:3/241: unlink d1/c9 0 2024-04-25T15:57:35.166 INFO:tasks.workunit.client.1.smithi155.stdout:5/211: truncate d0/f40 1856270 0 2024-04-25T15:57:35.168 INFO:tasks.workunit.client.1.smithi155.stdout:3/242: dread - d1/d4/d10/f43 zero size 2024-04-25T15:57:35.168 INFO:tasks.workunit.client.1.smithi155.stdout:5/212: rmdir d0/d27 39 2024-04-25T15:57:35.169 INFO:tasks.workunit.client.1.smithi155.stdout:5/213: mknod d0/d3/c46 0 2024-04-25T15:57:35.170 INFO:tasks.workunit.client.1.smithi155.stdout:5/214: stat d0/d3/d15/ld 0 2024-04-25T15:57:35.174 INFO:tasks.workunit.client.1.smithi155.stdout:5/215: dread d0/d3/d15/d13/f1a [0,4194304] 0 2024-04-25T15:57:35.176 INFO:tasks.workunit.client.1.smithi155.stdout:5/216: mkdir d0/d47 0 2024-04-25T15:57:35.176 INFO:tasks.workunit.client.1.smithi155.stdout:5/217: chown d0/d3/d15/d30/l44 49 1 2024-04-25T15:57:35.178 INFO:tasks.workunit.client.1.smithi155.stdout:5/218: creat d0/d3/d2c/f48 x:0 0 0 2024-04-25T15:57:35.181 INFO:tasks.workunit.client.1.smithi155.stdout:5/219: getdents d0/d3/d15/d30 0 2024-04-25T15:57:35.200 INFO:tasks.workunit.client.1.smithi155.stdout:7/224: sync 2024-04-25T15:57:35.200 INFO:tasks.workunit.client.1.smithi155.stdout:1/207: sync 2024-04-25T15:57:35.200 INFO:tasks.workunit.client.1.smithi155.stdout:5/220: dread d0/f37 [0,4194304] 0 2024-04-25T15:57:35.203 INFO:tasks.workunit.client.1.smithi155.stdout:1/208: fdatasync d1/d6/d1b/f35 0 2024-04-25T15:57:35.204 INFO:tasks.workunit.client.1.smithi155.stdout:5/221: rename d0/d3/d15/d13/f1c to d0/d3/d15/d13/d32/f49 0 2024-04-25T15:57:35.205 INFO:tasks.workunit.client.1.smithi155.stdout:1/209: truncate d1/d16/f1f 651373 0 2024-04-25T15:57:35.206 INFO:tasks.workunit.client.1.smithi155.stdout:5/222: readlink d0/d3/d15/d13/l36 0 2024-04-25T15:57:35.208 INFO:tasks.workunit.client.1.smithi155.stdout:7/225: dwrite d2/f1b [0,4194304] 0 2024-04-25T15:57:35.213 INFO:tasks.workunit.client.1.smithi155.stdout:1/210: rmdir d1/d44 0 2024-04-25T15:57:35.215 INFO:tasks.workunit.client.1.smithi155.stdout:7/226: dwrite d2/dd/d13/d24/d35/f3f [8388608,4194304] 0 2024-04-25T15:57:35.215 INFO:tasks.workunit.client.1.smithi155.stdout:5/223: creat d0/d3/f4a x:0 0 0 2024-04-25T15:57:35.218 INFO:tasks.workunit.client.1.smithi155.stdout:7/227: creat d2/dd/d36/d46/f51 x:0 0 0 2024-04-25T15:57:35.270 INFO:tasks.workunit.client.1.smithi155.stdout:5/224: truncate d0/f2 1878188 0 2024-04-25T15:57:35.270 INFO:tasks.workunit.client.1.smithi155.stdout:1/211: write d1/d6/d1b/f35 [2710863,1513] 0 2024-04-25T15:57:35.271 INFO:tasks.workunit.client.1.smithi155.stdout:5/225: chown d0/d3/d2c/f3c 150244 1 2024-04-25T15:57:35.272 INFO:tasks.workunit.client.1.smithi155.stdout:7/228: creat d2/dd/f52 x:0 0 0 2024-04-25T15:57:35.274 INFO:tasks.workunit.client.1.smithi155.stdout:1/212: dread d1/d16/d1d/f38 [0,4194304] 0 2024-04-25T15:57:35.274 INFO:tasks.workunit.client.1.smithi155.stdout:5/226: creat d0/d27/f4b x:0 0 0 2024-04-25T15:57:35.275 INFO:tasks.workunit.client.1.smithi155.stdout:1/213: write d1/d6/f7 [2765028,83272] 0 2024-04-25T15:57:35.275 INFO:tasks.workunit.client.1.smithi155.stdout:7/229: creat d2/d26/d3d/f53 x:0 0 0 2024-04-25T15:57:35.328 INFO:tasks.workunit.client.1.smithi155.stdout:4/204: sync 2024-04-25T15:57:35.343 INFO:tasks.workunit.client.1.smithi155.stdout:4/205: write da/f14 [845822,94628] 0 2024-04-25T15:57:35.343 INFO:tasks.workunit.client.1.smithi155.stdout:5/227: write d0/f40 [1805753,104615] 0 2024-04-25T15:57:35.348 INFO:tasks.workunit.client.1.smithi155.stdout:1/214: truncate d1/d16/f27 1161465 0 2024-04-25T15:57:35.351 INFO:tasks.workunit.client.1.smithi155.stdout:5/228: read d0/d3/d2c/f3a [1084853,41587] 0 2024-04-25T15:57:35.353 INFO:tasks.workunit.client.1.smithi155.stdout:1/215: read d1/f8 [132484,114084] 0 2024-04-25T15:57:35.354 INFO:tasks.workunit.client.1.smithi155.stdout:4/206: creat da/d23/d2a/f4f x:0 0 0 2024-04-25T15:57:35.355 INFO:tasks.workunit.client.1.smithi155.stdout:7/230: dread d2/f1b [0,4194304] 0 2024-04-25T15:57:35.356 INFO:tasks.workunit.client.1.smithi155.stdout:5/229: chown d0/d3/l24 735 1 2024-04-25T15:57:35.358 INFO:tasks.workunit.client.1.smithi155.stdout:5/230: read - d0/d27/f43 zero size 2024-04-25T15:57:35.358 INFO:tasks.workunit.client.1.smithi155.stdout:4/207: mknod da/dc/d18/d34/c50 0 2024-04-25T15:57:35.362 INFO:tasks.workunit.client.1.smithi155.stdout:1/216: link d1/d6/f2f d1/d16/d1d/d29/d3d/d43/f48 0 2024-04-25T15:57:35.366 INFO:tasks.workunit.client.1.smithi155.stdout:4/208: mknod da/d23/d2a/c51 0 2024-04-25T15:57:35.372 INFO:tasks.workunit.client.1.smithi155.stdout:1/217: creat d1/d6/d1b/f49 x:0 0 0 2024-04-25T15:57:35.372 INFO:tasks.workunit.client.1.smithi155.stdout:5/231: creat d0/f4c x:0 0 0 2024-04-25T15:57:35.374 INFO:tasks.workunit.client.1.smithi155.stdout:4/209: readlink da/dc/d18/l2b 0 2024-04-25T15:57:35.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/231: dwrite d2/f1d [0,4194304] 0 2024-04-25T15:57:35.378 INFO:tasks.workunit.client.1.smithi155.stdout:5/232: write d0/f37 [653835,62992] 0 2024-04-25T15:57:35.378 INFO:tasks.workunit.client.1.smithi155.stdout:1/218: symlink d1/d16/d1d/d33/l4a 0 2024-04-25T15:57:35.379 INFO:tasks.workunit.client.1.smithi155.stdout:4/210: write da/d23/f3d [949428,3773] 0 2024-04-25T15:57:35.380 INFO:tasks.workunit.client.1.smithi155.stdout:7/232: mknod d2/dd/d13/c54 0 2024-04-25T15:57:35.384 INFO:tasks.workunit.client.1.smithi155.stdout:5/233: unlink d0/d3/d15/l25 0 2024-04-25T15:57:35.384 INFO:tasks.workunit.client.1.smithi155.stdout:1/219: write d1/d6/d1b/d34/f36 [297217,90326] 0 2024-04-25T15:57:35.385 INFO:tasks.workunit.client.1.smithi155.stdout:7/233: write d2/dd/d13/d1c/f1e [752631,83239] 0 2024-04-25T15:57:35.387 INFO:tasks.workunit.client.1.smithi155.stdout:1/220: chown d1/d16/f3e 850118 1 2024-04-25T15:57:35.390 INFO:tasks.workunit.client.1.smithi155.stdout:1/221: write d1/d6/f14 [1728613,121496] 0 2024-04-25T15:57:35.391 INFO:tasks.workunit.client.1.smithi155.stdout:7/234: unlink d2/dd/d13/d1c/c33 0 2024-04-25T15:57:35.395 INFO:tasks.workunit.client.1.smithi155.stdout:7/235: write d2/f11 [928408,92584] 0 2024-04-25T15:57:35.396 INFO:tasks.workunit.client.1.smithi155.stdout:4/211: dwrite da/dc/fd [0,4194304] 0 2024-04-25T15:57:35.399 INFO:tasks.workunit.client.1.smithi155.stdout:7/236: symlink d2/dd/d30/d44/l55 0 2024-04-25T15:57:35.402 INFO:tasks.workunit.client.1.smithi155.stdout:7/237: mknod d2/dd/d36/d46/c56 0 2024-04-25T15:57:35.404 INFO:tasks.workunit.client.1.smithi155.stdout:7/238: fsync d2/f8 0 2024-04-25T15:57:35.405 INFO:tasks.workunit.client.1.smithi155.stdout:1/222: dread d1/d6/d1b/d34/f36 [0,4194304] 0 2024-04-25T15:57:35.406 INFO:tasks.workunit.client.1.smithi155.stdout:4/212: dread da/dc/f1f [0,4194304] 0 2024-04-25T15:57:35.407 INFO:tasks.workunit.client.1.smithi155.stdout:1/223: dread d1/d6/d1b/d34/f36 [0,4194304] 0 2024-04-25T15:57:35.407 INFO:tasks.workunit.client.1.smithi155.stdout:5/234: truncate d0/f37 615300 0 2024-04-25T15:57:35.410 INFO:tasks.workunit.client.1.smithi155.stdout:1/224: truncate d1/d16/f1c 1640815 0 2024-04-25T15:57:35.412 INFO:tasks.workunit.client.1.smithi155.stdout:2/296: sync 2024-04-25T15:57:35.412 INFO:tasks.workunit.client.1.smithi155.stdout:6/389: sync 2024-04-25T15:57:35.412 INFO:tasks.workunit.client.1.smithi155.stdout:9/193: sync 2024-04-25T15:57:35.413 INFO:tasks.workunit.client.1.smithi155.stdout:2/297: fdatasync f1 0 2024-04-25T15:57:35.413 INFO:tasks.workunit.client.1.smithi155.stdout:9/194: fdatasync dc/f14 0 2024-04-25T15:57:35.413 INFO:tasks.workunit.client.1.smithi155.stdout:4/213: dread da/f21 [0,4194304] 0 2024-04-25T15:57:35.414 INFO:tasks.workunit.client.1.smithi155.stdout:1/225: symlink d1/d16/d1d/d29/d3d/l4b 0 2024-04-25T15:57:35.415 INFO:tasks.workunit.client.1.smithi155.stdout:9/195: readlink l2 0 2024-04-25T15:57:35.415 INFO:tasks.workunit.client.1.smithi155.stdout:5/235: getdents d0/d3/d15/d1f 0 2024-04-25T15:57:35.417 INFO:tasks.workunit.client.1.smithi155.stdout:7/239: getdents d2/dd/d36/d46 0 2024-04-25T15:57:35.419 INFO:tasks.workunit.client.1.smithi155.stdout:1/226: rmdir d1/d6/d1b/d34 39 2024-04-25T15:57:35.421 INFO:tasks.workunit.client.1.smithi155.stdout:1/227: fdatasync d1/d6/f14 0 2024-04-25T15:57:35.422 INFO:tasks.workunit.client.1.smithi155.stdout:6/390: symlink d0/d13/d34/d6c/l8a 0 2024-04-25T15:57:35.424 INFO:tasks.workunit.client.1.smithi155.stdout:4/214: fsync da/f16 0 2024-04-25T15:57:35.425 INFO:tasks.workunit.client.1.smithi155.stdout:9/196: mknod dc/c4d 0 2024-04-25T15:57:35.426 INFO:tasks.workunit.client.1.smithi155.stdout:6/391: write d0/d18/f23 [249202,68172] 0 2024-04-25T15:57:35.426 INFO:tasks.workunit.client.1.smithi155.stdout:7/240: write d2/f1f [757466,98289] 0 2024-04-25T15:57:35.429 INFO:tasks.workunit.client.1.smithi155.stdout:1/228: dread - d1/d6/d1b/d34/f47 zero size 2024-04-25T15:57:35.429 INFO:tasks.workunit.client.1.smithi155.stdout:4/215: fdatasync da/dc/d18/f46 0 2024-04-25T15:57:35.431 INFO:tasks.workunit.client.1.smithi155.stdout:7/241: symlink d2/dd/d30/d44/l57 0 2024-04-25T15:57:35.433 INFO:tasks.workunit.client.1.smithi155.stdout:2/298: dread d7/db/dd/d15/f37 [0,4194304] 0 2024-04-25T15:57:35.433 INFO:tasks.workunit.client.1.smithi155.stdout:1/229: readlink d1/d16/d1d/d33/l4a 0 2024-04-25T15:57:35.433 INFO:tasks.workunit.client.1.smithi155.stdout:5/236: dwrite d0/d3/d2c/f3a [0,4194304] 0 2024-04-25T15:57:35.435 INFO:tasks.workunit.client.1.smithi155.stdout:4/216: truncate da/d23/f42 661796 0 2024-04-25T15:57:35.436 INFO:tasks.workunit.client.1.smithi155.stdout:9/197: rename dc/d11/l45 to dc/d44/l4e 0 2024-04-25T15:57:35.436 INFO:tasks.workunit.client.1.smithi155.stdout:7/242: chown d2/dd/d30/c3a 208488 1 2024-04-25T15:57:35.440 INFO:tasks.workunit.client.1.smithi155.stdout:2/299: mknod d7/db/d2e/d44/c5a 0 2024-04-25T15:57:35.441 INFO:tasks.workunit.client.1.smithi155.stdout:9/198: rename dc/d13/d2e/c38 to dc/d13/d48/c4f 0 2024-04-25T15:57:35.443 INFO:tasks.workunit.client.1.smithi155.stdout:5/237: unlink d0/d3/d15/d1f/f35 0 2024-04-25T15:57:35.444 INFO:tasks.workunit.client.1.smithi155.stdout:6/392: dwrite d0/d1a/d37/f4d [4194304,4194304] 0 2024-04-25T15:57:35.445 INFO:tasks.workunit.client.1.smithi155.stdout:7/243: fsync d2/dd/d13/d24/d35/f3c 0 2024-04-25T15:57:35.447 INFO:tasks.workunit.client.1.smithi155.stdout:9/199: symlink dc/d17/d18/l50 0 2024-04-25T15:57:35.450 INFO:tasks.workunit.client.1.smithi155.stdout:2/300: symlink d7/db/l5b 0 2024-04-25T15:57:35.450 INFO:tasks.workunit.client.1.smithi155.stdout:6/393: truncate d0/d18/f23 875054 0 2024-04-25T15:57:35.452 INFO:tasks.workunit.client.1.smithi155.stdout:5/238: creat d0/d47/f4d x:0 0 0 2024-04-25T15:57:35.452 INFO:tasks.workunit.client.1.smithi155.stdout:9/200: dread - dc/d13/f26 zero size 2024-04-25T15:57:35.453 INFO:tasks.workunit.client.1.smithi155.stdout:2/301: write d7/f3b [2581936,18597] 0 2024-04-25T15:57:35.456 INFO:tasks.workunit.client.1.smithi155.stdout:9/201: write dc/d11/f27 [1650705,110270] 0 2024-04-25T15:57:35.456 INFO:tasks.workunit.client.1.smithi155.stdout:7/244: rename d2/dd/d36/f43 to d2/d26/f58 0 2024-04-25T15:57:35.457 INFO:tasks.workunit.client.1.smithi155.stdout:6/394: truncate d0/d1a/d25/d2e/f67 951869 0 2024-04-25T15:57:35.457 INFO:tasks.workunit.client.1.smithi155.stdout:4/217: dwrite da/d30/f38 [0,4194304] 0 2024-04-25T15:57:35.457 INFO:tasks.workunit.client.1.smithi155.stdout:9/202: stat dc/d17/c24 0 2024-04-25T15:57:35.458 INFO:tasks.workunit.client.1.smithi155.stdout:7/245: read d2/f1d [2411796,13616] 0 2024-04-25T15:57:35.459 INFO:tasks.workunit.client.1.smithi155.stdout:5/239: rmdir d0/d3/d15/d30 39 2024-04-25T15:57:35.460 INFO:tasks.workunit.client.1.smithi155.stdout:7/246: fdatasync d2/dd/d36/d46/f51 0 2024-04-25T15:57:35.460 INFO:tasks.workunit.client.1.smithi155.stdout:4/218: chown da/dc/l3c 2822695 1 2024-04-25T15:57:35.461 INFO:tasks.workunit.client.1.smithi155.stdout:9/203: rmdir dc/d17/d2a 39 2024-04-25T15:57:35.462 INFO:tasks.workunit.client.1.smithi155.stdout:5/240: fdatasync d0/d3/d2c/f48 0 2024-04-25T15:57:35.463 INFO:tasks.workunit.client.1.smithi155.stdout:4/219: write da/d23/d2a/f4f [833301,83856] 0 2024-04-25T15:57:35.463 INFO:tasks.workunit.client.1.smithi155.stdout:9/204: truncate dc/d13/f3a 935073 0 2024-04-25T15:57:35.464 INFO:tasks.workunit.client.1.smithi155.stdout:6/395: unlink d0/d1a/d21/f5b 0 2024-04-25T15:57:35.464 INFO:tasks.workunit.client.1.smithi155.stdout:4/220: chown da 1 1 2024-04-25T15:57:35.466 INFO:tasks.workunit.client.1.smithi155.stdout:2/302: creat d7/db/dd/f5c x:0 0 0 2024-04-25T15:57:35.469 INFO:tasks.workunit.client.1.smithi155.stdout:4/221: unlink da/d23/c3e 0 2024-04-25T15:57:35.472 INFO:tasks.workunit.client.1.smithi155.stdout:4/222: rename da/dc/d18 to da/dc/d18/d52 22 2024-04-25T15:57:35.472 INFO:tasks.workunit.client.1.smithi155.stdout:7/247: dwrite d2/dd/d13/d4a/f4d [0,4194304] 0 2024-04-25T15:57:35.473 INFO:tasks.workunit.client.1.smithi155.stdout:6/396: dread d0/d18/f48 [0,4194304] 0 2024-04-25T15:57:35.475 INFO:tasks.workunit.client.1.smithi155.stdout:6/397: write d0/d13/d34/d38/f88 [403025,3599] 0 2024-04-25T15:57:35.477 INFO:tasks.workunit.client.1.smithi155.stdout:2/303: mknod d7/db/d29/c5d 0 2024-04-25T15:57:35.477 INFO:tasks.workunit.client.1.smithi155.stdout:9/205: link dc/d13/f3b dc/d17/f51 0 2024-04-25T15:57:35.478 INFO:tasks.workunit.client.1.smithi155.stdout:7/248: fdatasync d2/f1d 0 2024-04-25T15:57:35.479 INFO:tasks.workunit.client.1.smithi155.stdout:6/398: symlink d0/d18/l8b 0 2024-04-25T15:57:35.481 INFO:tasks.workunit.client.1.smithi155.stdout:2/304: rmdir d7/db 39 2024-04-25T15:57:35.481 INFO:tasks.workunit.client.1.smithi155.stdout:7/249: fsync d2/dd/d13/d24/d35/f3f 0 2024-04-25T15:57:35.482 INFO:tasks.workunit.client.1.smithi155.stdout:6/399: symlink d0/d18/l8c 0 2024-04-25T15:57:35.483 INFO:tasks.workunit.client.1.smithi155.stdout:9/206: creat dc/d17/d2a/f52 x:0 0 0 2024-04-25T15:57:35.486 INFO:tasks.workunit.client.1.smithi155.stdout:5/241: truncate d0/d3/d15/d13/f19 3575341 0 2024-04-25T15:57:35.487 INFO:tasks.workunit.client.1.smithi155.stdout:6/400: creat d0/d1a/d37/f8d x:0 0 0 2024-04-25T15:57:35.490 INFO:tasks.workunit.client.1.smithi155.stdout:7/250: truncate d2/dd/d13/d24/d35/f3f 10331217 0 2024-04-25T15:57:35.495 INFO:tasks.workunit.client.1.smithi155.stdout:5/242: rename d0/d27/l38 to d0/d3/l4e 0 2024-04-25T15:57:35.496 INFO:tasks.workunit.client.1.smithi155.stdout:9/207: getdents dc/d13/d48 0 2024-04-25T15:57:35.498 INFO:tasks.workunit.client.1.smithi155.stdout:5/243: truncate d0/d3/d15/fe 4845142 0 2024-04-25T15:57:35.499 INFO:tasks.workunit.client.1.smithi155.stdout:9/208: symlink dc/d13/d2e/l53 0 2024-04-25T15:57:35.499 INFO:tasks.workunit.client.1.smithi155.stdout:5/244: chown d0/d47 1983 1 2024-04-25T15:57:35.500 INFO:tasks.workunit.client.1.smithi155.stdout:2/305: truncate d7/db/dd/d15/f1a 206962 0 2024-04-25T15:57:35.500 INFO:tasks.workunit.client.1.smithi155.stdout:7/251: dwrite d2/dd/d13/f2c [0,4194304] 0 2024-04-25T15:57:35.501 INFO:tasks.workunit.client.1.smithi155.stdout:2/306: chown d7/f2b 2967245 1 2024-04-25T15:57:35.502 INFO:tasks.workunit.client.1.smithi155.stdout:7/252: fsync d2/f1f 0 2024-04-25T15:57:35.502 INFO:tasks.workunit.client.1.smithi155.stdout:9/209: getdents dc/d13/d48 0 2024-04-25T15:57:35.503 INFO:tasks.workunit.client.1.smithi155.stdout:6/401: truncate d0/d13/f20 1823823 0 2024-04-25T15:57:35.503 INFO:tasks.workunit.client.1.smithi155.stdout:6/402: stat d0/d18/f48 0 2024-04-25T15:57:35.504 INFO:tasks.workunit.client.1.smithi155.stdout:7/253: write d2/f15 [646318,5059] 0 2024-04-25T15:57:35.506 INFO:tasks.workunit.client.1.smithi155.stdout:9/210: fdatasync dc/d17/f1b 0 2024-04-25T15:57:35.515 INFO:tasks.workunit.client.1.smithi155.stdout:9/211: chown dc/d17/d18/l1c 1712780 1 2024-04-25T15:57:35.516 INFO:tasks.workunit.client.1.smithi155.stdout:5/245: dwrite d0/d3/f4a [0,4194304] 0 2024-04-25T15:57:35.518 INFO:tasks.workunit.client.1.smithi155.stdout:2/307: dwrite d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:35.520 INFO:tasks.workunit.client.1.smithi155.stdout:0/222: sync 2024-04-25T15:57:35.521 INFO:tasks.workunit.client.1.smithi155.stdout:2/308: dread - d7/db/dd/f5c zero size 2024-04-25T15:57:35.523 INFO:tasks.workunit.client.1.smithi155.stdout:9/212: read f7 [3719805,15870] 0 2024-04-25T15:57:35.524 INFO:tasks.workunit.client.1.smithi155.stdout:0/223: chown d1/d3/d5/f13 700 1 2024-04-25T15:57:35.524 INFO:tasks.workunit.client.1.smithi155.stdout:6/403: dwrite d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:35.527 INFO:tasks.workunit.client.1.smithi155.stdout:5/246: mkdir d0/d3/d15/d30/d4f 0 2024-04-25T15:57:35.529 INFO:tasks.workunit.client.1.smithi155.stdout:9/213: creat dc/d13/f54 x:0 0 0 2024-04-25T15:57:35.529 INFO:tasks.workunit.client.1.smithi155.stdout:5/247: rmdir d0/d3/d15/d30 39 2024-04-25T15:57:35.530 INFO:tasks.workunit.client.1.smithi155.stdout:2/309: creat d7/db/dd/f5e x:0 0 0 2024-04-25T15:57:35.533 INFO:tasks.workunit.client.1.smithi155.stdout:9/214: link dc/d17/d18/f41 dc/d17/d18/f55 0 2024-04-25T15:57:35.537 INFO:tasks.workunit.client.1.smithi155.stdout:2/310: mknod d7/db/d29/c5f 0 2024-04-25T15:57:35.538 INFO:tasks.workunit.client.1.smithi155.stdout:6/404: dwrite d0/d13/f27 [0,4194304] 0 2024-04-25T15:57:35.539 INFO:tasks.workunit.client.1.smithi155.stdout:9/215: dread dc/d17/f51 [0,4194304] 0 2024-04-25T15:57:35.539 INFO:tasks.workunit.client.1.smithi155.stdout:0/224: dwrite d1/f1b [0,4194304] 0 2024-04-25T15:57:35.540 INFO:tasks.workunit.client.1.smithi155.stdout:2/311: readlink d7/db/dd/l25 0 2024-04-25T15:57:35.541 INFO:tasks.workunit.client.1.smithi155.stdout:2/312: fsync d7/f49 0 2024-04-25T15:57:35.542 INFO:tasks.workunit.client.1.smithi155.stdout:7/254: dread d2/dd/d13/d1c/f22 [0,4194304] 0 2024-04-25T15:57:35.544 INFO:tasks.workunit.client.1.smithi155.stdout:0/225: mknod d1/d3/c57 0 2024-04-25T15:57:35.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/216: mkdir dc/d17/d18/d56 0 2024-04-25T15:57:35.547 INFO:tasks.workunit.client.1.smithi155.stdout:2/313: mkdir d7/db/dd/d15/d60 0 2024-04-25T15:57:35.549 INFO:tasks.workunit.client.1.smithi155.stdout:7/255: rename d2/dd/d13/d1c/f3b to d2/dd/d13/d1c/f59 0 2024-04-25T15:57:35.549 INFO:tasks.workunit.client.1.smithi155.stdout:5/248: dwrite d0/f37 [0,4194304] 0 2024-04-25T15:57:35.551 INFO:tasks.workunit.client.1.smithi155.stdout:2/314: read d7/db/dd/d15/f45 [5520274,120710] 0 2024-04-25T15:57:35.554 INFO:tasks.workunit.client.1.smithi155.stdout:2/315: chown d7/d23/f20 1193 1 2024-04-25T15:57:35.554 INFO:tasks.workunit.client.1.smithi155.stdout:7/256: read d2/f8 [2037499,5737] 0 2024-04-25T15:57:35.557 INFO:tasks.workunit.client.1.smithi155.stdout:0/226: truncate d1/d3/d5/f13 467991 0 2024-04-25T15:57:35.557 INFO:tasks.workunit.client.1.smithi155.stdout:9/217: link dc/d17/d18/f55 dc/d13/d2e/f57 0 2024-04-25T15:57:35.558 INFO:tasks.workunit.client.1.smithi155.stdout:6/405: dwrite d0/d1a/d21/f32 [0,4194304] 0 2024-04-25T15:57:35.558 INFO:tasks.workunit.client.1.smithi155.stdout:5/249: write d0/d3/d2c/f2f [839983,58211] 0 2024-04-25T15:57:35.560 INFO:tasks.workunit.client.1.smithi155.stdout:5/250: dread - d0/d27/f43 zero size 2024-04-25T15:57:35.560 INFO:tasks.workunit.client.1.smithi155.stdout:0/227: truncate d1/f3c 917910 0 2024-04-25T15:57:35.562 INFO:tasks.workunit.client.1.smithi155.stdout:6/406: chown d0/d1a/d21/f32 0 1 2024-04-25T15:57:35.562 INFO:tasks.workunit.client.1.smithi155.stdout:2/316: creat d7/db/d2e/f61 x:0 0 0 2024-04-25T15:57:35.564 INFO:tasks.workunit.client.1.smithi155.stdout:9/218: dread dc/d17/f29 [0,4194304] 0 2024-04-25T15:57:35.565 INFO:tasks.workunit.client.1.smithi155.stdout:6/407: write d0/d1a/d25/d2e/d39/f55 [3640507,83136] 0 2024-04-25T15:57:35.567 INFO:tasks.workunit.client.1.smithi155.stdout:7/257: symlink d2/dd/d30/l5a 0 2024-04-25T15:57:35.569 INFO:tasks.workunit.client.1.smithi155.stdout:5/251: mkdir d0/d3/d15/d1f/d50 0 2024-04-25T15:57:35.570 INFO:tasks.workunit.client.1.smithi155.stdout:5/252: read - d0/d27/f4b zero size 2024-04-25T15:57:35.575 INFO:tasks.workunit.client.1.smithi155.stdout:5/253: write d0/d27/f4b [902465,50358] 0 2024-04-25T15:57:35.575 INFO:tasks.workunit.client.1.smithi155.stdout:6/408: mkdir d0/d1a/d45/d61/d8e 0 2024-04-25T15:57:35.575 INFO:tasks.workunit.client.1.smithi155.stdout:7/258: creat d2/f5b x:0 0 0 2024-04-25T15:57:35.575 INFO:tasks.workunit.client.1.smithi155.stdout:0/228: mknod d1/d6/d16/c58 0 2024-04-25T15:57:35.576 INFO:tasks.workunit.client.1.smithi155.stdout:7/259: readlink d2/l4 0 2024-04-25T15:57:35.576 INFO:tasks.workunit.client.1.smithi155.stdout:5/254: write d0/d3/d15/d13/d32/f49 [875944,75813] 0 2024-04-25T15:57:35.576 INFO:tasks.workunit.client.1.smithi155.stdout:7/260: chown d2/l4 32 1 2024-04-25T15:57:35.577 INFO:tasks.workunit.client.1.smithi155.stdout:6/409: dread d0/d1a/d21/d73/f5a [0,4194304] 0 2024-04-25T15:57:35.586 INFO:tasks.workunit.client.1.smithi155.stdout:7/261: dwrite d2/f8 [4194304,4194304] 0 2024-04-25T15:57:35.589 INFO:tasks.workunit.client.1.smithi155.stdout:9/219: write dc/d13/d2e/f57 [348215,117892] 0 2024-04-25T15:57:35.591 INFO:tasks.workunit.client.1.smithi155.stdout:7/262: rename d2/dd/d30/l5a to d2/dd/d13/d24/d35/l5c 0 2024-04-25T15:57:35.592 INFO:tasks.workunit.client.1.smithi155.stdout:5/255: truncate d0/d3/d15/fe 2925431 0 2024-04-25T15:57:35.593 INFO:tasks.workunit.client.1.smithi155.stdout:2/317: dread d7/d23/f34 [0,4194304] 0 2024-04-25T15:57:35.594 INFO:tasks.workunit.client.1.smithi155.stdout:6/410: write d0/d13/f20 [14,127183] 0 2024-04-25T15:57:35.598 INFO:tasks.workunit.client.1.smithi155.stdout:7/263: link d2/dd/d13/d1c/f22 d2/dd/d13/d4a/f5d 0 2024-04-25T15:57:35.599 INFO:tasks.workunit.client.1.smithi155.stdout:2/318: write d7/db/d2e/f61 [719664,95623] 0 2024-04-25T15:57:35.602 INFO:tasks.workunit.client.1.smithi155.stdout:6/411: creat d0/d13/d6f/f8f x:0 0 0 2024-04-25T15:57:35.602 INFO:tasks.workunit.client.1.smithi155.stdout:5/256: symlink d0/d3/d15/l51 0 2024-04-25T15:57:35.603 INFO:tasks.workunit.client.1.smithi155.stdout:7/264: fdatasync d2/dd/f23 0 2024-04-25T15:57:35.603 INFO:tasks.workunit.client.1.smithi155.stdout:0/229: dread d1/d3/f43 [0,4194304] 0 2024-04-25T15:57:35.605 INFO:tasks.workunit.client.1.smithi155.stdout:9/220: dwrite dc/d17/d2a/f35 [0,4194304] 0 2024-04-25T15:57:35.608 INFO:tasks.workunit.client.1.smithi155.stdout:9/221: dread - dc/d13/f54 zero size 2024-04-25T15:57:35.609 INFO:tasks.workunit.client.1.smithi155.stdout:6/412: truncate d0/d1a/f6b 167686 0 2024-04-25T15:57:35.609 INFO:tasks.workunit.client.1.smithi155.stdout:0/230: creat d1/d6/d29/f59 x:0 0 0 2024-04-25T15:57:35.611 INFO:tasks.workunit.client.1.smithi155.stdout:7/265: creat d2/dd/d12/f5e x:0 0 0 2024-04-25T15:57:35.613 INFO:tasks.workunit.client.1.smithi155.stdout:7/266: chown d2/dd/d13/f21 83 1 2024-04-25T15:57:35.613 INFO:tasks.workunit.client.1.smithi155.stdout:9/222: symlink dc/d13/l58 0 2024-04-25T15:57:35.614 INFO:tasks.workunit.client.1.smithi155.stdout:0/231: symlink d1/d3/d5/da/l5a 0 2024-04-25T15:57:35.616 INFO:tasks.workunit.client.1.smithi155.stdout:5/257: dwrite d0/f37 [0,4194304] 0 2024-04-25T15:57:35.616 INFO:tasks.workunit.client.1.smithi155.stdout:6/413: getdents d0/d13/d34/d38/d4c 0 2024-04-25T15:57:35.616 INFO:tasks.workunit.client.1.smithi155.stdout:7/267: chown d2/dd/d36/d46/l4b 53115 1 2024-04-25T15:57:35.617 INFO:tasks.workunit.client.1.smithi155.stdout:9/223: mkdir dc/d13/d59 0 2024-04-25T15:57:35.618 INFO:tasks.workunit.client.1.smithi155.stdout:7/268: readlink d2/dd/d30/d44/l57 0 2024-04-25T15:57:35.618 INFO:tasks.workunit.client.1.smithi155.stdout:0/232: mkdir d1/d3/d5/d5b 0 2024-04-25T15:57:35.620 INFO:tasks.workunit.client.1.smithi155.stdout:9/224: mkdir dc/d11/d5a 0 2024-04-25T15:57:35.620 INFO:tasks.workunit.client.1.smithi155.stdout:5/258: write d0/d27/f43 [513087,102048] 0 2024-04-25T15:57:35.620 INFO:tasks.workunit.client.1.smithi155.stdout:6/414: mkdir d0/d13/d34/d38/d90 0 2024-04-25T15:57:35.621 INFO:tasks.workunit.client.1.smithi155.stdout:7/269: rmdir d2/dd/d12 39 2024-04-25T15:57:35.624 INFO:tasks.workunit.client.1.smithi155.stdout:9/225: mkdir dc/d11/d5a/d5b 0 2024-04-25T15:57:35.625 INFO:tasks.workunit.client.1.smithi155.stdout:9/226: chown dc/d17/d18/f23 105810 1 2024-04-25T15:57:35.626 INFO:tasks.workunit.client.1.smithi155.stdout:0/233: rename d1/d3/d12/c18 to d1/d6/d29/c5c 0 2024-04-25T15:57:35.626 INFO:tasks.workunit.client.1.smithi155.stdout:9/227: chown dc/ff 1 1 2024-04-25T15:57:35.628 INFO:tasks.workunit.client.1.smithi155.stdout:7/270: readlink d2/dd/d13/d24/d35/l5c 0 2024-04-25T15:57:35.629 INFO:tasks.workunit.client.1.smithi155.stdout:2/319: dread d7/db/ff [4194304,4194304] 0 2024-04-25T15:57:35.630 INFO:tasks.workunit.client.1.smithi155.stdout:8/161: sync 2024-04-25T15:57:35.630 INFO:tasks.workunit.client.1.smithi155.stdout:3/243: sync 2024-04-25T15:57:35.631 INFO:tasks.workunit.client.1.smithi155.stdout:6/415: rename d0/d13/d34/d38/c71 to d0/d13/d34/d38/d4c/c91 0 2024-04-25T15:57:35.631 INFO:tasks.workunit.client.1.smithi155.stdout:2/320: truncate d7/f31 2781711 0 2024-04-25T15:57:35.633 INFO:tasks.workunit.client.1.smithi155.stdout:9/228: symlink dc/d11/d30/l5c 0 2024-04-25T15:57:35.633 INFO:tasks.workunit.client.1.smithi155.stdout:5/259: link d0/d3/c46 d0/d3/d15/c52 0 2024-04-25T15:57:35.635 INFO:tasks.workunit.client.1.smithi155.stdout:8/162: write d2/d5/f29 [1152216,90250] 0 2024-04-25T15:57:35.635 INFO:tasks.workunit.client.1.smithi155.stdout:3/244: fdatasync d1/d4/f18 0 2024-04-25T15:57:35.640 INFO:tasks.workunit.client.1.smithi155.stdout:2/321: rename d7/db/dd/l1f to d7/db/d2e/l62 0 2024-04-25T15:57:35.641 INFO:tasks.workunit.client.1.smithi155.stdout:0/234: dwrite d1/d6/d29/d47/f55 [0,4194304] 0 2024-04-25T15:57:35.641 INFO:tasks.workunit.client.1.smithi155.stdout:8/163: truncate d2/d5/f29 1652189 0 2024-04-25T15:57:35.642 INFO:tasks.workunit.client.1.smithi155.stdout:8/164: read d2/fa [664671,1581] 0 2024-04-25T15:57:35.644 INFO:tasks.workunit.client.1.smithi155.stdout:7/271: dwrite d2/dd/f2f [0,4194304] 0 2024-04-25T15:57:35.647 INFO:tasks.workunit.client.1.smithi155.stdout:4/223: sync 2024-04-25T15:57:35.647 INFO:tasks.workunit.client.1.smithi155.stdout:1/230: sync 2024-04-25T15:57:35.649 INFO:tasks.workunit.client.1.smithi155.stdout:4/224: chown da/dc/d18/l1e 9679 1 2024-04-25T15:57:35.656 INFO:tasks.workunit.client.1.smithi155.stdout:4/225: write da/dc/f47 [563590,63323] 0 2024-04-25T15:57:35.657 INFO:tasks.workunit.client.1.smithi155.stdout:9/229: truncate f7 3575851 0 2024-04-25T15:57:35.659 INFO:tasks.workunit.client.1.smithi155.stdout:4/226: stat da/d30/l32 0 2024-04-25T15:57:35.660 INFO:tasks.workunit.client.1.smithi155.stdout:0/235: dwrite d1/d6/d29/d47/f55 [0,4194304] 0 2024-04-25T15:57:35.661 INFO:tasks.workunit.client.1.smithi155.stdout:7/272: creat d2/dd/d36/d46/f5f x:0 0 0 2024-04-25T15:57:35.661 INFO:tasks.workunit.client.1.smithi155.stdout:5/260: rename d0/d3/d15/d13 to d0/d3/d53 0 2024-04-25T15:57:35.664 INFO:tasks.workunit.client.1.smithi155.stdout:8/165: dwrite d2/d15/d18/f1a [0,4194304] 0 2024-04-25T15:57:35.668 INFO:tasks.workunit.client.1.smithi155.stdout:1/231: dwrite d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:35.675 INFO:tasks.workunit.client.1.smithi155.stdout:4/227: creat da/dc/f53 x:0 0 0 2024-04-25T15:57:35.675 INFO:tasks.workunit.client.1.smithi155.stdout:2/322: dwrite d7/db/ff [4194304,4194304] 0 2024-04-25T15:57:35.676 INFO:tasks.workunit.client.1.smithi155.stdout:4/228: chown da/dc/c17 0 1 2024-04-25T15:57:35.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/273: rename d2/dd/d13/f21 to d2/dd/d13/d1c/f60 0 2024-04-25T15:57:35.678 INFO:tasks.workunit.client.1.smithi155.stdout:1/232: creat d1/d16/d37/f4c x:0 0 0 2024-04-25T15:57:35.679 INFO:tasks.workunit.client.1.smithi155.stdout:9/230: creat dc/d13/d59/f5d x:0 0 0 2024-04-25T15:57:35.680 INFO:tasks.workunit.client.1.smithi155.stdout:7/274: truncate d2/f5b 751834 0 2024-04-25T15:57:35.680 INFO:tasks.workunit.client.1.smithi155.stdout:1/233: stat d1/d16/d37/f4c 0 2024-04-25T15:57:35.680 INFO:tasks.workunit.client.1.smithi155.stdout:2/323: unlink d7/db/d2e/f50 0 2024-04-25T15:57:35.684 INFO:tasks.workunit.client.1.smithi155.stdout:1/234: unlink d1/l9 0 2024-04-25T15:57:35.685 INFO:tasks.workunit.client.1.smithi155.stdout:0/236: link d1/d3/c57 d1/d6/d29/c5d 0 2024-04-25T15:57:35.685 INFO:tasks.workunit.client.1.smithi155.stdout:9/231: write dc/d13/d59/f5d [1017264,106954] 0 2024-04-25T15:57:35.686 INFO:tasks.workunit.client.1.smithi155.stdout:7/275: truncate d2/f1d 3467012 0 2024-04-25T15:57:35.687 INFO:tasks.workunit.client.1.smithi155.stdout:5/261: rename d0/d3/c22 to d0/d3/d15/d30/c54 0 2024-04-25T15:57:35.687 INFO:tasks.workunit.client.1.smithi155.stdout:0/237: fsync d1/d3/d5/f26 0 2024-04-25T15:57:35.689 INFO:tasks.workunit.client.1.smithi155.stdout:4/229: dwrite da/dc/d18/d34/f44 [0,4194304] 0 2024-04-25T15:57:35.690 INFO:tasks.workunit.client.1.smithi155.stdout:2/324: mknod d7/db/dd/d15/d60/c63 0 2024-04-25T15:57:35.692 INFO:tasks.workunit.client.1.smithi155.stdout:0/238: readlink d1/d3/d5/da/l52 0 2024-04-25T15:57:35.693 INFO:tasks.workunit.client.1.smithi155.stdout:9/232: rename dc/d17/d18/f55 to dc/d13/d59/f5e 0 2024-04-25T15:57:35.694 INFO:tasks.workunit.client.1.smithi155.stdout:0/239: write d1/f3c [28240,64489] 0 2024-04-25T15:57:35.696 INFO:tasks.workunit.client.1.smithi155.stdout:0/240: chown d1/d6 49 1 2024-04-25T15:57:35.698 INFO:tasks.workunit.client.1.smithi155.stdout:0/241: write d1/d6/f2f [354996,65468] 0 2024-04-25T15:57:35.699 INFO:tasks.workunit.client.1.smithi155.stdout:4/230: mknod da/dc/d18/d34/c54 0 2024-04-25T15:57:35.699 INFO:tasks.workunit.client.1.smithi155.stdout:2/325: mknod d7/db/dd/d15/d60/c64 0 2024-04-25T15:57:35.700 INFO:tasks.workunit.client.1.smithi155.stdout:9/233: creat dc/d13/d59/f5f x:0 0 0 2024-04-25T15:57:35.701 INFO:tasks.workunit.client.1.smithi155.stdout:5/262: dwrite d0/f4c [0,4194304] 0 2024-04-25T15:57:35.703 INFO:tasks.workunit.client.1.smithi155.stdout:9/234: write dc/d13/f26 [857805,40294] 0 2024-04-25T15:57:35.709 INFO:tasks.workunit.client.1.smithi155.stdout:5/263: symlink d0/d27/l55 0 2024-04-25T15:57:35.709 INFO:tasks.workunit.client.1.smithi155.stdout:2/326: mknod d7/db/dd/c65 0 2024-04-25T15:57:35.709 INFO:tasks.workunit.client.1.smithi155.stdout:5/264: write d0/f40 [441040,74590] 0 2024-04-25T15:57:35.712 INFO:tasks.workunit.client.1.smithi155.stdout:4/231: dwrite da/f11 [0,4194304] 0 2024-04-25T15:57:35.712 INFO:tasks.workunit.client.1.smithi155.stdout:0/242: link d1/d6/d16/c58 d1/d3/d12/c5e 0 2024-04-25T15:57:35.714 INFO:tasks.workunit.client.1.smithi155.stdout:0/243: read - d1/d6/d29/f53 zero size 2024-04-25T15:57:35.714 INFO:tasks.workunit.client.1.smithi155.stdout:2/327: symlink d7/db/dd/d15/d60/l66 0 2024-04-25T15:57:35.718 INFO:tasks.workunit.client.1.smithi155.stdout:0/244: creat d1/d1a/f5f x:0 0 0 2024-04-25T15:57:35.721 INFO:tasks.workunit.client.1.smithi155.stdout:9/235: dwrite dc/d17/f2b [0,4194304] 0 2024-04-25T15:57:35.726 INFO:tasks.workunit.client.1.smithi155.stdout:5/265: dwrite d0/d3/d2c/f2f [0,4194304] 0 2024-04-25T15:57:35.726 INFO:tasks.workunit.client.1.smithi155.stdout:2/328: truncate d7/db/dd/d15/f37 3530886 0 2024-04-25T15:57:35.726 INFO:tasks.workunit.client.1.smithi155.stdout:1/235: truncate d1/f12 1728526 0 2024-04-25T15:57:35.729 INFO:tasks.workunit.client.1.smithi155.stdout:4/232: dread da/f14 [0,4194304] 0 2024-04-25T15:57:35.731 INFO:tasks.workunit.client.1.smithi155.stdout:0/245: dread d1/d3/f43 [0,4194304] 0 2024-04-25T15:57:35.732 INFO:tasks.workunit.client.1.smithi155.stdout:5/266: creat d0/d3/d53/f56 x:0 0 0 2024-04-25T15:57:35.733 INFO:tasks.workunit.client.1.smithi155.stdout:2/329: symlink d7/db/dd/d15/d60/l67 0 2024-04-25T15:57:35.734 INFO:tasks.workunit.client.1.smithi155.stdout:5/267: fsync d0/d3/d2c/f3a 0 2024-04-25T15:57:35.735 INFO:tasks.workunit.client.1.smithi155.stdout:0/246: mkdir d1/d6/d16/d60 0 2024-04-25T15:57:35.737 INFO:tasks.workunit.client.1.smithi155.stdout:2/330: creat d7/db/d2e/d44/f68 x:0 0 0 2024-04-25T15:57:35.740 INFO:tasks.workunit.client.1.smithi155.stdout:5/268: symlink d0/d3/d15/d1f/d50/l57 0 2024-04-25T15:57:35.744 INFO:tasks.workunit.client.1.smithi155.stdout:0/247: creat d1/d3/d5/d5b/f61 x:0 0 0 2024-04-25T15:57:35.748 INFO:tasks.workunit.client.1.smithi155.stdout:1/236: symlink d1/d6/d1b/l4d 0 2024-04-25T15:57:35.749 INFO:tasks.workunit.client.1.smithi155.stdout:9/236: dread dc/d17/d18/f23 [0,4194304] 0 2024-04-25T15:57:35.752 INFO:tasks.workunit.client.1.smithi155.stdout:5/269: getdents d0/d3/d15/d1f 0 2024-04-25T15:57:35.752 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T15:57:35.753 INFO:tasks.workunit.client.1.smithi155.stdout:1/237: mknod d1/d16/c4e 0 2024-04-25T15:57:35.753 INFO:tasks.workunit.client.1.smithi155.stdout:2/331: dwrite d7/db/f4a [0,4194304] 0 2024-04-25T15:57:35.753 INFO:tasks.workunit.client.1.smithi155.stdout:1/238: stat d1/d32/c40 0 2024-04-25T15:57:35.755 INFO:tasks.workunit.client.1.smithi155.stdout:9/237: mkdir dc/d13/d60 0 2024-04-25T15:57:35.756 INFO:tasks.workunit.client.1.smithi155.stdout:1/239: creat d1/d16/d1d/d33/f4f x:0 0 0 2024-04-25T15:57:35.757 INFO:tasks.workunit.client.1.smithi155.stdout:2/332: creat d7/db/d2e/f69 x:0 0 0 2024-04-25T15:57:35.759 INFO:tasks.workunit.client.1.smithi155.stdout:2/333: write d7/db/dd/d15/f42 [1609501,22624] 0 2024-04-25T15:57:35.761 INFO:tasks.workunit.client.1.smithi155.stdout:0/248: write d1/d6/d29/f3a [3309376,9917] 0 2024-04-25T15:57:35.763 INFO:tasks.workunit.client.1.smithi155.stdout:9/238: dread dc/d13/d59/f5d [0,4194304] 0 2024-04-25T15:57:35.764 INFO:tasks.workunit.client.1.smithi155.stdout:9/239: chown dc/d13 852861095 1 2024-04-25T15:57:35.765 INFO:tasks.workunit.client.1.smithi155.stdout:5/270: rename d0/d3/d53 to d0/d58 0 2024-04-25T15:57:35.766 INFO:tasks.workunit.client.1.smithi155.stdout:1/240: symlink d1/d6/d1b/d34/l50 0 2024-04-25T15:57:35.766 INFO:tasks.workunit.client.1.smithi155.stdout:9/240: chown dc/d13/d2e/f4a 171661 1 2024-04-25T15:57:35.769 INFO:tasks.workunit.client.1.smithi155.stdout:5/271: write d0/d58/d32/f49 [567505,24805] 0 2024-04-25T15:57:35.770 INFO:tasks.workunit.client.1.smithi155.stdout:2/334: dwrite d7/db/f4a [0,4194304] 0 2024-04-25T15:57:35.770 INFO:tasks.workunit.client.1.smithi155.stdout:0/249: dread d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:35.771 INFO:tasks.workunit.client.1.smithi155.stdout:0/250: readlink d1/d3/d5/da/l52 0 2024-04-25T15:57:35.772 INFO:tasks.workunit.client.1.smithi155.stdout:9/241: creat dc/d13/d2e/d4c/f61 x:0 0 0 2024-04-25T15:57:35.773 INFO:tasks.workunit.client.1.smithi155.stdout:0/251: write d1/f4e [695692,8704] 0 2024-04-25T15:57:35.773 INFO:tasks.workunit.client.1.smithi155.stdout:1/241: creat d1/d6/d1b/d34/f51 x:0 0 0 2024-04-25T15:57:35.773 INFO:tasks.workunit.client.1.smithi155.stdout:5/272: stat d0/d3/c46 0 2024-04-25T15:57:35.778 INFO:tasks.workunit.client.1.smithi155.stdout:0/252: mknod d1/d6/d16/c62 0 2024-04-25T15:57:35.778 INFO:tasks.workunit.client.1.smithi155.stdout:1/242: chown d1/fb 12046352 1 2024-04-25T15:57:35.778 INFO:tasks.workunit.client.1.smithi155.stdout:9/242: mknod dc/d11/d5a/c62 0 2024-04-25T15:57:35.779 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T15:57:35.779 INFO:tasks.workunit.client.0.smithi087.stderr:+ make 2024-04-25T15:57:35.779 INFO:tasks.workunit.client.1.smithi155.stdout:9/243: mknod dc/d17/c63 0 2024-04-25T15:57:35.780 INFO:tasks.workunit.client.1.smithi155.stdout:1/243: dread d1/d16/f2c [0,4194304] 0 2024-04-25T15:57:35.781 INFO:tasks.workunit.client.1.smithi155.stdout:9/244: creat dc/d11/f64 x:0 0 0 2024-04-25T15:57:35.782 INFO:tasks.workunit.client.1.smithi155.stdout:9/245: creat dc/d11/d5a/f65 x:0 0 0 2024-04-25T15:57:35.785 INFO:tasks.workunit.client.1.smithi155.stdout:9/246: rename l4 to dc/d17/d2a/l66 0 2024-04-25T15:57:35.789 INFO:tasks.workunit.client.1.smithi155.stdout:1/244: dwrite d1/d6/d1b/d34/f47 [0,4194304] 0 2024-04-25T15:57:35.791 INFO:tasks.workunit.client.1.smithi155.stdout:1/245: write d1/f11 [155218,124396] 0 2024-04-25T15:57:35.793 INFO:tasks.workunit.client.1.smithi155.stdout:5/273: truncate d0/d3/d2c/f3a 3083259 0 2024-04-25T15:57:35.795 INFO:tasks.workunit.client.1.smithi155.stdout:1/246: truncate d1/fb 104220 0 2024-04-25T15:57:35.797 INFO:tasks.workunit.client.1.smithi155.stdout:1/247: write d1/d16/f3e [2937565,81133] 0 2024-04-25T15:57:35.798 INFO:tasks.workunit.client.1.smithi155.stdout:9/247: dwrite dc/d17/d18/f2d [0,4194304] 0 2024-04-25T15:57:35.802 INFO:tasks.workunit.client.1.smithi155.stdout:5/274: dread d0/f4c [0,4194304] 0 2024-04-25T15:57:35.805 INFO:tasks.workunit.client.1.smithi155.stdout:0/253: dread d1/d41/f44 [0,4194304] 0 2024-04-25T15:57:35.807 INFO:tasks.workunit.client.1.smithi155.stdout:0/254: fsync d1/f1b 0 2024-04-25T15:57:35.810 INFO:tasks.workunit.client.1.smithi155.stdout:0/255: dread - d1/d1a/f5f zero size 2024-04-25T15:57:35.813 INFO:tasks.workunit.client.1.smithi155.stdout:1/248: dwrite d1/d6/f2d [0,4194304] 0 2024-04-25T15:57:35.814 INFO:tasks.workunit.client.1.smithi155.stdout:5/275: dwrite d0/d58/f56 [0,4194304] 0 2024-04-25T15:57:35.815 INFO:tasks.workunit.client.1.smithi155.stdout:5/276: write d0/d27/f4b [784193,90181] 0 2024-04-25T15:57:35.820 INFO:tasks.workunit.client.1.smithi155.stdout:1/249: write d1/d6/f31 [228049,79307] 0 2024-04-25T15:57:35.821 INFO:tasks.workunit.client.1.smithi155.stdout:3/245: sync 2024-04-25T15:57:35.821 INFO:tasks.workunit.client.1.smithi155.stdout:6/416: sync 2024-04-25T15:57:35.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/417: stat d0/d18/c4e 0 2024-04-25T15:57:35.825 INFO:tasks.workunit.client.1.smithi155.stdout:1/250: dread d1/d6/d1b/d34/f47 [0,4194304] 0 2024-04-25T15:57:35.829 INFO:tasks.workunit.client.1.smithi155.stdout:1/251: link d1/d6/f7 d1/d6/d1b/d34/f52 0 2024-04-25T15:57:35.830 INFO:tasks.workunit.client.1.smithi155.stdout:6/418: truncate d0/d13/d43/f64 1500342 0 2024-04-25T15:57:35.830 INFO:tasks.workunit.client.1.smithi155.stdout:3/246: dwrite d1/f1f [4194304,4194304] 0 2024-04-25T15:57:35.834 INFO:tasks.workunit.client.1.smithi155.stdout:3/247: dread d1/f26 [0,4194304] 0 2024-04-25T15:57:35.835 INFO:tasks.workunit.client.1.smithi155.stdout:3/248: fdatasync d1/d4/d10/d21/f22 0 2024-04-25T15:57:35.837 INFO:tasks.workunit.client.1.smithi155.stdout:6/419: dread d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:35.838 INFO:tasks.workunit.client.1.smithi155.stdout:6/420: write d0/d1a/d37/f8d [828337,109619] 0 2024-04-25T15:57:35.840 INFO:tasks.workunit.client.1.smithi155.stdout:3/249: creat d1/d4/db/d28/d39/f4f x:0 0 0 2024-04-25T15:57:35.842 INFO:tasks.workunit.client.1.smithi155.stdout:1/252: truncate d1/d6/f2d 2722060 0 2024-04-25T15:57:35.844 INFO:tasks.workunit.client.1.smithi155.stdout:3/250: getdents d1/d4/db/d28/d29 0 2024-04-25T15:57:35.845 INFO:tasks.workunit.client.1.smithi155.stdout:1/253: creat d1/d6/d1b/d34/f53 x:0 0 0 2024-04-25T15:57:35.845 INFO:tasks.workunit.client.1.smithi155.stdout:1/254: stat d1/d16/d1d/d29 0 2024-04-25T15:57:35.896 INFO:tasks.workunit.client.1.smithi155.stdout:3/251: unlink d1/d4/d10/l4e 0 2024-04-25T15:57:35.900 INFO:tasks.workunit.client.1.smithi155.stdout:3/252: write d1/d4/db/f35 [747701,39190] 0 2024-04-25T15:57:35.903 INFO:tasks.workunit.client.1.smithi155.stdout:3/253: symlink d1/d4/db/l50 0 2024-04-25T15:57:35.904 INFO:tasks.workunit.client.1.smithi155.stdout:6/421: dread d0/f4f [0,4194304] 0 2024-04-25T15:57:35.908 INFO:tasks.workunit.client.1.smithi155.stdout:6/422: write d0/d1a/d25/d2e/f67 [1075238,63514] 0 2024-04-25T15:57:35.909 INFO:tasks.workunit.client.1.smithi155.stdout:3/254: rename d1/d4/db/d28/d39/c4d to d1/d4/d10/d21/c51 0 2024-04-25T15:57:35.913 INFO:tasks.workunit.client.1.smithi155.stdout:3/255: mkdir d1/d4/db/d20/d44/d52 0 2024-04-25T15:57:35.916 INFO:tasks.workunit.client.1.smithi155.stdout:6/423: link d0/d13/f27 d0/d1a/d45/f92 0 2024-04-25T15:57:35.918 INFO:tasks.workunit.client.1.smithi155.stdout:1/255: dread d1/d16/f39 [0,4194304] 0 2024-04-25T15:57:35.918 INFO:tasks.workunit.client.1.smithi155.stdout:3/256: creat d1/f53 x:0 0 0 2024-04-25T15:57:35.922 INFO:tasks.workunit.client.1.smithi155.stdout:1/256: unlink d1/d6/d1b/l21 0 2024-04-25T15:57:35.923 INFO:tasks.workunit.client.1.smithi155.stdout:6/424: dread d0/f10 [0,4194304] 0 2024-04-25T15:57:35.924 INFO:tasks.workunit.client.1.smithi155.stdout:3/257: getdents d1/d4/d25 0 2024-04-25T15:57:35.925 INFO:tasks.workunit.client.1.smithi155.stdout:1/257: creat d1/d16/f54 x:0 0 0 2024-04-25T15:57:35.926 INFO:tasks.workunit.client.1.smithi155.stdout:3/258: dread - d1/d4/db/d28/d39/f4f zero size 2024-04-25T15:57:35.927 INFO:tasks.workunit.client.1.smithi155.stdout:6/425: fsync d0/d1a/d25/d2e/d39/f4b 0 2024-04-25T15:57:35.928 INFO:tasks.workunit.client.1.smithi155.stdout:1/258: creat d1/d16/d1d/d29/f55 x:0 0 0 2024-04-25T15:57:35.930 INFO:tasks.workunit.client.1.smithi155.stdout:6/426: write d0/d1a/d25/d2e/f31 [1843112,36303] 0 2024-04-25T15:57:35.931 INFO:tasks.workunit.client.1.smithi155.stdout:3/259: truncate d1/d4/db/d28/d39/f4f 939359 0 2024-04-25T15:57:35.932 INFO:tasks.workunit.client.1.smithi155.stdout:1/259: creat d1/d6/d1b/d34/f56 x:0 0 0 2024-04-25T15:57:35.933 INFO:tasks.workunit.client.1.smithi155.stdout:6/427: readlink d0/d1a/d25/d51/l41 0 2024-04-25T15:57:35.933 INFO:tasks.workunit.client.1.smithi155.stdout:3/260: write d1/d4/db/f35 [1767593,124434] 0 2024-04-25T15:57:35.935 INFO:tasks.workunit.client.1.smithi155.stdout:3/261: chown d1/d4/d10/d2a/c30 4039329 1 2024-04-25T15:57:35.938 INFO:tasks.workunit.client.1.smithi155.stdout:1/260: rename d1/c20 to d1/d16/d1d/c57 0 2024-04-25T15:57:35.939 INFO:tasks.workunit.client.1.smithi155.stdout:3/262: rmdir d1/d4 39 2024-04-25T15:57:35.942 INFO:tasks.workunit.client.1.smithi155.stdout:1/261: mknod d1/d16/d1d/d29/d3d/d43/c58 0 2024-04-25T15:57:35.945 INFO:tasks.workunit.client.1.smithi155.stdout:3/263: truncate d1/d4/db/d28/f31 4434340 0 2024-04-25T15:57:35.947 INFO:tasks.workunit.client.1.smithi155.stdout:6/428: dwrite d0/d1a/d25/d2e/d39/f86 [0,4194304] 0 2024-04-25T15:57:35.951 INFO:tasks.workunit.client.1.smithi155.stdout:3/264: mkdir d1/d4/d10/d21/d54 0 2024-04-25T15:57:35.952 INFO:tasks.workunit.client.1.smithi155.stdout:1/262: link d1/d16/f54 d1/d16/d1d/d29/d3d/d43/f59 0 2024-04-25T15:57:35.952 INFO:tasks.workunit.client.1.smithi155.stdout:3/265: dread d1/f26 [0,4194304] 0 2024-04-25T15:57:35.953 INFO:tasks.workunit.client.1.smithi155.stdout:3/266: stat d1/f1f 0 2024-04-25T15:57:35.954 INFO:tasks.workunit.client.1.smithi155.stdout:8/166: sync 2024-04-25T15:57:35.955 INFO:tasks.workunit.client.1.smithi155.stdout:3/267: dread - d1/f53 zero size 2024-04-25T15:57:35.956 INFO:tasks.workunit.client.1.smithi155.stdout:1/263: read d1/d16/d1d/f38 [349541,123299] 0 2024-04-25T15:57:35.956 INFO:tasks.workunit.client.1.smithi155.stdout:6/429: dread d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:35.960 INFO:tasks.workunit.client.1.smithi155.stdout:1/264: unlink d1/d6/d1b/f41 0 2024-04-25T15:57:35.961 INFO:tasks.workunit.client.1.smithi155.stdout:1/265: symlink d1/d16/d37/l5a 0 2024-04-25T15:57:35.965 INFO:tasks.workunit.client.1.smithi155.stdout:6/430: dread d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:35.965 INFO:tasks.workunit.client.1.smithi155.stdout:1/266: symlink d1/d16/d1d/d33/l5b 0 2024-04-25T15:57:35.968 INFO:tasks.workunit.client.1.smithi155.stdout:3/268: dwrite d1/d4/db/d20/d44/f48 [0,4194304] 0 2024-04-25T15:57:35.969 INFO:tasks.workunit.client.1.smithi155.stdout:6/431: creat d0/d13/d43/f93 x:0 0 0 2024-04-25T15:57:35.970 INFO:tasks.workunit.client.1.smithi155.stdout:1/267: creat d1/d16/d1d/f5c x:0 0 0 2024-04-25T15:57:35.971 INFO:tasks.workunit.client.1.smithi155.stdout:8/167: dwrite d2/fa [0,4194304] 0 2024-04-25T15:57:35.972 INFO:tasks.workunit.client.1.smithi155.stdout:1/268: read d1/d6/d1b/d34/f52 [1845541,8408] 0 2024-04-25T15:57:35.974 INFO:tasks.workunit.client.1.smithi155.stdout:3/269: creat d1/d4/db/f55 x:0 0 0 2024-04-25T15:57:35.975 INFO:tasks.workunit.client.1.smithi155.stdout:1/269: stat d1/d6/d1b/d34/f51 0 2024-04-25T15:57:35.978 INFO:tasks.workunit.client.1.smithi155.stdout:1/270: stat d1/d16/d1d/d33 0 2024-04-25T15:57:35.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/271: rmdir d1/d6/d1b/d34 39 2024-04-25T15:57:35.983 INFO:tasks.workunit.client.1.smithi155.stdout:8/168: dwrite d2/d15/d18/d23/f2e [0,4194304] 0 2024-04-25T15:57:35.984 INFO:tasks.workunit.client.1.smithi155.stdout:8/169: readlink d2/l13 0 2024-04-25T15:57:35.989 INFO:tasks.workunit.client.1.smithi155.stdout:1/272: rename d1/d6/d1b/d34/f52 to d1/d6/d1b/f5d 0 2024-04-25T15:57:35.990 INFO:tasks.workunit.client.1.smithi155.stdout:1/273: write d1/d16/f3e [388642,15159] 0 2024-04-25T15:57:35.991 INFO:tasks.workunit.client.1.smithi155.stdout:8/170: link d2/d5/l20 d2/d15/d18/d23/d2d/l32 0 2024-04-25T15:57:35.994 INFO:tasks.workunit.client.1.smithi155.stdout:1/274: mkdir d1/d16/d1d/d5e 0 2024-04-25T15:57:35.999 INFO:tasks.workunit.client.1.smithi155.stdout:3/270: dread d1/f1f [0,4194304] 0 2024-04-25T15:57:35.999 INFO:tasks.workunit.client.1.smithi155.stdout:1/275: rename d1/d6/d1b to d1/d16/d1d/d29/d5f 0 2024-04-25T15:57:36.000 INFO:tasks.workunit.client.1.smithi155.stdout:8/171: dwrite d2/fa [4194304,4194304] 0 2024-04-25T15:57:36.001 INFO:tasks.workunit.client.1.smithi155.stdout:1/276: write d1/d16/d37/f4c [884566,112102] 0 2024-04-25T15:57:36.002 INFO:tasks.workunit.client.1.smithi155.stdout:8/172: chown d2/d15/d18/c2c 401 1 2024-04-25T15:57:36.002 INFO:tasks.workunit.client.1.smithi155.stdout:3/271: symlink d1/d4/db/d28/l56 0 2024-04-25T15:57:36.003 INFO:tasks.workunit.client.1.smithi155.stdout:3/272: dread - d1/d4/f41 zero size 2024-04-25T15:57:36.004 INFO:tasks.workunit.client.1.smithi155.stdout:1/277: getdents d1/d16/d1d/d5e 0 2024-04-25T15:57:36.004 INFO:tasks.workunit.client.1.smithi155.stdout:8/173: read d2/d5/f29 [1353834,126275] 0 2024-04-25T15:57:36.005 INFO:tasks.workunit.client.1.smithi155.stdout:8/174: write d2/d5/f21 [1046606,114406] 0 2024-04-25T15:57:36.006 INFO:tasks.workunit.client.1.smithi155.stdout:1/278: symlink d1/d16/d1d/l60 0 2024-04-25T15:57:36.008 INFO:tasks.workunit.client.1.smithi155.stdout:1/279: write d1/d16/d1d/d29/d5f/f49 [675985,45131] 0 2024-04-25T15:57:36.010 INFO:tasks.workunit.client.1.smithi155.stdout:8/175: creat d2/f33 x:0 0 0 2024-04-25T15:57:36.013 INFO:tasks.workunit.client.1.smithi155.stdout:3/273: truncate d1/d4/db/d28/f31 3262545 0 2024-04-25T15:57:36.014 INFO:tasks.workunit.client.1.smithi155.stdout:1/280: write d1/d16/d1d/d29/d3d/d43/f48 [2165835,103176] 0 2024-04-25T15:57:36.015 INFO:tasks.workunit.client.1.smithi155.stdout:3/274: mkdir d1/d4/db/d28/d39/d57 0 2024-04-25T15:57:36.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/281: write d1/d16/d1d/d29/d5f/d34/f51 [159798,46348] 0 2024-04-25T15:57:36.018 INFO:tasks.workunit.client.1.smithi155.stdout:3/275: fdatasync d1/d4/d10/d2a/f4b 0 2024-04-25T15:57:36.019 INFO:tasks.workunit.client.1.smithi155.stdout:3/276: write d1/d4/d10/f43 [810206,69274] 0 2024-04-25T15:57:36.020 INFO:tasks.workunit.client.1.smithi155.stdout:1/282: rename d1/d16/d1d/f38 to d1/f61 0 2024-04-25T15:57:36.020 INFO:tasks.workunit.client.1.smithi155.stdout:3/277: write d1/d4/db/d20/d44/f48 [448532,127740] 0 2024-04-25T15:57:36.022 INFO:tasks.workunit.client.1.smithi155.stdout:2/335: sync 2024-04-25T15:57:36.022 INFO:tasks.workunit.client.1.smithi155.stdout:4/233: sync 2024-04-25T15:57:36.022 INFO:tasks.workunit.client.1.smithi155.stdout:7/276: sync 2024-04-25T15:57:36.023 INFO:tasks.workunit.client.1.smithi155.stdout:2/336: readlink d7/db/dd/l25 0 2024-04-25T15:57:36.023 INFO:tasks.workunit.client.1.smithi155.stdout:4/234: chown da/dc/c17 1746 1 2024-04-25T15:57:36.024 INFO:tasks.workunit.client.1.smithi155.stdout:4/235: chown da/d23/f43 0 1 2024-04-25T15:57:36.027 INFO:tasks.workunit.client.1.smithi155.stdout:7/277: mknod d2/dd/d12/c61 0 2024-04-25T15:57:36.029 INFO:tasks.workunit.client.1.smithi155.stdout:4/236: mknod da/d23/d3f/c55 0 2024-04-25T15:57:36.032 INFO:tasks.workunit.client.1.smithi155.stdout:1/283: dwrite d1/d16/d1d/d29/d5f/d34/f36 [0,4194304] 0 2024-04-25T15:57:36.033 INFO:tasks.workunit.client.1.smithi155.stdout:3/278: dwrite d1/d4/db/d20/f46 [0,4194304] 0 2024-04-25T15:57:36.034 INFO:tasks.workunit.client.1.smithi155.stdout:2/337: getdents d7/db/d2e 0 2024-04-25T15:57:36.035 INFO:tasks.workunit.client.1.smithi155.stdout:2/338: truncate d7/f2d 4547759 0 2024-04-25T15:57:36.036 INFO:tasks.workunit.client.1.smithi155.stdout:2/339: fsync f3 0 2024-04-25T15:57:36.036 INFO:tasks.workunit.client.1.smithi155.stdout:4/237: mkdir da/d23/d3f/d56 0 2024-04-25T15:57:36.039 INFO:tasks.workunit.client.1.smithi155.stdout:1/284: creat d1/d16/d1d/d29/d3d/d43/f62 x:0 0 0 2024-04-25T15:57:36.039 INFO:tasks.workunit.client.1.smithi155.stdout:2/340: fsync d7/db/dd/d15/f28 0 2024-04-25T15:57:36.041 INFO:tasks.workunit.client.1.smithi155.stdout:7/278: getdents d2/dd/d13/d1c 0 2024-04-25T15:57:36.041 INFO:tasks.workunit.client.1.smithi155.stdout:1/285: readlink d1/la 0 2024-04-25T15:57:36.042 INFO:tasks.workunit.client.1.smithi155.stdout:4/238: rename da/f3b to da/d23/f57 0 2024-04-25T15:57:36.043 INFO:tasks.workunit.client.1.smithi155.stdout:2/341: rmdir d7/db/dd 39 2024-04-25T15:57:36.043 INFO:tasks.workunit.client.1.smithi155.stdout:4/239: stat da/d23/d2a/f4f 0 2024-04-25T15:57:36.044 INFO:tasks.workunit.client.1.smithi155.stdout:4/240: truncate da/dc/ff 1241848 0 2024-04-25T15:57:36.045 INFO:tasks.workunit.client.1.smithi155.stdout:7/279: rename d2/dd/f28 to d2/dd/d36/f62 0 2024-04-25T15:57:36.046 INFO:tasks.workunit.client.1.smithi155.stdout:4/241: read da/d23/f42 [246628,87019] 0 2024-04-25T15:57:36.046 INFO:tasks.workunit.client.1.smithi155.stdout:7/280: fdatasync d2/dd/d13/d1c/f1e 0 2024-04-25T15:57:36.047 INFO:tasks.workunit.client.1.smithi155.stdout:1/286: creat d1/d16/d1d/d5e/f63 x:0 0 0 2024-04-25T15:57:36.047 INFO:tasks.workunit.client.1.smithi155.stdout:1/287: stat d1/d16/d1d/d29/d5f/l4d 0 2024-04-25T15:57:36.049 INFO:tasks.workunit.client.1.smithi155.stdout:4/242: rename da/dc/c17 to da/dc/c58 0 2024-04-25T15:57:36.050 INFO:tasks.workunit.client.1.smithi155.stdout:2/342: symlink d7/db/dd/l6a 0 2024-04-25T15:57:36.051 INFO:tasks.workunit.client.1.smithi155.stdout:2/343: write d7/db/d2e/f2f [3461297,112034] 0 2024-04-25T15:57:36.052 INFO:tasks.workunit.client.1.smithi155.stdout:7/281: mkdir d2/dd/d63 0 2024-04-25T15:57:36.057 INFO:tasks.workunit.client.1.smithi155.stdout:4/243: getdents da/dc/d18 0 2024-04-25T15:57:36.059 INFO:tasks.workunit.client.1.smithi155.stdout:3/279: dwrite d1/d4/f18 [4194304,4194304] 0 2024-04-25T15:57:36.063 INFO:tasks.workunit.client.1.smithi155.stdout:3/280: unlink d1/d4/d10/c3a 0 2024-04-25T15:57:36.064 INFO:tasks.workunit.client.1.smithi155.stdout:2/344: dwrite d7/f49 [0,4194304] 0 2024-04-25T15:57:36.066 INFO:tasks.workunit.client.1.smithi155.stdout:7/282: dwrite d2/dd/f4e [0,4194304] 0 2024-04-25T15:57:36.071 INFO:tasks.workunit.client.1.smithi155.stdout:2/345: creat d7/db/d2e/d44/f6b x:0 0 0 2024-04-25T15:57:36.073 INFO:tasks.workunit.client.1.smithi155.stdout:7/283: read d2/dd/d36/f62 [1835805,66098] 0 2024-04-25T15:57:36.078 INFO:tasks.workunit.client.1.smithi155.stdout:2/346: rename d7/db/dd/f5c to d7/db/f6c 0 2024-04-25T15:57:36.079 INFO:tasks.workunit.client.1.smithi155.stdout:4/244: dwrite f7 [0,4194304] 0 2024-04-25T15:57:36.080 INFO:tasks.workunit.client.1.smithi155.stdout:7/284: unlink d2/f15 0 2024-04-25T15:57:36.081 INFO:tasks.workunit.client.1.smithi155.stdout:7/285: dread - d2/dd/d13/d1c/f40 zero size 2024-04-25T15:57:36.082 INFO:tasks.workunit.client.1.smithi155.stdout:2/347: fdatasync d7/f16 0 2024-04-25T15:57:36.082 INFO:tasks.workunit.client.1.smithi155.stdout:7/286: chown d2/dd/d13/d1c 190604 1 2024-04-25T15:57:36.085 INFO:tasks.workunit.client.1.smithi155.stdout:4/245: read da/f4b [2925607,6359] 0 2024-04-25T15:57:36.089 INFO:tasks.workunit.client.1.smithi155.stdout:4/246: creat da/d23/d3a/f59 x:0 0 0 2024-04-25T15:57:36.093 INFO:tasks.workunit.client.1.smithi155.stdout:2/348: dwrite d7/db/d2e/d44/f4b [0,4194304] 0 2024-04-25T15:57:36.093 INFO:tasks.workunit.client.1.smithi155.stdout:7/287: dwrite d2/dd/d13/d4a/f4d [0,4194304] 0 2024-04-25T15:57:36.094 INFO:tasks.workunit.client.1.smithi155.stdout:4/247: rmdir da/dc 39 2024-04-25T15:57:36.094 INFO:tasks.workunit.client.1.smithi155.stdout:3/281: dread d1/f16 [0,4194304] 0 2024-04-25T15:57:36.096 INFO:tasks.workunit.client.1.smithi155.stdout:2/349: rmdir d7/db/dd/d15/d60 39 2024-04-25T15:57:36.098 INFO:tasks.workunit.client.1.smithi155.stdout:4/248: write da/d23/d3a/f59 [761563,20919] 0 2024-04-25T15:57:36.101 INFO:tasks.workunit.client.1.smithi155.stdout:2/350: rmdir d7/db/d2e 39 2024-04-25T15:57:36.104 INFO:tasks.workunit.client.1.smithi155.stdout:3/282: rename d1/d4/db/d28/d29 to d1/d4/db/d28/d58 0 2024-04-25T15:57:36.108 INFO:tasks.workunit.client.1.smithi155.stdout:3/283: dread d1/f1f [0,4194304] 0 2024-04-25T15:57:36.109 INFO:tasks.workunit.client.1.smithi155.stdout:7/288: truncate d2/f5b 255562 0 2024-04-25T15:57:36.113 INFO:tasks.workunit.client.1.smithi155.stdout:2/351: truncate d7/db/dd/d15/f37 1121710 0 2024-04-25T15:57:36.114 INFO:tasks.workunit.client.1.smithi155.stdout:7/289: rename d2/dd/d13/d4a/f4d to d2/d26/d3d/f64 0 2024-04-25T15:57:36.115 INFO:tasks.workunit.client.1.smithi155.stdout:2/352: write d7/f2b [1252835,22267] 0 2024-04-25T15:57:36.117 INFO:tasks.workunit.client.1.smithi155.stdout:3/284: truncate d1/d4/db/f11 1555862 0 2024-04-25T15:57:36.118 INFO:tasks.workunit.client.1.smithi155.stdout:7/290: fdatasync d2/dd/d13/d1c/f1e 0 2024-04-25T15:57:36.120 INFO:tasks.workunit.client.1.smithi155.stdout:4/249: dwrite da/d23/f42 [0,4194304] 0 2024-04-25T15:57:36.121 INFO:tasks.workunit.client.1.smithi155.stdout:7/291: write d2/f11 [1389061,80536] 0 2024-04-25T15:57:36.121 INFO:tasks.workunit.client.1.smithi155.stdout:4/250: dread - da/d23/f43 zero size 2024-04-25T15:57:36.124 INFO:tasks.workunit.client.1.smithi155.stdout:2/353: creat d7/db/d2e/d44/f6d x:0 0 0 2024-04-25T15:57:36.125 INFO:tasks.workunit.client.1.smithi155.stdout:7/292: read d2/dd/d13/d1c/f31 [204895,51845] 0 2024-04-25T15:57:36.129 INFO:tasks.workunit.client.1.smithi155.stdout:4/251: dwrite da/d23/f3d [0,4194304] 0 2024-04-25T15:57:36.130 INFO:tasks.workunit.client.1.smithi155.stdout:0/256: sync 2024-04-25T15:57:36.130 INFO:tasks.workunit.client.1.smithi155.stdout:5/277: sync 2024-04-25T15:57:36.130 INFO:tasks.workunit.client.1.smithi155.stdout:9/248: sync 2024-04-25T15:57:36.132 INFO:tasks.workunit.client.1.smithi155.stdout:9/249: write dc/d17/f20 [779614,17360] 0 2024-04-25T15:57:36.133 INFO:tasks.workunit.client.1.smithi155.stdout:9/250: chown dc/d17/d2a/f2c 22 1 2024-04-25T15:57:36.135 INFO:tasks.workunit.client.1.smithi155.stdout:5/278: write d0/f4c [4700042,41174] 0 2024-04-25T15:57:36.135 INFO:tasks.workunit.client.1.smithi155.stdout:9/251: dread - dc/d13/d59/f5f zero size 2024-04-25T15:57:36.137 INFO:tasks.workunit.client.1.smithi155.stdout:0/257: dread d1/d3/d12/f3b [0,4194304] 0 2024-04-25T15:57:36.137 INFO:tasks.workunit.client.1.smithi155.stdout:2/354: symlink d7/db/l6e 0 2024-04-25T15:57:36.140 INFO:tasks.workunit.client.1.smithi155.stdout:2/355: read d7/db/d2e/f2f [3691998,95186] 0 2024-04-25T15:57:36.141 INFO:tasks.workunit.client.1.smithi155.stdout:3/285: link d1/d4/db/d28/f31 d1/d4/d10/d21/d54/f59 0 2024-04-25T15:57:36.142 INFO:tasks.workunit.client.1.smithi155.stdout:0/258: fdatasync d1/d3/d12/f3b 0 2024-04-25T15:57:36.146 INFO:tasks.workunit.client.1.smithi155.stdout:7/293: write d2/dd/f16 [4497836,109736] 0 2024-04-25T15:57:36.152 INFO:tasks.workunit.client.1.smithi155.stdout:3/286: rename d1/d4/db/d28/d39/f4f to d1/d4/d10/d21/f5a 0 2024-04-25T15:57:36.153 INFO:tasks.workunit.client.1.smithi155.stdout:0/259: chown d1/d6/c56 0 1 2024-04-25T15:57:36.155 INFO:tasks.workunit.client.1.smithi155.stdout:7/294: mkdir d2/d26/d3d/d65 0 2024-04-25T15:57:36.156 INFO:tasks.workunit.client.1.smithi155.stdout:4/252: truncate da/dc/f2f 694894 0 2024-04-25T15:57:36.158 INFO:tasks.workunit.client.1.smithi155.stdout:9/252: truncate fa 1944254 0 2024-04-25T15:57:36.159 INFO:tasks.workunit.client.1.smithi155.stdout:2/356: truncate d7/db/dd/d15/f45 5729563 0 2024-04-25T15:57:36.160 INFO:tasks.workunit.client.1.smithi155.stdout:2/357: read f1 [11087825,67755] 0 2024-04-25T15:57:36.161 INFO:tasks.workunit.client.1.smithi155.stdout:2/358: dread - d7/db/f59 zero size 2024-04-25T15:57:36.162 INFO:tasks.workunit.client.1.smithi155.stdout:3/287: rename d1/f53 to d1/d4/db/d28/f5b 0 2024-04-25T15:57:36.165 INFO:tasks.workunit.client.1.smithi155.stdout:5/279: dwrite d0/d3/d2c/f3a [0,4194304] 0 2024-04-25T15:57:36.165 INFO:tasks.workunit.client.1.smithi155.stdout:9/253: mkdir dc/d11/d67 0 2024-04-25T15:57:36.167 INFO:tasks.workunit.client.1.smithi155.stdout:7/295: mkdir d2/dd/d66 0 2024-04-25T15:57:36.169 INFO:tasks.workunit.client.1.smithi155.stdout:0/260: rename d1/d3/l4d to d1/d3f/l63 0 2024-04-25T15:57:36.170 INFO:tasks.workunit.client.1.smithi155.stdout:0/261: chown d1/d41/f44 1623918262 1 2024-04-25T15:57:36.171 INFO:tasks.workunit.client.1.smithi155.stdout:5/280: mkdir d0/d47/d59 0 2024-04-25T15:57:36.173 INFO:tasks.workunit.client.1.smithi155.stdout:7/296: fdatasync d2/dd/f23 0 2024-04-25T15:57:36.176 INFO:tasks.workunit.client.1.smithi155.stdout:6/432: sync 2024-04-25T15:57:36.177 INFO:tasks.workunit.client.1.smithi155.stdout:4/253: rename da/d23/d3a/f59 to da/dc/f5a 0 2024-04-25T15:57:36.178 INFO:tasks.workunit.client.1.smithi155.stdout:6/433: dread - d0/d1a/d25/d51/f84 zero size 2024-04-25T15:57:36.180 INFO:tasks.workunit.client.1.smithi155.stdout:7/297: symlink d2/dd/d13/d24/d35/l67 0 2024-04-25T15:57:36.183 INFO:tasks.workunit.client.1.smithi155.stdout:0/262: creat d1/d3/d3d/d46/f64 x:0 0 0 2024-04-25T15:57:36.184 INFO:tasks.workunit.client.1.smithi155.stdout:3/288: rename d1/d4/db/d20/d44/c4a to d1/d4/db/d28/d39/d57/c5c 0 2024-04-25T15:57:36.185 INFO:tasks.workunit.client.1.smithi155.stdout:0/263: truncate d1/d41/f44 4533356 0 2024-04-25T15:57:36.186 INFO:tasks.workunit.client.1.smithi155.stdout:6/434: dwrite d0/d1a/d21/f32 [0,4194304] 0 2024-04-25T15:57:36.186 INFO:tasks.workunit.client.1.smithi155.stdout:3/289: dread - d1/d4/d10/d2a/f3c zero size 2024-04-25T15:57:36.190 INFO:tasks.workunit.client.1.smithi155.stdout:0/264: chown d1/d1a/f5f 126 1 2024-04-25T15:57:36.190 INFO:tasks.workunit.client.1.smithi155.stdout:6/435: write d0/d1a/d25/d2e/d39/f86 [2105161,14468] 0 2024-04-25T15:57:36.191 INFO:tasks.workunit.client.1.smithi155.stdout:7/298: creat d2/f68 x:0 0 0 2024-04-25T15:57:36.191 INFO:tasks.workunit.client.1.smithi155.stdout:2/359: truncate d7/db/d29/f30 272476 0 2024-04-25T15:57:36.193 INFO:tasks.workunit.client.1.smithi155.stdout:5/281: creat d0/d3/f5a x:0 0 0 2024-04-25T15:57:36.194 INFO:tasks.workunit.client.1.smithi155.stdout:7/299: chown d2/dd/d12/f38 0 1 2024-04-25T15:57:36.194 INFO:tasks.workunit.client.1.smithi155.stdout:3/290: symlink d1/d4/d25/l5d 0 2024-04-25T15:57:36.195 INFO:tasks.workunit.client.1.smithi155.stdout:6/436: unlink d0/d1a/d25/d2e/d39/f55 0 2024-04-25T15:57:36.199 INFO:tasks.workunit.client.1.smithi155.stdout:0/265: dwrite d1/d6/d29/f53 [0,4194304] 0 2024-04-25T15:57:36.200 INFO:tasks.workunit.client.1.smithi155.stdout:2/360: mkdir d7/db/d2e/d6f 0 2024-04-25T15:57:36.200 INFO:tasks.workunit.client.1.smithi155.stdout:5/282: unlink d0/d3/d15/d1f/d50/l57 0 2024-04-25T15:57:36.203 INFO:tasks.workunit.client.1.smithi155.stdout:5/283: write d0/d58/d32/f49 [1718582,95368] 0 2024-04-25T15:57:36.203 INFO:tasks.workunit.client.1.smithi155.stdout:4/254: dread da/d23/d2a/f39 [0,4194304] 0 2024-04-25T15:57:36.204 INFO:tasks.workunit.client.1.smithi155.stdout:0/266: dread d1/d41/f44 [4194304,4194304] 0 2024-04-25T15:57:36.204 INFO:tasks.workunit.client.1.smithi155.stdout:6/437: rename d0/lb to d0/d13/d34/d38/d4c/l94 0 2024-04-25T15:57:36.204 INFO:tasks.workunit.client.1.smithi155.stdout:7/300: getdents d2/d26/d3d/d65 0 2024-04-25T15:57:36.207 INFO:tasks.workunit.client.1.smithi155.stdout:6/438: write d0/d13/f20 [1165968,6478] 0 2024-04-25T15:57:36.208 INFO:tasks.workunit.client.1.smithi155.stdout:5/284: creat d0/d27/f5b x:0 0 0 2024-04-25T15:57:36.209 INFO:tasks.workunit.client.1.smithi155.stdout:6/439: chown d0/d18/d54 31 1 2024-04-25T15:57:36.211 INFO:tasks.workunit.client.1.smithi155.stdout:4/255: symlink da/dc/d49/l5b 0 2024-04-25T15:57:36.213 INFO:tasks.workunit.client.1.smithi155.stdout:0/267: dread d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:36.215 INFO:tasks.workunit.client.1.smithi155.stdout:6/440: rmdir d0/d1a 39 2024-04-25T15:57:36.216 INFO:tasks.workunit.client.1.smithi155.stdout:2/361: dwrite d7/db/d2e/d44/f6d [0,4194304] 0 2024-04-25T15:57:36.220 INFO:tasks.workunit.client.1.smithi155.stdout:0/268: rename d1/d3/f43 to d1/d3f/f65 0 2024-04-25T15:57:36.221 INFO:tasks.workunit.client.1.smithi155.stdout:4/256: write da/f14 [111834,92121] 0 2024-04-25T15:57:36.222 INFO:tasks.workunit.client.1.smithi155.stdout:5/285: creat d0/d3/f5c x:0 0 0 2024-04-25T15:57:36.222 INFO:tasks.workunit.client.1.smithi155.stdout:3/291: dread d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:36.222 INFO:tasks.workunit.client.1.smithi155.stdout:7/301: dwrite d2/dd/d13/d1c/f40 [0,4194304] 0 2024-04-25T15:57:36.223 INFO:tasks.workunit.client.1.smithi155.stdout:2/362: mkdir d7/db/d2e/d44/d70 0 2024-04-25T15:57:36.225 INFO:tasks.workunit.client.1.smithi155.stdout:0/269: write d1/d3/d5/f32 [1993421,2123] 0 2024-04-25T15:57:36.229 INFO:tasks.workunit.client.1.smithi155.stdout:3/292: creat d1/d4/db/f5e x:0 0 0 2024-04-25T15:57:36.231 INFO:tasks.workunit.client.1.smithi155.stdout:6/441: dwrite d0/d13/f17 [0,4194304] 0 2024-04-25T15:57:36.233 INFO:tasks.workunit.client.1.smithi155.stdout:7/302: mknod d2/dd/d13/d4a/c69 0 2024-04-25T15:57:36.234 INFO:tasks.workunit.client.1.smithi155.stdout:3/293: mkdir d1/d4/db/d28/d39/d5f 0 2024-04-25T15:57:36.235 INFO:tasks.workunit.client.1.smithi155.stdout:7/303: dread - d2/dd/d12/f5e zero size 2024-04-25T15:57:36.235 INFO:tasks.workunit.client.1.smithi155.stdout:3/294: dread - d1/d4/d25/f38 zero size 2024-04-25T15:57:36.236 INFO:tasks.workunit.client.1.smithi155.stdout:4/257: getdents da/d30 0 2024-04-25T15:57:36.236 INFO:tasks.workunit.client.1.smithi155.stdout:3/295: stat d1/d4/db/f5e 0 2024-04-25T15:57:36.237 INFO:tasks.workunit.client.1.smithi155.stdout:3/296: write d1/d4/f18 [295480,117570] 0 2024-04-25T15:57:36.239 INFO:tasks.workunit.client.1.smithi155.stdout:6/442: mknod d0/d13/d7c/c95 0 2024-04-25T15:57:36.241 INFO:tasks.workunit.client.1.smithi155.stdout:4/258: dread da/d23/f3d [0,4194304] 0 2024-04-25T15:57:36.242 INFO:tasks.workunit.client.1.smithi155.stdout:7/304: creat d2/dd/d30/f6a x:0 0 0 2024-04-25T15:57:36.242 INFO:tasks.workunit.client.1.smithi155.stdout:7/305: write d2/f2e [181855,71073] 0 2024-04-25T15:57:36.244 INFO:tasks.workunit.client.1.smithi155.stdout:7/306: dread - d2/dd/d30/f6a zero size 2024-04-25T15:57:36.246 INFO:tasks.workunit.client.1.smithi155.stdout:7/307: write d2/dd/d36/f62 [1562036,100928] 0 2024-04-25T15:57:36.247 INFO:tasks.workunit.client.1.smithi155.stdout:6/443: link d0/f4f d0/d13/d43/d56/d7b/f96 0 2024-04-25T15:57:36.249 INFO:tasks.workunit.client.1.smithi155.stdout:7/308: read d2/dd/d13/d4a/f5d [3246787,71808] 0 2024-04-25T15:57:36.250 INFO:tasks.workunit.client.1.smithi155.stdout:7/309: readlink d2/l4 0 2024-04-25T15:57:36.250 INFO:tasks.workunit.client.1.smithi155.stdout:5/286: dwrite d0/f2 [0,4194304] 0 2024-04-25T15:57:36.250 INFO:tasks.workunit.client.1.smithi155.stdout:6/444: fsync d0/d1a/f6b 0 2024-04-25T15:57:36.255 INFO:tasks.workunit.client.1.smithi155.stdout:0/270: dread d1/d3/d5/f26 [0,4194304] 0 2024-04-25T15:57:36.259 INFO:tasks.workunit.client.1.smithi155.stdout:5/287: link d0/f4c d0/d47/d59/f5d 0 2024-04-25T15:57:36.260 INFO:tasks.workunit.client.1.smithi155.stdout:0/271: creat d1/d6/d29/f66 x:0 0 0 2024-04-25T15:57:36.261 INFO:tasks.workunit.client.1.smithi155.stdout:7/310: write d2/dd/d13/d1c/f31 [1077059,93019] 0 2024-04-25T15:57:36.263 INFO:tasks.workunit.client.1.smithi155.stdout:5/288: mknod d0/d3/d15/d1f/c5e 0 2024-04-25T15:57:36.263 INFO:tasks.workunit.client.1.smithi155.stdout:6/445: write d0/d13/d43/d56/d7b/f96 [1291251,37429] 0 2024-04-25T15:57:36.266 INFO:tasks.workunit.client.1.smithi155.stdout:5/289: symlink d0/d3/d2c/l5f 0 2024-04-25T15:57:36.268 INFO:tasks.workunit.client.1.smithi155.stdout:6/446: rename d0/d1a/d21/d73/c82 to d0/d13/d43/d56/c97 0 2024-04-25T15:57:36.277 INFO:tasks.workunit.client.1.smithi155.stdout:6/447: dwrite d0/f4f [0,4194304] 0 2024-04-25T15:57:36.278 INFO:tasks.workunit.client.1.smithi155.stdout:0/272: dwrite d1/d41/f44 [0,4194304] 0 2024-04-25T15:57:36.314 INFO:tasks.workunit.client.1.smithi155.stdout:1/288: sync 2024-04-25T15:57:36.314 INFO:tasks.workunit.client.1.smithi155.stdout:8/176: sync 2024-04-25T15:57:36.328 INFO:tasks.workunit.client.1.smithi155.stdout:5/290: dread d0/f40 [0,4194304] 0 2024-04-25T15:57:36.330 INFO:tasks.workunit.client.1.smithi155.stdout:7/311: dwrite d2/dd/d13/d24/d35/f3c [0,4194304] 0 2024-04-25T15:57:36.331 INFO:tasks.workunit.client.1.smithi155.stdout:5/291: chown d0/f4c 115318402 1 2024-04-25T15:57:36.331 INFO:tasks.workunit.client.1.smithi155.stdout:0/273: chown d1/d3/d12/c28 50444 1 2024-04-25T15:57:36.333 INFO:tasks.workunit.client.1.smithi155.stdout:8/177: mkdir d2/d15/d18/d34 0 2024-04-25T15:57:36.334 INFO:tasks.workunit.client.1.smithi155.stdout:1/289: creat d1/d16/d1d/d33/f64 x:0 0 0 2024-04-25T15:57:36.334 INFO:tasks.workunit.client.1.smithi155.stdout:0/274: chown d1/d1a/f5f 71696 1 2024-04-25T15:57:36.336 INFO:tasks.workunit.client.1.smithi155.stdout:7/312: unlink d2/d26/d3d/f53 0 2024-04-25T15:57:36.340 INFO:tasks.workunit.client.1.smithi155.stdout:5/292: mkdir d0/d3/d15/d1f/d50/d60 0 2024-04-25T15:57:36.341 INFO:tasks.workunit.client.1.smithi155.stdout:1/290: creat d1/d16/d1d/f65 x:0 0 0 2024-04-25T15:57:36.342 INFO:tasks.workunit.client.1.smithi155.stdout:7/313: mknod d2/d26/d47/c6b 0 2024-04-25T15:57:36.344 INFO:tasks.workunit.client.1.smithi155.stdout:1/291: chown d1/d16/f3e 352 1 2024-04-25T15:57:36.347 INFO:tasks.workunit.client.1.smithi155.stdout:0/275: dread d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:36.347 INFO:tasks.workunit.client.1.smithi155.stdout:7/314: symlink d2/dd/d30/d44/l6c 0 2024-04-25T15:57:36.349 INFO:tasks.workunit.client.1.smithi155.stdout:1/292: chown d1/d16/d1d/f5c 1131 1 2024-04-25T15:57:36.350 INFO:tasks.workunit.client.1.smithi155.stdout:8/178: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:36.352 INFO:tasks.workunit.client.0.smithi087.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T15:57:36.353 INFO:tasks.workunit.client.1.smithi155.stdout:0/276: symlink d1/d6/d16/d60/l67 0 2024-04-25T15:57:36.354 INFO:tasks.workunit.client.1.smithi155.stdout:7/315: write d2/d26/d3d/f64 [1060949,35876] 0 2024-04-25T15:57:36.358 INFO:tasks.workunit.client.1.smithi155.stdout:1/293: dread d1/d16/f1f [0,4194304] 0 2024-04-25T15:57:36.361 INFO:tasks.workunit.client.1.smithi155.stdout:5/293: dwrite d0/d27/f4b [0,4194304] 0 2024-04-25T15:57:36.364 INFO:tasks.workunit.client.1.smithi155.stdout:7/316: rename d2/dd/d13/d4a to d2/d26/d3d/d6d 0 2024-04-25T15:57:36.367 INFO:tasks.workunit.client.1.smithi155.stdout:5/294: symlink d0/d3/d15/l61 0 2024-04-25T15:57:36.369 INFO:tasks.workunit.client.1.smithi155.stdout:7/317: truncate d2/f1f 1146950 0 2024-04-25T15:57:36.372 INFO:tasks.workunit.client.1.smithi155.stdout:7/318: dread - d2/dd/d36/d46/f5f zero size 2024-04-25T15:57:36.374 INFO:tasks.workunit.client.1.smithi155.stdout:7/319: dread - d2/dd/d13/d1c/f59 zero size 2024-04-25T15:57:36.375 INFO:tasks.workunit.client.1.smithi155.stdout:1/294: truncate d1/d16/d1d/d29/d5f/f35 450002 0 2024-04-25T15:57:36.378 INFO:tasks.workunit.client.1.smithi155.stdout:5/295: dread d0/d58/d32/f49 [0,4194304] 0 2024-04-25T15:57:36.384 INFO:tasks.workunit.client.1.smithi155.stdout:8/179: dread d2/f16 [4194304,4194304] 0 2024-04-25T15:57:36.387 INFO:tasks.workunit.client.1.smithi155.stdout:0/277: dread d1/d3f/f50 [0,4194304] 0 2024-04-25T15:57:36.389 INFO:tasks.workunit.client.1.smithi155.stdout:7/320: dwrite d2/f2e [0,4194304] 0 2024-04-25T15:57:36.389 INFO:tasks.workunit.client.1.smithi155.stdout:0/278: chown d1/d41/f45 60320616 1 2024-04-25T15:57:36.390 INFO:tasks.workunit.client.1.smithi155.stdout:5/296: dread d0/f4c [0,4194304] 0 2024-04-25T15:57:36.397 INFO:tasks.workunit.client.1.smithi155.stdout:8/180: dread d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:36.397 INFO:tasks.workunit.client.1.smithi155.stdout:1/295: write d1/f15 [998241,49812] 0 2024-04-25T15:57:36.401 INFO:tasks.workunit.client.1.smithi155.stdout:8/181: mkdir d2/d15/d35 0 2024-04-25T15:57:36.404 INFO:tasks.workunit.client.1.smithi155.stdout:1/296: symlink d1/d16/d1d/d29/d3d/d43/l66 0 2024-04-25T15:57:36.408 INFO:tasks.workunit.client.1.smithi155.stdout:7/321: dwrite d2/dd/d13/d1c/f31 [0,4194304] 0 2024-04-25T15:57:36.409 INFO:tasks.workunit.client.1.smithi155.stdout:1/297: mknod d1/d6/c67 0 2024-04-25T15:57:36.411 INFO:tasks.workunit.client.1.smithi155.stdout:0/279: dwrite d1/d3/d3d/d46/f64 [0,4194304] 0 2024-04-25T15:57:36.411 INFO:tasks.workunit.client.1.smithi155.stdout:7/322: readlink d2/dd/d30/d44/l57 0 2024-04-25T15:57:36.413 INFO:tasks.workunit.client.1.smithi155.stdout:5/297: dwrite d0/f4c [0,4194304] 0 2024-04-25T15:57:36.414 INFO:tasks.workunit.client.1.smithi155.stdout:9/254: sync 2024-04-25T15:57:36.415 INFO:tasks.workunit.client.1.smithi155.stdout:1/298: dread d1/d16/f1f [0,4194304] 0 2024-04-25T15:57:36.416 INFO:tasks.workunit.client.1.smithi155.stdout:0/280: truncate d1/f4e 1325201 0 2024-04-25T15:57:36.417 INFO:tasks.workunit.client.1.smithi155.stdout:9/255: write dc/d11/f42 [222395,75401] 0 2024-04-25T15:57:36.418 INFO:tasks.workunit.client.1.smithi155.stdout:1/299: write d1/d6/fc [3944014,119762] 0 2024-04-25T15:57:36.420 INFO:tasks.workunit.client.1.smithi155.stdout:7/323: mknod d2/dd/d36/c6e 0 2024-04-25T15:57:36.420 INFO:tasks.workunit.client.1.smithi155.stdout:8/182: dwrite d2/f33 [0,4194304] 0 2024-04-25T15:57:36.424 INFO:tasks.workunit.client.1.smithi155.stdout:1/300: chown d1/d16/d1d/d5e/f63 11217 1 2024-04-25T15:57:36.429 INFO:tasks.workunit.client.1.smithi155.stdout:9/256: rename dc/d17/d2a/l66 to dc/d11/d5a/d5b/l68 0 2024-04-25T15:57:36.430 INFO:tasks.workunit.client.1.smithi155.stdout:5/298: dwrite d0/d3/d2c/f3a [0,4194304] 0 2024-04-25T15:57:36.430 INFO:tasks.workunit.client.1.smithi155.stdout:0/281: dwrite d1/d3f/f50 [4194304,4194304] 0 2024-04-25T15:57:36.433 INFO:tasks.workunit.client.1.smithi155.stdout:1/301: mkdir d1/d16/d1d/d29/d5f/d34/d68 0 2024-04-25T15:57:36.436 INFO:tasks.workunit.client.1.smithi155.stdout:7/324: rename d2/dd/d12/f34 to d2/dd/d13/d1c/f6f 0 2024-04-25T15:57:36.436 INFO:tasks.workunit.client.1.smithi155.stdout:5/299: unlink d0/d58/f1a 0 2024-04-25T15:57:36.436 INFO:tasks.workunit.client.1.smithi155.stdout:8/183: link d2/d15/d18/l30 d2/d15/l36 0 2024-04-25T15:57:36.439 INFO:tasks.workunit.client.1.smithi155.stdout:9/257: link dc/d13/f3b dc/d11/d5a/f69 0 2024-04-25T15:57:36.440 INFO:tasks.workunit.client.1.smithi155.stdout:1/302: read d1/d16/d1d/d29/d5f/f49 [206880,31153] 0 2024-04-25T15:57:36.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/325: creat d2/dd/d13/f70 x:0 0 0 2024-04-25T15:57:36.442 INFO:tasks.workunit.client.1.smithi155.stdout:8/184: mknod d2/d5/c37 0 2024-04-25T15:57:36.442 INFO:tasks.workunit.client.1.smithi155.stdout:9/258: chown dc/d13/f3a 177115 1 2024-04-25T15:57:36.443 INFO:tasks.workunit.client.1.smithi155.stdout:1/303: chown d1/d16/d37 120051 1 2024-04-25T15:57:36.443 INFO:tasks.workunit.client.1.smithi155.stdout:0/282: dwrite d1/d3/f48 [0,4194304] 0 2024-04-25T15:57:36.445 INFO:tasks.workunit.client.1.smithi155.stdout:5/300: write d0/d58/f29 [825434,72424] 0 2024-04-25T15:57:36.445 INFO:tasks.workunit.client.1.smithi155.stdout:7/326: write d2/f37 [707619,113] 0 2024-04-25T15:57:36.447 INFO:tasks.workunit.client.1.smithi155.stdout:8/185: write d2/f14 [2453323,105992] 0 2024-04-25T15:57:36.451 INFO:tasks.workunit.client.1.smithi155.stdout:1/304: getdents d1/d16/d1d/d29/d5f/d34/d68 0 2024-04-25T15:57:36.452 INFO:tasks.workunit.client.1.smithi155.stdout:5/301: creat d0/d3/d15/d30/d4f/f62 x:0 0 0 2024-04-25T15:57:36.452 INFO:tasks.workunit.client.1.smithi155.stdout:8/186: read d2/fc [1191901,48434] 0 2024-04-25T15:57:36.452 INFO:tasks.workunit.client.1.smithi155.stdout:0/283: link d1/d3f/l63 d1/d6/d29/l68 0 2024-04-25T15:57:36.457 INFO:tasks.workunit.client.1.smithi155.stdout:5/302: write d0/f2 [2866958,60630] 0 2024-04-25T15:57:36.458 INFO:tasks.workunit.client.1.smithi155.stdout:0/284: rmdir d1/d3/d5 39 2024-04-25T15:57:36.459 INFO:tasks.workunit.client.1.smithi155.stdout:7/327: dwrite d2/dd/d12/f38 [0,4194304] 0 2024-04-25T15:57:36.462 INFO:tasks.workunit.client.1.smithi155.stdout:1/305: rename d1/d16/d1d/f2a to d1/d16/d37/f69 0 2024-04-25T15:57:36.462 INFO:tasks.workunit.client.1.smithi155.stdout:0/285: symlink d1/d3f/l69 0 2024-04-25T15:57:36.464 INFO:tasks.workunit.client.1.smithi155.stdout:5/303: mkdir d0/d58/d63 0 2024-04-25T15:57:36.465 INFO:tasks.workunit.client.1.smithi155.stdout:7/328: unlink d2/dd/d13/d1c/l25 0 2024-04-25T15:57:36.465 INFO:tasks.workunit.client.1.smithi155.stdout:1/306: stat d1/d16/d1d/d29/d3d/d43 0 2024-04-25T15:57:36.466 INFO:tasks.workunit.client.1.smithi155.stdout:8/187: dwrite d2/d5/f21 [0,4194304] 0 2024-04-25T15:57:36.467 INFO:tasks.workunit.client.1.smithi155.stdout:5/304: write d0/d3/d15/d30/d4f/f62 [834985,89937] 0 2024-04-25T15:57:36.469 INFO:tasks.workunit.client.1.smithi155.stdout:0/286: mkdir d1/d3/d6a 0 2024-04-25T15:57:36.474 INFO:tasks.workunit.client.1.smithi155.stdout:0/287: chown d1/d6/d29/l68 1 1 2024-04-25T15:57:36.474 INFO:tasks.workunit.client.1.smithi155.stdout:8/188: rename d2/d5/l20 to d2/d5/l38 0 2024-04-25T15:57:36.475 INFO:tasks.workunit.client.1.smithi155.stdout:5/305: dread d0/d3/d15/d30/d4f/f62 [0,4194304] 0 2024-04-25T15:57:36.477 INFO:tasks.workunit.client.1.smithi155.stdout:0/288: mknod d1/c6b 0 2024-04-25T15:57:36.477 INFO:tasks.workunit.client.1.smithi155.stdout:5/306: fsync d0/d3/d2c/f2f 0 2024-04-25T15:57:36.478 INFO:tasks.workunit.client.1.smithi155.stdout:8/189: unlink d2/d15/c1c 0 2024-04-25T15:57:36.478 INFO:tasks.workunit.client.1.smithi155.stdout:9/259: dwrite fa [0,4194304] 0 2024-04-25T15:57:36.481 INFO:tasks.workunit.client.1.smithi155.stdout:1/307: dread d1/d16/d1d/d29/d5f/f5d [0,4194304] 0 2024-04-25T15:57:36.482 INFO:tasks.workunit.client.1.smithi155.stdout:0/289: write d1/d3f/f65 [1974037,33867] 0 2024-04-25T15:57:36.485 INFO:tasks.workunit.client.1.smithi155.stdout:5/307: write d0/d3/d2c/f3c [1246976,87618] 0 2024-04-25T15:57:36.486 INFO:tasks.workunit.client.1.smithi155.stdout:3/297: sync 2024-04-25T15:57:36.486 INFO:tasks.workunit.client.1.smithi155.stdout:2/363: sync 2024-04-25T15:57:36.487 INFO:tasks.workunit.client.1.smithi155.stdout:5/308: read - d0/d3/f5c zero size 2024-04-25T15:57:36.487 INFO:tasks.workunit.client.1.smithi155.stdout:1/308: write d1/d16/d1d/d29/d5f/d34/f47 [377612,51957] 0 2024-04-25T15:57:36.488 INFO:tasks.workunit.client.1.smithi155.stdout:9/260: dread dc/d11/f27 [4194304,4194304] 0 2024-04-25T15:57:36.489 INFO:tasks.workunit.client.1.smithi155.stdout:7/329: write d2/f2e [4740572,21003] 0 2024-04-25T15:57:36.489 INFO:tasks.workunit.client.1.smithi155.stdout:0/290: dread d1/f4e [0,4194304] 0 2024-04-25T15:57:36.490 INFO:tasks.workunit.client.1.smithi155.stdout:5/309: write d0/d27/f43 [248483,81344] 0 2024-04-25T15:57:36.493 INFO:tasks.workunit.client.1.smithi155.stdout:1/309: dread d1/d16/d1d/d29/d5f/d34/f51 [0,4194304] 0 2024-04-25T15:57:36.497 INFO:tasks.workunit.client.1.smithi155.stdout:9/261: rename dc/d11/l36 to dc/d13/d48/l6a 0 2024-04-25T15:57:36.498 INFO:tasks.workunit.client.1.smithi155.stdout:3/298: write d1/d4/db/f11 [436898,89299] 0 2024-04-25T15:57:36.499 INFO:tasks.workunit.client.1.smithi155.stdout:0/291: mknod d1/d3/d6a/c6c 0 2024-04-25T15:57:36.500 INFO:tasks.workunit.client.1.smithi155.stdout:2/364: truncate d7/f49 3621090 0 2024-04-25T15:57:36.501 INFO:tasks.workunit.client.1.smithi155.stdout:0/292: fsync d1/d1a/f5f 0 2024-04-25T15:57:36.502 INFO:tasks.workunit.client.1.smithi155.stdout:5/310: rename d0/d58/l2b to d0/d3/d15/d30/d4f/l64 0 2024-04-25T15:57:36.502 INFO:tasks.workunit.client.1.smithi155.stdout:2/365: chown d7/c52 341379 1 2024-04-25T15:57:36.502 INFO:tasks.workunit.client.1.smithi155.stdout:7/330: dwrite d2/dd/f2f [4194304,4194304] 0 2024-04-25T15:57:36.504 INFO:tasks.workunit.client.1.smithi155.stdout:9/262: mknod dc/d13/c6b 0 2024-04-25T15:57:36.504 INFO:tasks.workunit.client.1.smithi155.stdout:3/299: symlink d1/d4/db/l60 0 2024-04-25T15:57:36.504 INFO:tasks.workunit.client.1.smithi155.stdout:1/310: truncate d1/d16/f1c 284224 0 2024-04-25T15:57:36.507 INFO:tasks.workunit.client.1.smithi155.stdout:9/263: dread - dc/d13/d2e/f37 zero size 2024-04-25T15:57:36.507 INFO:tasks.workunit.client.1.smithi155.stdout:7/331: unlink d2/dd/d13/f2c 0 2024-04-25T15:57:36.507 INFO:tasks.workunit.client.1.smithi155.stdout:0/293: creat d1/d6/d16/d60/f6d x:0 0 0 2024-04-25T15:57:36.508 INFO:tasks.workunit.client.1.smithi155.stdout:9/264: chown dc/d13/d2e/l53 257507 1 2024-04-25T15:57:36.512 INFO:tasks.workunit.client.1.smithi155.stdout:0/294: mkdir d1/d6/d16/d6e 0 2024-04-25T15:57:36.513 INFO:tasks.workunit.client.1.smithi155.stdout:5/311: getdents d0/d47/d59 0 2024-04-25T15:57:36.514 INFO:tasks.workunit.client.1.smithi155.stdout:5/312: fsync d0/d3/d15/f16 0 2024-04-25T15:57:36.516 INFO:tasks.workunit.client.1.smithi155.stdout:3/300: mkdir d1/d4/db/d20/d44/d52/d61 0 2024-04-25T15:57:36.517 INFO:tasks.workunit.client.1.smithi155.stdout:5/313: write d0/d3/f4a [3798865,68725] 0 2024-04-25T15:57:36.517 INFO:tasks.workunit.client.1.smithi155.stdout:1/311: dwrite d1/d16/d1d/f23 [0,4194304] 0 2024-04-25T15:57:36.520 INFO:tasks.workunit.client.1.smithi155.stdout:3/301: fdatasync d1/d4/db/d20/d44/f48 0 2024-04-25T15:57:36.520 INFO:tasks.workunit.client.1.smithi155.stdout:7/332: mkdir d2/dd/d66/d71 0 2024-04-25T15:57:36.523 INFO:tasks.workunit.client.1.smithi155.stdout:5/314: write d0/d3/f4a [1145803,110383] 0 2024-04-25T15:57:36.524 INFO:tasks.workunit.client.1.smithi155.stdout:1/312: mknod d1/d16/d37/c6a 0 2024-04-25T15:57:36.527 INFO:tasks.workunit.client.1.smithi155.stdout:7/333: creat d2/d26/d3d/d65/f72 x:0 0 0 2024-04-25T15:57:36.530 INFO:tasks.workunit.client.1.smithi155.stdout:0/295: dwrite d1/d3/d5/f32 [0,4194304] 0 2024-04-25T15:57:36.530 INFO:tasks.workunit.client.1.smithi155.stdout:0/296: chown d1/d3f 13393 1 2024-04-25T15:57:36.535 INFO:tasks.workunit.client.1.smithi155.stdout:7/334: rename d2/dd/d30/f6a to d2/dd/d36/f73 0 2024-04-25T15:57:36.538 INFO:tasks.workunit.client.1.smithi155.stdout:9/265: dread dc/f14 [0,4194304] 0 2024-04-25T15:57:36.547 INFO:tasks.workunit.client.1.smithi155.stdout:0/297: dwrite d1/d6/d29/f59 [0,4194304] 0 2024-04-25T15:57:36.551 INFO:tasks.workunit.client.1.smithi155.stdout:1/313: dwrite d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:36.555 INFO:tasks.workunit.client.1.smithi155.stdout:9/266: write f7 [348312,8498] 0 2024-04-25T15:57:36.556 INFO:tasks.workunit.client.1.smithi155.stdout:5/315: dwrite d0/d3/d15/fe [0,4194304] 0 2024-04-25T15:57:36.556 INFO:tasks.workunit.client.1.smithi155.stdout:7/335: dwrite d2/dd/d12/f20 [0,4194304] 0 2024-04-25T15:57:36.556 INFO:tasks.workunit.client.1.smithi155.stdout:9/267: chown dc/d44 18988 1 2024-04-25T15:57:36.556 INFO:tasks.workunit.client.1.smithi155.stdout:3/302: dread d1/d4/db/d28/f31 [0,4194304] 0 2024-04-25T15:57:36.561 INFO:tasks.workunit.client.1.smithi155.stdout:7/336: chown d2/dd/d12/c18 22365956 1 2024-04-25T15:57:36.561 INFO:tasks.workunit.client.1.smithi155.stdout:3/303: write d1/d4/d10/f43 [777019,92407] 0 2024-04-25T15:57:36.563 INFO:tasks.workunit.client.1.smithi155.stdout:0/298: mknod d1/d3/d12/c6f 0 2024-04-25T15:57:36.565 INFO:tasks.workunit.client.1.smithi155.stdout:0/299: write d1/d3/d3d/d46/f64 [2981312,91954] 0 2024-04-25T15:57:36.566 INFO:tasks.workunit.client.1.smithi155.stdout:1/314: unlink d1/d16/c4e 0 2024-04-25T15:57:36.568 INFO:tasks.workunit.client.1.smithi155.stdout:5/316: creat d0/d3/d15/d1f/d50/d60/f65 x:0 0 0 2024-04-25T15:57:36.568 INFO:tasks.workunit.client.1.smithi155.stdout:3/304: write d1/d4/f41 [812977,24983] 0 2024-04-25T15:57:36.570 INFO:tasks.workunit.client.1.smithi155.stdout:7/337: creat d2/dd/f74 x:0 0 0 2024-04-25T15:57:36.571 INFO:tasks.workunit.client.1.smithi155.stdout:9/268: dwrite dc/d17/d2a/f52 [0,4194304] 0 2024-04-25T15:57:36.571 INFO:tasks.workunit.client.1.smithi155.stdout:5/317: rmdir d0/d3/d15 39 2024-04-25T15:57:36.572 INFO:tasks.workunit.client.1.smithi155.stdout:0/300: creat d1/f70 x:0 0 0 2024-04-25T15:57:36.573 INFO:tasks.workunit.client.1.smithi155.stdout:1/315: creat d1/d6/f6b x:0 0 0 2024-04-25T15:57:36.575 INFO:tasks.workunit.client.1.smithi155.stdout:3/305: symlink d1/d4/db/d20/d44/l62 0 2024-04-25T15:57:36.575 INFO:tasks.workunit.client.1.smithi155.stdout:0/301: dread - d1/f70 zero size 2024-04-25T15:57:36.575 INFO:tasks.workunit.client.1.smithi155.stdout:7/338: dread - d2/dd/d13/d1c/f59 zero size 2024-04-25T15:57:36.575 INFO:tasks.workunit.client.1.smithi155.stdout:1/316: dread - d1/d16/d1d/f65 zero size 2024-04-25T15:57:36.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/269: rename dc/c4d to dc/d17/c6c 0 2024-04-25T15:57:36.578 INFO:tasks.workunit.client.1.smithi155.stdout:9/270: write f7 [2623087,69264] 0 2024-04-25T15:57:36.579 INFO:tasks.workunit.client.1.smithi155.stdout:5/318: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:36.580 INFO:tasks.workunit.client.1.smithi155.stdout:3/306: symlink d1/d4/d10/d21/d54/l63 0 2024-04-25T15:57:36.581 INFO:tasks.workunit.client.1.smithi155.stdout:3/307: chown d1/d4/db/d20/d44/l62 163 1 2024-04-25T15:57:36.582 INFO:tasks.workunit.client.1.smithi155.stdout:7/339: rename d2/dd/d36/d46/l4b to d2/d26/d3d/d6d/l75 0 2024-04-25T15:57:36.584 INFO:tasks.workunit.client.1.smithi155.stdout:3/308: write d1/d4/db/d20/f46 [213669,19113] 0 2024-04-25T15:57:36.584 INFO:tasks.workunit.client.1.smithi155.stdout:5/319: stat d0/d3/d15/d30/l44 0 2024-04-25T15:57:36.584 INFO:tasks.workunit.client.1.smithi155.stdout:9/271: rename dc/d17/d2a/f47 to dc/d13/d2e/f6d 0 2024-04-25T15:57:36.586 INFO:tasks.workunit.client.1.smithi155.stdout:9/272: stat dc/d17/d18/c25 0 2024-04-25T15:57:36.586 INFO:tasks.workunit.client.1.smithi155.stdout:5/320: rmdir d0/d47 39 2024-04-25T15:57:36.588 INFO:tasks.workunit.client.1.smithi155.stdout:9/273: symlink dc/d17/d2a/l6e 0 2024-04-25T15:57:36.589 INFO:tasks.workunit.client.1.smithi155.stdout:5/321: rmdir d0/d3/d15/d1f/d50/d60 39 2024-04-25T15:57:36.590 INFO:tasks.workunit.client.1.smithi155.stdout:5/322: write d0/d3/d15/f16 [2188586,69607] 0 2024-04-25T15:57:36.591 INFO:tasks.workunit.client.1.smithi155.stdout:9/274: symlink dc/d11/d5a/l6f 0 2024-04-25T15:57:36.592 INFO:tasks.workunit.client.1.smithi155.stdout:5/323: symlink d0/d58/d32/l66 0 2024-04-25T15:57:36.593 INFO:tasks.workunit.client.1.smithi155.stdout:3/309: getdents d1/d4/db 0 2024-04-25T15:57:36.600 INFO:tasks.workunit.client.1.smithi155.stdout:3/310: chown d1/d4/d10/d21/c51 97341529 1 2024-04-25T15:57:36.601 INFO:tasks.workunit.client.1.smithi155.stdout:5/324: rename d0/d3/d15/d30/l44 to d0/d58/d63/l67 0 2024-04-25T15:57:36.601 INFO:tasks.workunit.client.1.smithi155.stdout:5/325: write d0/d3/f5a [832364,27385] 0 2024-04-25T15:57:36.601 INFO:tasks.workunit.client.1.smithi155.stdout:3/311: mknod d1/d4/d10/c64 0 2024-04-25T15:57:36.601 INFO:tasks.workunit.client.1.smithi155.stdout:5/326: symlink d0/d3/d15/d30/l68 0 2024-04-25T15:57:36.602 INFO:tasks.workunit.client.1.smithi155.stdout:3/312: creat d1/d4/db/d28/d39/d57/f65 x:0 0 0 2024-04-25T15:57:36.602 INFO:tasks.workunit.client.1.smithi155.stdout:9/275: getdents dc/d17/d2a 0 2024-04-25T15:57:36.603 INFO:tasks.workunit.client.1.smithi155.stdout:1/317: dwrite d1/d16/d37/f69 [0,4194304] 0 2024-04-25T15:57:36.604 INFO:tasks.workunit.client.1.smithi155.stdout:6/448: sync 2024-04-25T15:57:36.604 INFO:tasks.workunit.client.1.smithi155.stdout:4/259: sync 2024-04-25T15:57:36.605 INFO:tasks.workunit.client.1.smithi155.stdout:4/260: chown da/d23/d2a/f31 93951101 1 2024-04-25T15:57:36.605 INFO:tasks.workunit.client.1.smithi155.stdout:3/313: rmdir d1/d4/d10 39 2024-04-25T15:57:36.607 INFO:tasks.workunit.client.1.smithi155.stdout:6/449: rename d0/d13/l72 to d0/d1a/d45/d61/l98 0 2024-04-25T15:57:36.609 INFO:tasks.workunit.client.1.smithi155.stdout:3/314: symlink d1/d4/d25/l66 0 2024-04-25T15:57:36.609 INFO:tasks.workunit.client.1.smithi155.stdout:4/261: creat da/d30/f5c x:0 0 0 2024-04-25T15:57:36.612 INFO:tasks.workunit.client.1.smithi155.stdout:1/318: rename d1/d16/d1d/d29/d3d/l4b to d1/d16/d37/l6c 0 2024-04-25T15:57:36.613 INFO:tasks.workunit.client.1.smithi155.stdout:3/315: chown d1/d4/c2e 706 1 2024-04-25T15:57:36.613 INFO:tasks.workunit.client.1.smithi155.stdout:6/450: fsync d0/d1a/d25/d51/f3b 0 2024-04-25T15:57:36.614 INFO:tasks.workunit.client.1.smithi155.stdout:4/262: write da/dc/f5a [354128,37077] 0 2024-04-25T15:57:36.617 INFO:tasks.workunit.client.1.smithi155.stdout:5/327: dwrite d0/d47/f4d [0,4194304] 0 2024-04-25T15:57:36.617 INFO:tasks.workunit.client.1.smithi155.stdout:3/316: mknod d1/d4/db/d28/d39/c67 0 2024-04-25T15:57:36.618 INFO:tasks.workunit.client.1.smithi155.stdout:9/276: dwrite dc/d11/f42 [0,4194304] 0 2024-04-25T15:57:36.620 INFO:tasks.workunit.client.1.smithi155.stdout:4/263: write da/d23/f57 [807786,3796] 0 2024-04-25T15:57:36.622 INFO:tasks.workunit.client.1.smithi155.stdout:6/451: dread d0/f4f [0,4194304] 0 2024-04-25T15:57:36.625 INFO:tasks.workunit.client.1.smithi155.stdout:5/328: creat d0/d27/f69 x:0 0 0 2024-04-25T15:57:36.628 INFO:tasks.workunit.client.1.smithi155.stdout:5/329: fdatasync d0/d27/f43 0 2024-04-25T15:57:36.628 INFO:tasks.workunit.client.1.smithi155.stdout:6/452: dread - d0/d13/d43/f93 zero size 2024-04-25T15:57:36.629 INFO:tasks.workunit.client.1.smithi155.stdout:3/317: rename d1/d4/l24 to d1/d4/l68 0 2024-04-25T15:57:36.630 INFO:tasks.workunit.client.1.smithi155.stdout:5/330: mkdir d0/d58/d32/d6a 0 2024-04-25T15:57:36.630 INFO:tasks.workunit.client.1.smithi155.stdout:6/453: mkdir d0/d13/d7c/d99 0 2024-04-25T15:57:36.632 INFO:tasks.workunit.client.1.smithi155.stdout:9/277: dwrite dc/ff [0,4194304] 0 2024-04-25T15:57:36.634 INFO:tasks.workunit.client.1.smithi155.stdout:5/331: rename d0/f4c to d0/d3/d15/d30/d4f/f6b 0 2024-04-25T15:57:36.634 INFO:tasks.workunit.client.1.smithi155.stdout:3/318: getdents d1/d4/d10/d21 0 2024-04-25T15:57:36.635 INFO:tasks.workunit.client.1.smithi155.stdout:9/278: creat dc/d13/f70 x:0 0 0 2024-04-25T15:57:36.637 INFO:tasks.workunit.client.1.smithi155.stdout:9/279: readlink dc/d2f/l34 0 2024-04-25T15:57:36.638 INFO:tasks.workunit.client.1.smithi155.stdout:9/280: read dc/d17/d2a/f52 [2761008,83067] 0 2024-04-25T15:57:36.638 INFO:tasks.workunit.client.1.smithi155.stdout:3/319: mknod d1/d4/c69 0 2024-04-25T15:57:36.639 INFO:tasks.workunit.client.1.smithi155.stdout:9/281: fdatasync dc/d11/d30/d46/f4b 0 2024-04-25T15:57:36.640 INFO:tasks.workunit.client.1.smithi155.stdout:3/320: fdatasync d1/d4/d10/d21/d54/f59 0 2024-04-25T15:57:36.641 INFO:tasks.workunit.client.1.smithi155.stdout:3/321: dread - d1/d4/db/d20/f4c zero size 2024-04-25T15:57:36.641 INFO:tasks.workunit.client.1.smithi155.stdout:3/322: fsync d1/d4/db/f11 0 2024-04-25T15:57:36.646 INFO:tasks.workunit.client.1.smithi155.stdout:3/323: dread d1/d4/d10/d21/d54/f59 [0,4194304] 0 2024-04-25T15:57:36.647 INFO:tasks.workunit.client.1.smithi155.stdout:9/282: dwrite dc/d13/d2e/f6d [4194304,4194304] 0 2024-04-25T15:57:36.649 INFO:tasks.workunit.client.1.smithi155.stdout:9/283: truncate dc/d11/f64 810071 0 2024-04-25T15:57:36.650 INFO:tasks.workunit.client.1.smithi155.stdout:3/324: getdents d1/d4/db/d28/d39/d57 0 2024-04-25T15:57:36.650 INFO:tasks.workunit.client.1.smithi155.stdout:9/284: write dc/d13/d2e/d4c/f61 [414442,81967] 0 2024-04-25T15:57:36.652 INFO:tasks.workunit.client.1.smithi155.stdout:3/325: mkdir d1/d4/d6a 0 2024-04-25T15:57:36.653 INFO:tasks.workunit.client.1.smithi155.stdout:3/326: rename d1/d4 to d1/d4/d10/d2a/d6b 22 2024-04-25T15:57:36.654 INFO:tasks.workunit.client.1.smithi155.stdout:3/327: fsync d1/d4/db/d20/f46 0 2024-04-25T15:57:36.656 INFO:tasks.workunit.client.1.smithi155.stdout:3/328: write d1/d4/f41 [102665,84982] 0 2024-04-25T15:57:36.661 INFO:tasks.workunit.client.1.smithi155.stdout:3/329: mkdir d1/d4/d10/d2a/d6c 0 2024-04-25T15:57:36.661 INFO:tasks.workunit.client.1.smithi155.stdout:9/285: dwrite dc/d13/f70 [0,4194304] 0 2024-04-25T15:57:36.662 INFO:tasks.workunit.client.1.smithi155.stdout:9/286: write dc/f14 [5213676,67420] 0 2024-04-25T15:57:36.662 INFO:tasks.workunit.client.1.smithi155.stdout:3/330: chown d1/d4/d10/d21/c51 23 1 2024-04-25T15:57:36.663 INFO:tasks.workunit.client.1.smithi155.stdout:9/287: read dc/d11/f42 [206274,7952] 0 2024-04-25T15:57:36.664 INFO:tasks.workunit.client.1.smithi155.stdout:4/264: write da/d23/f3d [621630,93033] 0 2024-04-25T15:57:36.665 INFO:tasks.workunit.client.1.smithi155.stdout:3/331: stat d1/d4/d10/d2a/c3e 0 2024-04-25T15:57:36.667 INFO:tasks.workunit.client.1.smithi155.stdout:4/265: write da/d23/d2a/f31 [674840,94670] 0 2024-04-25T15:57:36.671 INFO:tasks.workunit.client.1.smithi155.stdout:4/266: mknod da/d23/d3f/d56/c5d 0 2024-04-25T15:57:36.672 INFO:tasks.workunit.client.1.smithi155.stdout:6/454: truncate d0/d13/d43/f33 663935 0 2024-04-25T15:57:36.674 INFO:tasks.workunit.client.1.smithi155.stdout:3/332: dread d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:36.676 INFO:tasks.workunit.client.1.smithi155.stdout:6/455: getdents d0 0 2024-04-25T15:57:36.678 INFO:tasks.workunit.client.1.smithi155.stdout:9/288: truncate dc/d17/d18/f2d 2158214 0 2024-04-25T15:57:36.680 INFO:tasks.workunit.client.1.smithi155.stdout:5/332: dwrite d0/d27/f4b [4194304,4194304] 0 2024-04-25T15:57:36.680 INFO:tasks.workunit.client.1.smithi155.stdout:3/333: getdents d1/d4/d25 0 2024-04-25T15:57:36.683 INFO:tasks.workunit.client.1.smithi155.stdout:3/334: write d1/d4/f2c [157979,81516] 0 2024-04-25T15:57:36.687 INFO:tasks.workunit.client.1.smithi155.stdout:4/267: dwrite da/dc/d49/f4e [0,4194304] 0 2024-04-25T15:57:36.691 INFO:tasks.workunit.client.1.smithi155.stdout:4/268: creat da/dc/d18/d34/f5e x:0 0 0 2024-04-25T15:57:36.693 INFO:tasks.workunit.client.1.smithi155.stdout:4/269: chown da/dc/c58 1779456 1 2024-04-25T15:57:36.694 INFO:tasks.workunit.client.1.smithi155.stdout:3/335: dread d1/d4/db/f11 [0,4194304] 0 2024-04-25T15:57:36.696 INFO:tasks.workunit.client.1.smithi155.stdout:4/270: creat da/dc/d18/f5f x:0 0 0 2024-04-25T15:57:36.696 INFO:tasks.workunit.client.1.smithi155.stdout:3/336: rmdir d1/d4/db/d20 39 2024-04-25T15:57:36.698 INFO:tasks.workunit.client.1.smithi155.stdout:4/271: creat da/d30/f60 x:0 0 0 2024-04-25T15:57:36.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/272: creat da/d30/f61 x:0 0 0 2024-04-25T15:57:36.702 INFO:tasks.workunit.client.1.smithi155.stdout:5/333: dread d0/d58/f19 [0,4194304] 0 2024-04-25T15:57:36.703 INFO:tasks.workunit.client.1.smithi155.stdout:4/273: mkdir da/d23/d2a/d62 0 2024-04-25T15:57:36.704 INFO:tasks.workunit.client.1.smithi155.stdout:3/337: dwrite d1/d4/d10/d2a/f4b [0,4194304] 0 2024-04-25T15:57:36.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/338: write d1/d4/f41 [700835,14743] 0 2024-04-25T15:57:36.711 INFO:tasks.workunit.client.1.smithi155.stdout:3/339: mknod d1/d4/db/d28/d58/c6d 0 2024-04-25T15:57:36.712 INFO:tasks.workunit.client.1.smithi155.stdout:5/334: dwrite d0/d3/f5a [0,4194304] 0 2024-04-25T15:57:36.713 INFO:tasks.workunit.client.1.smithi155.stdout:4/274: dwrite da/d23/f57 [0,4194304] 0 2024-04-25T15:57:36.714 INFO:tasks.workunit.client.1.smithi155.stdout:5/335: write d0/d3/d15/f16 [4713207,125823] 0 2024-04-25T15:57:36.715 INFO:tasks.workunit.client.1.smithi155.stdout:8/190: sync 2024-04-25T15:57:36.717 INFO:tasks.workunit.client.1.smithi155.stdout:8/191: stat d2/d15/d18/c26 0 2024-04-25T15:57:36.722 INFO:tasks.workunit.client.1.smithi155.stdout:5/336: symlink d0/d3/d15/d1f/l6c 0 2024-04-25T15:57:36.724 INFO:tasks.workunit.client.1.smithi155.stdout:4/275: creat da/dc/d18/d34/d4a/f63 x:0 0 0 2024-04-25T15:57:36.726 INFO:tasks.workunit.client.1.smithi155.stdout:8/192: creat d2/d15/d18/d23/d2d/f39 x:0 0 0 2024-04-25T15:57:36.729 INFO:tasks.workunit.client.1.smithi155.stdout:3/340: dwrite d1/f26 [0,4194304] 0 2024-04-25T15:57:36.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/193: rename d2/d15/d18/d23/f2e to d2/d15/d18/d23/d2f/f3a 0 2024-04-25T15:57:36.735 INFO:tasks.workunit.client.1.smithi155.stdout:8/194: write d2/d15/d18/f1a [871036,41590] 0 2024-04-25T15:57:36.735 INFO:tasks.workunit.client.1.smithi155.stdout:3/341: symlink d1/d4/db/d28/d39/d57/l6e 0 2024-04-25T15:57:36.737 INFO:tasks.workunit.client.1.smithi155.stdout:4/276: dwrite da/dc/d18/f5f [0,4194304] 0 2024-04-25T15:57:36.737 INFO:tasks.workunit.client.1.smithi155.stdout:3/342: chown d1/d4/d25/f38 291615 1 2024-04-25T15:57:36.739 INFO:tasks.workunit.client.1.smithi155.stdout:3/343: rename d1 to d1/d4/d6a/d6f 22 2024-04-25T15:57:36.739 INFO:tasks.workunit.client.1.smithi155.stdout:3/344: chown d1 208239 1 2024-04-25T15:57:36.740 INFO:tasks.workunit.client.1.smithi155.stdout:5/337: truncate d0/d3/d15/d30/d4f/f62 356488 0 2024-04-25T15:57:36.741 INFO:tasks.workunit.client.1.smithi155.stdout:8/195: symlink d2/d15/d18/d23/d2d/l3b 0 2024-04-25T15:57:36.743 INFO:tasks.workunit.client.1.smithi155.stdout:4/277: rename da/dc/d18/d34/c50 to da/dc/d18/c64 0 2024-04-25T15:57:36.745 INFO:tasks.workunit.client.1.smithi155.stdout:3/345: dread d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:36.745 INFO:tasks.workunit.client.1.smithi155.stdout:8/196: mkdir d2/d15/d18/d23/d3c 0 2024-04-25T15:57:36.746 INFO:tasks.workunit.client.1.smithi155.stdout:4/278: write da/dc/f1d [2791000,129669] 0 2024-04-25T15:57:36.748 INFO:tasks.workunit.client.1.smithi155.stdout:8/197: mkdir d2/d15/d35/d3d 0 2024-04-25T15:57:36.749 INFO:tasks.workunit.client.1.smithi155.stdout:3/346: mknod d1/d4/d10/d2a/d6c/c70 0 2024-04-25T15:57:36.750 INFO:tasks.workunit.client.1.smithi155.stdout:4/279: symlink da/dc/d18/d34/d4a/l65 0 2024-04-25T15:57:36.753 INFO:tasks.workunit.client.1.smithi155.stdout:3/347: write d1/d4/d10/d2a/f3c [531988,63327] 0 2024-04-25T15:57:36.754 INFO:tasks.workunit.client.1.smithi155.stdout:5/338: dwrite d0/f40 [0,4194304] 0 2024-04-25T15:57:36.754 INFO:tasks.workunit.client.1.smithi155.stdout:4/280: read da/d23/d2a/f4f [727543,54573] 0 2024-04-25T15:57:36.757 INFO:tasks.workunit.client.1.smithi155.stdout:4/281: symlink da/d23/d3a/l66 0 2024-04-25T15:57:36.758 INFO:tasks.workunit.client.1.smithi155.stdout:4/282: chown da/d23 1 1 2024-04-25T15:57:36.759 INFO:tasks.workunit.client.1.smithi155.stdout:3/348: creat d1/d4/db/d28/d39/d57/f71 x:0 0 0 2024-04-25T15:57:36.759 INFO:tasks.workunit.client.1.smithi155.stdout:4/283: readlink da/dc/d49/l5b 0 2024-04-25T15:57:36.759 INFO:tasks.workunit.client.1.smithi155.stdout:8/198: dwrite d2/f33 [0,4194304] 0 2024-04-25T15:57:36.763 INFO:tasks.workunit.client.1.smithi155.stdout:4/284: creat da/d23/d3f/d56/f67 x:0 0 0 2024-04-25T15:57:36.768 INFO:tasks.workunit.client.1.smithi155.stdout:5/339: getdents d0/d58 0 2024-04-25T15:57:36.768 INFO:tasks.workunit.client.1.smithi155.stdout:5/340: readlink d0/d3/d15/d1f/l6c 0 2024-04-25T15:57:36.770 INFO:tasks.workunit.client.1.smithi155.stdout:5/341: write d0/d3/d2c/f48 [108626,1497] 0 2024-04-25T15:57:36.770 INFO:tasks.workunit.client.1.smithi155.stdout:8/199: rename d2/d5/l38 to d2/d15/d18/d34/l3e 0 2024-04-25T15:57:36.771 INFO:tasks.workunit.client.1.smithi155.stdout:5/342: write d0/d3/d2c/f2f [4507819,45178] 0 2024-04-25T15:57:36.773 INFO:tasks.workunit.client.1.smithi155.stdout:8/200: mknod d2/c3f 0 2024-04-25T15:57:36.775 INFO:tasks.workunit.client.1.smithi155.stdout:8/201: fsync d2/f16 0 2024-04-25T15:57:36.775 INFO:tasks.workunit.client.1.smithi155.stdout:8/202: chown d2/d15/d18/d34 67 1 2024-04-25T15:57:36.778 INFO:tasks.workunit.client.1.smithi155.stdout:4/285: dread da/f4b [0,4194304] 0 2024-04-25T15:57:36.787 INFO:tasks.workunit.client.1.smithi155.stdout:3/349: dread d1/d4/db/d28/d58/f42 [0,4194304] 0 2024-04-25T15:57:36.788 INFO:tasks.workunit.client.1.smithi155.stdout:5/343: truncate d0/d3/d2c/f3c 1277692 0 2024-04-25T15:57:36.790 INFO:tasks.workunit.client.1.smithi155.stdout:8/203: dread d2/d15/d18/d23/d2d/f31 [0,4194304] 0 2024-04-25T15:57:36.792 INFO:tasks.workunit.client.1.smithi155.stdout:4/286: getdents da/dc/d18 0 2024-04-25T15:57:36.795 INFO:tasks.workunit.client.1.smithi155.stdout:8/204: dread d2/f33 [0,4194304] 0 2024-04-25T15:57:36.797 INFO:tasks.workunit.client.1.smithi155.stdout:3/350: creat d1/d4/f72 x:0 0 0 2024-04-25T15:57:36.797 INFO:tasks.workunit.client.1.smithi155.stdout:5/344: write d0/d58/f19 [2698663,127005] 0 2024-04-25T15:57:36.798 INFO:tasks.workunit.client.1.smithi155.stdout:8/205: mkdir d2/d5/d40 0 2024-04-25T15:57:36.798 INFO:tasks.workunit.client.1.smithi155.stdout:3/351: dread - d1/d4/db/d28/f5b zero size 2024-04-25T15:57:36.799 INFO:tasks.workunit.client.1.smithi155.stdout:4/287: creat da/d23/d2a/d62/f68 x:0 0 0 2024-04-25T15:57:36.802 INFO:tasks.workunit.client.1.smithi155.stdout:3/352: dread - d1/d4/db/d20/f4c zero size 2024-04-25T15:57:36.806 INFO:tasks.workunit.client.1.smithi155.stdout:3/353: write d1/d4/db/d28/d39/d57/f71 [387261,111746] 0 2024-04-25T15:57:36.806 INFO:tasks.workunit.client.1.smithi155.stdout:4/288: rename da/dc/d18/d34 to da/d23/d3f/d56/d69 0 2024-04-25T15:57:36.809 INFO:tasks.workunit.client.1.smithi155.stdout:3/354: rename d1/d4/d10/d21/d54 to d1/d4/d10/d21/d73 0 2024-04-25T15:57:36.811 INFO:tasks.workunit.client.1.smithi155.stdout:5/345: truncate d0/f2 1304236 0 2024-04-25T15:57:36.811 INFO:tasks.workunit.client.1.smithi155.stdout:8/206: dwrite d2/d5/f29 [0,4194304] 0 2024-04-25T15:57:36.813 INFO:tasks.workunit.client.1.smithi155.stdout:3/355: mknod d1/d4/d10/d2a/c74 0 2024-04-25T15:57:36.813 INFO:tasks.workunit.client.1.smithi155.stdout:5/346: read d0/f37 [2695240,122823] 0 2024-04-25T15:57:36.818 INFO:tasks.workunit.client.1.smithi155.stdout:5/347: chown d0/d3/l4e 447404 1 2024-04-25T15:57:36.820 INFO:tasks.workunit.client.0.smithi087.stderr:++ readlink -f fsstress 2024-04-25T15:57:36.821 INFO:tasks.workunit.client.1.smithi155.stdout:8/207: mkdir d2/d41 0 2024-04-25T15:57:36.822 INFO:tasks.workunit.client.1.smithi155.stdout:4/289: getdents da/dc/d18 0 2024-04-25T15:57:36.824 INFO:tasks.workunit.client.0.smithi087.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T15:57:36.824 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-04-25T15:57:36.824 INFO:tasks.workunit.client.1.smithi155.stdout:4/290: chown da/d30/l32 8756610 1 2024-04-25T15:57:36.824 INFO:tasks.workunit.client.1.smithi155.stdout:4/291: fsync da/dc/ff 0 2024-04-25T15:57:36.825 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T15:57:36.826 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-04-25T15:57:36.827 INFO:tasks.workunit.client.1.smithi155.stdout:5/348: mknod d0/d47/c6d 0 2024-04-25T15:57:36.827 INFO:tasks.workunit.client.1.smithi155.stdout:4/292: write da/d23/d3f/d56/d69/f44 [3893577,53024] 0 2024-04-25T15:57:36.827 INFO:tasks.workunit.client.1.smithi155.stdout:5/349: chown d0/d47/d59/f5d 445842 1 2024-04-25T15:57:36.828 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T15:57:36.828 INFO:tasks.workunit.client.0.smithi087.stderr:++ mktemp -d -p . 2024-04-25T15:57:36.829 INFO:tasks.workunit.client.1.smithi155.stdout:3/356: creat d1/d4/db/f75 x:0 0 0 2024-04-25T15:57:36.829 INFO:tasks.workunit.client.1.smithi155.stdout:4/293: symlink da/d23/d3f/l6a 0 2024-04-25T15:57:36.829 INFO:tasks.workunit.client.1.smithi155.stdout:4/294: chown da/d23/d3f/d56/f67 22 1 2024-04-25T15:57:36.830 INFO:tasks.workunit.client.1.smithi155.stdout:3/357: creat d1/d4/d25/f76 x:0 0 0 2024-04-25T15:57:36.831 INFO:tasks.workunit.client.1.smithi155.stdout:5/350: mknod d0/d3/d15/d1f/d50/d60/c6e 0 2024-04-25T15:57:36.831 INFO:tasks.workunit.client.1.smithi155.stdout:5/351: stat d0/d3/l4e 0 2024-04-25T15:57:36.832 INFO:tasks.workunit.client.1.smithi155.stdout:4/295: mkdir da/d23/d3f/d56/d69/d4a/d6b 0 2024-04-25T15:57:36.832 INFO:tasks.workunit.client.1.smithi155.stdout:0/302: sync 2024-04-25T15:57:36.832 INFO:tasks.workunit.client.1.smithi155.stdout:2/366: sync 2024-04-25T15:57:36.833 INFO:tasks.workunit.client.1.smithi155.stdout:5/352: truncate d0/d3/d15/f16 5362835 0 2024-04-25T15:57:36.833 INFO:tasks.workunit.client.1.smithi155.stdout:4/296: read da/d23/d2a/f2e [72530,4272] 0 2024-04-25T15:57:36.834 INFO:tasks.workunit.client.1.smithi155.stdout:3/358: unlink d1/d4/d25/l66 0 2024-04-25T15:57:36.836 INFO:tasks.workunit.client.1.smithi155.stdout:8/208: write d2/d5/f21 [4213932,97587] 0 2024-04-25T15:57:36.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:36.838 INFO:tasks.workunit.client.1.smithi155.stdout:5/353: dread d0/d3/d15/f16 [4194304,4194304] 0 2024-04-25T15:57:36.839 INFO:tasks.workunit.client.1.smithi155.stdout:4/297: rename da/d30/f60 to da/d23/f6c 0 2024-04-25T15:57:36.840 INFO:tasks.workunit.client.1.smithi155.stdout:2/367: symlink d7/db/d2e/d6f/l71 0 2024-04-25T15:57:36.842 INFO:tasks.workunit.client.1.smithi155.stdout:5/354: unlink d0/d3/d15/c14 0 2024-04-25T15:57:36.843 INFO:tasks.workunit.client.1.smithi155.stdout:0/303: creat d1/f71 x:0 0 0 2024-04-25T15:57:36.843 INFO:tasks.workunit.client.1.smithi155.stdout:8/209: getdents d2/d41 0 2024-04-25T15:57:36.844 INFO:tasks.workunit.client.1.smithi155.stdout:5/355: write d0/d27/f69 [819434,47263] 0 2024-04-25T15:57:36.848 INFO:tasks.workunit.client.1.smithi155.stdout:8/210: unlink d2/f28 0 2024-04-25T15:57:36.849 INFO:tasks.workunit.client.1.smithi155.stdout:4/298: dwrite da/f14 [0,4194304] 0 2024-04-25T15:57:36.849 INFO:tasks.workunit.client.1.smithi155.stdout:5/356: truncate d0/d3/d2c/f2f 5076098 0 2024-04-25T15:57:36.850 INFO:tasks.workunit.client.1.smithi155.stdout:3/359: dwrite d1/d4/d10/d2a/f45 [0,4194304] 0 2024-04-25T15:57:36.852 INFO:tasks.workunit.client.1.smithi155.stdout:3/360: write d1/d4/d10/f43 [305399,14078] 0 2024-04-25T15:57:36.853 INFO:tasks.workunit.client.1.smithi155.stdout:3/361: stat d1/d4/d10/d2a 0 2024-04-25T15:57:36.860 INFO:tasks.workunit.client.1.smithi155.stdout:4/299: creat da/d30/f6d x:0 0 0 2024-04-25T15:57:36.860 INFO:tasks.workunit.client.1.smithi155.stdout:5/357: fdatasync d0/d3/d15/f16 0 2024-04-25T15:57:36.865 INFO:tasks.workunit.client.1.smithi155.stdout:4/300: rename da/dc/d49 to da/dc/d18/d6e 0 2024-04-25T15:57:36.867 INFO:tasks.workunit.client.1.smithi155.stdout:4/301: fdatasync da/dc/fd 0 2024-04-25T15:57:36.867 INFO:tasks.workunit.client.1.smithi155.stdout:0/304: write d1/d3/d5/f13 [324366,9663] 0 2024-04-25T15:57:36.869 INFO:tasks.workunit.client.1.smithi155.stdout:2/368: dread d7/f49 [0,4194304] 0 2024-04-25T15:57:36.874 INFO:tasks.workunit.client.1.smithi155.stdout:2/369: stat d7/db/d2e/d44 0 2024-04-25T15:57:36.874 INFO:tasks.workunit.client.1.smithi155.stdout:8/211: dread d2/f16 [0,4194304] 0 2024-04-25T15:57:36.876 INFO:tasks.workunit.client.1.smithi155.stdout:5/358: truncate d0/d3/d15/f16 4593253 0 2024-04-25T15:57:36.877 INFO:tasks.workunit.client.1.smithi155.stdout:2/370: chown d7/d23/f35 256 1 2024-04-25T15:57:36.877 INFO:tasks.workunit.client.1.smithi155.stdout:8/212: fdatasync d2/fc 0 2024-04-25T15:57:36.879 INFO:tasks.workunit.client.1.smithi155.stdout:5/359: stat d0/d3/d15/d1f/d50/d60 0 2024-04-25T15:57:36.880 INFO:tasks.workunit.client.1.smithi155.stdout:3/362: dread d1/d4/d10/d2a/f45 [4194304,4194304] 0 2024-04-25T15:57:36.881 INFO:tasks.workunit.client.1.smithi155.stdout:5/360: stat d0/d58/l23 0 2024-04-25T15:57:36.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/305: dwrite d1/d3/d5/f26 [4194304,4194304] 0 2024-04-25T15:57:36.881 INFO:tasks.workunit.client.1.smithi155.stdout:4/302: dwrite da/d23/f42 [0,4194304] 0 2024-04-25T15:57:36.898 INFO:tasks.workunit.client.1.smithi155.stdout:0/306: dread - d1/d3/d5/f54 zero size 2024-04-25T15:57:36.898 INFO:tasks.workunit.client.1.smithi155.stdout:5/361: symlink d0/d3/d15/d1f/l6f 0 2024-04-25T15:57:36.900 INFO:tasks.workunit.client.1.smithi155.stdout:3/363: rename d1/d4/db/d28/d39 to d1/d4/d10/d21/d73/d77 0 2024-04-25T15:57:36.900 INFO:tasks.workunit.client.1.smithi155.stdout:4/303: truncate da/dc/d18/f46 576959 0 2024-04-25T15:57:36.901 INFO:tasks.workunit.client.1.smithi155.stdout:0/307: chown d1/d3/d3d/d46/f64 238 1 2024-04-25T15:57:36.902 INFO:tasks.workunit.client.1.smithi155.stdout:3/364: chown d1/d4/f72 2 1 2024-04-25T15:57:36.902 INFO:tasks.workunit.client.1.smithi155.stdout:2/371: dwrite d7/db/dd/f2a [0,4194304] 0 2024-04-25T15:57:36.905 INFO:tasks.workunit.client.1.smithi155.stdout:5/362: rename d0/d27/f5b to d0/d3/d15/d1f/f70 0 2024-04-25T15:57:36.905 INFO:tasks.workunit.client.1.smithi155.stdout:5/363: readlink d0/d58/l23 0 2024-04-25T15:57:36.908 INFO:tasks.workunit.client.1.smithi155.stdout:0/308: dread d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:36.909 INFO:tasks.workunit.client.1.smithi155.stdout:0/309: dread - d1/d41/f45 zero size 2024-04-25T15:57:36.913 INFO:tasks.workunit.client.1.smithi155.stdout:2/372: creat d7/db/dd/f72 x:0 0 0 2024-04-25T15:57:36.913 INFO:tasks.workunit.client.1.smithi155.stdout:0/310: fdatasync d1/d1a/f34 0 2024-04-25T15:57:36.915 INFO:tasks.workunit.client.1.smithi155.stdout:2/373: write d7/db/d2e/d44/f68 [961582,119678] 0 2024-04-25T15:57:36.915 INFO:tasks.workunit.client.1.smithi155.stdout:4/304: truncate da/dc/f1f 529790 0 2024-04-25T15:57:36.916 INFO:tasks.workunit.client.1.smithi155.stdout:3/365: dwrite d1/f1f [4194304,4194304] 0 2024-04-25T15:57:36.916 INFO:tasks.workunit.client.1.smithi155.stdout:0/311: mknod d1/d3/d5/d5b/c72 0 2024-04-25T15:57:36.916 INFO:tasks.workunit.client.1.smithi155.stdout:5/364: write d0/d3/d15/d30/d4f/f62 [981179,37466] 0 2024-04-25T15:57:36.919 INFO:tasks.workunit.client.1.smithi155.stdout:3/366: chown d1/d4/d10/d21/d73/d77/c67 0 1 2024-04-25T15:57:36.924 INFO:tasks.workunit.client.1.smithi155.stdout:0/312: creat d1/d3/d6a/f73 x:0 0 0 2024-04-25T15:57:36.929 INFO:tasks.workunit.client.1.smithi155.stdout:4/305: dwrite da/dc/d18/f5f [0,4194304] 0 2024-04-25T15:57:36.930 INFO:tasks.workunit.client.1.smithi155.stdout:2/374: dwrite d7/db/dd/d15/f55 [0,4194304] 0 2024-04-25T15:57:36.931 INFO:tasks.workunit.client.1.smithi155.stdout:3/367: dread d1/d4/d10/d2a/f45 [4194304,4194304] 0 2024-04-25T15:57:36.934 INFO:tasks.workunit.client.1.smithi155.stdout:5/365: truncate d0/d3/d2c/f3c 801274 0 2024-04-25T15:57:36.936 INFO:tasks.workunit.client.1.smithi155.stdout:3/368: mknod d1/d4/d10/d21/d73/d77/d57/c78 0 2024-04-25T15:57:36.937 INFO:tasks.workunit.client.1.smithi155.stdout:3/369: chown d1/d4/c2e 0 1 2024-04-25T15:57:36.937 INFO:tasks.workunit.client.1.smithi155.stdout:2/375: symlink d7/db/l73 0 2024-04-25T15:57:36.938 INFO:tasks.workunit.client.1.smithi155.stdout:5/366: rmdir d0 39 2024-04-25T15:57:36.941 INFO:tasks.workunit.client.1.smithi155.stdout:5/367: chown d0/d3/d2c/l5f 11250 1 2024-04-25T15:57:36.942 INFO:tasks.workunit.client.1.smithi155.stdout:3/370: dread d1/d4/f41 [0,4194304] 0 2024-04-25T15:57:36.942 INFO:tasks.workunit.client.1.smithi155.stdout:4/306: dread da/dc/ff [0,4194304] 0 2024-04-25T15:57:36.942 INFO:tasks.workunit.client.1.smithi155.stdout:2/376: chown d7/db/dd/d15/d60/c64 39 1 2024-04-25T15:57:36.943 INFO:tasks.workunit.client.1.smithi155.stdout:4/307: write da/d23/d2a/f31 [697989,12869] 0 2024-04-25T15:57:36.944 INFO:tasks.workunit.client.1.smithi155.stdout:5/368: symlink d0/d47/d59/l71 0 2024-04-25T15:57:36.948 INFO:tasks.workunit.client.1.smithi155.stdout:7/340: sync 2024-04-25T15:57:36.950 INFO:tasks.workunit.client.1.smithi155.stdout:4/308: dread da/dc/f5a [0,4194304] 0 2024-04-25T15:57:36.953 INFO:tasks.workunit.client.1.smithi155.stdout:7/341: write d2/dd/d13/d1c/f31 [4342,17922] 0 2024-04-25T15:57:36.954 INFO:tasks.workunit.client.1.smithi155.stdout:0/313: dread d1/f1b [0,4194304] 0 2024-04-25T15:57:36.954 INFO:tasks.workunit.client.1.smithi155.stdout:4/309: rmdir da/d30 39 2024-04-25T15:57:36.958 INFO:tasks.workunit.client.1.smithi155.stdout:2/377: dwrite d7/db/f6c [0,4194304] 0 2024-04-25T15:57:36.960 INFO:tasks.workunit.client.1.smithi155.stdout:5/369: dwrite d0/d3/d2c/f48 [0,4194304] 0 2024-04-25T15:57:36.964 INFO:tasks.workunit.client.1.smithi155.stdout:2/378: mkdir d7/d74 0 2024-04-25T15:57:36.968 INFO:tasks.workunit.client.1.smithi155.stdout:7/342: dwrite d2/f2e [4194304,4194304] 0 2024-04-25T15:57:36.969 INFO:tasks.workunit.client.1.smithi155.stdout:6/456: sync 2024-04-25T15:57:36.969 INFO:tasks.workunit.client.1.smithi155.stdout:9/289: sync 2024-04-25T15:57:36.969 INFO:tasks.workunit.client.1.smithi155.stdout:1/319: sync 2024-04-25T15:57:36.969 INFO:tasks.workunit.client.1.smithi155.stdout:2/379: creat d7/db/d2e/d6f/f75 x:0 0 0 2024-04-25T15:57:36.972 INFO:tasks.workunit.client.1.smithi155.stdout:7/343: write d2/dd/f52 [594991,45077] 0 2024-04-25T15:57:36.972 INFO:tasks.workunit.client.1.smithi155.stdout:9/290: chown dc/d11/d5a/c62 7 1 2024-04-25T15:57:36.973 INFO:tasks.workunit.client.1.smithi155.stdout:5/370: creat d0/d3/d15/f72 x:0 0 0 2024-04-25T15:57:36.973 INFO:tasks.workunit.client.1.smithi155.stdout:1/320: rmdir d1/d32 39 2024-04-25T15:57:36.974 INFO:tasks.workunit.client.1.smithi155.stdout:4/310: read da/dc/f1f [72345,122813] 0 2024-04-25T15:57:36.975 INFO:tasks.workunit.client.1.smithi155.stdout:3/371: dread d1/d4/db/d20/d44/f48 [0,4194304] 0 2024-04-25T15:57:36.975 INFO:tasks.workunit.client.1.smithi155.stdout:0/314: dread d1/d6/d29/f3a [0,4194304] 0 2024-04-25T15:57:36.976 INFO:tasks.workunit.client.1.smithi155.stdout:1/321: truncate d1/d16/f2c 2021977 0 2024-04-25T15:57:36.976 INFO:tasks.workunit.client.1.smithi155.stdout:2/380: creat d7/db/dd/d15/d60/f76 x:0 0 0 2024-04-25T15:57:36.979 INFO:tasks.workunit.client.1.smithi155.stdout:9/291: read dc/d13/d2e/d4c/f61 [364803,126766] 0 2024-04-25T15:57:36.979 INFO:tasks.workunit.client.1.smithi155.stdout:0/315: chown d1/d3/d5/d5b/c72 5256171 1 2024-04-25T15:57:36.981 INFO:tasks.workunit.client.1.smithi155.stdout:7/344: mkdir d2/dd/d12/d76 0 2024-04-25T15:57:36.981 INFO:tasks.workunit.client.1.smithi155.stdout:0/316: chown d1/d3/d6a 15707877 1 2024-04-25T15:57:36.982 INFO:tasks.workunit.client.1.smithi155.stdout:9/292: fdatasync dc/d17/d2a/f35 0 2024-04-25T15:57:36.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/322: symlink d1/d16/d1d/d29/l6d 0 2024-04-25T15:57:36.984 INFO:tasks.workunit.client.1.smithi155.stdout:3/372: unlink d1/c12 0 2024-04-25T15:57:36.986 INFO:tasks.workunit.client.1.smithi155.stdout:3/373: fsync d1/d4/db/f55 0 2024-04-25T15:57:36.986 INFO:tasks.workunit.client.1.smithi155.stdout:7/345: dread d2/dd/d13/d24/f27 [0,4194304] 0 2024-04-25T15:57:36.988 INFO:tasks.workunit.client.1.smithi155.stdout:4/311: rename da/d23/l40 to da/d30/l6f 0 2024-04-25T15:57:36.988 INFO:tasks.workunit.client.1.smithi155.stdout:3/374: truncate d1/f16 5088006 0 2024-04-25T15:57:36.989 INFO:tasks.workunit.client.1.smithi155.stdout:5/371: dwrite d0/d27/f69 [0,4194304] 0 2024-04-25T15:57:36.989 INFO:tasks.workunit.client.0.smithi087.stderr:+ T=./tmp.MQgXrN9THQ 2024-04-25T15:57:36.989 INFO:tasks.workunit.client.0.smithi087.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.MQgXrN9THQ -l 1 -n 1000 -p 10 -v 2024-04-25T15:57:36.991 INFO:tasks.workunit.client.1.smithi155.stdout:3/375: fdatasync d1/d4/d10/f43 0 2024-04-25T15:57:36.991 INFO:tasks.workunit.client.1.smithi155.stdout:7/346: truncate d2/dd/d12/f20 4806116 0 2024-04-25T15:57:36.992 INFO:tasks.workunit.client.1.smithi155.stdout:0/317: link d1/d3/d5/f32 d1/d6/d29/f74 0 2024-04-25T15:57:36.993 INFO:tasks.workunit.client.1.smithi155.stdout:4/312: truncate da/d23/f6c 183922 0 2024-04-25T15:57:36.994 INFO:tasks.workunit.client.1.smithi155.stdout:1/323: fdatasync d1/d16/d1d/d29/d5f/f49 0 2024-04-25T15:57:36.994 INFO:tasks.workunit.client.0.smithi087.stdout:seed = 1713720391 2024-04-25T15:57:36.996 INFO:tasks.workunit.client.1.smithi155.stdout:1/324: truncate d1/f11 5189527 0 2024-04-25T15:57:36.997 INFO:tasks.workunit.client.1.smithi155.stdout:3/376: write d1/f16 [2152857,63603] 0 2024-04-25T15:57:36.997 INFO:tasks.workunit.client.1.smithi155.stdout:6/457: truncate d0/d1a/d21/f47 2138957 0 2024-04-25T15:57:36.998 INFO:tasks.workunit.client.1.smithi155.stdout:5/372: mknod d0/d3/d15/d1f/d50/d60/c73 0 2024-04-25T15:57:36.999 INFO:tasks.workunit.client.1.smithi155.stdout:9/293: dwrite dc/d13/f3a [0,4194304] 0 2024-04-25T15:57:36.999 INFO:tasks.workunit.client.1.smithi155.stdout:6/458: chown d0/d1a/d25/d2e 52713918 1 2024-04-25T15:57:37.003 INFO:tasks.workunit.client.0.smithi087.stdout:2/0: link - no file 2024-04-25T15:57:37.003 INFO:tasks.workunit.client.0.smithi087.stdout:2/1: dwrite - no filename 2024-04-25T15:57:37.003 INFO:tasks.workunit.client.0.smithi087.stdout:2/2: dwrite - no filename 2024-04-25T15:57:37.003 INFO:tasks.workunit.client.0.smithi087.stdout:2/3: write - no filename 2024-04-25T15:57:37.003 INFO:tasks.workunit.client.0.smithi087.stdout:2/4: dwrite - no filename 2024-04-25T15:57:37.004 INFO:tasks.workunit.client.0.smithi087.stdout:0/0: symlink l0 0 2024-04-25T15:57:37.011 INFO:tasks.workunit.client.1.smithi155.stdout:4/313: rename da/d30/l32 to da/dc/l70 0 2024-04-25T15:57:37.011 INFO:tasks.workunit.client.1.smithi155.stdout:5/373: dwrite d0/d3/d15/f72 [0,4194304] 0 2024-04-25T15:57:37.011 INFO:tasks.workunit.client.1.smithi155.stdout:1/325: rmdir d1/d16/d1d/d29/d5f 39 2024-04-25T15:57:37.011 INFO:tasks.workunit.client.1.smithi155.stdout:1/326: readlink d1/d16/d1d/l60 0 2024-04-25T15:57:37.011 INFO:tasks.workunit.client.1.smithi155.stdout:5/374: read - d0/d3/d15/d1f/f70 zero size 2024-04-25T15:57:37.013 INFO:tasks.workunit.client.1.smithi155.stdout:1/327: dread - d1/d16/f54 zero size 2024-04-25T15:57:37.013 INFO:tasks.workunit.client.1.smithi155.stdout:7/347: creat d2/dd/d63/f77 x:0 0 0 2024-04-25T15:57:37.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/1: mkdir d1 0 2024-04-25T15:57:37.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/2: read - no filename 2024-04-25T15:57:37.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/5: creat f0 x:0 0 0 2024-04-25T15:57:37.014 INFO:tasks.workunit.client.0.smithi087.stdout:1/0: chown . 53441 1 2024-04-25T15:57:37.014 INFO:tasks.workunit.client.0.smithi087.stdout:1/1: dread - no filename 2024-04-25T15:57:37.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/6: creat f1 x:0 0 0 2024-04-25T15:57:37.014 INFO:tasks.workunit.client.0.smithi087.stdout:0/3: creat d1/f2 x:0 0 0 2024-04-25T15:57:37.015 INFO:tasks.workunit.client.1.smithi155.stdout:1/328: stat d1/d6/c67 0 2024-04-25T15:57:37.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/2: creat f0 x:0 0 0 2024-04-25T15:57:37.017 INFO:tasks.workunit.client.0.smithi087.stdout:2/7: creat f2 x:0 0 0 2024-04-25T15:57:37.018 INFO:tasks.workunit.client.0.smithi087.stdout:0/4: creat d1/f3 x:0 0 0 2024-04-25T15:57:37.019 INFO:tasks.workunit.client.1.smithi155.stdout:3/377: dwrite d1/f1f [4194304,4194304] 0 2024-04-25T15:57:37.023 INFO:tasks.workunit.client.0.smithi087.stdout:5/0: rename - no filename 2024-04-25T15:57:37.023 INFO:tasks.workunit.client.0.smithi087.stdout:5/1: readlink - no filename 2024-04-25T15:57:37.023 INFO:tasks.workunit.client.1.smithi155.stdout:5/375: dwrite d0/d27/f43 [0,4194304] 0 2024-04-25T15:57:37.024 INFO:tasks.workunit.client.1.smithi155.stdout:3/378: chown d1/d4/db/f75 24 1 2024-04-25T15:57:37.025 INFO:tasks.workunit.client.0.smithi087.stdout:2/8: mkdir d3 0 2024-04-25T15:57:37.026 INFO:tasks.workunit.client.1.smithi155.stdout:3/379: chown d1/d4/d10/d21/d73/d77 12176 1 2024-04-25T15:57:37.026 INFO:tasks.workunit.client.1.smithi155.stdout:7/348: dwrite d2/d26/d3d/d65/f72 [0,4194304] 0 2024-04-25T15:57:37.028 INFO:tasks.workunit.client.0.smithi087.stdout:0/5: symlink d1/l4 0 2024-04-25T15:57:37.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/0: creat f0 x:0 0 0 2024-04-25T15:57:37.031 INFO:tasks.workunit.client.0.smithi087.stdout:0/6: truncate d1/f2 243503 0 2024-04-25T15:57:37.032 INFO:tasks.workunit.client.1.smithi155.stdout:3/380: dread - d1/d4/db/d28/f5b zero size 2024-04-25T15:57:37.033 INFO:tasks.workunit.client.1.smithi155.stdout:1/329: symlink d1/d16/d1d/l6e 0 2024-04-25T15:57:37.033 INFO:tasks.workunit.client.0.smithi087.stdout:8/0: write - no filename 2024-04-25T15:57:37.034 INFO:tasks.workunit.client.1.smithi155.stdout:9/294: dread f7 [0,4194304] 0 2024-04-25T15:57:37.035 INFO:tasks.workunit.client.0.smithi087.stdout:6/1: symlink l1 0 2024-04-25T15:57:37.035 INFO:tasks.workunit.client.0.smithi087.stdout:1/3: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.036 INFO:tasks.workunit.client.0.smithi087.stdout:5/2: creat f0 x:0 0 0 2024-04-25T15:57:37.036 INFO:tasks.workunit.client.1.smithi155.stdout:1/330: fsync d1/d16/d1d/d29/f55 0 2024-04-25T15:57:37.037 INFO:tasks.workunit.client.0.smithi087.stdout:0/7: write d1/f3 [638945,59931] 0 2024-04-25T15:57:37.038 INFO:tasks.workunit.client.1.smithi155.stdout:0/318: creat d1/d6/f75 x:0 0 0 2024-04-25T15:57:37.038 INFO:tasks.workunit.client.1.smithi155.stdout:5/376: dwrite d0/d3/d15/d1f/d50/d60/f65 [0,4194304] 0 2024-04-25T15:57:37.039 INFO:tasks.workunit.client.0.smithi087.stdout:2/9: mkdir d3/d4 0 2024-04-25T15:57:37.039 INFO:tasks.workunit.client.0.smithi087.stdout:0/8: chown d1 0 1 2024-04-25T15:57:37.039 INFO:tasks.workunit.client.1.smithi155.stdout:4/314: link da/d23/d2a/f39 da/d23/d3f/f71 0 2024-04-25T15:57:37.041 INFO:tasks.workunit.client.1.smithi155.stdout:4/315: read da/dc/ff [329748,24248] 0 2024-04-25T15:57:37.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/9: write d1/f3 [154657,79978] 0 2024-04-25T15:57:37.041 INFO:tasks.workunit.client.0.smithi087.stdout:9/0: dread - no filename 2024-04-25T15:57:37.041 INFO:tasks.workunit.client.0.smithi087.stdout:9/1: rename - no filename 2024-04-25T15:57:37.041 INFO:tasks.workunit.client.1.smithi155.stdout:9/295: rmdir dc/d11/d30 39 2024-04-25T15:57:37.042 INFO:tasks.workunit.client.1.smithi155.stdout:9/296: truncate dc/d17/f51 247476 0 2024-04-25T15:57:37.042 INFO:tasks.workunit.client.0.smithi087.stdout:0/10: dread d1/f2 [0,4194304] 0 2024-04-25T15:57:37.043 INFO:tasks.workunit.client.1.smithi155.stdout:9/297: truncate dc/d11/f64 869165 0 2024-04-25T15:57:37.045 INFO:tasks.workunit.client.0.smithi087.stdout:1/4: creat f1 x:0 0 0 2024-04-25T15:57:37.045 INFO:tasks.workunit.client.1.smithi155.stdout:0/319: symlink d1/d3/d5/da/l76 0 2024-04-25T15:57:37.046 INFO:tasks.workunit.client.0.smithi087.stdout:6/2: rename l1 to l2 0 2024-04-25T15:57:37.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/320: chown d1/d41/f44 42790921 1 2024-04-25T15:57:37.047 INFO:tasks.workunit.client.1.smithi155.stdout:7/349: link d2/f11 d2/dd/d12/f78 0 2024-04-25T15:57:37.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/5: chown f1 27963 1 2024-04-25T15:57:37.050 INFO:tasks.workunit.client.1.smithi155.stdout:5/377: symlink d0/d3/d15/l74 0 2024-04-25T15:57:37.051 INFO:tasks.workunit.client.1.smithi155.stdout:0/321: symlink d1/d3/d5/da/l77 0 2024-04-25T15:57:37.053 INFO:tasks.workunit.client.0.smithi087.stdout:8/1: creat f0 x:0 0 0 2024-04-25T15:57:37.053 INFO:tasks.workunit.client.0.smithi087.stdout:8/2: rmdir - no directory 2024-04-25T15:57:37.054 INFO:tasks.workunit.client.0.smithi087.stdout:8/3: dread - f0 zero size 2024-04-25T15:57:37.054 INFO:tasks.workunit.client.1.smithi155.stdout:5/378: symlink d0/d3/d2c/l75 0 2024-04-25T15:57:37.054 INFO:tasks.workunit.client.1.smithi155.stdout:3/381: getdents d1/d4/db/d20/d44/d52 0 2024-04-25T15:57:37.056 INFO:tasks.workunit.client.1.smithi155.stdout:9/298: dwrite dc/d11/f42 [0,4194304] 0 2024-04-25T15:57:37.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/382: truncate d1/d4/f18 9211966 0 2024-04-25T15:57:37.057 INFO:tasks.workunit.client.1.smithi155.stdout:9/299: write dc/d13/f26 [43612,98112] 0 2024-04-25T15:57:37.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/3: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.060 INFO:tasks.workunit.client.1.smithi155.stdout:4/316: dread da/dc/d18/f46 [0,4194304] 0 2024-04-25T15:57:37.060 INFO:tasks.workunit.client.1.smithi155.stdout:0/322: link d1/f3c d1/d3/d3d/d46/f78 0 2024-04-25T15:57:37.061 INFO:tasks.workunit.client.1.smithi155.stdout:4/317: write da/d23/d3f/d56/d69/f5e [121890,128861] 0 2024-04-25T15:57:37.062 INFO:tasks.workunit.client.0.smithi087.stdout:5/4: chown f0 88 1 2024-04-25T15:57:37.063 INFO:tasks.workunit.client.1.smithi155.stdout:5/379: symlink d0/d3/l76 0 2024-04-25T15:57:37.065 INFO:tasks.workunit.client.1.smithi155.stdout:0/323: rename d1/c4a to d1/d6/d29/c79 0 2024-04-25T15:57:37.066 INFO:tasks.workunit.client.1.smithi155.stdout:3/383: link d1/f26 d1/d4/d10/d2a/f79 0 2024-04-25T15:57:37.067 INFO:tasks.workunit.client.1.smithi155.stdout:8/213: sync 2024-04-25T15:57:37.068 INFO:tasks.workunit.client.1.smithi155.stdout:5/380: mknod d0/d3/c77 0 2024-04-25T15:57:37.069 INFO:tasks.workunit.client.0.smithi087.stdout:8/4: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.069 INFO:tasks.workunit.client.1.smithi155.stdout:4/318: rename da/lb to da/d23/d3f/l72 0 2024-04-25T15:57:37.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/3: mknod c3 0 2024-04-25T15:57:37.071 INFO:tasks.workunit.client.1.smithi155.stdout:3/384: mknod d1/d4/d10/d2a/d6c/c7a 0 2024-04-25T15:57:37.071 INFO:tasks.workunit.client.0.smithi087.stdout:6/4: dread - f0 zero size 2024-04-25T15:57:37.073 INFO:tasks.workunit.client.1.smithi155.stdout:5/381: stat d0/d3/d15/d30/c3f 0 2024-04-25T15:57:37.073 INFO:tasks.workunit.client.1.smithi155.stdout:3/385: rmdir d1/d4/d10/d2a/d6c 39 2024-04-25T15:57:37.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/6: rename f1 to f2 0 2024-04-25T15:57:37.075 INFO:tasks.workunit.client.1.smithi155.stdout:5/382: rmdir d0/d47 39 2024-04-25T15:57:37.075 INFO:tasks.workunit.client.0.smithi087.stdout:3/0: write - no filename 2024-04-25T15:57:37.077 INFO:tasks.workunit.client.1.smithi155.stdout:9/300: dwrite dc/d17/d18/f41 [0,4194304] 0 2024-04-25T15:57:37.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.071+0000 7fd7bc1c2640 1 Processor -- start 2024-04-25T15:57:37.080 INFO:tasks.workunit.client.0.smithi087.stdout:9/2: creat f0 x:0 0 0 2024-04-25T15:57:37.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.071+0000 7fd7bc1c2640 1 -- start start 2024-04-25T15:57:37.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7bc1c2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b4157420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.082 INFO:tasks.workunit.client.0.smithi087.stdout:0/11: link d1/f2 d1/f5 0 2024-04-25T15:57:37.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7bc1c2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7b406fee0 0x7fd7b40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7bc1c2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b4157960 con 0x7fd7b41539b0 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7bc1c2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40ab760 con 0x7fd7b406fee0 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7bc1c2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40aba40 con 0x7fd7b4150bd0 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7b975d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7b406fee0 0x7fd7b40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7b975d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7b406fee0 0x7fd7b40702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:52258/0 (socket says 172.21.15.87:52258) 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7b975d640 1 -- 172.21.15.87:0/2214162777 learned_addr learned my addr 172.21.15.87:0/2214162777 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7b975d640 1 -- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 msgr2=0x7fd7b4157420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7b975d640 1 --2- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b4157420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.075+0000 7fd7b975d640 1 -- 172.21.15.87:0/2214162777 >> v1:172.21.15.155:6789/0 conn(0x7fd7b41539b0 legacy=0x7fd7b4153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.079+0000 7fd7b975d640 1 -- 172.21.15.87:0/2214162777 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40abd20 con 0x7fd7b406fee0 2024-04-25T15:57:37.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/5: rename f0 to f1 0 2024-04-25T15:57:37.084 INFO:tasks.workunit.client.1.smithi155.stdout:5/383: mkdir d0/d58/d32/d6a/d78 0 2024-04-25T15:57:37.085 INFO:tasks.workunit.client.1.smithi155.stdout:9/301: chown dc/d17/d2a/l6e 498638 1 2024-04-25T15:57:37.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.079+0000 7fd7b975d640 1 --2- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b406fee0 0x7fd7b40702f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009870 tx=0x7fd7a401e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d94b39c14e5025d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:37.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7b8f5c640 1 -- 172.21.15.87:0/2214162777 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40ac5f0 con 0x7fd7b406fee0 2024-04-25T15:57:37.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7b8f5c640 1 -- 172.21.15.87:0/2214162777 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a40b1070 con 0x7fd7b406fee0 2024-04-25T15:57:37.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7b8f5c640 1 -- 172.21.15.87:0/2214162777 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40ac9b0 con 0x7fd7b406fee0 2024-04-25T15:57:37.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/5: creat f4 x:0 0 0 2024-04-25T15:57:37.088 INFO:tasks.workunit.client.1.smithi155.stdout:9/302: fdatasync dc/d17/f2b 0 2024-04-25T15:57:37.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b406fee0 msgr2=0x7fd7b40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b406fee0 0x7fd7b40702f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009870 tx=0x7fd7a401e680 comp rx=0 tx=0).stop 2024-04-25T15:57:37.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/2214162777 shutdown_connections 2024-04-25T15:57:37.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b406fee0 0x7fd7b40702f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/2214162777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b4157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.090 INFO:tasks.workunit.client.0.smithi087.stdout:1/7: mkdir d3 0 2024-04-25T15:57:37.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.083+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/2214162777 >> 172.21.15.87:0/2214162777 conn(0x7fd7b40c8ba0 msgr2=0x7fd7b40c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:37.090 INFO:tasks.workunit.client.0.smithi087.stdout:7/0: getdents . 0 2024-04-25T15:57:37.090 INFO:tasks.workunit.client.0.smithi087.stdout:8/6: dread f1 [0,4194304] 0 2024-04-25T15:57:37.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.087+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/2214162777 shutdown_connections 2024-04-25T15:57:37.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.087+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/2214162777 wait complete. 2024-04-25T15:57:37.091 INFO:tasks.workunit.client.1.smithi155.stdout:9/303: readlink dc/l10 0 2024-04-25T15:57:37.091 INFO:tasks.workunit.client.1.smithi155.stdout:4/319: dwrite da/f4d [0,4194304] 0 2024-04-25T15:57:37.092 INFO:tasks.workunit.client.1.smithi155.stdout:9/304: readlink dc/l10 0 2024-04-25T15:57:37.092 INFO:tasks.workunit.client.1.smithi155.stdout:5/384: creat d0/d58/d32/f79 x:0 0 0 2024-04-25T15:57:37.092 INFO:tasks.workunit.client.1.smithi155.stdout:4/320: chown da/d23/d3f/d56/d69 327961 1 2024-04-25T15:57:37.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/3: creat f1 x:0 0 0 2024-04-25T15:57:37.092 INFO:tasks.workunit.client.1.smithi155.stdout:1/331: write d1/d16/f1f [1198093,119976] 0 2024-04-25T15:57:37.093 INFO:tasks.workunit.client.0.smithi087.stdout:9/4: truncate f1 1021449 0 2024-04-25T15:57:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.091+0000 7fd7bc1c2640 1 Processor -- start 2024-04-25T15:57:37.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.091+0000 7fd7bc1c2640 1 -- start start 2024-04-25T15:57:37.094 INFO:tasks.workunit.client.1.smithi155.stdout:3/386: link d1/d4/d10/d2a/d6c/c70 d1/d4/d10/d2a/d6c/c7b 0 2024-04-25T15:57:37.094 INFO:tasks.workunit.client.0.smithi087.stdout:9/5: write f0 [234358,9017] 0 2024-04-25T15:57:37.096 INFO:tasks.workunit.client.1.smithi155.stdout:0/324: dread d1/d41/f44 [0,4194304] 0 2024-04-25T15:57:37.097 INFO:tasks.workunit.client.1.smithi155.stdout:5/385: symlink d0/d27/l7a 0 2024-04-25T15:57:37.097 INFO:tasks.workunit.client.1.smithi155.stdout:7/350: truncate d2/fa 71875 0 2024-04-25T15:57:37.097 INFO:tasks.workunit.client.1.smithi155.stdout:4/321: rmdir da/d23/d3f/d56 39 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7bc1c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 0x7fd7b41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7bc1c2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b40c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7bc1c2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b41539b0 0x7fd7b41efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7bc1c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4160740 con 0x7fd7b406fee0 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7bc1c2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41605c0 con 0x7fd7b41539b0 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7bc1c2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b41608c0 con 0x7fd7b4150bd0 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 0x7fd7b41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 0x7fd7b41547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36280/0 (socket says 172.21.15.87:36280) 2024-04-25T15:57:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 -- 172.21.15.87:0/4286643353 learned_addr learned my addr 172.21.15.87:0/4286643353 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:37.100 INFO:tasks.workunit.client.1.smithi155.stdout:0/325: read d1/d1a/f34 [4277005,48610] 0 2024-04-25T15:57:37.100 INFO:tasks.workunit.client.1.smithi155.stdout:1/332: fdatasync d1/d16/d1d/d29/d5f/d34/f47 0 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b975d640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b40c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 -- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 msgr2=0x7fd7b40c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b40c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7ba75f640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b41539b0 0x7fd7b41efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 -- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b41539b0 msgr2=0x7fd7b41efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b41539b0 0x7fd7b41efbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 -- 172.21.15.87:0/4286643353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40c8120 con 0x7fd7b406fee0 2024-04-25T15:57:37.102 INFO:tasks.workunit.client.1.smithi155.stdout:3/387: mkdir d1/d4/d10/d21/d73/d77/d57/d7c 0 2024-04-25T15:57:37.102 INFO:tasks.workunit.client.1.smithi155.stdout:9/305: dread dc/d17/f20 [0,4194304] 0 2024-04-25T15:57:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.095+0000 7fd7b9f5e640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 0x7fd7b41547b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000b410 tx=0x7fd7b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.099+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0015020 con 0x7fd7b406fee0 2024-04-25T15:57:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.099+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b0011850 con 0x7fd7b406fee0 2024-04-25T15:57:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.099+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0011c40 con 0x7fd7b406fee0 2024-04-25T15:57:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.099+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b40c68d0 con 0x7fd7b406fee0 2024-04-25T15:57:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.099+0000 7fd7b975d640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b40c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:57:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.099+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b4149b20 con 0x7fd7b406fee0 2024-04-25T15:57:37.104 INFO:tasks.workunit.client.1.smithi155.stdout:8/214: dread d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:37.104 INFO:tasks.workunit.client.1.smithi155.stdout:8/215: fsync d2/d5/f29 0 2024-04-25T15:57:37.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.103+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd7b0018020 con 0x7fd7b406fee0 2024-04-25T15:57:37.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.103+0000 7fd7aa7fc640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd79806f430 0x7fd798071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.103+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b4069bb0 con 0x7fd7b406fee0 2024-04-25T15:57:37.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.103+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7fd7b008f0e0 con 0x7fd7b406fee0 2024-04-25T15:57:37.107 INFO:tasks.workunit.client.1.smithi155.stdout:3/388: unlink d1/d4/d10/d2a/f45 0 2024-04-25T15:57:37.108 INFO:tasks.workunit.client.1.smithi155.stdout:9/306: mknod dc/d3c/c71 0 2024-04-25T15:57:37.108 INFO:tasks.workunit.client.1.smithi155.stdout:3/389: write d1/d4/d10/d2a/f4b [2517629,122147] 0 2024-04-25T15:57:37.109 INFO:tasks.workunit.client.1.smithi155.stdout:8/216: creat d2/d15/d35/d3d/f42 x:0 0 0 2024-04-25T15:57:37.110 INFO:tasks.workunit.client.0.smithi087.stdout:0/12: dwrite d1/f2 [0,4194304] 0 2024-04-25T15:57:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.103+0000 7fd7b975d640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd79806f430 0x7fd798071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.103+0000 7fd7b975d640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd79806f430 0x7fd798071940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40b0000 tx=0x7fd7a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:37.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/1: symlink l0 0 2024-04-25T15:57:37.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/2: dwrite - no filename 2024-04-25T15:57:37.112 INFO:tasks.workunit.client.1.smithi155.stdout:3/390: unlink d1/d4/db/f75 0 2024-04-25T15:57:37.113 INFO:tasks.workunit.client.1.smithi155.stdout:1/333: link d1/d16/d37/l5a d1/d16/d1d/d29/l6f 0 2024-04-25T15:57:37.113 INFO:tasks.workunit.client.1.smithi155.stdout:3/391: chown d1/d4/f41 0 1 2024-04-25T15:57:37.114 INFO:tasks.workunit.client.0.smithi087.stdout:9/6: creat f2 x:0 0 0 2024-04-25T15:57:37.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.111+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7b001f070 con 0x7fd7b406fee0 2024-04-25T15:57:37.114 INFO:tasks.workunit.client.1.smithi155.stdout:1/334: dread - d1/d16/d1d/d5e/f63 zero size 2024-04-25T15:57:37.114 INFO:tasks.workunit.client.1.smithi155.stdout:8/217: dread d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:37.114 INFO:tasks.workunit.client.1.smithi155.stdout:3/392: chown d1/d4/db/l1a 16191 1 2024-04-25T15:57:37.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/7: write f1 [234409,90069] 0 2024-04-25T15:57:37.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/8: readlink - no filename 2024-04-25T15:57:37.124 INFO:tasks.workunit.client.0.smithi087.stdout:1/8: creat d3/f4 x:0 0 0 2024-04-25T15:57:37.124 INFO:tasks.workunit.client.0.smithi087.stdout:1/9: dread - d3/f4 zero size 2024-04-25T15:57:37.125 INFO:tasks.workunit.client.0.smithi087.stdout:7/1: creat f0 x:0 0 0 2024-04-25T15:57:37.126 INFO:tasks.workunit.client.1.smithi155.stdout:7/351: dwrite d2/f11 [0,4194304] 0 2024-04-25T15:57:37.126 INFO:tasks.workunit.client.0.smithi087.stdout:0/13: mkdir d1/d6 0 2024-04-25T15:57:37.127 INFO:tasks.workunit.client.1.smithi155.stdout:3/393: dwrite d1/d4/d10/d21/d73/d77/d57/f71 [0,4194304] 0 2024-04-25T15:57:37.128 INFO:tasks.workunit.client.1.smithi155.stdout:7/352: readlink d2/dd/d13/l39 0 2024-04-25T15:57:37.128 INFO:tasks.workunit.client.1.smithi155.stdout:1/335: write d1/d6/f7 [136870,44449] 0 2024-04-25T15:57:37.130 INFO:tasks.workunit.client.1.smithi155.stdout:8/218: dwrite d2/d15/d18/d23/d2f/f3a [0,4194304] 0 2024-04-25T15:57:37.130 INFO:tasks.workunit.client.0.smithi087.stdout:9/9: unlink f1 0 2024-04-25T15:57:37.132 INFO:tasks.workunit.client.1.smithi155.stdout:8/219: read - d2/d15/d35/d3d/f42 zero size 2024-04-25T15:57:37.132 INFO:tasks.workunit.client.0.smithi087.stdout:1/10: rmdir d3 39 2024-04-25T15:57:37.132 INFO:tasks.workunit.client.1.smithi155.stdout:3/394: creat d1/d4/db/f7d x:0 0 0 2024-04-25T15:57:37.133 INFO:tasks.workunit.client.1.smithi155.stdout:1/336: rmdir d1/d16/d1d/d29/d5f 39 2024-04-25T15:57:37.138 INFO:tasks.workunit.client.1.smithi155.stdout:1/337: dread - d1/d16/d1d/d29/d3d/d43/f62 zero size 2024-04-25T15:57:37.141 INFO:tasks.workunit.client.0.smithi087.stdout:7/2: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.141 INFO:tasks.workunit.client.0.smithi087.stdout:9/10: creat f3 x:0 0 0 2024-04-25T15:57:37.142 INFO:tasks.workunit.client.1.smithi155.stdout:7/353: dwrite d2/dd/d13/f70 [0,4194304] 0 2024-04-25T15:57:37.144 INFO:tasks.workunit.client.1.smithi155.stdout:7/354: chown d2/d26/d3d 0 1 2024-04-25T15:57:37.144 INFO:tasks.workunit.client.1.smithi155.stdout:3/395: dread d1/d4/db/d28/f31 [0,4194304] 0 2024-04-25T15:57:37.144 INFO:tasks.workunit.client.1.smithi155.stdout:1/338: mkdir d1/d16/d37/d70 0 2024-04-25T15:57:37.145 INFO:tasks.workunit.client.1.smithi155.stdout:8/220: dwrite d2/d5/f21 [4194304,4194304] 0 2024-04-25T15:57:37.146 INFO:tasks.workunit.client.0.smithi087.stdout:0/14: creat d1/d6/f7 x:0 0 0 2024-04-25T15:57:37.149 INFO:tasks.workunit.client.1.smithi155.stdout:1/339: symlink d1/d16/l71 0 2024-04-25T15:57:37.150 INFO:tasks.workunit.client.0.smithi087.stdout:9/11: symlink l4 0 2024-04-25T15:57:37.150 INFO:tasks.workunit.client.0.smithi087.stdout:9/12: fdatasync f0 0 2024-04-25T15:57:37.152 INFO:tasks.workunit.client.1.smithi155.stdout:8/221: dread d2/f16 [0,4194304] 0 2024-04-25T15:57:37.153 INFO:tasks.workunit.client.1.smithi155.stdout:7/355: write d2/d26/f58 [832156,118606] 0 2024-04-25T15:57:37.157 INFO:tasks.workunit.client.1.smithi155.stdout:3/396: creat d1/d4/d10/d21/d73/d77/d5f/f7e x:0 0 0 2024-04-25T15:57:37.159 INFO:tasks.workunit.client.1.smithi155.stdout:1/340: mknod d1/d16/d1d/d29/d5f/d34/d68/c72 0 2024-04-25T15:57:37.160 INFO:tasks.workunit.client.0.smithi087.stdout:0/15: creat d1/d6/f8 x:0 0 0 2024-04-25T15:57:37.161 INFO:tasks.workunit.client.0.smithi087.stdout:9/13: mknod c5 0 2024-04-25T15:57:37.162 INFO:tasks.workunit.client.1.smithi155.stdout:8/222: dwrite d2/d5/f21 [4194304,4194304] 0 2024-04-25T15:57:37.162 INFO:tasks.workunit.client.0.smithi087.stdout:0/16: symlink d1/l9 0 2024-04-25T15:57:37.163 INFO:tasks.workunit.client.1.smithi155.stdout:3/397: rename d1/d4/db/d20/d44/l62 to d1/d4/d10/l7f 0 2024-04-25T15:57:37.163 INFO:tasks.workunit.client.0.smithi087.stdout:0/17: truncate d1/f3 1706106 0 2024-04-25T15:57:37.164 INFO:tasks.workunit.client.0.smithi087.stdout:0/18: chown d1 628446781 1 2024-04-25T15:57:37.165 INFO:tasks.workunit.client.0.smithi087.stdout:0/19: truncate d1/d6/f7 647396 0 2024-04-25T15:57:37.166 INFO:tasks.workunit.client.1.smithi155.stdout:1/341: rename d1/d32/l45 to d1/d16/d1d/d33/l73 0 2024-04-25T15:57:37.166 INFO:tasks.workunit.client.1.smithi155.stdout:1/342: dread - d1/d16/d1d/d29/d3d/d43/f62 zero size 2024-04-25T15:57:37.167 INFO:tasks.workunit.client.1.smithi155.stdout:8/223: creat d2/d15/d18/d34/f43 x:0 0 0 2024-04-25T15:57:37.169 INFO:tasks.workunit.client.0.smithi087.stdout:0/20: mkdir d1/da 0 2024-04-25T15:57:37.172 INFO:tasks.workunit.client.0.smithi087.stdout:0/21: mknod d1/da/cb 0 2024-04-25T15:57:37.173 INFO:tasks.workunit.client.1.smithi155.stdout:1/343: getdents d1/d16/d1d/d29/d3d 0 2024-04-25T15:57:37.174 INFO:tasks.workunit.client.1.smithi155.stdout:1/344: stat d1/d6/fc 0 2024-04-25T15:57:37.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/22: truncate d1/d6/f8 461247 0 2024-04-25T15:57:37.174 INFO:tasks.workunit.client.1.smithi155.stdout:2/381: sync 2024-04-25T15:57:37.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/23: write d1/f3 [2710312,112403] 0 2024-04-25T15:57:37.177 INFO:tasks.workunit.client.1.smithi155.stdout:2/382: write d7/d23/f40 [1045719,94564] 0 2024-04-25T15:57:37.178 INFO:tasks.workunit.client.1.smithi155.stdout:3/398: dwrite d1/d4/d10/d21/f5a [0,4194304] 0 2024-04-25T15:57:37.178 INFO:tasks.workunit.client.0.smithi087.stdout:0/24: mknod d1/d6/cc 0 2024-04-25T15:57:37.180 INFO:tasks.workunit.client.1.smithi155.stdout:1/345: unlink d1/d16/f1f 0 2024-04-25T15:57:37.180 INFO:tasks.workunit.client.0.smithi087.stdout:0/25: creat d1/da/fd x:0 0 0 2024-04-25T15:57:37.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/26: dread - d1/da/fd zero size 2024-04-25T15:57:37.182 INFO:tasks.workunit.client.1.smithi155.stdout:7/356: dread d2/dd/d13/d24/d35/f3c [0,4194304] 0 2024-04-25T15:57:37.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/27: write d1/d6/f8 [279923,95787] 0 2024-04-25T15:57:37.183 INFO:tasks.workunit.client.1.smithi155.stdout:8/224: truncate d2/d5/f17 2441922 0 2024-04-25T15:57:37.185 INFO:tasks.workunit.client.1.smithi155.stdout:3/399: mkdir d1/d4/d10/d21/d73/d77/d57/d80 0 2024-04-25T15:57:37.185 INFO:tasks.workunit.client.1.smithi155.stdout:7/357: write d2/f68 [950436,44165] 0 2024-04-25T15:57:37.186 INFO:tasks.workunit.client.1.smithi155.stdout:1/346: readlink d1/d16/d1d/d33/l73 0 2024-04-25T15:57:37.186 INFO:tasks.workunit.client.1.smithi155.stdout:3/400: stat d1/d4/db/d28/c3d 0 2024-04-25T15:57:37.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/28: creat d1/d6/fe x:0 0 0 2024-04-25T15:57:37.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/29: stat d1/d6/cc 0 2024-04-25T15:57:37.187 INFO:tasks.workunit.client.1.smithi155.stdout:8/225: creat d2/d15/d35/f44 x:0 0 0 2024-04-25T15:57:37.187 INFO:tasks.workunit.client.1.smithi155.stdout:2/383: dread d7/f2c [0,4194304] 0 2024-04-25T15:57:37.188 INFO:tasks.workunit.client.1.smithi155.stdout:1/347: fsync d1/d16/d1d/d29/d5f/f5d 0 2024-04-25T15:57:37.190 INFO:tasks.workunit.client.1.smithi155.stdout:2/384: chown d7/db/dd/d15/d60/f76 439578 1 2024-04-25T15:57:37.190 INFO:tasks.workunit.client.1.smithi155.stdout:3/401: symlink d1/d4/d10/d21/l81 0 2024-04-25T15:57:37.191 INFO:tasks.workunit.client.1.smithi155.stdout:2/385: chown d7/db/dd 29 1 2024-04-25T15:57:37.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/30: dread d1/f2 [0,4194304] 0 2024-04-25T15:57:37.193 INFO:tasks.workunit.client.1.smithi155.stdout:7/358: dread d2/d26/d3d/d65/f72 [0,4194304] 0 2024-04-25T15:57:37.194 INFO:tasks.workunit.client.1.smithi155.stdout:8/226: rmdir d2/d15/d18/d23/d2f 39 2024-04-25T15:57:37.195 INFO:tasks.workunit.client.0.smithi087.stdout:0/31: unlink d1/l9 0 2024-04-25T15:57:37.196 INFO:tasks.workunit.client.1.smithi155.stdout:2/386: dread d7/d23/f40 [0,4194304] 0 2024-04-25T15:57:37.198 INFO:tasks.workunit.client.1.smithi155.stdout:2/387: stat d7/db/d2e/d6f/f75 0 2024-04-25T15:57:37.198 INFO:tasks.workunit.client.1.smithi155.stdout:1/348: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:57:37.201 INFO:tasks.workunit.client.1.smithi155.stdout:7/359: write d2/d26/d3d/d65/f72 [4927977,75341] 0 2024-04-25T15:57:37.208 INFO:tasks.workunit.client.1.smithi155.stdout:2/388: unlink d7/db/dd/f2a 0 2024-04-25T15:57:37.208 INFO:tasks.workunit.client.1.smithi155.stdout:1/349: dread d1/fb [0,4194304] 0 2024-04-25T15:57:37.209 INFO:tasks.workunit.client.1.smithi155.stdout:7/360: dwrite d2/f1d [0,4194304] 0 2024-04-25T15:57:37.212 INFO:tasks.workunit.client.1.smithi155.stdout:8/227: mknod d2/d41/c45 0 2024-04-25T15:57:37.212 INFO:tasks.workunit.client.1.smithi155.stdout:2/389: write d7/db/d29/f3e [84717,46576] 0 2024-04-25T15:57:37.213 INFO:tasks.workunit.client.1.smithi155.stdout:8/228: readlink d2/l13 0 2024-04-25T15:57:37.213 INFO:tasks.workunit.client.1.smithi155.stdout:2/390: fsync d7/f2b 0 2024-04-25T15:57:37.214 INFO:tasks.workunit.client.1.smithi155.stdout:8/229: write d2/d15/d35/f44 [7459,126815] 0 2024-04-25T15:57:37.218 INFO:tasks.workunit.client.1.smithi155.stdout:1/350: write d1/d6/fc [1526672,92582] 0 2024-04-25T15:57:37.218 INFO:tasks.workunit.client.1.smithi155.stdout:7/361: write d2/dd/d13/d1c/f60 [508369,120076] 0 2024-04-25T15:57:37.218 INFO:tasks.workunit.client.1.smithi155.stdout:8/230: chown d2/d15/d18/c26 241470 1 2024-04-25T15:57:37.219 INFO:tasks.workunit.client.1.smithi155.stdout:7/362: fsync d2/dd/f2f 0 2024-04-25T15:57:37.220 INFO:tasks.workunit.client.1.smithi155.stdout:1/351: chown d1/d6/f2d 0 1 2024-04-25T15:57:37.222 INFO:tasks.workunit.client.1.smithi155.stdout:3/402: dread d1/d4/db/d20/f3b [0,4194304] 0 2024-04-25T15:57:37.222 INFO:tasks.workunit.client.1.smithi155.stdout:7/363: read d2/dd/f2f [3741587,79085] 0 2024-04-25T15:57:37.223 INFO:tasks.workunit.client.1.smithi155.stdout:8/231: rename d2/d15/d18/f1a to d2/d15/d35/d3d/f46 0 2024-04-25T15:57:37.224 INFO:tasks.workunit.client.1.smithi155.stdout:1/352: creat d1/d16/d37/f74 x:0 0 0 2024-04-25T15:57:37.227 INFO:tasks.workunit.client.1.smithi155.stdout:8/232: rmdir d2/d15/d18/d34 39 2024-04-25T15:57:37.227 INFO:tasks.workunit.client.1.smithi155.stdout:3/403: unlink d1/d4/d10/d2a/f4b 0 2024-04-25T15:57:37.230 INFO:tasks.workunit.client.0.smithi087.stdout:2/10: fsync f0 0 2024-04-25T15:57:37.230 INFO:tasks.workunit.client.0.smithi087.stdout:2/11: stat f1 0 2024-04-25T15:57:37.230 INFO:tasks.workunit.client.0.smithi087.stdout:2/12: readlink - no filename 2024-04-25T15:57:37.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/13: rename d3/d4 to d3/d4/d5 22 2024-04-25T15:57:37.237 INFO:tasks.workunit.client.0.smithi087.stdout:2/14: getdents d3 0 2024-04-25T15:57:37.237 INFO:tasks.workunit.client.1.smithi155.stdout:1/353: dwrite d1/d16/d1d/d33/f64 [0,4194304] 0 2024-04-25T15:57:37.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/15: dread - f1 zero size 2024-04-25T15:57:37.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/16: write f2 [76871,80754] 0 2024-04-25T15:57:37.239 INFO:tasks.workunit.client.0.smithi087.stdout:6/6: readlink l2 0 2024-04-25T15:57:37.240 INFO:tasks.workunit.client.1.smithi155.stdout:1/354: chown d1/d32/c40 58397774 1 2024-04-25T15:57:37.241 INFO:tasks.workunit.client.1.smithi155.stdout:2/391: dread d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:37.242 INFO:tasks.workunit.client.0.smithi087.stdout:6/7: creat f5 x:0 0 0 2024-04-25T15:57:37.242 INFO:tasks.workunit.client.1.smithi155.stdout:3/404: dwrite d1/d4/d25/f76 [0,4194304] 0 2024-04-25T15:57:37.242 INFO:tasks.workunit.client.0.smithi087.stdout:6/8: truncate f0 109558 0 2024-04-25T15:57:37.243 INFO:tasks.workunit.client.1.smithi155.stdout:2/392: stat d7/db/f4a 0 2024-04-25T15:57:37.244 INFO:tasks.workunit.client.1.smithi155.stdout:3/405: chown d1/d4/f72 1482239 1 2024-04-25T15:57:37.245 INFO:tasks.workunit.client.1.smithi155.stdout:1/355: dread d1/f15 [0,4194304] 0 2024-04-25T15:57:37.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/9: unlink f4 0 2024-04-25T15:57:37.248 INFO:tasks.workunit.client.1.smithi155.stdout:8/233: dread d2/f11 [0,4194304] 0 2024-04-25T15:57:37.248 INFO:tasks.workunit.client.0.smithi087.stdout:2/17: rmdir d3/d4 0 2024-04-25T15:57:37.249 INFO:tasks.workunit.client.1.smithi155.stdout:3/406: creat d1/d4/d10/d21/d73/f82 x:0 0 0 2024-04-25T15:57:37.249 INFO:tasks.workunit.client.1.smithi155.stdout:7/364: dread d2/dd/d13/d1c/f1e [0,4194304] 0 2024-04-25T15:57:37.250 INFO:tasks.workunit.client.0.smithi087.stdout:2/18: write f2 [121174,65107] 0 2024-04-25T15:57:37.254 INFO:tasks.workunit.client.1.smithi155.stdout:2/393: dwrite d7/db/d29/f3c [0,4194304] 0 2024-04-25T15:57:37.258 INFO:tasks.workunit.client.1.smithi155.stdout:3/407: unlink d1/d4/d10/l7f 0 2024-04-25T15:57:37.260 INFO:tasks.workunit.client.1.smithi155.stdout:1/356: link d1/d32/c40 d1/d16/d1d/d33/c75 0 2024-04-25T15:57:37.262 INFO:tasks.workunit.client.0.smithi087.stdout:5/5: dwrite f0 [4194304,4194304] 0 2024-04-25T15:57:37.263 INFO:tasks.workunit.client.1.smithi155.stdout:1/357: write d1/d16/d1d/d29/d5f/d34/f36 [4911472,109187] 0 2024-04-25T15:57:37.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/408: read d1/f16 [853793,20145] 0 2024-04-25T15:57:37.263 INFO:tasks.workunit.client.0.smithi087.stdout:3/3: getdents . 0 2024-04-25T15:57:37.264 INFO:tasks.workunit.client.1.smithi155.stdout:8/234: link d2/fa d2/d15/d18/d23/d3c/f47 0 2024-04-25T15:57:37.266 INFO:tasks.workunit.client.0.smithi087.stdout:1/11: rename f0 to d3/f5 0 2024-04-25T15:57:37.269 INFO:tasks.workunit.client.1.smithi155.stdout:6/459: sync 2024-04-25T15:57:37.269 INFO:tasks.workunit.client.0.smithi087.stdout:5/6: creat f1 x:0 0 0 2024-04-25T15:57:37.270 INFO:tasks.workunit.client.0.smithi087.stdout:3/4: mknod c1 0 2024-04-25T15:57:37.271 INFO:tasks.workunit.client.1.smithi155.stdout:3/409: rename d1/d4/f72 to d1/d4/d10/d21/d73/d77/d57/d7c/f83 0 2024-04-25T15:57:37.273 INFO:tasks.workunit.client.1.smithi155.stdout:2/394: creat d7/f77 x:0 0 0 2024-04-25T15:57:37.273 INFO:tasks.workunit.client.1.smithi155.stdout:7/365: dwrite d2/f5b [0,4194304] 0 2024-04-25T15:57:37.275 INFO:tasks.workunit.client.1.smithi155.stdout:1/358: symlink d1/d16/d1d/d29/l76 0 2024-04-25T15:57:37.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/7: creat f2 x:0 0 0 2024-04-25T15:57:37.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/8: rmdir - no directory 2024-04-25T15:57:37.275 INFO:tasks.workunit.client.1.smithi155.stdout:7/366: chown d2/d26/d3d/d6d/f5d 557922 1 2024-04-25T15:57:37.277 INFO:tasks.workunit.client.1.smithi155.stdout:6/460: rmdir d0/d13/d43/d56 39 2024-04-25T15:57:37.278 INFO:tasks.workunit.client.1.smithi155.stdout:3/410: creat d1/d4/d10/d21/d73/d77/d5f/f84 x:0 0 0 2024-04-25T15:57:37.278 INFO:tasks.workunit.client.0.smithi087.stdout:3/5: symlink l2 0 2024-04-25T15:57:37.279 INFO:tasks.workunit.client.0.smithi087.stdout:3/6: dwrite - no filename 2024-04-25T15:57:37.279 INFO:tasks.workunit.client.0.smithi087.stdout:3/7: truncate - no filename 2024-04-25T15:57:37.279 INFO:tasks.workunit.client.1.smithi155.stdout:3/411: read - d1/d4/d25/f38 zero size 2024-04-25T15:57:37.279 INFO:tasks.workunit.client.1.smithi155.stdout:3/412: fdatasync d1/d4/f2c 0 2024-04-25T15:57:37.280 INFO:tasks.workunit.client.1.smithi155.stdout:1/359: mkdir d1/d32/d77 0 2024-04-25T15:57:37.282 INFO:tasks.workunit.client.1.smithi155.stdout:7/367: creat d2/d26/d3d/d6d/f79 x:0 0 0 2024-04-25T15:57:37.282 INFO:tasks.workunit.client.0.smithi087.stdout:5/9: creat f3 x:0 0 0 2024-04-25T15:57:37.283 INFO:tasks.workunit.client.0.smithi087.stdout:7/3: write f0 [4943951,98701] 0 2024-04-25T15:57:37.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/32: fsync d1/d6/f7 0 2024-04-25T15:57:37.283 INFO:tasks.workunit.client.1.smithi155.stdout:6/461: symlink d0/d18/d63/l9a 0 2024-04-25T15:57:37.284 INFO:tasks.workunit.client.1.smithi155.stdout:6/462: fsync d0/d1a/d25/f2d 0 2024-04-25T15:57:37.285 INFO:tasks.workunit.client.0.smithi087.stdout:3/8: mknod c3 0 2024-04-25T15:57:37.285 INFO:tasks.workunit.client.1.smithi155.stdout:8/235: getdents d2/d15/d35 0 2024-04-25T15:57:37.287 INFO:tasks.workunit.client.0.smithi087.stdout:3/9: chown c1 11 1 2024-04-25T15:57:37.287 INFO:tasks.workunit.client.0.smithi087.stdout:9/14: getdents . 0 2024-04-25T15:57:37.288 INFO:tasks.workunit.client.0.smithi087.stdout:7/4: chown f0 5 1 2024-04-25T15:57:37.289 INFO:tasks.workunit.client.0.smithi087.stdout:9/15: dread - f2 zero size 2024-04-25T15:57:37.289 INFO:tasks.workunit.client.0.smithi087.stdout:0/33: dread d1/d6/f8 [0,4194304] 0 2024-04-25T15:57:37.289 INFO:tasks.workunit.client.1.smithi155.stdout:1/360: rmdir d1/d16/d1d/d29/d5f/d34/d68 39 2024-04-25T15:57:37.292 INFO:tasks.workunit.client.1.smithi155.stdout:6/463: unlink d0/d18/l1d 0 2024-04-25T15:57:37.293 INFO:tasks.workunit.client.0.smithi087.stdout:7/5: mkdir d1 0 2024-04-25T15:57:37.294 INFO:tasks.workunit.client.0.smithi087.stdout:7/6: readlink - no filename 2024-04-25T15:57:37.294 INFO:tasks.workunit.client.1.smithi155.stdout:2/395: link d7/db/d2e/d44/f4b d7/db/f78 0 2024-04-25T15:57:37.295 INFO:tasks.workunit.client.1.smithi155.stdout:3/413: symlink d1/d4/db/l85 0 2024-04-25T15:57:37.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/10: mkdir d4 0 2024-04-25T15:57:37.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/11: dread - no filename 2024-04-25T15:57:37.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/12: dwrite - no filename 2024-04-25T15:57:37.296 INFO:tasks.workunit.client.0.smithi087.stdout:9/16: mkdir d6 0 2024-04-25T15:57:37.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/10: dwrite f2 [0,4194304] 0 2024-04-25T15:57:37.297 INFO:tasks.workunit.client.0.smithi087.stdout:9/17: truncate f2 260205 0 2024-04-25T15:57:37.298 INFO:tasks.workunit.client.0.smithi087.stdout:3/13: chown l0 7010 1 2024-04-25T15:57:37.298 INFO:tasks.workunit.client.0.smithi087.stdout:3/14: write - no filename 2024-04-25T15:57:37.298 INFO:tasks.workunit.client.1.smithi155.stdout:8/236: mkdir d2/d15/d18/d34/d48 0 2024-04-25T15:57:37.298 INFO:tasks.workunit.client.1.smithi155.stdout:3/414: chown d1/d4/db/d28/f5b 3346 1 2024-04-25T15:57:37.298 INFO:tasks.workunit.client.1.smithi155.stdout:7/368: dwrite d2/dd/d36/f73 [0,4194304] 0 2024-04-25T15:57:37.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/18: rename d6 to d6/d7 22 2024-04-25T15:57:37.299 INFO:tasks.workunit.client.0.smithi087.stdout:5/11: chown f2 1152087 1 2024-04-25T15:57:37.299 INFO:tasks.workunit.client.1.smithi155.stdout:6/464: dread d0/d18/f23 [0,4194304] 0 2024-04-25T15:57:37.300 INFO:tasks.workunit.client.1.smithi155.stdout:8/237: chown d2/f33 3812 1 2024-04-25T15:57:37.300 INFO:tasks.workunit.client.1.smithi155.stdout:1/361: symlink d1/d16/d1d/d29/d5f/d34/d68/l78 0 2024-04-25T15:57:37.301 INFO:tasks.workunit.client.1.smithi155.stdout:3/415: stat d1/d4/d10/d21/d73/d77/d57/c5c 0 2024-04-25T15:57:37.301 INFO:tasks.workunit.client.0.smithi087.stdout:6/10: fsync f5 0 2024-04-25T15:57:37.301 INFO:tasks.workunit.client.0.smithi087.stdout:5/12: chown f0 45914591 1 2024-04-25T15:57:37.301 INFO:tasks.workunit.client.0.smithi087.stdout:0/34: mkdir d1/df 0 2024-04-25T15:57:37.301 INFO:tasks.workunit.client.0.smithi087.stdout:0/35: readlink l0 0 2024-04-25T15:57:37.301 INFO:tasks.workunit.client.0.smithi087.stdout:9/19: read - f3 zero size 2024-04-25T15:57:37.302 INFO:tasks.workunit.client.0.smithi087.stdout:2/19: getdents d3 0 2024-04-25T15:57:37.302 INFO:tasks.workunit.client.1.smithi155.stdout:8/238: fsync d2/d5/f29 0 2024-04-25T15:57:37.302 INFO:tasks.workunit.client.1.smithi155.stdout:2/396: rename d7/db/f78 to d7/db/dd/d15/d60/f79 0 2024-04-25T15:57:37.303 INFO:tasks.workunit.client.0.smithi087.stdout:6/11: read - f5 zero size 2024-04-25T15:57:37.305 INFO:tasks.workunit.client.0.smithi087.stdout:9/20: write f2 [463576,129596] 0 2024-04-25T15:57:37.309 INFO:tasks.workunit.client.1.smithi155.stdout:6/465: dwrite d0/f1 [4194304,4194304] 0 2024-04-25T15:57:37.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/36: read d1/f5 [2978069,84804] 0 2024-04-25T15:57:37.312 INFO:tasks.workunit.client.0.smithi087.stdout:1/12: truncate d3/f5 3933292 0 2024-04-25T15:57:37.313 INFO:tasks.workunit.client.1.smithi155.stdout:1/362: dread d1/d16/f1c [0,4194304] 0 2024-04-25T15:57:37.314 INFO:tasks.workunit.client.1.smithi155.stdout:1/363: write d1/d16/d1d/d29/d5f/d34/f47 [3031156,128274] 0 2024-04-25T15:57:37.315 INFO:tasks.workunit.client.1.smithi155.stdout:1/364: stat d1/d16/d37/f74 0 2024-04-25T15:57:37.317 INFO:tasks.workunit.client.0.smithi087.stdout:0/37: write d1/d6/fe [69797,30208] 0 2024-04-25T15:57:37.317 INFO:tasks.workunit.client.0.smithi087.stdout:3/15: symlink d4/l5 0 2024-04-25T15:57:37.317 INFO:tasks.workunit.client.0.smithi087.stdout:2/20: mknod d3/c6 0 2024-04-25T15:57:37.321 INFO:tasks.workunit.client.1.smithi155.stdout:2/397: creat d7/db/d2e/f7a x:0 0 0 2024-04-25T15:57:37.322 INFO:tasks.workunit.client.1.smithi155.stdout:7/369: symlink d2/dd/d66/d71/l7a 0 2024-04-25T15:57:37.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/416: mkdir d1/d4/d6a/d86 0 2024-04-25T15:57:37.324 INFO:tasks.workunit.client.0.smithi087.stdout:6/12: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.324 INFO:tasks.workunit.client.1.smithi155.stdout:8/239: dwrite d2/f33 [0,4194304] 0 2024-04-25T15:57:37.326 INFO:tasks.workunit.client.0.smithi087.stdout:6/13: chown c3 14679 1 2024-04-25T15:57:37.326 INFO:tasks.workunit.client.1.smithi155.stdout:1/365: fsync d1/d6/f2d 0 2024-04-25T15:57:37.327 INFO:tasks.workunit.client.0.smithi087.stdout:1/13: rmdir d3 39 2024-04-25T15:57:37.327 INFO:tasks.workunit.client.0.smithi087.stdout:6/14: dread - f5 zero size 2024-04-25T15:57:37.327 INFO:tasks.workunit.client.1.smithi155.stdout:1/366: chown d1/d6/c3c 11668 1 2024-04-25T15:57:37.328 INFO:tasks.workunit.client.0.smithi087.stdout:9/21: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.328 INFO:tasks.workunit.client.1.smithi155.stdout:1/367: write d1/f8 [1104669,72710] 0 2024-04-25T15:57:37.329 INFO:tasks.workunit.client.0.smithi087.stdout:6/15: dread - f5 zero size 2024-04-25T15:57:37.329 INFO:tasks.workunit.client.1.smithi155.stdout:7/370: creat d2/dd/d36/f7b x:0 0 0 2024-04-25T15:57:37.331 INFO:tasks.workunit.client.1.smithi155.stdout:3/417: creat d1/d4/db/d28/f87 x:0 0 0 2024-04-25T15:57:37.332 INFO:tasks.workunit.client.1.smithi155.stdout:3/418: fdatasync d1/d4/d25/f76 0 2024-04-25T15:57:37.333 INFO:tasks.workunit.client.0.smithi087.stdout:6/16: write f5 [500313,32160] 0 2024-04-25T15:57:37.335 INFO:tasks.workunit.client.1.smithi155.stdout:8/240: rmdir d2/d15 39 2024-04-25T15:57:37.336 INFO:tasks.workunit.client.1.smithi155.stdout:2/398: mkdir d7/db/d2e/d44/d70/d7b 0 2024-04-25T15:57:37.339 INFO:tasks.workunit.client.0.smithi087.stdout:3/16: creat d4/f6 x:0 0 0 2024-04-25T15:57:37.339 INFO:tasks.workunit.client.1.smithi155.stdout:1/368: rmdir d1/d16/d1d/d29/d3d 39 2024-04-25T15:57:37.340 INFO:tasks.workunit.client.1.smithi155.stdout:2/399: read - d7/db/d2e/d44/f6b zero size 2024-04-25T15:57:37.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/21: creat d3/f7 x:0 0 0 2024-04-25T15:57:37.340 INFO:tasks.workunit.client.1.smithi155.stdout:7/371: mknod d2/dd/d36/d46/c7c 0 2024-04-25T15:57:37.341 INFO:tasks.workunit.client.0.smithi087.stdout:3/17: dread - d4/f6 zero size 2024-04-25T15:57:37.341 INFO:tasks.workunit.client.1.smithi155.stdout:6/466: getdents d0/d1a/d45/d61 0 2024-04-25T15:57:37.342 INFO:tasks.workunit.client.1.smithi155.stdout:7/372: chown d2/dd/c2d 0 1 2024-04-25T15:57:37.343 INFO:tasks.workunit.client.1.smithi155.stdout:7/373: fsync d2/dd/d13/d1c/f40 0 2024-04-25T15:57:37.343 INFO:tasks.workunit.client.1.smithi155.stdout:3/419: link d1/d4/f2c d1/d4/d6a/f88 0 2024-04-25T15:57:37.344 INFO:tasks.workunit.client.1.smithi155.stdout:8/241: dread d2/fa [4194304,4194304] 0 2024-04-25T15:57:37.346 INFO:tasks.workunit.client.0.smithi087.stdout:6/17: creat f6 x:0 0 0 2024-04-25T15:57:37.347 INFO:tasks.workunit.client.1.smithi155.stdout:6/467: creat d0/f9b x:0 0 0 2024-04-25T15:57:37.349 INFO:tasks.workunit.client.0.smithi087.stdout:2/22: unlink f1 0 2024-04-25T15:57:37.349 INFO:tasks.workunit.client.0.smithi087.stdout:2/23: readlink - no filename 2024-04-25T15:57:37.350 INFO:tasks.workunit.client.1.smithi155.stdout:3/420: rmdir d1/d4/db/d28 39 2024-04-25T15:57:37.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/22: mkdir d6/d8 0 2024-04-25T15:57:37.353 INFO:tasks.workunit.client.1.smithi155.stdout:3/421: write d1/d4/db/d20/f4c [380723,119131] 0 2024-04-25T15:57:37.353 INFO:tasks.workunit.client.0.smithi087.stdout:1/14: creat d3/f6 x:0 0 0 2024-04-25T15:57:37.354 INFO:tasks.workunit.client.1.smithi155.stdout:7/374: rename d2/fa to d2/dd/d30/d44/f7d 0 2024-04-25T15:57:37.354 INFO:tasks.workunit.client.1.smithi155.stdout:1/369: dwrite d1/d16/d1d/d29/d3d/d43/f62 [0,4194304] 0 2024-04-25T15:57:37.355 INFO:tasks.workunit.client.1.smithi155.stdout:7/375: write d2/dd/f23 [345097,12715] 0 2024-04-25T15:57:37.356 INFO:tasks.workunit.client.0.smithi087.stdout:9/23: write f0 [1125357,44798] 0 2024-04-25T15:57:37.356 INFO:tasks.workunit.client.1.smithi155.stdout:1/370: readlink d1/d6/le 0 2024-04-25T15:57:37.356 INFO:tasks.workunit.client.1.smithi155.stdout:3/422: dread - d1/d4/d10/d21/d73/d77/d5f/f7e zero size 2024-04-25T15:57:37.357 INFO:tasks.workunit.client.0.smithi087.stdout:9/24: write f2 [809962,117667] 0 2024-04-25T15:57:37.358 INFO:tasks.workunit.client.1.smithi155.stdout:5/386: sync 2024-04-25T15:57:37.359 INFO:tasks.workunit.client.1.smithi155.stdout:5/387: fdatasync d0/d3/d2c/f3a 0 2024-04-25T15:57:37.360 INFO:tasks.workunit.client.1.smithi155.stdout:5/388: readlink d0/d58/d32/l66 0 2024-04-25T15:57:37.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/18: rename c3 to d4/c7 0 2024-04-25T15:57:37.363 INFO:tasks.workunit.client.0.smithi087.stdout:5/13: truncate f2 3648620 0 2024-04-25T15:57:37.367 INFO:tasks.workunit.client.1.smithi155.stdout:1/371: mknod d1/d16/d1d/d29/d3d/d43/c79 0 2024-04-25T15:57:37.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/38: write d1/f2 [2836687,73294] 0 2024-04-25T15:57:37.367 INFO:tasks.workunit.client.0.smithi087.stdout:2/24: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.368 INFO:tasks.workunit.client.0.smithi087.stdout:3/19: fsync d4/f6 0 2024-04-25T15:57:37.369 INFO:tasks.workunit.client.0.smithi087.stdout:2/25: rename d3 to d3/d8 22 2024-04-25T15:57:37.369 INFO:tasks.workunit.client.0.smithi087.stdout:2/26: truncate f2 206746 0 2024-04-25T15:57:37.370 INFO:tasks.workunit.client.1.smithi155.stdout:5/389: write d0/d47/f4d [859021,98334] 0 2024-04-25T15:57:37.372 INFO:tasks.workunit.client.0.smithi087.stdout:3/20: read - d4/f6 zero size 2024-04-25T15:57:37.373 INFO:tasks.workunit.client.1.smithi155.stdout:7/376: mkdir d2/dd/d12/d76/d7e 0 2024-04-25T15:57:37.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/14: mknod c4 0 2024-04-25T15:57:37.374 INFO:tasks.workunit.client.1.smithi155.stdout:3/423: mkdir d1/d4/db/d20/d44/d52/d61/d89 0 2024-04-25T15:57:37.375 INFO:tasks.workunit.client.0.smithi087.stdout:2/27: symlink d3/l9 0 2024-04-25T15:57:37.376 INFO:tasks.workunit.client.0.smithi087.stdout:0/39: creat d1/da/f10 x:0 0 0 2024-04-25T15:57:37.376 INFO:tasks.workunit.client.0.smithi087.stdout:2/28: read f0 [1070863,116893] 0 2024-04-25T15:57:37.376 INFO:tasks.workunit.client.1.smithi155.stdout:6/468: rmdir d0/d18 39 2024-04-25T15:57:37.376 INFO:tasks.workunit.client.1.smithi155.stdout:9/307: sync 2024-04-25T15:57:37.377 INFO:tasks.workunit.client.1.smithi155.stdout:4/322: sync 2024-04-25T15:57:37.377 INFO:tasks.workunit.client.1.smithi155.stdout:0/326: sync 2024-04-25T15:57:37.377 INFO:tasks.workunit.client.0.smithi087.stdout:6/18: mkdir d7 0 2024-04-25T15:57:37.377 INFO:tasks.workunit.client.0.smithi087.stdout:1/15: dwrite d3/f4 [0,4194304] 0 2024-04-25T15:57:37.379 INFO:tasks.workunit.client.0.smithi087.stdout:0/40: write d1/da/fd [234714,18254] 0 2024-04-25T15:57:37.379 INFO:tasks.workunit.client.0.smithi087.stdout:0/41: fsync d1/d6/fe 0 2024-04-25T15:57:37.382 INFO:tasks.workunit.client.1.smithi155.stdout:2/400: dread d7/db/dd/d15/f45 [0,4194304] 0 2024-04-25T15:57:37.384 INFO:tasks.workunit.client.1.smithi155.stdout:7/377: dread d2/dd/d13/d24/d35/f3c [0,4194304] 0 2024-04-25T15:57:37.385 INFO:tasks.workunit.client.0.smithi087.stdout:9/25: symlink d6/d8/l9 0 2024-04-25T15:57:37.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/19: dread f0 [0,4194304] 0 2024-04-25T15:57:37.391 INFO:tasks.workunit.client.1.smithi155.stdout:8/242: rename d2/d15/d18/d23/d2f to d2/d15/d18/d49 0 2024-04-25T15:57:37.393 INFO:tasks.workunit.client.0.smithi087.stdout:0/42: dwrite d1/f3 [0,4194304] 0 2024-04-25T15:57:37.396 INFO:tasks.workunit.client.1.smithi155.stdout:0/327: link d1/f1b d1/d3/d3d/f7a 0 2024-04-25T15:57:37.397 INFO:tasks.workunit.client.1.smithi155.stdout:7/378: mkdir d2/dd/d30/d44/d7f 0 2024-04-25T15:57:37.397 INFO:tasks.workunit.client.0.smithi087.stdout:2/29: rename d3/c6 to d3/ca 0 2024-04-25T15:57:37.398 INFO:tasks.workunit.client.1.smithi155.stdout:3/424: dwrite d1/d4/db/f35 [0,4194304] 0 2024-04-25T15:57:37.399 INFO:tasks.workunit.client.1.smithi155.stdout:9/308: rename dc/d11/d5a/d5b to dc/d17/d18/d72 0 2024-04-25T15:57:37.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/30: dread - d3/f7 zero size 2024-04-25T15:57:37.400 INFO:tasks.workunit.client.1.smithi155.stdout:1/372: dwrite d1/d16/d1d/d29/d5f/d34/f51 [0,4194304] 0 2024-04-25T15:57:37.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/31: write f2 [699687,77935] 0 2024-04-25T15:57:37.402 INFO:tasks.workunit.client.0.smithi087.stdout:2/32: dread - d3/f7 zero size 2024-04-25T15:57:37.402 INFO:tasks.workunit.client.1.smithi155.stdout:7/379: write d2/f1f [1179143,45117] 0 2024-04-25T15:57:37.404 INFO:tasks.workunit.client.1.smithi155.stdout:4/323: dwrite da/dc/f47 [0,4194304] 0 2024-04-25T15:57:37.409 INFO:tasks.workunit.client.1.smithi155.stdout:2/401: truncate d7/db/dd/d15/f37 919945 0 2024-04-25T15:57:37.409 INFO:tasks.workunit.client.0.smithi087.stdout:1/16: truncate d3/f5 1831352 0 2024-04-25T15:57:37.409 INFO:tasks.workunit.client.1.smithi155.stdout:7/380: readlink d2/l4 0 2024-04-25T15:57:37.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/21: link l2 d4/l8 0 2024-04-25T15:57:37.414 INFO:tasks.workunit.client.0.smithi087.stdout:6/20: creat d7/f8 x:0 0 0 2024-04-25T15:57:37.415 INFO:tasks.workunit.client.1.smithi155.stdout:9/309: unlink dc/d13/d2e/l40 0 2024-04-25T15:57:37.415 INFO:tasks.workunit.client.1.smithi155.stdout:1/373: creat d1/f7a x:0 0 0 2024-04-25T15:57:37.417 INFO:tasks.workunit.client.1.smithi155.stdout:3/425: creat d1/d4/db/f8a x:0 0 0 2024-04-25T15:57:37.422 INFO:tasks.workunit.client.1.smithi155.stdout:5/390: dwrite d0/d3/d2c/f3c [0,4194304] 0 2024-04-25T15:57:37.422 INFO:tasks.workunit.client.1.smithi155.stdout:6/469: link d0/d13/d43/d56/d7b/c7f d0/c9c 0 2024-04-25T15:57:37.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/22: rename c1 to d4/c9 0 2024-04-25T15:57:37.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/23: read - d4/f6 zero size 2024-04-25T15:57:37.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/24: chown l0 49655 1 2024-04-25T15:57:37.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/21: creat d7/f9 x:0 0 0 2024-04-25T15:57:37.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/25: mknod d4/ca 0 2024-04-25T15:57:37.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/26: getdents d6 0 2024-04-25T15:57:37.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/26: mkdir d4/db 0 2024-04-25T15:57:37.425 INFO:tasks.workunit.client.1.smithi155.stdout:4/324: dwrite da/dc/fd [0,4194304] 0 2024-04-25T15:57:37.426 INFO:tasks.workunit.client.0.smithi087.stdout:9/27: creat d6/d8/fa x:0 0 0 2024-04-25T15:57:37.427 INFO:tasks.workunit.client.0.smithi087.stdout:9/28: stat f2 0 2024-04-25T15:57:37.427 INFO:tasks.workunit.client.1.smithi155.stdout:6/470: chown d0/d13/d43/d56/d7b/f96 29 1 2024-04-25T15:57:37.428 INFO:tasks.workunit.client.1.smithi155.stdout:1/374: creat d1/d16/d1d/d5e/f7b x:0 0 0 2024-04-25T15:57:37.429 INFO:tasks.workunit.client.0.smithi087.stdout:3/27: link d4/f6 d4/db/fc 0 2024-04-25T15:57:37.430 INFO:tasks.workunit.client.1.smithi155.stdout:9/310: rename dc/d13/d2e/l53 to dc/d17/d2a/l73 0 2024-04-25T15:57:37.431 INFO:tasks.workunit.client.1.smithi155.stdout:3/426: mknod d1/d4/d10/d21/d73/d77/d57/d7c/c8b 0 2024-04-25T15:57:37.432 INFO:tasks.workunit.client.1.smithi155.stdout:4/325: mknod da/d23/c73 0 2024-04-25T15:57:37.433 INFO:tasks.workunit.client.1.smithi155.stdout:6/471: mkdir d0/d13/d34/d6c/d9d 0 2024-04-25T15:57:37.434 INFO:tasks.workunit.client.1.smithi155.stdout:2/402: dread d7/db/f6c [0,4194304] 0 2024-04-25T15:57:37.435 INFO:tasks.workunit.client.1.smithi155.stdout:6/472: chown d0/d13/d43/d56 3778006 1 2024-04-25T15:57:37.435 INFO:tasks.workunit.client.1.smithi155.stdout:7/381: dwrite d2/dd/d36/d46/f5f [0,4194304] 0 2024-04-25T15:57:37.436 INFO:tasks.workunit.client.0.smithi087.stdout:9/29: dread f0 [0,4194304] 0 2024-04-25T15:57:37.437 INFO:tasks.workunit.client.1.smithi155.stdout:7/382: chown d2/dd/d12/d76/d7e 210 1 2024-04-25T15:57:37.437 INFO:tasks.workunit.client.0.smithi087.stdout:3/28: stat d4/l8 0 2024-04-25T15:57:37.437 INFO:tasks.workunit.client.0.smithi087.stdout:9/30: dread - f3 zero size 2024-04-25T15:57:37.438 INFO:tasks.workunit.client.1.smithi155.stdout:4/326: mknod da/c74 0 2024-04-25T15:57:37.439 INFO:tasks.workunit.client.1.smithi155.stdout:4/327: write da/d23/d3f/f48 [599069,68915] 0 2024-04-25T15:57:37.440 INFO:tasks.workunit.client.0.smithi087.stdout:0/43: dwrite d1/f3 [4194304,4194304] 0 2024-04-25T15:57:37.440 INFO:tasks.workunit.client.1.smithi155.stdout:5/391: dread d0/d58/f29 [0,4194304] 0 2024-04-25T15:57:37.441 INFO:tasks.workunit.client.0.smithi087.stdout:2/33: truncate f2 502399 0 2024-04-25T15:57:37.442 INFO:tasks.workunit.client.1.smithi155.stdout:5/392: chown d0/d3/f4a 576 1 2024-04-25T15:57:37.443 INFO:tasks.workunit.client.1.smithi155.stdout:7/383: unlink d2/f2e 0 2024-04-25T15:57:37.443 INFO:tasks.workunit.client.1.smithi155.stdout:5/393: write d0/f40 [2414057,21722] 0 2024-04-25T15:57:37.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/29: write d4/f6 [852147,48600] 0 2024-04-25T15:57:37.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/34: symlink d3/lb 0 2024-04-25T15:57:37.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/35: readlink d3/lb 0 2024-04-25T15:57:37.448 INFO:tasks.workunit.client.0.smithi087.stdout:9/31: rmdir d6/d8 39 2024-04-25T15:57:37.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/44: rename d1/df to d1/da/d11 0 2024-04-25T15:57:37.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/30: read d4/f6 [270827,109859] 0 2024-04-25T15:57:37.454 INFO:tasks.workunit.client.1.smithi155.stdout:6/473: symlink d0/d13/d34/d38/d4c/l9e 0 2024-04-25T15:57:37.454 INFO:tasks.workunit.client.1.smithi155.stdout:2/403: symlink d7/db/d2e/d6f/l7c 0 2024-04-25T15:57:37.454 INFO:tasks.workunit.client.1.smithi155.stdout:8/243: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:37.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/45: mknod d1/c12 0 2024-04-25T15:57:37.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/46: write d1/f3 [6903949,48405] 0 2024-04-25T15:57:37.457 INFO:tasks.workunit.client.1.smithi155.stdout:2/404: rename d7 to d7/d23/d7d 22 2024-04-25T15:57:37.458 INFO:tasks.workunit.client.1.smithi155.stdout:0/328: dread d1/d3/d5/f26 [4194304,4194304] 0 2024-04-25T15:57:37.459 INFO:tasks.workunit.client.0.smithi087.stdout:9/32: symlink d6/d8/lb 0 2024-04-25T15:57:37.460 INFO:tasks.workunit.client.1.smithi155.stdout:3/427: creat d1/d4/db/d20/d44/d52/d61/d89/f8c x:0 0 0 2024-04-25T15:57:37.460 INFO:tasks.workunit.client.1.smithi155.stdout:4/328: dwrite da/dc/f47 [0,4194304] 0 2024-04-25T15:57:37.461 INFO:tasks.workunit.client.1.smithi155.stdout:7/384: mknod d2/dd/d30/d44/c80 0 2024-04-25T15:57:37.464 INFO:tasks.workunit.client.1.smithi155.stdout:5/394: dread d0/d3/d15/d1f/d50/d60/f65 [0,4194304] 0 2024-04-25T15:57:37.465 INFO:tasks.workunit.client.0.smithi087.stdout:0/47: mknod d1/da/c13 0 2024-04-25T15:57:37.466 INFO:tasks.workunit.client.1.smithi155.stdout:7/385: write d2/dd/f2f [7872214,52951] 0 2024-04-25T15:57:37.466 INFO:tasks.workunit.client.1.smithi155.stdout:8/244: mkdir d2/d15/d18/d23/d3c/d4a 0 2024-04-25T15:57:37.467 INFO:tasks.workunit.client.1.smithi155.stdout:3/428: chown d1/d4/d10/c64 403 1 2024-04-25T15:57:37.471 INFO:tasks.workunit.client.1.smithi155.stdout:6/474: symlink d0/d18/d63/l9f 0 2024-04-25T15:57:37.471 INFO:tasks.workunit.client.1.smithi155.stdout:0/329: truncate d1/d6/d29/f66 789571 0 2024-04-25T15:57:37.472 INFO:tasks.workunit.client.1.smithi155.stdout:2/405: symlink d7/db/l7e 0 2024-04-25T15:57:37.472 INFO:tasks.workunit.client.1.smithi155.stdout:7/386: write d2/f1b [2751369,25682] 0 2024-04-25T15:57:37.474 INFO:tasks.workunit.client.1.smithi155.stdout:1/375: dread d1/d16/f39 [0,4194304] 0 2024-04-25T15:57:37.474 INFO:tasks.workunit.client.1.smithi155.stdout:6/475: readlink d0/d1a/d25/d2e/l30 0 2024-04-25T15:57:37.474 INFO:tasks.workunit.client.1.smithi155.stdout:0/330: write d1/d6/d29/f66 [652971,61183] 0 2024-04-25T15:57:37.474 INFO:tasks.workunit.client.1.smithi155.stdout:8/245: creat d2/d15/d18/d23/d3c/f4b x:0 0 0 2024-04-25T15:57:37.475 INFO:tasks.workunit.client.0.smithi087.stdout:0/48: creat d1/f14 x:0 0 0 2024-04-25T15:57:37.475 INFO:tasks.workunit.client.1.smithi155.stdout:6/476: fdatasync d0/d1a/d21/f32 0 2024-04-25T15:57:37.476 INFO:tasks.workunit.client.1.smithi155.stdout:0/331: write d1/f71 [290004,45164] 0 2024-04-25T15:57:37.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/33: link f0 d6/d8/fc 0 2024-04-25T15:57:37.478 INFO:tasks.workunit.client.1.smithi155.stdout:3/429: mkdir d1/d4/d10/d21/d73/d8d 0 2024-04-25T15:57:37.478 INFO:tasks.workunit.client.0.smithi087.stdout:3/31: link d4/l8 d4/ld 0 2024-04-25T15:57:37.478 INFO:tasks.workunit.client.0.smithi087.stdout:1/17: dwrite d3/f5 [0,4194304] 0 2024-04-25T15:57:37.480 INFO:tasks.workunit.client.1.smithi155.stdout:7/387: readlink d2/dd/d30/d44/l4f 0 2024-04-25T15:57:37.490 INFO:tasks.workunit.client.0.smithi087.stdout:0/49: mknod d1/da/d11/c15 0 2024-04-25T15:57:37.491 INFO:tasks.workunit.client.1.smithi155.stdout:0/332: creat d1/d3f/f7b x:0 0 0 2024-04-25T15:57:37.491 INFO:tasks.workunit.client.1.smithi155.stdout:6/477: dwrite d0/d1a/d37/f4d [4194304,4194304] 0 2024-04-25T15:57:37.491 INFO:tasks.workunit.client.0.smithi087.stdout:1/18: creat d3/f7 x:0 0 0 2024-04-25T15:57:37.492 INFO:tasks.workunit.client.1.smithi155.stdout:4/329: dwrite da/dc/f1f [0,4194304] 0 2024-04-25T15:57:37.492 INFO:tasks.workunit.client.1.smithi155.stdout:8/246: symlink d2/d15/d18/d23/d2d/l4c 0 2024-04-25T15:57:37.493 INFO:tasks.workunit.client.0.smithi087.stdout:3/32: truncate d4/f6 391350 0 2024-04-25T15:57:37.493 INFO:tasks.workunit.client.0.smithi087.stdout:2/36: truncate f2 1152637 0 2024-04-25T15:57:37.494 INFO:tasks.workunit.client.1.smithi155.stdout:7/388: dwrite d2/f37 [0,4194304] 0 2024-04-25T15:57:37.495 INFO:tasks.workunit.client.1.smithi155.stdout:5/395: creat d0/d3/f7b x:0 0 0 2024-04-25T15:57:37.495 INFO:tasks.workunit.client.0.smithi087.stdout:0/50: creat d1/da/d11/f16 x:0 0 0 2024-04-25T15:57:37.496 INFO:tasks.workunit.client.1.smithi155.stdout:5/396: chown d0/d3/d2c/f3a 130590 1 2024-04-25T15:57:37.503 INFO:tasks.workunit.client.1.smithi155.stdout:1/376: dwrite d1/d6/f2d [0,4194304] 0 2024-04-25T15:57:37.504 INFO:tasks.workunit.client.1.smithi155.stdout:7/389: dwrite d2/d26/d3d/f64 [0,4194304] 0 2024-04-25T15:57:37.507 INFO:tasks.workunit.client.1.smithi155.stdout:4/330: symlink da/d23/d2a/d62/l75 0 2024-04-25T15:57:37.507 INFO:tasks.workunit.client.1.smithi155.stdout:0/333: creat d1/d41/f7c x:0 0 0 2024-04-25T15:57:37.507 INFO:tasks.workunit.client.0.smithi087.stdout:0/51: rename l0 to d1/d6/l17 0 2024-04-25T15:57:37.508 INFO:tasks.workunit.client.1.smithi155.stdout:3/430: mknod d1/d4/d6a/d86/c8e 0 2024-04-25T15:57:37.509 INFO:tasks.workunit.client.0.smithi087.stdout:1/19: link f2 d3/f8 0 2024-04-25T15:57:37.510 INFO:tasks.workunit.client.1.smithi155.stdout:0/334: chown d1/d6/f75 2961 1 2024-04-25T15:57:37.512 INFO:tasks.workunit.client.1.smithi155.stdout:4/331: write da/dc/f47 [1402351,89327] 0 2024-04-25T15:57:37.515 INFO:tasks.workunit.client.1.smithi155.stdout:1/377: dread d1/d6/f2f [0,4194304] 0 2024-04-25T15:57:37.517 INFO:tasks.workunit.client.0.smithi087.stdout:0/52: rename d1/d6/f7 to d1/f18 0 2024-04-25T15:57:37.518 INFO:tasks.workunit.client.1.smithi155.stdout:2/406: truncate d7/db/dd/f48 845456 0 2024-04-25T15:57:37.520 INFO:tasks.workunit.client.1.smithi155.stdout:5/397: mkdir d0/d3/d15/d1f/d50/d7c 0 2024-04-25T15:57:37.523 INFO:tasks.workunit.client.1.smithi155.stdout:3/431: dwrite d1/d4/d10/d2a/f3c [0,4194304] 0 2024-04-25T15:57:37.524 INFO:tasks.workunit.client.1.smithi155.stdout:0/335: mknod d1/d1a/c7d 0 2024-04-25T15:57:37.524 INFO:tasks.workunit.client.1.smithi155.stdout:8/247: write d2/d15/d18/d23/d2d/f31 [8708169,128675] 0 2024-04-25T15:57:37.525 INFO:tasks.workunit.client.0.smithi087.stdout:1/20: write f2 [302127,10731] 0 2024-04-25T15:57:37.527 INFO:tasks.workunit.client.1.smithi155.stdout:4/332: rmdir da/d30 39 2024-04-25T15:57:37.527 INFO:tasks.workunit.client.1.smithi155.stdout:8/248: chown d2/d15/d18/d23/d2d/f39 1 1 2024-04-25T15:57:37.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.523+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7b40c4b50 con 0x7fd7b406fee0 2024-04-25T15:57:37.529 INFO:tasks.workunit.client.1.smithi155.stdout:8/249: chown d2/d15/d18/d23/d2d/l4c 57889395 1 2024-04-25T15:57:37.530 INFO:tasks.workunit.client.1.smithi155.stdout:2/407: creat d7/db/d2e/d44/f7f x:0 0 0 2024-04-25T15:57:37.531 INFO:tasks.workunit.client.0.smithi087.stdout:0/53: unlink d1/da/fd 0 2024-04-25T15:57:37.531 INFO:tasks.workunit.client.1.smithi155.stdout:7/390: write d2/d26/d3d/d6d/f5d [710817,95295] 0 2024-04-25T15:57:37.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.527+0000 7fd7aa7fc640 1 -- 172.21.15.87:0/4286643353 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7fd7b005bb80 con 0x7fd7b406fee0 2024-04-25T15:57:37.532 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:37.532 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:37.532 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:37.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/21: dread d3/f4 [0,4194304] 0 2024-04-25T15:57:37.533 INFO:tasks.workunit.client.1.smithi155.stdout:8/250: fsync d2/f14 0 2024-04-25T15:57:37.533 INFO:tasks.workunit.client.1.smithi155.stdout:5/398: dwrite d0/d27/f43 [0,4194304] 0 2024-04-25T15:57:37.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd79806f430 msgr2=0x7fd798071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd79806f430 0x7fd798071940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40b0000 tx=0x7fd7a4008040 comp rx=0 tx=0).stop 2024-04-25T15:57:37.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 msgr2=0x7fd7b41547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 0x7fd7b41547b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000b410 tx=0x7fd7b000b8d0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 shutdown_connections 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd79806f430 0x7fd798071940 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40b0000 tx=0x7fd7a4008040 comp rx=0 tx=0).stop 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7b41539b0 0x7fd7b41efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7b4150bd0 0x7fd7b40c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 --2- 172.21.15.87:0/4286643353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7b406fee0 0x7fd7b41547b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 >> 172.21.15.87:0/4286643353 conn(0x7fd7b40c8ba0 msgr2=0x7fd7b40ac680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:37.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 shutdown_connections 2024-04-25T15:57:37.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.531+0000 7fd7bc1c2640 1 -- 172.21.15.87:0/4286643353 wait complete. 2024-04-25T15:57:37.539 INFO:tasks.workunit.client.1.smithi155.stdout:7/391: truncate d2/dd/d12/f5e 719870 0 2024-04-25T15:57:37.539 INFO:tasks.workunit.client.0.smithi087.stdout:2/37: dread f2 [0,4194304] 0 2024-04-25T15:57:37.540 INFO:tasks.workunit.client.1.smithi155.stdout:2/408: creat d7/db/d2e/d6f/f80 x:0 0 0 2024-04-25T15:57:37.543 INFO:tasks.workunit.client.1.smithi155.stdout:4/333: creat da/d23/d3f/d56/f76 x:0 0 0 2024-04-25T15:57:37.544 INFO:tasks.workunit.client.0.smithi087.stdout:0/54: link d1/f18 d1/da/d11/f19 0 2024-04-25T15:57:37.545 INFO:tasks.workunit.client.1.smithi155.stdout:8/251: creat d2/d15/d35/f4d x:0 0 0 2024-04-25T15:57:37.547 INFO:tasks.workunit.client.1.smithi155.stdout:4/334: dread - da/d23/d3f/d56/f76 zero size 2024-04-25T15:57:37.547 INFO:tasks.workunit.client.1.smithi155.stdout:2/409: symlink d7/db/d2e/d44/d70/l81 0 2024-04-25T15:57:37.547 INFO:tasks.workunit.client.1.smithi155.stdout:1/378: dwrite d1/d16/f39 [4194304,4194304] 0 2024-04-25T15:57:37.549 INFO:tasks.workunit.client.1.smithi155.stdout:5/399: link d0/d3/d2c/f3a d0/d3/d15/d1f/d50/d7c/f7d 0 2024-04-25T15:57:37.550 INFO:tasks.workunit.client.1.smithi155.stdout:4/335: write da/d23/d3f/f48 [725251,83999] 0 2024-04-25T15:57:37.552 INFO:tasks.workunit.client.1.smithi155.stdout:7/392: rename d2/dd/d13/d24/f27 to d2/d26/d3d/d65/f81 0 2024-04-25T15:57:37.552 INFO:tasks.workunit.client.1.smithi155.stdout:0/336: dread d1/d6/d29/f59 [0,4194304] 0 2024-04-25T15:57:37.552 INFO:tasks.workunit.client.1.smithi155.stdout:4/336: chown da/dc/d18/l1e 169559310 1 2024-04-25T15:57:37.552 INFO:tasks.workunit.client.0.smithi087.stdout:3/33: write d4/f6 [1001987,112852] 0 2024-04-25T15:57:37.556 INFO:tasks.workunit.client.1.smithi155.stdout:5/400: write d0/d3/d2c/f3a [1507078,46046] 0 2024-04-25T15:57:37.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/22: dwrite d3/f8 [0,4194304] 0 2024-04-25T15:57:37.563 INFO:tasks.workunit.client.0.smithi087.stdout:2/38: write f2 [997359,124112] 0 2024-04-25T15:57:37.564 INFO:tasks.workunit.client.1.smithi155.stdout:4/337: unlink da/d23/d3f/d56/d69/c54 0 2024-04-25T15:57:37.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/55: getdents d1/d6 0 2024-04-25T15:57:37.566 INFO:tasks.workunit.client.1.smithi155.stdout:8/252: mkdir d2/d15/d18/d34/d48/d4e 0 2024-04-25T15:57:37.570 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-04-25T15:57:37.570 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:57:37.570 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:57:37.571 INFO:tasks.workunit.client.1.smithi155.stdout:7/393: symlink d2/dd/l82 0 2024-04-25T15:57:37.571 INFO:tasks.workunit.client.0.smithi087.stdout:1/23: dread f2 [0,4194304] 0 2024-04-25T15:57:37.572 INFO:tasks.workunit.client.0.smithi087.stdout:3/34: dwrite d4/f6 [0,4194304] 0 2024-04-25T15:57:37.573 INFO:tasks.workunit.client.1.smithi155.stdout:4/338: mkdir da/dc/d77 0 2024-04-25T15:57:37.574 INFO:tasks.workunit.client.1.smithi155.stdout:4/339: chown da/f4d 10 1 2024-04-25T15:57:37.575 INFO:tasks.workunit.client.1.smithi155.stdout:2/410: creat d7/f82 x:0 0 0 2024-04-25T15:57:37.577 INFO:tasks.workunit.client.1.smithi155.stdout:1/379: link d1/d6/f14 d1/d16/d1d/d29/d5f/f7c 0 2024-04-25T15:57:37.578 INFO:tasks.workunit.client.1.smithi155.stdout:1/380: fdatasync d1/d16/d1d/d29/f55 0 2024-04-25T15:57:37.579 INFO:tasks.workunit.client.1.smithi155.stdout:1/381: stat d1/d16/d37/f69 0 2024-04-25T15:57:37.580 INFO:tasks.workunit.client.0.smithi087.stdout:2/39: dwrite f0 [0,4194304] 0 2024-04-25T15:57:37.580 INFO:tasks.workunit.client.1.smithi155.stdout:5/401: symlink d0/d3/d15/d1f/d50/d7c/l7e 0 2024-04-25T15:57:37.582 INFO:tasks.workunit.client.1.smithi155.stdout:4/340: rename da/d23/d2a to da/d23/d3f/d56/d69/d4a/d78 0 2024-04-25T15:57:37.583 INFO:tasks.workunit.client.0.smithi087.stdout:2/40: dread f2 [0,4194304] 0 2024-04-25T15:57:37.584 INFO:tasks.workunit.client.1.smithi155.stdout:2/411: fdatasync d7/f16 0 2024-04-25T15:57:37.584 INFO:tasks.workunit.client.1.smithi155.stdout:4/341: readlink da/d23/d3f/l6a 0 2024-04-25T15:57:37.584 INFO:tasks.workunit.client.0.smithi087.stdout:3/35: dwrite d4/db/fc [0,4194304] 0 2024-04-25T15:57:37.586 INFO:tasks.workunit.client.0.smithi087.stdout:3/36: write d4/f6 [287316,1617] 0 2024-04-25T15:57:37.586 INFO:tasks.workunit.client.1.smithi155.stdout:4/342: chown da/d23/d3f/l6a 1016399174 1 2024-04-25T15:57:37.586 INFO:tasks.workunit.client.1.smithi155.stdout:2/412: chown d7/db/d2e/c39 136148 1 2024-04-25T15:57:37.587 INFO:tasks.workunit.client.1.smithi155.stdout:8/253: truncate d2/f14 232185 0 2024-04-25T15:57:37.588 INFO:tasks.workunit.client.1.smithi155.stdout:0/337: getdents d1/d6 0 2024-04-25T15:57:37.590 INFO:tasks.workunit.client.1.smithi155.stdout:4/343: stat da/c10 0 2024-04-25T15:57:37.590 INFO:tasks.workunit.client.1.smithi155.stdout:7/394: dwrite d2/dd/d12/f20 [4194304,4194304] 0 2024-04-25T15:57:37.591 INFO:tasks.workunit.client.1.smithi155.stdout:4/344: dread - da/dc/f53 zero size 2024-04-25T15:57:37.592 INFO:tasks.workunit.client.1.smithi155.stdout:2/413: rmdir d7/db/d29 39 2024-04-25T15:57:37.593 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:57:37.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:37.594 INFO:tasks.workunit.client.1.smithi155.stdout:7/395: rmdir d2/dd/d30/d44 39 2024-04-25T15:57:37.595 INFO:tasks.workunit.client.1.smithi155.stdout:7/396: stat d2/dd/d13/d1c/f59 0 2024-04-25T15:57:37.596 INFO:tasks.workunit.client.1.smithi155.stdout:0/338: unlink d1/d3/d12/f4c 0 2024-04-25T15:57:37.596 INFO:tasks.workunit.client.1.smithi155.stdout:7/397: write d2/dd/d12/f38 [4112647,125273] 0 2024-04-25T15:57:37.600 INFO:tasks.workunit.client.1.smithi155.stdout:8/254: unlink d2/d15/d18/c2b 0 2024-04-25T15:57:37.605 INFO:tasks.workunit.client.1.smithi155.stdout:7/398: creat d2/dd/d36/d46/f83 x:0 0 0 2024-04-25T15:57:37.605 INFO:tasks.workunit.client.1.smithi155.stdout:2/414: mkdir d7/db/d29/d83 0 2024-04-25T15:57:37.606 INFO:tasks.workunit.client.1.smithi155.stdout:1/382: truncate d1/fb 261040 0 2024-04-25T15:57:37.608 INFO:tasks.workunit.client.1.smithi155.stdout:5/402: dread d0/d58/f56 [0,4194304] 0 2024-04-25T15:57:37.610 INFO:tasks.workunit.client.1.smithi155.stdout:0/339: mknod d1/d6/d16/d6e/c7e 0 2024-04-25T15:57:37.611 INFO:tasks.workunit.client.1.smithi155.stdout:2/415: fdatasync d7/db/f6c 0 2024-04-25T15:57:37.611 INFO:tasks.workunit.client.1.smithi155.stdout:0/340: chown d1/d3/fd 9 1 2024-04-25T15:57:37.611 INFO:tasks.workunit.client.1.smithi155.stdout:8/255: dread d2/d15/d18/d23/d3c/f47 [0,4194304] 0 2024-04-25T15:57:37.612 INFO:tasks.workunit.client.1.smithi155.stdout:7/399: mknod d2/dd/d13/d24/c84 0 2024-04-25T15:57:37.612 INFO:tasks.workunit.client.1.smithi155.stdout:1/383: mknod d1/d32/c7d 0 2024-04-25T15:57:37.613 INFO:tasks.workunit.client.1.smithi155.stdout:7/400: chown d2/dd/d12 67598602 1 2024-04-25T15:57:37.613 INFO:tasks.workunit.client.1.smithi155.stdout:4/345: getdents da/d23/d3f/d56 0 2024-04-25T15:57:37.614 INFO:tasks.workunit.client.1.smithi155.stdout:5/403: creat d0/d27/f7f x:0 0 0 2024-04-25T15:57:37.615 INFO:tasks.workunit.client.1.smithi155.stdout:7/401: write d2/dd/d63/f77 [960827,124899] 0 2024-04-25T15:57:37.615 INFO:tasks.workunit.client.1.smithi155.stdout:2/416: creat d7/db/d2e/f84 x:0 0 0 2024-04-25T15:57:37.615 INFO:tasks.workunit.client.1.smithi155.stdout:0/341: creat d1/d41/f7f x:0 0 0 2024-04-25T15:57:37.616 INFO:tasks.workunit.client.1.smithi155.stdout:2/417: write d7/db/d2e/f69 [191606,61956] 0 2024-04-25T15:57:37.616 INFO:tasks.workunit.client.1.smithi155.stdout:8/256: mkdir d2/d15/d18/d34/d4f 0 2024-04-25T15:57:37.616 INFO:tasks.workunit.client.1.smithi155.stdout:7/402: chown d2/dd/c2d 34204269 1 2024-04-25T15:57:37.617 INFO:tasks.workunit.client.1.smithi155.stdout:8/257: stat d2/f11 0 2024-04-25T15:57:37.619 INFO:tasks.workunit.client.1.smithi155.stdout:9/311: sync 2024-04-25T15:57:37.620 INFO:tasks.workunit.client.1.smithi155.stdout:4/346: creat da/d23/d3f/f79 x:0 0 0 2024-04-25T15:57:37.621 INFO:tasks.workunit.client.1.smithi155.stdout:7/403: creat d2/dd/d12/d76/f85 x:0 0 0 2024-04-25T15:57:37.623 INFO:tasks.workunit.client.1.smithi155.stdout:7/404: chown d2/dd/f4e 6 1 2024-04-25T15:57:37.624 INFO:tasks.workunit.client.1.smithi155.stdout:9/312: dread dc/d13/d2e/d4c/f61 [0,4194304] 0 2024-04-25T15:57:37.625 INFO:tasks.workunit.client.1.smithi155.stdout:0/342: dread d1/d3/d3d/d46/f78 [0,4194304] 0 2024-04-25T15:57:37.630 INFO:tasks.workunit.client.1.smithi155.stdout:1/384: write d1/d16/d1d/d29/d5f/f7c [3664957,128826] 0 2024-04-25T15:57:37.630 INFO:tasks.workunit.client.1.smithi155.stdout:7/405: creat d2/d26/d3d/d65/f86 x:0 0 0 2024-04-25T15:57:37.630 INFO:tasks.workunit.client.1.smithi155.stdout:9/313: mkdir dc/d74 0 2024-04-25T15:57:37.633 INFO:tasks.workunit.client.1.smithi155.stdout:1/385: chown d1/d16/d37/d70 145956 1 2024-04-25T15:57:37.633 INFO:tasks.workunit.client.1.smithi155.stdout:8/258: dwrite d2/d15/d35/f44 [0,4194304] 0 2024-04-25T15:57:37.635 INFO:tasks.workunit.client.1.smithi155.stdout:7/406: symlink d2/dd/d66/l87 0 2024-04-25T15:57:37.635 INFO:tasks.workunit.client.1.smithi155.stdout:2/418: dwrite d7/db/dd/d15/d60/f76 [0,4194304] 0 2024-04-25T15:57:37.640 INFO:tasks.workunit.client.1.smithi155.stdout:9/314: symlink dc/d11/d30/d46/l75 0 2024-04-25T15:57:37.641 INFO:tasks.workunit.client.1.smithi155.stdout:8/259: write d2/d15/d35/d3d/f42 [184420,115553] 0 2024-04-25T15:57:37.641 INFO:tasks.workunit.client.1.smithi155.stdout:1/386: stat d1/d16/d1d/d29/d5f/c26 0 2024-04-25T15:57:37.643 INFO:tasks.workunit.client.1.smithi155.stdout:1/387: readlink d1/l5 0 2024-04-25T15:57:37.643 INFO:tasks.workunit.client.1.smithi155.stdout:5/404: dwrite d0/f37 [4194304,4194304] 0 2024-04-25T15:57:37.645 INFO:tasks.workunit.client.1.smithi155.stdout:2/419: symlink d7/db/l85 0 2024-04-25T15:57:37.648 INFO:tasks.workunit.client.1.smithi155.stdout:0/343: dwrite d1/d6/d29/f59 [0,4194304] 0 2024-04-25T15:57:37.652 INFO:tasks.workunit.client.1.smithi155.stdout:5/405: rmdir d0/d3/d2c 39 2024-04-25T15:57:37.656 INFO:tasks.workunit.client.1.smithi155.stdout:7/407: dwrite d2/d26/d3d/d6d/f5d [4194304,4194304] 0 2024-04-25T15:57:37.656 INFO:tasks.workunit.client.1.smithi155.stdout:8/260: fdatasync d2/d15/d35/d3d/f42 0 2024-04-25T15:57:37.656 INFO:tasks.workunit.client.1.smithi155.stdout:5/406: fsync d0/d3/f5c 0 2024-04-25T15:57:37.662 INFO:tasks.workunit.client.1.smithi155.stdout:0/344: creat d1/f80 x:0 0 0 2024-04-25T15:57:37.664 INFO:tasks.workunit.client.1.smithi155.stdout:8/261: fsync d2/d15/d18/d23/d3c/f47 0 2024-04-25T15:57:37.665 INFO:tasks.workunit.client.1.smithi155.stdout:5/407: write d0/f40 [591280,23551] 0 2024-04-25T15:57:37.667 INFO:tasks.workunit.client.1.smithi155.stdout:0/345: write d1/d3/fd [836232,93679] 0 2024-04-25T15:57:37.667 INFO:tasks.workunit.client.1.smithi155.stdout:9/315: dwrite dc/d13/d59/f5d [0,4194304] 0 2024-04-25T15:57:37.669 INFO:tasks.workunit.client.1.smithi155.stdout:8/262: write d2/d15/d18/d23/d3c/f4b [509390,122963] 0 2024-04-25T15:57:37.672 INFO:tasks.workunit.client.1.smithi155.stdout:2/420: dwrite d7/db/d2e/d44/f7f [0,4194304] 0 2024-04-25T15:57:37.672 INFO:tasks.workunit.client.1.smithi155.stdout:1/388: write d1/fb [333098,48743] 0 2024-04-25T15:57:37.675 INFO:tasks.workunit.client.1.smithi155.stdout:9/316: mknod dc/d13/d2e/c76 0 2024-04-25T15:57:37.678 INFO:tasks.workunit.client.1.smithi155.stdout:2/421: mkdir d7/db/d29/d83/d86 0 2024-04-25T15:57:37.680 INFO:tasks.workunit.client.1.smithi155.stdout:1/389: symlink d1/d16/d1d/d29/d5f/d34/l7e 0 2024-04-25T15:57:37.683 INFO:tasks.workunit.client.1.smithi155.stdout:9/317: rename dc/d44/l4e to dc/d11/l77 0 2024-04-25T15:57:37.686 INFO:tasks.workunit.client.1.smithi155.stdout:2/422: dwrite d7/db/f6c [0,4194304] 0 2024-04-25T15:57:37.687 INFO:tasks.workunit.client.1.smithi155.stdout:2/423: chown d7/db/d2e/d44 461201 1 2024-04-25T15:57:37.692 INFO:tasks.workunit.client.1.smithi155.stdout:1/390: truncate d1/d16/d1d/d29/d3d/d43/f48 2639473 0 2024-04-25T15:57:37.694 INFO:tasks.workunit.client.1.smithi155.stdout:7/408: dread d2/f8 [0,4194304] 0 2024-04-25T15:57:37.695 INFO:tasks.workunit.client.1.smithi155.stdout:9/318: dwrite dc/d11/f42 [4194304,4194304] 0 2024-04-25T15:57:37.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/391: truncate d1/d16/d1d/d5e/f63 308843 0 2024-04-25T15:57:37.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/392: readlink d1/d16/d1d/l60 0 2024-04-25T15:57:37.701 INFO:tasks.workunit.client.1.smithi155.stdout:9/319: creat dc/d11/d5a/f78 x:0 0 0 2024-04-25T15:57:37.702 INFO:tasks.workunit.client.1.smithi155.stdout:1/393: mkdir d1/d16/d7f 0 2024-04-25T15:57:37.703 INFO:tasks.workunit.client.1.smithi155.stdout:2/424: dwrite d7/db/f6c [0,4194304] 0 2024-04-25T15:57:37.708 INFO:tasks.workunit.client.1.smithi155.stdout:0/346: dread d1/d3f/f50 [4194304,4194304] 0 2024-04-25T15:57:37.710 INFO:tasks.workunit.client.1.smithi155.stdout:0/347: symlink d1/d6/l81 0 2024-04-25T15:57:37.711 INFO:tasks.workunit.client.1.smithi155.stdout:7/409: dwrite d2/dd/d13/d1c/f31 [4194304,4194304] 0 2024-04-25T15:57:37.712 INFO:tasks.workunit.client.1.smithi155.stdout:2/425: rename d7/db/dd/d15/f37 to d7/d23/f87 0 2024-04-25T15:57:37.718 INFO:tasks.workunit.client.1.smithi155.stdout:9/320: write dc/d13/f3b [6728,82980] 0 2024-04-25T15:57:37.720 INFO:tasks.workunit.client.1.smithi155.stdout:9/321: write dc/d11/d5a/f65 [377443,28617] 0 2024-04-25T15:57:37.721 INFO:tasks.workunit.client.1.smithi155.stdout:7/410: symlink d2/dd/d30/d44/d7f/l88 0 2024-04-25T15:57:37.721 INFO:tasks.workunit.client.1.smithi155.stdout:9/322: write dc/d13/d2e/f37 [701635,13755] 0 2024-04-25T15:57:37.724 INFO:tasks.workunit.client.1.smithi155.stdout:9/323: write dc/d13/d2e/f57 [2120001,124517] 0 2024-04-25T15:57:37.724 INFO:tasks.workunit.client.1.smithi155.stdout:2/426: getdents d7/db/d2e/d44 0 2024-04-25T15:57:37.725 INFO:tasks.workunit.client.1.smithi155.stdout:1/394: truncate d1/d16/d1d/d33/f64 297686 0 2024-04-25T15:57:37.727 INFO:tasks.workunit.client.1.smithi155.stdout:9/324: fsync dc/d11/f64 0 2024-04-25T15:57:37.727 INFO:tasks.workunit.client.1.smithi155.stdout:1/395: fsync d1/d6/f6b 0 2024-04-25T15:57:37.727 INFO:tasks.workunit.client.1.smithi155.stdout:0/348: symlink d1/d6/d29/l82 0 2024-04-25T15:57:37.730 INFO:tasks.workunit.client.1.smithi155.stdout:9/325: mknod dc/d3c/c79 0 2024-04-25T15:57:37.730 INFO:tasks.workunit.client.1.smithi155.stdout:1/396: creat d1/d16/d1d/d33/f80 x:0 0 0 2024-04-25T15:57:37.731 INFO:tasks.workunit.client.1.smithi155.stdout:0/349: mkdir d1/d3/d12/d83 0 2024-04-25T15:57:37.735 INFO:tasks.workunit.client.1.smithi155.stdout:7/411: dwrite d2/f1f [0,4194304] 0 2024-04-25T15:57:37.735 INFO:tasks.workunit.client.1.smithi155.stdout:9/326: mkdir dc/d13/d60/d7a 0 2024-04-25T15:57:37.735 INFO:tasks.workunit.client.1.smithi155.stdout:2/427: dread d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:37.737 INFO:tasks.workunit.client.1.smithi155.stdout:9/327: chown l2 94173 1 2024-04-25T15:57:37.737 INFO:tasks.workunit.client.1.smithi155.stdout:2/428: chown d7/db/dd/d15/f45 49405 1 2024-04-25T15:57:37.739 INFO:tasks.workunit.client.1.smithi155.stdout:7/412: readlink d2/dd/d30/d44/l6c 0 2024-04-25T15:57:37.739 INFO:tasks.workunit.client.1.smithi155.stdout:9/328: write dc/d11/d30/d46/f4b [831745,109599] 0 2024-04-25T15:57:37.740 INFO:tasks.workunit.client.1.smithi155.stdout:2/429: symlink d7/db/d29/l88 0 2024-04-25T15:57:37.741 INFO:tasks.workunit.client.1.smithi155.stdout:9/329: rmdir dc/d2f 39 2024-04-25T15:57:37.742 INFO:tasks.workunit.client.1.smithi155.stdout:1/397: dwrite d1/d16/d1d/d29/d3d/d43/f62 [0,4194304] 0 2024-04-25T15:57:37.742 INFO:tasks.workunit.client.1.smithi155.stdout:7/413: creat d2/dd/d36/f89 x:0 0 0 2024-04-25T15:57:37.745 INFO:tasks.workunit.client.1.smithi155.stdout:2/430: creat d7/db/dd/f89 x:0 0 0 2024-04-25T15:57:37.745 INFO:tasks.workunit.client.1.smithi155.stdout:1/398: mknod d1/c81 0 2024-04-25T15:57:37.748 INFO:tasks.workunit.client.1.smithi155.stdout:7/414: creat d2/d26/d3d/d6d/f8a x:0 0 0 2024-04-25T15:57:37.749 INFO:tasks.workunit.client.1.smithi155.stdout:7/415: fdatasync d2/f68 0 2024-04-25T15:57:37.749 INFO:tasks.workunit.client.1.smithi155.stdout:9/330: getdents dc/d13 0 2024-04-25T15:57:37.750 INFO:tasks.workunit.client.1.smithi155.stdout:7/416: write d2/f1b [2611400,89871] 0 2024-04-25T15:57:37.750 INFO:tasks.workunit.client.1.smithi155.stdout:1/399: mknod d1/d16/d1d/d29/c82 0 2024-04-25T15:57:37.752 INFO:tasks.workunit.client.1.smithi155.stdout:7/417: rmdir d2/dd/d13 39 2024-04-25T15:57:37.753 INFO:tasks.workunit.client.1.smithi155.stdout:1/400: mknod d1/d16/d1d/c83 0 2024-04-25T15:57:37.756 INFO:tasks.workunit.client.1.smithi155.stdout:1/401: unlink d1/d6/f2d 0 2024-04-25T15:57:37.758 INFO:tasks.workunit.client.1.smithi155.stdout:1/402: write d1/d16/d1d/d29/d5f/f5d [4360249,61530] 0 2024-04-25T15:57:37.758 INFO:tasks.workunit.client.1.smithi155.stdout:9/331: dwrite dc/d13/d59/f5d [0,4194304] 0 2024-04-25T15:57:37.761 INFO:tasks.workunit.client.1.smithi155.stdout:9/332: rmdir dc/d11 39 2024-04-25T15:57:37.762 INFO:tasks.workunit.client.1.smithi155.stdout:1/403: unlink d1/d16/d1d/d33/f80 0 2024-04-25T15:57:37.764 INFO:tasks.workunit.client.1.smithi155.stdout:6/478: sync 2024-04-25T15:57:37.764 INFO:tasks.workunit.client.1.smithi155.stdout:2/431: write d7/db/dd/d15/f1a [1098115,22536] 0 2024-04-25T15:57:37.766 INFO:tasks.workunit.client.1.smithi155.stdout:2/432: stat d7/db/d29/f54 0 2024-04-25T15:57:37.767 INFO:tasks.workunit.client.1.smithi155.stdout:6/479: write d0/d1a/d25/d2e/f31 [3207608,49322] 0 2024-04-25T15:57:37.769 INFO:tasks.workunit.client.1.smithi155.stdout:1/404: dread d1/d16/d1d/d29/d3d/d43/f62 [0,4194304] 0 2024-04-25T15:57:37.769 INFO:tasks.workunit.client.1.smithi155.stdout:6/480: fsync d0/d1a/d45/f92 0 2024-04-25T15:57:37.771 INFO:tasks.workunit.client.1.smithi155.stdout:1/405: mknod d1/d16/c84 0 2024-04-25T15:57:37.773 INFO:tasks.workunit.client.1.smithi155.stdout:6/481: mknod d0/d13/d43/ca0 0 2024-04-25T15:57:37.773 INFO:tasks.workunit.client.1.smithi155.stdout:1/406: chown d1/d16/d1d/d29/d5f/d34 87 1 2024-04-25T15:57:37.776 INFO:tasks.workunit.client.1.smithi155.stdout:6/482: truncate d0/f10 1659917 0 2024-04-25T15:57:37.777 INFO:tasks.workunit.client.1.smithi155.stdout:7/418: dread d2/dd/d12/f38 [0,4194304] 0 2024-04-25T15:57:37.777 INFO:tasks.workunit.client.1.smithi155.stdout:2/433: dwrite d7/db/dd/d15/f1d [0,4194304] 0 2024-04-25T15:57:37.778 INFO:tasks.workunit.client.1.smithi155.stdout:7/419: chown d2/d26 594949 1 2024-04-25T15:57:37.778 INFO:tasks.workunit.client.1.smithi155.stdout:1/407: getdents d1/d16/d37 0 2024-04-25T15:57:37.778 INFO:tasks.workunit.client.1.smithi155.stdout:6/483: rmdir d0/d18 39 2024-04-25T15:57:37.782 INFO:tasks.workunit.client.1.smithi155.stdout:2/434: rmdir d7/db/d29/d83 39 2024-04-25T15:57:37.784 INFO:tasks.workunit.client.1.smithi155.stdout:7/420: mkdir d2/dd/d13/d24/d8b 0 2024-04-25T15:57:37.786 INFO:tasks.workunit.client.1.smithi155.stdout:1/408: getdents d1/d16/d1d/d29/d5f/d34/d68 0 2024-04-25T15:57:37.787 INFO:tasks.workunit.client.1.smithi155.stdout:7/421: mkdir d2/dd/d66/d8c 0 2024-04-25T15:57:37.788 INFO:tasks.workunit.client.1.smithi155.stdout:6/484: dwrite d0/d1a/d25/f2d [4194304,4194304] 0 2024-04-25T15:57:37.788 INFO:tasks.workunit.client.1.smithi155.stdout:1/409: chown d1/d6/le 332026541 1 2024-04-25T15:57:37.789 INFO:tasks.workunit.client.1.smithi155.stdout:7/422: read d2/dd/d36/f73 [1691320,33183] 0 2024-04-25T15:57:37.789 INFO:tasks.workunit.client.1.smithi155.stdout:6/485: fdatasync d0/d13/f6a 0 2024-04-25T15:57:37.791 INFO:tasks.workunit.client.1.smithi155.stdout:2/435: dread d7/db/d29/f3a [0,4194304] 0 2024-04-25T15:57:37.791 INFO:tasks.workunit.client.1.smithi155.stdout:1/410: chown d1/d16/d1d/c57 93425552 1 2024-04-25T15:57:37.793 INFO:tasks.workunit.client.1.smithi155.stdout:2/436: rmdir d7/db/dd/d15/d60 39 2024-04-25T15:57:37.795 INFO:tasks.workunit.client.1.smithi155.stdout:7/423: dread d2/dd/d12/f5e [0,4194304] 0 2024-04-25T15:57:37.797 INFO:tasks.workunit.client.1.smithi155.stdout:1/411: link d1/d16/d37/f74 d1/d16/d1d/d29/d5f/f85 0 2024-04-25T15:57:37.799 INFO:tasks.workunit.client.1.smithi155.stdout:1/412: mkdir d1/d32/d86 0 2024-04-25T15:57:37.803 INFO:tasks.workunit.client.1.smithi155.stdout:2/437: dwrite d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:37.803 INFO:tasks.workunit.client.1.smithi155.stdout:1/413: creat d1/d32/d86/f87 x:0 0 0 2024-04-25T15:57:37.807 INFO:tasks.workunit.client.1.smithi155.stdout:1/414: mkdir d1/d16/d1d/d29/d3d/d43/d88 0 2024-04-25T15:57:37.807 INFO:tasks.workunit.client.1.smithi155.stdout:7/424: dwrite d2/f8 [0,4194304] 0 2024-04-25T15:57:37.809 INFO:tasks.workunit.client.1.smithi155.stdout:7/425: write d2/dd/f4e [1673407,34747] 0 2024-04-25T15:57:37.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 Processor -- start 2024-04-25T15:57:37.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 -- start start 2024-04-25T15:57:37.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c074930 0x7fc41c151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc41c06f8a0 0x7fc41c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41c06dbd0 con 0x7fc41c0aeca0 2024-04-25T15:57:37.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc41c151c40 con 0x7fc41c06f8a0 2024-04-25T15:57:37.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.807+0000 7fc421f96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c070440 con 0x7fc41c074930 2024-04-25T15:57:37.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc41c06f8a0 0x7fc41c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc41c06f8a0 0x7fc41c06fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36290/0 (socket says 172.21.15.87:36290) 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 -- 172.21.15.87:0/1328173240 learned_addr learned my addr 172.21.15.87:0/1328173240 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc413fff640 1 --2- 172.21.15.87:0/1328173240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c074930 0x7fc41c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 -- 172.21.15.87:0/1328173240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c074930 msgr2=0x7fc41c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 --2- 172.21.15.87:0/1328173240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c074930 0x7fc41c151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 -- 172.21.15.87:0/1328173240 >> v1:172.21.15.155:6789/0 conn(0x7fc41c0aeca0 legacy=0x7fc41c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 -- 172.21.15.87:0/1328173240 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c154870 con 0x7fc41c06f8a0 2024-04-25T15:57:37.815 INFO:tasks.workunit.client.1.smithi155.stdout:7/426: read d2/dd/f23 [2036751,46594] 0 2024-04-25T15:57:37.816 INFO:tasks.workunit.client.1.smithi155.stdout:6/486: dread d0/f4f [0,4194304] 0 2024-04-25T15:57:37.816 INFO:tasks.workunit.client.1.smithi155.stdout:2/438: dwrite d7/db/f59 [0,4194304] 0 2024-04-25T15:57:37.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41bfff640 1 --2- 172.21.15.87:0/1328173240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c06f8a0 0x7fc41c06fcb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc414009e50 tx=0x7fc41401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18f0f85684f44f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:37.817 INFO:tasks.workunit.client.1.smithi155.stdout:7/427: read - d2/dd/d36/d46/f83 zero size 2024-04-25T15:57:37.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41affd640 1 -- 172.21.15.87:0/1328173240 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140a56c0 con 0x7fc41c06f8a0 2024-04-25T15:57:37.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41affd640 1 -- 172.21.15.87:0/1328173240 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4140a5860 con 0x7fc41c06f8a0 2024-04-25T15:57:37.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.811+0000 7fc41affd640 1 -- 172.21.15.87:0/1328173240 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140a5c30 con 0x7fc41c06f8a0 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 -- 172.21.15.87:0/1328173240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c06f8a0 msgr2=0x7fc41c06fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 --2- 172.21.15.87:0/1328173240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c06f8a0 0x7fc41c06fcb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc414009e50 tx=0x7fc41401c910 comp rx=0 tx=0).stop 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 -- 172.21.15.87:0/1328173240 shutdown_connections 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 --2- 172.21.15.87:0/1328173240 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c074930 0x7fc41c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 --2- 172.21.15.87:0/1328173240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c06f8a0 0x7fc41c06fcb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 -- 172.21.15.87:0/1328173240 >> 172.21.15.87:0/1328173240 conn(0x7fc41c06d650 msgr2=0x7fc41c0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 -- 172.21.15.87:0/1328173240 shutdown_connections 2024-04-25T15:57:37.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 -- 172.21.15.87:0/1328173240 wait complete. 2024-04-25T15:57:37.820 INFO:tasks.workunit.client.1.smithi155.stdout:2/439: write d7/f77 [656556,66240] 0 2024-04-25T15:57:37.820 INFO:tasks.workunit.client.1.smithi155.stdout:7/428: mknod d2/dd/d12/c8d 0 2024-04-25T15:57:37.821 INFO:tasks.workunit.client.1.smithi155.stdout:1/415: link d1/d16/d1d/d29/c82 d1/d16/d1d/d29/d5f/d34/d68/c89 0 2024-04-25T15:57:37.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 Processor -- start 2024-04-25T15:57:37.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.815+0000 7fc421f96640 1 -- start start 2024-04-25T15:57:37.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/487: mkdir d0/d1a/da1 0 2024-04-25T15:57:37.823 INFO:tasks.workunit.client.1.smithi155.stdout:2/440: creat d7/db/d2e/f8a x:0 0 0 2024-04-25T15:57:37.824 INFO:tasks.workunit.client.1.smithi155.stdout:1/416: creat d1/d16/d1d/d29/d5f/d34/d68/f8a x:0 0 0 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc421f96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c06f8a0 0x7fc41c0acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc421f96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc41c074930 0x7fc41c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc421f96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 0x7fc41c1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc421f96640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c1612c0 con 0x7fc41c0aeca0 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc421f96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc41c074410 con 0x7fc41c074930 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc421f96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc41c161440 con 0x7fc41c06f8a0 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 0x7fc41c1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 0x7fc41c1450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36296/0 (socket says 172.21.15.87:36296) 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 -- 172.21.15.87:0/1466659586 learned_addr learned my addr 172.21.15.87:0/1466659586 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41b7fe640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c06f8a0 0x7fc41c0acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc413fff640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc41c074930 0x7fc41c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 -- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c06f8a0 msgr2=0x7fc41c0acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c06f8a0 0x7fc41c0acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 -- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc41c074930 msgr2=0x7fc41c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc41c074930 0x7fc41c0ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.819+0000 7fc41bfff640 1 -- 172.21.15.87:0/1466659586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41c0c6d40 con 0x7fc41c0aeca0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc41bfff640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 0x7fc41c1450d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc41401a540 tx=0x7fc4140196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4140bc020 con 0x7fc41c0aeca0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4140b8670 con 0x7fc41c0aeca0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41c1eda10 con 0x7fc41c0aeca0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414009510 con 0x7fc41c0aeca0 2024-04-25T15:57:37.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41c1448d0 con 0x7fc41c0aeca0 2024-04-25T15:57:37.828 INFO:tasks.workunit.client.1.smithi155.stdout:2/441: mkdir d7/db/d29/d83/d86/d8b 0 2024-04-25T15:57:37.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41c0c6f10 con 0x7fc41c0aeca0 2024-04-25T15:57:37.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc4140bf020 con 0x7fc41c0aeca0 2024-04-25T15:57:37.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc418ff9640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc3fc06f400 0x7fc3fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:37.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7fc41412a420 con 0x7fc41c0aeca0 2024-04-25T15:57:37.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc41b7fe640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc3fc06f400 0x7fc3fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:37.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.823+0000 7fc41b7fe640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc3fc06f400 0x7fc3fc071910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc40c007fd0 tx=0x7fc40c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:37.829 INFO:tasks.workunit.client.1.smithi155.stdout:1/417: unlink d1/d6/le 0 2024-04-25T15:57:37.834 INFO:tasks.workunit.client.1.smithi155.stdout:7/429: dwrite d2/f5b [4194304,4194304] 0 2024-04-25T15:57:37.834 INFO:tasks.workunit.client.1.smithi155.stdout:1/418: symlink d1/d16/d1d/d29/d3d/l8b 0 2024-04-25T15:57:37.835 INFO:tasks.workunit.client.1.smithi155.stdout:7/430: creat d2/dd/d13/f8e x:0 0 0 2024-04-25T15:57:37.837 INFO:tasks.workunit.client.1.smithi155.stdout:6/488: dwrite d0/d1a/d21/d73/f5a [0,4194304] 0 2024-04-25T15:57:37.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:37.835+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4140c6030 con 0x7fc41c0aeca0 2024-04-25T15:57:37.838 INFO:tasks.workunit.client.1.smithi155.stdout:6/489: chown d0/d1a/d21/d73/l78 63383394 1 2024-04-25T15:57:37.844 INFO:tasks.workunit.client.1.smithi155.stdout:7/431: dwrite d2/d26/d3d/d6d/f79 [0,4194304] 0 2024-04-25T15:57:37.846 INFO:tasks.workunit.client.1.smithi155.stdout:7/432: fdatasync d2/dd/d12/f20 0 2024-04-25T15:57:37.846 INFO:tasks.workunit.client.1.smithi155.stdout:7/433: chown d2/dd/d63/f77 11559538 1 2024-04-25T15:57:37.850 INFO:tasks.workunit.client.1.smithi155.stdout:7/434: link d2/dd/d13/d24/l45 d2/d26/d3d/d6d/l8f 0 2024-04-25T15:57:37.853 INFO:tasks.workunit.client.1.smithi155.stdout:6/490: read d0/d1a/d25/f2b [982676,130968] 0 2024-04-25T15:57:37.856 INFO:tasks.workunit.client.1.smithi155.stdout:6/491: creat d0/d1a/d45/d61/fa2 x:0 0 0 2024-04-25T15:57:37.856 INFO:tasks.workunit.client.1.smithi155.stdout:7/435: dread d2/dd/d63/f77 [0,4194304] 0 2024-04-25T15:57:37.857 INFO:tasks.workunit.client.1.smithi155.stdout:6/492: chown d0/d13/d7c/c95 274365 1 2024-04-25T15:57:37.857 INFO:tasks.workunit.client.1.smithi155.stdout:7/436: stat d2/d26/d3d/d65 0 2024-04-25T15:57:37.860 INFO:tasks.workunit.client.1.smithi155.stdout:7/437: creat d2/dd/d66/d8c/f90 x:0 0 0 2024-04-25T15:57:37.861 INFO:tasks.workunit.client.1.smithi155.stdout:7/438: write d2/dd/d12/f20 [631553,35616] 0 2024-04-25T15:57:37.863 INFO:tasks.workunit.client.1.smithi155.stdout:7/439: creat d2/f91 x:0 0 0 2024-04-25T15:57:37.865 INFO:tasks.workunit.client.1.smithi155.stdout:6/493: write d0/d1a/d45/f92 [4728117,25509] 0 2024-04-25T15:57:37.865 INFO:tasks.workunit.client.1.smithi155.stdout:7/440: write d2/dd/d13/d1c/f1e [2394119,8253] 0 2024-04-25T15:57:37.866 INFO:tasks.workunit.client.1.smithi155.stdout:7/441: chown d2/dd/d30/d44/l4f 1344612 1 2024-04-25T15:57:37.867 INFO:tasks.workunit.client.1.smithi155.stdout:7/442: chown d2/dd/d12 14569038 1 2024-04-25T15:57:37.869 INFO:tasks.workunit.client.1.smithi155.stdout:7/443: mknod d2/dd/d66/d8c/c92 0 2024-04-25T15:57:37.871 INFO:tasks.workunit.client.1.smithi155.stdout:1/419: dread d1/d16/d1d/d29/d5f/d34/f36 [0,4194304] 0 2024-04-25T15:57:37.872 INFO:tasks.workunit.client.1.smithi155.stdout:1/420: dread - d1/d16/d1d/f65 zero size 2024-04-25T15:57:37.873 INFO:tasks.workunit.client.1.smithi155.stdout:7/444: link d2/dd/d36/c6e d2/dd/d66/d71/c93 0 2024-04-25T15:57:37.874 INFO:tasks.workunit.client.1.smithi155.stdout:6/494: dwrite d0/d1a/d45/f52 [0,4194304] 0 2024-04-25T15:57:37.874 INFO:tasks.workunit.client.1.smithi155.stdout:1/421: chown d1/d16/d37/l5a 15688778 1 2024-04-25T15:57:37.875 INFO:tasks.workunit.client.1.smithi155.stdout:6/495: chown d0/d13/f20 3 1 2024-04-25T15:57:37.875 INFO:tasks.workunit.client.1.smithi155.stdout:7/445: write d2/dd/d63/f77 [216888,62225] 0 2024-04-25T15:57:37.876 INFO:tasks.workunit.client.1.smithi155.stdout:1/422: read d1/d16/f2c [1201741,26093] 0 2024-04-25T15:57:37.880 INFO:tasks.workunit.client.1.smithi155.stdout:7/446: creat d2/f94 x:0 0 0 2024-04-25T15:57:37.881 INFO:tasks.workunit.client.1.smithi155.stdout:1/423: rmdir d1/d32 39 2024-04-25T15:57:37.883 INFO:tasks.workunit.client.1.smithi155.stdout:6/496: creat d0/d1a/d87/fa3 x:0 0 0 2024-04-25T15:57:37.884 INFO:tasks.workunit.client.1.smithi155.stdout:7/447: creat d2/d26/d3d/d6d/f95 x:0 0 0 2024-04-25T15:57:37.885 INFO:tasks.workunit.client.1.smithi155.stdout:3/432: sync 2024-04-25T15:57:37.885 INFO:tasks.workunit.client.1.smithi155.stdout:7/448: dread - d2/d26/d3d/d65/f86 zero size 2024-04-25T15:57:37.885 INFO:tasks.workunit.client.1.smithi155.stdout:6/497: symlink d0/d1a/d45/d61/la4 0 2024-04-25T15:57:37.886 INFO:tasks.workunit.client.1.smithi155.stdout:7/449: dread - d2/dd/f74 zero size 2024-04-25T15:57:37.886 INFO:tasks.workunit.client.1.smithi155.stdout:6/498: dread - d0/d1a/d25/d51/f84 zero size 2024-04-25T15:57:37.886 INFO:tasks.workunit.client.1.smithi155.stdout:3/433: mknod d1/d4/db/d20/d44/c8f 0 2024-04-25T15:57:37.887 INFO:tasks.workunit.client.1.smithi155.stdout:6/499: fdatasync d0/f46 0 2024-04-25T15:57:37.891 INFO:tasks.workunit.client.1.smithi155.stdout:3/434: rename d1/d4/d10/d21/d73/d77/d57/l6e to d1/d4/d10/d21/d73/d8d/l90 0 2024-04-25T15:57:37.892 INFO:tasks.workunit.client.1.smithi155.stdout:7/450: dwrite d2/d26/d3d/d6d/f79 [0,4194304] 0 2024-04-25T15:57:37.893 INFO:tasks.workunit.client.1.smithi155.stdout:3/435: write d1/d4/d10/d21/d73/d77/d57/f71 [635126,59885] 0 2024-04-25T15:57:37.897 INFO:tasks.workunit.client.1.smithi155.stdout:7/451: mknod d2/dd/d12/d76/c96 0 2024-04-25T15:57:37.897 INFO:tasks.workunit.client.1.smithi155.stdout:3/436: dread - d1/d4/d10/d21/d73/f82 zero size 2024-04-25T15:57:37.898 INFO:tasks.workunit.client.1.smithi155.stdout:7/452: fsync d2/d26/d3d/d65/f72 0 2024-04-25T15:57:37.900 INFO:tasks.workunit.client.1.smithi155.stdout:3/437: chown d1/c1e 9252 1 2024-04-25T15:57:37.901 INFO:tasks.workunit.client.1.smithi155.stdout:6/500: dwrite d0/d18/f48 [4194304,4194304] 0 2024-04-25T15:57:37.902 INFO:tasks.workunit.client.1.smithi155.stdout:3/438: dread - d1/d4/d10/d21/d73/d77/d57/f65 zero size 2024-04-25T15:57:37.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/453: truncate d2/dd/d12/f78 554723 0 2024-04-25T15:57:37.923 INFO:tasks.workunit.client.1.smithi155.stdout:3/439: dwrite d1/d4/d10/d21/d73/f59 [0,4194304] 0 2024-04-25T15:57:37.933 INFO:tasks.workunit.client.1.smithi155.stdout:3/440: dwrite d1/d4/f41 [0,4194304] 0 2024-04-25T15:57:37.937 INFO:tasks.workunit.client.1.smithi155.stdout:3/441: mkdir d1/d4/db/d91 0 2024-04-25T15:57:37.938 INFO:tasks.workunit.client.1.smithi155.stdout:3/442: readlink d1/d4/l13 0 2024-04-25T15:57:37.939 INFO:tasks.workunit.client.1.smithi155.stdout:3/443: chown d1/d4/db/d20/d44/c8f 1356351 1 2024-04-25T15:57:37.940 INFO:tasks.workunit.client.1.smithi155.stdout:3/444: write d1/d4/db/f35 [5190779,69445] 0 2024-04-25T15:57:37.941 INFO:tasks.workunit.client.1.smithi155.stdout:3/445: write d1/d4/f18 [9408737,59507] 0 2024-04-25T15:57:37.955 INFO:tasks.workunit.client.1.smithi155.stdout:3/446: dread d1/d4/d10/d21/f5a [0,4194304] 0 2024-04-25T15:57:37.958 INFO:tasks.workunit.client.1.smithi155.stdout:3/447: getdents d1/d4/d6a 0 2024-04-25T15:57:37.961 INFO:tasks.workunit.client.1.smithi155.stdout:3/448: creat d1/d4/db/d28/d58/f92 x:0 0 0 2024-04-25T15:57:37.962 INFO:tasks.workunit.client.1.smithi155.stdout:3/449: read d1/d4/f2c [2918144,51540] 0 2024-04-25T15:57:37.964 INFO:tasks.workunit.client.1.smithi155.stdout:3/450: mkdir d1/d4/db/d20/d44/d52/d93 0 2024-04-25T15:57:37.968 INFO:tasks.workunit.client.1.smithi155.stdout:3/451: dread d1/d4/db/d20/f4c [0,4194304] 0 2024-04-25T15:57:37.968 INFO:tasks.workunit.client.1.smithi155.stdout:3/452: chown d1 12056 1 2024-04-25T15:57:37.969 INFO:tasks.workunit.client.1.smithi155.stdout:3/453: write d1/d4/f41 [5018423,126935] 0 2024-04-25T15:57:37.997 INFO:tasks.workunit.client.1.smithi155.stdout:4/347: sync 2024-04-25T15:57:37.997 INFO:tasks.workunit.client.1.smithi155.stdout:5/408: sync 2024-04-25T15:57:37.998 INFO:tasks.workunit.client.1.smithi155.stdout:3/454: chown d1/d4/d10/f14 22153 1 2024-04-25T15:57:38.000 INFO:tasks.workunit.client.1.smithi155.stdout:3/455: write d1/d4/d10/d21/d73/d77/d5f/f84 [700905,105377] 0 2024-04-25T15:57:38.013 INFO:tasks.workunit.client.1.smithi155.stdout:4/348: symlink da/dc/d77/l7a 0 2024-04-25T15:57:38.042 INFO:tasks.workunit.client.1.smithi155.stdout:4/349: dwrite da/d30/f6d [0,4194304] 0 2024-04-25T15:57:38.042 INFO:tasks.workunit.client.1.smithi155.stdout:5/409: rmdir d0/d3/d15/d1f 39 2024-04-25T15:57:38.047 INFO:tasks.workunit.client.1.smithi155.stdout:4/350: mkdir da/d23/d3a/d7b 0 2024-04-25T15:57:38.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc41c069bb0 con 0x7fc41c0aeca0 2024-04-25T15:57:38.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc418ff9640 1 -- 172.21.15.87:0/1466659586 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7fc414016620 con 0x7fc41c0aeca0 2024-04-25T15:57:38.051 INFO:tasks.workunit.client.1.smithi155.stdout:3/456: dread d1/d4/d10/f14 [0,4194304] 0 2024-04-25T15:57:38.051 INFO:tasks.workunit.client.1.smithi155.stdout:4/351: unlink da/dc/d77/l7a 0 2024-04-25T15:57:38.051 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:38.051 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:38.052 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:38.053 INFO:tasks.workunit.client.1.smithi155.stdout:4/352: creat da/d23/d3f/d56/f7c x:0 0 0 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc3fc06f400 msgr2=0x7fc3fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc3fc06f400 0x7fc3fc071910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc40c007fd0 tx=0x7fc40c009040 comp rx=0 tx=0).stop 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 msgr2=0x7fc41c1450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 0x7fc41c1450d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc41401a540 tx=0x7fc4140196b0 comp rx=0 tx=0).stop 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 shutdown_connections 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc3fc06f400 0x7fc3fc071910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc41c0aeca0 0x7fc41c1450d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc41c074930 0x7fc41c0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 --2- 172.21.15.87:0/1466659586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc41c06f8a0 0x7fc41c0acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.047+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 >> 172.21.15.87:0/1466659586 conn(0x7fc41c06d650 msgr2=0x7fc41c150490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:38.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.051+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 shutdown_connections 2024-04-25T15:57:38.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:38.051+0000 7fc421f96640 1 -- 172.21.15.87:0/1466659586 wait complete. 2024-04-25T15:57:38.055 INFO:tasks.workunit.client.1.smithi155.stdout:4/353: write da/f4d [4546697,122349] 0 2024-04-25T15:57:38.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/457: mkdir d1/d94 0 2024-04-25T15:57:38.058 INFO:tasks.workunit.client.1.smithi155.stdout:4/354: creat da/d23/d3f/d56/d69/d4a/d6b/f7d x:0 0 0 2024-04-25T15:57:38.059 INFO:tasks.workunit.client.1.smithi155.stdout:3/458: creat d1/d94/f95 x:0 0 0 2024-04-25T15:57:38.060 INFO:tasks.workunit.client.1.smithi155.stdout:4/355: readlink da/d23/d3f/l72 0 2024-04-25T15:57:38.060 INFO:tasks.workunit.client.1.smithi155.stdout:3/459: read - d1/d4/db/f8a zero size 2024-04-25T15:57:38.060 INFO:tasks.workunit.client.1.smithi155.stdout:4/356: readlink da/dc/l3c 0 2024-04-25T15:57:38.061 INFO:tasks.workunit.client.1.smithi155.stdout:3/460: write d1/d4/db/f11 [514996,51074] 0 2024-04-25T15:57:38.064 INFO:tasks.workunit.client.1.smithi155.stdout:4/357: rename da/f4b to da/d23/d3f/d56/d69/d4a/d78/d62/f7e 0 2024-04-25T15:57:38.067 INFO:tasks.workunit.client.1.smithi155.stdout:4/358: creat da/d23/d3f/d56/d69/d4a/d78/f7f x:0 0 0 2024-04-25T15:57:38.069 INFO:tasks.workunit.client.1.smithi155.stdout:3/461: dwrite d1/d4/db/f7d [0,4194304] 0 2024-04-25T15:57:38.072 INFO:tasks.workunit.client.1.smithi155.stdout:3/462: creat d1/d4/d10/d21/f96 x:0 0 0 2024-04-25T15:57:38.074 INFO:tasks.workunit.client.1.smithi155.stdout:3/463: write d1/d4/db/d20/d44/f48 [4388886,40901] 0 2024-04-25T15:57:38.075 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:38.077 INFO:tasks.workunit.client.1.smithi155.stdout:3/464: creat d1/d4/db/d91/f97 x:0 0 0 2024-04-25T15:57:38.080 INFO:tasks.workunit.client.1.smithi155.stdout:3/465: mknod d1/d4/c98 0 2024-04-25T15:57:38.081 INFO:tasks.workunit.client.1.smithi155.stdout:4/359: dread da/dc/d18/f5f [0,4194304] 0 2024-04-25T15:57:38.085 INFO:tasks.workunit.client.1.smithi155.stdout:3/466: creat d1/d4/d10/d21/d73/f99 x:0 0 0 2024-04-25T15:57:38.085 INFO:tasks.workunit.client.1.smithi155.stdout:0/350: sync 2024-04-25T15:57:38.085 INFO:tasks.workunit.client.1.smithi155.stdout:9/333: sync 2024-04-25T15:57:38.085 INFO:tasks.workunit.client.1.smithi155.stdout:8/263: sync 2024-04-25T15:57:38.086 INFO:tasks.workunit.client.1.smithi155.stdout:8/264: readlink d2/d5/lf 0 2024-04-25T15:57:38.086 INFO:tasks.workunit.client.1.smithi155.stdout:0/351: stat d1/d41/f7f 0 2024-04-25T15:57:38.087 INFO:tasks.workunit.client.1.smithi155.stdout:8/265: write d2/f33 [3137869,117173] 0 2024-04-25T15:57:38.088 INFO:tasks.workunit.client.1.smithi155.stdout:0/352: write d1/d3/d5/f54 [518791,78696] 0 2024-04-25T15:57:38.090 INFO:tasks.workunit.client.1.smithi155.stdout:9/334: creat dc/d2f/f7b x:0 0 0 2024-04-25T15:57:38.094 INFO:tasks.workunit.client.1.smithi155.stdout:9/335: mknod dc/d13/d2e/d4c/c7c 0 2024-04-25T15:57:38.097 INFO:tasks.workunit.client.1.smithi155.stdout:4/360: dwrite da/d30/f6d [0,4194304] 0 2024-04-25T15:57:38.097 INFO:tasks.workunit.client.1.smithi155.stdout:8/266: dread d2/d15/d35/f44 [0,4194304] 0 2024-04-25T15:57:38.098 INFO:tasks.workunit.client.1.smithi155.stdout:3/467: dwrite d1/d4/d10/d21/d73/f59 [0,4194304] 0 2024-04-25T15:57:38.099 INFO:tasks.workunit.client.1.smithi155.stdout:8/267: stat d2/d15/d18/d23/d3c/d4a 0 2024-04-25T15:57:38.100 INFO:tasks.workunit.client.1.smithi155.stdout:8/268: write d2/d15/d18/d23/d3c/f4b [567678,118914] 0 2024-04-25T15:57:38.101 INFO:tasks.workunit.client.1.smithi155.stdout:0/353: getdents d1/d6/d16/d60 0 2024-04-25T15:57:38.101 INFO:tasks.workunit.client.1.smithi155.stdout:9/336: rmdir dc/d13/d2e/d4c 39 2024-04-25T15:57:38.102 INFO:tasks.workunit.client.1.smithi155.stdout:4/361: symlink da/dc/l80 0 2024-04-25T15:57:38.106 INFO:tasks.workunit.client.1.smithi155.stdout:0/354: creat d1/d3/d12/f84 x:0 0 0 2024-04-25T15:57:38.192 INFO:tasks.workunit.client.1.smithi155.stdout:4/362: write da/dc/f2f [1424246,118209] 0 2024-04-25T15:57:38.193 INFO:tasks.workunit.client.1.smithi155.stdout:3/468: dwrite d1/d4/d10/d21/d73/d77/d5f/f7e [0,4194304] 0 2024-04-25T15:57:38.194 INFO:tasks.workunit.client.1.smithi155.stdout:0/355: read - d1/d6/f75 zero size 2024-04-25T15:57:38.200 INFO:tasks.workunit.client.1.smithi155.stdout:8/269: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:38.205 INFO:tasks.workunit.client.1.smithi155.stdout:3/469: dread d1/d4/d10/d21/f22 [0,4194304] 0 2024-04-25T15:57:38.209 INFO:tasks.workunit.client.1.smithi155.stdout:9/337: dwrite dc/d17/d18/f2d [0,4194304] 0 2024-04-25T15:57:38.210 INFO:tasks.workunit.client.1.smithi155.stdout:3/470: readlink d1/d4/d10/d21/d73/l63 0 2024-04-25T15:57:38.214 INFO:tasks.workunit.client.1.smithi155.stdout:9/338: chown dc/cd 3257 1 2024-04-25T15:57:38.226 INFO:tasks.workunit.client.1.smithi155.stdout:3/471: symlink d1/d4/db/d20/d44/d52/d61/l9a 0 2024-04-25T15:57:38.228 INFO:tasks.workunit.client.1.smithi155.stdout:4/363: dwrite da/f21 [0,4194304] 0 2024-04-25T15:57:38.234 INFO:tasks.workunit.client.1.smithi155.stdout:4/364: mknod da/dc/c81 0 2024-04-25T15:57:38.237 INFO:tasks.workunit.client.1.smithi155.stdout:8/270: truncate d2/d15/d18/d49/f3a 3464760 0 2024-04-25T15:57:38.242 INFO:tasks.workunit.client.1.smithi155.stdout:4/365: write da/d23/d3f/d56/d69/d4a/d78/f31 [192447,111854] 0 2024-04-25T15:57:38.242 INFO:tasks.workunit.client.1.smithi155.stdout:2/442: sync 2024-04-25T15:57:38.242 INFO:tasks.workunit.client.1.smithi155.stdout:9/339: truncate dc/d17/f2b 3731393 0 2024-04-25T15:57:38.244 INFO:tasks.workunit.client.1.smithi155.stdout:2/443: stat d7/db/l5b 0 2024-04-25T15:57:38.246 INFO:tasks.workunit.client.1.smithi155.stdout:4/366: write da/dc/f1f [2441346,33195] 0 2024-04-25T15:57:38.248 INFO:tasks.workunit.client.1.smithi155.stdout:8/271: creat d2/d15/d18/d34/d48/f50 x:0 0 0 2024-04-25T15:57:38.249 INFO:tasks.workunit.client.1.smithi155.stdout:2/444: chown d7/db/d29/f54 6 1 2024-04-25T15:57:38.249 INFO:tasks.workunit.client.1.smithi155.stdout:3/472: dwrite d1/d4/db/d28/d58/f92 [0,4194304] 0 2024-04-25T15:57:38.261 INFO:tasks.workunit.client.1.smithi155.stdout:9/340: rename dc/d13/d2e/c76 to dc/d17/d2a/c7d 0 2024-04-25T15:57:38.263 INFO:tasks.workunit.client.1.smithi155.stdout:9/341: chown dc/d13/d59 6094608 1 2024-04-25T15:57:38.265 INFO:tasks.workunit.client.1.smithi155.stdout:9/342: write dc/d13/f54 [556940,80122] 0 2024-04-25T15:57:38.275 INFO:tasks.workunit.client.1.smithi155.stdout:4/367: rename da/dc/l80 to da/d23/d3f/d56/d69/d4a/d78/d62/l82 0 2024-04-25T15:57:38.281 INFO:tasks.workunit.client.1.smithi155.stdout:2/445: symlink d7/db/dd/d15/d60/l8c 0 2024-04-25T15:57:38.288 INFO:tasks.workunit.client.1.smithi155.stdout:3/473: link d1/d4/db/f7d d1/d4/d6a/d86/f9b 0 2024-04-25T15:57:38.293 INFO:tasks.workunit.client.1.smithi155.stdout:4/368: rename da/d23/d3f/d56/d69/d4a/d6b to da/d23/d3f/d56/d69/d83 0 2024-04-25T15:57:38.294 INFO:tasks.workunit.client.1.smithi155.stdout:2/446: write d7/f2d [1399324,107883] 0 2024-04-25T15:57:38.298 INFO:tasks.workunit.client.1.smithi155.stdout:8/272: getdents d2/d15/d18/d23/d2d 0 2024-04-25T15:57:38.304 INFO:tasks.workunit.client.1.smithi155.stdout:9/343: rename dc/d13/d59/f5e to dc/d11/d67/f7e 0 2024-04-25T15:57:38.305 INFO:tasks.workunit.client.1.smithi155.stdout:9/344: readlink dc/d11/d30/d46/l75 0 2024-04-25T15:57:38.308 INFO:tasks.workunit.client.1.smithi155.stdout:9/345: read dc/d17/d2a/f2c [622873,56324] 0 2024-04-25T15:57:38.314 INFO:tasks.workunit.client.1.smithi155.stdout:2/447: mknod d7/db/c8d 0 2024-04-25T15:57:38.316 INFO:tasks.workunit.client.1.smithi155.stdout:8/273: dwrite d2/d15/d35/f44 [0,4194304] 0 2024-04-25T15:57:38.317 INFO:tasks.workunit.client.1.smithi155.stdout:3/474: getdents d1/d4/d10/d21/d73/d77/d5f 0 2024-04-25T15:57:38.318 INFO:tasks.workunit.client.1.smithi155.stdout:8/274: write d2/d15/d35/f44 [4428847,73436] 0 2024-04-25T15:57:38.319 INFO:tasks.workunit.client.1.smithi155.stdout:7/454: sync 2024-04-25T15:57:38.319 INFO:tasks.workunit.client.1.smithi155.stdout:6/501: sync 2024-04-25T15:57:38.319 INFO:tasks.workunit.client.1.smithi155.stdout:1/424: sync 2024-04-25T15:57:38.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/448: readlink d7/db/l53 0 2024-04-25T15:57:38.321 INFO:tasks.workunit.client.1.smithi155.stdout:4/369: getdents da/d23/d3a 0 2024-04-25T15:57:38.323 INFO:tasks.workunit.client.1.smithi155.stdout:4/370: read da/dc/f2f [302863,113651] 0 2024-04-25T15:57:38.326 INFO:tasks.workunit.client.1.smithi155.stdout:3/475: write d1/d4/db/f7d [635189,107394] 0 2024-04-25T15:57:38.326 INFO:tasks.workunit.client.1.smithi155.stdout:4/371: write da/d23/f57 [1829101,21] 0 2024-04-25T15:57:38.330 INFO:tasks.workunit.client.1.smithi155.stdout:7/455: dread d2/f1f [0,4194304] 0 2024-04-25T15:57:38.331 INFO:tasks.workunit.client.1.smithi155.stdout:7/456: chown d2/dd/f74 6391 1 2024-04-25T15:57:38.335 INFO:tasks.workunit.client.1.smithi155.stdout:6/502: mkdir d0/d13/d34/d38/d90/da5 0 2024-04-25T15:57:38.337 INFO:tasks.workunit.client.1.smithi155.stdout:9/346: getdents dc/d17/d2a 0 2024-04-25T15:57:38.341 INFO:tasks.workunit.client.1.smithi155.stdout:4/372: creat da/d23/d3f/d56/d69/d4a/d78/f84 x:0 0 0 2024-04-25T15:57:38.344 INFO:tasks.workunit.client.1.smithi155.stdout:6/503: dwrite d0/d13/f6a [4194304,4194304] 0 2024-04-25T15:57:38.344 INFO:tasks.workunit.client.1.smithi155.stdout:7/457: creat d2/d26/d3d/d6d/f97 x:0 0 0 2024-04-25T15:57:38.345 INFO:tasks.workunit.client.1.smithi155.stdout:6/504: stat d0/d13/f20 0 2024-04-25T15:57:38.346 INFO:tasks.workunit.client.1.smithi155.stdout:7/458: chown d2/dd/d36/f89 133066 1 2024-04-25T15:57:38.346 INFO:tasks.workunit.client.1.smithi155.stdout:6/505: chown d0/d1a/d45/f52 2700387 1 2024-04-25T15:57:38.348 INFO:tasks.workunit.client.1.smithi155.stdout:7/459: write d2/d26/d3d/d6d/f5d [655959,48105] 0 2024-04-25T15:57:38.348 INFO:tasks.workunit.client.1.smithi155.stdout:6/506: fdatasync d0/d13/d34/d38/f88 0 2024-04-25T15:57:38.350 INFO:tasks.workunit.client.1.smithi155.stdout:3/476: symlink d1/d4/l9c 0 2024-04-25T15:57:38.353 INFO:tasks.workunit.client.1.smithi155.stdout:4/373: creat da/d30/f85 x:0 0 0 2024-04-25T15:57:38.358 INFO:tasks.workunit.client.1.smithi155.stdout:6/507: dwrite d0/d13/d43/f42 [0,4194304] 0 2024-04-25T15:57:38.361 INFO:tasks.workunit.client.1.smithi155.stdout:9/347: dread dc/d13/f3a [0,4194304] 0 2024-04-25T15:57:38.361 INFO:tasks.workunit.client.1.smithi155.stdout:7/460: creat d2/d26/d47/f98 x:0 0 0 2024-04-25T15:57:38.362 INFO:tasks.workunit.client.1.smithi155.stdout:3/477: creat d1/d4/db/d91/f9d x:0 0 0 2024-04-25T15:57:38.366 INFO:tasks.workunit.client.1.smithi155.stdout:2/449: write d7/d23/f87 [476872,3423] 0 2024-04-25T15:57:38.371 INFO:tasks.workunit.client.1.smithi155.stdout:7/461: rename d2/dd/d30/d44/l4f to d2/dd/d63/l99 0 2024-04-25T15:57:38.371 INFO:tasks.workunit.client.1.smithi155.stdout:1/425: dwrite d1/d16/d1d/d29/d5f/f49 [0,4194304] 0 2024-04-25T15:57:38.372 INFO:tasks.workunit.client.1.smithi155.stdout:1/426: chown d1 560076 1 2024-04-25T15:57:38.374 INFO:tasks.workunit.client.1.smithi155.stdout:6/508: creat d0/d13/d34/d38/d7a/fa6 x:0 0 0 2024-04-25T15:57:38.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/462: dread d2/d26/f58 [0,4194304] 0 2024-04-25T15:57:38.384 INFO:tasks.workunit.client.1.smithi155.stdout:9/348: rmdir dc/d44 0 2024-04-25T15:57:38.386 INFO:tasks.workunit.client.1.smithi155.stdout:7/463: stat d2/d26/d3d/d6d/l8f 0 2024-04-25T15:57:38.391 INFO:tasks.workunit.client.1.smithi155.stdout:6/509: creat d0/d1a/da1/fa7 x:0 0 0 2024-04-25T15:57:38.392 INFO:tasks.workunit.client.1.smithi155.stdout:3/478: dwrite d1/d4/f2c [0,4194304] 0 2024-04-25T15:57:38.392 INFO:tasks.workunit.client.1.smithi155.stdout:7/464: symlink d2/dd/d12/d76/l9a 0 2024-04-25T15:57:38.392 INFO:tasks.workunit.client.1.smithi155.stdout:6/510: chown d0/d1a/d45/d61/d8e 427340 1 2024-04-25T15:57:38.393 INFO:tasks.workunit.client.1.smithi155.stdout:4/374: link da/c24 da/d23/d3f/d56/d69/c86 0 2024-04-25T15:57:38.414 INFO:tasks.workunit.client.1.smithi155.stdout:5/410: sync 2024-04-25T15:57:38.414 INFO:tasks.workunit.client.1.smithi155.stdout:0/356: sync 2024-04-25T15:57:38.425 INFO:tasks.workunit.client.1.smithi155.stdout:3/479: unlink d1/d4/d10/c36 0 2024-04-25T15:57:38.425 INFO:tasks.workunit.client.1.smithi155.stdout:2/450: write d7/d23/f21 [477266,109053] 0 2024-04-25T15:57:38.426 INFO:tasks.workunit.client.1.smithi155.stdout:5/411: stat d0/d58/d32/l66 0 2024-04-25T15:57:38.426 INFO:tasks.workunit.client.1.smithi155.stdout:3/480: chown d1/d4/db/d28 1 1 2024-04-25T15:57:38.426 INFO:tasks.workunit.client.1.smithi155.stdout:7/465: creat d2/dd/d13/f9b x:0 0 0 2024-04-25T15:57:38.427 INFO:tasks.workunit.client.1.smithi155.stdout:5/412: dread - d0/d3/f7b zero size 2024-04-25T15:57:38.427 INFO:tasks.workunit.client.1.smithi155.stdout:6/511: rmdir d0/d13/d34/d38/d7a 39 2024-04-25T15:57:38.428 INFO:tasks.workunit.client.1.smithi155.stdout:6/512: chown d0/d1a/d25/d2e/d39 39028326 1 2024-04-25T15:57:38.428 INFO:tasks.workunit.client.1.smithi155.stdout:4/375: mkdir da/d87 0 2024-04-25T15:57:38.429 INFO:tasks.workunit.client.1.smithi155.stdout:3/481: rmdir d1/d4/d6a 39 2024-04-25T15:57:38.430 INFO:tasks.workunit.client.1.smithi155.stdout:0/357: mkdir d1/d85 0 2024-04-25T15:57:38.432 INFO:tasks.workunit.client.1.smithi155.stdout:7/466: unlink d2/f1d 0 2024-04-25T15:57:38.433 INFO:tasks.workunit.client.1.smithi155.stdout:7/467: read - d2/d26/d3d/d65/f86 zero size 2024-04-25T15:57:38.434 INFO:tasks.workunit.client.1.smithi155.stdout:7/468: fdatasync d2/f94 0 2024-04-25T15:57:38.434 INFO:tasks.workunit.client.1.smithi155.stdout:2/451: mkdir d7/d8e 0 2024-04-25T15:57:38.438 INFO:tasks.workunit.client.1.smithi155.stdout:0/358: unlink d1/d3/c37 0 2024-04-25T15:57:38.442 INFO:tasks.workunit.client.1.smithi155.stdout:3/482: mkdir d1/d4/d6a/d86/d9e 0 2024-04-25T15:57:38.446 INFO:tasks.workunit.client.1.smithi155.stdout:0/359: mkdir d1/d3/d5/d5b/d86 0 2024-04-25T15:57:38.446 INFO:tasks.workunit.client.1.smithi155.stdout:0/360: write d1/d3/f48 [5191080,124526] 0 2024-04-25T15:57:38.446 INFO:tasks.workunit.client.1.smithi155.stdout:2/452: symlink d7/d74/l8f 0 2024-04-25T15:57:38.447 INFO:tasks.workunit.client.1.smithi155.stdout:7/469: link d2/f1b d2/d26/d3d/d6d/f9c 0 2024-04-25T15:57:38.449 INFO:tasks.workunit.client.1.smithi155.stdout:6/513: getdents d0/d13/d34/d38 0 2024-04-25T15:57:38.450 INFO:tasks.workunit.client.1.smithi155.stdout:5/413: dread d0/d3/d2c/f3c [0,4194304] 0 2024-04-25T15:57:38.451 INFO:tasks.workunit.client.1.smithi155.stdout:2/453: mkdir d7/db/d2e/d90 0 2024-04-25T15:57:38.451 INFO:tasks.workunit.client.1.smithi155.stdout:4/376: dread da/d23/f42 [0,4194304] 0 2024-04-25T15:57:38.454 INFO:tasks.workunit.client.1.smithi155.stdout:4/377: write da/dc/d18/f4c [55632,74938] 0 2024-04-25T15:57:38.454 INFO:tasks.workunit.client.1.smithi155.stdout:0/361: link d1/d1a/f34 d1/d41/f87 0 2024-04-25T15:57:38.456 INFO:tasks.workunit.client.1.smithi155.stdout:2/454: mkdir d7/db/d2e/d6f/d91 0 2024-04-25T15:57:38.457 INFO:tasks.workunit.client.1.smithi155.stdout:4/378: chown da/c74 307092253 1 2024-04-25T15:57:38.458 INFO:tasks.workunit.client.1.smithi155.stdout:0/362: dread - d1/d3/d12/f84 zero size 2024-04-25T15:57:38.460 INFO:tasks.workunit.client.1.smithi155.stdout:3/483: dread d1/d4/f18 [0,4194304] 0 2024-04-25T15:57:38.463 INFO:tasks.workunit.client.1.smithi155.stdout:7/470: dwrite d2/f8 [8388608,4194304] 0 2024-04-25T15:57:38.466 INFO:tasks.workunit.client.1.smithi155.stdout:6/514: dwrite d0/d1a/f6b [0,4194304] 0 2024-04-25T15:57:38.469 INFO:tasks.workunit.client.1.smithi155.stdout:4/379: mknod da/dc/d77/c88 0 2024-04-25T15:57:38.469 INFO:tasks.workunit.client.1.smithi155.stdout:7/471: stat d2/d26/d3d/d6d/f97 0 2024-04-25T15:57:38.471 INFO:tasks.workunit.client.1.smithi155.stdout:2/455: rename c0 to d7/db/d2e/d6f/d91/c92 0 2024-04-25T15:57:38.471 INFO:tasks.workunit.client.1.smithi155.stdout:4/380: chown da/d23/d3f 1914339 1 2024-04-25T15:57:38.473 INFO:tasks.workunit.client.1.smithi155.stdout:5/414: dwrite d0/d58/f29 [0,4194304] 0 2024-04-25T15:57:38.473 INFO:tasks.workunit.client.1.smithi155.stdout:0/363: creat d1/d6/d16/f88 x:0 0 0 2024-04-25T15:57:38.477 INFO:tasks.workunit.client.1.smithi155.stdout:3/484: dread d1/d4/d10/d21/d73/f59 [0,4194304] 0 2024-04-25T15:57:38.480 INFO:tasks.workunit.client.1.smithi155.stdout:3/485: write d1/d4/d10/f43 [1020456,15851] 0 2024-04-25T15:57:38.483 INFO:tasks.workunit.client.1.smithi155.stdout:5/415: dwrite d0/d47/f4d [0,4194304] 0 2024-04-25T15:57:38.488 INFO:tasks.workunit.client.1.smithi155.stdout:3/486: mknod d1/d4/db/d28/d58/c9f 0 2024-04-25T15:57:38.490 INFO:tasks.workunit.client.1.smithi155.stdout:3/487: write d1/d4/d6a/f88 [2731732,20162] 0 2024-04-25T15:57:38.492 INFO:tasks.workunit.client.1.smithi155.stdout:0/364: symlink d1/d3/d12/d83/l89 0 2024-04-25T15:57:38.495 INFO:tasks.workunit.client.1.smithi155.stdout:5/416: rename d0/d3/d15/d30/l68 to d0/d3/d15/d1f/d50/d7c/l80 0 2024-04-25T15:57:38.500 INFO:tasks.workunit.client.1.smithi155.stdout:3/488: creat d1/d4/d10/d21/d73/d77/d57/d80/fa0 x:0 0 0 2024-04-25T15:57:38.501 INFO:tasks.workunit.client.1.smithi155.stdout:2/456: dread d7/d23/f20 [0,4194304] 0 2024-04-25T15:57:38.503 INFO:tasks.workunit.client.1.smithi155.stdout:2/457: dread d7/db/d29/f3a [0,4194304] 0 2024-04-25T15:57:38.504 INFO:tasks.workunit.client.1.smithi155.stdout:0/365: rename d1/d3/d3d/d46/f64 to d1/d6/f8a 0 2024-04-25T15:57:38.504 INFO:tasks.workunit.client.1.smithi155.stdout:2/458: write d7/db/dd/d15/d60/f76 [2610029,45461] 0 2024-04-25T15:57:38.505 INFO:tasks.workunit.client.1.smithi155.stdout:7/472: chown d2/dd/d13 86 1 2024-04-25T15:57:38.505 INFO:tasks.workunit.client.1.smithi155.stdout:2/459: fdatasync d7/db/d29/f54 0 2024-04-25T15:57:38.506 INFO:tasks.workunit.client.1.smithi155.stdout:2/460: dread - d7/f82 zero size 2024-04-25T15:57:38.508 INFO:tasks.workunit.client.1.smithi155.stdout:5/417: rename d0/d3/l45 to d0/d3/d2c/l81 0 2024-04-25T15:57:38.508 INFO:tasks.workunit.client.1.smithi155.stdout:4/381: dread da/dc/f1f [0,4194304] 0 2024-04-25T15:57:38.509 INFO:tasks.workunit.client.1.smithi155.stdout:5/418: dread - d0/d3/f5c zero size 2024-04-25T15:57:38.511 INFO:tasks.workunit.client.1.smithi155.stdout:3/489: creat d1/d4/fa1 x:0 0 0 2024-04-25T15:57:38.512 INFO:tasks.workunit.client.1.smithi155.stdout:4/382: creat da/dc/d18/d6e/f89 x:0 0 0 2024-04-25T15:57:38.512 INFO:tasks.workunit.client.1.smithi155.stdout:3/490: dread - d1/d4/db/d20/d44/d52/d61/d89/f8c zero size 2024-04-25T15:57:38.513 INFO:tasks.workunit.client.1.smithi155.stdout:7/473: creat d2/dd/d63/f9d x:0 0 0 2024-04-25T15:57:38.514 INFO:tasks.workunit.client.1.smithi155.stdout:5/419: symlink d0/d58/d32/l82 0 2024-04-25T15:57:38.516 INFO:tasks.workunit.client.1.smithi155.stdout:7/474: dread d2/dd/d63/f77 [0,4194304] 0 2024-04-25T15:57:38.516 INFO:tasks.workunit.client.1.smithi155.stdout:5/420: read d0/d3/d15/d30/d4f/f62 [506457,10984] 0 2024-04-25T15:57:38.518 INFO:tasks.workunit.client.1.smithi155.stdout:5/421: fdatasync d0/f37 0 2024-04-25T15:57:38.523 INFO:tasks.workunit.client.1.smithi155.stdout:3/491: dwrite d1/d4/d10/f43 [0,4194304] 0 2024-04-25T15:57:38.526 INFO:tasks.workunit.client.1.smithi155.stdout:7/475: dwrite d2/dd/d13/f70 [0,4194304] 0 2024-04-25T15:57:38.528 INFO:tasks.workunit.client.1.smithi155.stdout:8/275: sync 2024-04-25T15:57:38.529 INFO:tasks.workunit.client.1.smithi155.stdout:7/476: truncate d2/d26/d3d/d6d/f8a 390026 0 2024-04-25T15:57:38.529 INFO:tasks.workunit.client.1.smithi155.stdout:0/366: dread d1/d3/d5/f32 [0,4194304] 0 2024-04-25T15:57:38.530 INFO:tasks.workunit.client.1.smithi155.stdout:7/477: fdatasync d2/dd/d13/f9b 0 2024-04-25T15:57:38.534 INFO:tasks.workunit.client.1.smithi155.stdout:3/492: write d1/d4/db/d20/f3b [1369266,8538] 0 2024-04-25T15:57:38.535 INFO:tasks.workunit.client.1.smithi155.stdout:8/276: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:38.536 INFO:tasks.workunit.client.1.smithi155.stdout:8/277: write d2/fa [1452950,111958] 0 2024-04-25T15:57:38.538 INFO:tasks.workunit.client.1.smithi155.stdout:5/422: link d0/d3/f5a d0/d3/d15/d1f/d50/d7c/f83 0 2024-04-25T15:57:38.539 INFO:tasks.workunit.client.1.smithi155.stdout:4/383: getdents da/d23/d3f/d56/d69/d4a/d78 0 2024-04-25T15:57:38.540 INFO:tasks.workunit.client.1.smithi155.stdout:0/367: symlink d1/d3/d12/d83/l8b 0 2024-04-25T15:57:38.543 INFO:tasks.workunit.client.1.smithi155.stdout:3/493: symlink d1/d4/db/d28/la2 0 2024-04-25T15:57:38.543 INFO:tasks.workunit.client.1.smithi155.stdout:0/368: dread - d1/d3/d12/f84 zero size 2024-04-25T15:57:38.546 INFO:tasks.workunit.client.1.smithi155.stdout:7/478: unlink d2/dd/l82 0 2024-04-25T15:57:38.547 INFO:tasks.workunit.client.1.smithi155.stdout:2/461: dwrite d7/f31 [0,4194304] 0 2024-04-25T15:57:38.548 INFO:tasks.workunit.client.1.smithi155.stdout:0/369: write d1/d3/d12/f84 [108368,101246] 0 2024-04-25T15:57:38.548 INFO:tasks.workunit.client.1.smithi155.stdout:3/494: fdatasync d1/d4/d10/d21/d73/d77/d5f/f84 0 2024-04-25T15:57:38.551 INFO:tasks.workunit.client.1.smithi155.stdout:8/278: creat d2/d15/f51 x:0 0 0 2024-04-25T15:57:38.552 INFO:tasks.workunit.client.1.smithi155.stdout:7/479: creat d2/dd/d36/d46/f9e x:0 0 0 2024-04-25T15:57:38.556 INFO:tasks.workunit.client.1.smithi155.stdout:8/279: dread d2/d15/d35/d3d/f42 [0,4194304] 0 2024-04-25T15:57:38.559 INFO:tasks.workunit.client.1.smithi155.stdout:8/280: fsync d2/d15/d35/d3d/f46 0 2024-04-25T15:57:38.561 INFO:tasks.workunit.client.1.smithi155.stdout:8/281: chown d2/d15/d35/f4d 141889 1 2024-04-25T15:57:38.562 INFO:tasks.workunit.client.1.smithi155.stdout:8/282: stat d2/d5 0 2024-04-25T15:57:38.564 INFO:tasks.workunit.client.1.smithi155.stdout:0/370: write d1/f3c [1395230,124413] 0 2024-04-25T15:57:38.567 INFO:tasks.workunit.client.1.smithi155.stdout:3/495: dwrite d1/d4/db/d20/f4c [0,4194304] 0 2024-04-25T15:57:38.570 INFO:tasks.workunit.client.1.smithi155.stdout:0/371: write d1/d3/f48 [3369201,87720] 0 2024-04-25T15:57:38.571 INFO:tasks.workunit.client.1.smithi155.stdout:7/480: dwrite d2/dd/d12/f38 [0,4194304] 0 2024-04-25T15:57:38.572 INFO:tasks.workunit.client.1.smithi155.stdout:3/496: chown d1/d4/db/l50 0 1 2024-04-25T15:57:38.574 INFO:tasks.workunit.client.1.smithi155.stdout:4/384: dread da/dc/d18/d6e/f4e [0,4194304] 0 2024-04-25T15:57:38.576 INFO:tasks.workunit.client.1.smithi155.stdout:2/462: dwrite d7/db/dd/d15/f33 [4194304,4194304] 0 2024-04-25T15:57:38.578 INFO:tasks.workunit.client.1.smithi155.stdout:8/283: dread d2/d15/d35/f44 [0,4194304] 0 2024-04-25T15:57:38.578 INFO:tasks.workunit.client.1.smithi155.stdout:4/385: chown da/d23/d3f/d56/d69/d4a/d78/f4f 279 1 2024-04-25T15:57:38.579 INFO:tasks.workunit.client.1.smithi155.stdout:0/372: read d1/d6/f22 [3895559,31645] 0 2024-04-25T15:57:38.580 INFO:tasks.workunit.client.1.smithi155.stdout:8/284: chown d2/d15/d18/d23/d2d/l4c 1860631 1 2024-04-25T15:57:38.581 INFO:tasks.workunit.client.1.smithi155.stdout:3/497: creat d1/d4/db/d20/fa3 x:0 0 0 2024-04-25T15:57:38.585 INFO:tasks.workunit.client.1.smithi155.stdout:7/481: creat d2/d26/d3d/d65/f9f x:0 0 0 2024-04-25T15:57:38.585 INFO:tasks.workunit.client.1.smithi155.stdout:2/463: mkdir d7/db/d93 0 2024-04-25T15:57:38.588 INFO:tasks.workunit.client.1.smithi155.stdout:7/482: symlink d2/dd/d30/la0 0 2024-04-25T15:57:38.590 INFO:tasks.workunit.client.1.smithi155.stdout:2/464: mkdir d7/db/dd/d15/d60/d94 0 2024-04-25T15:57:38.592 INFO:tasks.workunit.client.1.smithi155.stdout:7/483: rmdir d2/dd/d66/d71 39 2024-04-25T15:57:38.592 INFO:tasks.workunit.client.1.smithi155.stdout:2/465: stat d7/db/dd/d15/f42 0 2024-04-25T15:57:38.593 INFO:tasks.workunit.client.1.smithi155.stdout:0/373: dwrite d1/d3/d5/f2c [0,4194304] 0 2024-04-25T15:57:38.594 INFO:tasks.workunit.client.1.smithi155.stdout:3/498: dwrite d1/d4/db/f35 [0,4194304] 0 2024-04-25T15:57:38.598 INFO:tasks.workunit.client.1.smithi155.stdout:2/466: mkdir d7/db/d2e/d44/d95 0 2024-04-25T15:57:38.604 INFO:tasks.workunit.client.1.smithi155.stdout:2/467: mknod d7/db/d2e/d6f/c96 0 2024-04-25T15:57:38.606 INFO:tasks.workunit.client.1.smithi155.stdout:8/285: dread d2/d15/d18/d49/f3a [0,4194304] 0 2024-04-25T15:57:38.607 INFO:tasks.workunit.client.1.smithi155.stdout:7/484: dwrite d2/d26/d3d/d6d/f79 [0,4194304] 0 2024-04-25T15:57:38.612 INFO:tasks.workunit.client.1.smithi155.stdout:8/286: rmdir d2/d15/d18/d34/d4f 0 2024-04-25T15:57:38.612 INFO:tasks.workunit.client.1.smithi155.stdout:4/386: dread da/d23/d3f/f71 [0,4194304] 0 2024-04-25T15:57:38.613 INFO:tasks.workunit.client.1.smithi155.stdout:8/287: chown d2/d15/d18 23890115 1 2024-04-25T15:57:38.613 INFO:tasks.workunit.client.1.smithi155.stdout:2/468: dread d7/d23/f21 [0,4194304] 0 2024-04-25T15:57:38.616 INFO:tasks.workunit.client.1.smithi155.stdout:3/499: truncate d1/d4/f2d 1592026 0 2024-04-25T15:57:38.617 INFO:tasks.workunit.client.1.smithi155.stdout:7/485: link d2/dd/c14 d2/dd/d30/d44/d7f/ca1 0 2024-04-25T15:57:38.619 INFO:tasks.workunit.client.1.smithi155.stdout:2/469: truncate d7/db/dd/d15/d60/f79 229572 0 2024-04-25T15:57:38.620 INFO:tasks.workunit.client.1.smithi155.stdout:8/288: getdents d2/d15 0 2024-04-25T15:57:38.621 INFO:tasks.workunit.client.1.smithi155.stdout:3/500: creat d1/d4/d10/d21/d73/d8d/fa4 x:0 0 0 2024-04-25T15:57:38.622 INFO:tasks.workunit.client.1.smithi155.stdout:0/374: dwrite d1/f1b [4194304,4194304] 0 2024-04-25T15:57:38.624 INFO:tasks.workunit.client.1.smithi155.stdout:0/375: chown d1/d3/d3d 1 1 2024-04-25T15:57:38.625 INFO:tasks.workunit.client.1.smithi155.stdout:8/289: mknod d2/d15/c52 0 2024-04-25T15:57:38.628 INFO:tasks.workunit.client.1.smithi155.stdout:3/501: chown d1/d4/d10/d2a/d6c/c7b 1 1 2024-04-25T15:57:38.630 INFO:tasks.workunit.client.1.smithi155.stdout:2/470: rename d7/l1c to d7/db/d2e/d44/d95/l97 0 2024-04-25T15:57:38.633 INFO:tasks.workunit.client.1.smithi155.stdout:4/387: dwrite da/d23/d3f/d56/d69/d4a/d78/f4f [0,4194304] 0 2024-04-25T15:57:38.634 INFO:tasks.workunit.client.1.smithi155.stdout:7/486: dwrite d2/f94 [0,4194304] 0 2024-04-25T15:57:38.636 INFO:tasks.workunit.client.1.smithi155.stdout:4/388: write da/d23/d3f/f79 [395593,113266] 0 2024-04-25T15:57:38.638 INFO:tasks.workunit.client.1.smithi155.stdout:2/471: creat d7/d23/f98 x:0 0 0 2024-04-25T15:57:38.642 INFO:tasks.workunit.client.1.smithi155.stdout:7/487: write d2/dd/f74 [1000978,18441] 0 2024-04-25T15:57:38.644 INFO:tasks.workunit.client.1.smithi155.stdout:1/427: sync 2024-04-25T15:57:38.644 INFO:tasks.workunit.client.1.smithi155.stdout:0/376: fdatasync d1/f1b 0 2024-04-25T15:57:38.644 INFO:tasks.workunit.client.1.smithi155.stdout:4/389: truncate da/d23/f6c 1045221 0 2024-04-25T15:57:38.646 INFO:tasks.workunit.client.1.smithi155.stdout:3/502: dwrite d1/d94/f95 [0,4194304] 0 2024-04-25T15:57:38.646 INFO:tasks.workunit.client.1.smithi155.stdout:8/290: getdents d2/d15/d18/d49 0 2024-04-25T15:57:38.647 INFO:tasks.workunit.client.1.smithi155.stdout:2/472: truncate d7/db/dd/d15/f42 1789941 0 2024-04-25T15:57:38.650 INFO:tasks.workunit.client.1.smithi155.stdout:7/488: rmdir d2/dd/d12/d76 39 2024-04-25T15:57:38.650 INFO:tasks.workunit.client.1.smithi155.stdout:4/390: symlink da/d23/d3a/l8a 0 2024-04-25T15:57:38.651 INFO:tasks.workunit.client.1.smithi155.stdout:2/473: symlink d7/d23/l99 0 2024-04-25T15:57:38.652 INFO:tasks.workunit.client.1.smithi155.stdout:4/391: write da/d23/f43 [924201,24930] 0 2024-04-25T15:57:38.653 INFO:tasks.workunit.client.1.smithi155.stdout:2/474: chown d7/db/d2e/l62 0 1 2024-04-25T15:57:38.654 INFO:tasks.workunit.client.1.smithi155.stdout:0/377: read d1/d6/d29/f59 [1741585,108502] 0 2024-04-25T15:57:38.654 INFO:tasks.workunit.client.1.smithi155.stdout:3/503: creat d1/d4/d10/d21/d73/fa5 x:0 0 0 2024-04-25T15:57:38.656 INFO:tasks.workunit.client.1.smithi155.stdout:0/378: fsync d1/d3/d3d/f7a 0 2024-04-25T15:57:38.656 INFO:tasks.workunit.client.1.smithi155.stdout:1/428: rmdir d1/d16/d37/d70 0 2024-04-25T15:57:38.658 INFO:tasks.workunit.client.1.smithi155.stdout:4/392: mknod da/d23/d3f/d56/d69/d4a/d78/c8b 0 2024-04-25T15:57:38.661 INFO:tasks.workunit.client.1.smithi155.stdout:3/504: mkdir d1/d4/db/d20/d44/d52/d93/da6 0 2024-04-25T15:57:38.662 INFO:tasks.workunit.client.1.smithi155.stdout:8/291: dwrite d2/d15/d18/d23/d2d/f39 [0,4194304] 0 2024-04-25T15:57:38.666 INFO:tasks.workunit.client.1.smithi155.stdout:4/393: rename da/dc/f5a to da/d23/d3a/d7b/f8c 0 2024-04-25T15:57:38.668 INFO:tasks.workunit.client.1.smithi155.stdout:2/475: dwrite d7/db/f6c [0,4194304] 0 2024-04-25T15:57:38.669 INFO:tasks.workunit.client.1.smithi155.stdout:3/505: write d1/d4/db/d28/f5b [669551,988] 0 2024-04-25T15:57:38.670 INFO:tasks.workunit.client.1.smithi155.stdout:8/292: creat d2/d15/d18/d34/f53 x:0 0 0 2024-04-25T15:57:38.671 INFO:tasks.workunit.client.1.smithi155.stdout:1/429: link d1/d16/d1d/d29/d5f/l3f d1/d16/d1d/d29/d3d/l8c 0 2024-04-25T15:57:38.673 INFO:tasks.workunit.client.1.smithi155.stdout:0/379: dwrite d1/d41/f44 [0,4194304] 0 2024-04-25T15:57:38.679 INFO:tasks.workunit.client.1.smithi155.stdout:7/489: dwrite d2/dd/d13/d24/d35/f3f [0,4194304] 0 2024-04-25T15:57:38.680 INFO:tasks.workunit.client.1.smithi155.stdout:2/476: creat d7/db/d2e/d6f/d91/f9a x:0 0 0 2024-04-25T15:57:38.681 INFO:tasks.workunit.client.1.smithi155.stdout:0/380: mkdir d1/d85/d8c 0 2024-04-25T15:57:38.682 INFO:tasks.workunit.client.1.smithi155.stdout:1/430: fsync d1/d6/f2f 0 2024-04-25T15:57:38.683 INFO:tasks.workunit.client.1.smithi155.stdout:7/490: creat d2/fa2 x:0 0 0 2024-04-25T15:57:38.687 INFO:tasks.workunit.client.1.smithi155.stdout:2/477: symlink d7/db/d2e/d6f/d91/l9b 0 2024-04-25T15:57:38.689 INFO:tasks.workunit.client.1.smithi155.stdout:3/506: getdents d1/d4/d10/d21/d73/d8d 0 2024-04-25T15:57:38.692 INFO:tasks.workunit.client.1.smithi155.stdout:2/478: read d7/db/dd/d15/f55 [2438272,71311] 0 2024-04-25T15:57:38.692 INFO:tasks.workunit.client.1.smithi155.stdout:8/293: dread d2/d15/d18/d23/d3c/f47 [0,4194304] 0 2024-04-25T15:57:38.693 INFO:tasks.workunit.client.1.smithi155.stdout:7/491: link d2/dd/d66/d8c/f90 d2/dd/d12/d76/fa3 0 2024-04-25T15:57:38.694 INFO:tasks.workunit.client.1.smithi155.stdout:4/394: rename da/d23/d3a/d7b/f8c to da/d23/d3f/d56/d69/d4a/d78/f8d 0 2024-04-25T15:57:38.696 INFO:tasks.workunit.client.1.smithi155.stdout:8/294: stat d2/d5/f21 0 2024-04-25T15:57:38.696 INFO:tasks.workunit.client.1.smithi155.stdout:6/515: sync 2024-04-25T15:57:38.697 INFO:tasks.workunit.client.1.smithi155.stdout:9/349: sync 2024-04-25T15:57:38.699 INFO:tasks.workunit.client.1.smithi155.stdout:3/507: symlink d1/d4/d6a/d86/la7 0 2024-04-25T15:57:38.699 INFO:tasks.workunit.client.1.smithi155.stdout:0/381: dwrite d1/d3/d3d/d46/f78 [0,4194304] 0 2024-04-25T15:57:38.702 INFO:tasks.workunit.client.1.smithi155.stdout:8/295: write d2/f16 [2657394,105208] 0 2024-04-25T15:57:38.705 INFO:tasks.workunit.client.1.smithi155.stdout:3/508: chown d1/d4/db/d28/l56 354 1 2024-04-25T15:57:38.705 INFO:tasks.workunit.client.1.smithi155.stdout:6/516: write d0/f4f [3677203,88502] 0 2024-04-25T15:57:38.706 INFO:tasks.workunit.client.1.smithi155.stdout:0/382: write d1/d3/d12/f3b [1361771,54114] 0 2024-04-25T15:57:38.706 INFO:tasks.workunit.client.1.smithi155.stdout:1/431: dwrite d1/d32/d86/f87 [0,4194304] 0 2024-04-25T15:57:38.707 INFO:tasks.workunit.client.1.smithi155.stdout:7/492: mknod d2/dd/d30/ca4 0 2024-04-25T15:57:38.712 INFO:tasks.workunit.client.1.smithi155.stdout:8/296: fdatasync d2/d15/d35/d3d/f46 0 2024-04-25T15:57:38.712 INFO:tasks.workunit.client.1.smithi155.stdout:3/509: creat d1/d4/db/d20/fa8 x:0 0 0 2024-04-25T15:57:38.712 INFO:tasks.workunit.client.1.smithi155.stdout:0/383: chown d1/d6/d29/l68 241 1 2024-04-25T15:57:38.713 INFO:tasks.workunit.client.1.smithi155.stdout:1/432: symlink d1/d16/d7f/l8d 0 2024-04-25T15:57:38.713 INFO:tasks.workunit.client.1.smithi155.stdout:7/493: readlink d2/dd/d63/l99 0 2024-04-25T15:57:38.714 INFO:tasks.workunit.client.1.smithi155.stdout:6/517: creat d0/d18/d54/fa8 x:0 0 0 2024-04-25T15:57:38.717 INFO:tasks.workunit.client.1.smithi155.stdout:3/510: symlink d1/d4/d10/d21/d73/la9 0 2024-04-25T15:57:38.717 INFO:tasks.workunit.client.1.smithi155.stdout:8/297: chown d2/d15/d18/d49 379968758 1 2024-04-25T15:57:38.720 INFO:tasks.workunit.client.1.smithi155.stdout:6/518: mkdir d0/d13/d7c/da9 0 2024-04-25T15:57:38.724 INFO:tasks.workunit.client.1.smithi155.stdout:7/494: rmdir d2/dd/d12/d76/d7e 0 2024-04-25T15:57:38.725 INFO:tasks.workunit.client.1.smithi155.stdout:9/350: dwrite dc/d13/d2e/d4c/f61 [0,4194304] 0 2024-04-25T15:57:38.725 INFO:tasks.workunit.client.1.smithi155.stdout:5/423: sync 2024-04-25T15:57:38.726 INFO:tasks.workunit.client.1.smithi155.stdout:6/519: write d0/d1a/d45/f52 [2457193,92709] 0 2024-04-25T15:57:38.728 INFO:tasks.workunit.client.1.smithi155.stdout:9/351: write dc/d13/d59/f5f [529196,87213] 0 2024-04-25T15:57:38.728 INFO:tasks.workunit.client.1.smithi155.stdout:2/479: dread d7/db/f59 [0,4194304] 0 2024-04-25T15:57:38.729 INFO:tasks.workunit.client.1.smithi155.stdout:3/511: rename d1/d4/db/f11 to d1/d4/db/d91/faa 0 2024-04-25T15:57:38.731 INFO:tasks.workunit.client.1.smithi155.stdout:4/395: truncate da/dc/d18/f5f 1700440 0 2024-04-25T15:57:38.732 INFO:tasks.workunit.client.1.smithi155.stdout:3/512: stat d1/d4/d10/d21/d73/d8d 0 2024-04-25T15:57:38.732 INFO:tasks.workunit.client.1.smithi155.stdout:0/384: dwrite d1/d6/d29/f59 [0,4194304] 0 2024-04-25T15:57:38.732 INFO:tasks.workunit.client.1.smithi155.stdout:7/495: rmdir d2/dd/d13 39 2024-04-25T15:57:38.733 INFO:tasks.workunit.client.1.smithi155.stdout:2/480: write d7/db/dd/d15/f33 [5721718,45270] 0 2024-04-25T15:57:38.736 INFO:tasks.workunit.client.1.smithi155.stdout:1/433: dread d1/d16/f39 [0,4194304] 0 2024-04-25T15:57:38.736 INFO:tasks.workunit.client.1.smithi155.stdout:0/385: write d1/d6/d29/f53 [4708127,69368] 0 2024-04-25T15:57:38.737 INFO:tasks.workunit.client.1.smithi155.stdout:5/424: mkdir d0/d84 0 2024-04-25T15:57:38.743 INFO:tasks.workunit.client.1.smithi155.stdout:2/481: chown d7/db/l12 30 1 2024-04-25T15:57:38.743 INFO:tasks.workunit.client.1.smithi155.stdout:5/425: dread - d0/d3/d15/d1f/f70 zero size 2024-04-25T15:57:38.744 INFO:tasks.workunit.client.1.smithi155.stdout:4/396: creat da/d23/d3a/d7b/f8e x:0 0 0 2024-04-25T15:57:38.745 INFO:tasks.workunit.client.1.smithi155.stdout:8/298: dwrite d2/d15/d18/d23/d2d/f31 [4194304,4194304] 0 2024-04-25T15:57:38.748 INFO:tasks.workunit.client.1.smithi155.stdout:3/513: getdents d1/d4/db/d20/d44/d52/d93/da6 0 2024-04-25T15:57:38.749 INFO:tasks.workunit.client.1.smithi155.stdout:4/397: mknod da/dc/c8f 0 2024-04-25T15:57:38.750 INFO:tasks.workunit.client.1.smithi155.stdout:2/482: fsync d7/db/dd/f89 0 2024-04-25T15:57:38.753 INFO:tasks.workunit.client.1.smithi155.stdout:7/496: dread d2/dd/f52 [0,4194304] 0 2024-04-25T15:57:38.753 INFO:tasks.workunit.client.1.smithi155.stdout:6/520: dwrite d0/f3 [0,4194304] 0 2024-04-25T15:57:38.754 INFO:tasks.workunit.client.1.smithi155.stdout:5/426: link d0/d47/d59/f5d d0/d3/d2c/f85 0 2024-04-25T15:57:38.756 INFO:tasks.workunit.client.1.smithi155.stdout:6/521: chown d0/d13/d34/d38 150 1 2024-04-25T15:57:38.758 INFO:tasks.workunit.client.1.smithi155.stdout:9/352: truncate dc/d13/d59/f5d 4140551 0 2024-04-25T15:57:38.759 INFO:tasks.workunit.client.1.smithi155.stdout:2/483: creat d7/db/d2e/d44/d95/f9c x:0 0 0 2024-04-25T15:57:38.761 INFO:tasks.workunit.client.1.smithi155.stdout:0/386: truncate d1/d3/d5/f54 75860 0 2024-04-25T15:57:38.761 INFO:tasks.workunit.client.1.smithi155.stdout:5/427: write d0/d3/d2c/f3c [950523,115318] 0 2024-04-25T15:57:38.763 INFO:tasks.workunit.client.1.smithi155.stdout:4/398: dread da/d23/d3f/f48 [0,4194304] 0 2024-04-25T15:57:38.763 INFO:tasks.workunit.client.1.smithi155.stdout:7/497: rename d2/dd/d30/d44/l6c to d2/dd/d66/d8c/la5 0 2024-04-25T15:57:38.764 INFO:tasks.workunit.client.1.smithi155.stdout:3/514: dread d1/d4/d6a/f88 [0,4194304] 0 2024-04-25T15:57:38.764 INFO:tasks.workunit.client.1.smithi155.stdout:2/484: creat d7/db/d2e/d44/f9d x:0 0 0 2024-04-25T15:57:38.764 INFO:tasks.workunit.client.1.smithi155.stdout:9/353: unlink dc/d17/d2a/f52 0 2024-04-25T15:57:38.766 INFO:tasks.workunit.client.1.smithi155.stdout:5/428: symlink d0/d47/d59/l86 0 2024-04-25T15:57:38.767 INFO:tasks.workunit.client.1.smithi155.stdout:0/387: write d1/d3/d5/f32 [638360,53849] 0 2024-04-25T15:57:38.767 INFO:tasks.workunit.client.1.smithi155.stdout:8/299: getdents d2/d15/d35/d3d 0 2024-04-25T15:57:38.768 INFO:tasks.workunit.client.1.smithi155.stdout:4/399: write da/d23/d3f/d56/d69/d4a/d78/d62/f68 [829082,20072] 0 2024-04-25T15:57:38.771 INFO:tasks.workunit.client.1.smithi155.stdout:3/515: unlink d1/d4/db/d28/c3d 0 2024-04-25T15:57:38.772 INFO:tasks.workunit.client.1.smithi155.stdout:4/400: write da/dc/d18/f4c [767468,30720] 0 2024-04-25T15:57:38.773 INFO:tasks.workunit.client.1.smithi155.stdout:5/429: creat d0/d58/d32/d6a/d78/f87 x:0 0 0 2024-04-25T15:57:38.775 INFO:tasks.workunit.client.1.smithi155.stdout:0/388: dread d1/d3/d5/f13 [0,4194304] 0 2024-04-25T15:57:38.776 INFO:tasks.workunit.client.1.smithi155.stdout:5/430: readlink d0/d58/l23 0 2024-04-25T15:57:38.777 INFO:tasks.workunit.client.1.smithi155.stdout:7/498: rename d2/dd/d13/f70 to d2/dd/fa6 0 2024-04-25T15:57:38.779 INFO:tasks.workunit.client.1.smithi155.stdout:3/516: mkdir d1/d4/d10/d21/dab 0 2024-04-25T15:57:38.781 INFO:tasks.workunit.client.1.smithi155.stdout:9/354: dwrite dc/d13/d2e/f57 [0,4194304] 0 2024-04-25T15:57:38.784 INFO:tasks.workunit.client.1.smithi155.stdout:4/401: rename da/dc/d18/l2b to da/d30/l90 0 2024-04-25T15:57:38.784 INFO:tasks.workunit.client.1.smithi155.stdout:6/522: dread d0/d18/f48 [0,4194304] 0 2024-04-25T15:57:38.785 INFO:tasks.workunit.client.1.smithi155.stdout:7/499: creat d2/dd/d30/d44/d7f/fa7 x:0 0 0 2024-04-25T15:57:38.785 INFO:tasks.workunit.client.1.smithi155.stdout:6/523: chown d0/d13/d34/d38/d4c 31229358 1 2024-04-25T15:57:38.786 INFO:tasks.workunit.client.1.smithi155.stdout:7/500: fsync d2/f8 0 2024-04-25T15:57:38.787 INFO:tasks.workunit.client.1.smithi155.stdout:4/402: dread da/f16 [4194304,4194304] 0 2024-04-25T15:57:38.788 INFO:tasks.workunit.client.1.smithi155.stdout:6/524: chown d0/d1a/d45/d61/la4 13 1 2024-04-25T15:57:38.788 INFO:tasks.workunit.client.1.smithi155.stdout:0/389: creat d1/d6/d16/f8d x:0 0 0 2024-04-25T15:57:38.789 INFO:tasks.workunit.client.1.smithi155.stdout:4/403: chown da/dc/d18/d6e 881 1 2024-04-25T15:57:38.789 INFO:tasks.workunit.client.1.smithi155.stdout:2/485: dread d7/db/d2e/d44/f7f [0,4194304] 0 2024-04-25T15:57:38.791 INFO:tasks.workunit.client.1.smithi155.stdout:3/517: mknod d1/d4/db/cac 0 2024-04-25T15:57:38.793 INFO:tasks.workunit.client.1.smithi155.stdout:5/431: creat d0/d3/d15/f88 x:0 0 0 2024-04-25T15:57:38.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/390: mknod d1/d6/d16/d6e/c8e 0 2024-04-25T15:57:38.800 INFO:tasks.workunit.client.1.smithi155.stdout:6/525: dwrite d0/d13/f20 [0,4194304] 0 2024-04-25T15:57:38.800 INFO:tasks.workunit.client.1.smithi155.stdout:4/404: creat da/d23/d3f/d56/d69/d83/f91 x:0 0 0 2024-04-25T15:57:38.800 INFO:tasks.workunit.client.1.smithi155.stdout:7/501: dwrite d2/dd/d13/d1c/f1e [4194304,4194304] 0 2024-04-25T15:57:38.803 INFO:tasks.workunit.client.1.smithi155.stdout:3/518: creat d1/d4/db/d20/d44/d52/fad x:0 0 0 2024-04-25T15:57:38.812 INFO:tasks.workunit.client.1.smithi155.stdout:4/405: mknod da/d23/d3f/d56/c92 0 2024-04-25T15:57:38.816 INFO:tasks.workunit.client.1.smithi155.stdout:7/502: rename d2/dd/d30/d44/d7f/fa7 to d2/dd/d13/fa8 0 2024-04-25T15:57:38.816 INFO:tasks.workunit.client.1.smithi155.stdout:0/391: dread d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:38.818 INFO:tasks.workunit.client.1.smithi155.stdout:9/355: getdents dc/d13 0 2024-04-25T15:57:38.818 INFO:tasks.workunit.client.1.smithi155.stdout:4/406: mkdir da/d23/d3a/d7b/d93 0 2024-04-25T15:57:38.821 INFO:tasks.workunit.client.1.smithi155.stdout:2/486: dwrite d7/db/dd/f11 [4194304,4194304] 0 2024-04-25T15:57:38.821 INFO:tasks.workunit.client.1.smithi155.stdout:0/392: mknod d1/d3/d6a/c8f 0 2024-04-25T15:57:38.822 INFO:tasks.workunit.client.1.smithi155.stdout:3/519: chown d1/d4/d10/d2a/c30 794 1 2024-04-25T15:57:38.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/526: getdents d0/d18/d63 0 2024-04-25T15:57:38.822 INFO:tasks.workunit.client.1.smithi155.stdout:5/432: dread d0/d27/f69 [0,4194304] 0 2024-04-25T15:57:38.824 INFO:tasks.workunit.client.1.smithi155.stdout:2/487: fsync d7/db/dd/d15/f33 0 2024-04-25T15:57:38.825 INFO:tasks.workunit.client.1.smithi155.stdout:4/407: creat da/d23/f94 x:0 0 0 2024-04-25T15:57:38.827 INFO:tasks.workunit.client.1.smithi155.stdout:7/503: write d2/dd/fa6 [4392915,54634] 0 2024-04-25T15:57:38.827 INFO:tasks.workunit.client.1.smithi155.stdout:3/520: creat d1/d4/d10/d21/d73/d77/d5f/fae x:0 0 0 2024-04-25T15:57:38.828 INFO:tasks.workunit.client.1.smithi155.stdout:0/393: creat d1/d6/f90 x:0 0 0 2024-04-25T15:57:38.829 INFO:tasks.workunit.client.1.smithi155.stdout:5/433: symlink d0/l89 0 2024-04-25T15:57:38.831 INFO:tasks.workunit.client.1.smithi155.stdout:2/488: fdatasync d7/db/d2e/d44/f4b 0 2024-04-25T15:57:38.833 INFO:tasks.workunit.client.1.smithi155.stdout:7/504: dread - d2/d26/d3d/d65/f9f zero size 2024-04-25T15:57:38.835 INFO:tasks.workunit.client.1.smithi155.stdout:2/489: chown d7/f2d 5794 1 2024-04-25T15:57:38.835 INFO:tasks.workunit.client.1.smithi155.stdout:0/394: chown d1/d3/d12/c1c 0 1 2024-04-25T15:57:38.837 INFO:tasks.workunit.client.1.smithi155.stdout:5/434: read d0/d3/d15/f16 [153310,57029] 0 2024-04-25T15:57:38.837 INFO:tasks.workunit.client.1.smithi155.stdout:7/505: chown d2/f5b 58696808 1 2024-04-25T15:57:38.840 INFO:tasks.workunit.client.1.smithi155.stdout:0/395: fsync d1/d6/f2f 0 2024-04-25T15:57:38.842 INFO:tasks.workunit.client.1.smithi155.stdout:9/356: dwrite dc/d17/f29 [0,4194304] 0 2024-04-25T15:57:38.842 INFO:tasks.workunit.client.1.smithi155.stdout:2/490: unlink d7/db/d2e/d6f/d91/f9a 0 2024-04-25T15:57:38.844 INFO:tasks.workunit.client.1.smithi155.stdout:6/527: dwrite d0/d1a/d87/fa3 [0,4194304] 0 2024-04-25T15:57:38.844 INFO:tasks.workunit.client.1.smithi155.stdout:5/435: creat d0/d58/d32/d6a/f8a x:0 0 0 2024-04-25T15:57:38.847 INFO:tasks.workunit.client.1.smithi155.stdout:0/396: truncate d1/d1a/f5f 309438 0 2024-04-25T15:57:38.849 INFO:tasks.workunit.client.1.smithi155.stdout:4/408: dwrite da/d23/d3f/d56/d69/d4a/d78/d62/f7e [0,4194304] 0 2024-04-25T15:57:38.851 INFO:tasks.workunit.client.1.smithi155.stdout:0/397: write d1/d3/d5/f2c [1164623,108612] 0 2024-04-25T15:57:38.858 INFO:tasks.workunit.client.1.smithi155.stdout:3/521: write d1/d4/d10/d2a/f3c [4714905,65237] 0 2024-04-25T15:57:38.858 INFO:tasks.workunit.client.1.smithi155.stdout:9/357: rename dc/d11/l77 to dc/d11/d30/d46/l7f 0 2024-04-25T15:57:38.858 INFO:tasks.workunit.client.1.smithi155.stdout:9/358: chown dc/d17/d2a 7180243 1 2024-04-25T15:57:38.859 INFO:tasks.workunit.client.1.smithi155.stdout:4/409: creat da/d23/d3f/d56/d69/f95 x:0 0 0 2024-04-25T15:57:38.861 INFO:tasks.workunit.client.1.smithi155.stdout:6/528: dwrite d0/d1a/d45/f52 [0,4194304] 0 2024-04-25T15:57:38.862 INFO:tasks.workunit.client.1.smithi155.stdout:6/529: readlink d0/d13/d34/d38/l79 0 2024-04-25T15:57:38.863 INFO:tasks.workunit.client.1.smithi155.stdout:6/530: stat d0/d13/d34/d38/d7a 0 2024-04-25T15:57:38.864 INFO:tasks.workunit.client.1.smithi155.stdout:3/522: creat d1/d4/db/d28/d58/faf x:0 0 0 2024-04-25T15:57:38.865 INFO:tasks.workunit.client.1.smithi155.stdout:2/491: dread d7/f3b [0,4194304] 0 2024-04-25T15:57:38.866 INFO:tasks.workunit.client.1.smithi155.stdout:2/492: chown d7/db/d2e/d44 3898 1 2024-04-25T15:57:38.867 INFO:tasks.workunit.client.1.smithi155.stdout:9/359: unlink dc/d17/d18/l1c 0 2024-04-25T15:57:38.867 INFO:tasks.workunit.client.1.smithi155.stdout:2/493: dread d7/d23/f21 [0,4194304] 0 2024-04-25T15:57:38.870 INFO:tasks.workunit.client.1.smithi155.stdout:7/506: truncate d2/dd/fa6 3394320 0 2024-04-25T15:57:38.870 INFO:tasks.workunit.client.1.smithi155.stdout:3/523: rmdir d1/d4/db/d91 39 2024-04-25T15:57:38.871 INFO:tasks.workunit.client.1.smithi155.stdout:0/398: dread d1/d6/d29/d47/f55 [0,4194304] 0 2024-04-25T15:57:38.872 INFO:tasks.workunit.client.1.smithi155.stdout:6/531: creat d0/d1a/d21/d73/faa x:0 0 0 2024-04-25T15:57:38.873 INFO:tasks.workunit.client.1.smithi155.stdout:2/494: readlink d7/db/d2e/d44/d95/l97 0 2024-04-25T15:57:38.874 INFO:tasks.workunit.client.1.smithi155.stdout:2/495: fsync d7/f82 0 2024-04-25T15:57:38.877 INFO:tasks.workunit.client.1.smithi155.stdout:4/410: getdents da/dc 0 2024-04-25T15:57:38.877 INFO:tasks.workunit.client.1.smithi155.stdout:7/507: symlink d2/dd/d66/d71/la9 0 2024-04-25T15:57:38.879 INFO:tasks.workunit.client.1.smithi155.stdout:9/360: rename dc/f14 to dc/d11/f80 0 2024-04-25T15:57:38.882 INFO:tasks.workunit.client.1.smithi155.stdout:7/508: mkdir d2/d26/d3d/d6d/daa 0 2024-04-25T15:57:38.884 INFO:tasks.workunit.client.1.smithi155.stdout:9/361: write dc/d17/f20 [185859,28319] 0 2024-04-25T15:57:38.884 INFO:tasks.workunit.client.1.smithi155.stdout:2/496: dwrite d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:38.886 INFO:tasks.workunit.client.1.smithi155.stdout:7/509: truncate d2/fa2 853688 0 2024-04-25T15:57:38.891 INFO:tasks.workunit.client.1.smithi155.stdout:6/532: write d0/d1a/d21/f47 [2485613,54046] 0 2024-04-25T15:57:38.892 INFO:tasks.workunit.client.1.smithi155.stdout:4/411: dwrite da/d30/f6d [0,4194304] 0 2024-04-25T15:57:38.893 INFO:tasks.workunit.client.1.smithi155.stdout:9/362: creat dc/d13/d60/d7a/f81 x:0 0 0 2024-04-25T15:57:38.896 INFO:tasks.workunit.client.1.smithi155.stdout:0/399: dwrite d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:38.899 INFO:tasks.workunit.client.1.smithi155.stdout:4/412: creat da/dc/d77/f96 x:0 0 0 2024-04-25T15:57:38.900 INFO:tasks.workunit.client.1.smithi155.stdout:0/400: fsync d1/d6/d16/d60/f6d 0 2024-04-25T15:57:38.902 INFO:tasks.workunit.client.1.smithi155.stdout:7/510: getdents d2/dd/d30/d44/d7f 0 2024-04-25T15:57:38.902 INFO:tasks.workunit.client.1.smithi155.stdout:4/413: stat da/dc/d18/f46 0 2024-04-25T15:57:38.905 INFO:tasks.workunit.client.1.smithi155.stdout:2/497: dwrite d7/f3b [0,4194304] 0 2024-04-25T15:57:38.906 INFO:tasks.workunit.client.1.smithi155.stdout:2/498: dread - d7/db/d2e/f84 zero size 2024-04-25T15:57:38.907 INFO:tasks.workunit.client.1.smithi155.stdout:7/511: creat d2/d26/d3d/d6d/fab x:0 0 0 2024-04-25T15:57:38.908 INFO:tasks.workunit.client.1.smithi155.stdout:4/414: mkdir da/dc/d18/d97 0 2024-04-25T15:57:38.909 INFO:tasks.workunit.client.1.smithi155.stdout:6/533: link d0/d1a/d25/d2e/d39/l5e d0/d13/d43/lab 0 2024-04-25T15:57:38.912 INFO:tasks.workunit.client.1.smithi155.stdout:0/401: dread d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:38.914 INFO:tasks.workunit.client.1.smithi155.stdout:4/415: rename da/dc/f1f to da/d23/d3f/d56/f98 0 2024-04-25T15:57:38.914 INFO:tasks.workunit.client.1.smithi155.stdout:9/363: dwrite dc/d13/f3b [0,4194304] 0 2024-04-25T15:57:38.914 INFO:tasks.workunit.client.1.smithi155.stdout:7/512: readlink d2/dd/d13/d1c/l42 0 2024-04-25T15:57:38.916 INFO:tasks.workunit.client.1.smithi155.stdout:6/534: mkdir d0/d1a/da1/dac 0 2024-04-25T15:57:38.918 INFO:tasks.workunit.client.1.smithi155.stdout:9/364: symlink dc/d13/l82 0 2024-04-25T15:57:38.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/513: symlink d2/dd/d13/d24/d8b/lac 0 2024-04-25T15:57:38.920 INFO:tasks.workunit.client.1.smithi155.stdout:6/535: write d0/d13/d43/f42 [237020,74676] 0 2024-04-25T15:57:38.921 INFO:tasks.workunit.client.1.smithi155.stdout:0/402: getdents d1/d3f 0 2024-04-25T15:57:38.922 INFO:tasks.workunit.client.1.smithi155.stdout:9/365: write dc/d13/d2e/f6d [6440968,70596] 0 2024-04-25T15:57:38.923 INFO:tasks.workunit.client.1.smithi155.stdout:2/499: dwrite d7/db/dd/d15/f28 [0,4194304] 0 2024-04-25T15:57:38.924 INFO:tasks.workunit.client.1.smithi155.stdout:4/416: symlink da/d23/d3a/d7b/d93/l99 0 2024-04-25T15:57:38.924 INFO:tasks.workunit.client.1.smithi155.stdout:9/366: fsync dc/d13/d2e/f37 0 2024-04-25T15:57:38.925 INFO:tasks.workunit.client.1.smithi155.stdout:0/403: symlink d1/d85/l91 0 2024-04-25T15:57:38.930 INFO:tasks.workunit.client.1.smithi155.stdout:4/417: write da/d23/d3f/d56/d69/d4a/d78/f31 [1310378,12309] 0 2024-04-25T15:57:38.932 INFO:tasks.workunit.client.1.smithi155.stdout:2/500: rename d7/d74 to d7/db/d2e/d44/d9e 0 2024-04-25T15:57:38.935 INFO:tasks.workunit.client.1.smithi155.stdout:7/514: dwrite d2/dd/f74 [0,4194304] 0 2024-04-25T15:57:38.938 INFO:tasks.workunit.client.1.smithi155.stdout:2/501: mkdir d7/db/d2e/d44/d70/d7b/d9f 0 2024-04-25T15:57:38.939 INFO:tasks.workunit.client.1.smithi155.stdout:9/367: dwrite dc/d11/d5a/f78 [0,4194304] 0 2024-04-25T15:57:38.944 INFO:tasks.workunit.client.1.smithi155.stdout:2/502: write d7/db/dd/f72 [1012244,104039] 0 2024-04-25T15:57:38.945 INFO:tasks.workunit.client.1.smithi155.stdout:8/300: sync 2024-04-25T15:57:38.945 INFO:tasks.workunit.client.1.smithi155.stdout:1/434: sync 2024-04-25T15:57:38.946 INFO:tasks.workunit.client.1.smithi155.stdout:0/404: dwrite d1/d3/d5/f26 [0,4194304] 0 2024-04-25T15:57:38.950 INFO:tasks.workunit.client.1.smithi155.stdout:0/405: dread d1/d1a/f5f [0,4194304] 0 2024-04-25T15:57:38.951 INFO:tasks.workunit.client.1.smithi155.stdout:2/503: unlink d7/db/l12 0 2024-04-25T15:57:38.951 INFO:tasks.workunit.client.1.smithi155.stdout:8/301: symlink d2/d5/l54 0 2024-04-25T15:57:38.952 INFO:tasks.workunit.client.1.smithi155.stdout:9/368: write dc/d17/d18/f23 [2707355,63804] 0 2024-04-25T15:57:38.952 INFO:tasks.workunit.client.1.smithi155.stdout:1/435: mkdir d1/d16/d1d/d5e/d8e 0 2024-04-25T15:57:38.954 INFO:tasks.workunit.client.1.smithi155.stdout:4/418: dwrite da/d23/d3f/d56/f98 [4194304,4194304] 0 2024-04-25T15:57:38.955 INFO:tasks.workunit.client.1.smithi155.stdout:1/436: chown d1/d6 1690855703 1 2024-04-25T15:57:38.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/504: chown d7/db/d2e/d44/d70/d7b/d9f 6000640 1 2024-04-25T15:57:38.957 INFO:tasks.workunit.client.1.smithi155.stdout:1/437: chown d1/d16/d37/l5a 515036 1 2024-04-25T15:57:38.958 INFO:tasks.workunit.client.1.smithi155.stdout:4/419: dread - da/dc/f53 zero size 2024-04-25T15:57:38.958 INFO:tasks.workunit.client.1.smithi155.stdout:7/515: dread d2/dd/d13/d1c/f1e [0,4194304] 0 2024-04-25T15:57:38.959 INFO:tasks.workunit.client.1.smithi155.stdout:9/369: write dc/d11/f27 [220576,96308] 0 2024-04-25T15:57:38.961 INFO:tasks.workunit.client.1.smithi155.stdout:1/438: write d1/d16/d1d/d29/d5f/d34/d68/f8a [407991,119351] 0 2024-04-25T15:57:38.961 INFO:tasks.workunit.client.1.smithi155.stdout:7/516: write d2/d26/d3d/d6d/f5d [2577740,7939] 0 2024-04-25T15:57:38.961 INFO:tasks.workunit.client.1.smithi155.stdout:0/406: getdents d1/d41 0 2024-04-25T15:57:38.962 INFO:tasks.workunit.client.1.smithi155.stdout:9/370: truncate dc/d13/f26 981766 0 2024-04-25T15:57:38.962 INFO:tasks.workunit.client.1.smithi155.stdout:4/420: mknod da/d23/d3a/d7b/d93/c9a 0 2024-04-25T15:57:38.964 INFO:tasks.workunit.client.1.smithi155.stdout:0/407: stat d1/d3/d5/f26 0 2024-04-25T15:57:38.965 INFO:tasks.workunit.client.1.smithi155.stdout:0/408: dread - d1/d41/f45 zero size 2024-04-25T15:57:38.966 INFO:tasks.workunit.client.1.smithi155.stdout:1/439: chown d1/d16/d1d/d29/d5f/d34/l7e 463942 1 2024-04-25T15:57:38.966 INFO:tasks.workunit.client.1.smithi155.stdout:9/371: creat dc/d11/d67/f83 x:0 0 0 2024-04-25T15:57:38.967 INFO:tasks.workunit.client.1.smithi155.stdout:4/421: mknod da/d23/d3f/d56/c9b 0 2024-04-25T15:57:38.968 INFO:tasks.workunit.client.1.smithi155.stdout:9/372: write dc/d17/d18/f23 [4070149,109052] 0 2024-04-25T15:57:38.968 INFO:tasks.workunit.client.1.smithi155.stdout:7/517: getdents d2/dd/d30/d44/d7f 0 2024-04-25T15:57:38.969 INFO:tasks.workunit.client.1.smithi155.stdout:4/422: readlink da/d23/d3a/d7b/d93/l99 0 2024-04-25T15:57:38.970 INFO:tasks.workunit.client.1.smithi155.stdout:4/423: fdatasync da/d23/d3f/d56/d69/f44 0 2024-04-25T15:57:38.971 INFO:tasks.workunit.client.1.smithi155.stdout:9/373: mknod dc/d17/d2a/c84 0 2024-04-25T15:57:38.975 INFO:tasks.workunit.client.1.smithi155.stdout:9/374: link dc/d3c/c71 dc/d74/c85 0 2024-04-25T15:57:38.977 INFO:tasks.workunit.client.1.smithi155.stdout:1/440: write d1/d6/f2f [3270941,92463] 0 2024-04-25T15:57:38.978 INFO:tasks.workunit.client.1.smithi155.stdout:0/409: truncate d1/d6/d29/f74 2694912 0 2024-04-25T15:57:38.979 INFO:tasks.workunit.client.1.smithi155.stdout:9/375: mknod dc/d13/d48/c86 0 2024-04-25T15:57:38.980 INFO:tasks.workunit.client.1.smithi155.stdout:7/518: dread d2/dd/d36/f62 [0,4194304] 0 2024-04-25T15:57:38.984 INFO:tasks.workunit.client.1.smithi155.stdout:7/519: chown d2/dd/d66/d8c/f90 45 1 2024-04-25T15:57:38.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/410: truncate d1/d3f/f65 2096687 0 2024-04-25T15:57:38.991 INFO:tasks.workunit.client.1.smithi155.stdout:1/441: dwrite d1/d6/f2f [0,4194304] 0 2024-04-25T15:57:38.992 INFO:tasks.workunit.client.1.smithi155.stdout:4/424: dread da/d23/f3d [0,4194304] 0 2024-04-25T15:57:38.993 INFO:tasks.workunit.client.1.smithi155.stdout:8/302: dread d2/fc [0,4194304] 0 2024-04-25T15:57:38.995 INFO:tasks.workunit.client.1.smithi155.stdout:9/376: dwrite dc/d13/d2e/d4c/f61 [4194304,4194304] 0 2024-04-25T15:57:38.997 INFO:tasks.workunit.client.1.smithi155.stdout:2/505: dread d7/db/dd/f38 [0,4194304] 0 2024-04-25T15:57:38.998 INFO:tasks.workunit.client.1.smithi155.stdout:0/411: getdents d1/d3/d12 0 2024-04-25T15:57:39.003 INFO:tasks.workunit.client.1.smithi155.stdout:8/303: mknod d2/d15/d18/d23/c55 0 2024-04-25T15:57:39.005 INFO:tasks.workunit.client.1.smithi155.stdout:9/377: mknod dc/d74/c87 0 2024-04-25T15:57:39.008 INFO:tasks.workunit.client.1.smithi155.stdout:8/304: write d2/d15/d18/d34/f43 [327444,36333] 0 2024-04-25T15:57:39.008 INFO:tasks.workunit.client.1.smithi155.stdout:2/506: getdents d7/db/dd 0 2024-04-25T15:57:39.009 INFO:tasks.workunit.client.1.smithi155.stdout:1/442: dwrite d1/d16/d1d/d29/f55 [0,4194304] 0 2024-04-25T15:57:39.010 INFO:tasks.workunit.client.1.smithi155.stdout:9/378: write dc/d17/f20 [946756,24969] 0 2024-04-25T15:57:39.011 INFO:tasks.workunit.client.1.smithi155.stdout:0/412: dread d1/d41/f44 [0,4194304] 0 2024-04-25T15:57:39.011 INFO:tasks.workunit.client.1.smithi155.stdout:1/443: mkdir d1/d16/d8f 0 2024-04-25T15:57:39.011 INFO:tasks.workunit.client.1.smithi155.stdout:8/305: write d2/fc [2003876,79011] 0 2024-04-25T15:57:39.012 INFO:tasks.workunit.client.1.smithi155.stdout:2/507: symlink d7/db/d2e/d44/la0 0 2024-04-25T15:57:39.013 INFO:tasks.workunit.client.1.smithi155.stdout:0/413: write d1/f70 [784076,10574] 0 2024-04-25T15:57:39.015 INFO:tasks.workunit.client.1.smithi155.stdout:2/508: symlink d7/db/la1 0 2024-04-25T15:57:39.017 INFO:tasks.workunit.client.1.smithi155.stdout:2/509: stat d7/db/dd/d15/f42 0 2024-04-25T15:57:39.018 INFO:tasks.workunit.client.1.smithi155.stdout:0/414: mkdir d1/d3/d12/d92 0 2024-04-25T15:57:39.021 INFO:tasks.workunit.client.1.smithi155.stdout:4/425: truncate da/d23/f3d 181960 0 2024-04-25T15:57:39.022 INFO:tasks.workunit.client.1.smithi155.stdout:9/379: getdents dc/d17/d18 0 2024-04-25T15:57:39.023 INFO:tasks.workunit.client.1.smithi155.stdout:2/510: mknod d7/db/dd/d15/d60/ca2 0 2024-04-25T15:57:39.024 INFO:tasks.workunit.client.1.smithi155.stdout:1/444: dwrite d1/d16/d1d/d5e/f63 [0,4194304] 0 2024-04-25T15:57:39.024 INFO:tasks.workunit.client.1.smithi155.stdout:4/426: fsync da/d23/d3f/d56/f98 0 2024-04-25T15:57:39.026 INFO:tasks.workunit.client.1.smithi155.stdout:4/427: dread - da/d23/d3a/d7b/f8e zero size 2024-04-25T15:57:39.028 INFO:tasks.workunit.client.1.smithi155.stdout:4/428: dread - da/d23/d3f/d56/f7c zero size 2024-04-25T15:57:39.030 INFO:tasks.workunit.client.1.smithi155.stdout:9/380: creat dc/d13/d48/f88 x:0 0 0 2024-04-25T15:57:39.032 INFO:tasks.workunit.client.1.smithi155.stdout:4/429: symlink da/d30/l9c 0 2024-04-25T15:57:39.033 INFO:tasks.workunit.client.1.smithi155.stdout:8/306: dwrite d2/d15/d18/d49/f3a [0,4194304] 0 2024-04-25T15:57:39.034 INFO:tasks.workunit.client.1.smithi155.stdout:9/381: mknod dc/d13/d59/c89 0 2024-04-25T15:57:39.037 INFO:tasks.workunit.client.1.smithi155.stdout:4/430: unlink da/d23/d3f/d56/d69/d4a/d78/f7f 0 2024-04-25T15:57:39.039 INFO:tasks.workunit.client.1.smithi155.stdout:8/307: unlink d2/d15/d18/d34/f43 0 2024-04-25T15:57:39.045 INFO:tasks.workunit.client.1.smithi155.stdout:1/445: dwrite d1/d16/f2c [0,4194304] 0 2024-04-25T15:57:39.045 INFO:tasks.workunit.client.1.smithi155.stdout:8/308: mknod d2/d15/d18/d34/d48/c56 0 2024-04-25T15:57:39.049 INFO:tasks.workunit.client.1.smithi155.stdout:4/431: link da/dc/d18/f27 da/d87/f9d 0 2024-04-25T15:57:39.050 INFO:tasks.workunit.client.1.smithi155.stdout:1/446: unlink d1/d16/d1d/d29/d3d/d43/c58 0 2024-04-25T15:57:39.050 INFO:tasks.workunit.client.1.smithi155.stdout:4/432: chown da/d23/d3f/d56/c92 13 1 2024-04-25T15:57:39.051 INFO:tasks.workunit.client.1.smithi155.stdout:9/382: write dc/d17/f1b [6248842,8382] 0 2024-04-25T15:57:39.052 INFO:tasks.workunit.client.1.smithi155.stdout:1/447: chown d1/f15 1654905297 1 2024-04-25T15:57:39.052 INFO:tasks.workunit.client.1.smithi155.stdout:2/511: dread d7/db/d2e/d44/f6d [0,4194304] 0 2024-04-25T15:57:39.053 INFO:tasks.workunit.client.1.smithi155.stdout:8/309: rename d2/d5/f29 to d2/d15/d35/f57 0 2024-04-25T15:57:39.053 INFO:tasks.workunit.client.1.smithi155.stdout:1/448: read - d1/f7a zero size 2024-04-25T15:57:39.053 INFO:tasks.workunit.client.1.smithi155.stdout:4/433: read - da/d23/d3f/d56/f67 zero size 2024-04-25T15:57:39.054 INFO:tasks.workunit.client.1.smithi155.stdout:2/512: chown d7/d23/f35 3385 1 2024-04-25T15:57:39.054 INFO:tasks.workunit.client.1.smithi155.stdout:4/434: write f7 [3158123,84138] 0 2024-04-25T15:57:39.056 INFO:tasks.workunit.client.1.smithi155.stdout:1/449: write d1/d16/d1d/d29/d5f/f5d [1124323,56575] 0 2024-04-25T15:57:39.057 INFO:tasks.workunit.client.1.smithi155.stdout:9/383: link dc/d17/f1b dc/d13/d60/f8a 0 2024-04-25T15:57:39.057 INFO:tasks.workunit.client.1.smithi155.stdout:1/450: write d1/d16/f27 [3055219,103527] 0 2024-04-25T15:57:39.058 INFO:tasks.workunit.client.1.smithi155.stdout:8/310: creat d2/d5/d40/f58 x:0 0 0 2024-04-25T15:57:39.059 INFO:tasks.workunit.client.1.smithi155.stdout:4/435: mknod da/d23/c9e 0 2024-04-25T15:57:39.062 INFO:tasks.workunit.client.1.smithi155.stdout:9/384: write dc/d13/f54 [919517,95626] 0 2024-04-25T15:57:39.062 INFO:tasks.workunit.client.1.smithi155.stdout:1/451: write d1/d6/f6b [182521,123354] 0 2024-04-25T15:57:39.063 INFO:tasks.workunit.client.1.smithi155.stdout:8/311: mkdir d2/d15/d18/d34/d48/d59 0 2024-04-25T15:57:39.063 INFO:tasks.workunit.client.1.smithi155.stdout:4/436: fsync da/dc/d18/f4c 0 2024-04-25T15:57:39.065 INFO:tasks.workunit.client.1.smithi155.stdout:4/437: dread - da/d30/f5c zero size 2024-04-25T15:57:39.066 INFO:tasks.workunit.client.1.smithi155.stdout:4/438: fdatasync da/f11 0 2024-04-25T15:57:39.066 INFO:tasks.workunit.client.1.smithi155.stdout:1/452: rename d1/d16/d1d/d29/d5f/c26 to d1/d16/d1d/d5e/d8e/c90 0 2024-04-25T15:57:39.067 INFO:tasks.workunit.client.1.smithi155.stdout:8/312: write d2/d15/d18/d49/f3a [881490,94666] 0 2024-04-25T15:57:39.067 INFO:tasks.workunit.client.1.smithi155.stdout:1/453: stat d1/c2e 0 2024-04-25T15:57:39.068 INFO:tasks.workunit.client.1.smithi155.stdout:2/513: dwrite d7/db/dd/d15/f1d [0,4194304] 0 2024-04-25T15:57:39.069 INFO:tasks.workunit.client.1.smithi155.stdout:5/436: sync 2024-04-25T15:57:39.070 INFO:tasks.workunit.client.1.smithi155.stdout:1/454: write d1/d32/d86/f87 [2190797,71739] 0 2024-04-25T15:57:39.071 INFO:tasks.workunit.client.1.smithi155.stdout:9/385: rename dc/d11/d5a/f69 to dc/d17/d2a/f8b 0 2024-04-25T15:57:39.071 INFO:tasks.workunit.client.1.smithi155.stdout:4/439: write da/d23/d3f/d56/d69/d4a/d78/f31 [276956,28968] 0 2024-04-25T15:57:39.074 INFO:tasks.workunit.client.1.smithi155.stdout:1/455: chown d1/d16/f54 61963 1 2024-04-25T15:57:39.075 INFO:tasks.workunit.client.1.smithi155.stdout:4/440: write da/dc/d77/f96 [230811,50896] 0 2024-04-25T15:57:39.081 INFO:tasks.workunit.client.1.smithi155.stdout:8/313: rmdir d2/d15/d18/d23/d3c/d4a 0 2024-04-25T15:57:39.082 INFO:tasks.workunit.client.1.smithi155.stdout:4/441: creat da/dc/d18/f9f x:0 0 0 2024-04-25T15:57:39.085 INFO:tasks.workunit.client.1.smithi155.stdout:9/386: dwrite dc/d13/d2e/f6d [8388608,4194304] 0 2024-04-25T15:57:39.089 INFO:tasks.workunit.client.1.smithi155.stdout:1/456: dwrite d1/d6/fc [4194304,4194304] 0 2024-04-25T15:57:39.150 INFO:tasks.workunit.client.1.smithi155.stdout:1/457: chown d1/d32/d86/f87 2516224 1 2024-04-25T15:57:39.164 INFO:tasks.workunit.client.1.smithi155.stdout:8/314: creat d2/d15/d18/d23/d2d/f5a x:0 0 0 2024-04-25T15:57:39.168 INFO:tasks.workunit.client.1.smithi155.stdout:2/514: truncate d7/db/f4a 921002 0 2024-04-25T15:57:39.170 INFO:tasks.workunit.client.1.smithi155.stdout:5/437: truncate d0/d3/f4a 269008 0 2024-04-25T15:57:39.174 INFO:tasks.workunit.client.1.smithi155.stdout:2/515: creat d7/db/d2e/d44/d70/fa3 x:0 0 0 2024-04-25T15:57:39.175 INFO:tasks.workunit.client.1.smithi155.stdout:2/516: chown d7/db/d2e/c4d 60 1 2024-04-25T15:57:39.176 INFO:tasks.workunit.client.1.smithi155.stdout:5/438: mknod d0/d3/d15/d1f/c8b 0 2024-04-25T15:57:39.180 INFO:tasks.workunit.client.1.smithi155.stdout:1/458: mknod d1/c91 0 2024-04-25T15:57:39.181 INFO:tasks.workunit.client.1.smithi155.stdout:5/439: symlink d0/d47/d59/l8c 0 2024-04-25T15:57:39.187 INFO:tasks.workunit.client.1.smithi155.stdout:4/442: dwrite da/d23/d3f/d56/d69/d4a/d78/f8d [0,4194304] 0 2024-04-25T15:57:39.198 INFO:tasks.workunit.client.1.smithi155.stdout:2/517: dwrite d7/db/dd/d15/f33 [0,4194304] 0 2024-04-25T15:57:39.199 INFO:tasks.workunit.client.1.smithi155.stdout:9/387: truncate dc/d13/f26 170151 0 2024-04-25T15:57:39.199 INFO:tasks.workunit.client.1.smithi155.stdout:3/524: sync 2024-04-25T15:57:39.200 INFO:tasks.workunit.client.1.smithi155.stdout:4/443: creat da/d23/fa0 x:0 0 0 2024-04-25T15:57:39.204 INFO:tasks.workunit.client.1.smithi155.stdout:3/525: chown d1/f1f 18 1 2024-04-25T15:57:39.205 INFO:tasks.workunit.client.1.smithi155.stdout:2/518: truncate d7/db/d2e/f47 448057 0 2024-04-25T15:57:39.205 INFO:tasks.workunit.client.1.smithi155.stdout:1/459: dread d1/d16/d1d/d29/f55 [0,4194304] 0 2024-04-25T15:57:39.208 INFO:tasks.workunit.client.1.smithi155.stdout:9/388: creat dc/d11/d5a/f8c x:0 0 0 2024-04-25T15:57:39.209 INFO:tasks.workunit.client.1.smithi155.stdout:9/389: chown dc/d13/l58 113 1 2024-04-25T15:57:39.210 INFO:tasks.workunit.client.1.smithi155.stdout:2/519: rmdir d7 39 2024-04-25T15:57:39.210 INFO:tasks.workunit.client.1.smithi155.stdout:3/526: read d1/d4/f41 [1658185,66843] 0 2024-04-25T15:57:39.213 INFO:tasks.workunit.client.1.smithi155.stdout:5/440: dread d0/d27/f43 [0,4194304] 0 2024-04-25T15:57:39.214 INFO:tasks.workunit.client.1.smithi155.stdout:5/441: chown d0/d3/d15 804257153 1 2024-04-25T15:57:39.218 INFO:tasks.workunit.client.1.smithi155.stdout:2/520: truncate d7/db/d2e/d44/f68 1706713 0 2024-04-25T15:57:39.218 INFO:tasks.workunit.client.1.smithi155.stdout:9/390: dread dc/d13/d59/f5f [0,4194304] 0 2024-04-25T15:57:39.219 INFO:tasks.workunit.client.1.smithi155.stdout:1/460: truncate d1/d16/d1d/d33/f64 1088836 0 2024-04-25T15:57:39.219 INFO:tasks.workunit.client.1.smithi155.stdout:2/521: chown d7/db/dd/l25 0 1 2024-04-25T15:57:39.220 INFO:tasks.workunit.client.1.smithi155.stdout:1/461: write d1/f8 [3958904,20910] 0 2024-04-25T15:57:39.221 INFO:tasks.workunit.client.1.smithi155.stdout:2/522: chown d7/db/d2e/d44/d70/fa3 386 1 2024-04-25T15:57:39.222 INFO:tasks.workunit.client.1.smithi155.stdout:4/444: rename da/dc/d18/d6e/f89 to da/fa1 0 2024-04-25T15:57:39.224 INFO:tasks.workunit.client.1.smithi155.stdout:4/445: dread - da/d23/d3f/d56/d69/d83/f7d zero size 2024-04-25T15:57:39.225 INFO:tasks.workunit.client.1.smithi155.stdout:4/446: truncate f7 4491702 0 2024-04-25T15:57:39.235 INFO:tasks.workunit.client.1.smithi155.stdout:3/527: rename d1/d4/d10/d21/d73/d77/d57/c5c to d1/d4/db/d20/d44/d52/d61/cb0 0 2024-04-25T15:57:39.235 INFO:tasks.workunit.client.1.smithi155.stdout:4/447: dwrite da/d23/d3f/d56/d69/f95 [0,4194304] 0 2024-04-25T15:57:39.246 INFO:tasks.workunit.client.1.smithi155.stdout:5/442: rmdir d0/d84 0 2024-04-25T15:57:39.246 INFO:tasks.workunit.client.1.smithi155.stdout:5/443: read - d0/d58/d32/d6a/d78/f87 zero size 2024-04-25T15:57:39.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:39.248 INFO:tasks.workunit.client.1.smithi155.stdout:5/444: chown d0/d47/c6d 5 1 2024-04-25T15:57:39.250 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:39.252 INFO:tasks.workunit.client.1.smithi155.stdout:1/462: link d1/d16/d1d/d33/l4a d1/d16/d1d/l92 0 2024-04-25T15:57:39.254 INFO:tasks.workunit.client.1.smithi155.stdout:3/528: symlink d1/d4/d10/d21/dab/lb1 0 2024-04-25T15:57:39.255 INFO:tasks.workunit.client.1.smithi155.stdout:3/529: read - d1/d4/db/f5e zero size 2024-04-25T15:57:39.258 INFO:tasks.workunit.client.1.smithi155.stdout:1/463: mkdir d1/d16/d1d/d29/d5f/d34/d68/d93 0 2024-04-25T15:57:39.266 INFO:tasks.workunit.client.1.smithi155.stdout:2/523: write d7/db/d29/f30 [161419,108951] 0 2024-04-25T15:57:39.266 INFO:tasks.workunit.client.1.smithi155.stdout:3/530: creat d1/d4/d10/d21/d73/fb2 x:0 0 0 2024-04-25T15:57:39.269 INFO:tasks.workunit.client.1.smithi155.stdout:5/445: creat d0/d3/d15/f8d x:0 0 0 2024-04-25T15:57:39.269 INFO:tasks.workunit.client.1.smithi155.stdout:9/391: truncate fa 2018051 0 2024-04-25T15:57:39.271 INFO:tasks.workunit.client.1.smithi155.stdout:2/524: dwrite d7/db/d29/f54 [0,4194304] 0 2024-04-25T15:57:39.273 INFO:tasks.workunit.client.1.smithi155.stdout:2/525: chown d7/db/d2e/d44/c56 422188931 1 2024-04-25T15:57:39.274 INFO:tasks.workunit.client.1.smithi155.stdout:3/531: chown d1/d4/d10/d2a/d6c 15 1 2024-04-25T15:57:39.277 INFO:tasks.workunit.client.1.smithi155.stdout:1/464: creat d1/d16/d1d/d29/d3d/d43/d88/f94 x:0 0 0 2024-04-25T15:57:39.279 INFO:tasks.workunit.client.1.smithi155.stdout:9/392: dread dc/d13/f54 [0,4194304] 0 2024-04-25T15:57:39.281 INFO:tasks.workunit.client.1.smithi155.stdout:9/393: write dc/d13/d2e/d4c/f61 [7045121,92351] 0 2024-04-25T15:57:39.284 INFO:tasks.workunit.client.1.smithi155.stdout:1/465: creat d1/d32/f95 x:0 0 0 2024-04-25T15:57:39.286 INFO:tasks.workunit.client.1.smithi155.stdout:3/532: dwrite d1/d4/db/d28/f87 [0,4194304] 0 2024-04-25T15:57:39.297 INFO:tasks.workunit.client.1.smithi155.stdout:3/533: write d1/d4/f18 [2878399,38599] 0 2024-04-25T15:57:39.297 INFO:tasks.workunit.client.1.smithi155.stdout:7/520: sync 2024-04-25T15:57:39.297 INFO:tasks.workunit.client.1.smithi155.stdout:6/536: sync 2024-04-25T15:57:39.300 INFO:tasks.workunit.client.1.smithi155.stdout:3/534: read d1/d4/db/d20/f46 [969571,87094] 0 2024-04-25T15:57:39.302 INFO:tasks.workunit.client.1.smithi155.stdout:2/526: creat d7/db/d29/fa4 x:0 0 0 2024-04-25T15:57:39.306 INFO:tasks.workunit.client.1.smithi155.stdout:1/466: mknod d1/d16/d8f/c96 0 2024-04-25T15:57:39.307 INFO:tasks.workunit.client.1.smithi155.stdout:7/521: dwrite d2/f68 [0,4194304] 0 2024-04-25T15:57:39.308 INFO:tasks.workunit.client.1.smithi155.stdout:7/522: stat d2/dd/d36/d46/f51 0 2024-04-25T15:57:39.309 INFO:tasks.workunit.client.1.smithi155.stdout:5/446: link d0/d3/d15/d1f/l6f d0/d3/l8e 0 2024-04-25T15:57:39.313 INFO:tasks.workunit.client.1.smithi155.stdout:3/535: chown d1/cc 226 1 2024-04-25T15:57:39.317 INFO:tasks.workunit.client.1.smithi155.stdout:2/527: creat d7/db/d2e/d44/d9e/fa5 x:0 0 0 2024-04-25T15:57:39.317 INFO:tasks.workunit.client.1.smithi155.stdout:9/394: dwrite dc/d17/f2b [0,4194304] 0 2024-04-25T15:57:39.321 INFO:tasks.workunit.client.1.smithi155.stdout:6/537: mknod d0/d13/d34/d38/d90/da5/cad 0 2024-04-25T15:57:39.322 INFO:tasks.workunit.client.1.smithi155.stdout:6/538: dread - d0/d1a/d25/d51/f84 zero size 2024-04-25T15:57:39.323 INFO:tasks.workunit.client.1.smithi155.stdout:6/539: fsync d0/d1a/d21/d73/faa 0 2024-04-25T15:57:39.324 INFO:tasks.workunit.client.1.smithi155.stdout:3/536: dwrite d1/d4/d10/d21/f22 [0,4194304] 0 2024-04-25T15:57:39.326 INFO:tasks.workunit.client.1.smithi155.stdout:7/523: rename d2/d26/d3d/d65/f81 to d2/dd/d13/d1c/fad 0 2024-04-25T15:57:39.331 INFO:tasks.workunit.client.1.smithi155.stdout:1/467: mknod d1/d16/d1d/d29/d5f/d34/c97 0 2024-04-25T15:57:39.333 INFO:tasks.workunit.client.1.smithi155.stdout:8/315: sync 2024-04-25T15:57:39.333 INFO:tasks.workunit.client.1.smithi155.stdout:0/415: sync 2024-04-25T15:57:39.336 INFO:tasks.workunit.client.1.smithi155.stdout:6/540: mkdir d0/d13/d6f/dae 0 2024-04-25T15:57:39.336 INFO:tasks.workunit.client.1.smithi155.stdout:6/541: chown d0/d1a/d37/f3e 45380757 1 2024-04-25T15:57:39.339 INFO:tasks.workunit.client.1.smithi155.stdout:7/524: symlink d2/dd/d13/lae 0 2024-04-25T15:57:39.342 INFO:tasks.workunit.client.1.smithi155.stdout:1/468: symlink d1/d16/d7f/l98 0 2024-04-25T15:57:39.345 INFO:tasks.workunit.client.1.smithi155.stdout:6/542: readlink d0/d13/d43/lab 0 2024-04-25T15:57:39.346 INFO:tasks.workunit.client.1.smithi155.stdout:7/525: rename d2/dd/d13/f8e to d2/dd/d36/d46/faf 0 2024-04-25T15:57:39.348 INFO:tasks.workunit.client.1.smithi155.stdout:5/447: dwrite d0/d3/d15/f16 [0,4194304] 0 2024-04-25T15:57:39.348 INFO:tasks.workunit.client.1.smithi155.stdout:6/543: write d0/d1a/d25/f2d [864904,74563] 0 2024-04-25T15:57:39.350 INFO:tasks.workunit.client.1.smithi155.stdout:1/469: fsync d1/d16/d1d/d29/d5f/f85 0 2024-04-25T15:57:39.351 INFO:tasks.workunit.client.1.smithi155.stdout:9/395: truncate dc/d17/f1b 3147280 0 2024-04-25T15:57:39.354 INFO:tasks.workunit.client.1.smithi155.stdout:0/416: write d1/d6/d29/f74 [664865,116664] 0 2024-04-25T15:57:39.363 INFO:tasks.workunit.client.1.smithi155.stdout:2/528: dwrite d7/db/f51 [0,4194304] 0 2024-04-25T15:57:39.366 INFO:tasks.workunit.client.1.smithi155.stdout:9/396: write dc/d13/f3a [4219900,15418] 0 2024-04-25T15:57:39.369 INFO:tasks.workunit.client.1.smithi155.stdout:8/316: getdents d2/d15/d18/d23/d3c 0 2024-04-25T15:57:39.369 INFO:tasks.workunit.client.1.smithi155.stdout:5/448: dread d0/d3/d15/d30/d4f/f62 [0,4194304] 0 2024-04-25T15:57:39.371 INFO:tasks.workunit.client.1.smithi155.stdout:7/526: creat d2/dd/d66/fb0 x:0 0 0 2024-04-25T15:57:39.371 INFO:tasks.workunit.client.1.smithi155.stdout:3/537: dwrite d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:39.375 INFO:tasks.workunit.client.1.smithi155.stdout:1/470: dwrite d1/f11 [4194304,4194304] 0 2024-04-25T15:57:39.377 INFO:tasks.workunit.client.1.smithi155.stdout:6/544: write d0/f15 [3034516,69638] 0 2024-04-25T15:57:39.377 INFO:tasks.workunit.client.1.smithi155.stdout:9/397: chown dc/d17/c6c 30 1 2024-04-25T15:57:39.380 INFO:tasks.workunit.client.1.smithi155.stdout:8/317: mkdir d2/d5/d40/d5b 0 2024-04-25T15:57:39.380 INFO:tasks.workunit.client.1.smithi155.stdout:5/449: mknod d0/d3/d15/d30/c8f 0 2024-04-25T15:57:39.380 INFO:tasks.workunit.client.1.smithi155.stdout:7/527: symlink d2/dd/d12/d76/lb1 0 2024-04-25T15:57:39.382 INFO:tasks.workunit.client.1.smithi155.stdout:0/417: dwrite d1/d3/d5/f2c [0,4194304] 0 2024-04-25T15:57:39.383 INFO:tasks.workunit.client.1.smithi155.stdout:7/528: stat d2/dd/d13/d1c/f6f 0 2024-04-25T15:57:39.383 INFO:tasks.workunit.client.1.smithi155.stdout:1/471: chown d1/d16/d1d/d29/d3d/d43/c79 2927137 1 2024-04-25T15:57:39.385 INFO:tasks.workunit.client.1.smithi155.stdout:7/529: write d2/dd/f74 [3000413,104448] 0 2024-04-25T15:57:39.392 INFO:tasks.workunit.client.1.smithi155.stdout:7/530: write d2/dd/d66/fb0 [831987,69100] 0 2024-04-25T15:57:39.397 INFO:tasks.workunit.client.1.smithi155.stdout:0/418: creat d1/d41/f93 x:0 0 0 2024-04-25T15:57:39.397 INFO:tasks.workunit.client.1.smithi155.stdout:1/472: write d1/f24 [146063,38087] 0 2024-04-25T15:57:39.399 INFO:tasks.workunit.client.1.smithi155.stdout:9/398: link dc/d17/f20 dc/d11/d30/d46/f8d 0 2024-04-25T15:57:39.400 INFO:tasks.workunit.client.1.smithi155.stdout:0/419: fsync d1/d3/f48 0 2024-04-25T15:57:39.401 INFO:tasks.workunit.client.1.smithi155.stdout:9/399: fdatasync dc/d17/d2a/f2c 0 2024-04-25T15:57:39.404 INFO:tasks.workunit.client.1.smithi155.stdout:8/318: dwrite d2/fa [0,4194304] 0 2024-04-25T15:57:39.405 INFO:tasks.workunit.client.1.smithi155.stdout:0/420: creat d1/d3/f94 x:0 0 0 2024-04-25T15:57:39.405 INFO:tasks.workunit.client.1.smithi155.stdout:1/473: truncate d1/d16/d37/f74 668927 0 2024-04-25T15:57:39.405 INFO:tasks.workunit.client.1.smithi155.stdout:3/538: dwrite d1/f16 [4194304,4194304] 0 2024-04-25T15:57:39.407 INFO:tasks.workunit.client.1.smithi155.stdout:9/400: unlink dc/d2f/c43 0 2024-04-25T15:57:39.408 INFO:tasks.workunit.client.1.smithi155.stdout:3/539: truncate d1/d4/d10/d21/f5a 4689142 0 2024-04-25T15:57:39.412 INFO:tasks.workunit.client.1.smithi155.stdout:0/421: dread d1/f71 [0,4194304] 0 2024-04-25T15:57:39.417 INFO:tasks.workunit.client.1.smithi155.stdout:0/422: creat d1/d6/d16/d60/f95 x:0 0 0 2024-04-25T15:57:39.419 INFO:tasks.workunit.client.1.smithi155.stdout:3/540: dwrite d1/d4/d10/d2a/f3c [4194304,4194304] 0 2024-04-25T15:57:39.421 INFO:tasks.workunit.client.1.smithi155.stdout:3/541: stat d1/d4/d25/l49 0 2024-04-25T15:57:39.424 INFO:tasks.workunit.client.1.smithi155.stdout:8/319: rename d2/d15/f51 to d2/f5c 0 2024-04-25T15:57:39.426 INFO:tasks.workunit.client.1.smithi155.stdout:0/423: fsync d1/d6/f22 0 2024-04-25T15:57:39.426 INFO:tasks.workunit.client.1.smithi155.stdout:9/401: dwrite f5 [0,4194304] 0 2024-04-25T15:57:39.428 INFO:tasks.workunit.client.1.smithi155.stdout:0/424: readlink d1/d3/d5/da/l52 0 2024-04-25T15:57:39.428 INFO:tasks.workunit.client.1.smithi155.stdout:1/474: dwrite d1/d16/d1d/d29/d5f/d34/f36 [0,4194304] 0 2024-04-25T15:57:39.430 INFO:tasks.workunit.client.1.smithi155.stdout:4/448: sync 2024-04-25T15:57:39.431 INFO:tasks.workunit.client.1.smithi155.stdout:3/542: mkdir d1/d4/d10/d21/d73/d77/d5f/db3 0 2024-04-25T15:57:39.431 INFO:tasks.workunit.client.1.smithi155.stdout:5/450: truncate d0/d58/f56 509308 0 2024-04-25T15:57:39.431 INFO:tasks.workunit.client.1.smithi155.stdout:8/320: mkdir d2/d41/d5d 0 2024-04-25T15:57:39.432 INFO:tasks.workunit.client.1.smithi155.stdout:0/425: truncate d1/d41/f45 172897 0 2024-04-25T15:57:39.433 INFO:tasks.workunit.client.1.smithi155.stdout:4/449: mkdir da/d23/da2 0 2024-04-25T15:57:39.434 INFO:tasks.workunit.client.1.smithi155.stdout:1/475: creat d1/d16/d1d/f99 x:0 0 0 2024-04-25T15:57:39.435 INFO:tasks.workunit.client.1.smithi155.stdout:4/450: write da/d23/d3f/d56/d69/d4a/d78/d62/f68 [623210,109942] 0 2024-04-25T15:57:39.437 INFO:tasks.workunit.client.1.smithi155.stdout:3/543: rename d1/d4/fa1 to d1/d4/db/d20/d44/d52/d93/da6/fb4 0 2024-04-25T15:57:39.444 INFO:tasks.workunit.client.1.smithi155.stdout:4/451: chown da/d23/f3d 587432 1 2024-04-25T15:57:39.444 INFO:tasks.workunit.client.1.smithi155.stdout:9/402: dwrite dc/d13/f3b [0,4194304] 0 2024-04-25T15:57:39.446 INFO:tasks.workunit.client.1.smithi155.stdout:0/426: dwrite d1/d3f/f7b [0,4194304] 0 2024-04-25T15:57:39.451 INFO:tasks.workunit.client.1.smithi155.stdout:1/476: creat d1/d16/d1d/d29/f9a x:0 0 0 2024-04-25T15:57:39.453 INFO:tasks.workunit.client.1.smithi155.stdout:3/544: rename d1/d4/d25 to d1/d4/db/d20/d44/d52/d61/db5 0 2024-04-25T15:57:39.453 INFO:tasks.workunit.client.1.smithi155.stdout:8/321: rmdir d2/d15 39 2024-04-25T15:57:39.455 INFO:tasks.workunit.client.1.smithi155.stdout:9/403: unlink dc/d13/d60/d7a/f81 0 2024-04-25T15:57:39.455 INFO:tasks.workunit.client.1.smithi155.stdout:0/427: creat d1/d6/d29/f96 x:0 0 0 2024-04-25T15:57:39.455 INFO:tasks.workunit.client.1.smithi155.stdout:3/545: readlink d1/d4/d6a/d86/la7 0 2024-04-25T15:57:39.455 INFO:tasks.workunit.client.1.smithi155.stdout:1/477: creat d1/d16/d1d/d29/d3d/f9b x:0 0 0 2024-04-25T15:57:39.459 INFO:tasks.workunit.client.1.smithi155.stdout:4/452: creat da/d23/d3f/fa3 x:0 0 0 2024-04-25T15:57:39.460 INFO:tasks.workunit.client.1.smithi155.stdout:3/546: mknod d1/d4/db/d20/d44/d52/d61/db5/cb6 0 2024-04-25T15:57:39.461 INFO:tasks.workunit.client.1.smithi155.stdout:9/404: mkdir dc/d17/d8e 0 2024-04-25T15:57:39.461 INFO:tasks.workunit.client.1.smithi155.stdout:4/453: chown c2 91 1 2024-04-25T15:57:39.462 INFO:tasks.workunit.client.1.smithi155.stdout:9/405: stat dc/d13/f54 0 2024-04-25T15:57:39.463 INFO:tasks.workunit.client.1.smithi155.stdout:8/322: creat d2/d15/d18/d49/f5e x:0 0 0 2024-04-25T15:57:39.465 INFO:tasks.workunit.client.1.smithi155.stdout:9/406: write f5 [3316662,90888] 0 2024-04-25T15:57:39.466 INFO:tasks.workunit.client.1.smithi155.stdout:4/454: creat da/d23/d3f/d56/d69/d83/fa4 x:0 0 0 2024-04-25T15:57:39.471 INFO:tasks.workunit.client.1.smithi155.stdout:3/547: write d1/d4/d10/d21/d73/d77/d57/d80/fa0 [872224,12971] 0 2024-04-25T15:57:39.471 INFO:tasks.workunit.client.1.smithi155.stdout:1/478: dwrite d1/d16/d1d/d29/d3d/d43/d88/f94 [0,4194304] 0 2024-04-25T15:57:39.471 INFO:tasks.workunit.client.1.smithi155.stdout:8/323: mknod d2/d15/d18/c5f 0 2024-04-25T15:57:39.471 INFO:tasks.workunit.client.1.smithi155.stdout:1/479: write d1/d6/f14 [5801431,56894] 0 2024-04-25T15:57:39.472 INFO:tasks.workunit.client.1.smithi155.stdout:8/324: dread - d2/d15/d18/d34/d48/f50 zero size 2024-04-25T15:57:39.473 INFO:tasks.workunit.client.1.smithi155.stdout:3/548: creat d1/d4/d10/d21/d73/d77/d57/d80/fb7 x:0 0 0 2024-04-25T15:57:39.473 INFO:tasks.workunit.client.1.smithi155.stdout:1/480: chown d1/d16/d1d/d29/d3d/d43/f62 0 1 2024-04-25T15:57:39.474 INFO:tasks.workunit.client.1.smithi155.stdout:4/455: mkdir da/dc/d77/da5 0 2024-04-25T15:57:39.476 INFO:tasks.workunit.client.1.smithi155.stdout:0/428: dread d1/d3/f48 [0,4194304] 0 2024-04-25T15:57:39.479 INFO:tasks.workunit.client.1.smithi155.stdout:3/549: mknod d1/cb8 0 2024-04-25T15:57:39.481 INFO:tasks.workunit.client.1.smithi155.stdout:4/456: rename da/d23/f57 to da/dc/d18/d6e/fa6 0 2024-04-25T15:57:39.482 INFO:tasks.workunit.client.1.smithi155.stdout:1/481: dwrite d1/d6/f6b [0,4194304] 0 2024-04-25T15:57:39.483 INFO:tasks.workunit.client.1.smithi155.stdout:8/325: creat d2/f60 x:0 0 0 2024-04-25T15:57:39.484 INFO:tasks.workunit.client.1.smithi155.stdout:3/550: stat d1/d4/l68 0 2024-04-25T15:57:39.487 INFO:tasks.workunit.client.1.smithi155.stdout:8/326: creat d2/d15/d18/d23/d3c/f61 x:0 0 0 2024-04-25T15:57:39.487 INFO:tasks.workunit.client.1.smithi155.stdout:4/457: chown da/d23/d3f/d56/d69/c86 1 1 2024-04-25T15:57:39.487 INFO:tasks.workunit.client.1.smithi155.stdout:3/551: symlink d1/d4/db/d28/lb9 0 2024-04-25T15:57:39.491 INFO:tasks.workunit.client.1.smithi155.stdout:3/552: truncate d1/d4/db/f55 865267 0 2024-04-25T15:57:39.491 INFO:tasks.workunit.client.1.smithi155.stdout:8/327: symlink d2/d15/d18/d49/l62 0 2024-04-25T15:57:39.492 INFO:tasks.workunit.client.1.smithi155.stdout:1/482: dwrite d1/f7a [0,4194304] 0 2024-04-25T15:57:39.494 INFO:tasks.workunit.client.1.smithi155.stdout:3/553: dread - d1/d4/db/d91/f97 zero size 2024-04-25T15:57:39.498 INFO:tasks.workunit.client.1.smithi155.stdout:3/554: symlink d1/d4/db/d91/lba 0 2024-04-25T15:57:39.499 INFO:tasks.workunit.client.1.smithi155.stdout:3/555: write d1/d4/d10/d21/f22 [58271,79681] 0 2024-04-25T15:57:39.502 INFO:tasks.workunit.client.1.smithi155.stdout:4/458: link da/d23/d3f/d56/d69/d4a/d78/f31 da/d23/d3f/fa7 0 2024-04-25T15:57:39.503 INFO:tasks.workunit.client.1.smithi155.stdout:1/483: mkdir d1/d16/d1d/d29/d5f/d34/d9c 0 2024-04-25T15:57:39.506 INFO:tasks.workunit.client.1.smithi155.stdout:0/429: truncate d1/d3f/f7b 297414 0 2024-04-25T15:57:39.507 INFO:tasks.workunit.client.1.smithi155.stdout:3/556: creat d1/d4/d10/d21/d73/d77/fbb x:0 0 0 2024-04-25T15:57:39.509 INFO:tasks.workunit.client.1.smithi155.stdout:4/459: rename da/d23/d3f/d56/d69/d4a/d78/f84 to da/d23/d3a/d7b/d93/fa8 0 2024-04-25T15:57:39.510 INFO:tasks.workunit.client.1.smithi155.stdout:3/557: chown d1/d4/d10/d21/d73/d77/d57/d80/fb7 225630 1 2024-04-25T15:57:39.512 INFO:tasks.workunit.client.1.smithi155.stdout:1/484: dwrite d1/d16/d37/f4c [0,4194304] 0 2024-04-25T15:57:39.513 INFO:tasks.workunit.client.1.smithi155.stdout:0/430: dread d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:39.517 INFO:tasks.workunit.client.1.smithi155.stdout:8/328: dwrite d2/f14 [0,4194304] 0 2024-04-25T15:57:39.517 INFO:tasks.workunit.client.1.smithi155.stdout:1/485: unlink d1/c81 0 2024-04-25T15:57:39.518 INFO:tasks.workunit.client.1.smithi155.stdout:1/486: readlink d1/d16/d1d/d29/d5f/d34/l7e 0 2024-04-25T15:57:39.519 INFO:tasks.workunit.client.1.smithi155.stdout:4/460: link da/d23/d3f/d56/c5d da/d30/ca9 0 2024-04-25T15:57:39.523 INFO:tasks.workunit.client.1.smithi155.stdout:0/431: truncate d1/d3/d3d/f7a 3446666 0 2024-04-25T15:57:39.523 INFO:tasks.workunit.client.1.smithi155.stdout:8/329: write d2/d15/d35/f44 [2469860,18302] 0 2024-04-25T15:57:39.529 INFO:tasks.workunit.client.1.smithi155.stdout:4/461: dwrite da/d30/f61 [0,4194304] 0 2024-04-25T15:57:39.534 INFO:tasks.workunit.client.1.smithi155.stdout:4/462: symlink da/dc/laa 0 2024-04-25T15:57:39.541 INFO:tasks.workunit.client.1.smithi155.stdout:4/463: link da/d23/d3f/d56/d69/d4a/d78/c51 da/dc/d18/d6e/cab 0 2024-04-25T15:57:39.541 INFO:tasks.workunit.client.1.smithi155.stdout:4/464: dread - da/d23/d3f/d56/f7c zero size 2024-04-25T15:57:39.543 INFO:tasks.workunit.client.1.smithi155.stdout:4/465: symlink da/d30/lac 0 2024-04-25T15:57:39.546 INFO:tasks.workunit.client.1.smithi155.stdout:4/466: mkdir da/d23/da2/dad 0 2024-04-25T15:57:39.552 INFO:tasks.workunit.client.1.smithi155.stdout:4/467: dwrite da/dc/f53 [0,4194304] 0 2024-04-25T15:57:39.554 INFO:tasks.workunit.client.1.smithi155.stdout:4/468: chown da/d23/c9e 67146119 1 2024-04-25T15:57:39.555 INFO:tasks.workunit.client.1.smithi155.stdout:1/487: dread d1/f15 [0,4194304] 0 2024-04-25T15:57:39.562 INFO:tasks.workunit.client.1.smithi155.stdout:1/488: dread d1/d16/d1d/d29/f55 [0,4194304] 0 2024-04-25T15:57:39.564 INFO:tasks.workunit.client.1.smithi155.stdout:1/489: rmdir d1/d16/d1d/d29/d3d 39 2024-04-25T15:57:39.566 INFO:tasks.workunit.client.1.smithi155.stdout:4/469: dwrite da/dc/d18/d6e/fa6 [0,4194304] 0 2024-04-25T15:57:39.566 INFO:tasks.workunit.client.1.smithi155.stdout:1/490: write d1/d16/f27 [764515,111399] 0 2024-04-25T15:57:39.572 INFO:tasks.workunit.client.1.smithi155.stdout:1/491: mkdir d1/d32/d9d 0 2024-04-25T15:57:39.572 INFO:tasks.workunit.client.1.smithi155.stdout:4/470: rename da/d23/d3f/d56/d69/d4a/f63 to da/d23/da2/fae 0 2024-04-25T15:57:39.576 INFO:tasks.workunit.client.1.smithi155.stdout:4/471: unlink da/dc/d18/f46 0 2024-04-25T15:57:39.577 INFO:tasks.workunit.client.1.smithi155.stdout:1/492: write d1/d16/d1d/d29/d3d/d43/f62 [468634,96024] 0 2024-04-25T15:57:39.578 INFO:tasks.workunit.client.1.smithi155.stdout:1/493: dread d1/f15 [0,4194304] 0 2024-04-25T15:57:39.582 INFO:tasks.workunit.client.1.smithi155.stdout:1/494: rename d1/d16/d1d/c83 to d1/c9e 0 2024-04-25T15:57:39.583 INFO:tasks.workunit.client.1.smithi155.stdout:1/495: write d1/d6/f2f [335797,117382] 0 2024-04-25T15:57:39.586 INFO:tasks.workunit.client.1.smithi155.stdout:1/496: rename d1/d6/f2f to d1/d16/d8f/f9f 0 2024-04-25T15:57:39.587 INFO:tasks.workunit.client.1.smithi155.stdout:1/497: fdatasync d1/d16/d1d/d29/d3d/f9b 0 2024-04-25T15:57:39.588 INFO:tasks.workunit.client.1.smithi155.stdout:1/498: readlink d1/d16/d1d/l60 0 2024-04-25T15:57:39.591 INFO:tasks.workunit.client.1.smithi155.stdout:4/472: dread da/dc/f47 [0,4194304] 0 2024-04-25T15:57:39.592 INFO:tasks.workunit.client.1.smithi155.stdout:1/499: rename d1/d16/d7f to d1/da0 0 2024-04-25T15:57:39.599 INFO:tasks.workunit.client.1.smithi155.stdout:4/473: dwrite da/d30/f85 [0,4194304] 0 2024-04-25T15:57:39.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/500: dwrite d1/d16/d1d/d29/d3d/d43/f62 [0,4194304] 0 2024-04-25T15:57:39.601 INFO:tasks.workunit.client.1.smithi155.stdout:4/474: fsync da/d30/f5c 0 2024-04-25T15:57:39.602 INFO:tasks.workunit.client.1.smithi155.stdout:4/475: readlink da/d23/d3f/l72 0 2024-04-25T15:57:39.604 INFO:tasks.workunit.client.1.smithi155.stdout:1/501: truncate d1/d16/d1d/d33/f4f 1000728 0 2024-04-25T15:57:39.612 INFO:tasks.workunit.client.1.smithi155.stdout:4/476: dread da/dc/d18/f4c [0,4194304] 0 2024-04-25T15:57:39.613 INFO:tasks.workunit.client.1.smithi155.stdout:4/477: fdatasync da/dc/d18/f9f 0 2024-04-25T15:57:39.613 INFO:tasks.workunit.client.1.smithi155.stdout:4/478: stat da/dc/d18/f9f 0 2024-04-25T15:57:39.615 INFO:tasks.workunit.client.1.smithi155.stdout:4/479: symlink da/d23/d3a/d7b/laf 0 2024-04-25T15:57:39.618 INFO:tasks.workunit.client.1.smithi155.stdout:4/480: creat da/d23/fb0 x:0 0 0 2024-04-25T15:57:39.621 INFO:tasks.workunit.client.1.smithi155.stdout:4/481: getdents da/d23/d3a 0 2024-04-25T15:57:39.623 INFO:tasks.workunit.client.1.smithi155.stdout:4/482: creat da/d23/d3f/d56/d69/d4a/d78/d62/fb1 x:0 0 0 2024-04-25T15:57:39.626 INFO:tasks.workunit.client.1.smithi155.stdout:4/483: creat da/d23/d3a/d7b/fb2 x:0 0 0 2024-04-25T15:57:39.626 INFO:tasks.workunit.client.1.smithi155.stdout:4/484: chown da/dc/d18/l1e 1475 1 2024-04-25T15:57:39.627 INFO:tasks.workunit.client.1.smithi155.stdout:4/485: dread - da/d23/d3f/d56/d69/d83/fa4 zero size 2024-04-25T15:57:39.628 INFO:tasks.workunit.client.1.smithi155.stdout:2/529: sync 2024-04-25T15:57:39.629 INFO:tasks.workunit.client.1.smithi155.stdout:4/486: mknod da/d23/da2/cb3 0 2024-04-25T15:57:39.631 INFO:tasks.workunit.client.1.smithi155.stdout:4/487: read da/f16 [3218646,103220] 0 2024-04-25T15:57:39.632 INFO:tasks.workunit.client.1.smithi155.stdout:2/530: rmdir d7/db/d93 0 2024-04-25T15:57:39.634 INFO:tasks.workunit.client.1.smithi155.stdout:4/488: mknod da/d23/d3f/d56/d69/d83/cb4 0 2024-04-25T15:57:39.637 INFO:tasks.workunit.client.1.smithi155.stdout:4/489: write da/dc/d18/d6e/f4e [3356482,48811] 0 2024-04-25T15:57:39.639 INFO:tasks.workunit.client.1.smithi155.stdout:4/490: mknod da/dc/cb5 0 2024-04-25T15:57:39.641 INFO:tasks.workunit.client.1.smithi155.stdout:4/491: unlink da/dc/f53 0 2024-04-25T15:57:39.642 INFO:tasks.workunit.client.1.smithi155.stdout:4/492: truncate da/d23/d3f/fa3 388936 0 2024-04-25T15:57:39.645 INFO:tasks.workunit.client.1.smithi155.stdout:2/531: truncate d7/f2c 468618 0 2024-04-25T15:57:39.646 INFO:tasks.workunit.client.1.smithi155.stdout:4/493: getdents da/d23/da2 0 2024-04-25T15:57:39.650 INFO:tasks.workunit.client.1.smithi155.stdout:4/494: link da/dc/d18/c64 da/d23/da2/dad/cb6 0 2024-04-25T15:57:39.651 INFO:tasks.workunit.client.1.smithi155.stdout:4/495: read - da/d30/f5c zero size 2024-04-25T15:57:39.652 INFO:tasks.workunit.client.1.smithi155.stdout:2/532: dwrite d7/f31 [0,4194304] 0 2024-04-25T15:57:39.653 INFO:tasks.workunit.client.1.smithi155.stdout:2/533: fsync d7/d23/f35 0 2024-04-25T15:57:39.655 INFO:tasks.workunit.client.1.smithi155.stdout:4/496: symlink da/d23/d3f/d56/d69/d4a/lb7 0 2024-04-25T15:57:39.657 INFO:tasks.workunit.client.1.smithi155.stdout:4/497: creat da/d23/da2/fb8 x:0 0 0 2024-04-25T15:57:39.660 INFO:tasks.workunit.client.1.smithi155.stdout:4/498: write da/d23/d3f/d56/d69/f5e [1170976,113431] 0 2024-04-25T15:57:39.662 INFO:tasks.workunit.client.1.smithi155.stdout:2/534: dwrite d7/f82 [0,4194304] 0 2024-04-25T15:57:39.664 INFO:tasks.workunit.client.1.smithi155.stdout:4/499: write da/d23/d3f/f71 [673405,76722] 0 2024-04-25T15:57:39.667 INFO:tasks.workunit.client.1.smithi155.stdout:2/535: rename d7/f16 to d7/db/d2e/d44/d70/d7b/d9f/fa6 0 2024-04-25T15:57:39.670 INFO:tasks.workunit.client.1.smithi155.stdout:4/500: rename da/dc/d18/d6e/fa6 to da/d23/d3a/d7b/fb9 0 2024-04-25T15:57:39.673 INFO:tasks.workunit.client.1.smithi155.stdout:4/501: mknod da/dc/d18/d97/cba 0 2024-04-25T15:57:39.681 INFO:tasks.workunit.client.1.smithi155.stdout:4/502: dwrite da/d23/d3f/d56/d69/d4a/d78/d62/fb1 [0,4194304] 0 2024-04-25T15:57:39.684 INFO:tasks.workunit.client.1.smithi155.stdout:4/503: creat da/d23/d3f/d56/fbb x:0 0 0 2024-04-25T15:57:39.692 INFO:tasks.workunit.client.1.smithi155.stdout:4/504: link da/d23/d3f/f79 da/d23/fbc 0 2024-04-25T15:57:39.695 INFO:tasks.workunit.client.1.smithi155.stdout:4/505: write da/d23/d3f/f79 [1370355,91405] 0 2024-04-25T15:57:39.702 INFO:tasks.workunit.client.1.smithi155.stdout:4/506: dwrite da/d23/fa0 [0,4194304] 0 2024-04-25T15:57:39.703 INFO:tasks.workunit.client.1.smithi155.stdout:4/507: stat da/d23/d3f/d56/d69/d4a/d78/d62/f7e 0 2024-04-25T15:57:39.705 INFO:tasks.workunit.client.1.smithi155.stdout:4/508: truncate da/d23/d3f/fa3 907462 0 2024-04-25T15:57:39.778 INFO:tasks.workunit.client.1.smithi155.stdout:7/531: sync 2024-04-25T15:57:39.778 INFO:tasks.workunit.client.1.smithi155.stdout:6/545: sync 2024-04-25T15:57:39.783 INFO:tasks.workunit.client.1.smithi155.stdout:6/546: creat d0/d13/d34/d38/d90/faf x:0 0 0 2024-04-25T15:57:39.784 INFO:tasks.workunit.client.1.smithi155.stdout:7/532: mkdir d2/dd/d66/db2 0 2024-04-25T15:57:39.786 INFO:tasks.workunit.client.1.smithi155.stdout:6/547: rmdir d0/d13/d34/d38/d90/da5 39 2024-04-25T15:57:39.789 INFO:tasks.workunit.client.1.smithi155.stdout:7/533: mkdir d2/d26/d3d/d6d/db3 0 2024-04-25T15:57:39.791 INFO:tasks.workunit.client.1.smithi155.stdout:7/534: write d2/d26/d3d/d6d/f8a [923304,79779] 0 2024-04-25T15:57:39.792 INFO:tasks.workunit.client.1.smithi155.stdout:7/535: chown d2/dd/d63 53398 1 2024-04-25T15:57:39.793 INFO:tasks.workunit.client.1.smithi155.stdout:7/536: readlink d2/d26/d3d/d6d/l8f 0 2024-04-25T15:57:39.794 INFO:tasks.workunit.client.1.smithi155.stdout:6/548: getdents d0/d13/d43/d56/d7b 0 2024-04-25T15:57:39.795 INFO:tasks.workunit.client.1.smithi155.stdout:6/549: readlink d0/d18/l8b 0 2024-04-25T15:57:39.796 INFO:tasks.workunit.client.1.smithi155.stdout:7/537: truncate d2/dd/d12/f20 9025975 0 2024-04-25T15:57:39.800 INFO:tasks.workunit.client.1.smithi155.stdout:6/550: unlink d0/f15 0 2024-04-25T15:57:39.805 INFO:tasks.workunit.client.1.smithi155.stdout:6/551: creat d0/d1a/d25/d51/fb0 x:0 0 0 2024-04-25T15:57:39.806 INFO:tasks.workunit.client.1.smithi155.stdout:6/552: stat d0/d13 0 2024-04-25T15:57:39.815 INFO:tasks.workunit.client.1.smithi155.stdout:6/553: creat d0/d13/d7c/d99/fb1 x:0 0 0 2024-04-25T15:57:39.819 INFO:tasks.workunit.client.1.smithi155.stdout:6/554: truncate d0/d13/d43/d56/d7b/f85 459768 0 2024-04-25T15:57:39.822 INFO:tasks.workunit.client.1.smithi155.stdout:7/538: dwrite d2/dd/f23 [0,4194304] 0 2024-04-25T15:57:39.825 INFO:tasks.workunit.client.1.smithi155.stdout:6/555: creat d0/d13/d7c/da9/fb2 x:0 0 0 2024-04-25T15:57:39.827 INFO:tasks.workunit.client.1.smithi155.stdout:7/539: mkdir d2/dd/d13/d24/d35/db4 0 2024-04-25T15:57:39.828 INFO:tasks.workunit.client.1.smithi155.stdout:6/556: write d0/d1a/d25/d51/fb0 [578281,91519] 0 2024-04-25T15:57:39.831 INFO:tasks.workunit.client.1.smithi155.stdout:6/557: chown d0/d1a/l4a 32795117 1 2024-04-25T15:57:39.832 INFO:tasks.workunit.client.1.smithi155.stdout:5/451: sync 2024-04-25T15:57:39.832 INFO:tasks.workunit.client.1.smithi155.stdout:9/407: sync 2024-04-25T15:57:39.834 INFO:tasks.workunit.client.1.smithi155.stdout:6/558: chown d0/d1a/d87/fa3 58757217 1 2024-04-25T15:57:39.836 INFO:tasks.workunit.client.1.smithi155.stdout:6/559: truncate d0/d13/d43/f42 4927368 0 2024-04-25T15:57:39.845 INFO:tasks.workunit.client.1.smithi155.stdout:5/452: rename d0/d58/f19 to d0/d58/f90 0 2024-04-25T15:57:39.853 INFO:tasks.workunit.client.1.smithi155.stdout:9/408: write dc/d17/f20 [1533211,116599] 0 2024-04-25T15:57:39.853 INFO:tasks.workunit.client.1.smithi155.stdout:5/453: rmdir d0/d3/d15/d1f/d50 39 2024-04-25T15:57:39.858 INFO:tasks.workunit.client.1.smithi155.stdout:6/560: getdents d0/d1a/d37 0 2024-04-25T15:57:39.859 INFO:tasks.workunit.client.1.smithi155.stdout:5/454: rmdir d0/d58/d32/d6a/d78 39 2024-04-25T15:57:39.860 INFO:tasks.workunit.client.1.smithi155.stdout:7/540: dwrite d2/d26/d3d/d6d/f9c [0,4194304] 0 2024-04-25T15:57:39.866 INFO:tasks.workunit.client.1.smithi155.stdout:1/502: sync 2024-04-25T15:57:39.867 INFO:tasks.workunit.client.1.smithi155.stdout:3/558: sync 2024-04-25T15:57:39.867 INFO:tasks.workunit.client.1.smithi155.stdout:0/432: sync 2024-04-25T15:57:39.867 INFO:tasks.workunit.client.1.smithi155.stdout:4/509: sync 2024-04-25T15:57:39.867 INFO:tasks.workunit.client.1.smithi155.stdout:2/536: sync 2024-04-25T15:57:39.867 INFO:tasks.workunit.client.1.smithi155.stdout:8/330: sync 2024-04-25T15:57:39.870 INFO:tasks.workunit.client.1.smithi155.stdout:6/561: creat d0/d1a/da1/dac/fb3 x:0 0 0 2024-04-25T15:57:39.870 INFO:tasks.workunit.client.1.smithi155.stdout:4/510: write da/dc/d77/f96 [390342,12073] 0 2024-04-25T15:57:39.872 INFO:tasks.workunit.client.1.smithi155.stdout:9/409: write dc/d13/f26 [809461,123229] 0 2024-04-25T15:57:39.872 INFO:tasks.workunit.client.1.smithi155.stdout:7/541: dread d2/dd/d66/fb0 [0,4194304] 0 2024-04-25T15:57:39.873 INFO:tasks.workunit.client.1.smithi155.stdout:6/562: write d0/d1a/d25/f2d [8701724,8084] 0 2024-04-25T15:57:39.874 INFO:tasks.workunit.client.1.smithi155.stdout:1/503: mkdir d1/d16/d1d/d33/da1 0 2024-04-25T15:57:39.875 INFO:tasks.workunit.client.1.smithi155.stdout:5/455: dread d0/f2 [0,4194304] 0 2024-04-25T15:57:39.876 INFO:tasks.workunit.client.1.smithi155.stdout:6/563: truncate d0/d13/d43/d56/d7b/f96 4537525 0 2024-04-25T15:57:39.877 INFO:tasks.workunit.client.1.smithi155.stdout:0/433: symlink d1/d3/d5/da/l97 0 2024-04-25T15:57:39.878 INFO:tasks.workunit.client.1.smithi155.stdout:0/434: truncate d1/d6/d29/f96 281281 0 2024-04-25T15:57:39.880 INFO:tasks.workunit.client.1.smithi155.stdout:3/559: creat d1/d4/d10/d2a/d6c/fbc x:0 0 0 2024-04-25T15:57:39.881 INFO:tasks.workunit.client.1.smithi155.stdout:3/560: write d1/d4/db/d20/f4c [3245550,78567] 0 2024-04-25T15:57:39.882 INFO:tasks.workunit.client.1.smithi155.stdout:3/561: truncate d1/d4/d10/d21/d73/d77/fbb 445491 0 2024-04-25T15:57:39.886 INFO:tasks.workunit.client.1.smithi155.stdout:4/511: fdatasync da/d23/f3d 0 2024-04-25T15:57:39.886 INFO:tasks.workunit.client.1.smithi155.stdout:8/331: mkdir d2/d15/d63 0 2024-04-25T15:57:39.887 INFO:tasks.workunit.client.1.smithi155.stdout:8/332: truncate d2/d15/d35/f4d 815404 0 2024-04-25T15:57:39.888 INFO:tasks.workunit.client.1.smithi155.stdout:9/410: creat dc/d17/d2a/f8f x:0 0 0 2024-04-25T15:57:39.888 INFO:tasks.workunit.client.1.smithi155.stdout:9/411: stat dc/d13/f26 0 2024-04-25T15:57:39.889 INFO:tasks.workunit.client.1.smithi155.stdout:9/412: read - dc/d11/d67/f83 zero size 2024-04-25T15:57:39.892 INFO:tasks.workunit.client.1.smithi155.stdout:1/504: unlink d1/d16/f39 0 2024-04-25T15:57:39.893 INFO:tasks.workunit.client.1.smithi155.stdout:5/456: symlink d0/d27/l91 0 2024-04-25T15:57:39.900 INFO:tasks.workunit.client.1.smithi155.stdout:1/505: dwrite d1/d16/d1d/d29/d5f/d34/f51 [4194304,4194304] 0 2024-04-25T15:57:39.900 INFO:tasks.workunit.client.1.smithi155.stdout:4/512: write da/dc/f47 [4883145,80906] 0 2024-04-25T15:57:39.902 INFO:tasks.workunit.client.1.smithi155.stdout:1/506: chown d1/d16/f2c 815 1 2024-04-25T15:57:39.902 INFO:tasks.workunit.client.1.smithi155.stdout:1/507: readlink d1/d16/l71 0 2024-04-25T15:57:39.904 INFO:tasks.workunit.client.1.smithi155.stdout:8/333: mknod d2/d15/d35/c64 0 2024-04-25T15:57:39.905 INFO:tasks.workunit.client.1.smithi155.stdout:8/334: write d2/d15/d18/d23/d2d/f31 [1362610,25242] 0 2024-04-25T15:57:39.905 INFO:tasks.workunit.client.1.smithi155.stdout:7/542: mknod d2/d26/d3d/d6d/db3/cb5 0 2024-04-25T15:57:39.907 INFO:tasks.workunit.client.1.smithi155.stdout:8/335: dread - d2/d15/d18/d23/d3c/f61 zero size 2024-04-25T15:57:39.908 INFO:tasks.workunit.client.1.smithi155.stdout:8/336: fdatasync d2/f60 0 2024-04-25T15:57:39.908 INFO:tasks.workunit.client.1.smithi155.stdout:9/413: rename dc/d17/c6c to dc/d13/d48/c90 0 2024-04-25T15:57:39.910 INFO:tasks.workunit.client.1.smithi155.stdout:2/537: truncate d7/db/dd/d15/f33 999064 0 2024-04-25T15:57:39.911 INFO:tasks.workunit.client.1.smithi155.stdout:2/538: dread - d7/db/d2e/f8a zero size 2024-04-25T15:57:39.912 INFO:tasks.workunit.client.1.smithi155.stdout:5/457: symlink d0/d3/d2c/l92 0 2024-04-25T15:57:39.913 INFO:tasks.workunit.client.1.smithi155.stdout:5/458: chown d0/d58 145345 1 2024-04-25T15:57:39.914 INFO:tasks.workunit.client.1.smithi155.stdout:0/435: dwrite d1/d1a/f5f [0,4194304] 0 2024-04-25T15:57:39.919 INFO:tasks.workunit.client.1.smithi155.stdout:8/337: dwrite d2/f33 [0,4194304] 0 2024-04-25T15:57:39.922 INFO:tasks.workunit.client.1.smithi155.stdout:4/513: creat da/d23/d3f/d56/d69/d83/fbd x:0 0 0 2024-04-25T15:57:39.923 INFO:tasks.workunit.client.1.smithi155.stdout:6/564: truncate d0/d1a/d25/d2e/f67 427960 0 2024-04-25T15:57:39.924 INFO:tasks.workunit.client.1.smithi155.stdout:6/565: dread - d0/d18/d54/fa8 zero size 2024-04-25T15:57:39.924 INFO:tasks.workunit.client.1.smithi155.stdout:4/514: truncate da/d23/d3f/f71 4592105 0 2024-04-25T15:57:39.924 INFO:tasks.workunit.client.1.smithi155.stdout:1/508: rmdir d1/d16/d1d/d5e/d8e 39 2024-04-25T15:57:39.925 INFO:tasks.workunit.client.1.smithi155.stdout:4/515: write da/d30/f61 [4547849,78667] 0 2024-04-25T15:57:39.927 INFO:tasks.workunit.client.1.smithi155.stdout:7/543: chown d2/dd/d30/d44/d7f/ca1 2619 1 2024-04-25T15:57:39.930 INFO:tasks.workunit.client.1.smithi155.stdout:3/562: truncate d1/d4/d10/d21/d73/d77/fbb 200387 0 2024-04-25T15:57:39.931 INFO:tasks.workunit.client.1.smithi155.stdout:2/539: creat d7/db/d2e/d6f/fa7 x:0 0 0 2024-04-25T15:57:39.932 INFO:tasks.workunit.client.1.smithi155.stdout:2/540: chown d7/db/dd/f11 642670 1 2024-04-25T15:57:39.933 INFO:tasks.workunit.client.1.smithi155.stdout:5/459: mknod d0/d47/c93 0 2024-04-25T15:57:39.933 INFO:tasks.workunit.client.1.smithi155.stdout:5/460: chown d0/d47/d59/l86 21375537 1 2024-04-25T15:57:39.935 INFO:tasks.workunit.client.1.smithi155.stdout:5/461: fdatasync d0/f40 0 2024-04-25T15:57:39.935 INFO:tasks.workunit.client.1.smithi155.stdout:0/436: mkdir d1/d85/d98 0 2024-04-25T15:57:39.936 INFO:tasks.workunit.client.1.smithi155.stdout:5/462: dread - d0/d58/d32/d6a/f8a zero size 2024-04-25T15:57:39.937 INFO:tasks.workunit.client.1.smithi155.stdout:8/338: dread d2/d5/f21 [0,4194304] 0 2024-04-25T15:57:39.938 INFO:tasks.workunit.client.1.smithi155.stdout:8/339: write d2/d15/d18/d34/f53 [795461,83150] 0 2024-04-25T15:57:39.944 INFO:tasks.workunit.client.1.smithi155.stdout:9/414: link dc/d11/d5a/f78 dc/d17/d18/f91 0 2024-04-25T15:57:39.949 INFO:tasks.workunit.client.1.smithi155.stdout:6/566: mkdir d0/d1a/d25/db4 0 2024-04-25T15:57:39.950 INFO:tasks.workunit.client.1.smithi155.stdout:1/509: symlink d1/d16/d1d/d29/d5f/d34/la2 0 2024-04-25T15:57:39.952 INFO:tasks.workunit.client.1.smithi155.stdout:8/340: creat d2/d5/d40/f65 x:0 0 0 2024-04-25T15:57:39.954 INFO:tasks.workunit.client.1.smithi155.stdout:7/544: fsync d2/dd/fa6 0 2024-04-25T15:57:39.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/541: creat d7/db/d29/d83/d86/d8b/fa8 x:0 0 0 2024-04-25T15:57:39.959 INFO:tasks.workunit.client.1.smithi155.stdout:6/567: dwrite d0/d1a/d25/d51/fb0 [0,4194304] 0 2024-04-25T15:57:39.959 INFO:tasks.workunit.client.1.smithi155.stdout:9/415: dread dc/d11/f42 [0,4194304] 0 2024-04-25T15:57:39.960 INFO:tasks.workunit.client.1.smithi155.stdout:6/568: dread - d0/d13/d7c/da9/fb2 zero size 2024-04-25T15:57:39.961 INFO:tasks.workunit.client.1.smithi155.stdout:5/463: truncate d0/f37 5648963 0 2024-04-25T15:57:39.963 INFO:tasks.workunit.client.1.smithi155.stdout:9/416: read dc/d13/d2e/d4c/f61 [4675266,15785] 0 2024-04-25T15:57:39.964 INFO:tasks.workunit.client.1.smithi155.stdout:8/341: rmdir d2/d15/d18/d23/d3c 39 2024-04-25T15:57:39.967 INFO:tasks.workunit.client.1.smithi155.stdout:7/545: mkdir d2/dd/d12/d76/db6 0 2024-04-25T15:57:39.972 INFO:tasks.workunit.client.1.smithi155.stdout:1/510: symlink d1/d16/d1d/d29/d5f/la3 0 2024-04-25T15:57:39.972 INFO:tasks.workunit.client.1.smithi155.stdout:1/511: fdatasync d1/d6/f6b 0 2024-04-25T15:57:39.972 INFO:tasks.workunit.client.1.smithi155.stdout:4/516: getdents da/d23/d3f/d56/d69 0 2024-04-25T15:57:39.974 INFO:tasks.workunit.client.1.smithi155.stdout:4/517: readlink da/d23/d3a/d7b/d93/l99 0 2024-04-25T15:57:39.976 INFO:tasks.workunit.client.1.smithi155.stdout:2/542: link d7/db/d2e/d44/f6d d7/db/d29/d83/d86/fa9 0 2024-04-25T15:57:39.977 INFO:tasks.workunit.client.1.smithi155.stdout:6/569: dread d0/d1a/d21/f32 [0,4194304] 0 2024-04-25T15:57:39.979 INFO:tasks.workunit.client.1.smithi155.stdout:9/417: mknod dc/d11/c92 0 2024-04-25T15:57:39.981 INFO:tasks.workunit.client.1.smithi155.stdout:8/342: link d2/f14 d2/d15/d18/d34/d48/d59/f66 0 2024-04-25T15:57:39.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/512: dwrite d1/d16/d1d/d29/f9a [0,4194304] 0 2024-04-25T15:57:39.988 INFO:tasks.workunit.client.1.smithi155.stdout:6/570: dwrite d0/d1a/d25/d51/f84 [0,4194304] 0 2024-04-25T15:57:39.990 INFO:tasks.workunit.client.1.smithi155.stdout:8/343: creat d2/d5/f67 x:0 0 0 2024-04-25T15:57:39.991 INFO:tasks.workunit.client.1.smithi155.stdout:1/513: dwrite d1/d6/f7 [0,4194304] 0 2024-04-25T15:57:39.992 INFO:tasks.workunit.client.1.smithi155.stdout:2/543: symlink d7/d8e/laa 0 2024-04-25T15:57:39.993 INFO:tasks.workunit.client.1.smithi155.stdout:2/544: fdatasync d7/db/dd/f48 0 2024-04-25T15:57:39.997 INFO:tasks.workunit.client.1.smithi155.stdout:7/546: truncate d2/dd/f23 810451 0 2024-04-25T15:57:40.001 INFO:tasks.workunit.client.1.smithi155.stdout:6/571: symlink d0/d1a/d37/lb5 0 2024-04-25T15:57:40.003 INFO:tasks.workunit.client.1.smithi155.stdout:5/464: getdents d0/d58/d32/d6a/d78 0 2024-04-25T15:57:40.005 INFO:tasks.workunit.client.1.smithi155.stdout:5/465: write d0/d58/d32/f79 [603415,14202] 0 2024-04-25T15:57:40.005 INFO:tasks.workunit.client.1.smithi155.stdout:2/545: creat d7/db/dd/fab x:0 0 0 2024-04-25T15:57:40.006 INFO:tasks.workunit.client.1.smithi155.stdout:5/466: fdatasync d0/d3/d2c/f3a 0 2024-04-25T15:57:40.008 INFO:tasks.workunit.client.1.smithi155.stdout:9/418: link dc/d13/c6b dc/d17/d18/d72/c93 0 2024-04-25T15:57:40.008 INFO:tasks.workunit.client.1.smithi155.stdout:5/467: chown d0/d3/d15/d30/d4f/f62 113 1 2024-04-25T15:57:40.008 INFO:tasks.workunit.client.1.smithi155.stdout:4/518: getdents da/dc/d18/d97 0 2024-04-25T15:57:40.009 INFO:tasks.workunit.client.1.smithi155.stdout:9/419: write dc/d11/d67/f83 [488015,126964] 0 2024-04-25T15:57:40.009 INFO:tasks.workunit.client.1.smithi155.stdout:5/468: write d0/d3/d15/f88 [102119,17571] 0 2024-04-25T15:57:40.010 INFO:tasks.workunit.client.1.smithi155.stdout:6/572: mknod d0/d1a/d25/d51/cb6 0 2024-04-25T15:57:40.011 INFO:tasks.workunit.client.1.smithi155.stdout:1/514: mkdir d1/d16/d1d/d29/d5f/d34/d68/d93/da4 0 2024-04-25T15:57:40.014 INFO:tasks.workunit.client.1.smithi155.stdout:1/515: write d1/d16/d1d/d5e/f7b [381463,33929] 0 2024-04-25T15:57:40.014 INFO:tasks.workunit.client.1.smithi155.stdout:1/516: stat d1/d16/d1d/d5e/f7b 0 2024-04-25T15:57:40.015 INFO:tasks.workunit.client.1.smithi155.stdout:2/546: mknod d7/db/d2e/d44/d70/cac 0 2024-04-25T15:57:40.016 INFO:tasks.workunit.client.1.smithi155.stdout:1/517: write d1/d32/d86/f87 [1450700,88820] 0 2024-04-25T15:57:40.018 INFO:tasks.workunit.client.1.smithi155.stdout:5/469: mkdir d0/d3/d2c/d94 0 2024-04-25T15:57:40.018 INFO:tasks.workunit.client.1.smithi155.stdout:7/547: write d2/dd/d36/f62 [1427727,37615] 0 2024-04-25T15:57:40.019 INFO:tasks.workunit.client.1.smithi155.stdout:6/573: mknod d0/d18/cb7 0 2024-04-25T15:57:40.020 INFO:tasks.workunit.client.1.smithi155.stdout:8/344: dread d2/d15/d35/d3d/f46 [0,4194304] 0 2024-04-25T15:57:40.021 INFO:tasks.workunit.client.1.smithi155.stdout:9/420: creat dc/d13/d60/d7a/f94 x:0 0 0 2024-04-25T15:57:40.022 INFO:tasks.workunit.client.1.smithi155.stdout:7/548: fsync d2/d26/d3d/d6d/f95 0 2024-04-25T15:57:40.022 INFO:tasks.workunit.client.1.smithi155.stdout:6/574: chown d0/d1a/d87 3 1 2024-04-25T15:57:40.023 INFO:tasks.workunit.client.1.smithi155.stdout:3/563: sync 2024-04-25T15:57:40.024 INFO:tasks.workunit.client.1.smithi155.stdout:0/437: sync 2024-04-25T15:57:40.024 INFO:tasks.workunit.client.1.smithi155.stdout:2/547: unlink d7/db/d2e/c39 0 2024-04-25T15:57:40.026 INFO:tasks.workunit.client.1.smithi155.stdout:9/421: write dc/d11/d5a/f65 [542111,82723] 0 2024-04-25T15:57:40.027 INFO:tasks.workunit.client.1.smithi155.stdout:8/345: truncate d2/d5/f67 587973 0 2024-04-25T15:57:40.028 INFO:tasks.workunit.client.1.smithi155.stdout:7/549: symlink d2/d26/d47/lb7 0 2024-04-25T15:57:40.030 INFO:tasks.workunit.client.1.smithi155.stdout:0/438: mknod d1/d6/d29/c99 0 2024-04-25T15:57:40.032 INFO:tasks.workunit.client.1.smithi155.stdout:2/548: mkdir d7/db/d2e/d6f/d91/dad 0 2024-04-25T15:57:40.032 INFO:tasks.workunit.client.1.smithi155.stdout:4/519: dwrite da/d23/f6c [0,4194304] 0 2024-04-25T15:57:40.032 INFO:tasks.workunit.client.1.smithi155.stdout:7/550: read d2/dd/d66/fb0 [625873,32925] 0 2024-04-25T15:57:40.034 INFO:tasks.workunit.client.1.smithi155.stdout:0/439: write d1/d3/d5/d5b/f61 [592453,44859] 0 2024-04-25T15:57:40.035 INFO:tasks.workunit.client.1.smithi155.stdout:7/551: chown d2/dd/d13/d1c/f22 2 1 2024-04-25T15:57:40.037 INFO:tasks.workunit.client.1.smithi155.stdout:1/518: dread d1/d6/f31 [0,4194304] 0 2024-04-25T15:57:40.040 INFO:tasks.workunit.client.1.smithi155.stdout:3/564: rename d1/d4/db/d28/f5b to d1/d4/d6a/d86/d9e/fbd 0 2024-04-25T15:57:40.040 INFO:tasks.workunit.client.1.smithi155.stdout:4/520: rmdir da/d23/d3a/d7b/d93 39 2024-04-25T15:57:40.042 INFO:tasks.workunit.client.1.smithi155.stdout:2/549: creat d7/db/d2e/d44/d70/fae x:0 0 0 2024-04-25T15:57:40.042 INFO:tasks.workunit.client.1.smithi155.stdout:5/470: dread d0/d3/f5a [0,4194304] 0 2024-04-25T15:57:40.043 INFO:tasks.workunit.client.1.smithi155.stdout:0/440: write d1/d6/f14 [3998494,13621] 0 2024-04-25T15:57:40.044 INFO:tasks.workunit.client.1.smithi155.stdout:8/346: symlink d2/d15/d18/d34/d48/d59/l68 0 2024-04-25T15:57:40.045 INFO:tasks.workunit.client.1.smithi155.stdout:7/552: symlink d2/dd/d13/d24/d8b/lb8 0 2024-04-25T15:57:40.046 INFO:tasks.workunit.client.1.smithi155.stdout:8/347: write d2/d15/d18/d34/d48/f50 [736492,91249] 0 2024-04-25T15:57:40.048 INFO:tasks.workunit.client.1.smithi155.stdout:0/441: dread d1/d3/d12/f84 [0,4194304] 0 2024-04-25T15:57:40.050 INFO:tasks.workunit.client.1.smithi155.stdout:3/565: symlink d1/d4/d10/d21/d73/d77/lbe 0 2024-04-25T15:57:40.050 INFO:tasks.workunit.client.1.smithi155.stdout:5/471: rmdir d0/d3 39 2024-04-25T15:57:40.051 INFO:tasks.workunit.client.1.smithi155.stdout:0/442: chown d1/d6/d29/f66 15566723 1 2024-04-25T15:57:40.057 INFO:tasks.workunit.client.1.smithi155.stdout:8/348: dwrite d2/d15/d35/d3d/f42 [0,4194304] 0 2024-04-25T15:57:40.058 INFO:tasks.workunit.client.1.smithi155.stdout:7/553: dwrite d2/dd/d13/d1c/f22 [4194304,4194304] 0 2024-04-25T15:57:40.058 INFO:tasks.workunit.client.1.smithi155.stdout:3/566: mknod d1/d4/d10/cbf 0 2024-04-25T15:57:40.060 INFO:tasks.workunit.client.1.smithi155.stdout:0/443: unlink d1/d3/fd 0 2024-04-25T15:57:40.061 INFO:tasks.workunit.client.1.smithi155.stdout:5/472: dread d0/d3/d15/f88 [0,4194304] 0 2024-04-25T15:57:40.062 INFO:tasks.workunit.client.1.smithi155.stdout:4/521: write da/f16 [3768223,34327] 0 2024-04-25T15:57:40.062 INFO:tasks.workunit.client.1.smithi155.stdout:1/519: write d1/f61 [824145,16434] 0 2024-04-25T15:57:40.066 INFO:tasks.workunit.client.1.smithi155.stdout:2/550: dwrite d7/db/d29/f3a [0,4194304] 0 2024-04-25T15:57:40.067 INFO:tasks.workunit.client.1.smithi155.stdout:4/522: dread - da/d23/d3f/d56/f76 zero size 2024-04-25T15:57:40.068 INFO:tasks.workunit.client.1.smithi155.stdout:3/567: readlink d1/d4/db/d20/d44/d52/d61/l9a 0 2024-04-25T15:57:40.069 INFO:tasks.workunit.client.1.smithi155.stdout:7/554: dread d2/dd/d13/d1c/f31 [0,4194304] 0 2024-04-25T15:57:40.069 INFO:tasks.workunit.client.1.smithi155.stdout:2/551: dread - d7/d23/f35 zero size 2024-04-25T15:57:40.072 INFO:tasks.workunit.client.1.smithi155.stdout:5/473: rename d0/d3/c9 to d0/d27/c95 0 2024-04-25T15:57:40.074 INFO:tasks.workunit.client.1.smithi155.stdout:0/444: dread d1/d3/d5/d5b/f61 [0,4194304] 0 2024-04-25T15:57:40.074 INFO:tasks.workunit.client.1.smithi155.stdout:8/349: dwrite d2/d5/f21 [0,4194304] 0 2024-04-25T15:57:40.075 INFO:tasks.workunit.client.1.smithi155.stdout:5/474: chown d0/d3/d15/d30/d4f/f62 806420975 1 2024-04-25T15:57:40.076 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:40.076 INFO:tasks.workunit.client.1.smithi155.stdout:8/350: write d2/d15/d35/f44 [3627104,80252] 0 2024-04-25T15:57:40.077 INFO:tasks.workunit.client.1.smithi155.stdout:2/552: unlink d7/f3b 0 2024-04-25T15:57:40.077 INFO:tasks.workunit.client.1.smithi155.stdout:3/568: creat d1/d4/d10/d2a/d6c/fc0 x:0 0 0 2024-04-25T15:57:40.079 INFO:tasks.workunit.client.1.smithi155.stdout:7/555: rmdir d2/dd/d13 39 2024-04-25T15:57:40.080 INFO:tasks.workunit.client.1.smithi155.stdout:1/520: rename d1/d16/d37/l3b to d1/d32/d86/la5 0 2024-04-25T15:57:40.082 INFO:tasks.workunit.client.1.smithi155.stdout:7/556: truncate d2/dd/d12/d76/f85 762751 0 2024-04-25T15:57:40.084 INFO:tasks.workunit.client.1.smithi155.stdout:3/569: mknod d1/d4/db/d20/d44/d52/d61/cc1 0 2024-04-25T15:57:40.084 INFO:tasks.workunit.client.1.smithi155.stdout:3/570: fsync d1/d4/db/d20/f46 0 2024-04-25T15:57:40.085 INFO:tasks.workunit.client.1.smithi155.stdout:2/553: rename d7/db/f6c to d7/db/d2e/d6f/d91/faf 0 2024-04-25T15:57:40.092 INFO:tasks.workunit.client.1.smithi155.stdout:5/475: symlink d0/d58/d32/d6a/l96 0 2024-04-25T15:57:40.093 INFO:tasks.workunit.client.1.smithi155.stdout:3/571: symlink d1/d4/db/d20/d44/lc2 0 2024-04-25T15:57:40.093 INFO:tasks.workunit.client.1.smithi155.stdout:2/554: mkdir d7/db/d29/d83/d86/db0 0 2024-04-25T15:57:40.094 INFO:tasks.workunit.client.1.smithi155.stdout:1/521: unlink d1/d16/d1d/d29/d5f/l22 0 2024-04-25T15:57:40.095 INFO:tasks.workunit.client.1.smithi155.stdout:2/555: chown d7/db/d29/d83/d86/d8b 781658708 1 2024-04-25T15:57:40.095 INFO:tasks.workunit.client.1.smithi155.stdout:5/476: write d0/d3/d15/f16 [2847902,34088] 0 2024-04-25T15:57:40.096 INFO:tasks.workunit.client.1.smithi155.stdout:8/351: creat d2/d15/f69 x:0 0 0 2024-04-25T15:57:40.097 INFO:tasks.workunit.client.1.smithi155.stdout:1/522: write d1/d16/d1d/d29/d5f/f5d [1057776,65972] 0 2024-04-25T15:57:40.098 INFO:tasks.workunit.client.1.smithi155.stdout:7/557: dread d2/d26/f58 [0,4194304] 0 2024-04-25T15:57:40.101 INFO:tasks.workunit.client.1.smithi155.stdout:6/575: sync 2024-04-25T15:57:40.102 INFO:tasks.workunit.client.1.smithi155.stdout:6/576: chown d0/d13/d34/d38/c81 3322125 1 2024-04-25T15:57:40.104 INFO:tasks.workunit.client.1.smithi155.stdout:3/572: unlink d1/d4/d10/d21/l81 0 2024-04-25T15:57:40.105 INFO:tasks.workunit.client.1.smithi155.stdout:8/352: dwrite d2/d15/d18/d23/d2d/f31 [4194304,4194304] 0 2024-04-25T15:57:40.105 INFO:tasks.workunit.client.1.smithi155.stdout:4/523: truncate da/dc/f47 1735692 0 2024-04-25T15:57:40.109 INFO:tasks.workunit.client.1.smithi155.stdout:0/445: truncate d1/d6/d29/d47/f55 3685245 0 2024-04-25T15:57:40.113 INFO:tasks.workunit.client.1.smithi155.stdout:3/573: mknod d1/d4/db/d91/cc3 0 2024-04-25T15:57:40.114 INFO:tasks.workunit.client.1.smithi155.stdout:3/574: write d1/d4/d6a/d86/f9b [1322876,83869] 0 2024-04-25T15:57:40.120 INFO:tasks.workunit.client.1.smithi155.stdout:6/577: mkdir d0/d13/d34/d6c/d9d/db8 0 2024-04-25T15:57:40.124 INFO:tasks.workunit.client.1.smithi155.stdout:3/575: rename d1/d4/d10/d2a to d1/d4/db/d91/dc4 0 2024-04-25T15:57:40.126 INFO:tasks.workunit.client.1.smithi155.stdout:1/523: creat d1/d16/d1d/d29/d5f/fa6 x:0 0 0 2024-04-25T15:57:40.127 INFO:tasks.workunit.client.1.smithi155.stdout:1/524: dread - d1/d16/d1d/d29/d5f/fa6 zero size 2024-04-25T15:57:40.128 INFO:tasks.workunit.client.1.smithi155.stdout:8/353: creat d2/f6a x:0 0 0 2024-04-25T15:57:40.129 INFO:tasks.workunit.client.1.smithi155.stdout:6/578: creat d0/d13/d7c/d99/fb9 x:0 0 0 2024-04-25T15:57:40.132 INFO:tasks.workunit.client.1.smithi155.stdout:4/524: getdents da/dc/d77 0 2024-04-25T15:57:40.132 INFO:tasks.workunit.client.1.smithi155.stdout:5/477: truncate d0/d3/d15/f72 3013154 0 2024-04-25T15:57:40.133 INFO:tasks.workunit.client.1.smithi155.stdout:9/422: sync 2024-04-25T15:57:40.133 INFO:tasks.workunit.client.1.smithi155.stdout:1/525: mknod d1/d16/d1d/d33/ca7 0 2024-04-25T15:57:40.133 INFO:tasks.workunit.client.1.smithi155.stdout:6/579: read - d0/d13/d7c/d99/fb1 zero size 2024-04-25T15:57:40.135 INFO:tasks.workunit.client.1.smithi155.stdout:0/446: getdents d1/d1a 0 2024-04-25T15:57:40.137 INFO:tasks.workunit.client.1.smithi155.stdout:8/354: creat d2/d15/d35/d3d/f6b x:0 0 0 2024-04-25T15:57:40.139 INFO:tasks.workunit.client.1.smithi155.stdout:3/576: dwrite d1/d4/db/d91/f97 [0,4194304] 0 2024-04-25T15:57:40.139 INFO:tasks.workunit.client.1.smithi155.stdout:2/556: rename d7/db/d2e/d44/c56 to d7/db/dd/d15/cb1 0 2024-04-25T15:57:40.140 INFO:tasks.workunit.client.1.smithi155.stdout:1/526: creat d1/d32/d86/fa8 x:0 0 0 2024-04-25T15:57:40.141 INFO:tasks.workunit.client.1.smithi155.stdout:7/558: dwrite d2/dd/d12/f5e [0,4194304] 0 2024-04-25T15:57:40.141 INFO:tasks.workunit.client.1.smithi155.stdout:4/525: symlink da/d23/d3f/d56/d69/d83/lbe 0 2024-04-25T15:57:40.144 INFO:tasks.workunit.client.1.smithi155.stdout:6/580: chown d0/d1a/d25/d2e/c89 2125 1 2024-04-25T15:57:40.145 INFO:tasks.workunit.client.1.smithi155.stdout:0/447: symlink d1/d1a/l9a 0 2024-04-25T15:57:40.147 INFO:tasks.workunit.client.1.smithi155.stdout:0/448: dread - d1/d6/d16/d60/f95 zero size 2024-04-25T15:57:40.148 INFO:tasks.workunit.client.1.smithi155.stdout:8/355: dread d2/f14 [0,4194304] 0 2024-04-25T15:57:40.155 INFO:tasks.workunit.client.1.smithi155.stdout:6/581: write d0/d13/f17 [4970,47700] 0 2024-04-25T15:57:40.155 INFO:tasks.workunit.client.1.smithi155.stdout:3/577: symlink d1/d4/db/d91/dc4/d6c/lc5 0 2024-04-25T15:57:40.157 INFO:tasks.workunit.client.1.smithi155.stdout:3/578: fsync d1/d4/db/d20/f3b 0 2024-04-25T15:57:40.157 INFO:tasks.workunit.client.1.smithi155.stdout:9/423: creat dc/f95 x:0 0 0 2024-04-25T15:57:40.159 INFO:tasks.workunit.client.1.smithi155.stdout:9/424: write dc/d11/d5a/f8c [102414,79136] 0 2024-04-25T15:57:40.159 INFO:tasks.workunit.client.1.smithi155.stdout:0/449: write d1/d3/d12/f3b [2231883,103718] 0 2024-04-25T15:57:40.160 INFO:tasks.workunit.client.1.smithi155.stdout:8/356: mkdir d2/d15/d35/d3d/d6c 0 2024-04-25T15:57:40.161 INFO:tasks.workunit.client.1.smithi155.stdout:9/425: stat dc/d13/d2e/d4c/c7c 0 2024-04-25T15:57:40.161 INFO:tasks.workunit.client.1.smithi155.stdout:2/557: truncate d7/db/f4a 1726983 0 2024-04-25T15:57:40.162 INFO:tasks.workunit.client.1.smithi155.stdout:7/559: mkdir d2/dd/d66/db2/db9 0 2024-04-25T15:57:40.163 INFO:tasks.workunit.client.1.smithi155.stdout:1/527: rename d1/d16/d1d/d33/f64 to d1/d16/d1d/d29/d5f/d34/d68/d93/fa9 0 2024-04-25T15:57:40.164 INFO:tasks.workunit.client.1.smithi155.stdout:4/526: dread da/d23/d3f/f79 [0,4194304] 0 2024-04-25T15:57:40.166 INFO:tasks.workunit.client.1.smithi155.stdout:2/558: dread - d7/db/d2e/d44/d70/fa3 zero size 2024-04-25T15:57:40.166 INFO:tasks.workunit.client.1.smithi155.stdout:3/579: fsync d1/d4/f41 0 2024-04-25T15:57:40.167 INFO:tasks.workunit.client.1.smithi155.stdout:0/450: mkdir d1/d3/d6a/d9b 0 2024-04-25T15:57:40.168 INFO:tasks.workunit.client.1.smithi155.stdout:7/560: symlink d2/dd/d36/d46/lba 0 2024-04-25T15:57:40.170 INFO:tasks.workunit.client.1.smithi155.stdout:1/528: write d1/d6/f14 [8745533,6551] 0 2024-04-25T15:57:40.174 INFO:tasks.workunit.client.1.smithi155.stdout:5/478: dwrite d0/d3/d15/d30/d4f/f6b [4194304,4194304] 0 2024-04-25T15:57:40.174 INFO:tasks.workunit.client.1.smithi155.stdout:9/426: dread dc/d17/f20 [0,4194304] 0 2024-04-25T15:57:40.174 INFO:tasks.workunit.client.1.smithi155.stdout:0/451: symlink d1/d3/d3d/l9c 0 2024-04-25T15:57:40.176 INFO:tasks.workunit.client.1.smithi155.stdout:4/527: rename da/d23/d3a/d7b/d93/l99 to da/d23/lbf 0 2024-04-25T15:57:40.178 INFO:tasks.workunit.client.1.smithi155.stdout:7/561: creat d2/dd/d30/d44/fbb x:0 0 0 2024-04-25T15:57:40.179 INFO:tasks.workunit.client.1.smithi155.stdout:8/357: dwrite d2/f6a [0,4194304] 0 2024-04-25T15:57:40.180 INFO:tasks.workunit.client.1.smithi155.stdout:0/452: write d1/d6/d16/d60/f6d [665774,89493] 0 2024-04-25T15:57:40.183 INFO:tasks.workunit.client.1.smithi155.stdout:7/562: write d2/dd/d12/d76/f85 [91667,30591] 0 2024-04-25T15:57:40.183 INFO:tasks.workunit.client.1.smithi155.stdout:6/582: truncate d0/d1a/d37/f4d 3568936 0 2024-04-25T15:57:40.183 INFO:tasks.workunit.client.1.smithi155.stdout:3/580: rename d1/d4/d10/d21/f22 to d1/d4/db/d91/dc4/d6c/fc6 0 2024-04-25T15:57:40.192 INFO:tasks.workunit.client.1.smithi155.stdout:8/358: fdatasync d2/d15/d18/d23/d3c/f47 0 2024-04-25T15:57:40.192 INFO:tasks.workunit.client.1.smithi155.stdout:9/427: dwrite dc/d13/d48/f88 [0,4194304] 0 2024-04-25T15:57:40.192 INFO:tasks.workunit.client.1.smithi155.stdout:7/563: dread d2/f11 [0,4194304] 0 2024-04-25T15:57:40.197 INFO:tasks.workunit.client.1.smithi155.stdout:1/529: link d1/c91 d1/da0/caa 0 2024-04-25T15:57:40.198 INFO:tasks.workunit.client.1.smithi155.stdout:9/428: truncate dc/d11/f42 8536233 0 2024-04-25T15:57:40.198 INFO:tasks.workunit.client.1.smithi155.stdout:3/581: dwrite d1/d4/db/d20/fa8 [0,4194304] 0 2024-04-25T15:57:40.199 INFO:tasks.workunit.client.1.smithi155.stdout:4/528: rmdir da/dc/d77/da5 0 2024-04-25T15:57:40.200 INFO:tasks.workunit.client.1.smithi155.stdout:0/453: mkdir d1/d3/d12/d92/d9d 0 2024-04-25T15:57:40.203 INFO:tasks.workunit.client.1.smithi155.stdout:7/564: read d2/dd/d63/f77 [330093,5547] 0 2024-04-25T15:57:40.205 INFO:tasks.workunit.client.1.smithi155.stdout:4/529: readlink da/d23/d3f/d56/d69/d83/lbe 0 2024-04-25T15:57:40.207 INFO:tasks.workunit.client.1.smithi155.stdout:3/582: dread - d1/d4/db/d20/fa3 zero size 2024-04-25T15:57:40.213 INFO:tasks.workunit.client.1.smithi155.stdout:9/429: dread dc/d17/f20 [0,4194304] 0 2024-04-25T15:57:40.213 INFO:tasks.workunit.client.1.smithi155.stdout:2/559: dwrite d7/db/d29/d83/d86/fa9 [0,4194304] 0 2024-04-25T15:57:40.216 INFO:tasks.workunit.client.1.smithi155.stdout:0/454: unlink d1/d6/d16/c58 0 2024-04-25T15:57:40.220 INFO:tasks.workunit.client.1.smithi155.stdout:5/479: dwrite d0/d3/d15/d1f/d50/d60/f65 [4194304,4194304] 0 2024-04-25T15:57:40.221 INFO:tasks.workunit.client.1.smithi155.stdout:8/359: dwrite d2/d15/d18/d23/d3c/f61 [0,4194304] 0 2024-04-25T15:57:40.222 INFO:tasks.workunit.client.1.smithi155.stdout:9/430: mknod dc/d11/d30/c96 0 2024-04-25T15:57:40.222 INFO:tasks.workunit.client.1.smithi155.stdout:9/431: symlink dc/d74/l97 2 2024-04-25T15:57:40.223 INFO:tasks.workunit.client.1.smithi155.stdout:1/530: dwrite d1/d16/d1d/f5c [0,4194304] 0 2024-04-25T15:57:40.224 INFO:tasks.workunit.client.1.smithi155.stdout:4/530: mkdir da/d23/d3f/d56/d69/d4a/d78/d62/dc0 0 2024-04-25T15:57:40.226 INFO:tasks.workunit.client.1.smithi155.stdout:4/531: dread - da/d23/d3f/d56/d69/d83/f91 zero size 2024-04-25T15:57:40.229 INFO:tasks.workunit.client.1.smithi155.stdout:9/432: symlink dc/d13/d48/l98 0 2024-04-25T15:57:40.231 INFO:tasks.workunit.client.1.smithi155.stdout:2/560: getdents d7/db/dd/d15/d60/d94 0 2024-04-25T15:57:40.233 INFO:tasks.workunit.client.1.smithi155.stdout:8/360: creat d2/d15/d35/f6d x:0 0 0 2024-04-25T15:57:40.236 INFO:tasks.workunit.client.1.smithi155.stdout:9/433: write dc/d11/d5a/f65 [141962,75067] 0 2024-04-25T15:57:40.242 INFO:tasks.workunit.client.1.smithi155.stdout:7/565: dwrite d2/dd/d13/d1c/f22 [0,4194304] 0 2024-04-25T15:57:40.243 INFO:tasks.workunit.client.1.smithi155.stdout:4/532: write da/d23/d3f/d56/d69/d4a/d78/f8d [2774783,73025] 0 2024-04-25T15:57:40.243 INFO:tasks.workunit.client.1.smithi155.stdout:1/531: symlink d1/d16/d1d/d29/d5f/d34/lab 0 2024-04-25T15:57:40.243 INFO:tasks.workunit.client.1.smithi155.stdout:0/455: dwrite d1/d6/f2f [0,4194304] 0 2024-04-25T15:57:40.244 INFO:tasks.workunit.client.1.smithi155.stdout:5/480: link d0/d3/d2c/f2f d0/d3/d15/d30/d4f/f97 0 2024-04-25T15:57:40.244 INFO:tasks.workunit.client.1.smithi155.stdout:9/434: fsync dc/d13/d48/f88 0 2024-04-25T15:57:40.246 INFO:tasks.workunit.client.1.smithi155.stdout:2/561: write d7/d23/f20 [6223438,126369] 0 2024-04-25T15:57:40.251 INFO:tasks.workunit.client.1.smithi155.stdout:3/583: dread d1/d4/db/d28/f31 [0,4194304] 0 2024-04-25T15:57:40.251 INFO:tasks.workunit.client.1.smithi155.stdout:5/481: write d0/f40 [1799339,3444] 0 2024-04-25T15:57:40.251 INFO:tasks.workunit.client.1.smithi155.stdout:4/533: truncate da/d30/f5c 687803 0 2024-04-25T15:57:40.254 INFO:tasks.workunit.client.1.smithi155.stdout:8/361: symlink d2/d15/d18/d34/d48/d59/l6e 0 2024-04-25T15:57:40.254 INFO:tasks.workunit.client.1.smithi155.stdout:8/362: stat d2/d41/c45 0 2024-04-25T15:57:40.254 INFO:tasks.workunit.client.1.smithi155.stdout:2/562: readlink d7/db/la1 0 2024-04-25T15:57:40.254 INFO:tasks.workunit.client.1.smithi155.stdout:4/534: fdatasync da/d23/fb0 0 2024-04-25T15:57:40.255 INFO:tasks.workunit.client.1.smithi155.stdout:1/532: mknod d1/d16/d1d/cac 0 2024-04-25T15:57:40.257 INFO:tasks.workunit.client.1.smithi155.stdout:0/456: mkdir d1/d85/d8c/d9e 0 2024-04-25T15:57:40.259 INFO:tasks.workunit.client.1.smithi155.stdout:5/482: dread d0/d58/d32/f79 [0,4194304] 0 2024-04-25T15:57:40.259 INFO:tasks.workunit.client.1.smithi155.stdout:8/363: rmdir d2/d41 39 2024-04-25T15:57:40.261 INFO:tasks.workunit.client.1.smithi155.stdout:1/533: stat d1/d16/d1d/d29/d5f/fa6 0 2024-04-25T15:57:40.263 INFO:tasks.workunit.client.1.smithi155.stdout:2/563: dread - d7/db/dd/f89 zero size 2024-04-25T15:57:40.265 INFO:tasks.workunit.client.1.smithi155.stdout:8/364: mknod d2/d15/d18/d34/d48/c6f 0 2024-04-25T15:57:40.266 INFO:tasks.workunit.client.1.smithi155.stdout:0/457: read d1/d3/d5/f26 [3206803,46844] 0 2024-04-25T15:57:40.266 INFO:tasks.workunit.client.1.smithi155.stdout:5/483: unlink d0/d3/d15/f72 0 2024-04-25T15:57:40.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.263+0000 7f46a135d640 1 Processor -- start 2024-04-25T15:57:40.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.263+0000 7f46a135d640 1 -- start start 2024-04-25T15:57:40.268 INFO:tasks.workunit.client.1.smithi155.stdout:3/584: truncate d1/d4/db/d91/dc4/f79 1847853 0 2024-04-25T15:57:40.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.263+0000 7f46a135d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f469c1578b0 0x7f469c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.263+0000 7f46a135d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c0c5290 con 0x7f469c158200 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.263+0000 7f46a135d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c0c5550 con 0x7f469c1517d0 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.263+0000 7f46a135d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f469c0c5e80 con 0x7f469c1578b0 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f469c158200 0x7f469c15ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38344/0 (socket says 172.21.15.87:38344) 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 -- 172.21.15.87:0/273602399 learned_addr learned my addr 172.21.15.87:0/273602399 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469a7fc640 1 --2- 172.21.15.87:0/273602399 >> v2:172.21.15.155:3300/0 conn(0x7f469c1578b0 0x7f469c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131872288 0 0) 0x7f469c0c5290 con 0x7f469c158200 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4684003530 con 0x7f469c158200 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302010757 0 0) 0x7f469c0c5550 con 0x7f469c1517d0 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f469c0c5290 con 0x7f469c1517d0 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2855545163 0 0) 0x7f4684003530 con 0x7f469c158200 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 >> v2:172.21.15.155:3300/0 conn(0x7f469c1578b0 msgr2=0x7f469c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 --2- 172.21.15.87:0/273602399 >> v2:172.21.15.155:3300/0 conn(0x7f469c1578b0 0x7f469c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 >> v1:172.21.15.155:6789/0 conn(0x7f469c1517d0 legacy=0x7f469c0c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c0c5830 con 0x7f469c158200 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f468c001a00 con 0x7f469c158200 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 >> v1:172.21.15.87:6789/0 conn(0x7f469c158200 legacy=0x7f469c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4684003b50 0x7f4684003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4684004810 0x7f4684004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46840051b0 0x7f468400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f468400c120 con 0x7f46840051b0 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f468400c2d0 con 0x7f4684003b50 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f468400c4d0 con 0x7f4684004810 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46840051b0 0x7f468400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469a7fc640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4684004810 0x7f4684004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469affd640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4684003b50 0x7f4684003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 -- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4684004810 msgr2=0x7f4684004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4684004810 0x7f4684004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 -- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4684003b50 msgr2=0x7f4684003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:40.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4684003b50 0x7f4684003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 -- 172.21.15.87:0/273602399 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4684003530 con 0x7f46840051b0 2024-04-25T15:57:40.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469affd640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4684003b50 0x7f4684003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:40.275 INFO:tasks.workunit.client.1.smithi155.stdout:7/566: dwrite d2/dd/d12/f20 [8388608,4194304] 0 2024-04-25T15:57:40.276 INFO:tasks.workunit.client.1.smithi155.stdout:9/435: dwrite dc/d2f/f7b [0,4194304] 0 2024-04-25T15:57:40.276 INFO:tasks.workunit.client.1.smithi155.stdout:8/365: stat d2/d15/d35/f44 0 2024-04-25T15:57:40.276 INFO:tasks.workunit.client.1.smithi155.stdout:7/567: chown d2/dd/d66/db2/db9 395313 1 2024-04-25T15:57:40.276 INFO:tasks.workunit.client.1.smithi155.stdout:8/366: dread - d2/d15/d35/f6d zero size 2024-04-25T15:57:40.276 INFO:tasks.workunit.client.1.smithi155.stdout:5/484: chown d0/d3/d15/d1f/d50/d60/c73 711 1 2024-04-25T15:57:40.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 -- 172.21.15.87:0/273602399 reap_dead start 2024-04-25T15:57:40.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f469b7fe640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46840051b0 0x7f468400b9d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f46840057f0 tx=0x7f468c01fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e713e3fbf96d9a02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:40.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c00a450 con 0x7f46840051b0 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468c0072f0 con 0x7f46840051b0 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.267+0000 7f4699ffb640 1 -- 172.21.15.87:0/273602399 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c0076e0 con 0x7f46840051b0 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- 172.21.15.87:0/273602399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46840051b0 msgr2=0x7f468400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46840051b0 0x7f468400b9d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f46840057f0 tx=0x7f468c01fa00 comp rx=0 tx=0).stop 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- 172.21.15.87:0/273602399 shutdown_connections 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 --2- 172.21.15.87:0/273602399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46840051b0 0x7f468400b9d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- 172.21.15.87:0/273602399 >> 172.21.15.87:0/273602399 conn(0x7f469c06d780 msgr2=0x7f469c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- 172.21.15.87:0/273602399 shutdown_connections 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- 172.21.15.87:0/273602399 wait complete. 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 Processor -- start 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- start start 2024-04-25T15:57:40.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46840051b0 0x7f469c0c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 0x7f469c1f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c14a8d0 0x7f469c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f469c0c5b10 con 0x7f469c1f1150 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f469c151be0 con 0x7f469c14a8d0 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f46a135d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f469c0a8f70 con 0x7f46840051b0 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f469a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 0x7f469c1f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f469a7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 0x7f469c1f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36322/0 (socket says 172.21.15.87:36322) 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f469a7fc640 1 -- 172.21.15.87:0/726962719 learned_addr learned my addr 172.21.15.87:0/726962719 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.271+0000 7f469affd640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46840051b0 0x7f469c0c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469b7fe640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c14a8d0 0x7f469c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469a7fc640 1 -- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46840051b0 msgr2=0x7f469c0c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469a7fc640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46840051b0 0x7f469c0c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469a7fc640 1 -- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c14a8d0 msgr2=0x7f469c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469a7fc640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c14a8d0 0x7f469c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469a7fc640 1 -- 172.21.15.87:0/726962719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c14b220 con 0x7f469c1f1150 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469b7fe640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c14a8d0 0x7f469c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469a7fc640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 0x7f469c1f1560 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4690011960 tx=0x7f4690011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000fa90 con 0x7f469c1f1150 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469000fc30 con 0x7f469c1f1150 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c0ae400 con 0x7f469c1f1150 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690014440 con 0x7f469c1f1150 2024-04-25T15:57:40.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c0ae9c0 con 0x7f469c1f1150 2024-04-25T15:57:40.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4690012040 con 0x7f469c1f1150 2024-04-25T15:57:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c0aebc0 con 0x7f469c1f1150 2024-04-25T15:57:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46837fe640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468806f400 0x7f4688071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f469008fd90 con 0x7f469c1f1150 2024-04-25T15:57:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469affd640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468806f400 0x7f4688071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:40.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.275+0000 7f469affd640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468806f400 0x7f4688071910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4694000f70 tx=0x7f4694009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:40.283 INFO:tasks.workunit.client.1.smithi155.stdout:2/564: truncate d7/db/d29/d83/d86/d8b/fa8 197037 0 2024-04-25T15:57:40.283 INFO:tasks.workunit.client.1.smithi155.stdout:1/534: dwrite d1/f11 [0,4194304] 0 2024-04-25T15:57:40.283 INFO:tasks.workunit.client.1.smithi155.stdout:2/565: chown d7/d23/f40 372387 1 2024-04-25T15:57:40.283 INFO:tasks.workunit.client.1.smithi155.stdout:4/535: truncate da/d23/d3a/d7b/fb9 3043396 0 2024-04-25T15:57:40.284 INFO:tasks.workunit.client.1.smithi155.stdout:0/458: mknod d1/d85/c9f 0 2024-04-25T15:57:40.284 INFO:tasks.workunit.client.1.smithi155.stdout:9/436: mknod dc/d13/d60/c99 0 2024-04-25T15:57:40.284 INFO:tasks.workunit.client.1.smithi155.stdout:7/568: unlink d2/lf 0 2024-04-25T15:57:40.284 INFO:tasks.workunit.client.1.smithi155.stdout:5/485: rmdir d0/d27 39 2024-04-25T15:57:40.284 INFO:tasks.workunit.client.1.smithi155.stdout:9/437: readlink dc/d11/d5a/l6f 0 2024-04-25T15:57:40.284 INFO:tasks.workunit.client.1.smithi155.stdout:1/535: rmdir d1/d16 39 2024-04-25T15:57:40.285 INFO:tasks.workunit.client.1.smithi155.stdout:2/566: creat d7/db/d2e/d6f/fb2 x:0 0 0 2024-04-25T15:57:40.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.283+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f469c14b220 con 0x7f469c1f1150 2024-04-25T15:57:40.291 INFO:tasks.workunit.client.1.smithi155.stdout:2/567: link d7/db/dd/d15/f1a d7/d23/fb3 0 2024-04-25T15:57:40.292 INFO:tasks.workunit.client.1.smithi155.stdout:5/486: rename d0/d3/d15/f16 to d0/d27/f98 0 2024-04-25T15:57:40.293 INFO:tasks.workunit.client.1.smithi155.stdout:1/536: dread - d1/d16/d1d/f65 zero size 2024-04-25T15:57:40.333 INFO:tasks.workunit.client.1.smithi155.stdout:6/583: sync 2024-04-25T15:57:40.341 INFO:tasks.workunit.client.1.smithi155.stdout:6/584: dread - d0/d1a/da1/dac/fb3 zero size 2024-04-25T15:57:40.343 INFO:tasks.workunit.client.1.smithi155.stdout:0/459: dwrite d1/f71 [0,4194304] 0 2024-04-25T15:57:40.343 INFO:tasks.workunit.client.1.smithi155.stdout:7/569: dwrite d2/dd/d30/d44/fbb [0,4194304] 0 2024-04-25T15:57:40.345 INFO:tasks.workunit.client.1.smithi155.stdout:9/438: dwrite dc/d13/d2e/f37 [0,4194304] 0 2024-04-25T15:57:40.349 INFO:tasks.workunit.client.1.smithi155.stdout:7/570: readlink d2/dd/d30/d44/l57 0 2024-04-25T15:57:40.349 INFO:tasks.workunit.client.1.smithi155.stdout:2/568: rename d7/db/dd/d15/f1d to d7/db/d29/d83/d86/db0/fb4 0 2024-04-25T15:57:40.352 INFO:tasks.workunit.client.1.smithi155.stdout:6/585: write d0/d18/d54/fa8 [820393,57728] 0 2024-04-25T15:57:40.354 INFO:tasks.workunit.client.1.smithi155.stdout:7/571: chown d2/dd/d13/d24 38 1 2024-04-25T15:57:40.355 INFO:tasks.workunit.client.1.smithi155.stdout:9/439: write dc/d11/f42 [6659331,80471] 0 2024-04-25T15:57:40.356 INFO:tasks.workunit.client.1.smithi155.stdout:0/460: write d1/d3/f94 [379195,41009] 0 2024-04-25T15:57:40.358 INFO:tasks.workunit.client.1.smithi155.stdout:5/487: dwrite d0/d27/f69 [0,4194304] 0 2024-04-25T15:57:40.358 INFO:tasks.workunit.client.1.smithi155.stdout:4/536: dwrite da/d23/d3f/d56/d69/d4a/d78/f31 [0,4194304] 0 2024-04-25T15:57:40.359 INFO:tasks.workunit.client.1.smithi155.stdout:9/440: readlink dc/d13/l58 0 2024-04-25T15:57:40.359 INFO:tasks.workunit.client.1.smithi155.stdout:2/569: write d7/db/d2e/d44/f9d [28087,127872] 0 2024-04-25T15:57:40.361 INFO:tasks.workunit.client.1.smithi155.stdout:7/572: fdatasync d2/dd/d13/d24/d35/f3c 0 2024-04-25T15:57:40.364 INFO:tasks.workunit.client.1.smithi155.stdout:2/570: write f1 [3731889,95749] 0 2024-04-25T15:57:40.364 INFO:tasks.workunit.client.1.smithi155.stdout:0/461: truncate d1/d41/f7c 1044352 0 2024-04-25T15:57:40.369 INFO:tasks.workunit.client.1.smithi155.stdout:1/537: dread d1/d6/fc [0,4194304] 0 2024-04-25T15:57:40.371 INFO:tasks.workunit.client.1.smithi155.stdout:1/538: read - d1/d32/d86/fa8 zero size 2024-04-25T15:57:40.372 INFO:tasks.workunit.client.1.smithi155.stdout:9/441: dwrite dc/d17/f51 [0,4194304] 0 2024-04-25T15:57:40.373 INFO:tasks.workunit.client.1.smithi155.stdout:7/573: dread d2/f1b [0,4194304] 0 2024-04-25T15:57:40.375 INFO:tasks.workunit.client.1.smithi155.stdout:5/488: mknod d0/d3/d15/c99 0 2024-04-25T15:57:40.376 INFO:tasks.workunit.client.1.smithi155.stdout:4/537: fdatasync da/dc/d18/f5f 0 2024-04-25T15:57:40.377 INFO:tasks.workunit.client.1.smithi155.stdout:0/462: write d1/d3f/f50 [3349504,23597] 0 2024-04-25T15:57:40.377 INFO:tasks.workunit.client.1.smithi155.stdout:2/571: creat d7/db/d29/d83/fb5 x:0 0 0 2024-04-25T15:57:40.378 INFO:tasks.workunit.client.1.smithi155.stdout:9/442: mknod dc/d17/d18/c9a 0 2024-04-25T15:57:40.380 INFO:tasks.workunit.client.1.smithi155.stdout:2/572: write d7/f2b [1034015,98807] 0 2024-04-25T15:57:40.380 INFO:tasks.workunit.client.1.smithi155.stdout:1/539: symlink d1/d16/d1d/d33/da1/lad 0 2024-04-25T15:57:40.384 INFO:tasks.workunit.client.1.smithi155.stdout:9/443: stat dc/d17/d2a/c84 0 2024-04-25T15:57:40.387 INFO:tasks.workunit.client.1.smithi155.stdout:7/574: mkdir d2/dd/d30/dbc 0 2024-04-25T15:57:40.389 INFO:tasks.workunit.client.1.smithi155.stdout:1/540: creat d1/d16/d1d/d29/d5f/fae x:0 0 0 2024-04-25T15:57:40.391 INFO:tasks.workunit.client.1.smithi155.stdout:7/575: truncate d2/dd/f23 1163548 0 2024-04-25T15:57:40.392 INFO:tasks.workunit.client.1.smithi155.stdout:1/541: chown d1/d16/d1d/d29/d5f/d34/d68/c72 4 1 2024-04-25T15:57:40.393 INFO:tasks.workunit.client.1.smithi155.stdout:7/576: read - d2/dd/d13/d1c/f6f zero size 2024-04-25T15:57:40.398 INFO:tasks.workunit.client.1.smithi155.stdout:1/542: readlink d1/d16/d1d/d29/d5f/d34/l50 0 2024-04-25T15:57:40.399 INFO:tasks.workunit.client.1.smithi155.stdout:4/538: dwrite da/d23/d3f/d56/d69/d4a/d78/d62/f68 [0,4194304] 0 2024-04-25T15:57:40.399 INFO:tasks.workunit.client.1.smithi155.stdout:1/543: creat d1/d6/faf x:0 0 0 2024-04-25T15:57:40.432 INFO:tasks.workunit.client.1.smithi155.stdout:4/539: creat da/dc/d18/fc1 x:0 0 0 2024-04-25T15:57:40.433 INFO:tasks.workunit.client.1.smithi155.stdout:3/585: sync 2024-04-25T15:57:40.434 INFO:tasks.workunit.client.1.smithi155.stdout:7/577: write d2/dd/d36/f62 [817035,29301] 0 2024-04-25T15:57:40.435 INFO:tasks.workunit.client.1.smithi155.stdout:1/544: creat d1/d16/d1d/d33/da1/fb0 x:0 0 0 2024-04-25T15:57:40.436 INFO:tasks.workunit.client.1.smithi155.stdout:0/463: dread d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:40.439 INFO:tasks.workunit.client.1.smithi155.stdout:5/489: dread d0/d3/d15/d30/d4f/f6b [0,4194304] 0 2024-04-25T15:57:40.439 INFO:tasks.workunit.client.1.smithi155.stdout:0/464: unlink d1/d6/d29/f53 0 2024-04-25T15:57:40.440 INFO:tasks.workunit.client.1.smithi155.stdout:4/540: creat da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fc2 x:0 0 0 2024-04-25T15:57:40.441 INFO:tasks.workunit.client.1.smithi155.stdout:7/578: mknod d2/dd/d66/db2/db9/cbd 0 2024-04-25T15:57:40.443 INFO:tasks.workunit.client.1.smithi155.stdout:0/465: symlink d1/d3/d3d/la0 0 2024-04-25T15:57:40.445 INFO:tasks.workunit.client.1.smithi155.stdout:3/586: rename d1/d4/f41 to d1/d4/fc7 0 2024-04-25T15:57:40.446 INFO:tasks.workunit.client.1.smithi155.stdout:1/545: link d1/f12 d1/d32/d77/fb1 0 2024-04-25T15:57:40.446 INFO:tasks.workunit.client.1.smithi155.stdout:7/579: getdents d2/d26/d3d/d6d/daa 0 2024-04-25T15:57:40.447 INFO:tasks.workunit.client.1.smithi155.stdout:4/541: rename da/dc/d18/d6e/cab to da/d23/d3f/d56/cc3 0 2024-04-25T15:57:40.449 INFO:tasks.workunit.client.1.smithi155.stdout:7/580: chown d2/dd/d30/ca4 6126 1 2024-04-25T15:57:40.451 INFO:tasks.workunit.client.1.smithi155.stdout:5/490: dwrite d0/d3/d15/d30/d4f/f6b [0,4194304] 0 2024-04-25T15:57:40.451 INFO:tasks.workunit.client.1.smithi155.stdout:1/546: rename d1/d16/d1d/d29/d5f/f49 to d1/d32/d86/fb2 0 2024-04-25T15:57:40.453 INFO:tasks.workunit.client.1.smithi155.stdout:1/547: dread - d1/d16/d1d/d29/d5f/fae zero size 2024-04-25T15:57:40.456 INFO:tasks.workunit.client.1.smithi155.stdout:7/581: symlink d2/dd/d66/db2/db9/lbe 0 2024-04-25T15:57:40.457 INFO:tasks.workunit.client.1.smithi155.stdout:3/587: dread d1/d4/d10/d21/d73/d77/d57/d80/fa0 [0,4194304] 0 2024-04-25T15:57:40.458 INFO:tasks.workunit.client.1.smithi155.stdout:5/491: unlink d0/d58/d32/d6a/f8a 0 2024-04-25T15:57:40.459 INFO:tasks.workunit.client.1.smithi155.stdout:5/492: dread - d0/d3/d15/d1f/f70 zero size 2024-04-25T15:57:40.469 INFO:tasks.workunit.client.1.smithi155.stdout:7/582: truncate d2/d26/d3d/d6d/f8a 722901 0 2024-04-25T15:57:40.472 INFO:tasks.workunit.client.1.smithi155.stdout:3/588: dwrite d1/d4/d10/d21/d73/f99 [0,4194304] 0 2024-04-25T15:57:40.476 INFO:tasks.workunit.client.1.smithi155.stdout:5/493: dwrite d0/d3/d2c/f3a [0,4194304] 0 2024-04-25T15:57:40.477 INFO:tasks.workunit.client.1.smithi155.stdout:1/548: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:57:40.481 INFO:tasks.workunit.client.1.smithi155.stdout:4/542: dwrite da/d23/f3d [0,4194304] 0 2024-04-25T15:57:40.485 INFO:tasks.workunit.client.1.smithi155.stdout:4/543: chown da/d23 0 1 2024-04-25T15:57:40.485 INFO:tasks.workunit.client.1.smithi155.stdout:0/466: dwrite d1/d3f/f65 [0,4194304] 0 2024-04-25T15:57:40.485 INFO:tasks.workunit.client.1.smithi155.stdout:5/494: creat d0/d47/d59/f9a x:0 0 0 2024-04-25T15:57:40.486 INFO:tasks.workunit.client.1.smithi155.stdout:3/589: unlink d1/d4/db/d28/d58/c6d 0 2024-04-25T15:57:40.492 INFO:tasks.workunit.client.1.smithi155.stdout:5/495: chown d0/d3/d15/d1f/l6c 71 1 2024-04-25T15:57:40.492 INFO:tasks.workunit.client.1.smithi155.stdout:7/583: getdents d2/dd/d13/d24/d35 0 2024-04-25T15:57:40.493 INFO:tasks.workunit.client.1.smithi155.stdout:4/544: creat da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fc4 x:0 0 0 2024-04-25T15:57:40.499 INFO:tasks.workunit.client.1.smithi155.stdout:1/549: dwrite d1/f7a [0,4194304] 0 2024-04-25T15:57:40.499 INFO:tasks.workunit.client.1.smithi155.stdout:7/584: write d2/d26/d3d/d6d/f79 [2967587,4882] 0 2024-04-25T15:57:40.499 INFO:tasks.workunit.client.1.smithi155.stdout:7/585: fdatasync d2/dd/d13/d24/d35/f3f 0 2024-04-25T15:57:40.501 INFO:tasks.workunit.client.1.smithi155.stdout:7/586: rename d2/f1f to d2/dd/d13/d24/d8b/fbf 0 2024-04-25T15:57:40.504 INFO:tasks.workunit.client.1.smithi155.stdout:1/550: getdents d1/d6 0 2024-04-25T15:57:40.507 INFO:tasks.workunit.client.1.smithi155.stdout:3/590: dwrite d1/d4/db/d20/d44/d52/d93/da6/fb4 [0,4194304] 0 2024-04-25T15:57:40.512 INFO:tasks.workunit.client.1.smithi155.stdout:8/367: sync 2024-04-25T15:57:40.516 INFO:tasks.workunit.client.1.smithi155.stdout:5/496: dread d0/d58/f90 [0,4194304] 0 2024-04-25T15:57:40.516 INFO:tasks.workunit.client.1.smithi155.stdout:0/467: dwrite d1/d3f/f7b [0,4194304] 0 2024-04-25T15:57:40.517 INFO:tasks.workunit.client.1.smithi155.stdout:1/551: dread d1/d32/d77/fb1 [0,4194304] 0 2024-04-25T15:57:40.517 INFO:tasks.workunit.client.1.smithi155.stdout:8/368: symlink d2/d15/d18/l70 0 2024-04-25T15:57:40.518 INFO:tasks.workunit.client.1.smithi155.stdout:5/497: fsync d0/d3/d15/d1f/d50/d60/f65 0 2024-04-25T15:57:40.521 INFO:tasks.workunit.client.1.smithi155.stdout:5/498: mkdir d0/d58/d9b 0 2024-04-25T15:57:40.522 INFO:tasks.workunit.client.1.smithi155.stdout:5/499: chown d0/d3/d2c 32138289 1 2024-04-25T15:57:40.523 INFO:tasks.workunit.client.1.smithi155.stdout:1/552: symlink d1/d16/d1d/d29/d3d/d43/lb3 0 2024-04-25T15:57:40.526 INFO:tasks.workunit.client.1.smithi155.stdout:5/500: write d0/d27/f43 [2135624,58069] 0 2024-04-25T15:57:40.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.523+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f469c069bb0 con 0x7f469c1f1150 2024-04-25T15:57:40.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.523+0000 7f46837fe640 1 -- 172.21.15.87:0/726962719 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f4690019030 con 0x7f469c1f1150 2024-04-25T15:57:40.528 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:40.528 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:40.528 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:40.529 INFO:tasks.workunit.client.1.smithi155.stdout:1/553: write d1/d16/d1d/d29/d3d/d43/f62 [2036019,51700] 0 2024-04-25T15:57:40.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468806f400 msgr2=0x7f4688071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468806f400 0x7f4688071910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4694000f70 tx=0x7f4694009040 comp rx=0 tx=0).stop 2024-04-25T15:57:40.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 msgr2=0x7f469c1f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:40.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 0x7f469c1f1560 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4690011960 tx=0x7f4690011e20 comp rx=0 tx=0).stop 2024-04-25T15:57:40.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 shutdown_connections 2024-04-25T15:57:40.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f468806f400 0x7f4688071910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c14a8d0 0x7f469c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f469c1f1150 0x7f469c1f1560 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 --2- 172.21.15.87:0/726962719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46840051b0 0x7f469c0c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:40.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 >> 172.21.15.87:0/726962719 conn(0x7f469c06d780 msgr2=0x7f469c14e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:40.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 shutdown_connections 2024-04-25T15:57:40.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:40.527+0000 7f46a135d640 1 -- 172.21.15.87:0/726962719 wait complete. 2024-04-25T15:57:40.531 INFO:tasks.workunit.client.1.smithi155.stdout:0/468: dwrite d1/d6/d16/f88 [0,4194304] 0 2024-04-25T15:57:40.532 INFO:tasks.workunit.client.1.smithi155.stdout:8/369: dwrite d2/d15/d35/f6d [0,4194304] 0 2024-04-25T15:57:40.536 INFO:tasks.workunit.client.1.smithi155.stdout:5/501: unlink d0/d47/d59/f5d 0 2024-04-25T15:57:40.539 INFO:tasks.workunit.client.1.smithi155.stdout:5/502: write d0/d47/f4d [4150179,128228] 0 2024-04-25T15:57:40.539 INFO:tasks.workunit.client.1.smithi155.stdout:0/469: rename d1/d41/f7f to d1/d85/fa1 0 2024-04-25T15:57:40.546 INFO:tasks.workunit.client.1.smithi155.stdout:5/503: mknod d0/d58/d32/d6a/d78/c9c 0 2024-04-25T15:57:40.546 INFO:tasks.workunit.client.1.smithi155.stdout:8/370: rename d2/d15/d18/d34/d48/d59/l6e to d2/d15/d18/d34/d48/d4e/l71 0 2024-04-25T15:57:40.548 INFO:tasks.workunit.client.1.smithi155.stdout:0/470: truncate d1/d6/f75 354238 0 2024-04-25T15:57:40.548 INFO:tasks.workunit.client.1.smithi155.stdout:0/471: chown d1/d6/d16/c4f 2 1 2024-04-25T15:57:40.548 INFO:tasks.workunit.client.1.smithi155.stdout:0/472: chown d1/c36 2205348 1 2024-04-25T15:57:40.551 INFO:tasks.workunit.client.1.smithi155.stdout:0/473: mknod d1/d85/ca2 0 2024-04-25T15:57:40.553 INFO:tasks.workunit.client.1.smithi155.stdout:0/474: rmdir d1/d3/d3d/d46 39 2024-04-25T15:57:40.554 INFO:tasks.workunit.client.1.smithi155.stdout:8/371: dwrite d2/d15/d18/d23/d3c/f61 [0,4194304] 0 2024-04-25T15:57:40.555 INFO:tasks.workunit.client.1.smithi155.stdout:5/504: link d0/d3/d15/l61 d0/d58/d32/l9d 0 2024-04-25T15:57:40.557 INFO:tasks.workunit.client.1.smithi155.stdout:8/372: truncate d2/d15/d18/d49/f3a 4933650 0 2024-04-25T15:57:40.559 INFO:tasks.workunit.client.1.smithi155.stdout:0/475: link d1/d6/d29/f3a d1/d6/d29/d47/fa3 0 2024-04-25T15:57:40.561 INFO:tasks.workunit.client.1.smithi155.stdout:1/554: dwrite d1/d16/d1d/d29/d5f/d34/d68/d93/fa9 [0,4194304] 0 2024-04-25T15:57:40.561 INFO:tasks.workunit.client.1.smithi155.stdout:0/476: write d1/d3f/f7b [3524950,107465] 0 2024-04-25T15:57:40.563 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:40.564 INFO:tasks.workunit.client.1.smithi155.stdout:0/477: write d1/d41/f93 [241704,119151] 0 2024-04-25T15:57:40.566 INFO:tasks.workunit.client.1.smithi155.stdout:1/555: readlink d1/d16/d1d/d29/d3d/l8c 0 2024-04-25T15:57:40.568 INFO:tasks.workunit.client.1.smithi155.stdout:0/478: mkdir d1/d3/d3d/d46/da4 0 2024-04-25T15:57:40.570 INFO:tasks.workunit.client.1.smithi155.stdout:0/479: fsync d1/d85/fa1 0 2024-04-25T15:57:40.571 INFO:tasks.workunit.client.1.smithi155.stdout:8/373: dwrite d2/d15/d35/d3d/f42 [0,4194304] 0 2024-04-25T15:57:40.572 INFO:tasks.workunit.client.1.smithi155.stdout:0/480: chown d1/d3/d3d/la0 240582 1 2024-04-25T15:57:40.574 INFO:tasks.workunit.client.1.smithi155.stdout:8/374: read d2/d15/d18/d34/d48/f50 [541544,123657] 0 2024-04-25T15:57:40.575 INFO:tasks.workunit.client.1.smithi155.stdout:8/375: fdatasync d2/fa 0 2024-04-25T15:57:40.594 INFO:tasks.workunit.client.1.smithi155.stdout:1/556: truncate d1/d16/d1d/d29/d5f/f7c 1074873 0 2024-04-25T15:57:40.596 INFO:tasks.workunit.client.1.smithi155.stdout:1/557: mkdir d1/d6/db4 0 2024-04-25T15:57:40.596 INFO:tasks.workunit.client.1.smithi155.stdout:0/481: dread d1/d6/f22 [0,4194304] 0 2024-04-25T15:57:40.599 INFO:tasks.workunit.client.1.smithi155.stdout:0/482: creat d1/d6/d29/d47/fa5 x:0 0 0 2024-04-25T15:57:40.600 INFO:tasks.workunit.client.1.smithi155.stdout:1/558: symlink d1/d16/d1d/d29/d5f/lb5 0 2024-04-25T15:57:40.602 INFO:tasks.workunit.client.1.smithi155.stdout:0/483: creat d1/d6/d29/fa6 x:0 0 0 2024-04-25T15:57:40.602 INFO:tasks.workunit.client.1.smithi155.stdout:1/559: write d1/d16/d1d/d29/d3d/f9b [459541,95497] 0 2024-04-25T15:57:40.602 INFO:tasks.workunit.client.1.smithi155.stdout:5/505: dread d0/d3/d2c/f2f [0,4194304] 0 2024-04-25T15:57:40.603 INFO:tasks.workunit.client.1.smithi155.stdout:1/560: fdatasync d1/d16/d1d/d29/d5f/d34/d68/d93/fa9 0 2024-04-25T15:57:40.608 INFO:tasks.workunit.client.1.smithi155.stdout:1/561: mknod d1/d16/d1d/d29/d5f/d34/d68/d93/da4/cb6 0 2024-04-25T15:57:40.611 INFO:tasks.workunit.client.1.smithi155.stdout:1/562: mkdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7 0 2024-04-25T15:57:40.612 INFO:tasks.workunit.client.1.smithi155.stdout:1/563: write d1/d16/d1d/d29/f9a [2406492,122310] 0 2024-04-25T15:57:40.615 INFO:tasks.workunit.client.1.smithi155.stdout:1/564: mkdir d1/d16/d1d/d29/d5f/db8 0 2024-04-25T15:57:40.619 INFO:tasks.workunit.client.1.smithi155.stdout:5/506: dwrite d0/d3/d15/d30/d4f/f62 [0,4194304] 0 2024-04-25T15:57:40.621 INFO:tasks.workunit.client.1.smithi155.stdout:0/484: dwrite d1/f1b [0,4194304] 0 2024-04-25T15:57:40.621 INFO:tasks.workunit.client.1.smithi155.stdout:5/507: dread - d0/d3/d15/d1f/f70 zero size 2024-04-25T15:57:40.627 INFO:tasks.workunit.client.1.smithi155.stdout:0/485: creat d1/d1a/fa7 x:0 0 0 2024-04-25T15:57:40.629 INFO:tasks.workunit.client.1.smithi155.stdout:1/565: truncate d1/d16/d1d/d29/d3d/d43/f62 2267051 0 2024-04-25T15:57:40.631 INFO:tasks.workunit.client.1.smithi155.stdout:9/444: sync 2024-04-25T15:57:40.631 INFO:tasks.workunit.client.1.smithi155.stdout:2/573: sync 2024-04-25T15:57:40.631 INFO:tasks.workunit.client.1.smithi155.stdout:1/566: symlink d1/d16/d1d/d33/da1/lb9 0 2024-04-25T15:57:40.632 INFO:tasks.workunit.client.1.smithi155.stdout:6/586: sync 2024-04-25T15:57:40.632 INFO:tasks.workunit.client.1.smithi155.stdout:5/508: dwrite d0/d3/d15/d1f/d50/d7c/f83 [0,4194304] 0 2024-04-25T15:57:40.633 INFO:tasks.workunit.client.1.smithi155.stdout:2/574: dread - d7/d23/f98 zero size 2024-04-25T15:57:40.635 INFO:tasks.workunit.client.1.smithi155.stdout:6/587: chown d0/d1a/d45/d61/fa2 0 1 2024-04-25T15:57:40.635 INFO:tasks.workunit.client.1.smithi155.stdout:5/509: truncate d0/d47/d59/f9a 615126 0 2024-04-25T15:57:40.637 INFO:tasks.workunit.client.1.smithi155.stdout:2/575: dread d7/db/d29/d83/d86/d8b/fa8 [0,4194304] 0 2024-04-25T15:57:40.638 INFO:tasks.workunit.client.1.smithi155.stdout:0/486: rename d1/d3/f48 to d1/d3/d12/fa8 0 2024-04-25T15:57:40.638 INFO:tasks.workunit.client.1.smithi155.stdout:2/576: chown d7/db/d2e/d6f 145277640 1 2024-04-25T15:57:40.639 INFO:tasks.workunit.client.1.smithi155.stdout:9/445: dread dc/d13/f3b [0,4194304] 0 2024-04-25T15:57:40.641 INFO:tasks.workunit.client.1.smithi155.stdout:6/588: symlink d0/d1a/d25/d2e/lba 0 2024-04-25T15:57:40.644 INFO:tasks.workunit.client.1.smithi155.stdout:5/510: dread d0/d3/f4a [0,4194304] 0 2024-04-25T15:57:40.645 INFO:tasks.workunit.client.1.smithi155.stdout:2/577: creat d7/db/d2e/d6f/d91/fb6 x:0 0 0 2024-04-25T15:57:40.647 INFO:tasks.workunit.client.1.smithi155.stdout:9/446: mkdir dc/d3c/d9b 0 2024-04-25T15:57:40.648 INFO:tasks.workunit.client.1.smithi155.stdout:9/447: write dc/d17/d18/f2d [2139291,98311] 0 2024-04-25T15:57:40.648 INFO:tasks.workunit.client.1.smithi155.stdout:6/589: mknod d0/d1a/d25/d2e/cbb 0 2024-04-25T15:57:40.650 INFO:tasks.workunit.client.1.smithi155.stdout:0/487: truncate d1/d6/d29/d47/f55 4151826 0 2024-04-25T15:57:40.652 INFO:tasks.workunit.client.1.smithi155.stdout:5/511: creat d0/d3/d2c/f9e x:0 0 0 2024-04-25T15:57:40.653 INFO:tasks.workunit.client.1.smithi155.stdout:1/567: write d1/d6/f14 [620313,10899] 0 2024-04-25T15:57:40.655 INFO:tasks.workunit.client.1.smithi155.stdout:1/568: read d1/d16/d1d/d29/d5f/d34/d68/d93/fa9 [2527062,54617] 0 2024-04-25T15:57:40.655 INFO:tasks.workunit.client.1.smithi155.stdout:6/590: creat d0/d13/d7c/da9/fbc x:0 0 0 2024-04-25T15:57:40.660 INFO:tasks.workunit.client.1.smithi155.stdout:6/591: creat d0/d13/d34/fbd x:0 0 0 2024-04-25T15:57:40.661 INFO:tasks.workunit.client.1.smithi155.stdout:5/512: mkdir d0/d3/d15/d9f 0 2024-04-25T15:57:40.662 INFO:tasks.workunit.client.1.smithi155.stdout:9/448: write dc/d13/d2e/f4a [991340,97867] 0 2024-04-25T15:57:40.663 INFO:tasks.workunit.client.1.smithi155.stdout:0/488: link d1/c36 d1/d3/d5/d5b/ca9 0 2024-04-25T15:57:40.666 INFO:tasks.workunit.client.1.smithi155.stdout:2/578: link d7/db/dd/f72 d7/db/fb7 0 2024-04-25T15:57:40.666 INFO:tasks.workunit.client.1.smithi155.stdout:9/449: mkdir dc/d11/d67/d9c 0 2024-04-25T15:57:40.669 INFO:tasks.workunit.client.1.smithi155.stdout:0/489: rename d1/d3/f94 to d1/d3/d5/faa 0 2024-04-25T15:57:40.669 INFO:tasks.workunit.client.1.smithi155.stdout:5/513: dread d0/d3/d2c/f3c [0,4194304] 0 2024-04-25T15:57:40.670 INFO:tasks.workunit.client.1.smithi155.stdout:0/490: write d1/d41/f45 [1207462,42683] 0 2024-04-25T15:57:40.671 INFO:tasks.workunit.client.1.smithi155.stdout:2/579: creat d7/db/d2e/d90/fb8 x:0 0 0 2024-04-25T15:57:40.672 INFO:tasks.workunit.client.1.smithi155.stdout:6/592: dread d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:40.673 INFO:tasks.workunit.client.1.smithi155.stdout:2/580: mkdir d7/d8e/db9 0 2024-04-25T15:57:40.674 INFO:tasks.workunit.client.1.smithi155.stdout:0/491: creat d1/d6/d16/d6e/fab x:0 0 0 2024-04-25T15:57:40.674 INFO:tasks.workunit.client.1.smithi155.stdout:6/593: symlink d0/d13/d6f/lbe 0 2024-04-25T15:57:40.675 INFO:tasks.workunit.client.1.smithi155.stdout:2/581: readlink d7/db/dd/l10 0 2024-04-25T15:57:40.676 INFO:tasks.workunit.client.1.smithi155.stdout:0/492: symlink d1/d3/d5/da/lac 0 2024-04-25T15:57:40.685 INFO:tasks.workunit.client.1.smithi155.stdout:9/450: dread dc/d13/d59/f5d [0,4194304] 0 2024-04-25T15:57:40.685 INFO:tasks.workunit.client.1.smithi155.stdout:0/493: dwrite d1/d6/f35 [0,4194304] 0 2024-04-25T15:57:40.688 INFO:tasks.workunit.client.1.smithi155.stdout:5/514: dread d0/d47/f4d [0,4194304] 0 2024-04-25T15:57:40.689 INFO:tasks.workunit.client.1.smithi155.stdout:2/582: dread d7/f2d [0,4194304] 0 2024-04-25T15:57:40.690 INFO:tasks.workunit.client.1.smithi155.stdout:0/494: mknod d1/d3/d3d/d46/da4/cad 0 2024-04-25T15:57:40.696 INFO:tasks.workunit.client.1.smithi155.stdout:9/451: dwrite dc/d17/d2a/f8f [0,4194304] 0 2024-04-25T15:57:40.702 INFO:tasks.workunit.client.1.smithi155.stdout:2/583: link d7/d23/f35 d7/d23/fba 0 2024-04-25T15:57:40.710 INFO:tasks.workunit.client.1.smithi155.stdout:9/452: link dc/d17/d18/f41 dc/d11/d30/d46/f9d 0 2024-04-25T15:57:40.711 INFO:tasks.workunit.client.1.smithi155.stdout:6/594: truncate d0/d18/f48 8337103 0 2024-04-25T15:57:40.714 INFO:tasks.workunit.client.1.smithi155.stdout:9/453: rename dc/d13/f70 to dc/d17/d18/f9e 0 2024-04-25T15:57:40.715 INFO:tasks.workunit.client.1.smithi155.stdout:2/584: creat d7/db/dd/d15/fbb x:0 0 0 2024-04-25T15:57:40.717 INFO:tasks.workunit.client.1.smithi155.stdout:5/515: dwrite d0/f2 [0,4194304] 0 2024-04-25T15:57:40.717 INFO:tasks.workunit.client.1.smithi155.stdout:0/495: write d1/d3/d12/f84 [1136505,9812] 0 2024-04-25T15:57:40.719 INFO:tasks.workunit.client.1.smithi155.stdout:6/595: creat d0/fbf x:0 0 0 2024-04-25T15:57:40.720 INFO:tasks.workunit.client.1.smithi155.stdout:5/516: write d0/d3/d15/f8d [526976,6725] 0 2024-04-25T15:57:40.723 INFO:tasks.workunit.client.1.smithi155.stdout:9/454: creat dc/d3c/d9b/f9f x:0 0 0 2024-04-25T15:57:40.724 INFO:tasks.workunit.client.1.smithi155.stdout:0/496: truncate d1/d6/f90 81691 0 2024-04-25T15:57:40.725 INFO:tasks.workunit.client.1.smithi155.stdout:2/585: creat d7/db/dd/d15/fbc x:0 0 0 2024-04-25T15:57:40.727 INFO:tasks.workunit.client.1.smithi155.stdout:2/586: chown d7/db/d2e/d6f/d91/fb6 60120 1 2024-04-25T15:57:40.727 INFO:tasks.workunit.client.1.smithi155.stdout:5/517: mkdir d0/d58/d63/da0 0 2024-04-25T15:57:40.728 INFO:tasks.workunit.client.1.smithi155.stdout:9/455: readlink dc/d13/d48/l6a 0 2024-04-25T15:57:40.729 INFO:tasks.workunit.client.1.smithi155.stdout:5/518: read d0/d3/d15/d1f/d50/d7c/f83 [358628,88696] 0 2024-04-25T15:57:40.731 INFO:tasks.workunit.client.1.smithi155.stdout:6/596: dread d0/d1a/d37/f8d [0,4194304] 0 2024-04-25T15:57:40.732 INFO:tasks.workunit.client.1.smithi155.stdout:6/597: dread - d0/d13/d34/fbd zero size 2024-04-25T15:57:40.732 INFO:tasks.workunit.client.1.smithi155.stdout:6/598: stat d0/d13/d34/d38/d90 0 2024-04-25T15:57:40.734 INFO:tasks.workunit.client.1.smithi155.stdout:0/497: fdatasync d1/d6/d29/d47/f55 0 2024-04-25T15:57:40.734 INFO:tasks.workunit.client.1.smithi155.stdout:9/456: mkdir dc/d11/d30/d46/da0 0 2024-04-25T15:57:40.734 INFO:tasks.workunit.client.1.smithi155.stdout:2/587: dread d7/db/d29/f30 [0,4194304] 0 2024-04-25T15:57:40.734 INFO:tasks.workunit.client.1.smithi155.stdout:0/498: fsync d1/d6/f75 0 2024-04-25T15:57:40.735 INFO:tasks.workunit.client.1.smithi155.stdout:9/457: chown dc/d11/d30/d46/l75 26444 1 2024-04-25T15:57:40.735 INFO:tasks.workunit.client.1.smithi155.stdout:9/458: stat dc/d11/d30 0 2024-04-25T15:57:40.736 INFO:tasks.workunit.client.1.smithi155.stdout:9/459: chown dc/d13/d48 214 1 2024-04-25T15:57:40.737 INFO:tasks.workunit.client.1.smithi155.stdout:2/588: chown d7/db/c4c 211080 1 2024-04-25T15:57:40.737 INFO:tasks.workunit.client.1.smithi155.stdout:0/499: symlink d1/d3/d6a/lae 0 2024-04-25T15:57:40.741 INFO:tasks.workunit.client.1.smithi155.stdout:9/460: link dc/d17/d18/f9e dc/d11/fa1 0 2024-04-25T15:57:40.742 INFO:tasks.workunit.client.1.smithi155.stdout:9/461: chown dc/d17/d18/f9e 129778035 1 2024-04-25T15:57:40.743 INFO:tasks.workunit.client.1.smithi155.stdout:5/519: write d0/d58/f56 [278524,78969] 0 2024-04-25T15:57:40.744 INFO:tasks.workunit.client.1.smithi155.stdout:2/589: dread d7/db/d2e/d44/f68 [0,4194304] 0 2024-04-25T15:57:40.744 INFO:tasks.workunit.client.1.smithi155.stdout:9/462: write dc/d17/d2a/f2c [5162585,61714] 0 2024-04-25T15:57:40.748 INFO:tasks.workunit.client.1.smithi155.stdout:5/520: getdents d0/d58/d63/da0 0 2024-04-25T15:57:40.750 INFO:tasks.workunit.client.1.smithi155.stdout:2/590: write d7/f49 [1535606,1191] 0 2024-04-25T15:57:40.752 INFO:tasks.workunit.client.1.smithi155.stdout:9/463: dread dc/d13/f54 [0,4194304] 0 2024-04-25T15:57:40.753 INFO:tasks.workunit.client.1.smithi155.stdout:6/599: dwrite d0/d1a/d37/f4d [0,4194304] 0 2024-04-25T15:57:40.757 INFO:tasks.workunit.client.1.smithi155.stdout:5/521: dread d0/d58/d32/f49 [0,4194304] 0 2024-04-25T15:57:40.757 INFO:tasks.workunit.client.1.smithi155.stdout:9/464: unlink dc/l10 0 2024-04-25T15:57:40.757 INFO:tasks.workunit.client.1.smithi155.stdout:9/465: stat dc/d17/d18/l50 0 2024-04-25T15:57:40.758 INFO:tasks.workunit.client.1.smithi155.stdout:2/591: mkdir d7/db/d2e/d44/d9e/dbd 0 2024-04-25T15:57:40.761 INFO:tasks.workunit.client.1.smithi155.stdout:2/592: chown d7/db/d2e/d44/f9d 296667 1 2024-04-25T15:57:40.761 INFO:tasks.workunit.client.1.smithi155.stdout:0/500: dread d1/d1a/f5f [0,4194304] 0 2024-04-25T15:57:40.762 INFO:tasks.workunit.client.1.smithi155.stdout:9/466: creat dc/d13/d2e/d4c/fa2 x:0 0 0 2024-04-25T15:57:40.762 INFO:tasks.workunit.client.1.smithi155.stdout:2/593: readlink d7/db/d2e/d44/la0 0 2024-04-25T15:57:40.764 INFO:tasks.workunit.client.1.smithi155.stdout:6/600: dwrite d0/d1a/d37/f3e [4194304,4194304] 0 2024-04-25T15:57:40.764 INFO:tasks.workunit.client.1.smithi155.stdout:6/601: readlink d0/d13/l26 0 2024-04-25T15:57:40.765 INFO:tasks.workunit.client.1.smithi155.stdout:0/501: unlink d1/d41/f87 0 2024-04-25T15:57:40.766 INFO:tasks.workunit.client.1.smithi155.stdout:5/522: write d0/d3/d15/f88 [1010020,55916] 0 2024-04-25T15:57:40.767 INFO:tasks.workunit.client.1.smithi155.stdout:4/545: sync 2024-04-25T15:57:40.771 INFO:tasks.workunit.client.1.smithi155.stdout:0/502: creat d1/d3/d3d/d46/da4/faf x:0 0 0 2024-04-25T15:57:40.772 INFO:tasks.workunit.client.1.smithi155.stdout:4/546: creat da/d23/d3a/d7b/d93/fc5 x:0 0 0 2024-04-25T15:57:40.773 INFO:tasks.workunit.client.1.smithi155.stdout:5/523: dread d0/d58/f90 [0,4194304] 0 2024-04-25T15:57:40.773 INFO:tasks.workunit.client.1.smithi155.stdout:6/602: dwrite d0/d18/d54/fa8 [0,4194304] 0 2024-04-25T15:57:40.774 INFO:tasks.workunit.client.1.smithi155.stdout:5/524: stat d0/d27/f98 0 2024-04-25T15:57:40.775 INFO:tasks.workunit.client.1.smithi155.stdout:0/503: mkdir d1/d6/d29/d47/db0 0 2024-04-25T15:57:40.777 INFO:tasks.workunit.client.1.smithi155.stdout:4/547: write da/fa1 [758411,3852] 0 2024-04-25T15:57:40.777 INFO:tasks.workunit.client.1.smithi155.stdout:6/603: rename d0/d1a/d37/l3d to d0/d1a/d45/d61/lc0 0 2024-04-25T15:57:40.778 INFO:tasks.workunit.client.1.smithi155.stdout:4/548: chown da/d23/d3f 27316 1 2024-04-25T15:57:40.778 INFO:tasks.workunit.client.1.smithi155.stdout:0/504: mknod d1/d3/d5/da/cb1 0 2024-04-25T15:57:40.782 INFO:tasks.workunit.client.1.smithi155.stdout:5/525: link d0/d3/d2c/f2f d0/d3/d15/d1f/d50/d7c/fa1 0 2024-04-25T15:57:40.782 INFO:tasks.workunit.client.1.smithi155.stdout:4/549: mkdir da/d23/d3f/dc6 0 2024-04-25T15:57:40.783 INFO:tasks.workunit.client.1.smithi155.stdout:6/604: mknod d0/d13/cc1 0 2024-04-25T15:57:40.784 INFO:tasks.workunit.client.1.smithi155.stdout:5/526: mknod d0/d47/d59/ca2 0 2024-04-25T15:57:40.784 INFO:tasks.workunit.client.1.smithi155.stdout:6/605: fsync d0/d13/d43/d56/d7b/f85 0 2024-04-25T15:57:40.784 INFO:tasks.workunit.client.1.smithi155.stdout:4/550: symlink da/d23/d3a/lc7 0 2024-04-25T15:57:40.785 INFO:tasks.workunit.client.1.smithi155.stdout:0/505: dread d1/f1b [0,4194304] 0 2024-04-25T15:57:40.786 INFO:tasks.workunit.client.1.smithi155.stdout:0/506: rmdir d1/d3/d3d 39 2024-04-25T15:57:40.788 INFO:tasks.workunit.client.1.smithi155.stdout:9/467: dread dc/d13/d60/f8a [0,4194304] 0 2024-04-25T15:57:40.790 INFO:tasks.workunit.client.1.smithi155.stdout:5/527: creat d0/d3/d15/d1f/fa3 x:0 0 0 2024-04-25T15:57:40.791 INFO:tasks.workunit.client.1.smithi155.stdout:4/551: mkdir da/d23/d3f/dc6/dc8 0 2024-04-25T15:57:40.793 INFO:tasks.workunit.client.1.smithi155.stdout:5/528: truncate d0/d47/f4d 4882559 0 2024-04-25T15:57:40.794 INFO:tasks.workunit.client.1.smithi155.stdout:6/606: dwrite d0/d1a/d21/d73/faa [0,4194304] 0 2024-04-25T15:57:40.795 INFO:tasks.workunit.client.1.smithi155.stdout:0/507: mkdir d1/d3/d12/d92/d9d/db2 0 2024-04-25T15:57:40.797 INFO:tasks.workunit.client.1.smithi155.stdout:9/468: dread dc/d17/f51 [0,4194304] 0 2024-04-25T15:57:40.797 INFO:tasks.workunit.client.1.smithi155.stdout:5/529: rename d0/d47/f4d to d0/d47/fa4 0 2024-04-25T15:57:40.800 INFO:tasks.workunit.client.1.smithi155.stdout:0/508: symlink d1/d6/d29/d47/lb3 0 2024-04-25T15:57:40.801 INFO:tasks.workunit.client.1.smithi155.stdout:9/469: dread dc/d11/d5a/f8c [0,4194304] 0 2024-04-25T15:57:40.801 INFO:tasks.workunit.client.1.smithi155.stdout:0/509: chown d1/d3/d12/d92 140 1 2024-04-25T15:57:40.803 INFO:tasks.workunit.client.1.smithi155.stdout:4/552: dwrite da/dc/d18/f4c [0,4194304] 0 2024-04-25T15:57:40.806 INFO:tasks.workunit.client.1.smithi155.stdout:6/607: creat d0/d1a/d25/fc2 x:0 0 0 2024-04-25T15:57:40.807 INFO:tasks.workunit.client.1.smithi155.stdout:5/530: mknod d0/d3/d2c/d94/ca5 0 2024-04-25T15:57:40.807 INFO:tasks.workunit.client.1.smithi155.stdout:5/531: dread - d0/d3/d15/d1f/fa3 zero size 2024-04-25T15:57:40.808 INFO:tasks.workunit.client.1.smithi155.stdout:4/553: readlink da/d30/l6f 0 2024-04-25T15:57:40.809 INFO:tasks.workunit.client.1.smithi155.stdout:4/554: fsync da/d30/f6d 0 2024-04-25T15:57:40.810 INFO:tasks.workunit.client.1.smithi155.stdout:0/510: symlink d1/d3/d12/d83/lb4 0 2024-04-25T15:57:40.811 INFO:tasks.workunit.client.1.smithi155.stdout:9/470: symlink dc/d11/d67/d9c/la3 0 2024-04-25T15:57:40.812 INFO:tasks.workunit.client.1.smithi155.stdout:9/471: truncate dc/d11/f80 6234020 0 2024-04-25T15:57:40.813 INFO:tasks.workunit.client.1.smithi155.stdout:5/532: unlink d0/d47/c93 0 2024-04-25T15:57:40.816 INFO:tasks.workunit.client.1.smithi155.stdout:4/555: mknod da/d23/da2/cc9 0 2024-04-25T15:57:40.817 INFO:tasks.workunit.client.1.smithi155.stdout:9/472: mknod dc/d17/d8e/ca4 0 2024-04-25T15:57:40.819 INFO:tasks.workunit.client.1.smithi155.stdout:0/511: creat d1/d3/fb5 x:0 0 0 2024-04-25T15:57:40.819 INFO:tasks.workunit.client.1.smithi155.stdout:4/556: rmdir da/d23/d3f/d56/d69/d83 39 2024-04-25T15:57:40.821 INFO:tasks.workunit.client.1.smithi155.stdout:5/533: dwrite d0/d27/f4b [4194304,4194304] 0 2024-04-25T15:57:40.822 INFO:tasks.workunit.client.1.smithi155.stdout:9/473: creat dc/d11/d30/d46/da0/fa5 x:0 0 0 2024-04-25T15:57:40.825 INFO:tasks.workunit.client.1.smithi155.stdout:0/512: rmdir d1/d3/d12/d92/d9d/db2 0 2024-04-25T15:57:40.827 INFO:tasks.workunit.client.1.smithi155.stdout:5/534: rename d0/d3/d2c/l5f to d0/d3/d15/d1f/d50/d7c/la6 0 2024-04-25T15:57:40.828 INFO:tasks.workunit.client.1.smithi155.stdout:9/474: getdents dc/d13 0 2024-04-25T15:57:40.830 INFO:tasks.workunit.client.1.smithi155.stdout:6/608: dwrite d0/d13/d43/f64 [0,4194304] 0 2024-04-25T15:57:40.834 INFO:tasks.workunit.client.1.smithi155.stdout:0/513: mkdir d1/d3/d3d/d46/da4/db6 0 2024-04-25T15:57:40.835 INFO:tasks.workunit.client.1.smithi155.stdout:4/557: dwrite da/d23/da2/fae [0,4194304] 0 2024-04-25T15:57:40.835 INFO:tasks.workunit.client.1.smithi155.stdout:0/514: readlink d1/d85/l91 0 2024-04-25T15:57:40.840 INFO:tasks.workunit.client.1.smithi155.stdout:6/609: chown d0/d18/f48 2021 1 2024-04-25T15:57:40.840 INFO:tasks.workunit.client.1.smithi155.stdout:5/535: read d0/d58/d32/f79 [573656,53426] 0 2024-04-25T15:57:40.840 INFO:tasks.workunit.client.1.smithi155.stdout:4/558: rmdir da/d23/da2/dad 39 2024-04-25T15:57:40.843 INFO:tasks.workunit.client.1.smithi155.stdout:6/610: symlink d0/d1a/d21/lc3 0 2024-04-25T15:57:40.845 INFO:tasks.workunit.client.1.smithi155.stdout:0/515: dwrite d1/d6/d29/f96 [0,4194304] 0 2024-04-25T15:57:40.845 INFO:tasks.workunit.client.1.smithi155.stdout:4/559: dread - da/d23/d3f/d56/d69/d83/f7d zero size 2024-04-25T15:57:40.848 INFO:tasks.workunit.client.1.smithi155.stdout:5/536: rename d0/d3/d15/d1f/l6c to d0/d27/la7 0 2024-04-25T15:57:40.849 INFO:tasks.workunit.client.1.smithi155.stdout:6/611: symlink d0/d1a/d25/d2e/d39/lc4 0 2024-04-25T15:57:40.850 INFO:tasks.workunit.client.1.smithi155.stdout:4/560: mkdir da/d23/d3f/d56/dca 0 2024-04-25T15:57:40.851 INFO:tasks.workunit.client.1.smithi155.stdout:0/516: creat d1/d85/d98/fb7 x:0 0 0 2024-04-25T15:57:40.851 INFO:tasks.workunit.client.1.smithi155.stdout:4/561: read da/d23/f3d [3498129,47726] 0 2024-04-25T15:57:40.852 INFO:tasks.workunit.client.1.smithi155.stdout:5/537: symlink d0/d27/la8 0 2024-04-25T15:57:40.853 INFO:tasks.workunit.client.1.smithi155.stdout:6/612: mknod d0/d13/d43/d56/d7b/cc5 0 2024-04-25T15:57:40.855 INFO:tasks.workunit.client.1.smithi155.stdout:6/613: chown d0/d1a/da1/fa7 202 1 2024-04-25T15:57:40.855 INFO:tasks.workunit.client.1.smithi155.stdout:0/517: mknod d1/d6/d16/d6e/cb8 0 2024-04-25T15:57:40.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/538: symlink d0/d27/la9 0 2024-04-25T15:57:40.857 INFO:tasks.workunit.client.1.smithi155.stdout:9/475: dwrite dc/d17/f1b [0,4194304] 0 2024-04-25T15:57:40.860 INFO:tasks.workunit.client.1.smithi155.stdout:0/518: symlink d1/d3/d12/d92/lb9 0 2024-04-25T15:57:40.862 INFO:tasks.workunit.client.1.smithi155.stdout:5/539: creat d0/d47/faa x:0 0 0 2024-04-25T15:57:40.864 INFO:tasks.workunit.client.1.smithi155.stdout:5/540: readlink d0/d3/l76 0 2024-04-25T15:57:40.866 INFO:tasks.workunit.client.1.smithi155.stdout:0/519: rename d1/d3/fb5 to d1/d1a/fba 0 2024-04-25T15:57:40.867 INFO:tasks.workunit.client.1.smithi155.stdout:0/520: readlink d1/d6/d29/l82 0 2024-04-25T15:57:40.868 INFO:tasks.workunit.client.1.smithi155.stdout:5/541: write d0/d27/f98 [4971059,55305] 0 2024-04-25T15:57:40.868 INFO:tasks.workunit.client.1.smithi155.stdout:9/476: dwrite dc/d17/d2a/f8f [0,4194304] 0 2024-04-25T15:57:40.870 INFO:tasks.workunit.client.1.smithi155.stdout:0/521: write d1/d3/d3d/d46/f78 [2210903,129611] 0 2024-04-25T15:57:40.871 INFO:tasks.workunit.client.1.smithi155.stdout:5/542: readlink d0/d27/la8 0 2024-04-25T15:57:40.875 INFO:tasks.workunit.client.1.smithi155.stdout:0/522: stat d1/d3/d12/d83 0 2024-04-25T15:57:40.876 INFO:tasks.workunit.client.1.smithi155.stdout:0/523: readlink d1/d3/d12/d83/l8b 0 2024-04-25T15:57:40.878 INFO:tasks.workunit.client.1.smithi155.stdout:6/614: dread d0/d13/f27 [0,4194304] 0 2024-04-25T15:57:40.878 INFO:tasks.workunit.client.1.smithi155.stdout:0/524: chown d1/d3/d5/d5b/f61 22128 1 2024-04-25T15:57:40.878 INFO:tasks.workunit.client.1.smithi155.stdout:9/477: dwrite dc/d17/f29 [0,4194304] 0 2024-04-25T15:57:40.879 INFO:tasks.workunit.client.1.smithi155.stdout:0/525: chown d1/d6/l81 249982 1 2024-04-25T15:57:40.879 INFO:tasks.workunit.client.1.smithi155.stdout:0/526: readlink d1/d85/l91 0 2024-04-25T15:57:40.883 INFO:tasks.workunit.client.1.smithi155.stdout:0/527: truncate d1/d6/d29/d47/fa5 975968 0 2024-04-25T15:57:40.886 INFO:tasks.workunit.client.1.smithi155.stdout:0/528: symlink d1/d6/d16/d6e/lbb 0 2024-04-25T15:57:40.887 INFO:tasks.workunit.client.1.smithi155.stdout:6/615: link d0/d1a/d25/d2e/l30 d0/d1a/d25/db4/lc6 0 2024-04-25T15:57:40.887 INFO:tasks.workunit.client.1.smithi155.stdout:5/543: read d0/f40 [126029,112850] 0 2024-04-25T15:57:40.888 INFO:tasks.workunit.client.1.smithi155.stdout:6/616: dread - d0/d13/d7c/da9/fbc zero size 2024-04-25T15:57:40.888 INFO:tasks.workunit.client.1.smithi155.stdout:6/617: readlink d0/d18/d63/l9a 0 2024-04-25T15:57:40.889 INFO:tasks.workunit.client.1.smithi155.stdout:6/618: chown d0/d1a/d45/d61/d8e 17706958 1 2024-04-25T15:57:40.889 INFO:tasks.workunit.client.1.smithi155.stdout:0/529: fdatasync d1/d6/d29/d47/fa3 0 2024-04-25T15:57:40.889 INFO:tasks.workunit.client.1.smithi155.stdout:6/619: readlink d0/d18/l8b 0 2024-04-25T15:57:40.890 INFO:tasks.workunit.client.1.smithi155.stdout:9/478: link dc/d17/d18/c1d dc/d17/d18/d56/ca6 0 2024-04-25T15:57:40.892 INFO:tasks.workunit.client.1.smithi155.stdout:7/587: sync 2024-04-25T15:57:40.894 INFO:tasks.workunit.client.1.smithi155.stdout:5/544: creat d0/d58/d63/da0/fab x:0 0 0 2024-04-25T15:57:40.894 INFO:tasks.workunit.client.1.smithi155.stdout:9/479: dread dc/d13/d2e/f37 [0,4194304] 0 2024-04-25T15:57:40.895 INFO:tasks.workunit.client.1.smithi155.stdout:0/530: mknod d1/d3/d3d/d46/da4/cbc 0 2024-04-25T15:57:40.898 INFO:tasks.workunit.client.1.smithi155.stdout:9/480: creat dc/d13/fa7 x:0 0 0 2024-04-25T15:57:40.899 INFO:tasks.workunit.client.1.smithi155.stdout:9/481: fdatasync dc/d13/d2e/f4a 0 2024-04-25T15:57:40.900 INFO:tasks.workunit.client.1.smithi155.stdout:6/620: creat d0/d13/d43/fc7 x:0 0 0 2024-04-25T15:57:40.906 INFO:tasks.workunit.client.1.smithi155.stdout:9/482: symlink dc/d17/d18/la8 0 2024-04-25T15:57:40.906 INFO:tasks.workunit.client.1.smithi155.stdout:6/621: symlink d0/d13/d34/d6c/d9d/lc8 0 2024-04-25T15:57:40.906 INFO:tasks.workunit.client.1.smithi155.stdout:6/622: read d0/d1a/d87/fa3 [3192434,66901] 0 2024-04-25T15:57:40.907 INFO:tasks.workunit.client.1.smithi155.stdout:5/545: link d0/d3/f5a d0/d3/d15/d1f/d50/fac 0 2024-04-25T15:57:40.907 INFO:tasks.workunit.client.1.smithi155.stdout:6/623: dread - d0/fbf zero size 2024-04-25T15:57:40.908 INFO:tasks.workunit.client.1.smithi155.stdout:0/531: getdents d1/d3 0 2024-04-25T15:57:40.911 INFO:tasks.workunit.client.1.smithi155.stdout:6/624: symlink d0/d1a/d21/lc9 0 2024-04-25T15:57:40.912 INFO:tasks.workunit.client.1.smithi155.stdout:7/588: dread d2/dd/d30/d44/fbb [0,4194304] 0 2024-04-25T15:57:40.914 INFO:tasks.workunit.client.1.smithi155.stdout:9/483: dwrite dc/d3c/d9b/f9f [0,4194304] 0 2024-04-25T15:57:40.915 INFO:tasks.workunit.client.1.smithi155.stdout:5/546: rename d0/d3/d15/c52 to d0/d3/d15/cad 0 2024-04-25T15:57:40.916 INFO:tasks.workunit.client.1.smithi155.stdout:5/547: write d0/d47/d59/f9a [410479,52120] 0 2024-04-25T15:57:40.919 INFO:tasks.workunit.client.1.smithi155.stdout:7/589: creat d2/dd/d63/fc0 x:0 0 0 2024-04-25T15:57:40.920 INFO:tasks.workunit.client.1.smithi155.stdout:0/532: getdents d1/d3/d3d/d46 0 2024-04-25T15:57:40.922 INFO:tasks.workunit.client.1.smithi155.stdout:0/533: write d1/d6/d29/fa6 [219304,47890] 0 2024-04-25T15:57:40.924 INFO:tasks.workunit.client.1.smithi155.stdout:5/548: dread d0/d3/d15/d1f/d50/d7c/f83 [0,4194304] 0 2024-04-25T15:57:40.925 INFO:tasks.workunit.client.1.smithi155.stdout:6/625: truncate d0/d1a/d87/fa3 365223 0 2024-04-25T15:57:40.927 INFO:tasks.workunit.client.1.smithi155.stdout:6/626: truncate d0/fbf 940089 0 2024-04-25T15:57:40.928 INFO:tasks.workunit.client.1.smithi155.stdout:0/534: truncate d1/d6/f2f 1036303 0 2024-04-25T15:57:40.928 INFO:tasks.workunit.client.1.smithi155.stdout:0/535: fsync d1/d6/d16/d60/f95 0 2024-04-25T15:57:40.929 INFO:tasks.workunit.client.1.smithi155.stdout:5/549: rename d0/d3/d15/d1f/d50/d7c/la6 to d0/d3/d2c/lae 0 2024-04-25T15:57:40.930 INFO:tasks.workunit.client.1.smithi155.stdout:0/536: chown d1/d3/c57 1919 1 2024-04-25T15:57:40.930 INFO:tasks.workunit.client.1.smithi155.stdout:6/627: symlink d0/d13/d6f/dae/lca 0 2024-04-25T15:57:40.931 INFO:tasks.workunit.client.1.smithi155.stdout:6/628: write d0/f10 [414239,78537] 0 2024-04-25T15:57:40.932 INFO:tasks.workunit.client.1.smithi155.stdout:9/484: fdatasync dc/d3c/d9b/f9f 0 2024-04-25T15:57:40.932 INFO:tasks.workunit.client.1.smithi155.stdout:5/550: rename d0/d27/la7 to d0/d58/d9b/laf 0 2024-04-25T15:57:40.934 INFO:tasks.workunit.client.1.smithi155.stdout:6/629: truncate d0/d1a/d21/f32 5216006 0 2024-04-25T15:57:40.934 INFO:tasks.workunit.client.1.smithi155.stdout:9/485: chown dc/d13/d48/c4f 22083 1 2024-04-25T15:57:40.935 INFO:tasks.workunit.client.1.smithi155.stdout:0/537: rename d1/d3/d3d/d46/da4/cad to d1/d85/d8c/cbd 0 2024-04-25T15:57:40.935 INFO:tasks.workunit.client.1.smithi155.stdout:6/630: write d0/d1a/d37/f4d [2372313,99468] 0 2024-04-25T15:57:40.936 INFO:tasks.workunit.client.1.smithi155.stdout:9/486: mkdir dc/d3c/d9b/da9 0 2024-04-25T15:57:40.937 INFO:tasks.workunit.client.1.smithi155.stdout:5/551: dread d0/d3/d15/f8d [0,4194304] 0 2024-04-25T15:57:40.937 INFO:tasks.workunit.client.1.smithi155.stdout:9/487: chown dc/d17/d18/c25 5191 1 2024-04-25T15:57:40.938 INFO:tasks.workunit.client.1.smithi155.stdout:0/538: symlink d1/lbe 0 2024-04-25T15:57:40.940 INFO:tasks.workunit.client.1.smithi155.stdout:0/539: write d1/d3f/f65 [1084724,71988] 0 2024-04-25T15:57:40.942 INFO:tasks.workunit.client.1.smithi155.stdout:6/631: dread d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:40.948 INFO:tasks.workunit.client.1.smithi155.stdout:5/552: dwrite d0/d58/d63/da0/fab [0,4194304] 0 2024-04-25T15:57:40.949 INFO:tasks.workunit.client.1.smithi155.stdout:0/540: dread d1/f1b [0,4194304] 0 2024-04-25T15:57:40.952 INFO:tasks.workunit.client.1.smithi155.stdout:6/632: dwrite d0/d1a/d45/d61/fa2 [0,4194304] 0 2024-04-25T15:57:40.954 INFO:tasks.workunit.client.1.smithi155.stdout:6/633: write d0/d13/f6a [5446290,9045] 0 2024-04-25T15:57:40.955 INFO:tasks.workunit.client.1.smithi155.stdout:0/541: mknod d1/d3/d12/cbf 0 2024-04-25T15:57:40.957 INFO:tasks.workunit.client.1.smithi155.stdout:6/634: unlink d0/d13/d34/d38/d90/faf 0 2024-04-25T15:57:40.958 INFO:tasks.workunit.client.1.smithi155.stdout:5/553: getdents d0/d58/d9b 0 2024-04-25T15:57:40.960 INFO:tasks.workunit.client.1.smithi155.stdout:0/542: rename d1/d6/f35 to d1/d6/d29/d47/fc0 0 2024-04-25T15:57:40.961 INFO:tasks.workunit.client.1.smithi155.stdout:6/635: creat d0/d1a/d37/fcb x:0 0 0 2024-04-25T15:57:40.962 INFO:tasks.workunit.client.1.smithi155.stdout:6/636: fsync d0/d13/f17 0 2024-04-25T15:57:40.963 INFO:tasks.workunit.client.1.smithi155.stdout:5/554: dread d0/d3/d15/d1f/d50/d7c/f7d [0,4194304] 0 2024-04-25T15:57:40.964 INFO:tasks.workunit.client.1.smithi155.stdout:6/637: mknod d0/d13/d34/d6c/d9d/ccc 0 2024-04-25T15:57:40.964 INFO:tasks.workunit.client.1.smithi155.stdout:5/555: read - d0/d3/d2c/f9e zero size 2024-04-25T15:57:40.965 INFO:tasks.workunit.client.1.smithi155.stdout:0/543: link d1/d6/d16/d6e/c7e d1/d3/d5/da/cc1 0 2024-04-25T15:57:40.966 INFO:tasks.workunit.client.1.smithi155.stdout:5/556: symlink d0/d58/d63/da0/lb0 0 2024-04-25T15:57:40.970 INFO:tasks.workunit.client.1.smithi155.stdout:5/557: symlink d0/d3/d2c/d94/lb1 0 2024-04-25T15:57:40.972 INFO:tasks.workunit.client.1.smithi155.stdout:6/638: dwrite d0/d1a/d21/d73/f5a [0,4194304] 0 2024-04-25T15:57:40.973 INFO:tasks.workunit.client.1.smithi155.stdout:5/558: creat d0/d58/d63/da0/fb2 x:0 0 0 2024-04-25T15:57:40.976 INFO:tasks.workunit.client.1.smithi155.stdout:5/559: mkdir d0/d47/db3 0 2024-04-25T15:57:40.977 INFO:tasks.workunit.client.1.smithi155.stdout:5/560: truncate d0/d58/f56 525769 0 2024-04-25T15:57:40.978 INFO:tasks.workunit.client.1.smithi155.stdout:5/561: stat d0/d47/d59/ca2 0 2024-04-25T15:57:40.978 INFO:tasks.workunit.client.1.smithi155.stdout:6/639: rename d0/d1a/d25/d2e/d39/f4b to d0/d13/d34/d6c/fcd 0 2024-04-25T15:57:40.979 INFO:tasks.workunit.client.1.smithi155.stdout:6/640: readlink d0/d13/d34/d6c/l8a 0 2024-04-25T15:57:40.980 INFO:tasks.workunit.client.1.smithi155.stdout:5/562: mknod d0/d3/d15/d9f/cb4 0 2024-04-25T15:57:40.982 INFO:tasks.workunit.client.1.smithi155.stdout:5/563: write d0/d3/d15/d1f/f70 [98361,11582] 0 2024-04-25T15:57:40.985 INFO:tasks.workunit.client.1.smithi155.stdout:6/641: dread d0/d1a/d45/d61/fa2 [0,4194304] 0 2024-04-25T15:57:40.985 INFO:tasks.workunit.client.1.smithi155.stdout:0/544: dread d1/d41/f44 [0,4194304] 0 2024-04-25T15:57:40.985 INFO:tasks.workunit.client.1.smithi155.stdout:6/642: stat d0/d13/d34/d38/d7a 0 2024-04-25T15:57:40.986 INFO:tasks.workunit.client.1.smithi155.stdout:0/545: chown d1/d6/d16/f88 1624770720 1 2024-04-25T15:57:40.986 INFO:tasks.workunit.client.1.smithi155.stdout:5/564: creat d0/d3/d15/d1f/d50/d7c/fb5 x:0 0 0 2024-04-25T15:57:40.988 INFO:tasks.workunit.client.1.smithi155.stdout:6/643: write d0/d1a/d45/f92 [8993857,26145] 0 2024-04-25T15:57:40.989 INFO:tasks.workunit.client.1.smithi155.stdout:6/644: fdatasync d0/d13/f6a 0 2024-04-25T15:57:40.990 INFO:tasks.workunit.client.1.smithi155.stdout:5/565: rename d0/d58/d32/l66 to d0/d58/d63/lb6 0 2024-04-25T15:57:40.992 INFO:tasks.workunit.client.1.smithi155.stdout:5/566: dread d0/d3/d15/f8d [0,4194304] 0 2024-04-25T15:57:40.992 INFO:tasks.workunit.client.1.smithi155.stdout:6/645: unlink d0/d13/cc1 0 2024-04-25T15:57:40.993 INFO:tasks.workunit.client.1.smithi155.stdout:0/546: dwrite d1/f80 [0,4194304] 0 2024-04-25T15:57:40.994 INFO:tasks.workunit.client.1.smithi155.stdout:0/547: dread - d1/d1a/fba zero size 2024-04-25T15:57:40.997 INFO:tasks.workunit.client.1.smithi155.stdout:6/646: symlink d0/d13/d34/d38/d4c/lce 0 2024-04-25T15:57:40.998 INFO:tasks.workunit.client.1.smithi155.stdout:6/647: chown d0/d13/d43/d56/d7b/f85 8707 1 2024-04-25T15:57:40.998 INFO:tasks.workunit.client.1.smithi155.stdout:0/548: rmdir d1/d85/d98 39 2024-04-25T15:57:40.999 INFO:tasks.workunit.client.1.smithi155.stdout:6/648: truncate d0/d1a/d37/fcb 237172 0 2024-04-25T15:57:40.999 INFO:tasks.workunit.client.1.smithi155.stdout:5/567: mknod d0/d3/d15/d9f/cb7 0 2024-04-25T15:57:41.000 INFO:tasks.workunit.client.1.smithi155.stdout:5/568: chown d0/d3/d15/fe 776402 1 2024-04-25T15:57:41.001 INFO:tasks.workunit.client.1.smithi155.stdout:0/549: symlink d1/d3/d6a/lc2 0 2024-04-25T15:57:41.002 INFO:tasks.workunit.client.1.smithi155.stdout:6/649: creat d0/d18/fcf x:0 0 0 2024-04-25T15:57:41.003 INFO:tasks.workunit.client.1.smithi155.stdout:5/569: mknod d0/d58/d32/cb8 0 2024-04-25T15:57:41.004 INFO:tasks.workunit.client.1.smithi155.stdout:6/650: mknod d0/d1a/da1/dac/cd0 0 2024-04-25T15:57:41.005 INFO:tasks.workunit.client.1.smithi155.stdout:0/550: creat d1/d85/d98/fc3 x:0 0 0 2024-04-25T15:57:41.006 INFO:tasks.workunit.client.1.smithi155.stdout:6/651: mkdir d0/d13/dd1 0 2024-04-25T15:57:41.007 INFO:tasks.workunit.client.1.smithi155.stdout:0/551: write d1/d3/d12/f84 [336242,123391] 0 2024-04-25T15:57:41.009 INFO:tasks.workunit.client.1.smithi155.stdout:5/570: getdents d0/d3/d15/d30 0 2024-04-25T15:57:41.009 INFO:tasks.workunit.client.1.smithi155.stdout:0/552: dread - d1/d85/d98/fc3 zero size 2024-04-25T15:57:41.009 INFO:tasks.workunit.client.1.smithi155.stdout:6/652: write d0/d1a/d25/d51/f84 [1390747,127733] 0 2024-04-25T15:57:41.010 INFO:tasks.workunit.client.1.smithi155.stdout:5/571: write d0/d3/d15/fe [2677847,127687] 0 2024-04-25T15:57:41.011 INFO:tasks.workunit.client.1.smithi155.stdout:0/553: dread - d1/d3/d3d/d46/da4/faf zero size 2024-04-25T15:57:41.012 INFO:tasks.workunit.client.1.smithi155.stdout:6/653: truncate d0/d1a/d25/d2e/f31 4911038 0 2024-04-25T15:57:41.014 INFO:tasks.workunit.client.1.smithi155.stdout:0/554: truncate d1/d6/d16/d6e/fab 126411 0 2024-04-25T15:57:41.015 INFO:tasks.workunit.client.1.smithi155.stdout:5/572: truncate d0/d3/d15/d1f/d50/d7c/fb5 602641 0 2024-04-25T15:57:41.016 INFO:tasks.workunit.client.1.smithi155.stdout:0/555: dread - d1/d85/d98/fc3 zero size 2024-04-25T15:57:41.025 INFO:tasks.workunit.client.1.smithi155.stdout:5/573: dwrite d0/f40 [0,4194304] 0 2024-04-25T15:57:41.025 INFO:tasks.workunit.client.1.smithi155.stdout:0/556: dwrite d1/d3/d6a/f73 [0,4194304] 0 2024-04-25T15:57:41.029 INFO:tasks.workunit.client.1.smithi155.stdout:6/654: dread d0/d1a/f6b [0,4194304] 0 2024-04-25T15:57:41.031 INFO:tasks.workunit.client.1.smithi155.stdout:0/557: rename d1/d6/d16 to d1/d3/d5/d5b/dc4 0 2024-04-25T15:57:41.033 INFO:tasks.workunit.client.1.smithi155.stdout:6/655: mknod d0/d13/cd2 0 2024-04-25T15:57:41.033 INFO:tasks.workunit.client.1.smithi155.stdout:0/558: dread - d1/d3/d5/d5b/dc4/f8d zero size 2024-04-25T15:57:41.034 INFO:tasks.workunit.client.1.smithi155.stdout:3/591: sync 2024-04-25T15:57:41.035 INFO:tasks.workunit.client.1.smithi155.stdout:6/656: write d0/d1a/da1/dac/fb3 [76800,20062] 0 2024-04-25T15:57:41.037 INFO:tasks.workunit.client.1.smithi155.stdout:5/574: dwrite d0/d3/d15/d1f/d50/d7c/f7d [0,4194304] 0 2024-04-25T15:57:41.038 INFO:tasks.workunit.client.1.smithi155.stdout:3/592: mknod d1/d4/cc8 0 2024-04-25T15:57:41.040 INFO:tasks.workunit.client.1.smithi155.stdout:3/593: chown d1/d4/d10/d21/d73/f82 10061187 1 2024-04-25T15:57:41.042 INFO:tasks.workunit.client.1.smithi155.stdout:6/657: rename d0/d18/cb7 to d0/d1a/cd3 0 2024-04-25T15:57:41.043 INFO:tasks.workunit.client.1.smithi155.stdout:3/594: write d1/d4/d10/f43 [65946,121008] 0 2024-04-25T15:57:41.046 INFO:tasks.workunit.client.1.smithi155.stdout:5/575: creat d0/d58/d32/d6a/fb9 x:0 0 0 2024-04-25T15:57:41.046 INFO:tasks.workunit.client.1.smithi155.stdout:0/559: dwrite d1/d3/d6a/f73 [4194304,4194304] 0 2024-04-25T15:57:41.047 INFO:tasks.workunit.client.1.smithi155.stdout:6/658: write d0/d1a/d45/d61/fa2 [2693195,43119] 0 2024-04-25T15:57:41.048 INFO:tasks.workunit.client.1.smithi155.stdout:3/595: dread - d1/d4/d10/d21/d73/d77/d57/d7c/f83 zero size 2024-04-25T15:57:41.049 INFO:tasks.workunit.client.1.smithi155.stdout:5/576: read d0/d3/d2c/f2f [4663605,91881] 0 2024-04-25T15:57:41.053 INFO:tasks.workunit.client.1.smithi155.stdout:6/659: rename d0/d1a/d37/f4d to d0/d1a/d87/fd4 0 2024-04-25T15:57:41.053 INFO:tasks.workunit.client.1.smithi155.stdout:5/577: dread d0/d3/d15/d1f/d50/d7c/fb5 [0,4194304] 0 2024-04-25T15:57:41.054 INFO:tasks.workunit.client.1.smithi155.stdout:3/596: truncate d1/d4/db/d20/d44/d52/d93/da6/fb4 4449212 0 2024-04-25T15:57:41.054 INFO:tasks.workunit.client.1.smithi155.stdout:6/660: fsync d0/d13/d6f/f8f 0 2024-04-25T15:57:41.055 INFO:tasks.workunit.client.1.smithi155.stdout:5/578: fsync d0/d47/d59/f9a 0 2024-04-25T15:57:41.056 INFO:tasks.workunit.client.1.smithi155.stdout:6/661: readlink d0/d1a/d25/d51/l41 0 2024-04-25T15:57:41.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/597: rmdir d1 39 2024-04-25T15:57:41.057 INFO:tasks.workunit.client.1.smithi155.stdout:6/662: mknod d0/d18/cd5 0 2024-04-25T15:57:41.059 INFO:tasks.workunit.client.1.smithi155.stdout:3/598: dread - d1/d4/db/d20/d44/d52/fad zero size 2024-04-25T15:57:41.060 INFO:tasks.workunit.client.1.smithi155.stdout:6/663: truncate d0/d18/f48 5731578 0 2024-04-25T15:57:41.060 INFO:tasks.workunit.client.1.smithi155.stdout:5/579: dread d0/d3/d2c/f2f [0,4194304] 0 2024-04-25T15:57:41.061 INFO:tasks.workunit.client.1.smithi155.stdout:3/599: chown d1/d4/db/d20/d44/d52/d61/d89/f8c 454 1 2024-04-25T15:57:41.061 INFO:tasks.workunit.client.1.smithi155.stdout:0/560: dread d1/d1a/f34 [4194304,4194304] 0 2024-04-25T15:57:41.061 INFO:tasks.workunit.client.1.smithi155.stdout:6/664: chown d0/d1a/d25/d51/l41 620 1 2024-04-25T15:57:41.062 INFO:tasks.workunit.client.1.smithi155.stdout:3/600: stat d1/d4/db/d91/lba 0 2024-04-25T15:57:41.062 INFO:tasks.workunit.client.1.smithi155.stdout:5/580: creat d0/d47/db3/fba x:0 0 0 2024-04-25T15:57:41.064 INFO:tasks.workunit.client.1.smithi155.stdout:0/561: getdents d1/d85 0 2024-04-25T15:57:41.065 INFO:tasks.workunit.client.1.smithi155.stdout:3/601: mkdir d1/d4/db/d91/dc9 0 2024-04-25T15:57:41.066 INFO:tasks.workunit.client.1.smithi155.stdout:6/665: dread d0/f46 [0,4194304] 0 2024-04-25T15:57:41.066 INFO:tasks.workunit.client.1.smithi155.stdout:3/602: chown d1/d4 3780 1 2024-04-25T15:57:41.066 INFO:tasks.workunit.client.1.smithi155.stdout:0/562: symlink d1/d3/d12/d83/lc5 0 2024-04-25T15:57:41.066 INFO:tasks.workunit.client.1.smithi155.stdout:6/666: stat d0/d1a/d25/d51/fb0 0 2024-04-25T15:57:41.067 INFO:tasks.workunit.client.1.smithi155.stdout:0/563: readlink d1/lbe 0 2024-04-25T15:57:41.068 INFO:tasks.workunit.client.1.smithi155.stdout:3/603: symlink d1/d4/db/d20/d44/d52/d61/d89/lca 0 2024-04-25T15:57:41.069 INFO:tasks.workunit.client.1.smithi155.stdout:6/667: creat d0/d13/dd1/fd6 x:0 0 0 2024-04-25T15:57:41.070 INFO:tasks.workunit.client.1.smithi155.stdout:3/604: chown d1/d4/d10/f43 25184 1 2024-04-25T15:57:41.070 INFO:tasks.workunit.client.1.smithi155.stdout:0/564: write d1/d3/d5/faa [1223874,30111] 0 2024-04-25T15:57:41.074 INFO:tasks.workunit.client.1.smithi155.stdout:5/581: dwrite d0/d3/d15/f8d [0,4194304] 0 2024-04-25T15:57:41.080 INFO:tasks.workunit.client.1.smithi155.stdout:3/605: getdents d1/d4/d10/d21/d73/d77/d5f 0 2024-04-25T15:57:41.082 INFO:tasks.workunit.client.1.smithi155.stdout:6/668: dwrite d0/f46 [0,4194304] 0 2024-04-25T15:57:41.082 INFO:tasks.workunit.client.1.smithi155.stdout:5/582: dread d0/d47/d59/f9a [0,4194304] 0 2024-04-25T15:57:41.082 INFO:tasks.workunit.client.1.smithi155.stdout:6/669: stat d0/d18/l8b 0 2024-04-25T15:57:41.085 INFO:tasks.workunit.client.1.smithi155.stdout:5/583: rmdir d0/d3/d15/d30/d4f 39 2024-04-25T15:57:41.086 INFO:tasks.workunit.client.1.smithi155.stdout:6/670: mkdir d0/d13/d7c/dd7 0 2024-04-25T15:57:41.086 INFO:tasks.workunit.client.1.smithi155.stdout:5/584: write d0/d47/db3/fba [621566,121028] 0 2024-04-25T15:57:41.087 INFO:tasks.workunit.client.1.smithi155.stdout:3/606: link d1/d4/db/f55 d1/d4/d6a/fcb 0 2024-04-25T15:57:41.091 INFO:tasks.workunit.client.1.smithi155.stdout:3/607: unlink d1/d4/db/d28/d58/c9f 0 2024-04-25T15:57:41.091 INFO:tasks.workunit.client.1.smithi155.stdout:5/585: readlink d0/d58/d63/l67 0 2024-04-25T15:57:41.097 INFO:tasks.workunit.client.1.smithi155.stdout:3/608: write d1/d4/db/d20/d44/f48 [2397459,69388] 0 2024-04-25T15:57:41.099 INFO:tasks.workunit.client.1.smithi155.stdout:5/586: creat d0/d3/d2c/fbb x:0 0 0 2024-04-25T15:57:41.100 INFO:tasks.workunit.client.1.smithi155.stdout:3/609: chown d1/d4/d10/d21/d73/d77/d5f/fae 2 1 2024-04-25T15:57:41.100 INFO:tasks.workunit.client.1.smithi155.stdout:6/671: dwrite d0/d1a/d45/d61/fa2 [0,4194304] 0 2024-04-25T15:57:41.101 INFO:tasks.workunit.client.1.smithi155.stdout:0/565: dread d1/d3/f17 [0,4194304] 0 2024-04-25T15:57:41.101 INFO:tasks.workunit.client.1.smithi155.stdout:5/587: mknod d0/d47/cbc 0 2024-04-25T15:57:41.103 INFO:tasks.workunit.client.1.smithi155.stdout:0/566: chown d1/d3/d5/d5b/dc4/d6e 0 1 2024-04-25T15:57:41.103 INFO:tasks.workunit.client.1.smithi155.stdout:6/672: creat d0/d13/d34/d38/d7a/fd8 x:0 0 0 2024-04-25T15:57:41.103 INFO:tasks.workunit.client.1.smithi155.stdout:0/567: chown d1/d3/d5/da/l76 2380015 1 2024-04-25T15:57:41.105 INFO:tasks.workunit.client.1.smithi155.stdout:3/610: symlink d1/d4/d10/d21/d73/d77/d57/lcc 0 2024-04-25T15:57:41.110 INFO:tasks.workunit.client.1.smithi155.stdout:6/673: creat d0/d18/d63/fd9 x:0 0 0 2024-04-25T15:57:41.110 INFO:tasks.workunit.client.1.smithi155.stdout:5/588: rename d0/d58/d32/l9d to d0/d3/d15/d1f/d50/d60/lbd 0 2024-04-25T15:57:41.111 INFO:tasks.workunit.client.1.smithi155.stdout:5/589: unlink d0/f40 0 2024-04-25T15:57:41.113 INFO:tasks.workunit.client.1.smithi155.stdout:3/611: rename d1/f26 to d1/d4/d10/d21/d73/d8d/fcd 0 2024-04-25T15:57:41.114 INFO:tasks.workunit.client.1.smithi155.stdout:5/590: creat d0/d58/d63/da0/fbe x:0 0 0 2024-04-25T15:57:41.115 INFO:tasks.workunit.client.1.smithi155.stdout:6/674: dwrite d0/d1a/d25/d2e/f31 [0,4194304] 0 2024-04-25T15:57:41.115 INFO:tasks.workunit.client.1.smithi155.stdout:5/591: stat d0/d27/la9 0 2024-04-25T15:57:41.117 INFO:tasks.workunit.client.1.smithi155.stdout:3/612: creat d1/d4/d10/d21/d73/d77/d57/d7c/fce x:0 0 0 2024-04-25T15:57:41.119 INFO:tasks.workunit.client.1.smithi155.stdout:3/613: truncate d1/d4/db/d91/f97 4567134 0 2024-04-25T15:57:41.121 INFO:tasks.workunit.client.1.smithi155.stdout:6/675: getdents d0/d18 0 2024-04-25T15:57:41.125 INFO:tasks.workunit.client.1.smithi155.stdout:5/592: dwrite d0/d3/d15/d1f/fa3 [0,4194304] 0 2024-04-25T15:57:41.127 INFO:tasks.workunit.client.1.smithi155.stdout:3/614: mkdir d1/d4/d10/d21/d73/d77/d57/dcf 0 2024-04-25T15:57:41.128 INFO:tasks.workunit.client.1.smithi155.stdout:0/568: truncate d1/d3/d5/d5b/dc4/d60/f6d 22934 0 2024-04-25T15:57:41.130 INFO:tasks.workunit.client.1.smithi155.stdout:5/593: truncate d0/d3/d15/d1f/d50/d7c/fb5 1425031 0 2024-04-25T15:57:41.136 INFO:tasks.workunit.client.1.smithi155.stdout:6/676: write d0/d18/f48 [6492797,32041] 0 2024-04-25T15:57:41.137 INFO:tasks.workunit.client.1.smithi155.stdout:5/594: creat d0/d3/d15/d1f/fbf x:0 0 0 2024-04-25T15:57:41.142 INFO:tasks.workunit.client.1.smithi155.stdout:5/595: creat d0/d58/d9b/fc0 x:0 0 0 2024-04-25T15:57:41.143 INFO:tasks.workunit.client.1.smithi155.stdout:6/677: dwrite d0/d1a/d45/d61/fa2 [0,4194304] 0 2024-04-25T15:57:41.146 INFO:tasks.workunit.client.1.smithi155.stdout:5/596: mknod d0/d27/cc1 0 2024-04-25T15:57:41.147 INFO:tasks.workunit.client.1.smithi155.stdout:0/569: write d1/d3/d5/d5b/dc4/d60/f6d [968987,102519] 0 2024-04-25T15:57:41.148 INFO:tasks.workunit.client.1.smithi155.stdout:6/678: read d0/d1a/d87/fa3 [75882,106094] 0 2024-04-25T15:57:41.149 INFO:tasks.workunit.client.1.smithi155.stdout:6/679: fsync d0/d13/d34/d38/d7a/fd8 0 2024-04-25T15:57:41.151 INFO:tasks.workunit.client.1.smithi155.stdout:5/597: creat d0/d3/d15/d30/d4f/fc2 x:0 0 0 2024-04-25T15:57:41.152 INFO:tasks.workunit.client.1.smithi155.stdout:0/570: getdents d1/d85 0 2024-04-25T15:57:41.154 INFO:tasks.workunit.client.1.smithi155.stdout:5/598: mkdir d0/d3/d15/d9f/dc3 0 2024-04-25T15:57:41.155 INFO:tasks.workunit.client.1.smithi155.stdout:0/571: write d1/d3/d12/f3b [3925685,93047] 0 2024-04-25T15:57:41.157 INFO:tasks.workunit.client.1.smithi155.stdout:5/599: creat d0/d3/d15/d1f/d50/d7c/fc4 x:0 0 0 2024-04-25T15:57:41.161 INFO:tasks.workunit.client.1.smithi155.stdout:5/600: link d0/d3/f5c d0/d47/d59/fc5 0 2024-04-25T15:57:41.162 INFO:tasks.workunit.client.1.smithi155.stdout:0/572: link d1/d3/d5/da/l97 d1/d3/d5/lc6 0 2024-04-25T15:57:41.166 INFO:tasks.workunit.client.1.smithi155.stdout:0/573: dread d1/d3/f17 [0,4194304] 0 2024-04-25T15:57:41.168 INFO:tasks.workunit.client.1.smithi155.stdout:8/376: sync 2024-04-25T15:57:41.168 INFO:tasks.workunit.client.1.smithi155.stdout:1/569: sync 2024-04-25T15:57:41.168 INFO:tasks.workunit.client.1.smithi155.stdout:6/680: dread d0/d1a/d25/d2e/d39/f86 [0,4194304] 0 2024-04-25T15:57:41.170 INFO:tasks.workunit.client.1.smithi155.stdout:8/377: chown d2/d15/d18/d34/d48/d4e 995807 1 2024-04-25T15:57:41.170 INFO:tasks.workunit.client.1.smithi155.stdout:5/601: dwrite d0/d3/d15/d1f/d50/d60/f65 [0,4194304] 0 2024-04-25T15:57:41.170 INFO:tasks.workunit.client.1.smithi155.stdout:8/378: stat d2/c3 0 2024-04-25T15:57:41.172 INFO:tasks.workunit.client.1.smithi155.stdout:6/681: write d0/d13/d34/d38/d7a/fd8 [813976,44644] 0 2024-04-25T15:57:41.178 INFO:tasks.workunit.client.1.smithi155.stdout:0/574: dwrite d1/d6/d29/f96 [4194304,4194304] 0 2024-04-25T15:57:41.181 INFO:tasks.workunit.client.1.smithi155.stdout:1/570: truncate d1/d6/f14 195804 0 2024-04-25T15:57:41.181 INFO:tasks.workunit.client.1.smithi155.stdout:0/575: dread - d1/d3/d5/d5b/dc4/f8d zero size 2024-04-25T15:57:41.183 INFO:tasks.workunit.client.1.smithi155.stdout:5/602: dread d0/d3/d15/d1f/d50/d7c/f7d [0,4194304] 0 2024-04-25T15:57:41.184 INFO:tasks.workunit.client.1.smithi155.stdout:8/379: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:41.184 INFO:tasks.workunit.client.1.smithi155.stdout:0/576: stat d1/d6/d29/f3a 0 2024-04-25T15:57:41.189 INFO:tasks.workunit.client.1.smithi155.stdout:8/380: symlink d2/d41/d5d/l72 0 2024-04-25T15:57:41.191 INFO:tasks.workunit.client.1.smithi155.stdout:6/682: dwrite d0/d1a/d21/d73/f5a [0,4194304] 0 2024-04-25T15:57:41.196 INFO:tasks.workunit.client.1.smithi155.stdout:6/683: readlink d0/d13/d34/d38/d4c/l94 0 2024-04-25T15:57:41.196 INFO:tasks.workunit.client.1.smithi155.stdout:0/577: dwrite d1/d41/f93 [0,4194304] 0 2024-04-25T15:57:41.204 INFO:tasks.workunit.client.1.smithi155.stdout:6/684: dwrite d0/fbf [0,4194304] 0 2024-04-25T15:57:41.205 INFO:tasks.workunit.client.1.smithi155.stdout:8/381: truncate d2/d15/d18/d23/d2d/f39 1148010 0 2024-04-25T15:57:41.206 INFO:tasks.workunit.client.1.smithi155.stdout:0/578: truncate d1/d3/d5/d5b/dc4/d60/f6d 690909 0 2024-04-25T15:57:41.207 INFO:tasks.workunit.client.1.smithi155.stdout:1/571: dread d1/d6/f14 [0,4194304] 0 2024-04-25T15:57:41.208 INFO:tasks.workunit.client.1.smithi155.stdout:8/382: creat d2/d15/d18/d34/d48/d59/f73 x:0 0 0 2024-04-25T15:57:41.211 INFO:tasks.workunit.client.1.smithi155.stdout:0/579: symlink d1/d3/d3d/d46/da4/lc7 0 2024-04-25T15:57:41.214 INFO:tasks.workunit.client.1.smithi155.stdout:0/580: mknod d1/d85/d8c/cc8 0 2024-04-25T15:57:41.215 INFO:tasks.workunit.client.1.smithi155.stdout:6/685: dwrite d0/f9b [0,4194304] 0 2024-04-25T15:57:41.217 INFO:tasks.workunit.client.1.smithi155.stdout:8/383: link d2/l6 d2/d15/d18/d34/d48/l74 0 2024-04-25T15:57:41.218 INFO:tasks.workunit.client.1.smithi155.stdout:1/572: dwrite d1/d16/d1d/d29/d3d/d43/d88/f94 [0,4194304] 0 2024-04-25T15:57:41.219 INFO:tasks.workunit.client.1.smithi155.stdout:6/686: rename d0/d18/d63 to d0/d1a/d37/dda 0 2024-04-25T15:57:41.220 INFO:tasks.workunit.client.1.smithi155.stdout:6/687: chown d0/d13/d7c/dd7 2 1 2024-04-25T15:57:41.222 INFO:tasks.workunit.client.1.smithi155.stdout:1/573: unlink d1/d16/d1d/d29/l76 0 2024-04-25T15:57:41.225 INFO:tasks.workunit.client.1.smithi155.stdout:6/688: creat d0/d13/d7c/fdb x:0 0 0 2024-04-25T15:57:41.226 INFO:tasks.workunit.client.1.smithi155.stdout:1/574: write d1/d16/d1d/d29/d3d/d43/d88/f94 [3501410,52640] 0 2024-04-25T15:57:41.228 INFO:tasks.workunit.client.1.smithi155.stdout:1/575: fdatasync d1/d16/d1d/d29/d5f/d34/d68/d93/fa9 0 2024-04-25T15:57:41.229 INFO:tasks.workunit.client.1.smithi155.stdout:6/689: unlink d0/d13/f27 0 2024-04-25T15:57:41.229 INFO:tasks.workunit.client.1.smithi155.stdout:1/576: write d1/d16/d1d/f99 [21789,28767] 0 2024-04-25T15:57:41.230 INFO:tasks.workunit.client.1.smithi155.stdout:1/577: fdatasync d1/d16/d1d/d29/d3d/d43/f48 0 2024-04-25T15:57:41.232 INFO:tasks.workunit.client.1.smithi155.stdout:6/690: mknod d0/d1a/da1/cdc 0 2024-04-25T15:57:41.232 INFO:tasks.workunit.client.1.smithi155.stdout:6/691: write d0/f46 [1246142,37965] 0 2024-04-25T15:57:41.237 INFO:tasks.workunit.client.1.smithi155.stdout:6/692: mkdir d0/d18/ddd 0 2024-04-25T15:57:41.239 INFO:tasks.workunit.client.1.smithi155.stdout:6/693: read d0/d1a/d25/d2e/f31 [3801762,125541] 0 2024-04-25T15:57:41.239 INFO:tasks.workunit.client.1.smithi155.stdout:1/578: dwrite d1/f61 [0,4194304] 0 2024-04-25T15:57:41.244 INFO:tasks.workunit.client.1.smithi155.stdout:1/579: creat d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fba x:0 0 0 2024-04-25T15:57:41.248 INFO:tasks.workunit.client.1.smithi155.stdout:6/694: mknod d0/d13/d7c/dd7/cde 0 2024-04-25T15:57:41.252 INFO:tasks.workunit.client.1.smithi155.stdout:8/384: dread d2/d15/d35/f57 [0,4194304] 0 2024-04-25T15:57:41.253 INFO:tasks.workunit.client.1.smithi155.stdout:1/580: dwrite d1/d32/d86/fa8 [0,4194304] 0 2024-04-25T15:57:41.255 INFO:tasks.workunit.client.1.smithi155.stdout:6/695: creat d0/d1a/fdf x:0 0 0 2024-04-25T15:57:41.257 INFO:tasks.workunit.client.1.smithi155.stdout:8/385: symlink d2/d15/d35/d3d/l75 0 2024-04-25T15:57:41.257 INFO:tasks.workunit.client.1.smithi155.stdout:6/696: truncate d0/d13/d43/d56/d7b/f85 1219280 0 2024-04-25T15:57:41.258 INFO:tasks.workunit.client.1.smithi155.stdout:1/581: write d1/d6/f6b [3573763,21774] 0 2024-04-25T15:57:41.258 INFO:tasks.workunit.client.1.smithi155.stdout:6/697: dread - d0/d13/d34/d38/d7a/fa6 zero size 2024-04-25T15:57:41.259 INFO:tasks.workunit.client.1.smithi155.stdout:6/698: truncate d0/d13/d6f/f8f 862199 0 2024-04-25T15:57:41.260 INFO:tasks.workunit.client.1.smithi155.stdout:1/582: creat d1/d32/fbb x:0 0 0 2024-04-25T15:57:41.262 INFO:tasks.workunit.client.1.smithi155.stdout:1/583: chown d1/c9e 35137 1 2024-04-25T15:57:41.263 INFO:tasks.workunit.client.1.smithi155.stdout:1/584: mknod d1/d16/d1d/d29/d3d/cbc 0 2024-04-25T15:57:41.265 INFO:tasks.workunit.client.1.smithi155.stdout:1/585: creat d1/d16/d1d/d29/d3d/fbd x:0 0 0 2024-04-25T15:57:41.268 INFO:tasks.workunit.client.1.smithi155.stdout:6/699: truncate d0/d1a/d45/f52 2906435 0 2024-04-25T15:57:41.268 INFO:tasks.workunit.client.1.smithi155.stdout:1/586: mknod d1/d16/d1d/d29/d5f/d34/d9c/cbe 0 2024-04-25T15:57:41.270 INFO:tasks.workunit.client.1.smithi155.stdout:6/700: unlink d0/d13/d7c/fdb 0 2024-04-25T15:57:41.271 INFO:tasks.workunit.client.1.smithi155.stdout:1/587: creat d1/d16/d1d/d29/d5f/d34/d68/fbf x:0 0 0 2024-04-25T15:57:41.272 INFO:tasks.workunit.client.1.smithi155.stdout:6/701: symlink d0/d13/d7c/le0 0 2024-04-25T15:57:41.274 INFO:tasks.workunit.client.1.smithi155.stdout:6/702: mkdir d0/d13/d43/de1 0 2024-04-25T15:57:41.280 INFO:tasks.workunit.client.1.smithi155.stdout:6/703: fsync d0/d1a/d45/f52 0 2024-04-25T15:57:41.280 INFO:tasks.workunit.client.1.smithi155.stdout:1/588: dwrite d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fba [0,4194304] 0 2024-04-25T15:57:41.284 INFO:tasks.workunit.client.1.smithi155.stdout:6/704: getdents d0/d13/d34/d6c/d9d/db8 0 2024-04-25T15:57:41.287 INFO:tasks.workunit.client.1.smithi155.stdout:6/705: creat d0/d13/d6f/fe2 x:0 0 0 2024-04-25T15:57:41.290 INFO:tasks.workunit.client.1.smithi155.stdout:1/589: dwrite d1/d16/d1d/f65 [0,4194304] 0 2024-04-25T15:57:41.299 INFO:tasks.workunit.client.1.smithi155.stdout:6/706: dwrite d0/d1a/d45/f52 [0,4194304] 0 2024-04-25T15:57:41.301 INFO:tasks.workunit.client.1.smithi155.stdout:1/590: dwrite d1/d6/f6b [0,4194304] 0 2024-04-25T15:57:41.306 INFO:tasks.workunit.client.1.smithi155.stdout:9/488: sync 2024-04-25T15:57:41.306 INFO:tasks.workunit.client.1.smithi155.stdout:2/594: sync 2024-04-25T15:57:41.306 INFO:tasks.workunit.client.1.smithi155.stdout:7/590: sync 2024-04-25T15:57:41.306 INFO:tasks.workunit.client.1.smithi155.stdout:4/562: sync 2024-04-25T15:57:41.307 INFO:tasks.workunit.client.1.smithi155.stdout:1/591: fdatasync d1/d16/d1d/d29/d3d/d43/f62 0 2024-04-25T15:57:41.308 INFO:tasks.workunit.client.1.smithi155.stdout:9/489: fsync dc/d17/f2b 0 2024-04-25T15:57:41.311 INFO:tasks.workunit.client.1.smithi155.stdout:2/595: mkdir d7/db/d29/d83/dbe 0 2024-04-25T15:57:41.313 INFO:tasks.workunit.client.1.smithi155.stdout:7/591: fdatasync d2/dd/d66/d8c/f90 0 2024-04-25T15:57:41.313 INFO:tasks.workunit.client.1.smithi155.stdout:7/592: chown d2/l4 3239 1 2024-04-25T15:57:41.314 INFO:tasks.workunit.client.1.smithi155.stdout:1/592: mknod d1/d16/d1d/d29/d5f/d34/d68/cc0 0 2024-04-25T15:57:41.318 INFO:tasks.workunit.client.1.smithi155.stdout:2/596: dread d7/db/d29/d83/d86/d8b/fa8 [0,4194304] 0 2024-04-25T15:57:41.320 INFO:tasks.workunit.client.1.smithi155.stdout:1/593: unlink d1/d6/c3c 0 2024-04-25T15:57:41.321 INFO:tasks.workunit.client.1.smithi155.stdout:2/597: mkdir d7/db/d29/d83/d86/d8b/dbf 0 2024-04-25T15:57:41.323 INFO:tasks.workunit.client.1.smithi155.stdout:7/593: rename d2/dd/d66/d71/c93 to d2/dd/d36/cc1 0 2024-04-25T15:57:41.325 INFO:tasks.workunit.client.1.smithi155.stdout:1/594: rename d1/d16/d1d/d29/d3d/l8b to d1/d16/d1d/d29/d3d/lc1 0 2024-04-25T15:57:41.328 INFO:tasks.workunit.client.1.smithi155.stdout:1/595: write d1/f15 [1183620,799] 0 2024-04-25T15:57:41.330 INFO:tasks.workunit.client.1.smithi155.stdout:7/594: getdents d2/dd/d63 0 2024-04-25T15:57:41.330 INFO:tasks.workunit.client.1.smithi155.stdout:6/707: dread d0/d13/f17 [0,4194304] 0 2024-04-25T15:57:41.332 INFO:tasks.workunit.client.1.smithi155.stdout:1/596: mkdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2 0 2024-04-25T15:57:41.335 INFO:tasks.workunit.client.1.smithi155.stdout:7/595: rename d2/dd/d30/ca4 to d2/dd/d13/cc2 0 2024-04-25T15:57:41.337 INFO:tasks.workunit.client.1.smithi155.stdout:9/490: dread dc/d17/d2a/f2c [0,4194304] 0 2024-04-25T15:57:41.337 INFO:tasks.workunit.client.1.smithi155.stdout:1/597: unlink d1/d16/d1d/d29/d5f/lb5 0 2024-04-25T15:57:41.338 INFO:tasks.workunit.client.1.smithi155.stdout:2/598: write f3 [3938241,3468] 0 2024-04-25T15:57:41.339 INFO:tasks.workunit.client.1.smithi155.stdout:1/598: chown d1/d16/d1d/d29/l6f 486 1 2024-04-25T15:57:41.340 INFO:tasks.workunit.client.1.smithi155.stdout:2/599: dread - d7/db/d2e/d44/d9e/fa5 zero size 2024-04-25T15:57:41.340 INFO:tasks.workunit.client.1.smithi155.stdout:9/491: creat dc/d17/d18/d72/faa x:0 0 0 2024-04-25T15:57:41.341 INFO:tasks.workunit.client.1.smithi155.stdout:6/708: creat d0/d13/d43/fe3 x:0 0 0 2024-04-25T15:57:41.342 INFO:tasks.workunit.client.1.smithi155.stdout:2/600: write d7/db/d2e/d6f/fb2 [785968,50487] 0 2024-04-25T15:57:41.345 INFO:tasks.workunit.client.1.smithi155.stdout:7/596: write d2/dd/d36/f73 [2815097,118604] 0 2024-04-25T15:57:41.345 INFO:tasks.workunit.client.1.smithi155.stdout:1/599: symlink d1/d16/d1d/d5e/lc3 0 2024-04-25T15:57:41.346 INFO:tasks.workunit.client.1.smithi155.stdout:2/601: rename d7/db to d7/db/dc0 22 2024-04-25T15:57:41.346 INFO:tasks.workunit.client.1.smithi155.stdout:7/597: chown d2/dd/d63 572 1 2024-04-25T15:57:41.349 INFO:tasks.workunit.client.1.smithi155.stdout:1/600: mknod d1/d32/d77/cc4 0 2024-04-25T15:57:41.350 INFO:tasks.workunit.client.1.smithi155.stdout:7/598: chown d2/dd/d30/d44/d7f/l88 2 1 2024-04-25T15:57:41.351 INFO:tasks.workunit.client.1.smithi155.stdout:6/709: dwrite d0/d1a/d21/d73/faa [0,4194304] 0 2024-04-25T15:57:41.351 INFO:tasks.workunit.client.1.smithi155.stdout:9/492: dwrite dc/d13/d48/f88 [0,4194304] 0 2024-04-25T15:57:41.355 INFO:tasks.workunit.client.1.smithi155.stdout:2/602: link d7/db/d2e/d6f/f80 d7/d8e/fc1 0 2024-04-25T15:57:41.355 INFO:tasks.workunit.client.1.smithi155.stdout:6/710: creat d0/d13/d34/fe4 x:0 0 0 2024-04-25T15:57:41.359 INFO:tasks.workunit.client.1.smithi155.stdout:2/603: creat d7/db/d2e/d6f/fc2 x:0 0 0 2024-04-25T15:57:41.362 INFO:tasks.workunit.client.1.smithi155.stdout:9/493: getdents dc/d17/d2a 0 2024-04-25T15:57:41.364 INFO:tasks.workunit.client.1.smithi155.stdout:2/604: symlink d7/db/d2e/d44/d70/d7b/d9f/lc3 0 2024-04-25T15:57:41.366 INFO:tasks.workunit.client.1.smithi155.stdout:2/605: truncate d7/db/d2e/d44/d9e/fa5 526669 0 2024-04-25T15:57:41.367 INFO:tasks.workunit.client.1.smithi155.stdout:2/606: chown d7/db/d29/d83/d86/fa9 14845413 1 2024-04-25T15:57:41.368 INFO:tasks.workunit.client.1.smithi155.stdout:9/494: getdents dc/d17/d18/d72 0 2024-04-25T15:57:41.375 INFO:tasks.workunit.client.1.smithi155.stdout:9/495: dwrite dc/f95 [0,4194304] 0 2024-04-25T15:57:41.380 INFO:tasks.workunit.client.1.smithi155.stdout:2/607: getdents d7/db/d2e/d44/d70/d7b/d9f 0 2024-04-25T15:57:41.384 INFO:tasks.workunit.client.1.smithi155.stdout:6/711: dread d0/d1a/d25/d51/fb0 [0,4194304] 0 2024-04-25T15:57:41.431 INFO:tasks.workunit.client.1.smithi155.stdout:3/615: sync 2024-04-25T15:57:41.442 INFO:tasks.workunit.client.1.smithi155.stdout:9/496: dwrite dc/d3c/d9b/f9f [0,4194304] 0 2024-04-25T15:57:41.444 INFO:tasks.workunit.client.1.smithi155.stdout:3/616: write d1/d4/db/d28/d58/faf [255241,118055] 0 2024-04-25T15:57:41.445 INFO:tasks.workunit.client.1.smithi155.stdout:6/712: creat d0/d18/fe5 x:0 0 0 2024-04-25T15:57:41.447 INFO:tasks.workunit.client.1.smithi155.stdout:2/608: creat d7/db/dd/d15/d60/d94/fc4 x:0 0 0 2024-04-25T15:57:41.448 INFO:tasks.workunit.client.1.smithi155.stdout:6/713: readlink d0/d13/l66 0 2024-04-25T15:57:41.449 INFO:tasks.workunit.client.1.smithi155.stdout:2/609: dread - d7/db/d2e/d44/d70/fae zero size 2024-04-25T15:57:41.449 INFO:tasks.workunit.client.1.smithi155.stdout:6/714: fdatasync d0/d1a/d25/f2b 0 2024-04-25T15:57:41.450 INFO:tasks.workunit.client.1.smithi155.stdout:3/617: creat d1/d4/db/d20/d44/d52/fd0 x:0 0 0 2024-04-25T15:57:41.487 INFO:tasks.workunit.client.1.smithi155.stdout:9/497: truncate dc/d11/d67/f7e 2715003 0 2024-04-25T15:57:41.491 INFO:tasks.workunit.client.1.smithi155.stdout:2/610: read d7/db/d2e/d44/d70/d7b/d9f/fa6 [1684271,108933] 0 2024-04-25T15:57:41.491 INFO:tasks.workunit.client.1.smithi155.stdout:9/498: unlink dc/c1a 0 2024-04-25T15:57:41.491 INFO:tasks.workunit.client.1.smithi155.stdout:3/618: rmdir d1/d4/d10/d21/d73/d8d 39 2024-04-25T15:57:41.493 INFO:tasks.workunit.client.1.smithi155.stdout:6/715: stat d0/d1a/d37/dda/c62 0 2024-04-25T15:57:41.494 INFO:tasks.workunit.client.1.smithi155.stdout:3/619: chown d1/d4/db/d20/fa8 0 1 2024-04-25T15:57:41.494 INFO:tasks.workunit.client.1.smithi155.stdout:9/499: unlink dc/l33 0 2024-04-25T15:57:41.499 INFO:tasks.workunit.client.1.smithi155.stdout:6/716: creat d0/d1a/d25/d2e/d39/fe6 x:0 0 0 2024-04-25T15:57:41.499 INFO:tasks.workunit.client.1.smithi155.stdout:9/500: symlink dc/d11/d67/lab 0 2024-04-25T15:57:41.505 INFO:tasks.workunit.client.1.smithi155.stdout:9/501: rename dc/d13/d60/c99 to dc/d13/cac 0 2024-04-25T15:57:41.507 INFO:tasks.workunit.client.1.smithi155.stdout:3/620: getdents d1/d4/d10/d21/d73/d77/d57/d80 0 2024-04-25T15:57:41.509 INFO:tasks.workunit.client.1.smithi155.stdout:3/621: truncate d1/d4/d10/d21/f5a 5056727 0 2024-04-25T15:57:41.509 INFO:tasks.workunit.client.1.smithi155.stdout:9/502: symlink dc/d17/d18/d72/lad 0 2024-04-25T15:57:41.510 INFO:tasks.workunit.client.1.smithi155.stdout:9/503: dread - dc/d13/fa7 zero size 2024-04-25T15:57:41.511 INFO:tasks.workunit.client.1.smithi155.stdout:3/622: chown d1/d4/db/d91/cc3 9 1 2024-04-25T15:57:41.511 INFO:tasks.workunit.client.1.smithi155.stdout:2/611: fsync d7/db/dd/d15/d60/d94/fc4 0 2024-04-25T15:57:41.513 INFO:tasks.workunit.client.1.smithi155.stdout:3/623: dread - d1/d4/db/d20/fa3 zero size 2024-04-25T15:57:41.514 INFO:tasks.workunit.client.1.smithi155.stdout:2/612: chown d7/db/d2e/d6f/fc2 27033 1 2024-04-25T15:57:41.515 INFO:tasks.workunit.client.1.smithi155.stdout:3/624: stat d1/d4/db/d20/fa8 0 2024-04-25T15:57:41.516 INFO:tasks.workunit.client.1.smithi155.stdout:9/504: fsync dc/d17/d18/f91 0 2024-04-25T15:57:41.519 INFO:tasks.workunit.client.1.smithi155.stdout:5/603: sync 2024-04-25T15:57:41.530 INFO:tasks.workunit.client.1.smithi155.stdout:5/604: creat d0/d3/d15/d1f/d50/d60/fc6 x:0 0 0 2024-04-25T15:57:41.531 INFO:tasks.workunit.client.1.smithi155.stdout:2/613: dwrite d7/db/dd/f89 [0,4194304] 0 2024-04-25T15:57:41.533 INFO:tasks.workunit.client.1.smithi155.stdout:5/605: write d0/d3/d2c/fbb [831101,10940] 0 2024-04-25T15:57:41.536 INFO:tasks.workunit.client.1.smithi155.stdout:9/505: dread dc/d11/d30/d46/f8d [0,4194304] 0 2024-04-25T15:57:41.537 INFO:tasks.workunit.client.1.smithi155.stdout:2/614: fdatasync d7/db/dd/f11 0 2024-04-25T15:57:41.541 INFO:tasks.workunit.client.1.smithi155.stdout:2/615: write d7/db/d29/f3c [748635,14558] 0 2024-04-25T15:57:41.543 INFO:tasks.workunit.client.1.smithi155.stdout:9/506: mkdir dc/d17/d8e/dae 0 2024-04-25T15:57:41.548 INFO:tasks.workunit.client.1.smithi155.stdout:9/507: mknod dc/d11/d67/caf 0 2024-04-25T15:57:41.557 INFO:tasks.workunit.client.1.smithi155.stdout:3/625: truncate d1/d4/d10/d21/d73/d77/d5f/f7e 159890 0 2024-04-25T15:57:41.558 INFO:tasks.workunit.client.1.smithi155.stdout:2/616: link d7/c52 d7/db/dd/d15/d60/cc5 0 2024-04-25T15:57:41.560 INFO:tasks.workunit.client.1.smithi155.stdout:2/617: fsync d7/db/dd/f89 0 2024-04-25T15:57:41.562 INFO:tasks.workunit.client.1.smithi155.stdout:9/508: dwrite dc/d2f/f7b [0,4194304] 0 2024-04-25T15:57:41.566 INFO:tasks.workunit.client.1.smithi155.stdout:5/606: write d0/d3/d15/d1f/d50/d7c/fb5 [1531663,106317] 0 2024-04-25T15:57:41.569 INFO:tasks.workunit.client.1.smithi155.stdout:2/618: mkdir d7/db/d2e/d6f/dc6 0 2024-04-25T15:57:41.574 INFO:tasks.workunit.client.1.smithi155.stdout:9/509: creat dc/d17/d8e/dae/fb0 x:0 0 0 2024-04-25T15:57:41.579 INFO:tasks.workunit.client.1.smithi155.stdout:2/619: creat d7/db/d29/d83/d86/db0/fc7 x:0 0 0 2024-04-25T15:57:41.580 INFO:tasks.workunit.client.1.smithi155.stdout:2/620: chown d7/db/d2e/f84 59 1 2024-04-25T15:57:41.581 INFO:tasks.workunit.client.1.smithi155.stdout:3/626: write d1/d4/fc7 [137810,117269] 0 2024-04-25T15:57:41.585 INFO:tasks.workunit.client.1.smithi155.stdout:2/621: mkdir d7/db/d29/d83/dc8 0 2024-04-25T15:57:41.589 INFO:tasks.workunit.client.1.smithi155.stdout:5/607: dread d0/d58/f90 [0,4194304] 0 2024-04-25T15:57:41.589 INFO:tasks.workunit.client.1.smithi155.stdout:9/510: rename dc/d11/d5a/f8c to dc/d13/d2e/fb1 0 2024-04-25T15:57:41.591 INFO:tasks.workunit.client.1.smithi155.stdout:5/608: chown d0/d3/d2c/f85 1073033065 1 2024-04-25T15:57:41.597 INFO:tasks.workunit.client.1.smithi155.stdout:3/627: rename d1/d4/f2c to d1/d4/d10/d21/d73/d77/fd1 0 2024-04-25T15:57:41.598 INFO:tasks.workunit.client.1.smithi155.stdout:0/581: sync 2024-04-25T15:57:41.598 INFO:tasks.workunit.client.1.smithi155.stdout:8/386: sync 2024-04-25T15:57:41.598 INFO:tasks.workunit.client.1.smithi155.stdout:4/563: sync 2024-04-25T15:57:41.599 INFO:tasks.workunit.client.1.smithi155.stdout:2/622: creat d7/d8e/db9/fc9 x:0 0 0 2024-04-25T15:57:41.599 INFO:tasks.workunit.client.1.smithi155.stdout:8/387: stat d2/d15/c52 0 2024-04-25T15:57:41.601 INFO:tasks.workunit.client.1.smithi155.stdout:9/511: creat dc/d3c/d9b/fb2 x:0 0 0 2024-04-25T15:57:41.602 INFO:tasks.workunit.client.1.smithi155.stdout:3/628: mkdir d1/d4/db/d20/d44/d52/dd2 0 2024-04-25T15:57:41.604 INFO:tasks.workunit.client.1.smithi155.stdout:0/582: unlink d1/d3/d5/d5b/dc4/l27 0 2024-04-25T15:57:41.606 INFO:tasks.workunit.client.1.smithi155.stdout:0/583: chown d1/d3/d5/d5b/dc4/c4f 3 1 2024-04-25T15:57:41.612 INFO:tasks.workunit.client.1.smithi155.stdout:3/629: creat d1/d4/db/d20/d44/d52/d61/fd3 x:0 0 0 2024-04-25T15:57:41.616 INFO:tasks.workunit.client.1.smithi155.stdout:4/564: dread da/d23/d3f/d56/d69/d4a/d78/d62/f7e [0,4194304] 0 2024-04-25T15:57:41.616 INFO:tasks.workunit.client.1.smithi155.stdout:8/388: dread d2/d15/d18/d23/d2d/f39 [0,4194304] 0 2024-04-25T15:57:41.617 INFO:tasks.workunit.client.1.smithi155.stdout:8/389: read - d2/f5c zero size 2024-04-25T15:57:41.620 INFO:tasks.workunit.client.1.smithi155.stdout:2/623: getdents d7/db/d2e/d90 0 2024-04-25T15:57:41.623 INFO:tasks.workunit.client.1.smithi155.stdout:4/565: mknod da/d23/ccb 0 2024-04-25T15:57:41.624 INFO:tasks.workunit.client.1.smithi155.stdout:8/390: rmdir d2/d15/d18/d49 39 2024-04-25T15:57:41.624 INFO:tasks.workunit.client.1.smithi155.stdout:4/566: stat da/dc/f2f 0 2024-04-25T15:57:41.626 INFO:tasks.workunit.client.1.smithi155.stdout:2/624: mknod d7/db/d29/d83/cca 0 2024-04-25T15:57:41.631 INFO:tasks.workunit.client.1.smithi155.stdout:4/567: creat da/dc/fcc x:0 0 0 2024-04-25T15:57:41.635 INFO:tasks.workunit.client.1.smithi155.stdout:2/625: creat d7/db/d2e/d44/d9e/fcb x:0 0 0 2024-04-25T15:57:41.638 INFO:tasks.workunit.client.1.smithi155.stdout:8/391: dread d2/d5/f21 [0,4194304] 0 2024-04-25T15:57:41.641 INFO:tasks.workunit.client.1.smithi155.stdout:4/568: symlink da/d23/d3f/d56/d69/lcd 0 2024-04-25T15:57:41.642 INFO:tasks.workunit.client.1.smithi155.stdout:3/630: write d1/d4/db/f55 [1683602,8297] 0 2024-04-25T15:57:41.644 INFO:tasks.workunit.client.1.smithi155.stdout:4/569: chown da/c24 526068 1 2024-04-25T15:57:41.645 INFO:tasks.workunit.client.1.smithi155.stdout:8/392: mkdir d2/d15/d18/d23/d3c/d76 0 2024-04-25T15:57:41.645 INFO:tasks.workunit.client.1.smithi155.stdout:9/512: dwrite dc/d13/d2e/f37 [0,4194304] 0 2024-04-25T15:57:41.646 INFO:tasks.workunit.client.1.smithi155.stdout:3/631: chown d1/d4/d6a/d86/la7 985 1 2024-04-25T15:57:41.648 INFO:tasks.workunit.client.1.smithi155.stdout:8/393: read d2/d15/d35/f4d [300027,111055] 0 2024-04-25T15:57:41.648 INFO:tasks.workunit.client.1.smithi155.stdout:2/626: dwrite d7/f31 [0,4194304] 0 2024-04-25T15:57:41.654 INFO:tasks.workunit.client.1.smithi155.stdout:2/627: dread d7/db/d2e/d44/d9e/fa5 [0,4194304] 0 2024-04-25T15:57:41.656 INFO:tasks.workunit.client.1.smithi155.stdout:8/394: symlink d2/d15/d18/d34/d48/d59/l77 0 2024-04-25T15:57:41.661 INFO:tasks.workunit.client.1.smithi155.stdout:3/632: dwrite d1/d4/d10/d21/d73/d77/d57/f71 [0,4194304] 0 2024-04-25T15:57:41.674 INFO:tasks.workunit.client.1.smithi155.stdout:3/633: symlink d1/d4/d6a/d86/d9e/ld4 0 2024-04-25T15:57:41.676 INFO:tasks.workunit.client.1.smithi155.stdout:4/570: link da/d30/l9c da/dc/d77/lce 0 2024-04-25T15:57:41.676 INFO:tasks.workunit.client.1.smithi155.stdout:9/513: dread dc/d11/fa1 [0,4194304] 0 2024-04-25T15:57:41.677 INFO:tasks.workunit.client.1.smithi155.stdout:4/571: chown da/f11 114933 1 2024-04-25T15:57:41.679 INFO:tasks.workunit.client.1.smithi155.stdout:2/628: fsync d7/db/dd/d15/f33 0 2024-04-25T15:57:41.680 INFO:tasks.workunit.client.1.smithi155.stdout:2/629: dread - d7/db/d2e/d90/fb8 zero size 2024-04-25T15:57:41.682 INFO:tasks.workunit.client.1.smithi155.stdout:3/634: creat d1/d94/fd5 x:0 0 0 2024-04-25T15:57:41.685 INFO:tasks.workunit.client.1.smithi155.stdout:3/635: write d1/d4/db/d20/d44/d52/d93/da6/fb4 [3626390,27323] 0 2024-04-25T15:57:41.686 INFO:tasks.workunit.client.1.smithi155.stdout:4/572: dwrite da/d23/d3f/d56/d69/d83/fbd [0,4194304] 0 2024-04-25T15:57:41.687 INFO:tasks.workunit.client.1.smithi155.stdout:4/573: stat da/d23/d3f/d56/d69/c86 0 2024-04-25T15:57:41.688 INFO:tasks.workunit.client.1.smithi155.stdout:4/574: readlink da/dc/laa 0 2024-04-25T15:57:41.689 INFO:tasks.workunit.client.1.smithi155.stdout:4/575: fdatasync da/d23/da2/fb8 0 2024-04-25T15:57:41.689 INFO:tasks.workunit.client.1.smithi155.stdout:9/514: rename dc/d11/f64 to dc/d17/d18/d56/fb3 0 2024-04-25T15:57:41.690 INFO:tasks.workunit.client.1.smithi155.stdout:9/515: fsync dc/d11/f42 0 2024-04-25T15:57:41.692 INFO:tasks.workunit.client.1.smithi155.stdout:8/395: dread d2/d15/d35/d3d/f42 [0,4194304] 0 2024-04-25T15:57:41.694 INFO:tasks.workunit.client.1.smithi155.stdout:8/396: chown d2/l13 29319 1 2024-04-25T15:57:41.703 INFO:tasks.workunit.client.1.smithi155.stdout:4/576: creat da/d23/d3f/d56/d69/d83/fcf x:0 0 0 2024-04-25T15:57:41.703 INFO:tasks.workunit.client.1.smithi155.stdout:7/599: sync 2024-04-25T15:57:41.703 INFO:tasks.workunit.client.1.smithi155.stdout:1/601: sync 2024-04-25T15:57:41.703 INFO:tasks.workunit.client.1.smithi155.stdout:6/717: sync 2024-04-25T15:57:41.705 INFO:tasks.workunit.client.1.smithi155.stdout:2/630: write d7/d23/f35 [409369,53841] 0 2024-04-25T15:57:41.706 INFO:tasks.workunit.client.1.smithi155.stdout:6/718: dread - d0/d1a/d25/fc2 zero size 2024-04-25T15:57:41.706 INFO:tasks.workunit.client.1.smithi155.stdout:8/397: write d2/d15/d35/d3d/f42 [4456074,113850] 0 2024-04-25T15:57:41.707 INFO:tasks.workunit.client.1.smithi155.stdout:2/631: stat d7/db/d2e/d6f/f80 0 2024-04-25T15:57:41.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/636: symlink d1/d4/db/ld6 0 2024-04-25T15:57:41.708 INFO:tasks.workunit.client.1.smithi155.stdout:8/398: fdatasync d2/d15/d35/d3d/f6b 0 2024-04-25T15:57:41.708 INFO:tasks.workunit.client.1.smithi155.stdout:9/516: dread fa [0,4194304] 0 2024-04-25T15:57:41.708 INFO:tasks.workunit.client.1.smithi155.stdout:2/632: readlink d7/db/d29/l88 0 2024-04-25T15:57:41.710 INFO:tasks.workunit.client.1.smithi155.stdout:3/637: dread - d1/d4/db/d20/d44/d52/fd0 zero size 2024-04-25T15:57:41.710 INFO:tasks.workunit.client.1.smithi155.stdout:7/600: mknod d2/cc3 0 2024-04-25T15:57:41.711 INFO:tasks.workunit.client.1.smithi155.stdout:4/577: write da/d23/d3f/f79 [1077851,46485] 0 2024-04-25T15:57:41.712 INFO:tasks.workunit.client.1.smithi155.stdout:7/601: write d2/dd/d63/fc0 [432535,97383] 0 2024-04-25T15:57:41.713 INFO:tasks.workunit.client.1.smithi155.stdout:7/602: dread - d2/dd/d13/d1c/f6f zero size 2024-04-25T15:57:41.715 INFO:tasks.workunit.client.1.smithi155.stdout:9/517: symlink dc/d2f/lb4 0 2024-04-25T15:57:41.715 INFO:tasks.workunit.client.1.smithi155.stdout:4/578: truncate da/d23/d3f/d56/d69/d4a/d78/f8d 4406220 0 2024-04-25T15:57:41.716 INFO:tasks.workunit.client.1.smithi155.stdout:2/633: symlink d7/db/d29/d83/lcc 0 2024-04-25T15:57:41.726 INFO:tasks.workunit.client.1.smithi155.stdout:9/518: mknod dc/d17/d8e/cb5 0 2024-04-25T15:57:41.726 INFO:tasks.workunit.client.1.smithi155.stdout:4/579: symlink da/d23/d3f/d56/d69/d83/ld0 0 2024-04-25T15:57:41.729 INFO:tasks.workunit.client.1.smithi155.stdout:2/634: truncate d7/db/d2e/d44/f68 2378696 0 2024-04-25T15:57:41.732 INFO:tasks.workunit.client.1.smithi155.stdout:6/719: rmdir d0/d13/d43/de1 0 2024-04-25T15:57:41.733 INFO:tasks.workunit.client.1.smithi155.stdout:3/638: dread d1/d4/db/f35 [0,4194304] 0 2024-04-25T15:57:41.733 INFO:tasks.workunit.client.1.smithi155.stdout:1/602: truncate d1/d32/d86/fb2 3379715 0 2024-04-25T15:57:41.734 INFO:tasks.workunit.client.1.smithi155.stdout:9/519: fdatasync dc/d11/fa1 0 2024-04-25T15:57:41.734 INFO:tasks.workunit.client.1.smithi155.stdout:4/580: dwrite da/d23/d3f/f79 [0,4194304] 0 2024-04-25T15:57:41.735 INFO:tasks.workunit.client.1.smithi155.stdout:6/720: read - d0/d1a/d37/dda/fd9 zero size 2024-04-25T15:57:41.736 INFO:tasks.workunit.client.1.smithi155.stdout:2/635: symlink d7/d8e/db9/lcd 0 2024-04-25T15:57:41.736 INFO:tasks.workunit.client.1.smithi155.stdout:5/609: sync 2024-04-25T15:57:41.737 INFO:tasks.workunit.client.1.smithi155.stdout:8/399: dread d2/d15/d18/d49/f3a [0,4194304] 0 2024-04-25T15:57:41.738 INFO:tasks.workunit.client.1.smithi155.stdout:3/639: mknod d1/d4/d10/d21/d73/d77/cd7 0 2024-04-25T15:57:41.740 INFO:tasks.workunit.client.1.smithi155.stdout:9/520: mknod dc/d17/d8e/cb6 0 2024-04-25T15:57:41.741 INFO:tasks.workunit.client.1.smithi155.stdout:7/603: link d2/dd/d66/d8c/f90 d2/dd/fc4 0 2024-04-25T15:57:41.742 INFO:tasks.workunit.client.1.smithi155.stdout:5/610: symlink d0/d47/d59/lc7 0 2024-04-25T15:57:41.742 INFO:tasks.workunit.client.1.smithi155.stdout:7/604: write d2/f91 [733727,111142] 0 2024-04-25T15:57:41.744 INFO:tasks.workunit.client.1.smithi155.stdout:5/611: write d0/d27/f43 [2778986,103990] 0 2024-04-25T15:57:41.746 INFO:tasks.workunit.client.1.smithi155.stdout:4/581: dwrite da/d23/fa0 [0,4194304] 0 2024-04-25T15:57:41.746 INFO:tasks.workunit.client.1.smithi155.stdout:1/603: truncate d1/d16/d37/f74 201148 0 2024-04-25T15:57:41.750 INFO:tasks.workunit.client.1.smithi155.stdout:9/521: chown dc/d74/c85 11 1 2024-04-25T15:57:41.754 INFO:tasks.workunit.client.1.smithi155.stdout:4/582: dwrite da/f11 [4194304,4194304] 0 2024-04-25T15:57:41.755 INFO:tasks.workunit.client.1.smithi155.stdout:2/636: creat d7/db/d2e/d6f/d91/dad/fce x:0 0 0 2024-04-25T15:57:41.757 INFO:tasks.workunit.client.1.smithi155.stdout:8/400: link d2/d5/f67 d2/d15/d35/f78 0 2024-04-25T15:57:41.758 INFO:tasks.workunit.client.1.smithi155.stdout:7/605: symlink d2/dd/d13/lc5 0 2024-04-25T15:57:41.759 INFO:tasks.workunit.client.1.smithi155.stdout:7/606: chown d2/d26/l50 478001 1 2024-04-25T15:57:41.761 INFO:tasks.workunit.client.1.smithi155.stdout:4/583: dread da/dc/ff [0,4194304] 0 2024-04-25T15:57:41.762 INFO:tasks.workunit.client.1.smithi155.stdout:3/640: creat d1/d4/d10/d21/d73/d77/d5f/db3/fd8 x:0 0 0 2024-04-25T15:57:41.764 INFO:tasks.workunit.client.1.smithi155.stdout:3/641: write d1/d4/db/d91/dc4/d6c/fbc [974722,72939] 0 2024-04-25T15:57:41.767 INFO:tasks.workunit.client.1.smithi155.stdout:8/401: mknod d2/d5/d40/c79 0 2024-04-25T15:57:41.768 INFO:tasks.workunit.client.1.smithi155.stdout:7/607: creat d2/dd/d30/d44/d7f/fc6 x:0 0 0 2024-04-25T15:57:41.769 INFO:tasks.workunit.client.1.smithi155.stdout:4/584: dwrite da/d23/d3f/d56/d69/f44 [4194304,4194304] 0 2024-04-25T15:57:41.770 INFO:tasks.workunit.client.1.smithi155.stdout:5/612: link d0/d3/d15/f8d d0/d3/d2c/d94/fc8 0 2024-04-25T15:57:41.770 INFO:tasks.workunit.client.1.smithi155.stdout:4/585: dread - da/d23/da2/fb8 zero size 2024-04-25T15:57:41.776 INFO:tasks.workunit.client.1.smithi155.stdout:2/637: creat d7/db/d2e/d6f/dc6/fcf x:0 0 0 2024-04-25T15:57:41.782 INFO:tasks.workunit.client.1.smithi155.stdout:4/586: creat da/d23/d3f/d56/d69/d83/fd1 x:0 0 0 2024-04-25T15:57:41.786 INFO:tasks.workunit.client.1.smithi155.stdout:9/522: write dc/d17/d18/f41 [2166419,122973] 0 2024-04-25T15:57:41.787 INFO:tasks.workunit.client.1.smithi155.stdout:7/608: truncate d2/dd/fc4 132170 0 2024-04-25T15:57:41.788 INFO:tasks.workunit.client.1.smithi155.stdout:3/642: dread d1/d4/db/d20/f4c [0,4194304] 0 2024-04-25T15:57:41.789 INFO:tasks.workunit.client.1.smithi155.stdout:1/604: getdents d1/d16/d1d 0 2024-04-25T15:57:41.789 INFO:tasks.workunit.client.1.smithi155.stdout:7/609: dread - d2/dd/d36/d46/f9e zero size 2024-04-25T15:57:41.790 INFO:tasks.workunit.client.1.smithi155.stdout:7/610: chown d2/d26/d3d/d6d/db3/cb5 6853508 1 2024-04-25T15:57:41.791 INFO:tasks.workunit.client.1.smithi155.stdout:4/587: mknod da/d23/d3a/cd2 0 2024-04-25T15:57:41.791 INFO:tasks.workunit.client.1.smithi155.stdout:7/611: fdatasync d2/dd/d12/f38 0 2024-04-25T15:57:41.792 INFO:tasks.workunit.client.1.smithi155.stdout:7/612: dread - d2/dd/d36/f7b zero size 2024-04-25T15:57:41.792 INFO:tasks.workunit.client.1.smithi155.stdout:4/588: chown da/d23/d3f/d56/d69/f95 7 1 2024-04-25T15:57:41.793 INFO:tasks.workunit.client.1.smithi155.stdout:8/402: rename d2/f6a to d2/f7a 0 2024-04-25T15:57:41.794 INFO:tasks.workunit.client.1.smithi155.stdout:2/638: rename d7/c52 to d7/db/d2e/d44/d70/d7b/cd0 0 2024-04-25T15:57:41.797 INFO:tasks.workunit.client.1.smithi155.stdout:5/613: link d0/d27/f98 d0/d58/d32/d6a/fc9 0 2024-04-25T15:57:41.800 INFO:tasks.workunit.client.1.smithi155.stdout:7/613: dread d2/dd/d12/f78 [0,4194304] 0 2024-04-25T15:57:41.802 INFO:tasks.workunit.client.1.smithi155.stdout:8/403: symlink d2/d15/d18/d49/l7b 0 2024-04-25T15:57:41.805 INFO:tasks.workunit.client.1.smithi155.stdout:5/614: dwrite d0/d58/d63/da0/fb2 [0,4194304] 0 2024-04-25T15:57:41.807 INFO:tasks.workunit.client.1.smithi155.stdout:1/605: dread d1/d16/d37/f4c [0,4194304] 0 2024-04-25T15:57:41.808 INFO:tasks.workunit.client.1.smithi155.stdout:2/639: creat d7/db/d29/d83/d86/db0/fd1 x:0 0 0 2024-04-25T15:57:41.808 INFO:tasks.workunit.client.1.smithi155.stdout:1/606: chown d1/d16/d1d/d29/d5f/d34/d68 17524521 1 2024-04-25T15:57:41.810 INFO:tasks.workunit.client.1.smithi155.stdout:1/607: fdatasync d1/d16/d1d/f65 0 2024-04-25T15:57:41.810 INFO:tasks.workunit.client.1.smithi155.stdout:7/614: mknod d2/d26/d3d/d6d/cc7 0 2024-04-25T15:57:41.811 INFO:tasks.workunit.client.1.smithi155.stdout:9/523: link dc/d13/d59/c89 dc/d13/d60/d7a/cb7 0 2024-04-25T15:57:41.812 INFO:tasks.workunit.client.1.smithi155.stdout:7/615: dread - d2/dd/d13/fa8 zero size 2024-04-25T15:57:41.812 INFO:tasks.workunit.client.1.smithi155.stdout:1/608: chown d1/d6/db4 407860 1 2024-04-25T15:57:41.813 INFO:tasks.workunit.client.1.smithi155.stdout:5/615: dread d0/d3/d15/d1f/d50/d7c/fb5 [0,4194304] 0 2024-04-25T15:57:41.814 INFO:tasks.workunit.client.1.smithi155.stdout:3/643: rename d1/d4/d6a to d1/d4/db/d91/dc4/dd9 0 2024-04-25T15:57:41.815 INFO:tasks.workunit.client.1.smithi155.stdout:8/404: symlink d2/d15/d18/d23/l7c 0 2024-04-25T15:57:41.815 INFO:tasks.workunit.client.1.smithi155.stdout:9/524: truncate dc/d13/d60/f8a 4787204 0 2024-04-25T15:57:41.817 INFO:tasks.workunit.client.1.smithi155.stdout:7/616: rename d2/dd/d13/fa8 to d2/dd/d66/d8c/fc8 0 2024-04-25T15:57:41.817 INFO:tasks.workunit.client.1.smithi155.stdout:9/525: write dc/d13/d2e/f57 [2717586,63763] 0 2024-04-25T15:57:41.819 INFO:tasks.workunit.client.1.smithi155.stdout:9/526: chown dc/d17/d18/la8 2218382 1 2024-04-25T15:57:41.820 INFO:tasks.workunit.client.1.smithi155.stdout:8/405: dread d2/d15/d35/f4d [0,4194304] 0 2024-04-25T15:57:41.820 INFO:tasks.workunit.client.1.smithi155.stdout:5/616: rename d0/d47/d59/l86 to d0/d58/d32/d6a/d78/lca 0 2024-04-25T15:57:41.822 INFO:tasks.workunit.client.1.smithi155.stdout:7/617: mkdir d2/d26/d47/dc9 0 2024-04-25T15:57:41.822 INFO:tasks.workunit.client.1.smithi155.stdout:1/609: dread d1/d16/d1d/d29/d3d/f9b [0,4194304] 0 2024-04-25T15:57:41.822 INFO:tasks.workunit.client.1.smithi155.stdout:1/610: stat d1/d16/c19 0 2024-04-25T15:57:41.823 INFO:tasks.workunit.client.1.smithi155.stdout:3/644: creat d1/d4/d10/d21/d73/d8d/fda x:0 0 0 2024-04-25T15:57:41.824 INFO:tasks.workunit.client.1.smithi155.stdout:3/645: write d1/d4/fc7 [5846024,121737] 0 2024-04-25T15:57:41.828 INFO:tasks.workunit.client.1.smithi155.stdout:1/611: creat d1/d32/fc5 x:0 0 0 2024-04-25T15:57:41.830 INFO:tasks.workunit.client.1.smithi155.stdout:8/406: mkdir d2/d5/d40/d5b/d7d 0 2024-04-25T15:57:41.832 INFO:tasks.workunit.client.1.smithi155.stdout:8/407: write d2/fc [1035085,129256] 0 2024-04-25T15:57:41.832 INFO:tasks.workunit.client.1.smithi155.stdout:3/646: symlink d1/d4/d10/d21/d73/d8d/ldb 0 2024-04-25T15:57:41.834 INFO:tasks.workunit.client.1.smithi155.stdout:2/640: dwrite d7/db/dd/f72 [0,4194304] 0 2024-04-25T15:57:41.836 INFO:tasks.workunit.client.1.smithi155.stdout:2/641: dread - d7/d23/f98 zero size 2024-04-25T15:57:41.836 INFO:tasks.workunit.client.1.smithi155.stdout:1/612: mkdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc6 0 2024-04-25T15:57:41.840 INFO:tasks.workunit.client.1.smithi155.stdout:9/527: getdents dc/d11/d30/d46 0 2024-04-25T15:57:41.841 INFO:tasks.workunit.client.1.smithi155.stdout:5/617: write d0/d3/f5c [600413,123251] 0 2024-04-25T15:57:41.843 INFO:tasks.workunit.client.1.smithi155.stdout:3/647: creat d1/d4/db/d20/d44/d52/d61/db5/fdc x:0 0 0 2024-04-25T15:57:41.843 INFO:tasks.workunit.client.1.smithi155.stdout:3/648: stat d1/d4/db/d91/dc4/dd9/fcb 0 2024-04-25T15:57:41.844 INFO:tasks.workunit.client.1.smithi155.stdout:1/613: stat d1/d32/c40 0 2024-04-25T15:57:41.845 INFO:tasks.workunit.client.1.smithi155.stdout:2/642: mknod d7/db/dd/d15/d60/d94/cd2 0 2024-04-25T15:57:41.846 INFO:tasks.workunit.client.1.smithi155.stdout:8/408: mkdir d2/d15/d18/d23/d3c/d76/d7e 0 2024-04-25T15:57:41.847 INFO:tasks.workunit.client.1.smithi155.stdout:9/528: mknod dc/d74/cb8 0 2024-04-25T15:57:41.848 INFO:tasks.workunit.client.1.smithi155.stdout:7/618: write d2/dd/f16 [37574,84273] 0 2024-04-25T15:57:41.848 INFO:tasks.workunit.client.1.smithi155.stdout:5/618: unlink d0/d47/c6d 0 2024-04-25T15:57:41.850 INFO:tasks.workunit.client.1.smithi155.stdout:8/409: read d2/d15/d35/f6d [3190674,25826] 0 2024-04-25T15:57:41.853 INFO:tasks.workunit.client.1.smithi155.stdout:1/614: mknod d1/d16/d1d/d29/cc7 0 2024-04-25T15:57:41.853 INFO:tasks.workunit.client.1.smithi155.stdout:7/619: read d2/dd/d13/d1c/f31 [377597,109734] 0 2024-04-25T15:57:41.856 INFO:tasks.workunit.client.1.smithi155.stdout:2/643: rename d7/db/dd/d15/cb1 to d7/db/d2e/d6f/dc6/cd3 0 2024-04-25T15:57:41.857 INFO:tasks.workunit.client.1.smithi155.stdout:8/410: mkdir d2/d15/d18/d34/d48/d7f 0 2024-04-25T15:57:41.857 INFO:tasks.workunit.client.1.smithi155.stdout:8/411: dread - d2/d15/d35/d3d/f6b zero size 2024-04-25T15:57:41.860 INFO:tasks.workunit.client.1.smithi155.stdout:7/620: creat d2/dd/d13/d1c/fca x:0 0 0 2024-04-25T15:57:41.860 INFO:tasks.workunit.client.1.smithi155.stdout:3/649: truncate d1/d4/d10/f43 2034645 0 2024-04-25T15:57:41.861 INFO:tasks.workunit.client.1.smithi155.stdout:7/621: fdatasync d2/dd/f16 0 2024-04-25T15:57:41.861 INFO:tasks.workunit.client.1.smithi155.stdout:0/584: sync 2024-04-25T15:57:41.862 INFO:tasks.workunit.client.1.smithi155.stdout:5/619: rename d0/d47/d59/l8c to d0/d3/d15/d9f/dc3/lcb 0 2024-04-25T15:57:41.862 INFO:tasks.workunit.client.1.smithi155.stdout:7/622: write d2/f5b [2754825,105730] 0 2024-04-25T15:57:41.863 INFO:tasks.workunit.client.1.smithi155.stdout:8/412: symlink d2/d15/d18/d34/d48/d59/l80 0 2024-04-25T15:57:41.865 INFO:tasks.workunit.client.1.smithi155.stdout:3/650: mkdir d1/d4/db/d28/ddd 0 2024-04-25T15:57:41.866 INFO:tasks.workunit.client.1.smithi155.stdout:0/585: rmdir d1/d3/d12/d92 39 2024-04-25T15:57:41.867 INFO:tasks.workunit.client.1.smithi155.stdout:9/529: getdents dc/d17/d18/d72 0 2024-04-25T15:57:41.867 INFO:tasks.workunit.client.1.smithi155.stdout:0/586: chown d1/d3/d5/d5b/dc4/d6e/fab 79557744 1 2024-04-25T15:57:41.868 INFO:tasks.workunit.client.1.smithi155.stdout:0/587: fsync d1/d41/f45 0 2024-04-25T15:57:41.868 INFO:tasks.workunit.client.1.smithi155.stdout:9/530: fdatasync dc/d11/d30/d46/da0/fa5 0 2024-04-25T15:57:41.869 INFO:tasks.workunit.client.1.smithi155.stdout:1/615: creat d1/fc8 x:0 0 0 2024-04-25T15:57:41.869 INFO:tasks.workunit.client.1.smithi155.stdout:1/616: chown d1/d16/f3e 24 1 2024-04-25T15:57:41.871 INFO:tasks.workunit.client.1.smithi155.stdout:8/413: rename d2/d5/d40/d5b/d7d to d2/d15/d18/d34/d48/d4e/d81 0 2024-04-25T15:57:41.878 INFO:tasks.workunit.client.1.smithi155.stdout:8/414: unlink d2/d15/d35/d3d/f46 0 2024-04-25T15:57:41.878 INFO:tasks.workunit.client.1.smithi155.stdout:2/644: getdents d7/db/d29/d83/d86/d8b 0 2024-04-25T15:57:41.879 INFO:tasks.workunit.client.1.smithi155.stdout:3/651: link d1/d4/db/f55 d1/d4/db/d20/d44/d52/d61/db5/fde 0 2024-04-25T15:57:41.880 INFO:tasks.workunit.client.1.smithi155.stdout:7/623: creat d2/dd/d30/fcb x:0 0 0 2024-04-25T15:57:41.881 INFO:tasks.workunit.client.1.smithi155.stdout:5/620: link d0/d47/faa d0/d3/fcc 0 2024-04-25T15:57:41.881 INFO:tasks.workunit.client.1.smithi155.stdout:9/531: symlink dc/d11/lb9 0 2024-04-25T15:57:41.883 INFO:tasks.workunit.client.1.smithi155.stdout:2/645: stat d7/db/d2e/d6f/dc6/cd3 0 2024-04-25T15:57:41.883 INFO:tasks.workunit.client.1.smithi155.stdout:3/652: rmdir d1/d4/d10 39 2024-04-25T15:57:41.885 INFO:tasks.workunit.client.1.smithi155.stdout:2/646: dread - d7/db/d2e/d6f/f75 zero size 2024-04-25T15:57:41.886 INFO:tasks.workunit.client.1.smithi155.stdout:1/617: creat d1/d6/fc9 x:0 0 0 2024-04-25T15:57:41.888 INFO:tasks.workunit.client.1.smithi155.stdout:8/415: dwrite d2/d15/f69 [0,4194304] 0 2024-04-25T15:57:41.890 INFO:tasks.workunit.client.1.smithi155.stdout:3/653: symlink d1/ldf 0 2024-04-25T15:57:41.893 INFO:tasks.workunit.client.1.smithi155.stdout:2/647: rename d7/db/d29/d83/d86/db0/fd1 to d7/db/d29/d83/d86/db0/fd4 0 2024-04-25T15:57:41.893 INFO:tasks.workunit.client.1.smithi155.stdout:7/624: dwrite d2/dd/d13/d1c/f6f [0,4194304] 0 2024-04-25T15:57:41.896 INFO:tasks.workunit.client.1.smithi155.stdout:9/532: getdents dc/d11/d5a 0 2024-04-25T15:57:41.896 INFO:tasks.workunit.client.1.smithi155.stdout:1/618: symlink d1/lca 0 2024-04-25T15:57:41.898 INFO:tasks.workunit.client.1.smithi155.stdout:9/533: chown dc/d13/d60/d7a/f94 1876 1 2024-04-25T15:57:41.898 INFO:tasks.workunit.client.1.smithi155.stdout:3/654: creat d1/d4/db/d20/d44/fe0 x:0 0 0 2024-04-25T15:57:41.900 INFO:tasks.workunit.client.1.smithi155.stdout:2/648: truncate d7/db/dd/d15/f33 791701 0 2024-04-25T15:57:41.900 INFO:tasks.workunit.client.1.smithi155.stdout:8/416: dwrite d2/f7a [0,4194304] 0 2024-04-25T15:57:41.900 INFO:tasks.workunit.client.1.smithi155.stdout:5/621: write d0/d3/f5a [4317572,110665] 0 2024-04-25T15:57:41.901 INFO:tasks.workunit.client.1.smithi155.stdout:1/619: rmdir d1/d16/d1d/d29 39 2024-04-25T15:57:41.906 INFO:tasks.workunit.client.1.smithi155.stdout:3/655: unlink d1/d4/db/d91/dc4/dd9/f88 0 2024-04-25T15:57:41.908 INFO:tasks.workunit.client.1.smithi155.stdout:5/622: chown d0/d3/d15/cad 317 1 2024-04-25T15:57:41.909 INFO:tasks.workunit.client.1.smithi155.stdout:9/534: dwrite dc/d13/f3a [4194304,4194304] 0 2024-04-25T15:57:41.910 INFO:tasks.workunit.client.1.smithi155.stdout:1/620: chown d1/d16/d1d/d29/d5f/d34/d68/c72 19846 1 2024-04-25T15:57:41.914 INFO:tasks.workunit.client.1.smithi155.stdout:8/417: creat d2/d15/d18/d34/d48/d7f/f82 x:0 0 0 2024-04-25T15:57:41.917 INFO:tasks.workunit.client.1.smithi155.stdout:3/656: creat d1/d4/d10/d21/d73/fe1 x:0 0 0 2024-04-25T15:57:41.918 INFO:tasks.workunit.client.1.smithi155.stdout:8/418: mknod d2/d15/d18/d34/c83 0 2024-04-25T15:57:41.920 INFO:tasks.workunit.client.1.smithi155.stdout:8/419: chown d2/d15/d18/d49 227 1 2024-04-25T15:57:41.922 INFO:tasks.workunit.client.1.smithi155.stdout:7/625: dwrite d2/dd/fc4 [0,4194304] 0 2024-04-25T15:57:41.922 INFO:tasks.workunit.client.1.smithi155.stdout:3/657: write d1/d4/d10/d21/d73/fa5 [437159,52235] 0 2024-04-25T15:57:41.923 INFO:tasks.workunit.client.1.smithi155.stdout:1/621: dwrite d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:41.925 INFO:tasks.workunit.client.1.smithi155.stdout:7/626: chown d2/d26/d3d/d6d/cc7 0 1 2024-04-25T15:57:41.930 INFO:tasks.workunit.client.1.smithi155.stdout:7/627: dread - d2/dd/d63/f9d zero size 2024-04-25T15:57:41.931 INFO:tasks.workunit.client.1.smithi155.stdout:1/622: write d1/d16/d1d/d29/d3d/f9b [408323,18191] 0 2024-04-25T15:57:41.931 INFO:tasks.workunit.client.1.smithi155.stdout:8/420: creat d2/d15/d63/f84 x:0 0 0 2024-04-25T15:57:41.931 INFO:tasks.workunit.client.1.smithi155.stdout:7/628: truncate d2/f11 1840403 0 2024-04-25T15:57:41.932 INFO:tasks.workunit.client.1.smithi155.stdout:3/658: link d1/d4/db/f35 d1/d4/db/d20/d44/d52/d93/fe2 0 2024-04-25T15:57:41.933 INFO:tasks.workunit.client.1.smithi155.stdout:3/659: stat d1/d4/l13 0 2024-04-25T15:57:41.937 INFO:tasks.workunit.client.1.smithi155.stdout:1/623: dwrite d1/f7a [0,4194304] 0 2024-04-25T15:57:41.938 INFO:tasks.workunit.client.1.smithi155.stdout:7/629: link d2/dd/d66/d71/l7a d2/dd/d66/lcc 0 2024-04-25T15:57:41.938 INFO:tasks.workunit.client.1.smithi155.stdout:6/721: sync 2024-04-25T15:57:41.940 INFO:tasks.workunit.client.1.smithi155.stdout:5/623: dread d0/d3/d15/d1f/d50/d60/f65 [4194304,4194304] 0 2024-04-25T15:57:41.942 INFO:tasks.workunit.client.1.smithi155.stdout:5/624: truncate d0/d58/d63/da0/fbe 551185 0 2024-04-25T15:57:41.943 INFO:tasks.workunit.client.1.smithi155.stdout:7/630: rename d2/d26/d47 to d2/dd/d36/dcd 0 2024-04-25T15:57:41.946 INFO:tasks.workunit.client.1.smithi155.stdout:1/624: rename d1/d16/d1d/d29/d5f/fa6 to d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/fcb 0 2024-04-25T15:57:41.946 INFO:tasks.workunit.client.1.smithi155.stdout:6/722: dwrite d0/d13/f6a [0,4194304] 0 2024-04-25T15:57:41.948 INFO:tasks.workunit.client.1.smithi155.stdout:7/631: creat d2/d26/d3d/d6d/daa/fce x:0 0 0 2024-04-25T15:57:41.951 INFO:tasks.workunit.client.1.smithi155.stdout:7/632: symlink d2/dd/d36/d46/lcf 0 2024-04-25T15:57:41.955 INFO:tasks.workunit.client.1.smithi155.stdout:1/625: getdents d1/d32/d86 0 2024-04-25T15:57:41.956 INFO:tasks.workunit.client.1.smithi155.stdout:6/723: link d0/d1a/cd3 d0/d13/d34/d38/d4c/ce7 0 2024-04-25T15:57:41.958 INFO:tasks.workunit.client.1.smithi155.stdout:7/633: creat d2/dd/d30/dbc/fd0 x:0 0 0 2024-04-25T15:57:41.961 INFO:tasks.workunit.client.1.smithi155.stdout:5/625: dread d0/d3/d2c/d94/fc8 [0,4194304] 0 2024-04-25T15:57:41.961 INFO:tasks.workunit.client.1.smithi155.stdout:6/724: rename d0/d13/d34/fe4 to d0/d13/d7c/da9/fe8 0 2024-04-25T15:57:41.964 INFO:tasks.workunit.client.1.smithi155.stdout:5/626: symlink d0/d47/lcd 0 2024-04-25T15:57:41.965 INFO:tasks.workunit.client.1.smithi155.stdout:5/627: stat d0/d3/d15/l51 0 2024-04-25T15:57:41.965 INFO:tasks.workunit.client.1.smithi155.stdout:5/628: stat d0/d3/d15/d30 0 2024-04-25T15:57:41.966 INFO:tasks.workunit.client.1.smithi155.stdout:5/629: chown d0/d27 1466326 1 2024-04-25T15:57:41.968 INFO:tasks.workunit.client.1.smithi155.stdout:7/634: creat d2/dd/d12/fd1 x:0 0 0 2024-04-25T15:57:41.968 INFO:tasks.workunit.client.1.smithi155.stdout:1/626: write d1/d16/d1d/d29/d5f/d34/f56 [501861,115361] 0 2024-04-25T15:57:41.969 INFO:tasks.workunit.client.1.smithi155.stdout:1/627: stat d1/d16/d1d/d29/d5f/d34/f56 0 2024-04-25T15:57:41.969 INFO:tasks.workunit.client.1.smithi155.stdout:6/725: symlink d0/d13/d34/d38/d90/da5/le9 0 2024-04-25T15:57:41.970 INFO:tasks.workunit.client.1.smithi155.stdout:6/726: stat d0/d1a/d45/d61/la4 0 2024-04-25T15:57:41.970 INFO:tasks.workunit.client.1.smithi155.stdout:5/630: mknod d0/d3/d2c/cce 0 2024-04-25T15:57:41.971 INFO:tasks.workunit.client.1.smithi155.stdout:7/635: mknod d2/dd/d36/d46/cd2 0 2024-04-25T15:57:41.971 INFO:tasks.workunit.client.1.smithi155.stdout:6/727: rmdir d0/d1a/da1/dac 39 2024-04-25T15:57:41.972 INFO:tasks.workunit.client.1.smithi155.stdout:7/636: mknod d2/dd/d30/d44/cd3 0 2024-04-25T15:57:41.973 INFO:tasks.workunit.client.1.smithi155.stdout:7/637: write d2/f37 [5199134,99169] 0 2024-04-25T15:57:41.973 INFO:tasks.workunit.client.1.smithi155.stdout:1/628: creat d1/fcc x:0 0 0 2024-04-25T15:57:41.976 INFO:tasks.workunit.client.1.smithi155.stdout:7/638: creat d2/dd/d13/d24/d35/fd4 x:0 0 0 2024-04-25T15:57:41.978 INFO:tasks.workunit.client.1.smithi155.stdout:7/639: symlink d2/d26/ld5 0 2024-04-25T15:57:41.980 INFO:tasks.workunit.client.1.smithi155.stdout:7/640: chown d2/d26/d3d/d65/f9f 98500 1 2024-04-25T15:57:41.980 INFO:tasks.workunit.client.1.smithi155.stdout:6/728: write d0/d18/f1e [1532880,70342] 0 2024-04-25T15:57:41.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/629: dwrite d1/d16/d1d/d29/d3d/fbd [0,4194304] 0 2024-04-25T15:57:41.982 INFO:tasks.workunit.client.1.smithi155.stdout:1/630: stat d1/d16/c84 0 2024-04-25T15:57:41.983 INFO:tasks.workunit.client.1.smithi155.stdout:6/729: rmdir d0/d1a/d37 39 2024-04-25T15:57:41.985 INFO:tasks.workunit.client.1.smithi155.stdout:1/631: symlink d1/d16/d1d/d33/lcd 0 2024-04-25T15:57:41.986 INFO:tasks.workunit.client.1.smithi155.stdout:1/632: write d1/d16/d1d/d29/d3d/d43/f48 [860770,37905] 0 2024-04-25T15:57:41.987 INFO:tasks.workunit.client.1.smithi155.stdout:6/730: rename d0/d1a/da1/fa7 to d0/d1a/d21/fea 0 2024-04-25T15:57:41.988 INFO:tasks.workunit.client.1.smithi155.stdout:6/731: dread - d0/d1a/d21/fea zero size 2024-04-25T15:57:41.989 INFO:tasks.workunit.client.1.smithi155.stdout:6/732: chown d0/d1a/d21 24 1 2024-04-25T15:57:41.989 INFO:tasks.workunit.client.1.smithi155.stdout:7/641: getdents d2/dd/d30/d44 0 2024-04-25T15:57:41.990 INFO:tasks.workunit.client.1.smithi155.stdout:1/633: creat d1/d16/d8f/fce x:0 0 0 2024-04-25T15:57:41.991 INFO:tasks.workunit.client.1.smithi155.stdout:1/634: chown d1/d16/d1d/d29/d5f/db8 286892739 1 2024-04-25T15:57:41.991 INFO:tasks.workunit.client.1.smithi155.stdout:6/733: mkdir d0/d13/d34/deb 0 2024-04-25T15:57:41.996 INFO:tasks.workunit.client.1.smithi155.stdout:6/734: rename d0/d13/d34/deb to d0/d1a/d37/dec 0 2024-04-25T15:57:41.997 INFO:tasks.workunit.client.1.smithi155.stdout:7/642: dwrite d2/dd/f2f [4194304,4194304] 0 2024-04-25T15:57:42.000 INFO:tasks.workunit.client.1.smithi155.stdout:1/635: dwrite d1/d16/d1d/d33/da1/fb0 [0,4194304] 0 2024-04-25T15:57:42.003 INFO:tasks.workunit.client.1.smithi155.stdout:1/636: chown d1/d16/d1d/d29/d3d/d43/f62 59353855 1 2024-04-25T15:57:42.003 INFO:tasks.workunit.client.1.smithi155.stdout:7/643: symlink d2/dd/d66/d8c/ld6 0 2024-04-25T15:57:42.005 INFO:tasks.workunit.client.1.smithi155.stdout:7/644: stat d2/dd/d12/c29 0 2024-04-25T15:57:42.008 INFO:tasks.workunit.client.1.smithi155.stdout:6/735: dwrite d0/d13/d34/d38/f88 [0,4194304] 0 2024-04-25T15:57:42.008 INFO:tasks.workunit.client.1.smithi155.stdout:1/637: mkdir d1/d16/d1d/d29/dcf 0 2024-04-25T15:57:42.009 INFO:tasks.workunit.client.1.smithi155.stdout:6/736: readlink d0/d18/l8b 0 2024-04-25T15:57:42.009 INFO:tasks.workunit.client.1.smithi155.stdout:1/638: write d1/f8 [3162493,109227] 0 2024-04-25T15:57:42.010 INFO:tasks.workunit.client.1.smithi155.stdout:7/645: rename d2/dd/d13/d1c/l42 to d2/d26/ld7 0 2024-04-25T15:57:42.012 INFO:tasks.workunit.client.1.smithi155.stdout:7/646: dread - d2/dd/d30/dbc/fd0 zero size 2024-04-25T15:57:42.012 INFO:tasks.workunit.client.1.smithi155.stdout:6/737: truncate d0/d13/d7c/da9/fbc 10190 0 2024-04-25T15:57:42.015 INFO:tasks.workunit.client.1.smithi155.stdout:6/738: unlink d0/d1a/d45/d61/fa2 0 2024-04-25T15:57:42.016 INFO:tasks.workunit.client.1.smithi155.stdout:7/647: getdents d2/dd/d13/d24/d35/db4 0 2024-04-25T15:57:42.020 INFO:tasks.workunit.client.1.smithi155.stdout:7/648: creat d2/dd/d13/d24/d8b/fd8 x:0 0 0 2024-04-25T15:57:42.020 INFO:tasks.workunit.client.1.smithi155.stdout:1/639: dwrite d1/d16/d1d/d29/f55 [0,4194304] 0 2024-04-25T15:57:42.027 INFO:tasks.workunit.client.1.smithi155.stdout:6/739: dread d0/d13/d43/d56/d7b/f96 [0,4194304] 0 2024-04-25T15:57:42.030 INFO:tasks.workunit.client.1.smithi155.stdout:7/649: truncate d2/dd/d30/d44/fbb 2196970 0 2024-04-25T15:57:42.031 INFO:tasks.workunit.client.1.smithi155.stdout:1/640: dwrite d1/d32/fbb [0,4194304] 0 2024-04-25T15:57:42.033 INFO:tasks.workunit.client.1.smithi155.stdout:7/650: write d2/dd/d13/d24/d35/fd4 [129367,78039] 0 2024-04-25T15:57:42.036 INFO:tasks.workunit.client.1.smithi155.stdout:1/641: chown d1/d16/d1d/d29/d5f/d34/d68/d93/fa9 94733 1 2024-04-25T15:57:42.037 INFO:tasks.workunit.client.1.smithi155.stdout:4/589: sync 2024-04-25T15:57:42.038 INFO:tasks.workunit.client.1.smithi155.stdout:7/651: truncate d2/dd/d13/d1c/f31 302220 0 2024-04-25T15:57:42.039 INFO:tasks.workunit.client.1.smithi155.stdout:6/740: dwrite d0/d13/d34/d38/f88 [0,4194304] 0 2024-04-25T15:57:42.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/642: mkdir d1/d16/d1d/d5e/dd0 0 2024-04-25T15:57:42.041 INFO:tasks.workunit.client.1.smithi155.stdout:7/652: mkdir d2/dd/d13/d1c/dd9 0 2024-04-25T15:57:42.042 INFO:tasks.workunit.client.1.smithi155.stdout:1/643: write d1/d16/d1d/d29/d3d/f9b [1166659,6733] 0 2024-04-25T15:57:42.044 INFO:tasks.workunit.client.1.smithi155.stdout:6/741: truncate d0/d1a/d37/f8d 1280677 0 2024-04-25T15:57:42.044 INFO:tasks.workunit.client.1.smithi155.stdout:7/653: write d2/dd/d13/d1c/f40 [3947238,124433] 0 2024-04-25T15:57:42.046 INFO:tasks.workunit.client.1.smithi155.stdout:6/742: chown d0/d1a/d25/d2e/c89 0 1 2024-04-25T15:57:42.046 INFO:tasks.workunit.client.1.smithi155.stdout:1/644: rmdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7 39 2024-04-25T15:57:42.050 INFO:tasks.workunit.client.1.smithi155.stdout:1/645: rmdir d1/d16/d1d/d29/d5f/d34 39 2024-04-25T15:57:42.052 INFO:tasks.workunit.client.1.smithi155.stdout:6/743: creat d0/d18/ddd/fed x:0 0 0 2024-04-25T15:57:42.052 INFO:tasks.workunit.client.1.smithi155.stdout:1/646: fsync d1/d16/d1d/d29/d5f/f7c 0 2024-04-25T15:57:42.053 INFO:tasks.workunit.client.1.smithi155.stdout:6/744: chown d0/d13/d34/d38/d4c/lce 0 1 2024-04-25T15:57:42.056 INFO:tasks.workunit.client.1.smithi155.stdout:7/654: write d2/dd/d13/d1c/f31 [1223097,43825] 0 2024-04-25T15:57:42.058 INFO:tasks.workunit.client.1.smithi155.stdout:1/647: rename d1/d16/f1c to d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 0 2024-04-25T15:57:42.060 INFO:tasks.workunit.client.1.smithi155.stdout:7/655: mknod d2/dd/d13/d24/d35/db4/cda 0 2024-04-25T15:57:42.065 INFO:tasks.workunit.client.1.smithi155.stdout:4/590: dread da/d23/d3f/d56/d69/d4a/d78/f4f [0,4194304] 0 2024-04-25T15:57:42.066 INFO:tasks.workunit.client.1.smithi155.stdout:4/591: fdatasync da/d23/d3f/d56/d69/d83/fa4 0 2024-04-25T15:57:42.068 INFO:tasks.workunit.client.1.smithi155.stdout:4/592: symlink da/d23/d3f/d56/dca/ld3 0 2024-04-25T15:57:42.069 INFO:tasks.workunit.client.1.smithi155.stdout:7/656: dread d2/dd/d13/d24/d35/f3c [0,4194304] 0 2024-04-25T15:57:42.070 INFO:tasks.workunit.client.1.smithi155.stdout:4/593: rmdir da/d23/d3f/d56/dca 39 2024-04-25T15:57:42.071 INFO:tasks.workunit.client.1.smithi155.stdout:7/657: creat d2/d26/d3d/fdb x:0 0 0 2024-04-25T15:57:42.072 INFO:tasks.workunit.client.1.smithi155.stdout:4/594: mknod da/d23/d3f/d56/dca/cd4 0 2024-04-25T15:57:42.073 INFO:tasks.workunit.client.1.smithi155.stdout:7/658: mkdir d2/dd/d12/ddc 0 2024-04-25T15:57:42.075 INFO:tasks.workunit.client.1.smithi155.stdout:4/595: getdents da/dc/d18/d6e 0 2024-04-25T15:57:42.076 INFO:tasks.workunit.client.1.smithi155.stdout:7/659: rename d2/dd/d12/ddc to d2/dd/d30/d44/ddd 0 2024-04-25T15:57:42.076 INFO:tasks.workunit.client.1.smithi155.stdout:4/596: read da/d23/d3f/d56/d69/f95 [4093333,30373] 0 2024-04-25T15:57:42.077 INFO:tasks.workunit.client.1.smithi155.stdout:7/660: chown d2/dd/d13/d1c/f31 5 1 2024-04-25T15:57:42.078 INFO:tasks.workunit.client.1.smithi155.stdout:4/597: mknod da/dc/cd5 0 2024-04-25T15:57:42.078 INFO:tasks.workunit.client.1.smithi155.stdout:7/661: mknod d2/dd/d30/d44/ddd/cde 0 2024-04-25T15:57:42.079 INFO:tasks.workunit.client.1.smithi155.stdout:7/662: read - d2/dd/d63/f9d zero size 2024-04-25T15:57:42.080 INFO:tasks.workunit.client.1.smithi155.stdout:7/663: chown d2/dd/d13/l39 162 1 2024-04-25T15:57:42.080 INFO:tasks.workunit.client.1.smithi155.stdout:4/598: creat da/d23/d3a/fd6 x:0 0 0 2024-04-25T15:57:42.081 INFO:tasks.workunit.client.1.smithi155.stdout:7/664: rmdir d2/dd/d13/d24/d8b 39 2024-04-25T15:57:42.082 INFO:tasks.workunit.client.1.smithi155.stdout:7/665: chown d2/dd/f2f 242215 1 2024-04-25T15:57:42.082 INFO:tasks.workunit.client.1.smithi155.stdout:4/599: mknod da/d23/d3f/d56/d69/d4a/d78/d62/cd7 0 2024-04-25T15:57:42.084 INFO:tasks.workunit.client.1.smithi155.stdout:7/666: symlink d2/dd/d66/d8c/ldf 0 2024-04-25T15:57:42.085 INFO:tasks.workunit.client.1.smithi155.stdout:4/600: mkdir da/dc/d18/d97/dd8 0 2024-04-25T15:57:42.086 INFO:tasks.workunit.client.1.smithi155.stdout:7/667: rename d2/dd/d12/d76/l9a to d2/dd/d30/d44/le0 0 2024-04-25T15:57:42.087 INFO:tasks.workunit.client.1.smithi155.stdout:4/601: truncate da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fc4 621489 0 2024-04-25T15:57:42.089 INFO:tasks.workunit.client.1.smithi155.stdout:4/602: getdents da/dc/d18/d6e 0 2024-04-25T15:57:42.090 INFO:tasks.workunit.client.1.smithi155.stdout:4/603: read da/f14 [2569376,30529] 0 2024-04-25T15:57:42.137 INFO:tasks.workunit.client.1.smithi155.stdout:2/649: sync 2024-04-25T15:57:42.137 INFO:tasks.workunit.client.1.smithi155.stdout:9/535: sync 2024-04-25T15:57:42.137 INFO:tasks.workunit.client.1.smithi155.stdout:0/588: sync 2024-04-25T15:57:42.139 INFO:tasks.workunit.client.1.smithi155.stdout:0/589: chown d1/d3/d5/faa 10829751 1 2024-04-25T15:57:42.139 INFO:tasks.workunit.client.1.smithi155.stdout:2/650: write d7/db/d2e/d44/f6b [350799,21888] 0 2024-04-25T15:57:42.142 INFO:tasks.workunit.client.1.smithi155.stdout:0/590: fdatasync d1/d6/d29/d47/fc0 0 2024-04-25T15:57:42.144 INFO:tasks.workunit.client.1.smithi155.stdout:0/591: readlink d1/d3/d12/l42 0 2024-04-25T15:57:42.149 INFO:tasks.workunit.client.1.smithi155.stdout:0/592: creat d1/d3/d12/d83/fc9 x:0 0 0 2024-04-25T15:57:42.157 INFO:tasks.workunit.client.1.smithi155.stdout:0/593: getdents d1/d3/d12/d92 0 2024-04-25T15:57:42.157 INFO:tasks.workunit.client.1.smithi155.stdout:2/651: dread f3 [0,4194304] 0 2024-04-25T15:57:42.158 INFO:tasks.workunit.client.1.smithi155.stdout:2/652: fdatasync d7/f82 0 2024-04-25T15:57:42.160 INFO:tasks.workunit.client.1.smithi155.stdout:2/653: truncate d7/db/d2e/f7a 811019 0 2024-04-25T15:57:42.162 INFO:tasks.workunit.client.1.smithi155.stdout:2/654: dread - d7/db/d2e/d6f/fc2 zero size 2024-04-25T15:57:42.163 INFO:tasks.workunit.client.1.smithi155.stdout:2/655: chown d7/db/l6e 342974 1 2024-04-25T15:57:42.163 INFO:tasks.workunit.client.1.smithi155.stdout:0/594: dread d1/f4e [0,4194304] 0 2024-04-25T15:57:42.176 INFO:tasks.workunit.client.1.smithi155.stdout:0/595: creat d1/d6/fca x:0 0 0 2024-04-25T15:57:42.180 INFO:tasks.workunit.client.1.smithi155.stdout:2/656: dwrite d7/db/f59 [4194304,4194304] 0 2024-04-25T15:57:42.185 INFO:tasks.workunit.client.1.smithi155.stdout:2/657: stat d7/db/d2e/d44/f68 0 2024-04-25T15:57:42.190 INFO:tasks.workunit.client.1.smithi155.stdout:2/658: mknod d7/d8e/db9/cd5 0 2024-04-25T15:57:42.191 INFO:tasks.workunit.client.1.smithi155.stdout:0/596: dwrite d1/d3/d12/fa8 [0,4194304] 0 2024-04-25T15:57:42.196 INFO:tasks.workunit.client.1.smithi155.stdout:2/659: mkdir d7/db/d2e/d6f/dc6/dd6 0 2024-04-25T15:57:42.208 INFO:tasks.workunit.client.1.smithi155.stdout:6/745: sync 2024-04-25T15:57:42.208 INFO:tasks.workunit.client.1.smithi155.stdout:5/631: sync 2024-04-25T15:57:42.208 INFO:tasks.workunit.client.1.smithi155.stdout:3/660: sync 2024-04-25T15:57:42.208 INFO:tasks.workunit.client.1.smithi155.stdout:8/421: sync 2024-04-25T15:57:42.210 INFO:tasks.workunit.client.1.smithi155.stdout:8/422: readlink d2/d15/d18/d49/l62 0 2024-04-25T15:57:42.211 INFO:tasks.workunit.client.1.smithi155.stdout:3/661: write d1/d4/d10/d21/d73/d8d/fa4 [503261,18846] 0 2024-04-25T15:57:42.211 INFO:tasks.workunit.client.1.smithi155.stdout:0/597: mkdir d1/d3/d3d/dcb 0 2024-04-25T15:57:42.213 INFO:tasks.workunit.client.1.smithi155.stdout:5/632: fdatasync d0/d3/d2c/f3c 0 2024-04-25T15:57:42.215 INFO:tasks.workunit.client.1.smithi155.stdout:8/423: mknod d2/d41/c85 0 2024-04-25T15:57:42.219 INFO:tasks.workunit.client.1.smithi155.stdout:8/424: write d2/d15/d35/d3d/f42 [5526090,107562] 0 2024-04-25T15:57:42.219 INFO:tasks.workunit.client.1.smithi155.stdout:5/633: mknod d0/d58/ccf 0 2024-04-25T15:57:42.225 INFO:tasks.workunit.client.1.smithi155.stdout:6/746: getdents d0/d13/d7c/da9 0 2024-04-25T15:57:42.227 INFO:tasks.workunit.client.1.smithi155.stdout:6/747: write d0/d13/d7c/da9/fbc [263084,33392] 0 2024-04-25T15:57:42.228 INFO:tasks.workunit.client.1.smithi155.stdout:3/662: dwrite d1/d4/db/d91/f9d [0,4194304] 0 2024-04-25T15:57:42.231 INFO:tasks.workunit.client.1.smithi155.stdout:2/660: dread d7/db/ff [4194304,4194304] 0 2024-04-25T15:57:42.232 INFO:tasks.workunit.client.1.smithi155.stdout:8/425: link d2/d5/d40/f58 d2/d15/d18/d23/d3c/f86 0 2024-04-25T15:57:42.232 INFO:tasks.workunit.client.1.smithi155.stdout:2/661: fdatasync d7/d23/fba 0 2024-04-25T15:57:42.239 INFO:tasks.workunit.client.1.smithi155.stdout:5/634: getdents d0/d3/d15/d1f 0 2024-04-25T15:57:42.241 INFO:tasks.workunit.client.1.smithi155.stdout:8/426: symlink d2/d15/l87 0 2024-04-25T15:57:42.243 INFO:tasks.workunit.client.1.smithi155.stdout:8/427: truncate d2/d5/d40/f65 392580 0 2024-04-25T15:57:42.243 INFO:tasks.workunit.client.1.smithi155.stdout:2/662: mkdir d7/db/dd/d15/dd7 0 2024-04-25T15:57:42.245 INFO:tasks.workunit.client.1.smithi155.stdout:2/663: fsync d7/db/d29/f3a 0 2024-04-25T15:57:42.246 INFO:tasks.workunit.client.1.smithi155.stdout:5/635: creat d0/d3/d15/d9f/dc3/fd0 x:0 0 0 2024-04-25T15:57:42.246 INFO:tasks.workunit.client.1.smithi155.stdout:0/598: dwrite d1/d3/d5/d5b/dc4/d60/f6d [0,4194304] 0 2024-04-25T15:57:42.247 INFO:tasks.workunit.client.1.smithi155.stdout:5/636: readlink d0/d3/l24 0 2024-04-25T15:57:42.253 INFO:tasks.workunit.client.1.smithi155.stdout:2/664: mknod d7/db/d2e/d44/d9e/cd8 0 2024-04-25T15:57:42.255 INFO:tasks.workunit.client.1.smithi155.stdout:5/637: symlink d0/d47/db3/ld1 0 2024-04-25T15:57:42.258 INFO:tasks.workunit.client.1.smithi155.stdout:0/599: creat d1/d3/d3d/dcb/fcc x:0 0 0 2024-04-25T15:57:42.261 INFO:tasks.workunit.client.1.smithi155.stdout:2/665: dwrite d7/db/d2e/d6f/fb2 [0,4194304] 0 2024-04-25T15:57:42.264 INFO:tasks.workunit.client.1.smithi155.stdout:5/638: rename d0/d47/d59/lc7 to d0/d58/d9b/ld2 0 2024-04-25T15:57:42.266 INFO:tasks.workunit.client.1.smithi155.stdout:0/600: symlink d1/d3/d3d/d46/lcd 0 2024-04-25T15:57:42.268 INFO:tasks.workunit.client.1.smithi155.stdout:0/601: read d1/d3/d5/f13 [83684,20458] 0 2024-04-25T15:57:42.269 INFO:tasks.workunit.client.1.smithi155.stdout:0/602: write d1/d3/d12/f84 [1703047,68303] 0 2024-04-25T15:57:42.272 INFO:tasks.workunit.client.1.smithi155.stdout:5/639: creat d0/d3/d15/d9f/dc3/fd3 x:0 0 0 2024-04-25T15:57:42.278 INFO:tasks.workunit.client.1.smithi155.stdout:0/603: unlink d1/d3/d3d/l9c 0 2024-04-25T15:57:42.281 INFO:tasks.workunit.client.1.smithi155.stdout:5/640: rename d0/d27/la9 to d0/ld4 0 2024-04-25T15:57:42.281 INFO:tasks.workunit.client.1.smithi155.stdout:5/641: fdatasync d0/d3/f5c 0 2024-04-25T15:57:42.283 INFO:tasks.workunit.client.1.smithi155.stdout:0/604: creat d1/d3/d3d/dcb/fce x:0 0 0 2024-04-25T15:57:42.283 INFO:tasks.workunit.client.1.smithi155.stdout:5/642: write d0/d3/d15/d9f/dc3/fd3 [884073,112924] 0 2024-04-25T15:57:42.284 INFO:tasks.workunit.client.1.smithi155.stdout:0/605: truncate d1/d1a/fa7 471786 0 2024-04-25T15:57:42.286 INFO:tasks.workunit.client.1.smithi155.stdout:5/643: rmdir d0/d3/d15/d1f/d50/d60 39 2024-04-25T15:57:42.286 INFO:tasks.workunit.client.1.smithi155.stdout:5/644: readlink d0/d3/d15/l74 0 2024-04-25T15:57:42.287 INFO:tasks.workunit.client.1.smithi155.stdout:0/606: write d1/f1b [2382970,71641] 0 2024-04-25T15:57:42.290 INFO:tasks.workunit.client.1.smithi155.stdout:0/607: symlink d1/d3/d12/d83/lcf 0 2024-04-25T15:57:42.294 INFO:tasks.workunit.client.1.smithi155.stdout:2/666: dread d7/db/dd/d15/d60/f76 [0,4194304] 0 2024-04-25T15:57:42.300 INFO:tasks.workunit.client.1.smithi155.stdout:1/648: sync 2024-04-25T15:57:42.300 INFO:tasks.workunit.client.1.smithi155.stdout:7/668: sync 2024-04-25T15:57:42.302 INFO:tasks.workunit.client.1.smithi155.stdout:7/669: chown d2/dd/d36/dcd/lb7 128481098 1 2024-04-25T15:57:42.306 INFO:tasks.workunit.client.1.smithi155.stdout:2/667: dread d7/db/f59 [0,4194304] 0 2024-04-25T15:57:42.308 INFO:tasks.workunit.client.1.smithi155.stdout:1/649: fdatasync d1/d16/d37/f74 0 2024-04-25T15:57:42.312 INFO:tasks.workunit.client.1.smithi155.stdout:0/608: write d1/f4e [741859,121445] 0 2024-04-25T15:57:42.316 INFO:tasks.workunit.client.1.smithi155.stdout:0/609: mknod d1/d3/cd0 0 2024-04-25T15:57:42.317 INFO:tasks.workunit.client.1.smithi155.stdout:7/670: truncate d2/dd/d13/d1c/f22 6029595 0 2024-04-25T15:57:42.318 INFO:tasks.workunit.client.1.smithi155.stdout:0/610: truncate d1/d6/f90 987176 0 2024-04-25T15:57:42.319 INFO:tasks.workunit.client.1.smithi155.stdout:1/650: mkdir d1/d16/d1d/d29/dcf/dd2 0 2024-04-25T15:57:42.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/668: dwrite f3 [0,4194304] 0 2024-04-25T15:57:42.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/669: chown d7/db/d29 23 1 2024-04-25T15:57:42.320 INFO:tasks.workunit.client.1.smithi155.stdout:1/651: stat d1/d16/d1d/d29/d5f/d34/f56 0 2024-04-25T15:57:42.321 INFO:tasks.workunit.client.1.smithi155.stdout:7/671: symlink d2/d26/d3d/d6d/db3/le1 0 2024-04-25T15:57:42.324 INFO:tasks.workunit.client.1.smithi155.stdout:2/670: creat d7/db/d29/d83/d86/db0/fd9 x:0 0 0 2024-04-25T15:57:42.325 INFO:tasks.workunit.client.1.smithi155.stdout:2/671: readlink d7/db/d2e/l62 0 2024-04-25T15:57:42.326 INFO:tasks.workunit.client.1.smithi155.stdout:0/611: mkdir d1/d6/d29/d47/db0/dd1 0 2024-04-25T15:57:42.327 INFO:tasks.workunit.client.1.smithi155.stdout:0/612: fsync d1/d6/d29/f66 0 2024-04-25T15:57:42.328 INFO:tasks.workunit.client.1.smithi155.stdout:1/652: creat d1/d6/db4/fd3 x:0 0 0 2024-04-25T15:57:42.329 INFO:tasks.workunit.client.1.smithi155.stdout:1/653: write d1/f11 [4526987,98778] 0 2024-04-25T15:57:42.330 INFO:tasks.workunit.client.1.smithi155.stdout:2/672: symlink d7/db/d2e/d44/d70/lda 0 2024-04-25T15:57:42.332 INFO:tasks.workunit.client.1.smithi155.stdout:2/673: truncate d7/db/d2e/f8a 776315 0 2024-04-25T15:57:42.333 INFO:tasks.workunit.client.1.smithi155.stdout:2/674: dread - d7/db/dd/d15/d60/d94/fc4 zero size 2024-04-25T15:57:42.333 INFO:tasks.workunit.client.1.smithi155.stdout:0/613: creat d1/d3/d3d/dcb/fd2 x:0 0 0 2024-04-25T15:57:42.334 INFO:tasks.workunit.client.1.smithi155.stdout:0/614: chown d1/d41/f93 1369198 1 2024-04-25T15:57:42.335 INFO:tasks.workunit.client.1.smithi155.stdout:1/654: read d1/d16/d1d/f65 [1621325,123749] 0 2024-04-25T15:57:42.337 INFO:tasks.workunit.client.1.smithi155.stdout:1/655: read - d1/d6/db4/fd3 zero size 2024-04-25T15:57:42.341 INFO:tasks.workunit.client.1.smithi155.stdout:0/615: symlink d1/d3/d6a/d9b/ld3 0 2024-04-25T15:57:42.345 INFO:tasks.workunit.client.1.smithi155.stdout:1/656: dread d1/d16/d1d/f23 [4194304,4194304] 0 2024-04-25T15:57:42.346 INFO:tasks.workunit.client.1.smithi155.stdout:2/675: rename d7/d23/fba to d7/db/dd/d15/fdb 0 2024-04-25T15:57:42.348 INFO:tasks.workunit.client.1.smithi155.stdout:2/676: dread d7/db/d2e/f69 [0,4194304] 0 2024-04-25T15:57:42.349 INFO:tasks.workunit.client.1.smithi155.stdout:0/616: mkdir d1/d3/d5/d5b/dd4 0 2024-04-25T15:57:42.350 INFO:tasks.workunit.client.1.smithi155.stdout:0/617: truncate d1/d6/f75 490944 0 2024-04-25T15:57:42.354 INFO:tasks.workunit.client.1.smithi155.stdout:2/677: creat d7/d8e/db9/fdc x:0 0 0 2024-04-25T15:57:42.357 INFO:tasks.workunit.client.1.smithi155.stdout:0/618: dwrite d1/d6/fca [0,4194304] 0 2024-04-25T15:57:42.360 INFO:tasks.workunit.client.1.smithi155.stdout:0/619: write d1/d3/d5/d5b/dc4/d60/f6d [624689,72870] 0 2024-04-25T15:57:42.361 INFO:tasks.workunit.client.1.smithi155.stdout:2/678: mkdir d7/db/d2e/d90/ddd 0 2024-04-25T15:57:42.363 INFO:tasks.workunit.client.1.smithi155.stdout:7/672: dwrite d2/dd/d12/f78 [0,4194304] 0 2024-04-25T15:57:42.364 INFO:tasks.workunit.client.1.smithi155.stdout:7/673: dread - d2/dd/d30/d44/d7f/fc6 zero size 2024-04-25T15:57:42.375 INFO:tasks.workunit.client.1.smithi155.stdout:1/657: truncate d1/f61 2456627 0 2024-04-25T15:57:42.376 INFO:tasks.workunit.client.1.smithi155.stdout:1/658: chown d1/d16/f3e 217984535 1 2024-04-25T15:57:42.378 INFO:tasks.workunit.client.1.smithi155.stdout:0/620: link d1/d3/d12/d83/lb4 d1/d3/d5/ld5 0 2024-04-25T15:57:42.379 INFO:tasks.workunit.client.1.smithi155.stdout:2/679: getdents d7/d23 0 2024-04-25T15:57:42.380 INFO:tasks.workunit.client.1.smithi155.stdout:2/680: read d7/db/dd/d15/f42 [1369187,63947] 0 2024-04-25T15:57:42.381 INFO:tasks.workunit.client.1.smithi155.stdout:0/621: symlink d1/ld6 0 2024-04-25T15:57:42.384 INFO:tasks.workunit.client.1.smithi155.stdout:2/681: stat d7/db/d2e/d6f/d91/c92 0 2024-04-25T15:57:42.389 INFO:tasks.workunit.client.1.smithi155.stdout:9/536: sync 2024-04-25T15:57:42.389 INFO:tasks.workunit.client.1.smithi155.stdout:4/604: sync 2024-04-25T15:57:42.390 INFO:tasks.workunit.client.1.smithi155.stdout:7/674: truncate d2/dd/d13/d1c/f1e 768197 0 2024-04-25T15:57:42.390 INFO:tasks.workunit.client.1.smithi155.stdout:4/605: dread - da/d23/fb0 zero size 2024-04-25T15:57:42.391 INFO:tasks.workunit.client.1.smithi155.stdout:7/675: readlink d2/dd/d13/d24/l45 0 2024-04-25T15:57:42.393 INFO:tasks.workunit.client.1.smithi155.stdout:9/537: chown dc/d13/d2e/d4c/f61 5299767 1 2024-04-25T15:57:42.396 INFO:tasks.workunit.client.1.smithi155.stdout:9/538: write dc/d17/d18/f2d [2706055,35622] 0 2024-04-25T15:57:42.402 INFO:tasks.workunit.client.1.smithi155.stdout:0/622: write d1/d3/f17 [740202,73081] 0 2024-04-25T15:57:42.408 INFO:tasks.workunit.client.1.smithi155.stdout:1/659: dread d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 [0,4194304] 0 2024-04-25T15:57:42.408 INFO:tasks.workunit.client.1.smithi155.stdout:4/606: dwrite da/f21 [0,4194304] 0 2024-04-25T15:57:42.410 INFO:tasks.workunit.client.1.smithi155.stdout:2/682: dread d7/db/dd/d15/f42 [0,4194304] 0 2024-04-25T15:57:42.416 INFO:tasks.workunit.client.1.smithi155.stdout:4/607: mknod da/d23/d3a/cd9 0 2024-04-25T15:57:42.416 INFO:tasks.workunit.client.1.smithi155.stdout:5/645: sync 2024-04-25T15:57:42.416 INFO:tasks.workunit.client.1.smithi155.stdout:8/428: sync 2024-04-25T15:57:42.417 INFO:tasks.workunit.client.1.smithi155.stdout:6/748: sync 2024-04-25T15:57:42.417 INFO:tasks.workunit.client.1.smithi155.stdout:3/663: sync 2024-04-25T15:57:42.417 INFO:tasks.workunit.client.1.smithi155.stdout:9/539: dwrite dc/d13/d59/f5f [0,4194304] 0 2024-04-25T15:57:42.422 INFO:tasks.workunit.client.1.smithi155.stdout:8/429: stat d2/d5/d40/d5b 0 2024-04-25T15:57:42.423 INFO:tasks.workunit.client.1.smithi155.stdout:0/623: dwrite d1/d3/d5/f26 [8388608,4194304] 0 2024-04-25T15:57:42.425 INFO:tasks.workunit.client.1.smithi155.stdout:4/608: dread - da/d23/d3a/d7b/fb2 zero size 2024-04-25T15:57:42.426 INFO:tasks.workunit.client.1.smithi155.stdout:7/676: dread d2/f8 [0,4194304] 0 2024-04-25T15:57:42.426 INFO:tasks.workunit.client.1.smithi155.stdout:9/540: creat dc/d11/d67/fba x:0 0 0 2024-04-25T15:57:42.428 INFO:tasks.workunit.client.1.smithi155.stdout:4/609: chown da/d23/f94 1680 1 2024-04-25T15:57:42.432 INFO:tasks.workunit.client.1.smithi155.stdout:3/664: creat d1/d4/db/d91/dc4/d6c/fe3 x:0 0 0 2024-04-25T15:57:42.435 INFO:tasks.workunit.client.1.smithi155.stdout:0/624: creat d1/d6/d29/d47/db0/dd1/fd7 x:0 0 0 2024-04-25T15:57:42.437 INFO:tasks.workunit.client.1.smithi155.stdout:5/646: creat d0/d3/d15/d1f/d50/fd5 x:0 0 0 2024-04-25T15:57:42.437 INFO:tasks.workunit.client.1.smithi155.stdout:9/541: truncate dc/d11/d67/fba 663746 0 2024-04-25T15:57:42.439 INFO:tasks.workunit.client.1.smithi155.stdout:4/610: creat da/dc/d18/fda x:0 0 0 2024-04-25T15:57:42.442 INFO:tasks.workunit.client.1.smithi155.stdout:0/625: fdatasync d1/d6/d29/f96 0 2024-04-25T15:57:42.442 INFO:tasks.workunit.client.1.smithi155.stdout:2/683: dwrite d7/db/d2e/f61 [0,4194304] 0 2024-04-25T15:57:42.442 INFO:tasks.workunit.client.1.smithi155.stdout:9/542: dread - dc/d13/fa7 zero size 2024-04-25T15:57:42.442 INFO:tasks.workunit.client.1.smithi155.stdout:7/677: truncate d2/dd/d12/fd1 291702 0 2024-04-25T15:57:42.444 INFO:tasks.workunit.client.1.smithi155.stdout:8/430: dwrite d2/d5/f17 [0,4194304] 0 2024-04-25T15:57:42.444 INFO:tasks.workunit.client.1.smithi155.stdout:6/749: dwrite d0/d1a/f6b [0,4194304] 0 2024-04-25T15:57:42.448 INFO:tasks.workunit.client.1.smithi155.stdout:1/660: dread d1/d16/f3e [0,4194304] 0 2024-04-25T15:57:42.450 INFO:tasks.workunit.client.1.smithi155.stdout:1/661: stat d1/d16/d1d/d29/dcf 0 2024-04-25T15:57:42.455 INFO:tasks.workunit.client.1.smithi155.stdout:2/684: chown d7/d8e/db9/cd5 1627 1 2024-04-25T15:57:42.456 INFO:tasks.workunit.client.1.smithi155.stdout:8/431: symlink d2/d41/d5d/l88 0 2024-04-25T15:57:42.456 INFO:tasks.workunit.client.1.smithi155.stdout:5/647: write d0/d3/d15/d30/d4f/f6b [6356251,39002] 0 2024-04-25T15:57:42.456 INFO:tasks.workunit.client.1.smithi155.stdout:9/543: rmdir dc/d13/d48 39 2024-04-25T15:57:42.459 INFO:tasks.workunit.client.1.smithi155.stdout:1/662: mknod d1/d32/d9d/cd4 0 2024-04-25T15:57:42.460 INFO:tasks.workunit.client.1.smithi155.stdout:9/544: rename dc/d11/d67/f7e to dc/d11/d67/fbb 0 2024-04-25T15:57:42.462 INFO:tasks.workunit.client.1.smithi155.stdout:7/678: getdents d2 0 2024-04-25T15:57:42.463 INFO:tasks.workunit.client.1.smithi155.stdout:3/665: dread d1/d4/db/d91/dc4/dd9/d86/d9e/fbd [0,4194304] 0 2024-04-25T15:57:42.464 INFO:tasks.workunit.client.1.smithi155.stdout:5/648: stat d0/d58/d32/d6a/d78/lca 0 2024-04-25T15:57:42.466 INFO:tasks.workunit.client.1.smithi155.stdout:8/432: creat d2/d15/d18/d34/d48/f89 x:0 0 0 2024-04-25T15:57:42.467 INFO:tasks.workunit.client.1.smithi155.stdout:7/679: write d2/dd/d13/d1c/f6f [1103335,44324] 0 2024-04-25T15:57:42.468 INFO:tasks.workunit.client.1.smithi155.stdout:5/649: rmdir d0/d3/d15/d30 39 2024-04-25T15:57:42.469 INFO:tasks.workunit.client.1.smithi155.stdout:3/666: read - d1/d4/db/d91/dc4/d6c/fc0 zero size 2024-04-25T15:57:42.470 INFO:tasks.workunit.client.1.smithi155.stdout:1/663: rename d1/d16/d1d/d29/d5f/d34/f51 to d1/d16/d1d/d5e/dd0/fd5 0 2024-04-25T15:57:42.472 INFO:tasks.workunit.client.1.smithi155.stdout:7/680: stat d2/d26/d3d/d6d/l8f 0 2024-04-25T15:57:42.473 INFO:tasks.workunit.client.1.smithi155.stdout:9/545: getdents dc/d11 0 2024-04-25T15:57:42.473 INFO:tasks.workunit.client.1.smithi155.stdout:2/685: dwrite d7/db/d29/d83/d86/db0/fc7 [0,4194304] 0 2024-04-25T15:57:42.474 INFO:tasks.workunit.client.1.smithi155.stdout:4/611: dread da/dc/d18/f4c [0,4194304] 0 2024-04-25T15:57:42.474 INFO:tasks.workunit.client.1.smithi155.stdout:7/681: fsync d2/dd/d12/f78 0 2024-04-25T15:57:42.476 INFO:tasks.workunit.client.1.smithi155.stdout:3/667: mkdir d1/d4/db/d91/de4 0 2024-04-25T15:57:42.478 INFO:tasks.workunit.client.1.smithi155.stdout:2/686: chown d7/db/d29/d83/d86/d8b/dbf 682737639 1 2024-04-25T15:57:42.479 INFO:tasks.workunit.client.1.smithi155.stdout:4/612: mknod da/d23/cdb 0 2024-04-25T15:57:42.482 INFO:tasks.workunit.client.1.smithi155.stdout:1/664: rename d1/la to d1/d16/d1d/d29/d3d/ld6 0 2024-04-25T15:57:42.483 INFO:tasks.workunit.client.1.smithi155.stdout:3/668: truncate d1/f1f 440118 0 2024-04-25T15:57:42.484 INFO:tasks.workunit.client.1.smithi155.stdout:0/626: dread d1/d6/f8a [0,4194304] 0 2024-04-25T15:57:42.485 INFO:tasks.workunit.client.1.smithi155.stdout:4/613: mkdir da/d87/ddc 0 2024-04-25T15:57:42.487 INFO:tasks.workunit.client.1.smithi155.stdout:5/650: dread d0/d3/d15/d1f/d50/d60/f65 [4194304,4194304] 0 2024-04-25T15:57:42.488 INFO:tasks.workunit.client.1.smithi155.stdout:6/750: dwrite d0/d13/d43/d56/d7b/f96 [4194304,4194304] 0 2024-04-25T15:57:42.491 INFO:tasks.workunit.client.1.smithi155.stdout:2/687: symlink d7/db/d29/d83/dbe/lde 0 2024-04-25T15:57:42.491 INFO:tasks.workunit.client.1.smithi155.stdout:4/614: creat da/dc/d18/fdd x:0 0 0 2024-04-25T15:57:42.491 INFO:tasks.workunit.client.1.smithi155.stdout:3/669: fdatasync d1/d4/d10/d21/d73/d77/d57/d80/fa0 0 2024-04-25T15:57:42.493 INFO:tasks.workunit.client.1.smithi155.stdout:0/627: rename d1/d3f/l69 to d1/d3/d6a/d9b/ld8 0 2024-04-25T15:57:42.495 INFO:tasks.workunit.client.1.smithi155.stdout:7/682: link d2/dd/d30/d44/f7d d2/d26/d3d/d65/fe2 0 2024-04-25T15:57:42.495 INFO:tasks.workunit.client.1.smithi155.stdout:6/751: dread d0/d1a/f6b [0,4194304] 0 2024-04-25T15:57:42.496 INFO:tasks.workunit.client.1.smithi155.stdout:1/665: creat d1/d16/d1d/d29/d5f/fd7 x:0 0 0 2024-04-25T15:57:42.498 INFO:tasks.workunit.client.1.smithi155.stdout:4/615: mknod da/d23/da2/dad/cde 0 2024-04-25T15:57:42.499 INFO:tasks.workunit.client.1.smithi155.stdout:2/688: symlink d7/db/d29/d83/d86/ldf 0 2024-04-25T15:57:42.500 INFO:tasks.workunit.client.1.smithi155.stdout:4/616: chown da/f4d 49202 1 2024-04-25T15:57:42.502 INFO:tasks.workunit.client.1.smithi155.stdout:8/433: dread d2/d15/d18/d23/d2d/f31 [4194304,4194304] 0 2024-04-25T15:57:42.503 INFO:tasks.workunit.client.1.smithi155.stdout:7/683: rename d2/d26/d3d/f64 to d2/d26/fe3 0 2024-04-25T15:57:42.504 INFO:tasks.workunit.client.1.smithi155.stdout:8/434: fsync d2/fa 0 2024-04-25T15:57:42.504 INFO:tasks.workunit.client.1.smithi155.stdout:4/617: write da/d23/f6c [4216762,37738] 0 2024-04-25T15:57:42.505 INFO:tasks.workunit.client.1.smithi155.stdout:3/670: dwrite d1/d4/d10/d21/d73/fb2 [0,4194304] 0 2024-04-25T15:57:42.506 INFO:tasks.workunit.client.1.smithi155.stdout:7/684: write d2/f8 [7243100,19111] 0 2024-04-25T15:57:42.506 INFO:tasks.workunit.client.1.smithi155.stdout:1/666: chown d1/d16/d1d/d29/d3d/ld6 114278 1 2024-04-25T15:57:42.508 INFO:tasks.workunit.client.1.smithi155.stdout:4/618: chown da/d23/d3f/d56 0 1 2024-04-25T15:57:42.509 INFO:tasks.workunit.client.1.smithi155.stdout:0/628: creat d1/d3/d5/d5b/dd4/fd9 x:0 0 0 2024-04-25T15:57:42.510 INFO:tasks.workunit.client.1.smithi155.stdout:3/671: chown d1/d4/db/d91/dc4/f3c 115 1 2024-04-25T15:57:42.512 INFO:tasks.workunit.client.1.smithi155.stdout:0/629: write d1/d3/d12/fa8 [5553280,30890] 0 2024-04-25T15:57:42.512 INFO:tasks.workunit.client.1.smithi155.stdout:3/672: fdatasync d1/d4/db/d20/d44/fe0 0 2024-04-25T15:57:42.514 INFO:tasks.workunit.client.1.smithi155.stdout:2/689: mkdir d7/db/d2e/d6f/d91/dad/de0 0 2024-04-25T15:57:42.515 INFO:tasks.workunit.client.1.smithi155.stdout:0/630: read d1/d3/d12/f84 [1757209,102817] 0 2024-04-25T15:57:42.516 INFO:tasks.workunit.client.1.smithi155.stdout:8/435: rmdir d2/d15/d18/d23 39 2024-04-25T15:57:42.517 INFO:tasks.workunit.client.1.smithi155.stdout:4/619: dread da/dc/ff [0,4194304] 0 2024-04-25T15:57:42.518 INFO:tasks.workunit.client.1.smithi155.stdout:4/620: fdatasync da/d23/d3f/d56/f76 0 2024-04-25T15:57:42.519 INFO:tasks.workunit.client.1.smithi155.stdout:4/621: truncate da/dc/d18/f9f 778784 0 2024-04-25T15:57:42.520 INFO:tasks.workunit.client.1.smithi155.stdout:4/622: readlink da/d30/l6f 0 2024-04-25T15:57:42.521 INFO:tasks.workunit.client.1.smithi155.stdout:5/651: truncate d0/d3/f5a 134221 0 2024-04-25T15:57:42.522 INFO:tasks.workunit.client.1.smithi155.stdout:2/690: rmdir d7/db/d29 39 2024-04-25T15:57:42.522 INFO:tasks.workunit.client.1.smithi155.stdout:6/752: dread d0/d1a/d21/d73/f5a [0,4194304] 0 2024-04-25T15:57:42.523 INFO:tasks.workunit.client.1.smithi155.stdout:6/753: stat d0/d13/d43/f42 0 2024-04-25T15:57:42.524 INFO:tasks.workunit.client.1.smithi155.stdout:4/623: truncate da/d23/d3a/d7b/d93/fc5 256624 0 2024-04-25T15:57:42.525 INFO:tasks.workunit.client.1.smithi155.stdout:1/667: rename d1/d16/d1d/d29/d5f/d34/d68/c89 to d1/d16/d1d/d33/cd8 0 2024-04-25T15:57:42.531 INFO:tasks.workunit.client.1.smithi155.stdout:4/624: stat da/d23/d3f/d56/d69/d4a/d78/c51 0 2024-04-25T15:57:42.532 INFO:tasks.workunit.client.1.smithi155.stdout:7/685: rename d2/d26/d3d/d6d/fab to d2/dd/d36/dcd/fe4 0 2024-04-25T15:57:42.533 INFO:tasks.workunit.client.1.smithi155.stdout:8/436: symlink d2/d15/d18/d23/l8a 0 2024-04-25T15:57:42.535 INFO:tasks.workunit.client.1.smithi155.stdout:5/652: dwrite d0/d3/d2c/fbb [0,4194304] 0 2024-04-25T15:57:42.538 INFO:tasks.workunit.client.1.smithi155.stdout:7/686: write d2/dd/d12/f38 [2267857,120762] 0 2024-04-25T15:57:42.541 INFO:tasks.workunit.client.1.smithi155.stdout:0/631: dread d1/d3f/f7b [0,4194304] 0 2024-04-25T15:57:42.542 INFO:tasks.workunit.client.1.smithi155.stdout:2/691: truncate d7/f49 2119092 0 2024-04-25T15:57:42.544 INFO:tasks.workunit.client.1.smithi155.stdout:0/632: read - d1/d85/fa1 zero size 2024-04-25T15:57:42.546 INFO:tasks.workunit.client.1.smithi155.stdout:6/754: dwrite d0/d1a/d37/dda/fd9 [0,4194304] 0 2024-04-25T15:57:42.546 INFO:tasks.workunit.client.1.smithi155.stdout:5/653: unlink d0/d3/d2c/d94/ca5 0 2024-04-25T15:57:42.547 INFO:tasks.workunit.client.1.smithi155.stdout:1/668: link d1/d16/d1d/d29/d3d/l8c d1/d16/d1d/d29/d5f/d34/ld9 0 2024-04-25T15:57:42.549 INFO:tasks.workunit.client.1.smithi155.stdout:3/673: dwrite d1/d4/d10/d21/d73/d77/fd1 [0,4194304] 0 2024-04-25T15:57:42.549 INFO:tasks.workunit.client.1.smithi155.stdout:8/437: truncate d2/d15/d18/d34/d48/d7f/f82 825311 0 2024-04-25T15:57:42.549 INFO:tasks.workunit.client.1.smithi155.stdout:7/687: creat d2/d26/fe5 x:0 0 0 2024-04-25T15:57:42.550 INFO:tasks.workunit.client.1.smithi155.stdout:0/633: chown d1/d3/d5/d5b/dd4 33030 1 2024-04-25T15:57:42.554 INFO:tasks.workunit.client.1.smithi155.stdout:4/625: dwrite da/d23/fbc [0,4194304] 0 2024-04-25T15:57:42.555 INFO:tasks.workunit.client.1.smithi155.stdout:5/654: stat d0/d3/d15/d30/c42 0 2024-04-25T15:57:42.560 INFO:tasks.workunit.client.1.smithi155.stdout:7/688: creat d2/dd/d30/d44/ddd/fe6 x:0 0 0 2024-04-25T15:57:42.560 INFO:tasks.workunit.client.1.smithi155.stdout:8/438: unlink d2/d15/d18/d34/d48/d59/l80 0 2024-04-25T15:57:42.560 INFO:tasks.workunit.client.1.smithi155.stdout:1/669: read d1/d6/fc [63897,51644] 0 2024-04-25T15:57:42.561 INFO:tasks.workunit.client.1.smithi155.stdout:3/674: mknod d1/d4/d10/d21/d73/d8d/ce5 0 2024-04-25T15:57:42.564 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:42.565 INFO:tasks.workunit.client.1.smithi155.stdout:3/675: dread - d1/d4/d10/d21/d73/f82 zero size 2024-04-25T15:57:42.566 INFO:tasks.workunit.client.1.smithi155.stdout:8/439: write d2/d15/d18/d23/d3c/f61 [1901587,91803] 0 2024-04-25T15:57:42.567 INFO:tasks.workunit.client.1.smithi155.stdout:0/634: dwrite d1/d3/d12/d83/fc9 [0,4194304] 0 2024-04-25T15:57:42.568 INFO:tasks.workunit.client.1.smithi155.stdout:1/670: unlink d1/d16/d1d/d29/l6d 0 2024-04-25T15:57:42.571 INFO:tasks.workunit.client.1.smithi155.stdout:0/635: write d1/f71 [2066500,113674] 0 2024-04-25T15:57:42.576 INFO:tasks.workunit.client.1.smithi155.stdout:3/676: dwrite d1/d4/db/f7d [4194304,4194304] 0 2024-04-25T15:57:42.579 INFO:tasks.workunit.client.1.smithi155.stdout:4/626: link da/d23/d3f/d56/d69/d4a/d78/f2e da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fdf 0 2024-04-25T15:57:42.581 INFO:tasks.workunit.client.1.smithi155.stdout:7/689: link d2/dd/d13/d1c/f60 d2/dd/d30/d44/fe7 0 2024-04-25T15:57:42.584 INFO:tasks.workunit.client.1.smithi155.stdout:6/755: dread d0/d1a/d25/d2e/d39/f86 [0,4194304] 0 2024-04-25T15:57:42.585 INFO:tasks.workunit.client.1.smithi155.stdout:6/756: write d0/d18/fe5 [542312,113523] 0 2024-04-25T15:57:42.586 INFO:tasks.workunit.client.1.smithi155.stdout:5/655: fsync d0/d47/fa4 0 2024-04-25T15:57:42.586 INFO:tasks.workunit.client.1.smithi155.stdout:4/627: mkdir da/d23/d3f/d56/d69/d4a/de0 0 2024-04-25T15:57:42.587 INFO:tasks.workunit.client.1.smithi155.stdout:6/757: readlink d0/d13/l66 0 2024-04-25T15:57:42.589 INFO:tasks.workunit.client.1.smithi155.stdout:6/758: chown d0/d13/f17 76 1 2024-04-25T15:57:42.589 INFO:tasks.workunit.client.1.smithi155.stdout:4/628: chown da/d23/d3f/d56/f98 2092273 1 2024-04-25T15:57:42.590 INFO:tasks.workunit.client.1.smithi155.stdout:8/440: getdents d2/d15/d35 0 2024-04-25T15:57:42.590 INFO:tasks.workunit.client.1.smithi155.stdout:7/690: mknod d2/dd/d12/ce8 0 2024-04-25T15:57:42.591 INFO:tasks.workunit.client.1.smithi155.stdout:6/759: write d0/d13/d6f/f8f [464880,121879] 0 2024-04-25T15:57:42.592 INFO:tasks.workunit.client.1.smithi155.stdout:5/656: mkdir d0/d58/d63/da0/dd6 0 2024-04-25T15:57:42.592 INFO:tasks.workunit.client.1.smithi155.stdout:7/691: dread - d2/dd/d66/d8c/fc8 zero size 2024-04-25T15:57:42.593 INFO:tasks.workunit.client.1.smithi155.stdout:4/629: creat da/d30/fe1 x:0 0 0 2024-04-25T15:57:42.593 INFO:tasks.workunit.client.1.smithi155.stdout:2/692: dread d7/db/dd/d15/f55 [0,4194304] 0 2024-04-25T15:57:42.594 INFO:tasks.workunit.client.1.smithi155.stdout:5/657: chown d0/d3/d15/l51 1038733957 1 2024-04-25T15:57:42.596 INFO:tasks.workunit.client.1.smithi155.stdout:4/630: chown da/d23/d3f/d56/d69/d83/cb4 1762 1 2024-04-25T15:57:42.597 INFO:tasks.workunit.client.1.smithi155.stdout:2/693: chown d7/db/c4c 667 1 2024-04-25T15:57:42.597 INFO:tasks.workunit.client.1.smithi155.stdout:8/441: creat d2/d15/d18/d34/d48/f8b x:0 0 0 2024-04-25T15:57:42.599 INFO:tasks.workunit.client.1.smithi155.stdout:6/760: mknod d0/d1a/d21/d73/cee 0 2024-04-25T15:57:42.600 INFO:tasks.workunit.client.1.smithi155.stdout:4/631: chown da/d23/d3f/d56/d69/d4a/d78/d62/dc0 109451 1 2024-04-25T15:57:42.602 INFO:tasks.workunit.client.1.smithi155.stdout:4/632: stat da/d23/d3a/lc7 0 2024-04-25T15:57:42.602 INFO:tasks.workunit.client.1.smithi155.stdout:6/761: write d0/d13/d7c/d99/fb9 [772160,15921] 0 2024-04-25T15:57:42.603 INFO:tasks.workunit.client.1.smithi155.stdout:5/658: dread d0/d47/db3/fba [0,4194304] 0 2024-04-25T15:57:42.604 INFO:tasks.workunit.client.1.smithi155.stdout:8/442: unlink d2/d15/d18/d34/d48/d59/f73 0 2024-04-25T15:57:42.605 INFO:tasks.workunit.client.1.smithi155.stdout:8/443: chown d2/f60 773978 1 2024-04-25T15:57:42.606 INFO:tasks.workunit.client.1.smithi155.stdout:4/633: mkdir da/d23/d3f/dc6/de2 0 2024-04-25T15:57:42.606 INFO:tasks.workunit.client.1.smithi155.stdout:3/677: dread d1/d4/db/d28/f87 [0,4194304] 0 2024-04-25T15:57:42.607 INFO:tasks.workunit.client.1.smithi155.stdout:4/634: readlink da/d23/d3a/l66 0 2024-04-25T15:57:42.608 INFO:tasks.workunit.client.1.smithi155.stdout:6/762: mkdir d0/d1a/d37/dda/def 0 2024-04-25T15:57:42.611 INFO:tasks.workunit.client.1.smithi155.stdout:3/678: mkdir d1/d4/db/d28/d58/de6 0 2024-04-25T15:57:42.612 INFO:tasks.workunit.client.1.smithi155.stdout:4/635: mknod da/dc/d77/ce3 0 2024-04-25T15:57:42.612 INFO:tasks.workunit.client.1.smithi155.stdout:5/659: dread d0/d3/d15/d1f/d50/fac [0,4194304] 0 2024-04-25T15:57:42.612 INFO:tasks.workunit.client.1.smithi155.stdout:2/694: getdents d7/db/d2e/d6f 0 2024-04-25T15:57:42.613 INFO:tasks.workunit.client.1.smithi155.stdout:6/763: fdatasync d0/d13/d7c/da9/fe8 0 2024-04-25T15:57:42.613 INFO:tasks.workunit.client.1.smithi155.stdout:7/692: dread d2/dd/d12/f5e [0,4194304] 0 2024-04-25T15:57:42.615 INFO:tasks.workunit.client.1.smithi155.stdout:3/679: read - d1/d4/db/d20/d44/d52/d61/db5/fdc zero size 2024-04-25T15:57:42.616 INFO:tasks.workunit.client.1.smithi155.stdout:4/636: symlink da/d23/d3f/d56/d69/d4a/le4 0 2024-04-25T15:57:42.616 INFO:tasks.workunit.client.1.smithi155.stdout:7/693: stat d2/dd/d36/d46/f5f 0 2024-04-25T15:57:42.616 INFO:tasks.workunit.client.1.smithi155.stdout:6/764: mkdir d0/d13/d43/d56/df0 0 2024-04-25T15:57:42.617 INFO:tasks.workunit.client.1.smithi155.stdout:2/695: truncate d7/db/ff 104219 0 2024-04-25T15:57:42.618 INFO:tasks.workunit.client.1.smithi155.stdout:7/694: stat d2/dd/d12/d76/c96 0 2024-04-25T15:57:42.620 INFO:tasks.workunit.client.1.smithi155.stdout:2/696: dread - d7/db/d2e/d6f/d91/fb6 zero size 2024-04-25T15:57:42.622 INFO:tasks.workunit.client.1.smithi155.stdout:8/444: dwrite d2/f14 [0,4194304] 0 2024-04-25T15:57:42.624 INFO:tasks.workunit.client.1.smithi155.stdout:3/680: getdents d1/d4/d10/d21/d73/d8d 0 2024-04-25T15:57:42.626 INFO:tasks.workunit.client.1.smithi155.stdout:5/660: dwrite d0/d47/d59/fc5 [0,4194304] 0 2024-04-25T15:57:42.628 INFO:tasks.workunit.client.1.smithi155.stdout:6/765: rename d0/d1a/d25/d51/c3a to d0/d1a/cf1 0 2024-04-25T15:57:42.634 INFO:tasks.workunit.client.1.smithi155.stdout:7/695: dwrite d2/dd/f4e [0,4194304] 0 2024-04-25T15:57:42.634 INFO:tasks.workunit.client.1.smithi155.stdout:5/661: unlink d0/d3/d15/d1f/c5e 0 2024-04-25T15:57:42.634 INFO:tasks.workunit.client.1.smithi155.stdout:3/681: symlink d1/le7 0 2024-04-25T15:57:42.636 INFO:tasks.workunit.client.1.smithi155.stdout:7/696: stat d2/d26/d3d/d6d/f95 0 2024-04-25T15:57:42.637 INFO:tasks.workunit.client.1.smithi155.stdout:2/697: dread d7/d23/fb3 [0,4194304] 0 2024-04-25T15:57:42.638 INFO:tasks.workunit.client.1.smithi155.stdout:6/766: write d0/d1a/d21/fea [739611,89225] 0 2024-04-25T15:57:42.638 INFO:tasks.workunit.client.1.smithi155.stdout:3/682: rmdir d1/d4/db/d20 39 2024-04-25T15:57:42.639 INFO:tasks.workunit.client.1.smithi155.stdout:2/698: stat d7/db/dd/d15/d60/f79 0 2024-04-25T15:57:42.641 INFO:tasks.workunit.client.1.smithi155.stdout:5/662: symlink d0/d3/d15/d30/d4f/ld7 0 2024-04-25T15:57:42.643 INFO:tasks.workunit.client.1.smithi155.stdout:5/663: fdatasync d0/d3/d2c/f9e 0 2024-04-25T15:57:42.644 INFO:tasks.workunit.client.1.smithi155.stdout:2/699: symlink d7/d23/le1 0 2024-04-25T15:57:42.644 INFO:tasks.workunit.client.1.smithi155.stdout:6/767: chown d0/l1f 2039710363 1 2024-04-25T15:57:42.645 INFO:tasks.workunit.client.1.smithi155.stdout:5/664: dread - d0/d3/d15/d9f/dc3/fd0 zero size 2024-04-25T15:57:42.646 INFO:tasks.workunit.client.1.smithi155.stdout:7/697: dwrite d2/d26/d3d/d65/f9f [0,4194304] 0 2024-04-25T15:57:42.647 INFO:tasks.workunit.client.1.smithi155.stdout:5/665: stat d0/c1d 0 2024-04-25T15:57:42.649 INFO:tasks.workunit.client.1.smithi155.stdout:7/698: truncate d2/dd/d36/dcd/fe4 517463 0 2024-04-25T15:57:42.652 INFO:tasks.workunit.client.1.smithi155.stdout:5/666: write d0/d3/d2c/d94/fc8 [207299,103009] 0 2024-04-25T15:57:42.655 INFO:tasks.workunit.client.1.smithi155.stdout:7/699: truncate d2/dd/d63/f77 1760004 0 2024-04-25T15:57:42.657 INFO:tasks.workunit.client.1.smithi155.stdout:6/768: dwrite d0/d1a/d21/f32 [4194304,4194304] 0 2024-04-25T15:57:42.662 INFO:tasks.workunit.client.1.smithi155.stdout:9/546: sync 2024-04-25T15:57:42.662 INFO:tasks.workunit.client.1.smithi155.stdout:9/547: chown dc/d13/d2e/d4c/fa2 123935829 1 2024-04-25T15:57:42.662 INFO:tasks.workunit.client.1.smithi155.stdout:6/769: symlink d0/d1a/lf2 0 2024-04-25T15:57:42.663 INFO:tasks.workunit.client.1.smithi155.stdout:9/548: chown dc/d13/d2e/f37 3025 1 2024-04-25T15:57:42.663 INFO:tasks.workunit.client.1.smithi155.stdout:2/700: dwrite d7/f49 [0,4194304] 0 2024-04-25T15:57:42.664 INFO:tasks.workunit.client.1.smithi155.stdout:6/770: stat d0/d13/d34/d38/d7a/fd8 0 2024-04-25T15:57:42.664 INFO:tasks.workunit.client.1.smithi155.stdout:2/701: readlink d7/db/dd/d15/d60/l66 0 2024-04-25T15:57:42.666 INFO:tasks.workunit.client.1.smithi155.stdout:5/667: write d0/d3/fcc [382984,4064] 0 2024-04-25T15:57:42.666 INFO:tasks.workunit.client.1.smithi155.stdout:7/700: write d2/dd/d30/d44/fe7 [934016,21527] 0 2024-04-25T15:57:42.667 INFO:tasks.workunit.client.1.smithi155.stdout:2/702: truncate d7/d8e/db9/fdc 169511 0 2024-04-25T15:57:42.668 INFO:tasks.workunit.client.1.smithi155.stdout:9/549: chown dc/d13/d48/l6a 7 1 2024-04-25T15:57:42.670 INFO:tasks.workunit.client.1.smithi155.stdout:5/668: rmdir d0/d3/d15/d30 39 2024-04-25T15:57:42.670 INFO:tasks.workunit.client.1.smithi155.stdout:7/701: write d2/dd/d36/d46/f9e [807838,84831] 0 2024-04-25T15:57:42.671 INFO:tasks.workunit.client.1.smithi155.stdout:6/771: getdents d0/d1a/d87 0 2024-04-25T15:57:42.671 INFO:tasks.workunit.client.1.smithi155.stdout:2/703: symlink d7/db/d29/d83/dbe/le2 0 2024-04-25T15:57:42.672 INFO:tasks.workunit.client.1.smithi155.stdout:9/550: rename dc/d11/c92 to dc/d11/d67/cbc 0 2024-04-25T15:57:42.673 INFO:tasks.workunit.client.1.smithi155.stdout:7/702: mkdir d2/de9 0 2024-04-25T15:57:42.673 INFO:tasks.workunit.client.1.smithi155.stdout:5/669: dread d0/d47/db3/fba [0,4194304] 0 2024-04-25T15:57:42.674 INFO:tasks.workunit.client.1.smithi155.stdout:6/772: symlink d0/d13/d7c/lf3 0 2024-04-25T15:57:42.676 INFO:tasks.workunit.client.1.smithi155.stdout:2/704: fsync d7/db/dd/d15/f33 0 2024-04-25T15:57:42.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/703: truncate d2/d26/d3d/d65/f86 61954 0 2024-04-25T15:57:42.676 INFO:tasks.workunit.client.1.smithi155.stdout:5/670: write d0/d3/d2c/d94/fc8 [1390091,21652] 0 2024-04-25T15:57:42.678 INFO:tasks.workunit.client.1.smithi155.stdout:2/705: chown d7/db/c8d 860 1 2024-04-25T15:57:42.679 INFO:tasks.workunit.client.1.smithi155.stdout:7/704: mknod d2/dd/d30/d44/cea 0 2024-04-25T15:57:42.680 INFO:tasks.workunit.client.1.smithi155.stdout:5/671: mknod d0/d58/d63/cd8 0 2024-04-25T15:57:42.683 INFO:tasks.workunit.client.1.smithi155.stdout:3/683: dread d1/d4/d10/d21/d73/f59 [0,4194304] 0 2024-04-25T15:57:42.684 INFO:tasks.workunit.client.1.smithi155.stdout:5/672: creat d0/d3/d15/d9f/fd9 x:0 0 0 2024-04-25T15:57:42.686 INFO:tasks.workunit.client.1.smithi155.stdout:7/705: mknod d2/dd/d12/d76/db6/ceb 0 2024-04-25T15:57:42.687 INFO:tasks.workunit.client.1.smithi155.stdout:9/551: symlink dc/d11/d67/d9c/lbd 0 2024-04-25T15:57:42.691 INFO:tasks.workunit.client.1.smithi155.stdout:9/552: write dc/d13/d59/f5f [1086625,65217] 0 2024-04-25T15:57:42.692 INFO:tasks.workunit.client.1.smithi155.stdout:2/706: dwrite d7/db/d2e/d6f/d91/faf [0,4194304] 0 2024-04-25T15:57:42.695 INFO:tasks.workunit.client.1.smithi155.stdout:7/706: truncate d2/dd/f16 881871 0 2024-04-25T15:57:42.695 INFO:tasks.workunit.client.1.smithi155.stdout:6/773: dread d0/d1a/d25/d51/f84 [0,4194304] 0 2024-04-25T15:57:42.696 INFO:tasks.workunit.client.1.smithi155.stdout:3/684: dwrite d1/d4/db/d28/d58/f92 [0,4194304] 0 2024-04-25T15:57:42.697 INFO:tasks.workunit.client.1.smithi155.stdout:7/707: write d2/dd/d30/d44/ddd/fe6 [742918,23975] 0 2024-04-25T15:57:42.698 INFO:tasks.workunit.client.1.smithi155.stdout:5/673: dread d0/d3/d15/d9f/dc3/fd3 [0,4194304] 0 2024-04-25T15:57:42.699 INFO:tasks.workunit.client.1.smithi155.stdout:6/774: dread - d0/d13/d43/f93 zero size 2024-04-25T15:57:42.699 INFO:tasks.workunit.client.1.smithi155.stdout:9/553: read dc/d13/d2e/f57 [1435505,124084] 0 2024-04-25T15:57:42.701 INFO:tasks.workunit.client.1.smithi155.stdout:7/708: symlink d2/d26/d3d/lec 0 2024-04-25T15:57:42.703 INFO:tasks.workunit.client.1.smithi155.stdout:5/674: creat d0/d47/db3/fda x:0 0 0 2024-04-25T15:57:42.704 INFO:tasks.workunit.client.1.smithi155.stdout:6/775: creat d0/d13/d7c/ff4 x:0 0 0 2024-04-25T15:57:42.705 INFO:tasks.workunit.client.1.smithi155.stdout:6/776: chown d0/d13/d43/fc7 0 1 2024-04-25T15:57:42.706 INFO:tasks.workunit.client.1.smithi155.stdout:3/685: symlink d1/d4/db/d20/d44/le8 0 2024-04-25T15:57:42.707 INFO:tasks.workunit.client.1.smithi155.stdout:3/686: readlink d1/d4/db/l50 0 2024-04-25T15:57:42.709 INFO:tasks.workunit.client.1.smithi155.stdout:9/554: rename dc/d17/f1b to dc/d17/d2a/fbe 0 2024-04-25T15:57:42.710 INFO:tasks.workunit.client.1.smithi155.stdout:7/709: symlink d2/dd/d66/d71/led 0 2024-04-25T15:57:42.713 INFO:tasks.workunit.client.1.smithi155.stdout:9/555: rmdir dc/d17/d18 39 2024-04-25T15:57:42.717 INFO:tasks.workunit.client.1.smithi155.stdout:3/687: dwrite d1/d4/fc7 [4194304,4194304] 0 2024-04-25T15:57:42.719 INFO:tasks.workunit.client.1.smithi155.stdout:9/556: fsync dc/d13/f3b 0 2024-04-25T15:57:42.721 INFO:tasks.workunit.client.1.smithi155.stdout:2/707: truncate d7/db/dd/f38 2121938 0 2024-04-25T15:57:42.721 INFO:tasks.workunit.client.1.smithi155.stdout:5/675: mkdir d0/d3/d15/d1f/d50/ddb 0 2024-04-25T15:57:42.722 INFO:tasks.workunit.client.1.smithi155.stdout:7/710: dwrite d2/d26/d3d/d65/f9f [4194304,4194304] 0 2024-04-25T15:57:42.724 INFO:tasks.workunit.client.1.smithi155.stdout:2/708: mknod d7/d23/ce3 0 2024-04-25T15:57:42.725 INFO:tasks.workunit.client.1.smithi155.stdout:3/688: truncate d1/d4/db/d91/dc4/d6c/fe3 566540 0 2024-04-25T15:57:42.726 INFO:tasks.workunit.client.1.smithi155.stdout:2/709: readlink d7/db/d29/d83/dbe/lde 0 2024-04-25T15:57:42.728 INFO:tasks.workunit.client.1.smithi155.stdout:7/711: unlink d2/d26/ld7 0 2024-04-25T15:57:42.729 INFO:tasks.workunit.client.1.smithi155.stdout:7/712: fdatasync d2/fa2 0 2024-04-25T15:57:42.730 INFO:tasks.workunit.client.1.smithi155.stdout:7/713: chown d2/dd 115043551 1 2024-04-25T15:57:42.730 INFO:tasks.workunit.client.1.smithi155.stdout:3/689: mkdir d1/d4/d10/d21/d73/d77/de9 0 2024-04-25T15:57:42.731 INFO:tasks.workunit.client.1.smithi155.stdout:2/710: mknod d7/db/d2e/d90/ce4 0 2024-04-25T15:57:42.732 INFO:tasks.workunit.client.1.smithi155.stdout:6/777: dread d0/d1a/d87/fd4 [0,4194304] 0 2024-04-25T15:57:42.734 INFO:tasks.workunit.client.1.smithi155.stdout:9/557: getdents dc/d13/d48 0 2024-04-25T15:57:42.737 INFO:tasks.workunit.client.1.smithi155.stdout:7/714: chown d2/dd/d12/f20 26 1 2024-04-25T15:57:42.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.731+0000 7f59bf142640 1 Processor -- start 2024-04-25T15:57:42.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.731+0000 7f59bf142640 1 -- start start 2024-04-25T15:57:42.738 INFO:tasks.workunit.client.1.smithi155.stdout:7/715: chown d2/d26/ld5 921 1 2024-04-25T15:57:42.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bf142640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b80a8cc0 0x7f59b81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:42.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bf142640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59b8152870 0x7f59b8155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:42.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bf142640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b8152c80 con 0x7f59b8155780 2024-04-25T15:57:42.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bf142640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f59b80aebc0 con 0x7f59b8152870 2024-04-25T15:57:42.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bf142640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f59b8158f20 con 0x7f59b80a8cc0 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bd6df640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f59b8155780 0x7f59b806c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45626/0 (socket says 172.21.15.87:45626) 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bd6df640 1 -- 172.21.15.87:0/2105878065 learned_addr learned my addr 172.21.15.87:0/2105878065 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bcede640 1 --2- 172.21.15.87:0/2105878065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b80a8cc0 0x7f59b81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59b7fff640 1 --2- 172.21.15.87:0/2105878065 >> v2:172.21.15.155:3300/0 conn(0x7f59b8152870 0x7f59b8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59b77fe640 1 -- 172.21.15.87:0/2105878065 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877594585 0 0) 0x7f59b8152c80 con 0x7f59b8155780 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59b77fe640 1 -- 172.21.15.87:0/2105878065 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003530 con 0x7f59b8155780 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bcede640 1 -- 172.21.15.87:0/2105878065 >> v2:172.21.15.155:3300/0 conn(0x7f59b8152870 msgr2=0x7f59b8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bcede640 1 --2- 172.21.15.87:0/2105878065 >> v2:172.21.15.155:3300/0 conn(0x7f59b8152870 0x7f59b8155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bcede640 1 -- 172.21.15.87:0/2105878065 >> v1:172.21.15.87:6789/0 conn(0x7f59b8155780 legacy=0x7f59b806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.735+0000 7f59bcede640 1 -- 172.21.15.87:0/2105878065 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80ae8e0 con 0x7f59b80a8cc0 2024-04-25T15:57:42.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bcede640 1 --2- 172.21.15.87:0/2105878065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b80a8cc0 0x7f59b81593b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59b80aed40 tx=0x7f59ac01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c382c7d2701d5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:42.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59b77fe640 1 -- 172.21.15.87:0/2105878065 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0b0070 con 0x7f59b80a8cc0 2024-04-25T15:57:42.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59b77fe640 1 -- 172.21.15.87:0/2105878065 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac004230 con 0x7f59b80a8cc0 2024-04-25T15:57:42.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59b77fe640 1 -- 172.21.15.87:0/2105878065 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac003620 con 0x7f59b80a8cc0 2024-04-25T15:57:42.746 INFO:tasks.workunit.client.1.smithi155.stdout:6/778: mkdir d0/d13/d34/d38/d7a/df5 0 2024-04-25T15:57:42.746 INFO:tasks.workunit.client.1.smithi155.stdout:7/716: dread - d2/dd/d13/f9b zero size 2024-04-25T15:57:42.746 INFO:tasks.workunit.client.1.smithi155.stdout:3/690: dwrite d1/d4/f2d [0,4194304] 0 2024-04-25T15:57:42.746 INFO:tasks.workunit.client.1.smithi155.stdout:9/558: write dc/d11/d30/d46/da0/fa5 [430256,121609] 0 2024-04-25T15:57:42.747 INFO:tasks.workunit.client.1.smithi155.stdout:6/779: symlink d0/d13/d7c/lf6 0 2024-04-25T15:57:42.747 INFO:tasks.workunit.client.1.smithi155.stdout:3/691: chown d1/d4/db/d28/d58/faf 298960 1 2024-04-25T15:57:42.747 INFO:tasks.workunit.client.1.smithi155.stdout:9/559: write dc/d13/d2e/d4c/fa2 [615288,128110] 0 2024-04-25T15:57:42.747 INFO:tasks.workunit.client.1.smithi155.stdout:2/711: creat d7/db/dd/d15/fe5 x:0 0 0 2024-04-25T15:57:42.747 INFO:tasks.workunit.client.1.smithi155.stdout:9/560: chown dc/d11/d67/caf 0 1 2024-04-25T15:57:42.748 INFO:tasks.workunit.client.1.smithi155.stdout:2/712: write d7/db/dd/d15/f45 [1516123,25719] 0 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 -- 172.21.15.87:0/2105878065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b80a8cc0 msgr2=0x7f59b81593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 --2- 172.21.15.87:0/2105878065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b80a8cc0 0x7f59b81593b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59b80aed40 tx=0x7f59ac01c350 comp rx=0 tx=0).stop 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 -- 172.21.15.87:0/2105878065 shutdown_connections 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 --2- 172.21.15.87:0/2105878065 >> v2:172.21.15.155:3300/0 conn(0x7f59b8152870 0x7f59b8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 --2- 172.21.15.87:0/2105878065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b80a8cc0 0x7f59b81593b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 -- 172.21.15.87:0/2105878065 >> 172.21.15.87:0/2105878065 conn(0x7f59b806d780 msgr2=0x7f59b806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 -- 172.21.15.87:0/2105878065 shutdown_connections 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.739+0000 7f59bf142640 1 -- 172.21.15.87:0/2105878065 wait complete. 2024-04-25T15:57:42.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 Processor -- start 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 -- start start 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80a8cc0 0x7f59b80aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 0x7f59b8152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b8155780 0x7f59b814ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59b80ac870 con 0x7f59b8155780 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f59b80ac6f0 con 0x7f59b80a8cc0 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bf142640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f59b81623e0 con 0x7f59b8152870 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 0x7f59b8152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bcede640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80a8cc0 0x7f59b80aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 0x7f59b8152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:36974/0 (socket says 172.21.15.87:36974) 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bcede640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80a8cc0 0x7f59b80aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:39162/0 (socket says 172.21.15.87:39162) 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 -- 172.21.15.87:0/3164742987 learned_addr learned my addr 172.21.15.87:0/3164742987 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:42.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59bd6df640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b8155780 0x7f59b814ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 -- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80a8cc0 msgr2=0x7f59b80aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80a8cc0 0x7f59b80aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 -- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b8155780 msgr2=0x7f59b814ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b8155780 0x7f59b814ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 -- 172.21.15.87:0/3164742987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80ab050 con 0x7f59b8152870 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.743+0000 7f59b7fff640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 0x7f59b8152f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009a70 tx=0x7f59a4009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.747+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a401e070 con 0x7f59b8152870 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.747+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a400bab0 con 0x7f59b8152870 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.747+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4019410 con 0x7f59b8152870 2024-04-25T15:57:42.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.747+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b80c8930 con 0x7f59b8152870 2024-04-25T15:57:42.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.747+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b80a93d0 con 0x7f59b8152870 2024-04-25T15:57:42.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.747+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b8069bb0 con 0x7f59b8152870 2024-04-25T15:57:42.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.751+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f59a4021070 con 0x7f59b8152870 2024-04-25T15:57:42.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.751+0000 7f59b57fa640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f599c06f400 0x7f599c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:42.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.751+0000 7f59bcede640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f599c06f400 0x7f599c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:42.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.751+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f59a40933b0 con 0x7f59b8152870 2024-04-25T15:57:42.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.751+0000 7f59bcede640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f599c06f400 0x7f599c071910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0ad000 tx=0x7f59ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:6/780: symlink d0/d1a/d25/d2e/lf7 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:2/713: read d7/db/d2e/d44/f4b [65407,32059] 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:3/692: creat d1/d4/db/d20/d44/d52/fea x:0 0 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:5/676: dread d0/d58/f29 [0,4194304] 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:9/561: creat dc/d13/d59/fbf x:0 0 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:6/781: write d0/f1 [1782948,19707] 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:9/562: write dc/d13/d2e/f4a [1256366,93330] 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:2/714: read d7/db/d29/d83/d86/fa9 [3704085,57582] 0 2024-04-25T15:57:42.758 INFO:tasks.workunit.client.1.smithi155.stdout:5/677: getdents d0/d47/d59 0 2024-04-25T15:57:42.759 INFO:tasks.workunit.client.1.smithi155.stdout:9/563: mkdir dc/d17/dc0 0 2024-04-25T15:57:42.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:42.755+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59a405f870 con 0x7f59b8152870 2024-04-25T15:57:42.760 INFO:tasks.workunit.client.1.smithi155.stdout:5/678: dread - d0/d3/d15/d1f/d50/d60/fc6 zero size 2024-04-25T15:57:42.760 INFO:tasks.workunit.client.1.smithi155.stdout:2/715: creat d7/db/d2e/d90/fe6 x:0 0 0 2024-04-25T15:57:42.761 INFO:tasks.workunit.client.1.smithi155.stdout:9/564: fsync dc/d2f/f7b 0 2024-04-25T15:57:42.764 INFO:tasks.workunit.client.1.smithi155.stdout:3/693: dwrite d1/d4/db/d20/d44/d52/d61/d89/f8c [0,4194304] 0 2024-04-25T15:57:42.764 INFO:tasks.workunit.client.1.smithi155.stdout:1/671: sync 2024-04-25T15:57:42.766 INFO:tasks.workunit.client.1.smithi155.stdout:5/679: chown d0/d3/d15/d1f/d50/d60/lbd 217891548 1 2024-04-25T15:57:42.767 INFO:tasks.workunit.client.1.smithi155.stdout:3/694: chown d1/d4/db/d91/dc4/dd9/d86/la7 598 1 2024-04-25T15:57:42.774 INFO:tasks.workunit.client.1.smithi155.stdout:3/695: unlink d1/d4/db/d20/d44/d52/d61/cb0 0 2024-04-25T15:57:42.775 INFO:tasks.workunit.client.1.smithi155.stdout:1/672: dwrite d1/d16/d1d/d29/f9a [0,4194304] 0 2024-04-25T15:57:42.781 INFO:tasks.workunit.client.1.smithi155.stdout:9/565: dwrite dc/d11/d30/d46/da0/fa5 [0,4194304] 0 2024-04-25T15:57:42.781 INFO:tasks.workunit.client.1.smithi155.stdout:7/717: dread d2/d26/d3d/d6d/f5d [0,4194304] 0 2024-04-25T15:57:42.782 INFO:tasks.workunit.client.1.smithi155.stdout:7/718: stat d2/dd/d63/l99 0 2024-04-25T15:57:42.782 INFO:tasks.workunit.client.1.smithi155.stdout:3/696: mkdir d1/d4/d10/d21/deb 0 2024-04-25T15:57:42.783 INFO:tasks.workunit.client.1.smithi155.stdout:2/716: write d7/db/d2e/f69 [36241,75502] 0 2024-04-25T15:57:42.783 INFO:tasks.workunit.client.1.smithi155.stdout:9/566: creat dc/d17/d2a/fc1 x:0 0 0 2024-04-25T15:57:42.786 INFO:tasks.workunit.client.1.smithi155.stdout:7/719: chown d2/dd/d36/dcd/fe4 126982428 1 2024-04-25T15:57:42.788 INFO:tasks.workunit.client.1.smithi155.stdout:6/782: dread d0/d13/d34/d6c/fcd [0,4194304] 0 2024-04-25T15:57:42.789 INFO:tasks.workunit.client.1.smithi155.stdout:3/697: mknod d1/d4/db/cec 0 2024-04-25T15:57:42.795 INFO:tasks.workunit.client.1.smithi155.stdout:3/698: read d1/d4/db/d28/f31 [587704,53292] 0 2024-04-25T15:57:42.796 INFO:tasks.workunit.client.1.smithi155.stdout:6/783: fsync d0/d1a/d25/d51/f3b 0 2024-04-25T15:57:42.797 INFO:tasks.workunit.client.1.smithi155.stdout:7/720: dread d2/dd/d30/d44/ddd/fe6 [0,4194304] 0 2024-04-25T15:57:42.797 INFO:tasks.workunit.client.1.smithi155.stdout:9/567: dread dc/d17/f20 [0,4194304] 0 2024-04-25T15:57:42.799 INFO:tasks.workunit.client.1.smithi155.stdout:2/717: dwrite d7/db/dd/fab [0,4194304] 0 2024-04-25T15:57:42.801 INFO:tasks.workunit.client.1.smithi155.stdout:1/673: dwrite d1/f61 [0,4194304] 0 2024-04-25T15:57:42.801 INFO:tasks.workunit.client.1.smithi155.stdout:6/784: symlink d0/d1a/d37/dec/lf8 0 2024-04-25T15:57:42.802 INFO:tasks.workunit.client.1.smithi155.stdout:7/721: creat d2/dd/d30/dbc/fee x:0 0 0 2024-04-25T15:57:42.803 INFO:tasks.workunit.client.1.smithi155.stdout:3/699: symlink d1/d4/d10/d21/d73/d77/d57/d80/led 0 2024-04-25T15:57:42.805 INFO:tasks.workunit.client.1.smithi155.stdout:6/785: write d0/d18/d54/fa8 [375762,67933] 0 2024-04-25T15:57:42.805 INFO:tasks.workunit.client.1.smithi155.stdout:1/674: read d1/d16/d1d/d29/f9a [1577938,108189] 0 2024-04-25T15:57:42.805 INFO:tasks.workunit.client.1.smithi155.stdout:9/568: dread dc/d17/f20 [0,4194304] 0 2024-04-25T15:57:42.809 INFO:tasks.workunit.client.1.smithi155.stdout:9/569: truncate dc/d3c/d9b/fb2 245217 0 2024-04-25T15:57:42.809 INFO:tasks.workunit.client.1.smithi155.stdout:6/786: unlink d0/d1a/d25/f2d 0 2024-04-25T15:57:42.809 INFO:tasks.workunit.client.1.smithi155.stdout:1/675: write d1/d16/d1d/f99 [421185,102049] 0 2024-04-25T15:57:42.811 INFO:tasks.workunit.client.1.smithi155.stdout:3/700: mkdir d1/d4/d10/d21/d73/d77/d5f/dee 0 2024-04-25T15:57:42.812 INFO:tasks.workunit.client.1.smithi155.stdout:1/676: chown d1/d16/d1d/d29/d5f/d34/d68/l78 501576 1 2024-04-25T15:57:42.814 INFO:tasks.workunit.client.1.smithi155.stdout:6/787: rename d0/l1f to d0/d1a/d25/d51/lf9 0 2024-04-25T15:57:42.815 INFO:tasks.workunit.client.1.smithi155.stdout:6/788: fsync d0/d13/f17 0 2024-04-25T15:57:42.815 INFO:tasks.workunit.client.1.smithi155.stdout:9/570: creat dc/d17/d18/fc2 x:0 0 0 2024-04-25T15:57:42.815 INFO:tasks.workunit.client.1.smithi155.stdout:3/701: rmdir d1/d4/db/d91 39 2024-04-25T15:57:42.816 INFO:tasks.workunit.client.1.smithi155.stdout:9/571: fdatasync dc/d11/f42 0 2024-04-25T15:57:42.817 INFO:tasks.workunit.client.1.smithi155.stdout:1/677: creat d1/d16/d1d/d29/d5f/d34/d68/d93/db7/fda x:0 0 0 2024-04-25T15:57:42.818 INFO:tasks.workunit.client.1.smithi155.stdout:9/572: write dc/d13/fa7 [332999,22652] 0 2024-04-25T15:57:42.819 INFO:tasks.workunit.client.1.smithi155.stdout:6/789: mknod d0/d1a/da1/dac/cfa 0 2024-04-25T15:57:42.819 INFO:tasks.workunit.client.1.smithi155.stdout:3/702: symlink d1/d4/d10/d21/d73/d77/de9/lef 0 2024-04-25T15:57:42.821 INFO:tasks.workunit.client.1.smithi155.stdout:9/573: creat dc/d11/d30/fc3 x:0 0 0 2024-04-25T15:57:42.822 INFO:tasks.workunit.client.1.smithi155.stdout:6/790: creat d0/d13/d34/d38/d7a/ffb x:0 0 0 2024-04-25T15:57:42.822 INFO:tasks.workunit.client.1.smithi155.stdout:9/574: fsync dc/d17/d8e/dae/fb0 0 2024-04-25T15:57:42.823 INFO:tasks.workunit.client.1.smithi155.stdout:1/678: creat d1/d16/d1d/d5e/fdb x:0 0 0 2024-04-25T15:57:42.825 INFO:tasks.workunit.client.1.smithi155.stdout:9/575: mkdir dc/d11/dc4 0 2024-04-25T15:57:42.826 INFO:tasks.workunit.client.1.smithi155.stdout:6/791: symlink d0/d13/d34/d38/d90/lfc 0 2024-04-25T15:57:42.826 INFO:tasks.workunit.client.1.smithi155.stdout:3/703: link d1/d4/db/d20/d44/d52/d61/cc1 d1/d4/db/d20/d44/d52/d93/cf0 0 2024-04-25T15:57:42.827 INFO:tasks.workunit.client.1.smithi155.stdout:6/792: chown d0/d13/d34/d38/f88 22383527 1 2024-04-25T15:57:42.827 INFO:tasks.workunit.client.1.smithi155.stdout:9/576: creat dc/d17/d2a/fc5 x:0 0 0 2024-04-25T15:57:42.829 INFO:tasks.workunit.client.1.smithi155.stdout:1/679: creat d1/d16/d1d/d29/d5f/d34/d68/d93/fdc x:0 0 0 2024-04-25T15:57:42.830 INFO:tasks.workunit.client.1.smithi155.stdout:7/722: dread d2/f94 [0,4194304] 0 2024-04-25T15:57:42.830 INFO:tasks.workunit.client.1.smithi155.stdout:3/704: symlink d1/d4/db/d91/dc4/d6c/lf1 0 2024-04-25T15:57:42.831 INFO:tasks.workunit.client.1.smithi155.stdout:1/680: rmdir d1/d16/d1d 39 2024-04-25T15:57:42.832 INFO:tasks.workunit.client.1.smithi155.stdout:6/793: link d0/d13/d7c/da9/fb2 d0/d13/d34/d38/d7a/df5/ffd 0 2024-04-25T15:57:42.835 INFO:tasks.workunit.client.1.smithi155.stdout:6/794: read d0/f4f [7908198,100236] 0 2024-04-25T15:57:42.839 INFO:tasks.workunit.client.1.smithi155.stdout:7/723: dwrite d2/d26/d3d/d6d/f95 [0,4194304] 0 2024-04-25T15:57:42.844 INFO:tasks.workunit.client.1.smithi155.stdout:7/724: symlink d2/dd/d12/d76/lef 0 2024-04-25T15:57:42.844 INFO:tasks.workunit.client.1.smithi155.stdout:6/795: write d0/d1a/d87/fd4 [1812010,97574] 0 2024-04-25T15:57:42.844 INFO:tasks.workunit.client.1.smithi155.stdout:7/725: chown d2/dd/d36/f62 9 1 2024-04-25T15:57:42.844 INFO:tasks.workunit.client.1.smithi155.stdout:6/796: chown d0/d1a/d87/fd4 16363121 1 2024-04-25T15:57:42.846 INFO:tasks.workunit.client.1.smithi155.stdout:7/726: truncate d2/dd/f23 1561865 0 2024-04-25T15:57:42.849 INFO:tasks.workunit.client.1.smithi155.stdout:6/797: rename d0/d13/d43/d56 to d0/d1a/d37/dda/dfe 0 2024-04-25T15:57:42.849 INFO:tasks.workunit.client.1.smithi155.stdout:2/718: write d7/db/d2e/d44/d70/d7b/d9f/fa6 [1848348,46341] 0 2024-04-25T15:57:42.849 INFO:tasks.workunit.client.1.smithi155.stdout:1/681: dwrite d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 [0,4194304] 0 2024-04-25T15:57:42.852 INFO:tasks.workunit.client.1.smithi155.stdout:6/798: dread - d0/d13/dd1/fd6 zero size 2024-04-25T15:57:42.852 INFO:tasks.workunit.client.1.smithi155.stdout:1/682: chown d1/c3 13 1 2024-04-25T15:57:42.858 INFO:tasks.workunit.client.1.smithi155.stdout:2/719: truncate d7/db/dd/f11 250087 0 2024-04-25T15:57:42.863 INFO:tasks.workunit.client.1.smithi155.stdout:7/727: dwrite d2/f94 [0,4194304] 0 2024-04-25T15:57:42.867 INFO:tasks.workunit.client.1.smithi155.stdout:6/799: dwrite d0/d13/f17 [4194304,4194304] 0 2024-04-25T15:57:42.868 INFO:tasks.workunit.client.1.smithi155.stdout:7/728: readlink d2/dd/d30/la0 0 2024-04-25T15:57:42.871 INFO:tasks.workunit.client.1.smithi155.stdout:1/683: dwrite d1/d16/f2c [0,4194304] 0 2024-04-25T15:57:42.875 INFO:tasks.workunit.client.1.smithi155.stdout:6/800: creat d0/d18/d54/fff x:0 0 0 2024-04-25T15:57:42.877 INFO:tasks.workunit.client.1.smithi155.stdout:9/577: dwrite dc/d17/d2a/f35 [4194304,4194304] 0 2024-04-25T15:57:42.880 INFO:tasks.workunit.client.1.smithi155.stdout:6/801: write d0/f3 [5518761,115813] 0 2024-04-25T15:57:42.883 INFO:tasks.workunit.client.1.smithi155.stdout:1/684: write d1/d16/d1d/d33/da1/fb0 [3312820,74803] 0 2024-04-25T15:57:42.884 INFO:tasks.workunit.client.1.smithi155.stdout:9/578: readlink l2 0 2024-04-25T15:57:42.884 INFO:tasks.workunit.client.1.smithi155.stdout:6/802: chown d0/d13/d7c/d99/fb1 1365 1 2024-04-25T15:57:42.885 INFO:tasks.workunit.client.1.smithi155.stdout:1/685: stat d1/f61 0 2024-04-25T15:57:42.887 INFO:tasks.workunit.client.1.smithi155.stdout:9/579: write dc/d17/d18/fc2 [146350,1404] 0 2024-04-25T15:57:42.887 INFO:tasks.workunit.client.1.smithi155.stdout:7/729: rename d2/d26/d3d/d6d/l8f to d2/dd/d30/d44/lf0 0 2024-04-25T15:57:42.887 INFO:tasks.workunit.client.1.smithi155.stdout:1/686: readlink d1/d32/d86/la5 0 2024-04-25T15:57:42.890 INFO:tasks.workunit.client.1.smithi155.stdout:2/720: dwrite d7/db/d2e/d44/f7f [4194304,4194304] 0 2024-04-25T15:57:42.890 INFO:tasks.workunit.client.1.smithi155.stdout:7/730: mknod d2/dd/d63/cf1 0 2024-04-25T15:57:42.892 INFO:tasks.workunit.client.1.smithi155.stdout:7/731: chown d2/dd/d12 6759023 1 2024-04-25T15:57:42.892 INFO:tasks.workunit.client.1.smithi155.stdout:1/687: chown d1/d16/d1d/d29/d5f/d34/d68/cc0 257 1 2024-04-25T15:57:42.896 INFO:tasks.workunit.client.1.smithi155.stdout:2/721: unlink d7/c57 0 2024-04-25T15:57:42.898 INFO:tasks.workunit.client.1.smithi155.stdout:7/732: rmdir d2/dd/d66/db2/db9 39 2024-04-25T15:57:42.900 INFO:tasks.workunit.client.1.smithi155.stdout:0/636: sync 2024-04-25T15:57:42.901 INFO:tasks.workunit.client.1.smithi155.stdout:6/803: dwrite d0/d13/d43/fe3 [0,4194304] 0 2024-04-25T15:57:42.903 INFO:tasks.workunit.client.1.smithi155.stdout:2/722: chown d7/db/dd/f11 3263 1 2024-04-25T15:57:42.904 INFO:tasks.workunit.client.1.smithi155.stdout:7/733: symlink d2/dd/d13/d24/d35/lf2 0 2024-04-25T15:57:42.904 INFO:tasks.workunit.client.1.smithi155.stdout:2/723: chown d7/d23/f87 34684 1 2024-04-25T15:57:42.905 INFO:tasks.workunit.client.1.smithi155.stdout:0/637: fsync d1/d6/f8a 0 2024-04-25T15:57:42.908 INFO:tasks.workunit.client.1.smithi155.stdout:2/724: unlink d7/db/d2e/d6f/d91/l9b 0 2024-04-25T15:57:42.909 INFO:tasks.workunit.client.1.smithi155.stdout:0/638: creat d1/d3/d12/d92/fda x:0 0 0 2024-04-25T15:57:42.911 INFO:tasks.workunit.client.1.smithi155.stdout:6/804: rename d0/d13/d6f/f8f to d0/d1a/f100 0 2024-04-25T15:57:42.912 INFO:tasks.workunit.client.1.smithi155.stdout:2/725: creat d7/db/dd/d15/d60/d94/fe7 x:0 0 0 2024-04-25T15:57:42.913 INFO:tasks.workunit.client.1.smithi155.stdout:0/639: creat d1/d3/d3d/d46/da4/db6/fdb x:0 0 0 2024-04-25T15:57:42.915 INFO:tasks.workunit.client.1.smithi155.stdout:0/640: chown d1/f1b 41 1 2024-04-25T15:57:42.915 INFO:tasks.workunit.client.1.smithi155.stdout:7/734: rename d2/de9 to d2/dd/d12/df3 0 2024-04-25T15:57:42.916 INFO:tasks.workunit.client.1.smithi155.stdout:6/805: dread d0/f4f [4194304,4194304] 0 2024-04-25T15:57:42.917 INFO:tasks.workunit.client.1.smithi155.stdout:0/641: chown d1/d3/d5/da/l97 234343 1 2024-04-25T15:57:42.917 INFO:tasks.workunit.client.1.smithi155.stdout:0/642: chown d1/d3/d3d/d46/lcd 373227261 1 2024-04-25T15:57:42.918 INFO:tasks.workunit.client.1.smithi155.stdout:2/726: rename d7/db/d29/d83/dbe/le2 to d7/db/d29/d83/d86/db0/le8 0 2024-04-25T15:57:42.919 INFO:tasks.workunit.client.1.smithi155.stdout:0/643: write d1/f71 [5018977,129784] 0 2024-04-25T15:57:42.919 INFO:tasks.workunit.client.1.smithi155.stdout:7/735: creat d2/dd/d36/d46/ff4 x:0 0 0 2024-04-25T15:57:42.919 INFO:tasks.workunit.client.1.smithi155.stdout:6/806: fsync d0/d1a/d25/d51/f84 0 2024-04-25T15:57:42.921 INFO:tasks.workunit.client.1.smithi155.stdout:6/807: write d0/d1a/d21/d73/faa [3768749,22417] 0 2024-04-25T15:57:42.922 INFO:tasks.workunit.client.1.smithi155.stdout:2/727: rename f3 to d7/db/d2e/fe9 0 2024-04-25T15:57:42.924 INFO:tasks.workunit.client.1.smithi155.stdout:7/736: mkdir d2/dd/d12/d76/db6/df5 0 2024-04-25T15:57:42.925 INFO:tasks.workunit.client.1.smithi155.stdout:9/580: dread dc/d17/d2a/f35 [0,4194304] 0 2024-04-25T15:57:42.925 INFO:tasks.workunit.client.1.smithi155.stdout:7/737: fsync d2/dd/d36/f62 0 2024-04-25T15:57:42.926 INFO:tasks.workunit.client.1.smithi155.stdout:7/738: truncate d2/dd/d36/dcd/f98 355393 0 2024-04-25T15:57:42.927 INFO:tasks.workunit.client.1.smithi155.stdout:2/728: mknod d7/db/cea 0 2024-04-25T15:57:42.928 INFO:tasks.workunit.client.1.smithi155.stdout:0/644: link d1/d3/d5/d5b/dc4/c62 d1/d6/d29/d47/db0/dd1/cdc 0 2024-04-25T15:57:42.929 INFO:tasks.workunit.client.1.smithi155.stdout:9/581: write dc/d13/d60/f8a [983905,100428] 0 2024-04-25T15:57:42.929 INFO:tasks.workunit.client.1.smithi155.stdout:7/739: mknod d2/dd/d12/d76/db6/cf6 0 2024-04-25T15:57:42.930 INFO:tasks.workunit.client.1.smithi155.stdout:2/729: creat d7/db/d2e/d90/feb x:0 0 0 2024-04-25T15:57:42.931 INFO:tasks.workunit.client.1.smithi155.stdout:0/645: mknod d1/d85/cdd 0 2024-04-25T15:57:42.931 INFO:tasks.workunit.client.1.smithi155.stdout:1/688: dread d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:42.932 INFO:tasks.workunit.client.1.smithi155.stdout:9/582: creat dc/d13/d59/fc6 x:0 0 0 2024-04-25T15:57:42.933 INFO:tasks.workunit.client.1.smithi155.stdout:0/646: mknod d1/d3/d3d/d46/cde 0 2024-04-25T15:57:42.933 INFO:tasks.workunit.client.1.smithi155.stdout:9/583: rmdir dc/d3c 39 2024-04-25T15:57:42.934 INFO:tasks.workunit.client.1.smithi155.stdout:7/740: truncate d2/dd/d66/d8c/fc8 522995 0 2024-04-25T15:57:42.935 INFO:tasks.workunit.client.1.smithi155.stdout:0/647: creat d1/d6/d29/fdf x:0 0 0 2024-04-25T15:57:42.936 INFO:tasks.workunit.client.1.smithi155.stdout:1/689: truncate d1/d16/d1d/d29/d5f/d34/d68/f8a 884977 0 2024-04-25T15:57:42.939 INFO:tasks.workunit.client.1.smithi155.stdout:0/648: truncate d1/d85/d98/fb7 893702 0 2024-04-25T15:57:42.939 INFO:tasks.workunit.client.1.smithi155.stdout:1/690: unlink d1/d16/d1d/d33/l73 0 2024-04-25T15:57:42.942 INFO:tasks.workunit.client.1.smithi155.stdout:2/730: dwrite d7/db/dd/d15/d60/d94/fe7 [0,4194304] 0 2024-04-25T15:57:42.948 INFO:tasks.workunit.client.1.smithi155.stdout:7/741: dwrite d2/dd/d36/dcd/fe4 [0,4194304] 0 2024-04-25T15:57:42.954 INFO:tasks.workunit.client.1.smithi155.stdout:0/649: unlink d1/d3/d5/d5b/dc4/c33 0 2024-04-25T15:57:42.954 INFO:tasks.workunit.client.1.smithi155.stdout:1/691: symlink d1/d16/d1d/d29/d5f/ldd 0 2024-04-25T15:57:42.956 INFO:tasks.workunit.client.1.smithi155.stdout:2/731: dwrite d7/db/d29/d83/d86/db0/fc7 [0,4194304] 0 2024-04-25T15:57:42.957 INFO:tasks.workunit.client.1.smithi155.stdout:9/584: dread dc/d13/d48/f88 [0,4194304] 0 2024-04-25T15:57:42.963 INFO:tasks.workunit.client.1.smithi155.stdout:9/585: creat dc/d13/d60/fc7 x:0 0 0 2024-04-25T15:57:42.963 INFO:tasks.workunit.client.1.smithi155.stdout:2/732: read d7/db/ff [32917,37781] 0 2024-04-25T15:57:42.966 INFO:tasks.workunit.client.1.smithi155.stdout:7/742: rename d2/dd/d12/d76/db6/df5 to d2/dd/d12/df7 0 2024-04-25T15:57:42.968 INFO:tasks.workunit.client.1.smithi155.stdout:1/692: dwrite d1/d16/d1d/d29/d3d/d43/f48 [0,4194304] 0 2024-04-25T15:57:42.975 INFO:tasks.workunit.client.1.smithi155.stdout:2/733: fdatasync d7/db/dd/f38 0 2024-04-25T15:57:42.976 INFO:tasks.workunit.client.1.smithi155.stdout:0/650: write d1/d6/f2f [167730,107334] 0 2024-04-25T15:57:42.979 INFO:tasks.workunit.client.1.smithi155.stdout:0/651: write d1/d6/fca [1897392,36308] 0 2024-04-25T15:57:42.982 INFO:tasks.workunit.client.1.smithi155.stdout:2/734: dread d7/db/d2e/d44/f6b [0,4194304] 0 2024-04-25T15:57:42.983 INFO:tasks.workunit.client.1.smithi155.stdout:1/693: link d1/d16/d1d/d29/d3d/d43/f59 d1/d16/d1d/d29/d5f/d34/d68/d93/db7/fde 0 2024-04-25T15:57:42.983 INFO:tasks.workunit.client.1.smithi155.stdout:7/743: write d2/d26/d3d/d65/fe2 [163214,129464] 0 2024-04-25T15:57:42.985 INFO:tasks.workunit.client.1.smithi155.stdout:7/744: fdatasync d2/dd/d13/d24/d35/f3f 0 2024-04-25T15:57:42.986 INFO:tasks.workunit.client.1.smithi155.stdout:7/745: fsync d2/dd/d36/dcd/f98 0 2024-04-25T15:57:42.987 INFO:tasks.workunit.client.1.smithi155.stdout:2/735: unlink d7/d8e/db9/lcd 0 2024-04-25T15:57:42.987 INFO:tasks.workunit.client.1.smithi155.stdout:1/694: rmdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7 39 2024-04-25T15:57:42.988 INFO:tasks.workunit.client.1.smithi155.stdout:2/736: stat d7/db/d2e/d44/d70/cac 0 2024-04-25T15:57:42.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/652: write d1/d6/d29/f3a [2941643,116427] 0 2024-04-25T15:57:42.989 INFO:tasks.workunit.client.1.smithi155.stdout:1/695: read d1/d6/f6b [3998346,71138] 0 2024-04-25T15:57:42.991 INFO:tasks.workunit.client.1.smithi155.stdout:7/746: creat d2/dd/d13/d24/d8b/ff8 x:0 0 0 2024-04-25T15:57:42.991 INFO:tasks.workunit.client.1.smithi155.stdout:9/586: dread dc/d17/d18/f2d [0,4194304] 0 2024-04-25T15:57:42.992 INFO:tasks.workunit.client.1.smithi155.stdout:1/696: creat d1/d32/d77/fdf x:0 0 0 2024-04-25T15:57:42.995 INFO:tasks.workunit.client.1.smithi155.stdout:7/747: creat d2/d26/d3d/d6d/db3/ff9 x:0 0 0 2024-04-25T15:57:42.996 INFO:tasks.workunit.client.1.smithi155.stdout:0/653: write d1/d6/d29/d47/f55 [4588214,127054] 0 2024-04-25T15:57:42.999 INFO:tasks.workunit.client.1.smithi155.stdout:0/654: truncate d1/d3/d5/f13 1415538 0 2024-04-25T15:57:43.000 INFO:tasks.workunit.client.1.smithi155.stdout:0/655: write d1/d85/fa1 [695839,111418] 0 2024-04-25T15:57:43.007 INFO:tasks.workunit.client.1.smithi155.stdout:9/587: dread f7 [0,4194304] 0 2024-04-25T15:57:43.012 INFO:tasks.workunit.client.1.smithi155.stdout:1/697: dread d1/f11 [4194304,4194304] 0 2024-04-25T15:57:43.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59b8070890 con 0x7f59b8152870 2024-04-25T15:57:43.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59b57fa640 1 -- 172.21.15.87:0/3164742987 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f59a4063b70 con 0x7f59b8152870 2024-04-25T15:57:43.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:43.016 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:43.016 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:43.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f599c06f400 msgr2=0x7f599c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f599c06f400 0x7f599c071910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0ad000 tx=0x7f59ac008040 comp rx=0 tx=0).stop 2024-04-25T15:57:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 msgr2=0x7f59b8152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 0x7f59b8152f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009a70 tx=0x7f59a4009f30 comp rx=0 tx=0).stop 2024-04-25T15:57:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 shutdown_connections 2024-04-25T15:57:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f599c06f400 0x7f599c071910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:43.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59b8155780 0x7f59b814ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59b8152870 0x7f59b8152f00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 --2- 172.21.15.87:0/3164742987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59b80a8cc0 0x7f59b80aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 >> 172.21.15.87:0/3164742987 conn(0x7f59b806d780 msgr2=0x7f59b81580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 shutdown_connections 2024-04-25T15:57:43.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:43.011+0000 7f59bf142640 1 -- 172.21.15.87:0/3164742987 wait complete. 2024-04-25T15:57:43.026 INFO:tasks.workunit.client.1.smithi155.stdout:0/656: unlink d1/d41/f45 0 2024-04-25T15:57:43.029 INFO:tasks.workunit.client.1.smithi155.stdout:1/698: mkdir d1/d16/d1d/d33/da1/de0 0 2024-04-25T15:57:43.029 INFO:tasks.workunit.client.1.smithi155.stdout:7/748: write d2/d26/d3d/d6d/f8a [1722919,79599] 0 2024-04-25T15:57:43.031 INFO:tasks.workunit.client.1.smithi155.stdout:0/657: rmdir d1/d3/d3d/d46/da4 39 2024-04-25T15:57:43.032 INFO:tasks.workunit.client.1.smithi155.stdout:9/588: rename dc/d17/d2a/fbe to dc/d11/d67/fc8 0 2024-04-25T15:57:43.033 INFO:tasks.workunit.client.1.smithi155.stdout:1/699: chown d1/da0/caa 1084105 1 2024-04-25T15:57:43.033 INFO:tasks.workunit.client.1.smithi155.stdout:7/749: fdatasync d2/dd/d36/d46/f51 0 2024-04-25T15:57:43.034 INFO:tasks.workunit.client.1.smithi155.stdout:1/700: dread - d1/fc8 zero size 2024-04-25T15:57:43.036 INFO:tasks.workunit.client.1.smithi155.stdout:1/701: truncate d1/d16/d8f/fce 744477 0 2024-04-25T15:57:43.037 INFO:tasks.workunit.client.1.smithi155.stdout:1/702: readlink d1/d16/d1d/d29/d5f/la3 0 2024-04-25T15:57:43.038 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:43.038 INFO:tasks.workunit.client.1.smithi155.stdout:1/703: readlink d1/d16/d1d/d5e/lc3 0 2024-04-25T15:57:43.041 INFO:tasks.workunit.client.1.smithi155.stdout:4/637: sync 2024-04-25T15:57:43.045 INFO:tasks.workunit.client.1.smithi155.stdout:0/658: dwrite d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:43.045 INFO:tasks.workunit.client.1.smithi155.stdout:9/589: dwrite dc/d17/d2a/f2c [4194304,4194304] 0 2024-04-25T15:57:43.050 INFO:tasks.workunit.client.1.smithi155.stdout:1/704: dread d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 [0,4194304] 0 2024-04-25T15:57:43.050 INFO:tasks.workunit.client.1.smithi155.stdout:9/590: write dc/d3c/d9b/fb2 [421227,95828] 0 2024-04-25T15:57:43.053 INFO:tasks.workunit.client.1.smithi155.stdout:0/659: dread d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:43.055 INFO:tasks.workunit.client.1.smithi155.stdout:0/660: write d1/d3/d3d/dcb/fce [169755,112878] 0 2024-04-25T15:57:43.057 INFO:tasks.workunit.client.1.smithi155.stdout:1/705: truncate d1/d16/d1d/d29/d5f/d34/d68/d93/db7/fda 932950 0 2024-04-25T15:57:43.059 INFO:tasks.workunit.client.1.smithi155.stdout:1/706: write d1/d16/d1d/d29/d5f/d34/f56 [1427516,49850] 0 2024-04-25T15:57:43.066 INFO:tasks.workunit.client.1.smithi155.stdout:1/707: dread d1/d16/d1d/d29/d5f/f7c [0,4194304] 0 2024-04-25T15:57:43.071 INFO:tasks.workunit.client.1.smithi155.stdout:1/708: truncate d1/d16/d1d/d29/d5f/f85 769737 0 2024-04-25T15:57:43.072 INFO:tasks.workunit.client.1.smithi155.stdout:4/638: creat da/dc/d18/fe5 x:0 0 0 2024-04-25T15:57:43.074 INFO:tasks.workunit.client.1.smithi155.stdout:4/639: write da/d23/da2/fb8 [610525,101891] 0 2024-04-25T15:57:43.075 INFO:tasks.workunit.client.1.smithi155.stdout:1/709: mknod d1/d6/ce1 0 2024-04-25T15:57:43.077 INFO:tasks.workunit.client.1.smithi155.stdout:9/591: dread dc/d17/f51 [0,4194304] 0 2024-04-25T15:57:43.078 INFO:tasks.workunit.client.1.smithi155.stdout:4/640: symlink da/d23/d3f/dc6/dc8/le6 0 2024-04-25T15:57:43.081 INFO:tasks.workunit.client.1.smithi155.stdout:1/710: creat d1/d16/d1d/d5e/fe2 x:0 0 0 2024-04-25T15:57:43.082 INFO:tasks.workunit.client.1.smithi155.stdout:4/641: symlink da/d23/da2/le7 0 2024-04-25T15:57:43.088 INFO:tasks.workunit.client.1.smithi155.stdout:9/592: dwrite dc/f95 [0,4194304] 0 2024-04-25T15:57:43.094 INFO:tasks.workunit.client.1.smithi155.stdout:7/750: creat d2/dd/d30/d44/ffa x:0 0 0 2024-04-25T15:57:43.094 INFO:tasks.workunit.client.1.smithi155.stdout:9/593: mkdir dc/d17/dc0/dc9 0 2024-04-25T15:57:43.099 INFO:tasks.workunit.client.1.smithi155.stdout:1/711: dwrite d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:43.100 INFO:tasks.workunit.client.1.smithi155.stdout:4/642: dwrite da/d23/d3f/d56/d69/d83/f7d [0,4194304] 0 2024-04-25T15:57:43.112 INFO:tasks.workunit.client.1.smithi155.stdout:1/712: symlink d1/d6/db4/le3 0 2024-04-25T15:57:43.115 INFO:tasks.workunit.client.1.smithi155.stdout:9/594: dwrite dc/d2f/f7b [0,4194304] 0 2024-04-25T15:57:43.118 INFO:tasks.workunit.client.1.smithi155.stdout:1/713: mknod d1/d16/d1d/d29/d3d/d43/ce4 0 2024-04-25T15:57:43.119 INFO:tasks.workunit.client.1.smithi155.stdout:4/643: dwrite da/d30/f61 [0,4194304] 0 2024-04-25T15:57:43.120 INFO:tasks.workunit.client.1.smithi155.stdout:1/714: fsync d1/d16/d1d/d33/f4f 0 2024-04-25T15:57:43.121 INFO:tasks.workunit.client.1.smithi155.stdout:1/715: readlink d1/d16/d1d/d33/l5b 0 2024-04-25T15:57:43.122 INFO:tasks.workunit.client.1.smithi155.stdout:1/716: write d1/fcc [655286,58383] 0 2024-04-25T15:57:43.122 INFO:tasks.workunit.client.1.smithi155.stdout:1/717: chown d1/d6/db4 68 1 2024-04-25T15:57:43.126 INFO:tasks.workunit.client.1.smithi155.stdout:1/718: mknod d1/d16/d1d/d29/d3d/d43/ce5 0 2024-04-25T15:57:43.127 INFO:tasks.workunit.client.1.smithi155.stdout:1/719: chown d1/d16/d1d/d29/d3d/d43/f62 625 1 2024-04-25T15:57:43.137 INFO:tasks.workunit.client.1.smithi155.stdout:9/595: truncate dc/d11/d30/d46/f4b 1247369 0 2024-04-25T15:57:43.140 INFO:tasks.workunit.client.1.smithi155.stdout:7/751: dwrite d2/dd/f16 [0,4194304] 0 2024-04-25T15:57:43.143 INFO:tasks.workunit.client.1.smithi155.stdout:9/596: creat dc/d11/d5a/fca x:0 0 0 2024-04-25T15:57:43.143 INFO:tasks.workunit.client.1.smithi155.stdout:9/597: truncate dc/d17/d18/f41 3426790 0 2024-04-25T15:57:43.144 INFO:tasks.workunit.client.1.smithi155.stdout:9/598: chown dc/d17/d18/d72/faa 17585 1 2024-04-25T15:57:43.145 INFO:tasks.workunit.client.1.smithi155.stdout:7/752: creat d2/dd/d13/d1c/ffb x:0 0 0 2024-04-25T15:57:43.150 INFO:tasks.workunit.client.1.smithi155.stdout:7/753: creat d2/dd/d30/ffc x:0 0 0 2024-04-25T15:57:43.153 INFO:tasks.workunit.client.1.smithi155.stdout:4/644: dwrite da/dc/f2f [0,4194304] 0 2024-04-25T15:57:43.153 INFO:tasks.workunit.client.1.smithi155.stdout:7/754: chown d2/dd/d36/f89 160880529 1 2024-04-25T15:57:43.156 INFO:tasks.workunit.client.1.smithi155.stdout:9/599: dwrite dc/d13/d2e/f57 [0,4194304] 0 2024-04-25T15:57:43.160 INFO:tasks.workunit.client.1.smithi155.stdout:7/755: creat d2/dd/d13/d24/ffd x:0 0 0 2024-04-25T15:57:43.160 INFO:tasks.workunit.client.1.smithi155.stdout:9/600: rmdir dc/d13/d60/d7a 39 2024-04-25T15:57:43.162 INFO:tasks.workunit.client.1.smithi155.stdout:9/601: mknod dc/d11/d67/ccb 0 2024-04-25T15:57:43.163 INFO:tasks.workunit.client.1.smithi155.stdout:7/756: symlink d2/dd/d13/d24/d35/lfe 0 2024-04-25T15:57:43.166 INFO:tasks.workunit.client.1.smithi155.stdout:4/645: dwrite da/d23/d3f/d56/d69/d83/f91 [0,4194304] 0 2024-04-25T15:57:43.166 INFO:tasks.workunit.client.1.smithi155.stdout:7/757: write d2/dd/d12/f5e [4972398,601] 0 2024-04-25T15:57:43.173 INFO:tasks.workunit.client.1.smithi155.stdout:4/646: rename da/d23/d3a/d7b/f8e to da/d23/d3f/dc6/fe8 0 2024-04-25T15:57:43.175 INFO:tasks.workunit.client.1.smithi155.stdout:4/647: dread - da/d23/d3a/d7b/d93/fa8 zero size 2024-04-25T15:57:43.177 INFO:tasks.workunit.client.1.smithi155.stdout:9/602: dwrite dc/d13/d59/f5f [0,4194304] 0 2024-04-25T15:57:43.177 INFO:tasks.workunit.client.1.smithi155.stdout:7/758: dwrite d2/dd/d12/d76/f85 [0,4194304] 0 2024-04-25T15:57:43.180 INFO:tasks.workunit.client.1.smithi155.stdout:7/759: creat d2/d26/d3d/fff x:0 0 0 2024-04-25T15:57:43.185 INFO:tasks.workunit.client.1.smithi155.stdout:4/648: dwrite da/d23/d3a/fd6 [0,4194304] 0 2024-04-25T15:57:43.190 INFO:tasks.workunit.client.1.smithi155.stdout:8/445: sync 2024-04-25T15:57:43.190 INFO:tasks.workunit.client.1.smithi155.stdout:3/705: sync 2024-04-25T15:57:43.190 INFO:tasks.workunit.client.1.smithi155.stdout:5/680: sync 2024-04-25T15:57:43.191 INFO:tasks.workunit.client.1.smithi155.stdout:3/706: chown d1/d4/db/l50 76 1 2024-04-25T15:57:43.191 INFO:tasks.workunit.client.1.smithi155.stdout:5/681: dread - d0/d3/d15/d9f/dc3/fd0 zero size 2024-04-25T15:57:43.192 INFO:tasks.workunit.client.1.smithi155.stdout:9/603: truncate dc/d13/fa7 180075 0 2024-04-25T15:57:43.192 INFO:tasks.workunit.client.1.smithi155.stdout:5/682: write d0/d3/d15/f88 [766909,122394] 0 2024-04-25T15:57:43.193 INFO:tasks.workunit.client.1.smithi155.stdout:4/649: symlink da/d23/d3f/d56/d69/le9 0 2024-04-25T15:57:43.195 INFO:tasks.workunit.client.1.smithi155.stdout:8/446: unlink d2/d5/f21 0 2024-04-25T15:57:43.195 INFO:tasks.workunit.client.1.smithi155.stdout:7/760: link d2/dd/d36/c6e d2/dd/d36/c100 0 2024-04-25T15:57:43.197 INFO:tasks.workunit.client.1.smithi155.stdout:5/683: creat d0/d27/fdc x:0 0 0 2024-04-25T15:57:43.199 INFO:tasks.workunit.client.1.smithi155.stdout:3/707: creat d1/d4/d10/d21/d73/d77/d57/dcf/ff2 x:0 0 0 2024-04-25T15:57:43.199 INFO:tasks.workunit.client.1.smithi155.stdout:7/761: fsync d2/dd/d36/d46/f51 0 2024-04-25T15:57:43.202 INFO:tasks.workunit.client.1.smithi155.stdout:4/650: creat da/d23/d3f/dc6/de2/fea x:0 0 0 2024-04-25T15:57:43.203 INFO:tasks.workunit.client.1.smithi155.stdout:7/762: unlink d2/dd/d13/d24/d8b/fd8 0 2024-04-25T15:57:43.203 INFO:tasks.workunit.client.1.smithi155.stdout:4/651: chown da/dc/c58 8365749 1 2024-04-25T15:57:43.204 INFO:tasks.workunit.client.1.smithi155.stdout:8/447: dwrite d2/d15/d18/d34/d48/d59/f66 [0,4194304] 0 2024-04-25T15:57:43.204 INFO:tasks.workunit.client.1.smithi155.stdout:5/684: symlink d0/d3/d15/ldd 0 2024-04-25T15:57:43.206 INFO:tasks.workunit.client.1.smithi155.stdout:5/685: write d0/d3/d15/d1f/d50/d7c/fc4 [537624,45452] 0 2024-04-25T15:57:43.211 INFO:tasks.workunit.client.1.smithi155.stdout:7/763: read d2/dd/d13/d1c/fad [121728,23694] 0 2024-04-25T15:57:43.213 INFO:tasks.workunit.client.1.smithi155.stdout:3/708: creat d1/d4/ff3 x:0 0 0 2024-04-25T15:57:43.215 INFO:tasks.workunit.client.1.smithi155.stdout:9/604: truncate dc/f95 1694055 0 2024-04-25T15:57:43.216 INFO:tasks.workunit.client.1.smithi155.stdout:7/764: creat d2/d26/d3d/d65/f101 x:0 0 0 2024-04-25T15:57:43.217 INFO:tasks.workunit.client.1.smithi155.stdout:7/765: write d2/dd/d36/dcd/f98 [721166,16472] 0 2024-04-25T15:57:43.218 INFO:tasks.workunit.client.1.smithi155.stdout:4/652: creat da/dc/d18/d97/dd8/feb x:0 0 0 2024-04-25T15:57:43.219 INFO:tasks.workunit.client.1.smithi155.stdout:7/766: write d2/dd/d13/d1c/f31 [189499,119121] 0 2024-04-25T15:57:43.221 INFO:tasks.workunit.client.1.smithi155.stdout:5/686: symlink d0/d3/d15/d1f/lde 0 2024-04-25T15:57:43.224 INFO:tasks.workunit.client.1.smithi155.stdout:3/709: creat d1/d4/db/d91/dc9/ff4 x:0 0 0 2024-04-25T15:57:43.225 INFO:tasks.workunit.client.1.smithi155.stdout:7/767: truncate d2/dd/d13/d1c/f59 241723 0 2024-04-25T15:57:43.227 INFO:tasks.workunit.client.1.smithi155.stdout:4/653: link da/d23/d3f/d56/d69/d4a/d78/d62/fb1 da/d30/fec 0 2024-04-25T15:57:43.229 INFO:tasks.workunit.client.1.smithi155.stdout:3/710: read - d1/d4/db/d20/d44/d52/d61/db5/fdc zero size 2024-04-25T15:57:43.231 INFO:tasks.workunit.client.1.smithi155.stdout:3/711: readlink d1/ldf 0 2024-04-25T15:57:43.234 INFO:tasks.workunit.client.1.smithi155.stdout:9/605: dwrite dc/d13/d48/f88 [0,4194304] 0 2024-04-25T15:57:43.236 INFO:tasks.workunit.client.1.smithi155.stdout:8/448: dwrite d2/d5/d40/f58 [0,4194304] 0 2024-04-25T15:57:43.236 INFO:tasks.workunit.client.1.smithi155.stdout:7/768: getdents d2/dd/d13/d24/d35/db4 0 2024-04-25T15:57:43.238 INFO:tasks.workunit.client.1.smithi155.stdout:9/606: dread - dc/d17/d2a/fc1 zero size 2024-04-25T15:57:43.238 INFO:tasks.workunit.client.1.smithi155.stdout:3/712: dread - d1/d4/d10/d21/f96 zero size 2024-04-25T15:57:43.241 INFO:tasks.workunit.client.1.smithi155.stdout:5/687: dread d0/d3/d15/fe [0,4194304] 0 2024-04-25T15:57:43.241 INFO:tasks.workunit.client.1.smithi155.stdout:9/607: readlink dc/d17/d18/la8 0 2024-04-25T15:57:43.243 INFO:tasks.workunit.client.1.smithi155.stdout:7/769: mkdir d2/dd/d36/dcd/dc9/d102 0 2024-04-25T15:57:43.244 INFO:tasks.workunit.client.1.smithi155.stdout:5/688: chown d0/d58/d32/l82 0 1 2024-04-25T15:57:43.245 INFO:tasks.workunit.client.1.smithi155.stdout:9/608: write dc/d13/d59/f5f [316764,57685] 0 2024-04-25T15:57:43.245 INFO:tasks.workunit.client.1.smithi155.stdout:4/654: dwrite da/d23/da2/fae [0,4194304] 0 2024-04-25T15:57:43.248 INFO:tasks.workunit.client.1.smithi155.stdout:4/655: write da/dc/d18/d97/dd8/feb [397946,62794] 0 2024-04-25T15:57:43.249 INFO:tasks.workunit.client.1.smithi155.stdout:7/770: creat d2/dd/d12/d76/db6/f103 x:0 0 0 2024-04-25T15:57:43.251 INFO:tasks.workunit.client.1.smithi155.stdout:9/609: rename f7 to dc/d17/d8e/dae/fcc 0 2024-04-25T15:57:43.251 INFO:tasks.workunit.client.1.smithi155.stdout:8/449: dwrite d2/d15/d18/d34/d48/f8b [0,4194304] 0 2024-04-25T15:57:43.289 INFO:tasks.workunit.client.1.smithi155.stdout:7/771: chown d2/dd/d36/d46/f9e 3460 1 2024-04-25T15:57:43.289 INFO:tasks.workunit.client.1.smithi155.stdout:9/610: dread - dc/d13/d60/fc7 zero size 2024-04-25T15:57:43.289 INFO:tasks.workunit.client.1.smithi155.stdout:3/713: truncate d1/d4/db/d20/f4c 2227355 0 2024-04-25T15:57:43.291 INFO:tasks.workunit.client.1.smithi155.stdout:8/450: symlink d2/d5/d40/l8c 0 2024-04-25T15:57:43.293 INFO:tasks.workunit.client.1.smithi155.stdout:7/772: write d2/dd/d30/d44/ddd/fe6 [1060960,27602] 0 2024-04-25T15:57:43.297 INFO:tasks.workunit.client.1.smithi155.stdout:8/451: mknod d2/d15/d18/c8d 0 2024-04-25T15:57:43.299 INFO:tasks.workunit.client.1.smithi155.stdout:9/611: dwrite dc/d3c/d9b/f9f [0,4194304] 0 2024-04-25T15:57:43.302 INFO:tasks.workunit.client.1.smithi155.stdout:8/452: truncate d2/d15/d18/d49/f3a 280047 0 2024-04-25T15:57:43.305 INFO:tasks.workunit.client.1.smithi155.stdout:4/656: dread da/d23/d3a/d7b/fb9 [0,4194304] 0 2024-04-25T15:57:43.307 INFO:tasks.workunit.client.1.smithi155.stdout:3/714: dwrite d1/d4/d10/d21/f96 [0,4194304] 0 2024-04-25T15:57:43.307 INFO:tasks.workunit.client.1.smithi155.stdout:4/657: readlink da/d23/d3f/d56/d69/d4a/le4 0 2024-04-25T15:57:43.309 INFO:tasks.workunit.client.1.smithi155.stdout:9/612: rmdir dc/d3c/d9b/da9 0 2024-04-25T15:57:43.320 INFO:tasks.workunit.client.1.smithi155.stdout:3/715: dwrite d1/d4/db/d28/f31 [0,4194304] 0 2024-04-25T15:57:43.320 INFO:tasks.workunit.client.1.smithi155.stdout:9/613: write dc/d11/d5a/f78 [3234222,108065] 0 2024-04-25T15:57:43.321 INFO:tasks.workunit.client.1.smithi155.stdout:3/716: readlink d1/d4/db/d91/lba 0 2024-04-25T15:57:43.323 INFO:tasks.workunit.client.1.smithi155.stdout:9/614: fdatasync dc/ff 0 2024-04-25T15:57:43.327 INFO:tasks.workunit.client.1.smithi155.stdout:9/615: creat dc/d11/d30/d46/fcd x:0 0 0 2024-04-25T15:57:43.327 INFO:tasks.workunit.client.1.smithi155.stdout:3/717: symlink d1/d4/d10/d21/d73/d8d/lf5 0 2024-04-25T15:57:43.328 INFO:tasks.workunit.client.1.smithi155.stdout:3/718: readlink d1/d4/db/d91/lba 0 2024-04-25T15:57:43.329 INFO:tasks.workunit.client.1.smithi155.stdout:3/719: readlink d1/d4/db/d20/d44/le8 0 2024-04-25T15:57:43.329 INFO:tasks.workunit.client.1.smithi155.stdout:7/773: dread d2/dd/f4e [0,4194304] 0 2024-04-25T15:57:43.330 INFO:tasks.workunit.client.1.smithi155.stdout:9/616: symlink dc/d11/dc4/lce 0 2024-04-25T15:57:43.331 INFO:tasks.workunit.client.1.smithi155.stdout:9/617: fsync dc/d11/d30/fc3 0 2024-04-25T15:57:43.332 INFO:tasks.workunit.client.1.smithi155.stdout:7/774: mkdir d2/dd/d36/d104 0 2024-04-25T15:57:43.334 INFO:tasks.workunit.client.1.smithi155.stdout:3/720: rename d1/d4/l13 to d1/d4/d10/d21/d73/d77/de9/lf6 0 2024-04-25T15:57:43.335 INFO:tasks.workunit.client.1.smithi155.stdout:7/775: mknod d2/dd/d63/c105 0 2024-04-25T15:57:43.338 INFO:tasks.workunit.client.1.smithi155.stdout:7/776: fsync d2/dd/d36/d46/f83 0 2024-04-25T15:57:43.344 INFO:tasks.workunit.client.1.smithi155.stdout:6/808: sync 2024-04-25T15:57:43.345 INFO:tasks.workunit.client.1.smithi155.stdout:2/737: sync 2024-04-25T15:57:43.345 INFO:tasks.workunit.client.1.smithi155.stdout:7/777: rename d2/dd/d30/d44/fbb to d2/dd/d12/d76/f106 0 2024-04-25T15:57:43.345 INFO:tasks.workunit.client.1.smithi155.stdout:7/778: readlink d2/dd/d13/lc5 0 2024-04-25T15:57:43.345 INFO:tasks.workunit.client.1.smithi155.stdout:2/738: chown d7/db/d2e/d6f/fb2 1624879202 1 2024-04-25T15:57:43.346 INFO:tasks.workunit.client.1.smithi155.stdout:6/809: stat d0/d1a/d45/f92 0 2024-04-25T15:57:43.348 INFO:tasks.workunit.client.1.smithi155.stdout:2/739: rename d7 to d7/db/dec 22 2024-04-25T15:57:43.353 INFO:tasks.workunit.client.1.smithi155.stdout:7/779: dwrite d2/f68 [0,4194304] 0 2024-04-25T15:57:43.354 INFO:tasks.workunit.client.1.smithi155.stdout:6/810: creat d0/d1a/da1/f101 x:0 0 0 2024-04-25T15:57:43.359 INFO:tasks.workunit.client.1.smithi155.stdout:3/721: dwrite d1/d4/d10/d21/d73/d77/fbb [0,4194304] 0 2024-04-25T15:57:43.369 INFO:tasks.workunit.client.1.smithi155.stdout:2/740: dwrite d7/d23/f87 [0,4194304] 0 2024-04-25T15:57:43.377 INFO:tasks.workunit.client.1.smithi155.stdout:6/811: dwrite d0/d1a/d45/f52 [0,4194304] 0 2024-04-25T15:57:43.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/780: dwrite d2/d26/d3d/d65/f86 [0,4194304] 0 2024-04-25T15:57:43.379 INFO:tasks.workunit.client.1.smithi155.stdout:3/722: dwrite d1/d4/ff3 [0,4194304] 0 2024-04-25T15:57:43.382 INFO:tasks.workunit.client.1.smithi155.stdout:7/781: mknod d2/dd/d13/d24/d35/db4/c107 0 2024-04-25T15:57:43.387 INFO:tasks.workunit.client.1.smithi155.stdout:2/741: truncate d7/db/dd/d15/f42 531212 0 2024-04-25T15:57:43.388 INFO:tasks.workunit.client.1.smithi155.stdout:6/812: stat d0/d13/d34/d38/d4c/ce7 0 2024-04-25T15:57:43.389 INFO:tasks.workunit.client.1.smithi155.stdout:2/742: fsync d7/db/d2e/d90/fb8 0 2024-04-25T15:57:43.393 INFO:tasks.workunit.client.1.smithi155.stdout:3/723: unlink d1/d4/d10/f43 0 2024-04-25T15:57:43.394 INFO:tasks.workunit.client.1.smithi155.stdout:2/743: rmdir d7/db/d29 39 2024-04-25T15:57:43.399 INFO:tasks.workunit.client.1.smithi155.stdout:2/744: fdatasync d7/d23/f40 0 2024-04-25T15:57:43.399 INFO:tasks.workunit.client.1.smithi155.stdout:7/782: truncate d2/f1b 4566462 0 2024-04-25T15:57:43.401 INFO:tasks.workunit.client.1.smithi155.stdout:6/813: dwrite d0/d1a/da1/f101 [0,4194304] 0 2024-04-25T15:57:43.404 INFO:tasks.workunit.client.1.smithi155.stdout:6/814: write d0/d13/d43/fc7 [308324,121213] 0 2024-04-25T15:57:43.406 INFO:tasks.workunit.client.1.smithi155.stdout:3/724: getdents d1/d4/db/d91/dc4/dd9/d86/d9e 0 2024-04-25T15:57:43.409 INFO:tasks.workunit.client.1.smithi155.stdout:6/815: creat d0/d13/d34/d38/d90/da5/f102 x:0 0 0 2024-04-25T15:57:43.412 INFO:tasks.workunit.client.1.smithi155.stdout:2/745: dwrite d7/d23/f98 [0,4194304] 0 2024-04-25T15:57:43.412 INFO:tasks.workunit.client.1.smithi155.stdout:3/725: creat d1/d4/d10/d21/d73/d77/d57/d80/ff7 x:0 0 0 2024-04-25T15:57:43.413 INFO:tasks.workunit.client.1.smithi155.stdout:6/816: symlink d0/d13/d7c/dd7/l103 0 2024-04-25T15:57:43.413 INFO:tasks.workunit.client.1.smithi155.stdout:7/783: dread d2/dd/d13/d1c/f22 [0,4194304] 0 2024-04-25T15:57:43.415 INFO:tasks.workunit.client.1.smithi155.stdout:6/817: fsync d0/d1a/d21/d73/faa 0 2024-04-25T15:57:43.415 INFO:tasks.workunit.client.1.smithi155.stdout:7/784: readlink d2/dd/d66/d71/l7a 0 2024-04-25T15:57:43.417 INFO:tasks.workunit.client.1.smithi155.stdout:3/726: mkdir d1/d4/d10/d21/d73/d77/d5f/dee/df8 0 2024-04-25T15:57:43.418 INFO:tasks.workunit.client.1.smithi155.stdout:2/746: mknod d7/db/d2e/d44/d9e/dbd/ced 0 2024-04-25T15:57:43.420 INFO:tasks.workunit.client.1.smithi155.stdout:3/727: mknod d1/d4/db/d20/d44/d52/d61/d89/cf9 0 2024-04-25T15:57:43.421 INFO:tasks.workunit.client.1.smithi155.stdout:7/785: link d2/d26/d3d/d65/f101 d2/dd/d30/d44/d7f/f108 0 2024-04-25T15:57:43.422 INFO:tasks.workunit.client.1.smithi155.stdout:2/747: creat d7/db/dd/d15/fee x:0 0 0 2024-04-25T15:57:43.424 INFO:tasks.workunit.client.1.smithi155.stdout:7/786: creat d2/dd/d13/d24/d35/f109 x:0 0 0 2024-04-25T15:57:43.426 INFO:tasks.workunit.client.1.smithi155.stdout:2/748: mkdir d7/db/d2e/def 0 2024-04-25T15:57:43.429 INFO:tasks.workunit.client.1.smithi155.stdout:7/787: creat d2/dd/d12/f10a x:0 0 0 2024-04-25T15:57:43.429 INFO:tasks.workunit.client.1.smithi155.stdout:6/818: write d0/d1a/d37/f3e [2544618,96803] 0 2024-04-25T15:57:43.430 INFO:tasks.workunit.client.1.smithi155.stdout:2/749: mknod d7/db/d29/d83/dbe/cf0 0 2024-04-25T15:57:43.430 INFO:tasks.workunit.client.1.smithi155.stdout:7/788: chown d2/dd/d36/dcd/dc9/d102 40 1 2024-04-25T15:57:43.431 INFO:tasks.workunit.client.1.smithi155.stdout:2/750: fdatasync d7/db/d29/f3c 0 2024-04-25T15:57:43.432 INFO:tasks.workunit.client.1.smithi155.stdout:7/789: write d2/dd/d30/dbc/fee [86163,99262] 0 2024-04-25T15:57:43.433 INFO:tasks.workunit.client.1.smithi155.stdout:2/751: chown d7/db/d2e/d6f/dc6/fcf 22 1 2024-04-25T15:57:43.434 INFO:tasks.workunit.client.1.smithi155.stdout:3/728: truncate d1/d4/d10/d21/d73/f59 140681 0 2024-04-25T15:57:43.436 INFO:tasks.workunit.client.1.smithi155.stdout:2/752: unlink d7/db/d29/d83/d86/fa9 0 2024-04-25T15:57:43.436 INFO:tasks.workunit.client.1.smithi155.stdout:0/661: sync 2024-04-25T15:57:43.436 INFO:tasks.workunit.client.1.smithi155.stdout:1/720: sync 2024-04-25T15:57:43.437 INFO:tasks.workunit.client.1.smithi155.stdout:3/729: rename d1/d4/db/f5e to d1/d4/db/d20/ffa 0 2024-04-25T15:57:43.439 INFO:tasks.workunit.client.1.smithi155.stdout:6/819: dwrite d0/d1a/d21/d73/faa [0,4194304] 0 2024-04-25T15:57:43.439 INFO:tasks.workunit.client.1.smithi155.stdout:1/721: mkdir d1/d16/d1d/d33/da1/de6 0 2024-04-25T15:57:43.440 INFO:tasks.workunit.client.1.smithi155.stdout:2/753: chown d7/db/d2e/d44/d70/d7b/d9f/fa6 1231738 1 2024-04-25T15:57:43.441 INFO:tasks.workunit.client.1.smithi155.stdout:3/730: dread - d1/d4/d10/d21/d73/d77/d57/d80/fb7 zero size 2024-04-25T15:57:43.443 INFO:tasks.workunit.client.1.smithi155.stdout:7/790: dread d2/dd/d13/d1c/f31 [0,4194304] 0 2024-04-25T15:57:43.445 INFO:tasks.workunit.client.1.smithi155.stdout:2/754: creat d7/db/d29/d83/dbe/ff1 x:0 0 0 2024-04-25T15:57:43.446 INFO:tasks.workunit.client.1.smithi155.stdout:2/755: stat d7/f2d 0 2024-04-25T15:57:43.446 INFO:tasks.workunit.client.1.smithi155.stdout:3/731: creat d1/d4/d10/ffb x:0 0 0 2024-04-25T15:57:43.446 INFO:tasks.workunit.client.1.smithi155.stdout:6/820: dread d0/d1a/d21/fea [0,4194304] 0 2024-04-25T15:57:43.447 INFO:tasks.workunit.client.1.smithi155.stdout:0/662: link d1/d3/d3d/d46/da4/db6/fdb d1/d85/d8c/fe0 0 2024-04-25T15:57:43.449 INFO:tasks.workunit.client.1.smithi155.stdout:6/821: fdatasync d0/d18/d54/fff 0 2024-04-25T15:57:43.449 INFO:tasks.workunit.client.1.smithi155.stdout:0/663: stat d1/d6/d29/d47/lb3 0 2024-04-25T15:57:43.450 INFO:tasks.workunit.client.1.smithi155.stdout:2/756: creat d7/db/d2e/ff2 x:0 0 0 2024-04-25T15:57:43.450 INFO:tasks.workunit.client.1.smithi155.stdout:3/732: readlink d1/d4/db/d20/d44/d52/d61/db5/l49 0 2024-04-25T15:57:43.451 INFO:tasks.workunit.client.1.smithi155.stdout:1/722: dwrite d1/d16/f2c [4194304,4194304] 0 2024-04-25T15:57:43.451 INFO:tasks.workunit.client.1.smithi155.stdout:7/791: getdents d2/dd/d13/d24/d35/db4 0 2024-04-25T15:57:43.452 INFO:tasks.workunit.client.1.smithi155.stdout:0/664: write d1/d3f/f50 [4265145,84255] 0 2024-04-25T15:57:43.455 INFO:tasks.workunit.client.1.smithi155.stdout:6/822: truncate d0/d13/d34/d38/d7a/df5/ffd 388215 0 2024-04-25T15:57:43.456 INFO:tasks.workunit.client.1.smithi155.stdout:0/665: dread d1/d6/f75 [0,4194304] 0 2024-04-25T15:57:43.456 INFO:tasks.workunit.client.1.smithi155.stdout:7/792: mknod d2/dd/d30/d44/d7f/c10b 0 2024-04-25T15:57:43.457 INFO:tasks.workunit.client.1.smithi155.stdout:6/823: stat d0/d1a/d25/d51 0 2024-04-25T15:57:43.457 INFO:tasks.workunit.client.1.smithi155.stdout:3/733: unlink d1/d4/db/d20/d44/d52/fd0 0 2024-04-25T15:57:43.459 INFO:tasks.workunit.client.1.smithi155.stdout:2/757: rename d7/db/dd/f38 to d7/db/d2e/ff3 0 2024-04-25T15:57:43.459 INFO:tasks.workunit.client.1.smithi155.stdout:2/758: readlink d7/d8e/laa 0 2024-04-25T15:57:43.464 INFO:tasks.workunit.client.1.smithi155.stdout:0/666: unlink d1/d3/d5/f2c 0 2024-04-25T15:57:43.470 INFO:tasks.workunit.client.1.smithi155.stdout:2/759: unlink d7/db/fb7 0 2024-04-25T15:57:43.471 INFO:tasks.workunit.client.1.smithi155.stdout:7/793: dwrite d2/dd/d13/d24/d8b/fbf [0,4194304] 0 2024-04-25T15:57:43.476 INFO:tasks.workunit.client.1.smithi155.stdout:7/794: read d2/dd/d13/d24/d35/f3c [3388215,65043] 0 2024-04-25T15:57:43.481 INFO:tasks.workunit.client.1.smithi155.stdout:0/667: link d1/d6/d29/f3a d1/d3/d6a/d9b/fe1 0 2024-04-25T15:57:43.483 INFO:tasks.workunit.client.1.smithi155.stdout:2/760: creat d7/db/d29/d83/d86/d8b/dbf/ff4 x:0 0 0 2024-04-25T15:57:43.485 INFO:tasks.workunit.client.1.smithi155.stdout:7/795: dwrite d2/dd/d63/fc0 [0,4194304] 0 2024-04-25T15:57:43.489 INFO:tasks.workunit.client.1.smithi155.stdout:2/761: read d7/db/d2e/d6f/fb2 [2647662,15399] 0 2024-04-25T15:57:43.490 INFO:tasks.workunit.client.1.smithi155.stdout:1/723: dwrite d1/d32/d86/fb2 [0,4194304] 0 2024-04-25T15:57:43.490 INFO:tasks.workunit.client.1.smithi155.stdout:6/824: write d0/d1a/d25/d2e/f67 [212195,111812] 0 2024-04-25T15:57:43.495 INFO:tasks.workunit.client.1.smithi155.stdout:1/724: write d1/d16/d1d/d29/f55 [4938972,36766] 0 2024-04-25T15:57:43.496 INFO:tasks.workunit.client.1.smithi155.stdout:7/796: rmdir d2/dd/d36/dcd/dc9 39 2024-04-25T15:57:43.499 INFO:tasks.workunit.client.1.smithi155.stdout:3/734: dwrite d1/d4/db/d20/d44/d52/d61/db5/f76 [0,4194304] 0 2024-04-25T15:57:43.499 INFO:tasks.workunit.client.1.smithi155.stdout:6/825: mkdir d0/d1a/d25/d51/d104 0 2024-04-25T15:57:43.501 INFO:tasks.workunit.client.1.smithi155.stdout:7/797: mknod d2/dd/d66/d8c/c10c 0 2024-04-25T15:57:43.504 INFO:tasks.workunit.client.1.smithi155.stdout:0/668: dread d1/d3f/f7b [0,4194304] 0 2024-04-25T15:57:43.506 INFO:tasks.workunit.client.1.smithi155.stdout:3/735: readlink d1/d4/d10/d21/d73/d77/d57/d80/led 0 2024-04-25T15:57:43.507 INFO:tasks.workunit.client.1.smithi155.stdout:2/762: write d7/f77 [478863,114188] 0 2024-04-25T15:57:43.509 INFO:tasks.workunit.client.1.smithi155.stdout:0/669: creat d1/d6/d29/d47/fe2 x:0 0 0 2024-04-25T15:57:43.511 INFO:tasks.workunit.client.1.smithi155.stdout:3/736: mknod d1/d4/db/d28/d58/de6/cfc 0 2024-04-25T15:57:43.512 INFO:tasks.workunit.client.1.smithi155.stdout:1/725: truncate d1/d16/d1d/d29/f9a 2735241 0 2024-04-25T15:57:43.513 INFO:tasks.workunit.client.1.smithi155.stdout:1/726: fdatasync d1/d16/d1d/d33/da1/fb0 0 2024-04-25T15:57:43.514 INFO:tasks.workunit.client.1.smithi155.stdout:2/763: rename d7/db/dd/d15/f28 to d7/db/d29/d83/d86/db0/ff5 0 2024-04-25T15:57:43.515 INFO:tasks.workunit.client.1.smithi155.stdout:6/826: dread d0/d1a/d25/d51/f84 [0,4194304] 0 2024-04-25T15:57:43.515 INFO:tasks.workunit.client.1.smithi155.stdout:7/798: truncate d2/dd/d36/dcd/f98 723423 0 2024-04-25T15:57:43.515 INFO:tasks.workunit.client.1.smithi155.stdout:1/727: write d1/d16/f27 [4154528,103185] 0 2024-04-25T15:57:43.515 INFO:tasks.workunit.client.1.smithi155.stdout:0/670: mknod d1/d85/d8c/d9e/ce3 0 2024-04-25T15:57:43.516 INFO:tasks.workunit.client.1.smithi155.stdout:1/728: fdatasync d1/f15 0 2024-04-25T15:57:43.517 INFO:tasks.workunit.client.1.smithi155.stdout:7/799: dread - d2/d26/d3d/fdb zero size 2024-04-25T15:57:43.517 INFO:tasks.workunit.client.1.smithi155.stdout:6/827: chown d0/d18/cd5 28074627 1 2024-04-25T15:57:43.518 INFO:tasks.workunit.client.1.smithi155.stdout:0/671: write d1/d6/d29/d47/fa5 [812047,50754] 0 2024-04-25T15:57:43.519 INFO:tasks.workunit.client.1.smithi155.stdout:0/672: chown d1/d3/d12/d83 219 1 2024-04-25T15:57:43.521 INFO:tasks.workunit.client.1.smithi155.stdout:6/828: fdatasync d0/d13/d34/d6c/fcd 0 2024-04-25T15:57:43.521 INFO:tasks.workunit.client.1.smithi155.stdout:1/729: write d1/d6/f31 [8394568,73460] 0 2024-04-25T15:57:43.523 INFO:tasks.workunit.client.1.smithi155.stdout:0/673: creat d1/d6/d29/d47/db0/fe4 x:0 0 0 2024-04-25T15:57:43.525 INFO:tasks.workunit.client.1.smithi155.stdout:3/737: getdents d1/d4/db/d91/dc4/dd9/d86 0 2024-04-25T15:57:43.525 INFO:tasks.workunit.client.1.smithi155.stdout:1/730: symlink d1/d16/d1d/d33/le7 0 2024-04-25T15:57:43.525 INFO:tasks.workunit.client.1.smithi155.stdout:0/674: readlink d1/d3/d5/d5b/dc4/d6e/lbb 0 2024-04-25T15:57:43.525 INFO:tasks.workunit.client.1.smithi155.stdout:7/800: dread d2/dd/d13/d24/d8b/fbf [0,4194304] 0 2024-04-25T15:57:43.526 INFO:tasks.workunit.client.1.smithi155.stdout:6/829: symlink d0/d1a/d25/l105 0 2024-04-25T15:57:43.527 INFO:tasks.workunit.client.1.smithi155.stdout:6/830: stat d0/d13/d34/d6c/d9d/lc8 0 2024-04-25T15:57:43.527 INFO:tasks.workunit.client.1.smithi155.stdout:1/731: chown d1/d6/faf 0 1 2024-04-25T15:57:43.528 INFO:tasks.workunit.client.1.smithi155.stdout:1/732: stat d1/d16/d1d/d29/d5f/db8 0 2024-04-25T15:57:43.528 INFO:tasks.workunit.client.1.smithi155.stdout:0/675: creat d1/d85/d8c/fe5 x:0 0 0 2024-04-25T15:57:43.530 INFO:tasks.workunit.client.1.smithi155.stdout:0/676: dread - d1/d3/d5/d5b/dc4/f8d zero size 2024-04-25T15:57:43.530 INFO:tasks.workunit.client.1.smithi155.stdout:7/801: creat d2/dd/d36/f10d x:0 0 0 2024-04-25T15:57:43.531 INFO:tasks.workunit.client.1.smithi155.stdout:6/831: fsync d0/d1a/d21/f47 0 2024-04-25T15:57:43.533 INFO:tasks.workunit.client.1.smithi155.stdout:7/802: symlink d2/dd/d30/d44/d7f/l10e 0 2024-04-25T15:57:43.534 INFO:tasks.workunit.client.1.smithi155.stdout:6/832: write d0/d13/d43/f64 [4402196,529] 0 2024-04-25T15:57:43.535 INFO:tasks.workunit.client.1.smithi155.stdout:0/677: rename d1/d3/d12/f3b to d1/d3/d3d/dcb/fe6 0 2024-04-25T15:57:43.536 INFO:tasks.workunit.client.1.smithi155.stdout:6/833: stat d0/d13/d7c/dd7/l103 0 2024-04-25T15:57:43.537 INFO:tasks.workunit.client.1.smithi155.stdout:7/803: rmdir d2/dd/d66 39 2024-04-25T15:57:43.540 INFO:tasks.workunit.client.1.smithi155.stdout:2/764: dwrite d7/d23/f40 [0,4194304] 0 2024-04-25T15:57:43.540 INFO:tasks.workunit.client.1.smithi155.stdout:6/834: write d0/d18/d54/fff [540624,32492] 0 2024-04-25T15:57:43.544 INFO:tasks.workunit.client.1.smithi155.stdout:0/678: rename d1/d3/d5/d5b/dc4/c4f to d1/d3/d5/d5b/d86/ce7 0 2024-04-25T15:57:43.545 INFO:tasks.workunit.client.1.smithi155.stdout:2/765: unlink d7/f31 0 2024-04-25T15:57:43.547 INFO:tasks.workunit.client.1.smithi155.stdout:1/733: dread d1/d16/d1d/d5e/dd0/fd5 [4194304,4194304] 0 2024-04-25T15:57:43.547 INFO:tasks.workunit.client.1.smithi155.stdout:7/804: mknod d2/dd/d36/dcd/dc9/c10f 0 2024-04-25T15:57:43.549 INFO:tasks.workunit.client.1.smithi155.stdout:5/689: sync 2024-04-25T15:57:43.549 INFO:tasks.workunit.client.1.smithi155.stdout:8/453: sync 2024-04-25T15:57:43.550 INFO:tasks.workunit.client.1.smithi155.stdout:6/835: rename d0/d1a/d37/dda/dfe/d7b/f85 to d0/d13/dd1/f106 0 2024-04-25T15:57:43.551 INFO:tasks.workunit.client.1.smithi155.stdout:8/454: write d2/d15/d18/d23/d3c/f47 [9202661,84309] 0 2024-04-25T15:57:43.551 INFO:tasks.workunit.client.1.smithi155.stdout:7/805: symlink d2/dd/d13/d24/d35/db4/l110 0 2024-04-25T15:57:43.554 INFO:tasks.workunit.client.1.smithi155.stdout:1/734: dread d1/d16/d1d/d5e/f7b [0,4194304] 0 2024-04-25T15:57:43.554 INFO:tasks.workunit.client.1.smithi155.stdout:2/766: fdatasync d7/db/dd/d15/f42 0 2024-04-25T15:57:43.567 INFO:tasks.workunit.client.1.smithi155.stdout:7/806: fsync d2/dd/d12/d76/db6/f103 0 2024-04-25T15:57:43.567 INFO:tasks.workunit.client.1.smithi155.stdout:0/679: rename d1/d3/d5/d5b/dc4/d6e/c7e to d1/d41/ce8 0 2024-04-25T15:57:43.567 INFO:tasks.workunit.client.1.smithi155.stdout:6/836: write d0/d1a/f100 [639022,94417] 0 2024-04-25T15:57:43.567 INFO:tasks.workunit.client.1.smithi155.stdout:5/690: dread d0/d3/d15/d1f/d50/d7c/fb5 [0,4194304] 0 2024-04-25T15:57:43.567 INFO:tasks.workunit.client.1.smithi155.stdout:0/680: read d1/d1a/f34 [919861,72660] 0 2024-04-25T15:57:43.567 INFO:tasks.workunit.client.1.smithi155.stdout:2/767: unlink d7/db/d29/d83/lcc 0 2024-04-25T15:57:43.568 INFO:tasks.workunit.client.1.smithi155.stdout:8/455: mkdir d2/d15/d18/d23/d3c/d76/d7e/d8e 0 2024-04-25T15:57:43.569 INFO:tasks.workunit.client.1.smithi155.stdout:7/807: mkdir d2/dd/d12/d76/db6/d111 0 2024-04-25T15:57:43.569 INFO:tasks.workunit.client.1.smithi155.stdout:5/691: symlink d0/d3/d15/d1f/d50/d60/ldf 0 2024-04-25T15:57:43.570 INFO:tasks.workunit.client.1.smithi155.stdout:2/768: stat d7/db/d2e/d6f/dc6/dd6 0 2024-04-25T15:57:43.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/456: fsync d2/d15/d18/d23/d3c/f47 0 2024-04-25T15:57:43.570 INFO:tasks.workunit.client.1.smithi155.stdout:0/681: mkdir d1/d3/d5/da/de9 0 2024-04-25T15:57:43.571 INFO:tasks.workunit.client.1.smithi155.stdout:2/769: chown d7/db/d2e/d44/d70 147699 1 2024-04-25T15:57:43.572 INFO:tasks.workunit.client.1.smithi155.stdout:0/682: chown d1/d3f/l63 733 1 2024-04-25T15:57:43.572 INFO:tasks.workunit.client.1.smithi155.stdout:7/808: creat d2/d26/f112 x:0 0 0 2024-04-25T15:57:43.573 INFO:tasks.workunit.client.1.smithi155.stdout:8/457: chown d2/d15/d18/d23/d3c/d76/d7e 4861335 1 2024-04-25T15:57:43.573 INFO:tasks.workunit.client.1.smithi155.stdout:5/692: mknod d0/d3/d2c/ce0 0 2024-04-25T15:57:43.574 INFO:tasks.workunit.client.1.smithi155.stdout:7/809: readlink d2/d26/d3d/lec 0 2024-04-25T15:57:43.575 INFO:tasks.workunit.client.1.smithi155.stdout:1/735: write d1/d32/d77/fb1 [2685758,57491] 0 2024-04-25T15:57:43.576 INFO:tasks.workunit.client.1.smithi155.stdout:2/770: symlink d7/db/d2e/d6f/dc6/lf6 0 2024-04-25T15:57:43.578 INFO:tasks.workunit.client.1.smithi155.stdout:6/837: dwrite d0/d13/d34/d38/d90/da5/f102 [0,4194304] 0 2024-04-25T15:57:43.578 INFO:tasks.workunit.client.1.smithi155.stdout:8/458: chown d2/d15/d18/d34/d48/l74 85 1 2024-04-25T15:57:43.580 INFO:tasks.workunit.client.1.smithi155.stdout:5/693: mknod d0/d3/d15/d30/d4f/ce1 0 2024-04-25T15:57:43.580 INFO:tasks.workunit.client.1.smithi155.stdout:6/838: chown d0/d13/d34/d6c/l8a 254374 1 2024-04-25T15:57:43.582 INFO:tasks.workunit.client.1.smithi155.stdout:5/694: fdatasync d0/d27/f4b 0 2024-04-25T15:57:43.583 INFO:tasks.workunit.client.1.smithi155.stdout:7/810: mkdir d2/dd/d30/d113 0 2024-04-25T15:57:43.584 INFO:tasks.workunit.client.1.smithi155.stdout:8/459: truncate d2/d15/d18/d23/d2d/f5a 60255 0 2024-04-25T15:57:43.586 INFO:tasks.workunit.client.1.smithi155.stdout:2/771: symlink d7/db/d2e/d6f/d91/dad/lf7 0 2024-04-25T15:57:43.587 INFO:tasks.workunit.client.1.smithi155.stdout:2/772: fdatasync d7/f2b 0 2024-04-25T15:57:43.588 INFO:tasks.workunit.client.1.smithi155.stdout:8/460: stat d2/d15/d18/d34/d48/d4e/d81 0 2024-04-25T15:57:43.590 INFO:tasks.workunit.client.1.smithi155.stdout:2/773: readlink d7/db/l85 0 2024-04-25T15:57:43.593 INFO:tasks.workunit.client.1.smithi155.stdout:8/461: unlink d2/d5/l54 0 2024-04-25T15:57:43.595 INFO:tasks.workunit.client.1.smithi155.stdout:2/774: creat d7/db/d2e/d44/d70/ff8 x:0 0 0 2024-04-25T15:57:43.597 INFO:tasks.workunit.client.1.smithi155.stdout:6/839: dwrite d0/d1a/d25/fc2 [0,4194304] 0 2024-04-25T15:57:43.599 INFO:tasks.workunit.client.1.smithi155.stdout:2/775: read - d7/db/d2e/d90/feb zero size 2024-04-25T15:57:43.599 INFO:tasks.workunit.client.1.smithi155.stdout:1/736: dread d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fba [0,4194304] 0 2024-04-25T15:57:43.600 INFO:tasks.workunit.client.1.smithi155.stdout:8/462: creat d2/d15/d18/d34/d48/f8f x:0 0 0 2024-04-25T15:57:43.603 INFO:tasks.workunit.client.1.smithi155.stdout:5/695: dread d0/d27/f4b [0,4194304] 0 2024-04-25T15:57:43.603 INFO:tasks.workunit.client.1.smithi155.stdout:6/840: read d0/d13/d43/fc7 [267033,36671] 0 2024-04-25T15:57:43.604 INFO:tasks.workunit.client.1.smithi155.stdout:6/841: readlink d0/d18/l8b 0 2024-04-25T15:57:43.605 INFO:tasks.workunit.client.1.smithi155.stdout:1/737: unlink d1/d16/d1d/d29/d5f/d34/la2 0 2024-04-25T15:57:43.606 INFO:tasks.workunit.client.1.smithi155.stdout:0/683: dread d1/d41/f93 [0,4194304] 0 2024-04-25T15:57:43.607 INFO:tasks.workunit.client.1.smithi155.stdout:7/811: dread d2/dd/d13/d24/d35/f3c [0,4194304] 0 2024-04-25T15:57:43.610 INFO:tasks.workunit.client.1.smithi155.stdout:0/684: write d1/d3f/f50 [2411821,13003] 0 2024-04-25T15:57:43.611 INFO:tasks.workunit.client.1.smithi155.stdout:1/738: stat d1/d16/d1d/d29/d3d/fbd 0 2024-04-25T15:57:43.614 INFO:tasks.workunit.client.1.smithi155.stdout:7/812: creat d2/dd/d13/d24/d35/f114 x:0 0 0 2024-04-25T15:57:43.615 INFO:tasks.workunit.client.1.smithi155.stdout:2/776: dwrite d7/db/d2e/f8a [0,4194304] 0 2024-04-25T15:57:43.617 INFO:tasks.workunit.client.1.smithi155.stdout:1/739: creat d1/d16/d1d/d29/d3d/d43/d88/fe8 x:0 0 0 2024-04-25T15:57:43.618 INFO:tasks.workunit.client.1.smithi155.stdout:5/696: truncate d0/d58/d32/f49 380270 0 2024-04-25T15:57:43.620 INFO:tasks.workunit.client.1.smithi155.stdout:2/777: symlink d7/db/d2e/d90/ddd/lf9 0 2024-04-25T15:57:43.621 INFO:tasks.workunit.client.1.smithi155.stdout:1/740: chown d1/d32/d86/la5 124144 1 2024-04-25T15:57:43.621 INFO:tasks.workunit.client.1.smithi155.stdout:6/842: dread d0/d1a/d25/d51/fb0 [0,4194304] 0 2024-04-25T15:57:43.621 INFO:tasks.workunit.client.1.smithi155.stdout:7/813: dread d2/dd/d36/d46/f9e [0,4194304] 0 2024-04-25T15:57:43.623 INFO:tasks.workunit.client.1.smithi155.stdout:5/697: creat d0/d3/d2c/fe2 x:0 0 0 2024-04-25T15:57:43.624 INFO:tasks.workunit.client.1.smithi155.stdout:6/843: fsync d0/d13/d6f/fe2 0 2024-04-25T15:57:43.624 INFO:tasks.workunit.client.1.smithi155.stdout:2/778: unlink d7/f2c 0 2024-04-25T15:57:43.627 INFO:tasks.workunit.client.1.smithi155.stdout:8/463: dwrite d2/d15/d18/d49/f3a [0,4194304] 0 2024-04-25T15:57:43.628 INFO:tasks.workunit.client.1.smithi155.stdout:7/814: rename d2/dd/d12/df7 to d2/d26/d3d/d115 0 2024-04-25T15:57:43.628 INFO:tasks.workunit.client.1.smithi155.stdout:6/844: write d0/d13/d7c/d99/fb9 [775967,440] 0 2024-04-25T15:57:43.631 INFO:tasks.workunit.client.1.smithi155.stdout:6/845: mknod d0/d1a/d25/d51/c107 0 2024-04-25T15:57:43.632 INFO:tasks.workunit.client.1.smithi155.stdout:0/685: dread d1/d6/f8a [0,4194304] 0 2024-04-25T15:57:43.633 INFO:tasks.workunit.client.1.smithi155.stdout:2/779: mknod d7/db/d2e/def/cfa 0 2024-04-25T15:57:43.636 INFO:tasks.workunit.client.1.smithi155.stdout:8/464: creat d2/d15/d18/d34/d48/d4e/f90 x:0 0 0 2024-04-25T15:57:43.638 INFO:tasks.workunit.client.1.smithi155.stdout:0/686: mknod d1/d41/cea 0 2024-04-25T15:57:43.638 INFO:tasks.workunit.client.1.smithi155.stdout:5/698: write d0/d27/f98 [1849455,30206] 0 2024-04-25T15:57:43.639 INFO:tasks.workunit.client.1.smithi155.stdout:2/780: mknod d7/db/d2e/d90/ddd/cfb 0 2024-04-25T15:57:43.641 INFO:tasks.workunit.client.1.smithi155.stdout:8/465: fdatasync d2/d15/d35/f6d 0 2024-04-25T15:57:43.642 INFO:tasks.workunit.client.1.smithi155.stdout:2/781: readlink d7/db/d2e/d44/d70/l81 0 2024-04-25T15:57:43.642 INFO:tasks.workunit.client.1.smithi155.stdout:6/846: dwrite d0/d13/d34/d38/d7a/fd8 [0,4194304] 0 2024-04-25T15:57:43.643 INFO:tasks.workunit.client.1.smithi155.stdout:5/699: stat d0/d27/c95 0 2024-04-25T15:57:43.644 INFO:tasks.workunit.client.1.smithi155.stdout:5/700: stat d0/d3/d15/d30/c42 0 2024-04-25T15:57:43.644 INFO:tasks.workunit.client.1.smithi155.stdout:8/466: write d2/d15/d35/d3d/f42 [2206373,109555] 0 2024-04-25T15:57:43.645 INFO:tasks.workunit.client.1.smithi155.stdout:0/687: mkdir d1/d3/d3d/d46/deb 0 2024-04-25T15:57:43.647 INFO:tasks.workunit.client.1.smithi155.stdout:2/782: unlink d7/db/d2e/d90/feb 0 2024-04-25T15:57:43.650 INFO:tasks.workunit.client.1.smithi155.stdout:5/701: creat d0/d58/d32/d6a/d78/fe3 x:0 0 0 2024-04-25T15:57:43.651 INFO:tasks.workunit.client.1.smithi155.stdout:0/688: fdatasync d1/d6/d29/f3a 0 2024-04-25T15:57:43.654 INFO:tasks.workunit.client.1.smithi155.stdout:8/467: rename d2/d15/d63/f84 to d2/d5/d40/d5b/f91 0 2024-04-25T15:57:43.654 INFO:tasks.workunit.client.1.smithi155.stdout:5/702: mkdir d0/d47/de4 0 2024-04-25T15:57:43.656 INFO:tasks.workunit.client.1.smithi155.stdout:7/815: dwrite d2/dd/d30/d44/fe7 [0,4194304] 0 2024-04-25T15:57:43.657 INFO:tasks.workunit.client.1.smithi155.stdout:6/847: dwrite d0/d13/d43/f42 [0,4194304] 0 2024-04-25T15:57:43.662 INFO:tasks.workunit.client.1.smithi155.stdout:2/783: link d7/db/d2e/d6f/d91/dad/lf7 d7/db/d2e/d44/d9e/lfc 0 2024-04-25T15:57:43.665 INFO:tasks.workunit.client.1.smithi155.stdout:5/703: mknod d0/d3/ce5 0 2024-04-25T15:57:43.666 INFO:tasks.workunit.client.1.smithi155.stdout:2/784: chown d7/db/d2e/d6f/dc6/lf6 2 1 2024-04-25T15:57:43.667 INFO:tasks.workunit.client.1.smithi155.stdout:5/704: fdatasync d0/d3/d15/d1f/d50/fd5 0 2024-04-25T15:57:43.668 INFO:tasks.workunit.client.1.smithi155.stdout:7/816: creat d2/dd/d30/d113/f116 x:0 0 0 2024-04-25T15:57:43.668 INFO:tasks.workunit.client.1.smithi155.stdout:6/848: dwrite d0/d13/d6f/fe2 [0,4194304] 0 2024-04-25T15:57:43.670 INFO:tasks.workunit.client.1.smithi155.stdout:8/468: rmdir d2/d15/d18/d23/d3c/d76/d7e/d8e 0 2024-04-25T15:57:43.673 INFO:tasks.workunit.client.1.smithi155.stdout:6/849: mknod d0/d18/d54/c108 0 2024-04-25T15:57:43.675 INFO:tasks.workunit.client.1.smithi155.stdout:0/689: truncate d1/f3c 2347199 0 2024-04-25T15:57:43.677 INFO:tasks.workunit.client.1.smithi155.stdout:5/705: symlink d0/d58/d63/da0/dd6/le6 0 2024-04-25T15:57:43.678 INFO:tasks.workunit.client.1.smithi155.stdout:5/706: stat d0/d27/la8 0 2024-04-25T15:57:43.678 INFO:tasks.workunit.client.1.smithi155.stdout:8/469: symlink d2/d15/d35/d3d/d6c/l92 0 2024-04-25T15:57:43.679 INFO:tasks.workunit.client.1.smithi155.stdout:5/707: fsync d0/d3/d2c/fbb 0 2024-04-25T15:57:43.682 INFO:tasks.workunit.client.1.smithi155.stdout:0/690: creat d1/d3/d12/fec x:0 0 0 2024-04-25T15:57:43.682 INFO:tasks.workunit.client.1.smithi155.stdout:7/817: getdents d2/d26/d3d/d6d/daa 0 2024-04-25T15:57:43.684 INFO:tasks.workunit.client.1.smithi155.stdout:5/708: rename d0/d58/d63/da0/fbe to d0/d58/fe7 0 2024-04-25T15:57:43.686 INFO:tasks.workunit.client.1.smithi155.stdout:6/850: dwrite d0/d1a/d21/d73/f5a [0,4194304] 0 2024-04-25T15:57:43.695 INFO:tasks.workunit.client.1.smithi155.stdout:6/851: mkdir d0/d1a/d25/d51/d109 0 2024-04-25T15:57:43.696 INFO:tasks.workunit.client.1.smithi155.stdout:2/785: write d7/db/dd/d15/d60/f79 [225405,17651] 0 2024-04-25T15:57:43.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/658: sync 2024-04-25T15:57:43.700 INFO:tasks.workunit.client.1.smithi155.stdout:9/618: sync 2024-04-25T15:57:43.701 INFO:tasks.workunit.client.1.smithi155.stdout:8/470: truncate d2/f14 5283 0 2024-04-25T15:57:43.702 INFO:tasks.workunit.client.1.smithi155.stdout:6/852: mkdir d0/d1a/d37/d10a 0 2024-04-25T15:57:43.704 INFO:tasks.workunit.client.1.smithi155.stdout:9/619: creat dc/d11/d30/d46/da0/fcf x:0 0 0 2024-04-25T15:57:43.704 INFO:tasks.workunit.client.1.smithi155.stdout:9/620: fdatasync dc/d17/d2a/fc5 0 2024-04-25T15:57:43.705 INFO:tasks.workunit.client.1.smithi155.stdout:5/709: truncate d0/d27/f43 224023 0 2024-04-25T15:57:43.706 INFO:tasks.workunit.client.1.smithi155.stdout:2/786: dread d7/d23/f21 [0,4194304] 0 2024-04-25T15:57:43.706 INFO:tasks.workunit.client.1.smithi155.stdout:5/710: chown d0/d58/d63/l67 1 1 2024-04-25T15:57:43.706 INFO:tasks.workunit.client.1.smithi155.stdout:7/818: write d2/dd/d66/d8c/fc8 [794913,6005] 0 2024-04-25T15:57:43.707 INFO:tasks.workunit.client.1.smithi155.stdout:5/711: dread - d0/d3/d15/d9f/dc3/fd0 zero size 2024-04-25T15:57:43.708 INFO:tasks.workunit.client.1.smithi155.stdout:5/712: readlink d0/d3/l3e 0 2024-04-25T15:57:43.708 INFO:tasks.workunit.client.1.smithi155.stdout:8/471: rename d2/d15/d35/f44 to d2/d15/d18/d34/d48/d4e/f93 0 2024-04-25T15:57:43.714 INFO:tasks.workunit.client.1.smithi155.stdout:2/787: creat d7/db/d2e/def/ffd x:0 0 0 2024-04-25T15:57:43.721 INFO:tasks.workunit.client.1.smithi155.stdout:6/853: dread d0/d1a/d87/fd4 [0,4194304] 0 2024-04-25T15:57:43.724 INFO:tasks.workunit.client.1.smithi155.stdout:4/659: truncate da/d23/d3f/d56/d69/d4a/d78/d62/f68 427117 0 2024-04-25T15:57:43.725 INFO:tasks.workunit.client.1.smithi155.stdout:2/788: dwrite d7/db/d29/d83/d86/db0/fc7 [0,4194304] 0 2024-04-25T15:57:43.725 INFO:tasks.workunit.client.1.smithi155.stdout:9/621: getdents dc/d11/d67/d9c 0 2024-04-25T15:57:43.727 INFO:tasks.workunit.client.1.smithi155.stdout:8/472: getdents d2/d15/d18/d23/d3c 0 2024-04-25T15:57:43.727 INFO:tasks.workunit.client.1.smithi155.stdout:4/660: write da/d30/fe1 [944517,81975] 0 2024-04-25T15:57:43.728 INFO:tasks.workunit.client.1.smithi155.stdout:5/713: dwrite d0/d58/d32/f79 [0,4194304] 0 2024-04-25T15:57:43.733 INFO:tasks.workunit.client.1.smithi155.stdout:8/473: creat d2/d15/d18/d34/f94 x:0 0 0 2024-04-25T15:57:43.733 INFO:tasks.workunit.client.1.smithi155.stdout:5/714: rmdir d0/d3/d15 39 2024-04-25T15:57:43.735 INFO:tasks.workunit.client.1.smithi155.stdout:8/474: dread - d2/d15/d35/d3d/f6b zero size 2024-04-25T15:57:43.735 INFO:tasks.workunit.client.1.smithi155.stdout:4/661: unlink da/d23/d3f/d56/dca/cd4 0 2024-04-25T15:57:43.736 INFO:tasks.workunit.client.1.smithi155.stdout:0/691: dread d1/d3/d3d/d46/f78 [0,4194304] 0 2024-04-25T15:57:43.737 INFO:tasks.workunit.client.1.smithi155.stdout:5/715: mkdir d0/d58/d63/da0/dd6/de8 0 2024-04-25T15:57:43.739 INFO:tasks.workunit.client.1.smithi155.stdout:2/789: getdents d7/db/d2e/d6f/d91/dad 0 2024-04-25T15:57:43.740 INFO:tasks.workunit.client.1.smithi155.stdout:0/692: write d1/d3/d5/d5b/dc4/d60/f6d [3399339,47553] 0 2024-04-25T15:57:43.741 INFO:tasks.workunit.client.1.smithi155.stdout:8/475: mkdir d2/d15/d18/d95 0 2024-04-25T15:57:43.741 INFO:tasks.workunit.client.1.smithi155.stdout:2/790: write d7/db/d2e/d6f/fc2 [429556,114773] 0 2024-04-25T15:57:43.742 INFO:tasks.workunit.client.1.smithi155.stdout:5/716: creat d0/d58/d63/da0/dd6/fe9 x:0 0 0 2024-04-25T15:57:43.743 INFO:tasks.workunit.client.1.smithi155.stdout:0/693: chown d1/d3/d12/l15 1773 1 2024-04-25T15:57:43.743 INFO:tasks.workunit.client.1.smithi155.stdout:8/476: symlink d2/d15/d18/d34/l96 0 2024-04-25T15:57:43.744 INFO:tasks.workunit.client.1.smithi155.stdout:2/791: symlink d7/db/d2e/d90/ddd/lfe 0 2024-04-25T15:57:43.744 INFO:tasks.workunit.client.1.smithi155.stdout:8/477: stat d2/f7a 0 2024-04-25T15:57:43.745 INFO:tasks.workunit.client.1.smithi155.stdout:5/717: mkdir d0/d58/dea 0 2024-04-25T15:57:43.747 INFO:tasks.workunit.client.1.smithi155.stdout:8/478: unlink d2/d15/d18/d23/l8a 0 2024-04-25T15:57:43.749 INFO:tasks.workunit.client.1.smithi155.stdout:2/792: mkdir d7/db/dd/d15/dff 0 2024-04-25T15:57:43.754 INFO:tasks.workunit.client.1.smithi155.stdout:6/854: dread d0/d1a/d25/f2b [0,4194304] 0 2024-04-25T15:57:43.754 INFO:tasks.workunit.client.1.smithi155.stdout:2/793: chown d7/db/d2e/d44/f6d 186634 1 2024-04-25T15:57:43.755 INFO:tasks.workunit.client.1.smithi155.stdout:6/855: write d0/d18/f48 [2867511,114235] 0 2024-04-25T15:57:43.757 INFO:tasks.workunit.client.1.smithi155.stdout:2/794: stat d7/db/d29/c5f 0 2024-04-25T15:57:43.758 INFO:tasks.workunit.client.1.smithi155.stdout:6/856: fsync d0/d13/d7c/da9/fbc 0 2024-04-25T15:57:43.765 INFO:tasks.workunit.client.1.smithi155.stdout:6/857: creat d0/d13/d34/d38/d90/da5/f10b x:0 0 0 2024-04-25T15:57:43.766 INFO:tasks.workunit.client.1.smithi155.stdout:4/662: dread da/dc/fd [0,4194304] 0 2024-04-25T15:57:43.769 INFO:tasks.workunit.client.1.smithi155.stdout:8/479: dwrite d2/d15/d35/f4d [0,4194304] 0 2024-04-25T15:57:43.770 INFO:tasks.workunit.client.1.smithi155.stdout:2/795: dread d7/d23/f40 [0,4194304] 0 2024-04-25T15:57:43.772 INFO:tasks.workunit.client.1.smithi155.stdout:5/718: dwrite d0/d3/d15/d1f/d50/d7c/f7d [0,4194304] 0 2024-04-25T15:57:43.772 INFO:tasks.workunit.client.1.smithi155.stdout:0/694: dread d1/d3/d6a/f73 [4194304,4194304] 0 2024-04-25T15:57:43.773 INFO:tasks.workunit.client.1.smithi155.stdout:5/719: chown d0/d3/l3e 103 1 2024-04-25T15:57:43.773 INFO:tasks.workunit.client.1.smithi155.stdout:8/480: truncate d2/d5/d40/f58 5155915 0 2024-04-25T15:57:43.776 INFO:tasks.workunit.client.1.smithi155.stdout:2/796: creat d7/d8e/f100 x:0 0 0 2024-04-25T15:57:43.776 INFO:tasks.workunit.client.1.smithi155.stdout:5/720: rmdir d0/d58/d32/d6a/d78 39 2024-04-25T15:57:43.778 INFO:tasks.workunit.client.1.smithi155.stdout:8/481: mknod d2/d5/d40/d5b/c97 0 2024-04-25T15:57:43.781 INFO:tasks.workunit.client.1.smithi155.stdout:6/858: link d0/d1a/d21/lc9 d0/d1a/d21/d73/l10c 0 2024-04-25T15:57:43.781 INFO:tasks.workunit.client.1.smithi155.stdout:8/482: rmdir d2/d15/d35/d3d/d6c 39 2024-04-25T15:57:43.781 INFO:tasks.workunit.client.1.smithi155.stdout:2/797: write d7/d23/fb3 [31482,7278] 0 2024-04-25T15:57:43.782 INFO:tasks.workunit.client.1.smithi155.stdout:5/721: symlink d0/d3/d15/d1f/d50/leb 0 2024-04-25T15:57:43.784 INFO:tasks.workunit.client.1.smithi155.stdout:6/859: mkdir d0/d1a/da1/dac/d10d 0 2024-04-25T15:57:43.784 INFO:tasks.workunit.client.1.smithi155.stdout:6/860: chown d0/d1a/d21/f47 1722487 1 2024-04-25T15:57:43.784 INFO:tasks.workunit.client.1.smithi155.stdout:8/483: unlink d2/d15/d18/d49/l7b 0 2024-04-25T15:57:43.785 INFO:tasks.workunit.client.1.smithi155.stdout:5/722: stat d0/d3/d15/d1f/l6f 0 2024-04-25T15:57:43.786 INFO:tasks.workunit.client.1.smithi155.stdout:2/798: mkdir d7/db/d29/d83/dbe/d101 0 2024-04-25T15:57:43.786 INFO:tasks.workunit.client.1.smithi155.stdout:6/861: rmdir d0/d1a/d37/dda 39 2024-04-25T15:57:43.789 INFO:tasks.workunit.client.1.smithi155.stdout:6/862: creat d0/d1a/da1/f10e x:0 0 0 2024-04-25T15:57:43.790 INFO:tasks.workunit.client.1.smithi155.stdout:2/799: rename d7/db/d2e/d44/d9e/fa5 to d7/db/d2e/d44/d95/f102 0 2024-04-25T15:57:43.790 INFO:tasks.workunit.client.1.smithi155.stdout:6/863: fdatasync d0/d1a/da1/dac/fb3 0 2024-04-25T15:57:43.794 INFO:tasks.workunit.client.1.smithi155.stdout:6/864: creat d0/d13/d34/d38/f10f x:0 0 0 2024-04-25T15:57:43.796 INFO:tasks.workunit.client.1.smithi155.stdout:6/865: readlink d0/l11 0 2024-04-25T15:57:43.796 INFO:tasks.workunit.client.1.smithi155.stdout:5/723: dwrite d0/d3/d15/d1f/d50/d7c/fb5 [0,4194304] 0 2024-04-25T15:57:43.797 INFO:tasks.workunit.client.1.smithi155.stdout:5/724: fdatasync d0/f2 0 2024-04-25T15:57:43.803 INFO:tasks.workunit.client.1.smithi155.stdout:2/800: write d7/db/d2e/d6f/f80 [463782,60293] 0 2024-04-25T15:57:43.805 INFO:tasks.workunit.client.1.smithi155.stdout:2/801: chown d7/d8e/f100 108 1 2024-04-25T15:57:43.806 INFO:tasks.workunit.client.1.smithi155.stdout:8/484: dread d2/d15/d35/f6d [0,4194304] 0 2024-04-25T15:57:43.806 INFO:tasks.workunit.client.1.smithi155.stdout:5/725: dread d0/d3/d15/d1f/f70 [0,4194304] 0 2024-04-25T15:57:43.806 INFO:tasks.workunit.client.1.smithi155.stdout:6/866: rmdir d0/d13/d34/d38/d4c 39 2024-04-25T15:57:43.807 INFO:tasks.workunit.client.1.smithi155.stdout:4/663: dwrite da/d23/d3f/d56/d69/d4a/d78/d62/f68 [0,4194304] 0 2024-04-25T15:57:43.808 INFO:tasks.workunit.client.1.smithi155.stdout:2/802: dread - d7/db/dd/f5e zero size 2024-04-25T15:57:43.808 INFO:tasks.workunit.client.1.smithi155.stdout:8/485: write d2/f60 [179765,81346] 0 2024-04-25T15:57:43.810 INFO:tasks.workunit.client.1.smithi155.stdout:6/867: write d0/d18/d54/fff [744312,21072] 0 2024-04-25T15:57:43.812 INFO:tasks.workunit.client.1.smithi155.stdout:5/726: write d0/d58/d63/da0/fab [2582637,39684] 0 2024-04-25T15:57:43.813 INFO:tasks.workunit.client.1.smithi155.stdout:4/664: creat da/dc/d18/fed x:0 0 0 2024-04-25T15:57:43.814 INFO:tasks.workunit.client.1.smithi155.stdout:5/727: chown d0/d3/ce5 0 1 2024-04-25T15:57:43.818 INFO:tasks.workunit.client.1.smithi155.stdout:5/728: fsync d0/d3/fcc 0 2024-04-25T15:57:43.818 INFO:tasks.workunit.client.1.smithi155.stdout:8/486: mknod d2/d15/d35/d3d/d6c/c98 0 2024-04-25T15:57:43.818 INFO:tasks.workunit.client.1.smithi155.stdout:5/729: write d0/d27/f98 [5660082,89141] 0 2024-04-25T15:57:43.818 INFO:tasks.workunit.client.1.smithi155.stdout:4/665: read da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fc4 [264076,119856] 0 2024-04-25T15:57:43.819 INFO:tasks.workunit.client.1.smithi155.stdout:8/487: readlink d2/d15/d35/d3d/l75 0 2024-04-25T15:57:43.820 INFO:tasks.workunit.client.1.smithi155.stdout:6/868: mknod d0/d13/d34/d38/d90/da5/c110 0 2024-04-25T15:57:43.820 INFO:tasks.workunit.client.1.smithi155.stdout:4/666: rmdir da/d23/d3a 39 2024-04-25T15:57:43.821 INFO:tasks.workunit.client.1.smithi155.stdout:8/488: dread - d2/d15/d18/d34/d48/f8f zero size 2024-04-25T15:57:43.822 INFO:tasks.workunit.client.1.smithi155.stdout:5/730: rmdir d0/d58/d63/da0/dd6/de8 0 2024-04-25T15:57:43.823 INFO:tasks.workunit.client.1.smithi155.stdout:6/869: fsync d0/d1a/d25/d2e/d39/f86 0 2024-04-25T15:57:43.823 INFO:tasks.workunit.client.1.smithi155.stdout:2/803: dwrite d7/db/d29/d83/d86/db0/fc7 [0,4194304] 0 2024-04-25T15:57:43.824 INFO:tasks.workunit.client.1.smithi155.stdout:8/489: mknod d2/d15/d35/c99 0 2024-04-25T15:57:43.824 INFO:tasks.workunit.client.1.smithi155.stdout:4/667: chown da/d23/d3f/d56/d69/d4a/d78/d62/fb1 356429638 1 2024-04-25T15:57:43.825 INFO:tasks.workunit.client.1.smithi155.stdout:5/731: dread - d0/d27/f7f zero size 2024-04-25T15:57:43.826 INFO:tasks.workunit.client.1.smithi155.stdout:8/490: chown d2/d5/c37 187 1 2024-04-25T15:57:43.827 INFO:tasks.workunit.client.1.smithi155.stdout:3/738: sync 2024-04-25T15:57:43.827 INFO:tasks.workunit.client.1.smithi155.stdout:6/870: write d0/d13/d7c/da9/fbc [252934,104173] 0 2024-04-25T15:57:43.829 INFO:tasks.workunit.client.1.smithi155.stdout:5/732: mknod d0/d3/d2c/d94/cec 0 2024-04-25T15:57:43.830 INFO:tasks.workunit.client.1.smithi155.stdout:6/871: chown d0/d18/d54/fff 34457 1 2024-04-25T15:57:43.830 INFO:tasks.workunit.client.1.smithi155.stdout:8/491: dread - d2/d15/d18/d34/d48/f89 zero size 2024-04-25T15:57:43.831 INFO:tasks.workunit.client.1.smithi155.stdout:3/739: symlink d1/d4/db/d91/lfd 0 2024-04-25T15:57:43.832 INFO:tasks.workunit.client.1.smithi155.stdout:8/492: readlink d2/d15/d35/d3d/d6c/l92 0 2024-04-25T15:57:43.834 INFO:tasks.workunit.client.1.smithi155.stdout:5/733: rename d0/d3/d15/l61 to d0/d3/d15/d9f/dc3/led 0 2024-04-25T15:57:43.836 INFO:tasks.workunit.client.1.smithi155.stdout:6/872: creat d0/d1a/d87/f111 x:0 0 0 2024-04-25T15:57:43.839 INFO:tasks.workunit.client.1.smithi155.stdout:8/493: creat d2/d15/d18/d23/d3c/d76/d7e/f9a x:0 0 0 2024-04-25T15:57:43.840 INFO:tasks.workunit.client.1.smithi155.stdout:3/740: dwrite d1/d4/d10/d21/d73/d8d/fda [0,4194304] 0 2024-04-25T15:57:43.845 INFO:tasks.workunit.client.1.smithi155.stdout:8/494: creat d2/d5/f9b x:0 0 0 2024-04-25T15:57:43.846 INFO:tasks.workunit.client.1.smithi155.stdout:2/804: write d7/db/dd/f48 [1218958,107007] 0 2024-04-25T15:57:43.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/741: creat d1/d4/d10/d21/ffe x:0 0 0 2024-04-25T15:57:43.853 INFO:tasks.workunit.client.1.smithi155.stdout:8/495: unlink d2/d15/d18/c26 0 2024-04-25T15:57:43.854 INFO:tasks.workunit.client.1.smithi155.stdout:4/668: truncate da/d23/d3f/d56/d69/d83/f7d 1048392 0 2024-04-25T15:57:43.858 INFO:tasks.workunit.client.1.smithi155.stdout:5/734: creat d0/d3/d15/d1f/d50/fee x:0 0 0 2024-04-25T15:57:43.859 INFO:tasks.workunit.client.1.smithi155.stdout:3/742: creat d1/d4/d10/d21/d73/d77/d5f/fff x:0 0 0 2024-04-25T15:57:43.860 INFO:tasks.workunit.client.1.smithi155.stdout:3/743: readlink d1/d4/l9c 0 2024-04-25T15:57:43.860 INFO:tasks.workunit.client.1.smithi155.stdout:8/496: dwrite d2/d15/d18/d34/f53 [0,4194304] 0 2024-04-25T15:57:43.861 INFO:tasks.workunit.client.1.smithi155.stdout:3/744: chown d1/d4/db/d28/ddd 9737 1 2024-04-25T15:57:43.862 INFO:tasks.workunit.client.1.smithi155.stdout:6/873: rmdir d0/d1a/d25/d51/d109 0 2024-04-25T15:57:43.865 INFO:tasks.workunit.client.1.smithi155.stdout:4/669: fsync da/dc/d18/f4c 0 2024-04-25T15:57:43.870 INFO:tasks.workunit.client.1.smithi155.stdout:5/735: rename d0/f2 to d0/d58/d9b/fef 0 2024-04-25T15:57:43.871 INFO:tasks.workunit.client.1.smithi155.stdout:5/736: dread - d0/d3/f7b zero size 2024-04-25T15:57:43.873 INFO:tasks.workunit.client.1.smithi155.stdout:2/805: dwrite d7/db/dd/d15/f42 [0,4194304] 0 2024-04-25T15:57:43.879 INFO:tasks.workunit.client.1.smithi155.stdout:4/670: fsync da/d87/f9d 0 2024-04-25T15:57:43.879 INFO:tasks.workunit.client.1.smithi155.stdout:3/745: dread d1/d94/f95 [0,4194304] 0 2024-04-25T15:57:43.881 INFO:tasks.workunit.client.1.smithi155.stdout:3/746: dread - d1/d4/db/d20/d44/fe0 zero size 2024-04-25T15:57:43.883 INFO:tasks.workunit.client.1.smithi155.stdout:6/874: getdents d0/d1a/d45/d61/d8e 0 2024-04-25T15:57:43.891 INFO:tasks.workunit.client.1.smithi155.stdout:6/875: rename d0/d13/d7c/da9 to d0/d18/d112 0 2024-04-25T15:57:43.891 INFO:tasks.workunit.client.1.smithi155.stdout:4/671: mknod da/d23/d3f/d56/d69/cee 0 2024-04-25T15:57:43.891 INFO:tasks.workunit.client.1.smithi155.stdout:3/747: dread d1/d4/db/d91/faa [0,4194304] 0 2024-04-25T15:57:43.893 INFO:tasks.workunit.client.1.smithi155.stdout:6/876: write d0/d1a/d21/fea [1000985,46859] 0 2024-04-25T15:57:43.894 INFO:tasks.workunit.client.1.smithi155.stdout:2/806: truncate d7/db/d29/d83/d86/db0/fc7 118404 0 2024-04-25T15:57:43.894 INFO:tasks.workunit.client.1.smithi155.stdout:6/877: fdatasync d0/d18/d112/fbc 0 2024-04-25T15:57:43.895 INFO:tasks.workunit.client.1.smithi155.stdout:4/672: fsync da/f14 0 2024-04-25T15:57:43.896 INFO:tasks.workunit.client.1.smithi155.stdout:2/807: write d7/db/dd/f48 [2701598,82335] 0 2024-04-25T15:57:43.896 INFO:tasks.workunit.client.1.smithi155.stdout:6/878: read - d0/d1a/da1/f10e zero size 2024-04-25T15:57:43.896 INFO:tasks.workunit.client.1.smithi155.stdout:8/497: link d2/d15/d18/d34/l3e d2/d15/d18/d23/l9c 0 2024-04-25T15:57:43.899 INFO:tasks.workunit.client.1.smithi155.stdout:5/737: dread d0/d58/d9b/fef [0,4194304] 0 2024-04-25T15:57:43.900 INFO:tasks.workunit.client.1.smithi155.stdout:2/808: symlink d7/db/dd/d15/l103 0 2024-04-25T15:57:43.900 INFO:tasks.workunit.client.1.smithi155.stdout:2/809: fdatasync d7/db/d2e/f84 0 2024-04-25T15:57:43.901 INFO:tasks.workunit.client.1.smithi155.stdout:4/673: creat da/d23/d3a/fef x:0 0 0 2024-04-25T15:57:43.901 INFO:tasks.workunit.client.1.smithi155.stdout:3/748: getdents d1/d4/db/d20/d44/d52/d93 0 2024-04-25T15:57:43.902 INFO:tasks.workunit.client.1.smithi155.stdout:3/749: readlink d1/d4/d10/d21/d73/d77/lbe 0 2024-04-25T15:57:43.903 INFO:tasks.workunit.client.1.smithi155.stdout:8/498: rename d2/d15/d18/d34/d48/d59/l77 to d2/d15/d18/d34/d48/d4e/d81/l9d 0 2024-04-25T15:57:43.904 INFO:tasks.workunit.client.1.smithi155.stdout:5/738: mknod d0/d58/d63/da0/dd6/cf0 0 2024-04-25T15:57:43.904 INFO:tasks.workunit.client.1.smithi155.stdout:8/499: chown d2/d15/d18/d23/c55 2857 1 2024-04-25T15:57:43.904 INFO:tasks.workunit.client.1.smithi155.stdout:2/810: write d7/db/d29/f30 [1061434,79646] 0 2024-04-25T15:57:43.905 INFO:tasks.workunit.client.1.smithi155.stdout:4/674: fsync da/d23/f3d 0 2024-04-25T15:57:43.907 INFO:tasks.workunit.client.1.smithi155.stdout:4/675: dread - da/dc/d18/fda zero size 2024-04-25T15:57:43.907 INFO:tasks.workunit.client.1.smithi155.stdout:6/879: rename d0/d13/d34/d38/d90/da5/le9 to d0/d1a/d37/dda/l113 0 2024-04-25T15:57:43.909 INFO:tasks.workunit.client.1.smithi155.stdout:6/880: chown d0/d1a/d37/dda/dfe/df0 0 1 2024-04-25T15:57:43.909 INFO:tasks.workunit.client.1.smithi155.stdout:4/676: chown da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fc4 4 1 2024-04-25T15:57:43.909 INFO:tasks.workunit.client.1.smithi155.stdout:6/881: chown d0/d18/l60 861564 1 2024-04-25T15:57:43.910 INFO:tasks.workunit.client.1.smithi155.stdout:4/677: write da/d30/fe1 [849578,26678] 0 2024-04-25T15:57:43.912 INFO:tasks.workunit.client.1.smithi155.stdout:2/811: mkdir d7/d23/d104 0 2024-04-25T15:57:43.918 INFO:tasks.workunit.client.1.smithi155.stdout:6/882: creat d0/d13/d6f/f114 x:0 0 0 2024-04-25T15:57:43.918 INFO:tasks.workunit.client.1.smithi155.stdout:6/883: fdatasync d0/d13/d7c/d99/fb1 0 2024-04-25T15:57:43.919 INFO:tasks.workunit.client.1.smithi155.stdout:6/884: write d0/d13/dd1/fd6 [655638,61165] 0 2024-04-25T15:57:43.921 INFO:tasks.workunit.client.1.smithi155.stdout:6/885: read d0/d13/d34/d38/d90/da5/f102 [3185103,4613] 0 2024-04-25T15:57:43.921 INFO:tasks.workunit.client.1.smithi155.stdout:6/886: read - d0/d13/d6f/f114 zero size 2024-04-25T15:57:43.922 INFO:tasks.workunit.client.1.smithi155.stdout:2/812: rmdir d7/db/d2e/d6f 39 2024-04-25T15:57:43.922 INFO:tasks.workunit.client.1.smithi155.stdout:6/887: chown d0/d1a/d37/dda/fd9 9680 1 2024-04-25T15:57:43.923 INFO:tasks.workunit.client.1.smithi155.stdout:5/739: link d0/d47/db3/fba d0/d3/d15/d30/d4f/ff1 0 2024-04-25T15:57:43.925 INFO:tasks.workunit.client.1.smithi155.stdout:4/678: symlink da/d23/d3f/lf0 0 2024-04-25T15:57:43.929 INFO:tasks.workunit.client.1.smithi155.stdout:2/813: chown d7/db/d2e/d6f/c96 159541 1 2024-04-25T15:57:43.929 INFO:tasks.workunit.client.1.smithi155.stdout:6/888: readlink d0/d13/l66 0 2024-04-25T15:57:43.931 INFO:tasks.workunit.client.1.smithi155.stdout:3/750: rename d1/d4/db/d91/dc4/d6c/fbc to d1/f100 0 2024-04-25T15:57:43.932 INFO:tasks.workunit.client.1.smithi155.stdout:5/740: fdatasync d0/d47/db3/fba 0 2024-04-25T15:57:43.933 INFO:tasks.workunit.client.1.smithi155.stdout:8/500: dwrite d2/d15/d18/d23/d2d/f39 [0,4194304] 0 2024-04-25T15:57:43.933 INFO:tasks.workunit.client.1.smithi155.stdout:3/751: chown d1/d4/f18 96231 1 2024-04-25T15:57:43.936 INFO:tasks.workunit.client.1.smithi155.stdout:8/501: dread - d2/d15/d18/d34/d48/f89 zero size 2024-04-25T15:57:43.941 INFO:tasks.workunit.client.1.smithi155.stdout:6/889: dwrite d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:43.943 INFO:tasks.workunit.client.1.smithi155.stdout:4/679: rename da/d30/l6f to da/d87/lf1 0 2024-04-25T15:57:43.946 INFO:tasks.workunit.client.1.smithi155.stdout:3/752: dwrite d1/d4/d10/d21/d73/f82 [0,4194304] 0 2024-04-25T15:57:43.947 INFO:tasks.workunit.client.1.smithi155.stdout:8/502: creat d2/d15/d18/d49/f9e x:0 0 0 2024-04-25T15:57:43.949 INFO:tasks.workunit.client.1.smithi155.stdout:4/680: mknod da/d23/d3f/d56/d69/d4a/d78/cf2 0 2024-04-25T15:57:43.950 INFO:tasks.workunit.client.1.smithi155.stdout:4/681: chown da/dc/d18/fe5 14 1 2024-04-25T15:57:43.951 INFO:tasks.workunit.client.1.smithi155.stdout:6/890: dread d0/d1a/da1/f101 [0,4194304] 0 2024-04-25T15:57:43.952 INFO:tasks.workunit.client.1.smithi155.stdout:5/741: rmdir d0/d3/d15/d1f/d50/ddb 0 2024-04-25T15:57:43.954 INFO:tasks.workunit.client.1.smithi155.stdout:2/814: getdents d7/db/d2e/d44 0 2024-04-25T15:57:43.955 INFO:tasks.workunit.client.1.smithi155.stdout:6/891: mknod d0/d1a/d25/d51/d104/c115 0 2024-04-25T15:57:43.958 INFO:tasks.workunit.client.1.smithi155.stdout:5/742: getdents d0/d58/d63/da0 0 2024-04-25T15:57:43.960 INFO:tasks.workunit.client.1.smithi155.stdout:8/503: dwrite d2/d15/d18/d34/d48/f89 [0,4194304] 0 2024-04-25T15:57:43.960 INFO:tasks.workunit.client.1.smithi155.stdout:5/743: stat d0/d58/d63/lb6 0 2024-04-25T15:57:43.962 INFO:tasks.workunit.client.1.smithi155.stdout:2/815: read f1 [273814,50228] 0 2024-04-25T15:57:43.965 INFO:tasks.workunit.client.1.smithi155.stdout:2/816: write d7/db/dd/d15/d60/d94/fe7 [1589197,112447] 0 2024-04-25T15:57:43.968 INFO:tasks.workunit.client.1.smithi155.stdout:6/892: dwrite d0/d13/d43/fe3 [0,4194304] 0 2024-04-25T15:57:43.968 INFO:tasks.workunit.client.1.smithi155.stdout:2/817: creat d7/db/d2e/d44/f105 x:0 0 0 2024-04-25T15:57:43.970 INFO:tasks.workunit.client.1.smithi155.stdout:2/818: chown d7/db/d29/d83/dbe/lde 15240570 1 2024-04-25T15:57:43.972 INFO:tasks.workunit.client.1.smithi155.stdout:2/819: read d7/f2d [2357553,1307] 0 2024-04-25T15:57:43.972 INFO:tasks.workunit.client.1.smithi155.stdout:5/744: getdents d0/d27 0 2024-04-25T15:57:43.975 INFO:tasks.workunit.client.1.smithi155.stdout:1/741: sync 2024-04-25T15:57:43.975 INFO:tasks.workunit.client.1.smithi155.stdout:6/893: rmdir d0/d1a/d37/dda/def 0 2024-04-25T15:57:43.975 INFO:tasks.workunit.client.1.smithi155.stdout:4/682: dread da/f21 [0,4194304] 0 2024-04-25T15:57:43.978 INFO:tasks.workunit.client.1.smithi155.stdout:4/683: write da/d23/da2/fb8 [594191,123030] 0 2024-04-25T15:57:43.978 INFO:tasks.workunit.client.1.smithi155.stdout:5/745: creat d0/d3/d15/d30/ff2 x:0 0 0 2024-04-25T15:57:43.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/742: fdatasync d1/d16/d1d/d29/d5f/f35 0 2024-04-25T15:57:43.983 INFO:tasks.workunit.client.1.smithi155.stdout:6/894: dread d0/d1a/d25/d51/f84 [0,4194304] 0 2024-04-25T15:57:43.983 INFO:tasks.workunit.client.1.smithi155.stdout:1/743: write d1/d16/d1d/f5c [3488715,48738] 0 2024-04-25T15:57:43.984 INFO:tasks.workunit.client.1.smithi155.stdout:4/684: creat da/d23/d3f/d56/d69/d4a/ff3 x:0 0 0 2024-04-25T15:57:43.986 INFO:tasks.workunit.client.1.smithi155.stdout:4/685: chown da/d23/d3a/d7b/d93/fc5 1060967079 1 2024-04-25T15:57:43.986 INFO:tasks.workunit.client.1.smithi155.stdout:8/504: dread d2/f33 [0,4194304] 0 2024-04-25T15:57:43.987 INFO:tasks.workunit.client.1.smithi155.stdout:5/746: creat d0/d3/d15/d30/ff3 x:0 0 0 2024-04-25T15:57:43.989 INFO:tasks.workunit.client.1.smithi155.stdout:2/820: truncate d7/db/d2e/f61 3699331 0 2024-04-25T15:57:43.990 INFO:tasks.workunit.client.1.smithi155.stdout:8/505: stat d2/d15/d18/d34/l3e 0 2024-04-25T15:57:43.991 INFO:tasks.workunit.client.1.smithi155.stdout:1/744: mknod d1/d16/d1d/d29/d5f/db8/ce9 0 2024-04-25T15:57:43.992 INFO:tasks.workunit.client.1.smithi155.stdout:8/506: chown d2/f60 3 1 2024-04-25T15:57:43.993 INFO:tasks.workunit.client.1.smithi155.stdout:5/747: unlink d0/d58/d32/d6a/fc9 0 2024-04-25T15:57:43.993 INFO:tasks.workunit.client.1.smithi155.stdout:6/895: dwrite d0/d1a/d25/fc2 [0,4194304] 0 2024-04-25T15:57:43.997 INFO:tasks.workunit.client.1.smithi155.stdout:1/745: read d1/d16/d1d/d29/d5f/d34/d68/f8a [657903,34052] 0 2024-04-25T15:57:43.997 INFO:tasks.workunit.client.1.smithi155.stdout:5/748: chown d0/d3/fcc 1 1 2024-04-25T15:57:43.998 INFO:tasks.workunit.client.1.smithi155.stdout:4/686: dwrite da/d23/d3f/f79 [0,4194304] 0 2024-04-25T15:57:44.004 INFO:tasks.workunit.client.1.smithi155.stdout:1/746: creat d1/d6/db4/fea x:0 0 0 2024-04-25T15:57:44.005 INFO:tasks.workunit.client.1.smithi155.stdout:6/896: rename d0/d1a/d21/d73/l78 to d0/l116 0 2024-04-25T15:57:44.005 INFO:tasks.workunit.client.1.smithi155.stdout:1/747: write d1/f15 [412520,11442] 0 2024-04-25T15:57:44.007 INFO:tasks.workunit.client.1.smithi155.stdout:4/687: creat da/d23/d3f/d56/dca/ff4 x:0 0 0 2024-04-25T15:57:44.007 INFO:tasks.workunit.client.1.smithi155.stdout:2/821: dwrite d7/db/dd/d15/f55 [0,4194304] 0 2024-04-25T15:57:44.010 INFO:tasks.workunit.client.1.smithi155.stdout:6/897: creat d0/d13/d7c/f117 x:0 0 0 2024-04-25T15:57:44.010 INFO:tasks.workunit.client.1.smithi155.stdout:8/507: dwrite d2/d15/d18/d34/d48/f8f [0,4194304] 0 2024-04-25T15:57:44.013 INFO:tasks.workunit.client.1.smithi155.stdout:2/822: chown d7/db/dd/d15/f55 8390 1 2024-04-25T15:57:44.013 INFO:tasks.workunit.client.1.smithi155.stdout:8/508: stat d2/d15/c52 0 2024-04-25T15:57:44.014 INFO:tasks.workunit.client.1.smithi155.stdout:6/898: dread - d0/d18/fcf zero size 2024-04-25T15:57:44.015 INFO:tasks.workunit.client.1.smithi155.stdout:1/748: creat d1/d16/d1d/d29/d5f/d34/d68/feb x:0 0 0 2024-04-25T15:57:44.019 INFO:tasks.workunit.client.1.smithi155.stdout:6/899: stat d0/d1a/d37/dda/dfe/d7b/cc5 0 2024-04-25T15:57:44.019 INFO:tasks.workunit.client.1.smithi155.stdout:5/749: dwrite d0/d3/d15/d1f/f70 [0,4194304] 0 2024-04-25T15:57:44.022 INFO:tasks.workunit.client.1.smithi155.stdout:6/900: read - d0/d13/d7c/d99/fb1 zero size 2024-04-25T15:57:44.022 INFO:tasks.workunit.client.1.smithi155.stdout:1/749: unlink d1/d16/d37/l5a 0 2024-04-25T15:57:44.026 INFO:tasks.workunit.client.1.smithi155.stdout:5/750: rename d0/d3/d15/d1f/d50/d60/f65 to d0/d3/d2c/ff4 0 2024-04-25T15:57:44.027 INFO:tasks.workunit.client.1.smithi155.stdout:8/509: dwrite d2/f60 [0,4194304] 0 2024-04-25T15:57:44.030 INFO:tasks.workunit.client.1.smithi155.stdout:1/750: creat d1/d16/d1d/d33/fec x:0 0 0 2024-04-25T15:57:44.032 INFO:tasks.workunit.client.1.smithi155.stdout:4/688: write da/d23/d3f/d56/d69/d4a/d78/d62/fb1 [4282590,43907] 0 2024-04-25T15:57:44.034 INFO:tasks.workunit.client.1.smithi155.stdout:5/751: creat d0/d47/de4/ff5 x:0 0 0 2024-04-25T15:57:44.036 INFO:tasks.workunit.client.1.smithi155.stdout:2/823: dread d7/d23/fb3 [0,4194304] 0 2024-04-25T15:57:44.037 INFO:tasks.workunit.client.1.smithi155.stdout:4/689: rmdir da/d23/da2/dad 39 2024-04-25T15:57:44.039 INFO:tasks.workunit.client.1.smithi155.stdout:2/824: chown d7/d23/f34 85527276 1 2024-04-25T15:57:44.040 INFO:tasks.workunit.client.1.smithi155.stdout:5/752: chown d0/d58/d32/d6a/d78/lca 53 1 2024-04-25T15:57:44.041 INFO:tasks.workunit.client.1.smithi155.stdout:8/510: dwrite d2/d15/d18/d34/d48/f8b [0,4194304] 0 2024-04-25T15:57:44.041 INFO:tasks.workunit.client.1.smithi155.stdout:1/751: dwrite d1/d16/d1d/f5c [4194304,4194304] 0 2024-04-25T15:57:44.043 INFO:tasks.workunit.client.1.smithi155.stdout:8/511: chown d2/d15/d18/d34/d48 2 1 2024-04-25T15:57:44.046 INFO:tasks.workunit.client.1.smithi155.stdout:8/512: chown d2/d15/d18/c1e 380935 1 2024-04-25T15:57:44.046 INFO:tasks.workunit.client.1.smithi155.stdout:5/753: symlink d0/d58/d32/d6a/d78/lf6 0 2024-04-25T15:57:44.047 INFO:tasks.workunit.client.1.smithi155.stdout:4/690: symlink da/d23/d3a/d7b/lf5 0 2024-04-25T15:57:44.050 INFO:tasks.workunit.client.1.smithi155.stdout:4/691: dread - da/dc/d18/fdd zero size 2024-04-25T15:57:44.051 INFO:tasks.workunit.client.1.smithi155.stdout:6/901: dwrite d0/d1a/d25/d2e/f31 [4194304,4194304] 0 2024-04-25T15:57:44.053 INFO:tasks.workunit.client.1.smithi155.stdout:5/754: mkdir d0/d3/d15/d9f/df7 0 2024-04-25T15:57:44.053 INFO:tasks.workunit.client.1.smithi155.stdout:2/825: link d7/db/l5b d7/d23/d104/l106 0 2024-04-25T15:57:44.057 INFO:tasks.workunit.client.1.smithi155.stdout:4/692: unlink da/d23/d3a/fef 0 2024-04-25T15:57:44.059 INFO:tasks.workunit.client.1.smithi155.stdout:4/693: chown da/d23/d3f/d56/d69/d4a/de0 3 1 2024-04-25T15:57:44.061 INFO:tasks.workunit.client.1.smithi155.stdout:8/513: link d2/d15/d18/d34/f53 d2/d15/d18/d34/f9f 0 2024-04-25T15:57:44.061 INFO:tasks.workunit.client.1.smithi155.stdout:6/902: dwrite d0/d18/d112/fe8 [0,4194304] 0 2024-04-25T15:57:44.062 INFO:tasks.workunit.client.1.smithi155.stdout:6/903: chown d0/d13/d43/lab 1531763 1 2024-04-25T15:57:44.064 INFO:tasks.workunit.client.1.smithi155.stdout:2/826: creat d7/db/dd/d15/dd7/f107 x:0 0 0 2024-04-25T15:57:44.065 INFO:tasks.workunit.client.1.smithi155.stdout:1/752: mkdir d1/d16/d1d/d29/dcf/dd2/ded 0 2024-04-25T15:57:44.067 INFO:tasks.workunit.client.1.smithi155.stdout:4/694: creat da/d23/d3f/d56/dca/ff6 x:0 0 0 2024-04-25T15:57:44.068 INFO:tasks.workunit.client.1.smithi155.stdout:8/514: mknod d2/d15/d18/d34/ca0 0 2024-04-25T15:57:44.070 INFO:tasks.workunit.client.1.smithi155.stdout:1/753: write d1/d16/d1d/d29/d3d/fbd [3890017,55387] 0 2024-04-25T15:57:44.071 INFO:tasks.workunit.client.1.smithi155.stdout:6/904: creat d0/d1a/d37/f118 x:0 0 0 2024-04-25T15:57:44.072 INFO:tasks.workunit.client.1.smithi155.stdout:6/905: write d0/f9b [11440,73259] 0 2024-04-25T15:57:44.072 INFO:tasks.workunit.client.1.smithi155.stdout:4/695: rename da/d23/f3d to da/d23/d3a/ff7 0 2024-04-25T15:57:44.072 INFO:tasks.workunit.client.1.smithi155.stdout:2/827: dwrite d7/db/d29/f3a [0,4194304] 0 2024-04-25T15:57:44.074 INFO:tasks.workunit.client.1.smithi155.stdout:8/515: mkdir d2/d15/da1 0 2024-04-25T15:57:44.077 INFO:tasks.workunit.client.1.smithi155.stdout:4/696: mknod da/d23/d3a/cf8 0 2024-04-25T15:57:44.077 INFO:tasks.workunit.client.1.smithi155.stdout:8/516: write d2/d15/d18/d49/f9e [1007667,83897] 0 2024-04-25T15:57:44.079 INFO:tasks.workunit.client.1.smithi155.stdout:4/697: write da/d23/d3f/d56/d69/d83/fa4 [746203,36909] 0 2024-04-25T15:57:44.081 INFO:tasks.workunit.client.1.smithi155.stdout:4/698: chown da/d23/d3f/d56/dca/ld3 187358 1 2024-04-25T15:57:44.083 INFO:tasks.workunit.client.1.smithi155.stdout:2/828: symlink d7/db/d2e/d6f/d91/dad/de0/l108 0 2024-04-25T15:57:44.087 INFO:tasks.workunit.client.1.smithi155.stdout:1/754: dwrite d1/d16/d1d/d29/d5f/d34/f56 [0,4194304] 0 2024-04-25T15:57:44.087 INFO:tasks.workunit.client.1.smithi155.stdout:5/755: dread d0/d3/d15/f8d [0,4194304] 0 2024-04-25T15:57:44.088 INFO:tasks.workunit.client.1.smithi155.stdout:4/699: link da/f16 da/d87/ddc/ff9 0 2024-04-25T15:57:44.089 INFO:tasks.workunit.client.1.smithi155.stdout:2/829: symlink d7/db/d29/d83/d86/d8b/dbf/l109 0 2024-04-25T15:57:44.089 INFO:tasks.workunit.client.1.smithi155.stdout:7/819: sync 2024-04-25T15:57:44.090 INFO:tasks.workunit.client.1.smithi155.stdout:9/622: sync 2024-04-25T15:57:44.091 INFO:tasks.workunit.client.1.smithi155.stdout:2/830: dread d7/d8e/db9/fdc [0,4194304] 0 2024-04-25T15:57:44.091 INFO:tasks.workunit.client.1.smithi155.stdout:5/756: write d0/d58/d32/d6a/fb9 [771686,76221] 0 2024-04-25T15:57:44.092 INFO:tasks.workunit.client.1.smithi155.stdout:1/755: creat d1/d32/fee x:0 0 0 2024-04-25T15:57:44.092 INFO:tasks.workunit.client.1.smithi155.stdout:9/623: write dc/d17/d18/f9e [982463,69465] 0 2024-04-25T15:57:44.094 INFO:tasks.workunit.client.1.smithi155.stdout:7/820: rmdir d2/dd/d30/dbc 39 2024-04-25T15:57:44.095 INFO:tasks.workunit.client.1.smithi155.stdout:5/757: read d0/d3/d15/d1f/d50/d7c/fb5 [2261737,27074] 0 2024-04-25T15:57:44.097 INFO:tasks.workunit.client.1.smithi155.stdout:2/831: rmdir d7/db/d29/d83/d86/db0 39 2024-04-25T15:57:44.098 INFO:tasks.workunit.client.1.smithi155.stdout:6/906: write d0/d13/d34/d38/d7a/df5/ffd [135260,12978] 0 2024-04-25T15:57:44.100 INFO:tasks.workunit.client.1.smithi155.stdout:7/821: creat d2/dd/d13/d24/d35/f117 x:0 0 0 2024-04-25T15:57:44.101 INFO:tasks.workunit.client.1.smithi155.stdout:5/758: creat d0/d47/de4/ff8 x:0 0 0 2024-04-25T15:57:44.102 INFO:tasks.workunit.client.1.smithi155.stdout:1/756: getdents d1/d32/d86 0 2024-04-25T15:57:44.102 INFO:tasks.workunit.client.1.smithi155.stdout:2/832: rmdir d7/db/d2e/d44/d70/d7b 39 2024-04-25T15:57:44.102 INFO:tasks.workunit.client.1.smithi155.stdout:7/822: write d2/d26/fe5 [55451,64242] 0 2024-04-25T15:57:44.104 INFO:tasks.workunit.client.1.smithi155.stdout:9/624: getdents dc/d13/d60/d7a 0 2024-04-25T15:57:44.106 INFO:tasks.workunit.client.1.smithi155.stdout:6/907: link d0/d18/d112/fe8 d0/d1a/d37/dda/dfe/d7b/f119 0 2024-04-25T15:57:44.107 INFO:tasks.workunit.client.1.smithi155.stdout:1/757: readlink d1/d16/d1d/l92 0 2024-04-25T15:57:44.108 INFO:tasks.workunit.client.1.smithi155.stdout:4/700: dread da/dc/f1d [0,4194304] 0 2024-04-25T15:57:44.115 INFO:tasks.workunit.client.1.smithi155.stdout:1/758: read d1/fb [686506,69974] 0 2024-04-25T15:57:44.116 INFO:tasks.workunit.client.1.smithi155.stdout:1/759: chown d1/d6/db4/le3 43297479 1 2024-04-25T15:57:44.118 INFO:tasks.workunit.client.1.smithi155.stdout:9/625: dwrite dc/d11/d5a/f78 [4194304,4194304] 0 2024-04-25T15:57:44.119 INFO:tasks.workunit.client.1.smithi155.stdout:7/823: link d2/dd/d36/d46/ff4 d2/dd/d13/d24/d35/f118 0 2024-04-25T15:57:44.120 INFO:tasks.workunit.client.1.smithi155.stdout:9/626: dread dc/d13/d2e/fb1 [0,4194304] 0 2024-04-25T15:57:44.121 INFO:tasks.workunit.client.1.smithi155.stdout:4/701: creat da/d87/ffa x:0 0 0 2024-04-25T15:57:44.121 INFO:tasks.workunit.client.1.smithi155.stdout:7/824: truncate d2/dd/d12/fd1 434388 0 2024-04-25T15:57:44.122 INFO:tasks.workunit.client.1.smithi155.stdout:5/759: getdents d0/d58/d32/d6a 0 2024-04-25T15:57:44.122 INFO:tasks.workunit.client.1.smithi155.stdout:2/833: link d7/db/d29/l46 d7/db/d29/d83/d86/l10a 0 2024-04-25T15:57:44.122 INFO:tasks.workunit.client.1.smithi155.stdout:9/627: dread dc/d13/d2e/fb1 [0,4194304] 0 2024-04-25T15:57:44.123 INFO:tasks.workunit.client.1.smithi155.stdout:7/825: dread - d2/dd/d30/fcb zero size 2024-04-25T15:57:44.124 INFO:tasks.workunit.client.1.smithi155.stdout:1/760: getdents d1/d16/d8f 0 2024-04-25T15:57:44.124 INFO:tasks.workunit.client.1.smithi155.stdout:2/834: write d7/d8e/db9/fc9 [46500,106502] 0 2024-04-25T15:57:44.125 INFO:tasks.workunit.client.1.smithi155.stdout:4/702: creat da/d23/d3f/dc6/dc8/ffb x:0 0 0 2024-04-25T15:57:44.126 INFO:tasks.workunit.client.1.smithi155.stdout:7/826: mknod d2/dd/d36/c119 0 2024-04-25T15:57:44.128 INFO:tasks.workunit.client.1.smithi155.stdout:1/761: fdatasync d1/d16/d1d/d29/d5f/d34/f36 0 2024-04-25T15:57:44.129 INFO:tasks.workunit.client.1.smithi155.stdout:9/628: rename dc/d17/d18/f2d to dc/d11/fd0 0 2024-04-25T15:57:44.131 INFO:tasks.workunit.client.1.smithi155.stdout:9/629: symlink dc/d13/d48/ld1 0 2024-04-25T15:57:44.133 INFO:tasks.workunit.client.1.smithi155.stdout:9/630: fdatasync dc/d11/d5a/fca 0 2024-04-25T15:57:44.133 INFO:tasks.workunit.client.1.smithi155.stdout:1/762: unlink d1/d16/d1d/d33/cd8 0 2024-04-25T15:57:44.133 INFO:tasks.workunit.client.1.smithi155.stdout:2/835: getdents d7/db/d2e/d44/d9e/dbd 0 2024-04-25T15:57:44.134 INFO:tasks.workunit.client.1.smithi155.stdout:1/763: fdatasync d1/d6/fc9 0 2024-04-25T15:57:44.135 INFO:tasks.workunit.client.1.smithi155.stdout:7/827: dread d2/dd/d66/fb0 [0,4194304] 0 2024-04-25T15:57:44.135 INFO:tasks.workunit.client.1.smithi155.stdout:4/703: dread da/d23/d3a/d7b/fb9 [0,4194304] 0 2024-04-25T15:57:44.136 INFO:tasks.workunit.client.1.smithi155.stdout:9/631: write dc/d13/d48/f88 [4076249,82963] 0 2024-04-25T15:57:44.136 INFO:tasks.workunit.client.1.smithi155.stdout:2/836: write d7/db/d2e/d90/fe6 [684277,72747] 0 2024-04-25T15:57:44.138 INFO:tasks.workunit.client.1.smithi155.stdout:9/632: read - dc/d17/d2a/fc1 zero size 2024-04-25T15:57:44.139 INFO:tasks.workunit.client.1.smithi155.stdout:7/828: rename d2/dd/f52 to d2/dd/d63/f11a 0 2024-04-25T15:57:44.140 INFO:tasks.workunit.client.1.smithi155.stdout:9/633: readlink dc/d2f/l3d 0 2024-04-25T15:57:44.140 INFO:tasks.workunit.client.1.smithi155.stdout:2/837: unlink d7/db/d2e/ff2 0 2024-04-25T15:57:44.141 INFO:tasks.workunit.client.1.smithi155.stdout:5/760: dread d0/d27/f98 [0,4194304] 0 2024-04-25T15:57:44.142 INFO:tasks.workunit.client.1.smithi155.stdout:4/704: truncate da/d87/ddc/ff9 4338268 0 2024-04-25T15:57:44.142 INFO:tasks.workunit.client.1.smithi155.stdout:2/838: mkdir d7/d10b 0 2024-04-25T15:57:44.143 INFO:tasks.workunit.client.1.smithi155.stdout:9/634: mkdir dc/d11/d30/dd2 0 2024-04-25T15:57:44.144 INFO:tasks.workunit.client.1.smithi155.stdout:2/839: readlink d7/db/l73 0 2024-04-25T15:57:44.144 INFO:tasks.workunit.client.1.smithi155.stdout:7/829: creat d2/dd/d13/d24/d35/db4/f11b x:0 0 0 2024-04-25T15:57:44.145 INFO:tasks.workunit.client.1.smithi155.stdout:9/635: creat dc/d11/dc4/fd3 x:0 0 0 2024-04-25T15:57:44.146 INFO:tasks.workunit.client.1.smithi155.stdout:2/840: mknod d7/db/dd/d15/dd7/c10c 0 2024-04-25T15:57:44.147 INFO:tasks.workunit.client.1.smithi155.stdout:9/636: chown dc/d13/d2e 13102581 1 2024-04-25T15:57:44.147 INFO:tasks.workunit.client.1.smithi155.stdout:7/830: chown d2/dd/d13/d24/d8b/ff8 76 1 2024-04-25T15:57:44.150 INFO:tasks.workunit.client.1.smithi155.stdout:2/841: mknod d7/db/d2e/d44/d70/d7b/c10d 0 2024-04-25T15:57:44.154 INFO:tasks.workunit.client.1.smithi155.stdout:2/842: rmdir d7/db/d29/d83 39 2024-04-25T15:57:44.155 INFO:tasks.workunit.client.1.smithi155.stdout:4/705: dwrite da/d23/d3f/d56/d69/d4a/ff3 [0,4194304] 0 2024-04-25T15:57:44.156 INFO:tasks.workunit.client.1.smithi155.stdout:7/831: link d2/d26/ld5 d2/dd/d12/d76/l11c 0 2024-04-25T15:57:44.156 INFO:tasks.workunit.client.1.smithi155.stdout:1/764: dread d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 [0,4194304] 0 2024-04-25T15:57:44.157 INFO:tasks.workunit.client.1.smithi155.stdout:2/843: stat d7/db/d29/l88 0 2024-04-25T15:57:44.160 INFO:tasks.workunit.client.1.smithi155.stdout:7/832: read d2/dd/d13/d1c/f60 [3534390,25129] 0 2024-04-25T15:57:44.160 INFO:tasks.workunit.client.1.smithi155.stdout:9/637: dwrite dc/d13/f3a [4194304,4194304] 0 2024-04-25T15:57:44.163 INFO:tasks.workunit.client.1.smithi155.stdout:4/706: mknod da/d87/cfc 0 2024-04-25T15:57:44.167 INFO:tasks.workunit.client.1.smithi155.stdout:2/844: symlink d7/db/dd/d15/l10e 0 2024-04-25T15:57:44.167 INFO:tasks.workunit.client.1.smithi155.stdout:2/845: fsync d7/db/d2e/d6f/d91/dad/fce 0 2024-04-25T15:57:44.168 INFO:tasks.workunit.client.1.smithi155.stdout:4/707: mknod da/d23/d3f/dc6/de2/cfd 0 2024-04-25T15:57:44.168 INFO:tasks.workunit.client.1.smithi155.stdout:2/846: write d7/db/d2e/d44/f7f [7872859,36815] 0 2024-04-25T15:57:44.171 INFO:tasks.workunit.client.1.smithi155.stdout:1/765: rename d1/d16/d1d/d29/d5f/ldd to d1/d6/lef 0 2024-04-25T15:57:44.174 INFO:tasks.workunit.client.1.smithi155.stdout:4/708: symlink da/d30/lfe 0 2024-04-25T15:57:44.177 INFO:tasks.workunit.client.1.smithi155.stdout:1/766: mkdir d1/d32/d77/df0 0 2024-04-25T15:57:44.177 INFO:tasks.workunit.client.1.smithi155.stdout:9/638: getdents dc/d11/d30/d46/da0 0 2024-04-25T15:57:44.181 INFO:tasks.workunit.client.1.smithi155.stdout:9/639: symlink dc/d11/dc4/ld4 0 2024-04-25T15:57:44.182 INFO:tasks.workunit.client.1.smithi155.stdout:5/761: truncate d0/d3/d15/d1f/fa3 369483 0 2024-04-25T15:57:44.183 INFO:tasks.workunit.client.1.smithi155.stdout:2/847: creat d7/db/d29/d83/d86/db0/f10f x:0 0 0 2024-04-25T15:57:44.184 INFO:tasks.workunit.client.1.smithi155.stdout:1/767: creat d1/d16/d1d/d33/da1/de6/ff1 x:0 0 0 2024-04-25T15:57:44.186 INFO:tasks.workunit.client.1.smithi155.stdout:5/762: truncate d0/d3/d2c/f3c 2990977 0 2024-04-25T15:57:44.190 INFO:tasks.workunit.client.1.smithi155.stdout:9/640: dwrite dc/d13/d59/fc6 [0,4194304] 0 2024-04-25T15:57:44.192 INFO:tasks.workunit.client.1.smithi155.stdout:9/641: write dc/d11/d30/fc3 [27872,32701] 0 2024-04-25T15:57:44.192 INFO:tasks.workunit.client.1.smithi155.stdout:5/763: rename d0/d3/l4e to d0/lf9 0 2024-04-25T15:57:44.193 INFO:tasks.workunit.client.1.smithi155.stdout:4/709: dread f7 [0,4194304] 0 2024-04-25T15:57:44.193 INFO:tasks.workunit.client.1.smithi155.stdout:5/764: chown d0/d3/f4a 4071 1 2024-04-25T15:57:44.194 INFO:tasks.workunit.client.1.smithi155.stdout:5/765: chown d0/d58/d63/da0/dd6 8427 1 2024-04-25T15:57:44.195 INFO:tasks.workunit.client.1.smithi155.stdout:4/710: truncate da/f21 4814789 0 2024-04-25T15:57:44.196 INFO:tasks.workunit.client.1.smithi155.stdout:5/766: write d0/d47/db3/fda [522131,90760] 0 2024-04-25T15:57:44.198 INFO:tasks.workunit.client.1.smithi155.stdout:9/642: rename dc/d11/dc4/ld4 to dc/d17/dc0/dc9/ld5 0 2024-04-25T15:57:44.200 INFO:tasks.workunit.client.1.smithi155.stdout:0/695: sync 2024-04-25T15:57:44.200 INFO:tasks.workunit.client.1.smithi155.stdout:3/753: sync 2024-04-25T15:57:44.202 INFO:tasks.workunit.client.1.smithi155.stdout:4/711: rename da/dc/ff to da/d23/d3f/d56/d69/d4a/d78/fff 0 2024-04-25T15:57:44.204 INFO:tasks.workunit.client.1.smithi155.stdout:5/767: dwrite d0/d47/db3/fba [0,4194304] 0 2024-04-25T15:57:44.204 INFO:tasks.workunit.client.1.smithi155.stdout:9/643: unlink dc/d11/d30/d46/l75 0 2024-04-25T15:57:44.208 INFO:tasks.workunit.client.1.smithi155.stdout:0/696: unlink d1/d3/d12/fa8 0 2024-04-25T15:57:44.211 INFO:tasks.workunit.client.1.smithi155.stdout:3/754: rename d1/f16 to d1/d4/db/d20/d44/f101 0 2024-04-25T15:57:44.214 INFO:tasks.workunit.client.1.smithi155.stdout:2/848: dwrite d7/db/d29/d83/d86/d8b/fa8 [0,4194304] 0 2024-04-25T15:57:44.218 INFO:tasks.workunit.client.1.smithi155.stdout:0/697: rmdir d1/d3/d5/d5b/dc4/d60 39 2024-04-25T15:57:44.222 INFO:tasks.workunit.client.1.smithi155.stdout:5/768: write d0/d3/d15/d1f/d50/d7c/f83 [580847,41078] 0 2024-04-25T15:57:44.222 INFO:tasks.workunit.client.1.smithi155.stdout:2/849: mkdir d7/d8e/db9/d110 0 2024-04-25T15:57:44.224 INFO:tasks.workunit.client.1.smithi155.stdout:4/712: creat da/d23/d3f/f100 x:0 0 0 2024-04-25T15:57:44.225 INFO:tasks.workunit.client.1.smithi155.stdout:5/769: fdatasync d0/d3/d15/fe 0 2024-04-25T15:57:44.227 INFO:tasks.workunit.client.1.smithi155.stdout:9/644: getdents dc/d11/d30/d46 0 2024-04-25T15:57:44.227 INFO:tasks.workunit.client.1.smithi155.stdout:4/713: symlink da/l101 0 2024-04-25T15:57:44.230 INFO:tasks.workunit.client.1.smithi155.stdout:2/850: dread d7/db/d2e/d90/fe6 [0,4194304] 0 2024-04-25T15:57:44.231 INFO:tasks.workunit.client.1.smithi155.stdout:5/770: write d0/d47/db3/fba [4053484,62330] 0 2024-04-25T15:57:44.231 INFO:tasks.workunit.client.1.smithi155.stdout:4/714: chown da/d23/d3f/c55 97316 1 2024-04-25T15:57:44.235 INFO:tasks.workunit.client.1.smithi155.stdout:2/851: symlink d7/db/d2e/d6f/d91/dad/de0/l111 0 2024-04-25T15:57:44.237 INFO:tasks.workunit.client.1.smithi155.stdout:0/698: dwrite d1/d3/d6a/f73 [8388608,4194304] 0 2024-04-25T15:57:44.241 INFO:tasks.workunit.client.1.smithi155.stdout:5/771: truncate d0/d58/d32/d6a/d78/f87 845263 0 2024-04-25T15:57:44.242 INFO:tasks.workunit.client.1.smithi155.stdout:3/755: dread d1/d4/db/d20/f46 [0,4194304] 0 2024-04-25T15:57:44.242 INFO:tasks.workunit.client.1.smithi155.stdout:0/699: rmdir d1/d3/d12/d92 39 2024-04-25T15:57:44.244 INFO:tasks.workunit.client.1.smithi155.stdout:9/645: dwrite dc/d11/fa1 [4194304,4194304] 0 2024-04-25T15:57:44.244 INFO:tasks.workunit.client.1.smithi155.stdout:2/852: link d7/db/d2e/f47 d7/db/d2e/d44/d70/f112 0 2024-04-25T15:57:44.245 INFO:tasks.workunit.client.1.smithi155.stdout:5/772: chown d0/d3/d15/d1f/d50/d7c/f7d 115 1 2024-04-25T15:57:44.246 INFO:tasks.workunit.client.1.smithi155.stdout:2/853: chown d7/ca 23922 1 2024-04-25T15:57:44.248 INFO:tasks.workunit.client.1.smithi155.stdout:4/715: dwrite da/d23/d3f/d56/dca/ff6 [0,4194304] 0 2024-04-25T15:57:44.248 INFO:tasks.workunit.client.1.smithi155.stdout:2/854: fdatasync d7/db/f51 0 2024-04-25T15:57:44.248 INFO:tasks.workunit.client.1.smithi155.stdout:0/700: mkdir d1/d3/d3d/d46/deb/ded 0 2024-04-25T15:57:44.250 INFO:tasks.workunit.client.1.smithi155.stdout:5/773: symlink d0/d3/d15/d9f/dc3/lfa 0 2024-04-25T15:57:44.253 INFO:tasks.workunit.client.1.smithi155.stdout:2/855: write d7/d23/f87 [830403,2405] 0 2024-04-25T15:57:44.254 INFO:tasks.workunit.client.1.smithi155.stdout:3/756: dread d1/d4/db/d20/f46 [0,4194304] 0 2024-04-25T15:57:44.256 INFO:tasks.workunit.client.1.smithi155.stdout:0/701: read d1/f71 [3242720,20845] 0 2024-04-25T15:57:44.256 INFO:tasks.workunit.client.1.smithi155.stdout:2/856: fsync d7/d23/f21 0 2024-04-25T15:57:44.257 INFO:tasks.workunit.client.1.smithi155.stdout:4/716: mkdir da/d23/d3f/d56/d69/d102 0 2024-04-25T15:57:44.259 INFO:tasks.workunit.client.1.smithi155.stdout:4/717: chown da/d23/f42 95340690 1 2024-04-25T15:57:44.259 INFO:tasks.workunit.client.1.smithi155.stdout:2/857: write d7/db/dd/d15/d60/d94/fc4 [243964,96521] 0 2024-04-25T15:57:44.259 INFO:tasks.workunit.client.1.smithi155.stdout:5/774: rename d0/d58/c3b to d0/d3/d2c/d94/cfb 0 2024-04-25T15:57:44.260 INFO:tasks.workunit.client.1.smithi155.stdout:0/702: truncate d1/d6/d29/d47/db0/dd1/fd7 70573 0 2024-04-25T15:57:44.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/757: getdents d1/d4/db/d20 0 2024-04-25T15:57:44.264 INFO:tasks.workunit.client.1.smithi155.stdout:5/775: rename d0/d3/d15/d1f/d50/fd5 to d0/d47/de4/ffc 0 2024-04-25T15:57:44.265 INFO:tasks.workunit.client.1.smithi155.stdout:0/703: creat d1/d6/d29/d47/fee x:0 0 0 2024-04-25T15:57:44.266 INFO:tasks.workunit.client.1.smithi155.stdout:5/776: write d0/d3/d2c/f85 [7013931,10012] 0 2024-04-25T15:57:44.266 INFO:tasks.workunit.client.1.smithi155.stdout:2/858: rmdir d7/d8e/db9/d110 0 2024-04-25T15:57:44.267 INFO:tasks.workunit.client.1.smithi155.stdout:2/859: stat d7/d8e/db9/cd5 0 2024-04-25T15:57:44.269 INFO:tasks.workunit.client.1.smithi155.stdout:0/704: chown d1/d3/d5/d5b/dc4/c62 20 1 2024-04-25T15:57:44.269 INFO:tasks.workunit.client.1.smithi155.stdout:2/860: rmdir d7/d8e/db9 39 2024-04-25T15:57:44.270 INFO:tasks.workunit.client.1.smithi155.stdout:0/705: chown d1/d1a/f34 0 1 2024-04-25T15:57:44.270 INFO:tasks.workunit.client.1.smithi155.stdout:3/758: rmdir d1/d4/db/d28/ddd 0 2024-04-25T15:57:44.271 INFO:tasks.workunit.client.1.smithi155.stdout:5/777: mknod d0/cfd 0 2024-04-25T15:57:44.272 INFO:tasks.workunit.client.1.smithi155.stdout:0/706: mknod d1/d1a/cef 0 2024-04-25T15:57:44.272 INFO:tasks.workunit.client.1.smithi155.stdout:2/861: creat d7/db/d2e/d6f/d91/f113 x:0 0 0 2024-04-25T15:57:44.273 INFO:tasks.workunit.client.1.smithi155.stdout:3/759: creat d1/d4/d10/f102 x:0 0 0 2024-04-25T15:57:44.275 INFO:tasks.workunit.client.1.smithi155.stdout:0/707: mknod d1/d6/d29/d47/db0/dd1/cf0 0 2024-04-25T15:57:44.277 INFO:tasks.workunit.client.1.smithi155.stdout:5/778: link d0/d3/d15/d1f/d50/d60/ldf d0/d3/d2c/lfe 0 2024-04-25T15:57:44.280 INFO:tasks.workunit.client.1.smithi155.stdout:0/708: write d1/d3/d5/d5b/dc4/d6e/fab [1063619,46705] 0 2024-04-25T15:57:44.283 INFO:tasks.workunit.client.1.smithi155.stdout:4/718: dread da/d23/d3f/d56/d69/f95 [0,4194304] 0 2024-04-25T15:57:44.283 INFO:tasks.workunit.client.1.smithi155.stdout:0/709: mknod d1/d3/cf1 0 2024-04-25T15:57:44.284 INFO:tasks.workunit.client.1.smithi155.stdout:2/862: dwrite d7/d8e/fc1 [0,4194304] 0 2024-04-25T15:57:44.285 INFO:tasks.workunit.client.1.smithi155.stdout:3/760: dwrite d1/d4/db/d20/f3b [0,4194304] 0 2024-04-25T15:57:44.286 INFO:tasks.workunit.client.1.smithi155.stdout:4/719: chown da/d23/d3f/d56/d69/d83/lbe 5199 1 2024-04-25T15:57:44.288 INFO:tasks.workunit.client.1.smithi155.stdout:3/761: dread - d1/d4/db/d20/d44/fe0 zero size 2024-04-25T15:57:44.288 INFO:tasks.workunit.client.1.smithi155.stdout:3/762: chown d1/d94 161 1 2024-04-25T15:57:44.289 INFO:tasks.workunit.client.1.smithi155.stdout:2/863: rename d7/f2d to d7/d8e/db9/f114 0 2024-04-25T15:57:44.289 INFO:tasks.workunit.client.1.smithi155.stdout:3/763: chown d1/d4/db/d91 62870 1 2024-04-25T15:57:44.291 INFO:tasks.workunit.client.1.smithi155.stdout:3/764: chown d1/d4/db/d91/dc4/dd9/d86/d9e/ld4 14342576 1 2024-04-25T15:57:44.294 INFO:tasks.workunit.client.1.smithi155.stdout:2/864: rename d7/db/d2e/c41 to d7/db/d2e/d6f/d91/c115 0 2024-04-25T15:57:44.295 INFO:tasks.workunit.client.1.smithi155.stdout:4/720: link da/d87/ffa da/d23/d3f/d56/f103 0 2024-04-25T15:57:44.303 INFO:tasks.workunit.client.1.smithi155.stdout:2/865: dwrite d7/d23/f87 [0,4194304] 0 2024-04-25T15:57:44.303 INFO:tasks.workunit.client.1.smithi155.stdout:5/779: truncate d0/d58/d63/da0/fab 1658873 0 2024-04-25T15:57:44.303 INFO:tasks.workunit.client.1.smithi155.stdout:0/710: write d1/d6/d29/d47/fa3 [3174070,95607] 0 2024-04-25T15:57:44.307 INFO:tasks.workunit.client.1.smithi155.stdout:0/711: dread d1/d3/d5/f54 [0,4194304] 0 2024-04-25T15:57:44.308 INFO:tasks.workunit.client.1.smithi155.stdout:3/765: dread d1/d4/db/d91/dc4/d6c/fc6 [0,4194304] 0 2024-04-25T15:57:44.310 INFO:tasks.workunit.client.1.smithi155.stdout:3/766: read d1/f100 [317763,82422] 0 2024-04-25T15:57:44.310 INFO:tasks.workunit.client.1.smithi155.stdout:2/866: creat d7/db/dd/d15/dff/f116 x:0 0 0 2024-04-25T15:57:44.311 INFO:tasks.workunit.client.1.smithi155.stdout:5/780: symlink d0/d3/d15/d9f/df7/lff 0 2024-04-25T15:57:44.316 INFO:tasks.workunit.client.1.smithi155.stdout:0/712: rename d1/d3/d12/c5e to d1/d3/d5/d5b/dc4/cf2 0 2024-04-25T15:57:44.316 INFO:tasks.workunit.client.1.smithi155.stdout:4/721: dwrite da/d23/f94 [0,4194304] 0 2024-04-25T15:57:44.317 INFO:tasks.workunit.client.1.smithi155.stdout:0/713: chown d1/d1a/fa7 651978858 1 2024-04-25T15:57:44.317 INFO:tasks.workunit.client.1.smithi155.stdout:3/767: symlink d1/d4/db/d91/dc4/dd9/d86/d9e/l103 0 2024-04-25T15:57:44.319 INFO:tasks.workunit.client.1.smithi155.stdout:2/867: link d7/db/dd/d15/d60/f79 d7/d23/f117 0 2024-04-25T15:57:44.320 INFO:tasks.workunit.client.1.smithi155.stdout:3/768: write d1/d4/f2d [2697,51371] 0 2024-04-25T15:57:44.322 INFO:tasks.workunit.client.1.smithi155.stdout:8/517: sync 2024-04-25T15:57:44.326 INFO:tasks.workunit.client.1.smithi155.stdout:2/868: mknod d7/db/d29/d83/c118 0 2024-04-25T15:57:44.326 INFO:tasks.workunit.client.1.smithi155.stdout:5/781: dwrite d0/d47/d59/f9a [0,4194304] 0 2024-04-25T15:57:44.329 INFO:tasks.workunit.client.1.smithi155.stdout:5/782: fdatasync d0/d3/d2c/f2f 0 2024-04-25T15:57:44.331 INFO:tasks.workunit.client.1.smithi155.stdout:0/714: dread d1/d3/d5/f13 [0,4194304] 0 2024-04-25T15:57:44.332 INFO:tasks.workunit.client.1.smithi155.stdout:8/518: getdents d2/d15/d18/d34/d48/d4e 0 2024-04-25T15:57:44.333 INFO:tasks.workunit.client.1.smithi155.stdout:4/722: write da/dc/fd [1027155,11730] 0 2024-04-25T15:57:44.333 INFO:tasks.workunit.client.1.smithi155.stdout:8/519: write d2/d15/f69 [1006823,6382] 0 2024-04-25T15:57:44.337 INFO:tasks.workunit.client.1.smithi155.stdout:0/715: rename d1/lbe to d1/d85/d98/lf3 0 2024-04-25T15:57:44.340 INFO:tasks.workunit.client.1.smithi155.stdout:8/520: unlink d2/d15/d18/d23/c55 0 2024-04-25T15:57:44.341 INFO:tasks.workunit.client.1.smithi155.stdout:0/716: readlink d1/d6/l49 0 2024-04-25T15:57:44.342 INFO:tasks.workunit.client.1.smithi155.stdout:4/723: getdents da/d23/d3f/d56/d69/d102 0 2024-04-25T15:57:44.342 INFO:tasks.workunit.client.1.smithi155.stdout:4/724: chown da/dc/d18/d6e/f4e 1210 1 2024-04-25T15:57:44.343 INFO:tasks.workunit.client.1.smithi155.stdout:8/521: unlink d2/d15/d18/d34/d48/d7f/f82 0 2024-04-25T15:57:44.349 INFO:tasks.workunit.client.1.smithi155.stdout:0/717: getdents d1/d3/d5 0 2024-04-25T15:57:44.351 INFO:tasks.workunit.client.1.smithi155.stdout:0/718: fsync d1/f3c 0 2024-04-25T15:57:44.353 INFO:tasks.workunit.client.1.smithi155.stdout:4/725: write da/dc/f1d [352525,124860] 0 2024-04-25T15:57:44.353 INFO:tasks.workunit.client.1.smithi155.stdout:8/522: dwrite d2/d15/d18/d23/d3c/d76/d7e/f9a [0,4194304] 0 2024-04-25T15:57:44.355 INFO:tasks.workunit.client.1.smithi155.stdout:0/719: write d1/d3/d3d/dcb/fd2 [725232,101691] 0 2024-04-25T15:57:44.355 INFO:tasks.workunit.client.1.smithi155.stdout:5/783: dread d0/d58/d63/da0/fb2 [0,4194304] 0 2024-04-25T15:57:44.355 INFO:tasks.workunit.client.1.smithi155.stdout:4/726: chown da/dc/d18/f4c 5 1 2024-04-25T15:57:44.357 INFO:tasks.workunit.client.1.smithi155.stdout:0/720: chown d1/d6/l81 538 1 2024-04-25T15:57:44.358 INFO:tasks.workunit.client.1.smithi155.stdout:5/784: rename d0/d3 to d0/d3/d15/d30/d4f/d100 22 2024-04-25T15:57:44.359 INFO:tasks.workunit.client.1.smithi155.stdout:8/523: mknod d2/d15/d18/d23/d3c/ca2 0 2024-04-25T15:57:44.362 INFO:tasks.workunit.client.1.smithi155.stdout:8/524: creat d2/d15/d18/d34/d48/d4e/d81/fa3 x:0 0 0 2024-04-25T15:57:44.363 INFO:tasks.workunit.client.1.smithi155.stdout:5/785: write d0/d47/de4/ffc [60724,14308] 0 2024-04-25T15:57:44.363 INFO:tasks.workunit.client.1.smithi155.stdout:4/727: write da/dc/d18/f27 [2215849,124943] 0 2024-04-25T15:57:44.366 INFO:tasks.workunit.client.1.smithi155.stdout:8/525: creat d2/d15/d35/fa4 x:0 0 0 2024-04-25T15:57:44.368 INFO:tasks.workunit.client.1.smithi155.stdout:8/526: fsync d2/d15/d18/d49/f3a 0 2024-04-25T15:57:44.369 INFO:tasks.workunit.client.1.smithi155.stdout:0/721: dwrite d1/d85/d98/fb7 [0,4194304] 0 2024-04-25T15:57:44.370 INFO:tasks.workunit.client.1.smithi155.stdout:4/728: getdents da/d23/d3a/d7b/d93 0 2024-04-25T15:57:44.374 INFO:tasks.workunit.client.1.smithi155.stdout:8/527: truncate d2/d5/d40/f65 1028004 0 2024-04-25T15:57:44.376 INFO:tasks.workunit.client.1.smithi155.stdout:8/528: fdatasync d2/d15/d18/d23/d3c/f61 0 2024-04-25T15:57:44.378 INFO:tasks.workunit.client.1.smithi155.stdout:5/786: dread d0/f37 [4194304,4194304] 0 2024-04-25T15:57:44.379 INFO:tasks.workunit.client.1.smithi155.stdout:5/787: chown d0/d27/f7f 1148 1 2024-04-25T15:57:44.380 INFO:tasks.workunit.client.1.smithi155.stdout:0/722: dread d1/d6/d29/d47/fa3 [0,4194304] 0 2024-04-25T15:57:44.381 INFO:tasks.workunit.client.1.smithi155.stdout:0/723: readlink d1/d6/d29/l51 0 2024-04-25T15:57:44.386 INFO:tasks.workunit.client.1.smithi155.stdout:4/729: truncate da/d23/d3f/d56/d69/d4a/d78/d62/f68 3919403 0 2024-04-25T15:57:44.387 INFO:tasks.workunit.client.1.smithi155.stdout:8/529: truncate d2/d15/f69 2578340 0 2024-04-25T15:57:44.389 INFO:tasks.workunit.client.1.smithi155.stdout:8/530: chown d2/d41/d5d/l72 139 1 2024-04-25T15:57:44.390 INFO:tasks.workunit.client.1.smithi155.stdout:5/788: dwrite d0/d58/d32/d6a/fb9 [0,4194304] 0 2024-04-25T15:57:44.393 INFO:tasks.workunit.client.1.smithi155.stdout:8/531: mkdir d2/d15/d18/d23/d2d/da5 0 2024-04-25T15:57:44.402 INFO:tasks.workunit.client.1.smithi155.stdout:5/789: dwrite d0/d3/d15/d30/ff2 [0,4194304] 0 2024-04-25T15:57:44.405 INFO:tasks.workunit.client.1.smithi155.stdout:4/730: dwrite da/d23/d3f/f48 [0,4194304] 0 2024-04-25T15:57:44.407 INFO:tasks.workunit.client.1.smithi155.stdout:0/724: dread d1/d6/fca [0,4194304] 0 2024-04-25T15:57:44.409 INFO:tasks.workunit.client.1.smithi155.stdout:0/725: dread - d1/d3/d12/fec zero size 2024-04-25T15:57:44.410 INFO:tasks.workunit.client.1.smithi155.stdout:8/532: dread d2/d15/d35/f57 [0,4194304] 0 2024-04-25T15:57:44.410 INFO:tasks.workunit.client.1.smithi155.stdout:4/731: readlink da/dc/d77/lce 0 2024-04-25T15:57:44.412 INFO:tasks.workunit.client.1.smithi155.stdout:0/726: read d1/d3/d5/f54 [38076,71026] 0 2024-04-25T15:57:44.416 INFO:tasks.workunit.client.1.smithi155.stdout:0/727: rename d1/d6/d29 to d1/d41/df4 0 2024-04-25T15:57:44.417 INFO:tasks.workunit.client.1.smithi155.stdout:0/728: rmdir d1/d3 39 2024-04-25T15:57:44.419 INFO:tasks.workunit.client.1.smithi155.stdout:5/790: dwrite d0/d58/d63/da0/fab [0,4194304] 0 2024-04-25T15:57:44.420 INFO:tasks.workunit.client.1.smithi155.stdout:0/729: stat d1/d3/d5/da/l76 0 2024-04-25T15:57:44.420 INFO:tasks.workunit.client.1.smithi155.stdout:8/533: dwrite d2/fc [0,4194304] 0 2024-04-25T15:57:44.426 INFO:tasks.workunit.client.1.smithi155.stdout:0/730: dread d1/d41/df4/fa6 [0,4194304] 0 2024-04-25T15:57:44.426 INFO:tasks.workunit.client.1.smithi155.stdout:4/732: dread da/dc/f47 [0,4194304] 0 2024-04-25T15:57:44.429 INFO:tasks.workunit.client.1.smithi155.stdout:0/731: read d1/d3/d3d/dcb/fd2 [396638,86349] 0 2024-04-25T15:57:44.430 INFO:tasks.workunit.client.1.smithi155.stdout:5/791: link d0/d3/d2c/f85 d0/d3/d15/d1f/d50/f101 0 2024-04-25T15:57:44.431 INFO:tasks.workunit.client.1.smithi155.stdout:8/534: dwrite d2/d15/d18/d23/d3c/f47 [8388608,4194304] 0 2024-04-25T15:57:44.431 INFO:tasks.workunit.client.1.smithi155.stdout:5/792: chown d0/d58/d9b/fef 980937 1 2024-04-25T15:57:44.432 INFO:tasks.workunit.client.1.smithi155.stdout:8/535: chown d2/d15/d18/d34/f53 16585193 1 2024-04-25T15:57:44.432 INFO:tasks.workunit.client.1.smithi155.stdout:4/733: unlink da/d23/d3a/d7b/laf 0 2024-04-25T15:57:44.434 INFO:tasks.workunit.client.1.smithi155.stdout:0/732: unlink d1/d1a/f5f 0 2024-04-25T15:57:44.437 INFO:tasks.workunit.client.1.smithi155.stdout:8/536: rename d2/d15/d18/d34/f94 to d2/d5/d40/fa6 0 2024-04-25T15:57:44.437 INFO:tasks.workunit.client.1.smithi155.stdout:0/733: truncate d1/d41/df4/f96 9080123 0 2024-04-25T15:57:44.438 INFO:tasks.workunit.client.1.smithi155.stdout:5/793: mkdir d0/d3/d15/d1f/d102 0 2024-04-25T15:57:44.440 INFO:tasks.workunit.client.1.smithi155.stdout:0/734: unlink d1/d41/df4/d47/f55 0 2024-04-25T15:57:44.441 INFO:tasks.workunit.client.1.smithi155.stdout:0/735: read d1/d41/df4/fa6 [118042,91603] 0 2024-04-25T15:57:44.446 INFO:tasks.workunit.client.1.smithi155.stdout:0/736: unlink d1/d3/d12/d92/lb9 0 2024-04-25T15:57:44.447 INFO:tasks.workunit.client.1.smithi155.stdout:0/737: read d1/d6/f22 [4133264,97239] 0 2024-04-25T15:57:44.451 INFO:tasks.workunit.client.1.smithi155.stdout:4/734: truncate da/d23/d3f/d56/dca/ff6 1269961 0 2024-04-25T15:57:44.452 INFO:tasks.workunit.client.1.smithi155.stdout:4/735: write da/d23/d3f/d56/d69/f5e [2330701,70120] 0 2024-04-25T15:57:44.453 INFO:tasks.workunit.client.1.smithi155.stdout:5/794: write d0/d27/f7f [276484,88278] 0 2024-04-25T15:57:44.456 INFO:tasks.workunit.client.1.smithi155.stdout:8/537: dread d2/d15/d18/d34/f53 [0,4194304] 0 2024-04-25T15:57:44.456 INFO:tasks.workunit.client.1.smithi155.stdout:5/795: write d0/d3/d15/d9f/dc3/fd0 [923161,84473] 0 2024-04-25T15:57:44.458 INFO:tasks.workunit.client.1.smithi155.stdout:5/796: fsync d0/d3/d2c/f9e 0 2024-04-25T15:57:44.459 INFO:tasks.workunit.client.1.smithi155.stdout:8/538: rmdir d2/d15/d18/d23 39 2024-04-25T15:57:44.464 INFO:tasks.workunit.client.1.smithi155.stdout:4/736: dwrite da/d23/d3a/d7b/d93/fc5 [0,4194304] 0 2024-04-25T15:57:44.465 INFO:tasks.workunit.client.1.smithi155.stdout:0/738: dread d1/d3/d3d/f7a [0,4194304] 0 2024-04-25T15:57:44.466 INFO:tasks.workunit.client.1.smithi155.stdout:8/539: truncate d2/fa 12292931 0 2024-04-25T15:57:44.469 INFO:tasks.workunit.client.1.smithi155.stdout:5/797: dwrite d0/d3/d15/d9f/fd9 [0,4194304] 0 2024-04-25T15:57:44.470 INFO:tasks.workunit.client.1.smithi155.stdout:5/798: chown d0/d3/d15/d1f/f70 462868487 1 2024-04-25T15:57:44.483 INFO:tasks.workunit.client.1.smithi155.stdout:6/908: sync 2024-04-25T15:57:44.539 INFO:tasks.workunit.client.1.smithi155.stdout:4/737: mknod da/d30/c104 0 2024-04-25T15:57:44.543 INFO:tasks.workunit.client.1.smithi155.stdout:0/739: fsync d1/d3/d5/d5b/dc4/d60/f95 0 2024-04-25T15:57:44.545 INFO:tasks.workunit.client.1.smithi155.stdout:8/540: creat d2/d5/fa7 x:0 0 0 2024-04-25T15:57:44.547 INFO:tasks.workunit.client.1.smithi155.stdout:4/738: mkdir da/d87/d105 0 2024-04-25T15:57:44.551 INFO:tasks.workunit.client.1.smithi155.stdout:4/739: write da/dc/f1d [4760014,130372] 0 2024-04-25T15:57:44.551 INFO:tasks.workunit.client.1.smithi155.stdout:8/541: fsync d2/f11 0 2024-04-25T15:57:44.558 INFO:tasks.workunit.client.1.smithi155.stdout:6/909: creat d0/d13/d34/d38/d90/f11a x:0 0 0 2024-04-25T15:57:44.562 INFO:tasks.workunit.client.1.smithi155.stdout:4/740: unlink da/dc/d77/ce3 0 2024-04-25T15:57:44.562 INFO:tasks.workunit.client.1.smithi155.stdout:6/910: fdatasync d0/d1a/d21/d73/f5a 0 2024-04-25T15:57:44.565 INFO:tasks.workunit.client.1.smithi155.stdout:0/740: getdents d1/d41/df4 0 2024-04-25T15:57:44.569 INFO:tasks.workunit.client.1.smithi155.stdout:5/799: dwrite d0/d58/fe7 [0,4194304] 0 2024-04-25T15:57:44.573 INFO:tasks.workunit.client.1.smithi155.stdout:6/911: mkdir d0/d1a/d37/dda/d11b 0 2024-04-25T15:57:44.576 INFO:tasks.workunit.client.1.smithi155.stdout:4/741: mknod da/d23/d3a/d7b/c106 0 2024-04-25T15:57:44.577 INFO:tasks.workunit.client.1.smithi155.stdout:9/646: sync 2024-04-25T15:57:44.579 INFO:tasks.workunit.client.1.smithi155.stdout:1/768: sync 2024-04-25T15:57:44.579 INFO:tasks.workunit.client.1.smithi155.stdout:7/833: sync 2024-04-25T15:57:44.581 INFO:tasks.workunit.client.1.smithi155.stdout:8/542: getdents d2/d15/d18/d34 0 2024-04-25T15:57:44.583 INFO:tasks.workunit.client.1.smithi155.stdout:6/912: creat d0/d13/d6f/dae/f11c x:0 0 0 2024-04-25T15:57:44.584 INFO:tasks.workunit.client.1.smithi155.stdout:5/800: mknod d0/d3/d15/d30/c103 0 2024-04-25T15:57:44.587 INFO:tasks.workunit.client.1.smithi155.stdout:7/834: readlink d2/dd/d13/d24/d35/lfe 0 2024-04-25T15:57:44.587 INFO:tasks.workunit.client.1.smithi155.stdout:1/769: truncate d1/d6/fc9 247597 0 2024-04-25T15:57:44.587 INFO:tasks.workunit.client.1.smithi155.stdout:4/742: stat da/d23/da2/dad 0 2024-04-25T15:57:44.587 INFO:tasks.workunit.client.1.smithi155.stdout:8/543: chown d2/d15/d18/d49/l62 263134097 1 2024-04-25T15:57:44.588 INFO:tasks.workunit.client.1.smithi155.stdout:9/647: rename dc/d17/d18 to dc/d17/d8e/dae/dd6 0 2024-04-25T15:57:44.590 INFO:tasks.workunit.client.1.smithi155.stdout:6/913: creat d0/d13/d34/d6c/d9d/f11d x:0 0 0 2024-04-25T15:57:44.592 INFO:tasks.workunit.client.1.smithi155.stdout:7/835: creat d2/dd/d30/d44/d7f/f11d x:0 0 0 2024-04-25T15:57:44.625 INFO:tasks.workunit.client.1.smithi155.stdout:8/544: mknod d2/d15/d18/d34/ca8 0 2024-04-25T15:57:44.626 INFO:tasks.workunit.client.1.smithi155.stdout:0/741: dread d1/d3/d3d/dcb/fe6 [0,4194304] 0 2024-04-25T15:57:44.628 INFO:tasks.workunit.client.1.smithi155.stdout:1/770: mknod d1/d32/d77/df0/cf2 0 2024-04-25T15:57:44.628 INFO:tasks.workunit.client.1.smithi155.stdout:4/743: fsync da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fdf 0 2024-04-25T15:57:44.631 INFO:tasks.workunit.client.1.smithi155.stdout:7/836: creat d2/d26/d3d/d65/f11e x:0 0 0 2024-04-25T15:57:44.633 INFO:tasks.workunit.client.1.smithi155.stdout:0/742: mknod d1/d85/d8c/cf5 0 2024-04-25T15:57:44.635 INFO:tasks.workunit.client.1.smithi155.stdout:0/743: stat d1/d3/d3d/d46 0 2024-04-25T15:57:44.637 INFO:tasks.workunit.client.1.smithi155.stdout:9/648: dwrite dc/d11/fd0 [0,4194304] 0 2024-04-25T15:57:44.637 INFO:tasks.workunit.client.1.smithi155.stdout:6/914: dwrite d0/d13/d34/d38/d90/da5/f102 [0,4194304] 0 2024-04-25T15:57:44.638 INFO:tasks.workunit.client.1.smithi155.stdout:8/545: creat d2/d15/d18/d23/d3c/fa9 x:0 0 0 2024-04-25T15:57:44.640 INFO:tasks.workunit.client.1.smithi155.stdout:1/771: symlink d1/d16/d1d/d5e/dd0/lf3 0 2024-04-25T15:57:44.641 INFO:tasks.workunit.client.1.smithi155.stdout:9/649: chown dc/d13/d60/fc7 50178042 1 2024-04-25T15:57:44.644 INFO:tasks.workunit.client.1.smithi155.stdout:4/744: dwrite da/d23/d3f/d56/d69/f44 [0,4194304] 0 2024-04-25T15:57:44.651 INFO:tasks.workunit.client.1.smithi155.stdout:6/915: write d0/d13/d43/fc7 [1239011,66586] 0 2024-04-25T15:57:44.655 INFO:tasks.workunit.client.1.smithi155.stdout:9/650: creat dc/d13/d60/d7a/fd7 x:0 0 0 2024-04-25T15:57:44.657 INFO:tasks.workunit.client.1.smithi155.stdout:4/745: symlink da/d23/d3f/d56/dca/l107 0 2024-04-25T15:57:44.659 INFO:tasks.workunit.client.1.smithi155.stdout:1/772: dread d1/d16/d1d/d29/d5f/f35 [0,4194304] 0 2024-04-25T15:57:44.667 INFO:tasks.workunit.client.1.smithi155.stdout:4/746: mknod da/dc/d18/d97/c108 0 2024-04-25T15:57:44.670 INFO:tasks.workunit.client.1.smithi155.stdout:0/744: write d1/d85/d8c/fe0 [634347,108385] 0 2024-04-25T15:57:44.671 INFO:tasks.workunit.client.1.smithi155.stdout:0/745: chown d1/f70 72765663 1 2024-04-25T15:57:44.671 INFO:tasks.workunit.client.1.smithi155.stdout:8/546: link d2/d15/d18/d34/c83 d2/d15/d18/d34/d48/caa 0 2024-04-25T15:57:44.673 INFO:tasks.workunit.client.1.smithi155.stdout:6/916: symlink d0/d13/d43/l11e 0 2024-04-25T15:57:44.676 INFO:tasks.workunit.client.1.smithi155.stdout:0/746: symlink d1/d41/df4/d47/db0/dd1/lf6 0 2024-04-25T15:57:44.678 INFO:tasks.workunit.client.1.smithi155.stdout:8/547: creat d2/d15/d18/d23/d3c/d76/fab x:0 0 0 2024-04-25T15:57:44.679 INFO:tasks.workunit.client.1.smithi155.stdout:9/651: creat dc/fd8 x:0 0 0 2024-04-25T15:57:44.685 INFO:tasks.workunit.client.1.smithi155.stdout:6/917: symlink d0/d13/l11f 0 2024-04-25T15:57:44.685 INFO:tasks.workunit.client.1.smithi155.stdout:3/769: sync 2024-04-25T15:57:44.685 INFO:tasks.workunit.client.1.smithi155.stdout:2/869: sync 2024-04-25T15:57:44.685 INFO:tasks.workunit.client.1.smithi155.stdout:2/870: chown d7/db/f51 781 1 2024-04-25T15:57:44.691 INFO:tasks.workunit.client.1.smithi155.stdout:6/918: write d0/d1a/d37/fcb [950826,7200] 0 2024-04-25T15:57:44.692 INFO:tasks.workunit.client.1.smithi155.stdout:1/773: dread d1/d16/f2c [4194304,4194304] 0 2024-04-25T15:57:44.694 INFO:tasks.workunit.client.1.smithi155.stdout:9/652: dwrite dc/d13/d60/f8a [0,4194304] 0 2024-04-25T15:57:44.696 INFO:tasks.workunit.client.1.smithi155.stdout:0/747: link d1/d3/f17 d1/d3/d3d/d46/ff7 0 2024-04-25T15:57:44.697 INFO:tasks.workunit.client.1.smithi155.stdout:2/871: symlink d7/db/dd/d15/dff/l119 0 2024-04-25T15:57:44.698 INFO:tasks.workunit.client.1.smithi155.stdout:0/748: readlink d1/d3f/l63 0 2024-04-25T15:57:44.699 INFO:tasks.workunit.client.1.smithi155.stdout:8/548: creat d2/d15/d35/d3d/fac x:0 0 0 2024-04-25T15:57:44.702 INFO:tasks.workunit.client.1.smithi155.stdout:3/770: mkdir d1/d4/db/d91/de4/d104 0 2024-04-25T15:57:44.705 INFO:tasks.workunit.client.1.smithi155.stdout:4/747: truncate da/d23/d3f/d56/d69/d4a/d78/d62/f7e 360165 0 2024-04-25T15:57:44.705 INFO:tasks.workunit.client.1.smithi155.stdout:8/549: truncate d2/f5c 1036486 0 2024-04-25T15:57:44.707 INFO:tasks.workunit.client.1.smithi155.stdout:0/749: creat d1/d3/d5/d5b/d86/ff8 x:0 0 0 2024-04-25T15:57:44.709 INFO:tasks.workunit.client.1.smithi155.stdout:3/771: mknod d1/d4/db/d91/c105 0 2024-04-25T15:57:44.709 INFO:tasks.workunit.client.1.smithi155.stdout:8/550: fdatasync d2/d5/fa7 0 2024-04-25T15:57:44.711 INFO:tasks.workunit.client.1.smithi155.stdout:6/919: dwrite d0/f1 [4194304,4194304] 0 2024-04-25T15:57:44.717 INFO:tasks.workunit.client.1.smithi155.stdout:9/653: dwrite dc/d17/d2a/f8b [0,4194304] 0 2024-04-25T15:57:44.717 INFO:tasks.workunit.client.1.smithi155.stdout:8/551: stat d2/d15/d18/d34/d48/f8f 0 2024-04-25T15:57:44.719 INFO:tasks.workunit.client.1.smithi155.stdout:0/750: rename d1/d41/df4/fdf to d1/ff9 0 2024-04-25T15:57:44.721 INFO:tasks.workunit.client.1.smithi155.stdout:8/552: readlink d2/d5/l27 0 2024-04-25T15:57:44.723 INFO:tasks.workunit.client.1.smithi155.stdout:2/872: dwrite d7/db/d29/d83/fb5 [0,4194304] 0 2024-04-25T15:57:44.725 INFO:tasks.workunit.client.1.smithi155.stdout:0/751: readlink d1/d3/d12/d83/l8b 0 2024-04-25T15:57:44.726 INFO:tasks.workunit.client.1.smithi155.stdout:1/774: dread d1/d16/d1d/d29/d3d/d43/d88/f94 [0,4194304] 0 2024-04-25T15:57:44.729 INFO:tasks.workunit.client.1.smithi155.stdout:4/748: dwrite da/d23/d3f/d56/f76 [0,4194304] 0 2024-04-25T15:57:44.733 INFO:tasks.workunit.client.1.smithi155.stdout:8/553: symlink d2/d15/d18/d23/d2d/lad 0 2024-04-25T15:57:44.733 INFO:tasks.workunit.client.1.smithi155.stdout:3/772: dread d1/d4/d10/d21/d73/d8d/fa4 [0,4194304] 0 2024-04-25T15:57:44.735 INFO:tasks.workunit.client.1.smithi155.stdout:0/752: fsync d1/d3f/f7b 0 2024-04-25T15:57:44.736 INFO:tasks.workunit.client.1.smithi155.stdout:3/773: write d1/d4/d10/d21/d73/fe1 [157242,77370] 0 2024-04-25T15:57:44.737 INFO:tasks.workunit.client.1.smithi155.stdout:2/873: creat d7/db/d29/d83/d86/d8b/f11a x:0 0 0 2024-04-25T15:57:44.741 INFO:tasks.workunit.client.1.smithi155.stdout:9/654: rename dc/f95 to dc/d11/d30/dd2/fd9 0 2024-04-25T15:57:44.743 INFO:tasks.workunit.client.1.smithi155.stdout:4/749: dwrite da/d23/d3f/d56/d69/f5e [0,4194304] 0 2024-04-25T15:57:44.747 INFO:tasks.workunit.client.1.smithi155.stdout:8/554: unlink d2/d15/d35/f4d 0 2024-04-25T15:57:44.749 INFO:tasks.workunit.client.1.smithi155.stdout:8/555: dread - d2/d15/d35/d3d/f6b zero size 2024-04-25T15:57:44.749 INFO:tasks.workunit.client.1.smithi155.stdout:1/775: symlink d1/d16/d1d/d29/d5f/d34/lf4 0 2024-04-25T15:57:44.751 INFO:tasks.workunit.client.1.smithi155.stdout:3/774: creat d1/d4/d10/d21/d73/d77/d5f/db3/f106 x:0 0 0 2024-04-25T15:57:44.752 INFO:tasks.workunit.client.1.smithi155.stdout:2/874: mknod d7/db/d2e/d44/d70/d7b/c11b 0 2024-04-25T15:57:44.753 INFO:tasks.workunit.client.1.smithi155.stdout:4/750: fsync da/d23/d3f/d56/d69/f95 0 2024-04-25T15:57:44.759 INFO:tasks.workunit.client.1.smithi155.stdout:1/776: mknod d1/d32/cf5 0 2024-04-25T15:57:44.762 INFO:tasks.workunit.client.1.smithi155.stdout:4/751: dwrite da/d23/d3f/d56/d69/d4a/d78/f39 [0,4194304] 0 2024-04-25T15:57:44.762 INFO:tasks.workunit.client.1.smithi155.stdout:4/752: fsync da/d30/fec 0 2024-04-25T15:57:44.764 INFO:tasks.workunit.client.1.smithi155.stdout:8/556: mkdir d2/d15/d18/d34/d48/d4e/d81/dae 0 2024-04-25T15:57:44.764 INFO:tasks.workunit.client.1.smithi155.stdout:0/753: dread d1/d41/df4/f59 [0,4194304] 0 2024-04-25T15:57:44.766 INFO:tasks.workunit.client.1.smithi155.stdout:3/775: creat d1/d4/d10/d21/d73/d77/d5f/f107 x:0 0 0 2024-04-25T15:57:44.767 INFO:tasks.workunit.client.1.smithi155.stdout:2/875: mknod d7/db/d2e/def/c11c 0 2024-04-25T15:57:44.769 INFO:tasks.workunit.client.1.smithi155.stdout:3/776: chown d1/d4/db/d28/d58/faf 19 1 2024-04-25T15:57:44.772 INFO:tasks.workunit.client.1.smithi155.stdout:8/557: mkdir d2/d15/d18/d34/d48/d4e/daf 0 2024-04-25T15:57:44.772 INFO:tasks.workunit.client.1.smithi155.stdout:3/777: write d1/d4/db/d20/d44/d52/d61/db5/f76 [3726934,59411] 0 2024-04-25T15:57:44.772 INFO:tasks.workunit.client.1.smithi155.stdout:4/753: dwrite da/d23/d3f/d56/dca/ff4 [0,4194304] 0 2024-04-25T15:57:44.773 INFO:tasks.workunit.client.1.smithi155.stdout:0/754: symlink d1/d3/d12/d92/lfa 0 2024-04-25T15:57:44.774 INFO:tasks.workunit.client.1.smithi155.stdout:4/754: dread - da/dc/d18/fed zero size 2024-04-25T15:57:44.775 INFO:tasks.workunit.client.1.smithi155.stdout:2/876: mknod d7/db/d2e/d44/d70/d7b/c11d 0 2024-04-25T15:57:44.777 INFO:tasks.workunit.client.1.smithi155.stdout:9/655: link dc/d17/d2a/c84 dc/d11/d30/d46/da0/cda 0 2024-04-25T15:57:44.778 INFO:tasks.workunit.client.1.smithi155.stdout:9/656: write dc/d11/d5a/f65 [1648167,128053] 0 2024-04-25T15:57:44.778 INFO:tasks.workunit.client.1.smithi155.stdout:9/657: fsync dc/d13/f3a 0 2024-04-25T15:57:44.780 INFO:tasks.workunit.client.1.smithi155.stdout:2/877: dread d7/db/d2e/d44/f4b [0,4194304] 0 2024-04-25T15:57:44.780 INFO:tasks.workunit.client.1.smithi155.stdout:2/878: chown d7/db/dd/d15/dd7 13870 1 2024-04-25T15:57:44.782 INFO:tasks.workunit.client.1.smithi155.stdout:3/778: creat d1/d4/d10/d21/dab/f108 x:0 0 0 2024-04-25T15:57:44.786 INFO:tasks.workunit.client.1.smithi155.stdout:0/755: rename d1/d3/d3d/d46/deb to d1/d3/d6a/dfb 0 2024-04-25T15:57:44.791 INFO:tasks.workunit.client.1.smithi155.stdout:8/558: creat d2/d15/d18/d95/fb0 x:0 0 0 2024-04-25T15:57:44.793 INFO:tasks.workunit.client.1.smithi155.stdout:8/559: fdatasync d2/d15/d18/d49/f3a 0 2024-04-25T15:57:44.793 INFO:tasks.workunit.client.1.smithi155.stdout:9/658: creat dc/d74/fdb x:0 0 0 2024-04-25T15:57:44.796 INFO:tasks.workunit.client.1.smithi155.stdout:2/879: symlink d7/d8e/db9/l11e 0 2024-04-25T15:57:44.797 INFO:tasks.workunit.client.1.smithi155.stdout:2/880: chown d7/db/d2e/d6f/dc6/fcf 274369 1 2024-04-25T15:57:44.798 INFO:tasks.workunit.client.1.smithi155.stdout:3/779: mkdir d1/d4/d10/d21/d73/d77/d57/d80/d109 0 2024-04-25T15:57:44.799 INFO:tasks.workunit.client.1.smithi155.stdout:3/780: write d1/d4/db/f7d [455231,117888] 0 2024-04-25T15:57:44.803 INFO:tasks.workunit.client.1.smithi155.stdout:8/560: rename d2/d15/d18/d23/d3c/d76/fab to d2/d15/d18/d34/d48/d7f/fb1 0 2024-04-25T15:57:44.804 INFO:tasks.workunit.client.1.smithi155.stdout:9/659: readlink l3 0 2024-04-25T15:57:44.807 INFO:tasks.workunit.client.1.smithi155.stdout:0/756: mkdir d1/d3/d5/d5b/dc4/dfc 0 2024-04-25T15:57:44.808 INFO:tasks.workunit.client.1.smithi155.stdout:8/561: dread d2/d15/d18/d34/f9f [0,4194304] 0 2024-04-25T15:57:44.809 INFO:tasks.workunit.client.1.smithi155.stdout:3/781: mknod d1/d4/db/d20/d44/c10a 0 2024-04-25T15:57:44.810 INFO:tasks.workunit.client.1.smithi155.stdout:3/782: stat d1/d4/d10/d21/f96 0 2024-04-25T15:57:44.811 INFO:tasks.workunit.client.1.smithi155.stdout:2/881: dread d7/db/f59 [4194304,4194304] 0 2024-04-25T15:57:44.812 INFO:tasks.workunit.client.1.smithi155.stdout:9/660: rmdir dc/d17/dc0/dc9 39 2024-04-25T15:57:44.812 INFO:tasks.workunit.client.1.smithi155.stdout:5/801: sync 2024-04-25T15:57:44.813 INFO:tasks.workunit.client.1.smithi155.stdout:5/802: chown d0/d47/de4/ff5 14 1 2024-04-25T15:57:44.815 INFO:tasks.workunit.client.1.smithi155.stdout:4/755: link da/d23/da2/dad/cb6 da/d23/d3f/d56/d69/d4a/d78/c109 0 2024-04-25T15:57:44.818 INFO:tasks.workunit.client.1.smithi155.stdout:8/562: rename d2/f5c to d2/d41/d5d/fb2 0 2024-04-25T15:57:44.819 INFO:tasks.workunit.client.1.smithi155.stdout:8/563: fsync d2/d15/d18/d49/f3a 0 2024-04-25T15:57:44.822 INFO:tasks.workunit.client.1.smithi155.stdout:9/661: creat dc/d17/d2a/fdc x:0 0 0 2024-04-25T15:57:44.823 INFO:tasks.workunit.client.1.smithi155.stdout:9/662: stat dc/d13/d2e/f4a 0 2024-04-25T15:57:44.823 INFO:tasks.workunit.client.1.smithi155.stdout:9/663: fdatasync dc/d11/d5a/fca 0 2024-04-25T15:57:44.825 INFO:tasks.workunit.client.1.smithi155.stdout:5/803: creat d0/d58/d32/d6a/f104 x:0 0 0 2024-04-25T15:57:44.832 INFO:tasks.workunit.client.1.smithi155.stdout:9/664: write dc/d13/d2e/fb1 [1129008,26764] 0 2024-04-25T15:57:44.837 INFO:tasks.workunit.client.1.smithi155.stdout:8/564: mknod d2/d15/d18/d23/d2d/da5/cb3 0 2024-04-25T15:57:44.840 INFO:tasks.workunit.client.1.smithi155.stdout:9/665: mknod dc/d11/d30/dd2/cdd 0 2024-04-25T15:57:44.842 INFO:tasks.workunit.client.1.smithi155.stdout:2/882: write d7/d23/f34 [4026454,122426] 0 2024-04-25T15:57:44.842 INFO:tasks.workunit.client.1.smithi155.stdout:9/666: chown dc/d11/d30/dd2/cdd 18306514 1 2024-04-25T15:57:44.845 INFO:tasks.workunit.client.1.smithi155.stdout:3/783: rename d1/d4/db/d20/d44/d52/dd2 to d1/d4/db/d91/dc4/d10b 0 2024-04-25T15:57:44.848 INFO:tasks.workunit.client.1.smithi155.stdout:8/565: read d2/d15/f69 [1374489,127299] 0 2024-04-25T15:57:44.849 INFO:tasks.workunit.client.1.smithi155.stdout:0/757: truncate d1/d41/f44 3781866 0 2024-04-25T15:57:44.850 INFO:tasks.workunit.client.1.smithi155.stdout:5/804: creat d0/f105 x:0 0 0 2024-04-25T15:57:44.851 INFO:tasks.workunit.client.1.smithi155.stdout:9/667: mknod dc/d17/d2a/cde 0 2024-04-25T15:57:44.853 INFO:tasks.workunit.client.1.smithi155.stdout:2/883: symlink d7/db/d2e/d6f/d91/dad/de0/l11f 0 2024-04-25T15:57:44.853 INFO:tasks.workunit.client.1.smithi155.stdout:2/884: chown d7/f82 791137 1 2024-04-25T15:57:44.853 INFO:tasks.workunit.client.1.smithi155.stdout:3/784: creat d1/d4/db/d91/de4/f10c x:0 0 0 2024-04-25T15:57:44.854 INFO:tasks.workunit.client.1.smithi155.stdout:5/805: dread d0/d3/d15/d30/d4f/ff1 [0,4194304] 0 2024-04-25T15:57:44.855 INFO:tasks.workunit.client.1.smithi155.stdout:8/566: unlink d2/d5/d40/l8c 0 2024-04-25T15:57:44.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/806: truncate d0/d3/d2c/f3a 4337270 0 2024-04-25T15:57:44.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/807: stat d0/d3/d15/d30/d4f 0 2024-04-25T15:57:44.857 INFO:tasks.workunit.client.1.smithi155.stdout:9/668: mkdir dc/d11/d30/dd2/ddf 0 2024-04-25T15:57:44.859 INFO:tasks.workunit.client.1.smithi155.stdout:3/785: creat d1/d4/d10/d21/d73/d8d/f10d x:0 0 0 2024-04-25T15:57:44.860 INFO:tasks.workunit.client.1.smithi155.stdout:0/758: symlink d1/d3/d3d/lfd 0 2024-04-25T15:57:44.862 INFO:tasks.workunit.client.1.smithi155.stdout:8/567: unlink d2/d15/d18/d34/d48/f89 0 2024-04-25T15:57:44.864 INFO:tasks.workunit.client.1.smithi155.stdout:5/808: creat d0/d3/d2c/f106 x:0 0 0 2024-04-25T15:57:44.867 INFO:tasks.workunit.client.1.smithi155.stdout:3/786: creat d1/d4/db/d28/d58/de6/f10e x:0 0 0 2024-04-25T15:57:44.869 INFO:tasks.workunit.client.1.smithi155.stdout:0/759: creat d1/d41/df4/d47/db0/dd1/ffe x:0 0 0 2024-04-25T15:57:44.871 INFO:tasks.workunit.client.1.smithi155.stdout:2/885: creat d7/db/dd/f120 x:0 0 0 2024-04-25T15:57:44.873 INFO:tasks.workunit.client.1.smithi155.stdout:5/809: dwrite d0/d3/d2c/f3a [4194304,4194304] 0 2024-04-25T15:57:44.874 INFO:tasks.workunit.client.1.smithi155.stdout:2/886: dread d7/db/d2e/d90/fe6 [0,4194304] 0 2024-04-25T15:57:44.876 INFO:tasks.workunit.client.1.smithi155.stdout:2/887: stat d7/db/dd/d15/l22 0 2024-04-25T15:57:44.876 INFO:tasks.workunit.client.1.smithi155.stdout:3/787: dread - d1/d4/db/d20/d44/d52/d61/db5/f38 zero size 2024-04-25T15:57:44.879 INFO:tasks.workunit.client.1.smithi155.stdout:0/760: unlink d1/d85/c9f 0 2024-04-25T15:57:44.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/761: truncate d1/d85/fa1 1431814 0 2024-04-25T15:57:44.881 INFO:tasks.workunit.client.1.smithi155.stdout:8/568: dread d2/f33 [0,4194304] 0 2024-04-25T15:57:44.883 INFO:tasks.workunit.client.1.smithi155.stdout:0/762: truncate d1/d3/d12/fec 612346 0 2024-04-25T15:57:44.884 INFO:tasks.workunit.client.1.smithi155.stdout:8/569: dread d2/d15/d18/d23/d3c/f86 [4194304,4194304] 0 2024-04-25T15:57:44.885 INFO:tasks.workunit.client.1.smithi155.stdout:0/763: truncate d1/d41/df4/fa6 1046382 0 2024-04-25T15:57:44.887 INFO:tasks.workunit.client.1.smithi155.stdout:9/669: dread dc/d17/d8e/dae/dd6/f91 [0,4194304] 0 2024-04-25T15:57:44.888 INFO:tasks.workunit.client.1.smithi155.stdout:2/888: creat d7/db/d2e/d6f/dc6/dd6/f121 x:0 0 0 2024-04-25T15:57:44.893 INFO:tasks.workunit.client.1.smithi155.stdout:5/810: creat d0/d3/d15/d1f/d50/f107 x:0 0 0 2024-04-25T15:57:44.895 INFO:tasks.workunit.client.1.smithi155.stdout:5/811: truncate d0/d3/d15/d1f/d50/fee 834505 0 2024-04-25T15:57:44.901 INFO:tasks.workunit.client.1.smithi155.stdout:5/812: chown d0/d3/c2e 656077 1 2024-04-25T15:57:44.902 INFO:tasks.workunit.client.1.smithi155.stdout:2/889: getdents d7/db/d29/d83/dc8 0 2024-04-25T15:57:44.905 INFO:tasks.workunit.client.1.smithi155.stdout:5/813: creat d0/d58/d9b/f108 x:0 0 0 2024-04-25T15:57:44.908 INFO:tasks.workunit.client.1.smithi155.stdout:5/814: read d0/d3/d15/d1f/d50/d7c/fa1 [1174241,9224] 0 2024-04-25T15:57:44.908 INFO:tasks.workunit.client.1.smithi155.stdout:0/764: getdents d1/d41 0 2024-04-25T15:57:44.909 INFO:tasks.workunit.client.1.smithi155.stdout:8/570: getdents d2/d15/d18/d23/d3c/d76/d7e 0 2024-04-25T15:57:44.910 INFO:tasks.workunit.client.1.smithi155.stdout:2/890: dwrite d7/db/dd/d15/fbc [0,4194304] 0 2024-04-25T15:57:44.912 INFO:tasks.workunit.client.1.smithi155.stdout:3/788: dread d1/d4/db/d91/dc4/f3c [4194304,4194304] 0 2024-04-25T15:57:44.912 INFO:tasks.workunit.client.1.smithi155.stdout:5/815: fsync d0/d27/f43 0 2024-04-25T15:57:44.912 INFO:tasks.workunit.client.1.smithi155.stdout:2/891: fsync d7/db/d2e/d90/fb8 0 2024-04-25T15:57:44.915 INFO:tasks.workunit.client.1.smithi155.stdout:9/670: truncate dc/d11/d5a/f65 135842 0 2024-04-25T15:57:44.916 INFO:tasks.workunit.client.1.smithi155.stdout:8/571: fdatasync d2/f16 0 2024-04-25T15:57:44.917 INFO:tasks.workunit.client.1.smithi155.stdout:9/671: fdatasync dc/d11/d30/d46/fcd 0 2024-04-25T15:57:44.918 INFO:tasks.workunit.client.1.smithi155.stdout:5/816: dread d0/d3/d15/d1f/d50/fac [0,4194304] 0 2024-04-25T15:57:44.919 INFO:tasks.workunit.client.1.smithi155.stdout:0/765: dwrite d1/d3/d5/d5b/dc4/f88 [0,4194304] 0 2024-04-25T15:57:44.920 INFO:tasks.workunit.client.1.smithi155.stdout:3/789: mkdir d1/d4/db/d28/d58/de6/d10f 0 2024-04-25T15:57:44.920 INFO:tasks.workunit.client.1.smithi155.stdout:7/837: sync 2024-04-25T15:57:44.922 INFO:tasks.workunit.client.1.smithi155.stdout:3/790: chown d1/d4/db/d91/dc4/d6c/fc6 10502067 1 2024-04-25T15:57:44.922 INFO:tasks.workunit.client.1.smithi155.stdout:7/838: read d2/dd/d13/d1c/fad [68383,94165] 0 2024-04-25T15:57:44.923 INFO:tasks.workunit.client.1.smithi155.stdout:0/766: read d1/d41/df4/f66 [101746,34557] 0 2024-04-25T15:57:44.927 INFO:tasks.workunit.client.1.smithi155.stdout:7/839: dread d2/dd/d63/f11a [0,4194304] 0 2024-04-25T15:57:44.933 INFO:tasks.workunit.client.1.smithi155.stdout:7/840: dread d2/dd/d30/d44/f7d [0,4194304] 0 2024-04-25T15:57:44.934 INFO:tasks.workunit.client.1.smithi155.stdout:9/672: rename dc/d11/d30/d46/f9d to dc/d11/d67/fe0 0 2024-04-25T15:57:44.934 INFO:tasks.workunit.client.1.smithi155.stdout:3/791: unlink d1/d4/d10/f102 0 2024-04-25T15:57:44.934 INFO:tasks.workunit.client.1.smithi155.stdout:7/841: write d2/d26/d3d/d65/f86 [2040663,24895] 0 2024-04-25T15:57:44.934 INFO:tasks.workunit.client.1.smithi155.stdout:0/767: creat d1/d41/fff x:0 0 0 2024-04-25T15:57:44.936 INFO:tasks.workunit.client.1.smithi155.stdout:9/673: chown dc/d13/d60/f8a 3861171 1 2024-04-25T15:57:44.936 INFO:tasks.workunit.client.1.smithi155.stdout:3/792: readlink d1/d4/db/d91/dc4/d6c/lf1 0 2024-04-25T15:57:44.937 INFO:tasks.workunit.client.1.smithi155.stdout:7/842: readlink d2/dd/d13/d24/d35/l67 0 2024-04-25T15:57:44.939 INFO:tasks.workunit.client.1.smithi155.stdout:0/768: read d1/d3/d5/faa [336853,87382] 0 2024-04-25T15:57:44.944 INFO:tasks.workunit.client.1.smithi155.stdout:9/674: rename dc/d11/d67/d9c to dc/d17/d8e/de1 0 2024-04-25T15:57:44.944 INFO:tasks.workunit.client.1.smithi155.stdout:2/892: dwrite d7/db/dd/d15/f33 [0,4194304] 0 2024-04-25T15:57:44.945 INFO:tasks.workunit.client.1.smithi155.stdout:7/843: creat d2/d26/d3d/f11f x:0 0 0 2024-04-25T15:57:44.946 INFO:tasks.workunit.client.1.smithi155.stdout:5/817: dwrite d0/d3/d15/d30/d4f/ff1 [0,4194304] 0 2024-04-25T15:57:44.946 INFO:tasks.workunit.client.1.smithi155.stdout:9/675: write dc/d13/f26 [163403,60597] 0 2024-04-25T15:57:44.949 INFO:tasks.workunit.client.1.smithi155.stdout:3/793: creat d1/d4/db/d20/d44/d52/d61/f110 x:0 0 0 2024-04-25T15:57:44.951 INFO:tasks.workunit.client.1.smithi155.stdout:8/572: write d2/d15/d18/d23/d3c/f47 [4898269,50494] 0 2024-04-25T15:57:44.953 INFO:tasks.workunit.client.1.smithi155.stdout:9/676: mkdir dc/d17/d8e/de2 0 2024-04-25T15:57:44.954 INFO:tasks.workunit.client.1.smithi155.stdout:5/818: mknod d0/d3/c109 0 2024-04-25T15:57:44.956 INFO:tasks.workunit.client.1.smithi155.stdout:3/794: mkdir d1/d4/db/d91/dc4/d6c/d111 0 2024-04-25T15:57:44.957 INFO:tasks.workunit.client.1.smithi155.stdout:2/893: rename d7/db/dd/d15/d60/ca2 to d7/db/d29/d83/d86/d8b/dbf/c122 0 2024-04-25T15:57:44.959 INFO:tasks.workunit.client.1.smithi155.stdout:7/844: dwrite d2/dd/d30/fcb [0,4194304] 0 2024-04-25T15:57:44.961 INFO:tasks.workunit.client.1.smithi155.stdout:6/920: sync 2024-04-25T15:57:44.961 INFO:tasks.workunit.client.1.smithi155.stdout:1/777: sync 2024-04-25T15:57:44.962 INFO:tasks.workunit.client.1.smithi155.stdout:2/894: dread d7/db/d2e/f7a [0,4194304] 0 2024-04-25T15:57:44.967 INFO:tasks.workunit.client.1.smithi155.stdout:5/819: chown d0/d58/d32/d6a/d78 23 1 2024-04-25T15:57:44.971 INFO:tasks.workunit.client.1.smithi155.stdout:1/778: dread - d1/d16/f54 zero size 2024-04-25T15:57:44.976 INFO:tasks.workunit.client.1.smithi155.stdout:3/795: dwrite d1/d4/db/d91/faa [0,4194304] 0 2024-04-25T15:57:44.976 INFO:tasks.workunit.client.1.smithi155.stdout:6/921: rename d0/d18/cd5 to d0/d1a/d37/dda/dfe/df0/c120 0 2024-04-25T15:57:44.978 INFO:tasks.workunit.client.1.smithi155.stdout:2/895: mkdir d7/db/d29/d83/dbe/d101/d123 0 2024-04-25T15:57:44.978 INFO:tasks.workunit.client.1.smithi155.stdout:9/677: dwrite dc/d17/d8e/dae/dd6/f41 [0,4194304] 0 2024-04-25T15:57:44.981 INFO:tasks.workunit.client.1.smithi155.stdout:5/820: mkdir d0/d3/d15/d1f/d50/d10a 0 2024-04-25T15:57:44.983 INFO:tasks.workunit.client.1.smithi155.stdout:9/678: dread - dc/d11/d5a/fca zero size 2024-04-25T15:57:44.985 INFO:tasks.workunit.client.1.smithi155.stdout:1/779: mkdir d1/d16/df6 0 2024-04-25T15:57:44.986 INFO:tasks.workunit.client.1.smithi155.stdout:0/769: dwrite d1/d6/f75 [0,4194304] 0 2024-04-25T15:57:44.990 INFO:tasks.workunit.client.1.smithi155.stdout:8/573: dread d2/f60 [0,4194304] 0 2024-04-25T15:57:44.991 INFO:tasks.workunit.client.1.smithi155.stdout:5/821: getdents d0/d3 0 2024-04-25T15:57:44.994 INFO:tasks.workunit.client.1.smithi155.stdout:9/679: dread dc/d13/fa7 [0,4194304] 0 2024-04-25T15:57:44.994 INFO:tasks.workunit.client.1.smithi155.stdout:6/922: rename d0/d1a/d25/d2e/d39/fe6 to d0/d1a/d25/f121 0 2024-04-25T15:57:44.997 INFO:tasks.workunit.client.1.smithi155.stdout:7/845: dwrite d2/dd/d12/d76/db6/f103 [0,4194304] 0 2024-04-25T15:57:44.998 INFO:tasks.workunit.client.1.smithi155.stdout:0/770: truncate d1/d85/d8c/fe0 1615841 0 2024-04-25T15:57:44.998 INFO:tasks.workunit.client.1.smithi155.stdout:1/780: write d1/d16/d1d/d29/d3d/d43/d88/f94 [4673223,74638] 0 2024-04-25T15:57:45.002 INFO:tasks.workunit.client.1.smithi155.stdout:8/574: creat d2/d15/d18/d34/d48/d4e/d81/fb4 x:0 0 0 2024-04-25T15:57:45.003 INFO:tasks.workunit.client.1.smithi155.stdout:3/796: dwrite d1/d4/db/d20/ffa [0,4194304] 0 2024-04-25T15:57:45.005 INFO:tasks.workunit.client.1.smithi155.stdout:6/923: mkdir d0/d1a/d37/dda/dfe/df0/d122 0 2024-04-25T15:57:45.006 INFO:tasks.workunit.client.1.smithi155.stdout:7/846: creat d2/dd/d12/d76/f120 x:0 0 0 2024-04-25T15:57:45.008 INFO:tasks.workunit.client.1.smithi155.stdout:1/781: dread d1/d6/fc9 [0,4194304] 0 2024-04-25T15:57:45.008 INFO:tasks.workunit.client.1.smithi155.stdout:9/680: creat dc/d17/fe3 x:0 0 0 2024-04-25T15:57:45.008 INFO:tasks.workunit.client.1.smithi155.stdout:0/771: mknod d1/d41/df4/d47/db0/c100 0 2024-04-25T15:57:45.008 INFO:tasks.workunit.client.1.smithi155.stdout:5/822: rename d0/d3/d15/d1f/d50/d60/ldf to d0/d58/d32/l10b 0 2024-04-25T15:57:45.010 INFO:tasks.workunit.client.1.smithi155.stdout:2/896: dwrite d7/db/d2e/d44/f4b [0,4194304] 0 2024-04-25T15:57:45.011 INFO:tasks.workunit.client.1.smithi155.stdout:8/575: creat d2/d15/d18/d23/d3c/fb5 x:0 0 0 2024-04-25T15:57:45.013 INFO:tasks.workunit.client.1.smithi155.stdout:4/756: sync 2024-04-25T15:57:45.015 INFO:tasks.workunit.client.1.smithi155.stdout:3/797: creat d1/d4/d10/d21/d73/d77/d57/d7c/f112 x:0 0 0 2024-04-25T15:57:45.016 INFO:tasks.workunit.client.1.smithi155.stdout:6/924: mknod d0/d1a/d37/dda/dfe/d7b/c123 0 2024-04-25T15:57:45.016 INFO:tasks.workunit.client.1.smithi155.stdout:7/847: getdents d2/d26/d3d/d6d/daa 0 2024-04-25T15:57:45.019 INFO:tasks.workunit.client.1.smithi155.stdout:1/782: rmdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2 39 2024-04-25T15:57:45.021 INFO:tasks.workunit.client.1.smithi155.stdout:0/772: dwrite d1/d6/f8a [0,4194304] 0 2024-04-25T15:57:45.022 INFO:tasks.workunit.client.1.smithi155.stdout:3/798: mkdir d1/d4/db/d28/d58/d113 0 2024-04-25T15:57:45.026 INFO:tasks.workunit.client.1.smithi155.stdout:7/848: unlink d2/dd/d63/fc0 0 2024-04-25T15:57:45.028 INFO:tasks.workunit.client.1.smithi155.stdout:1/783: readlink d1/d6/lef 0 2024-04-25T15:57:45.028 INFO:tasks.workunit.client.1.smithi155.stdout:9/681: link dc/d74/c85 dc/d17/d8e/dae/dd6/d72/ce4 0 2024-04-25T15:57:45.029 INFO:tasks.workunit.client.1.smithi155.stdout:1/784: chown d1/d32/fee 184136500 1 2024-04-25T15:57:45.029 INFO:tasks.workunit.client.1.smithi155.stdout:4/757: creat da/d87/ddc/f10a x:0 0 0 2024-04-25T15:57:45.031 INFO:tasks.workunit.client.1.smithi155.stdout:3/799: creat d1/d4/db/d91/f114 x:0 0 0 2024-04-25T15:57:45.031 INFO:tasks.workunit.client.1.smithi155.stdout:5/823: link d0/d27/l91 d0/d47/db3/l10c 0 2024-04-25T15:57:45.032 INFO:tasks.workunit.client.1.smithi155.stdout:8/576: link d2/d15/d18/d34/d48/c56 d2/d41/d5d/cb6 0 2024-04-25T15:57:45.035 INFO:tasks.workunit.client.1.smithi155.stdout:7/849: creat d2/dd/d13/d1c/dd9/f121 x:0 0 0 2024-04-25T15:57:45.036 INFO:tasks.workunit.client.1.smithi155.stdout:5/824: creat d0/d58/f10d x:0 0 0 2024-04-25T15:57:45.036 INFO:tasks.workunit.client.1.smithi155.stdout:3/800: mkdir d1/d4/d10/d21/d73/d8d/d115 0 2024-04-25T15:57:45.037 INFO:tasks.workunit.client.1.smithi155.stdout:6/925: dread d0/f4f [0,4194304] 0 2024-04-25T15:57:45.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:45.039 INFO:tasks.workunit.client.1.smithi155.stdout:8/577: rename d2/d15/d35/f6d to d2/d15/d18/fb7 0 2024-04-25T15:57:45.039 INFO:tasks.workunit.client.1.smithi155.stdout:6/926: chown d0/d18/d54/fa8 2096 1 2024-04-25T15:57:45.041 INFO:tasks.workunit.client.1.smithi155.stdout:5/825: mkdir d0/d3/d15/d30/d10e 0 2024-04-25T15:57:45.044 INFO:tasks.workunit.client.1.smithi155.stdout:6/927: creat d0/d1a/d37/dda/dfe/f124 x:0 0 0 2024-04-25T15:57:45.050 INFO:tasks.workunit.client.1.smithi155.stdout:3/801: dwrite d1/d4/db/d28/d58/f42 [4194304,4194304] 0 2024-04-25T15:57:45.050 INFO:tasks.workunit.client.1.smithi155.stdout:9/682: dread dc/d11/f80 [0,4194304] 0 2024-04-25T15:57:45.052 INFO:tasks.workunit.client.1.smithi155.stdout:9/683: chown dc/d13/l58 2439 1 2024-04-25T15:57:45.052 INFO:tasks.workunit.client.1.smithi155.stdout:4/758: dread da/d23/d3f/d56/d69/d4a/d78/f4f [0,4194304] 0 2024-04-25T15:57:45.053 INFO:tasks.workunit.client.1.smithi155.stdout:8/578: rename d2/d15/d35/f57 to d2/d15/d18/d34/d48/d4e/d81/fb8 0 2024-04-25T15:57:45.055 INFO:tasks.workunit.client.1.smithi155.stdout:0/773: write d1/d3/d3d/dcb/fe6 [3979290,97959] 0 2024-04-25T15:57:45.058 INFO:tasks.workunit.client.1.smithi155.stdout:8/579: chown d2/d5/l27 413008 1 2024-04-25T15:57:45.058 INFO:tasks.workunit.client.1.smithi155.stdout:4/759: getdents da/d23/d3f/d56/d69/d102 0 2024-04-25T15:57:45.060 INFO:tasks.workunit.client.1.smithi155.stdout:9/684: mkdir dc/d13/de5 0 2024-04-25T15:57:45.060 INFO:tasks.workunit.client.1.smithi155.stdout:8/580: truncate d2/d5/d40/d5b/f91 578970 0 2024-04-25T15:57:45.061 INFO:tasks.workunit.client.1.smithi155.stdout:0/774: mkdir d1/d85/d98/d101 0 2024-04-25T15:57:45.062 INFO:tasks.workunit.client.1.smithi155.stdout:7/850: truncate d2/dd/d30/dbc/fee 131317 0 2024-04-25T15:57:45.063 INFO:tasks.workunit.client.1.smithi155.stdout:6/928: link d0/d13/d43/c5d d0/d1a/d45/d61/d8e/c125 0 2024-04-25T15:57:45.063 INFO:tasks.workunit.client.1.smithi155.stdout:9/685: write dc/d11/d67/f83 [351112,74349] 0 2024-04-25T15:57:45.066 INFO:tasks.workunit.client.1.smithi155.stdout:9/686: stat dc/d13/f3a 0 2024-04-25T15:57:45.067 INFO:tasks.workunit.client.1.smithi155.stdout:8/581: mknod d2/d15/d18/d23/d3c/d76/d7e/cb9 0 2024-04-25T15:57:45.071 INFO:tasks.workunit.client.1.smithi155.stdout:7/851: creat d2/dd/d30/f122 x:0 0 0 2024-04-25T15:57:45.071 INFO:tasks.workunit.client.1.smithi155.stdout:5/826: dwrite d0/d27/f43 [0,4194304] 0 2024-04-25T15:57:45.072 INFO:tasks.workunit.client.1.smithi155.stdout:6/929: mknod d0/d1a/d25/c126 0 2024-04-25T15:57:45.074 INFO:tasks.workunit.client.1.smithi155.stdout:8/582: read - d2/d15/d18/d34/d48/d4e/f90 zero size 2024-04-25T15:57:45.079 INFO:tasks.workunit.client.1.smithi155.stdout:3/802: dread d1/d4/fc7 [0,4194304] 0 2024-04-25T15:57:45.079 INFO:tasks.workunit.client.1.smithi155.stdout:4/760: dwrite da/d23/d3f/d56/d69/d4a/d78/f31 [0,4194304] 0 2024-04-25T15:57:45.080 INFO:tasks.workunit.client.1.smithi155.stdout:5/827: creat d0/d58/d32/d6a/d78/f10f x:0 0 0 2024-04-25T15:57:45.081 INFO:tasks.workunit.client.1.smithi155.stdout:7/852: symlink d2/d26/d3d/d6d/db3/l123 0 2024-04-25T15:57:45.082 INFO:tasks.workunit.client.1.smithi155.stdout:8/583: write d2/d15/d35/d3d/f42 [3037531,78056] 0 2024-04-25T15:57:45.083 INFO:tasks.workunit.client.1.smithi155.stdout:3/803: rmdir d1 39 2024-04-25T15:57:45.084 INFO:tasks.workunit.client.1.smithi155.stdout:5/828: rmdir d0/d3/d15 39 2024-04-25T15:57:45.087 INFO:tasks.workunit.client.1.smithi155.stdout:7/853: fsync d2/dd/fa6 0 2024-04-25T15:57:45.088 INFO:tasks.workunit.client.1.smithi155.stdout:4/761: symlink da/d23/d3f/dc6/l10b 0 2024-04-25T15:57:45.090 INFO:tasks.workunit.client.1.smithi155.stdout:4/762: write da/d23/d3f/f100 [298793,107902] 0 2024-04-25T15:57:45.091 INFO:tasks.workunit.client.1.smithi155.stdout:7/854: symlink d2/dd/d63/l124 0 2024-04-25T15:57:45.094 INFO:tasks.workunit.client.1.smithi155.stdout:6/930: dread d0/d1a/d37/f3e [0,4194304] 0 2024-04-25T15:57:45.096 INFO:tasks.workunit.client.1.smithi155.stdout:4/763: rename da/dc to da/d23/d3f/d56/d69/d83/d10c 0 2024-04-25T15:57:45.100 INFO:tasks.workunit.client.1.smithi155.stdout:9/687: dread dc/d11/fa1 [0,4194304] 0 2024-04-25T15:57:45.100 INFO:tasks.workunit.client.1.smithi155.stdout:7/855: rmdir d2/dd/d36/dcd/dc9/d102 0 2024-04-25T15:57:45.100 INFO:tasks.workunit.client.1.smithi155.stdout:4/764: write da/d30/f85 [710055,96634] 0 2024-04-25T15:57:45.106 INFO:tasks.workunit.client.1.smithi155.stdout:3/804: dwrite d1/d4/db/d20/d44/d52/fad [0,4194304] 0 2024-04-25T15:57:45.106 INFO:tasks.workunit.client.1.smithi155.stdout:5/829: dread d0/d3/d15/d9f/dc3/fd3 [0,4194304] 0 2024-04-25T15:57:45.107 INFO:tasks.workunit.client.1.smithi155.stdout:3/805: readlink d1/d4/db/l1a 0 2024-04-25T15:57:45.108 INFO:tasks.workunit.client.1.smithi155.stdout:4/765: read da/d23/fbc [4099519,109328] 0 2024-04-25T15:57:45.111 INFO:tasks.workunit.client.1.smithi155.stdout:3/806: chown d1/d4/d10/d21/d73/d77/d5f/fff 7973230 1 2024-04-25T15:57:45.111 INFO:tasks.workunit.client.1.smithi155.stdout:7/856: creat d2/d26/d3d/d6d/daa/f125 x:0 0 0 2024-04-25T15:57:45.111 INFO:tasks.workunit.client.1.smithi155.stdout:8/584: dread d2/fa [0,4194304] 0 2024-04-25T15:57:45.113 INFO:tasks.workunit.client.1.smithi155.stdout:3/807: stat d1/d4/d10/d21/d73/d77/d5f/f107 0 2024-04-25T15:57:45.121 INFO:tasks.workunit.client.1.smithi155.stdout:9/688: creat dc/d13/d60/fe6 x:0 0 0 2024-04-25T15:57:45.125 INFO:tasks.workunit.client.1.smithi155.stdout:4/766: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/fed [0,4194304] 0 2024-04-25T15:57:45.126 INFO:tasks.workunit.client.1.smithi155.stdout:6/931: truncate d0/d1a/d25/d2e/f67 377351 0 2024-04-25T15:57:45.129 INFO:tasks.workunit.client.1.smithi155.stdout:5/830: truncate d0/d58/d63/da0/fb2 994149 0 2024-04-25T15:57:45.134 INFO:tasks.workunit.client.1.smithi155.stdout:3/808: mkdir d1/d4/db/d20/d44/d52/d93/d116 0 2024-04-25T15:57:45.135 INFO:tasks.workunit.client.1.smithi155.stdout:8/585: dwrite d2/d15/f69 [0,4194304] 0 2024-04-25T15:57:45.138 INFO:tasks.workunit.client.1.smithi155.stdout:5/831: chown d0/d3/d2c/d94/fc8 484 1 2024-04-25T15:57:45.140 INFO:tasks.workunit.client.1.smithi155.stdout:5/832: write d0/d58/f56 [1164789,21981] 0 2024-04-25T15:57:45.142 INFO:tasks.workunit.client.1.smithi155.stdout:6/932: dread d0/d1a/f6b [0,4194304] 0 2024-04-25T15:57:45.146 INFO:tasks.workunit.client.1.smithi155.stdout:4/767: creat da/d23/d3f/d56/d69/f10d x:0 0 0 2024-04-25T15:57:45.149 INFO:tasks.workunit.client.1.smithi155.stdout:6/933: link d0/d1a/d25/d51/f84 d0/d1a/da1/dac/d10d/f127 0 2024-04-25T15:57:45.152 INFO:tasks.workunit.client.1.smithi155.stdout:4/768: symlink da/d23/d3f/l10e 0 2024-04-25T15:57:45.152 INFO:tasks.workunit.client.1.smithi155.stdout:4/769: dread - da/d23/d3f/dc6/de2/fea zero size 2024-04-25T15:57:45.154 INFO:tasks.workunit.client.1.smithi155.stdout:4/770: chown da/d23/da2/fb8 248939878 1 2024-04-25T15:57:45.155 INFO:tasks.workunit.client.1.smithi155.stdout:4/771: write da/d23/d3f/d56/d69/d4a/d78/f31 [1215592,92102] 0 2024-04-25T15:57:45.156 INFO:tasks.workunit.client.1.smithi155.stdout:7/857: write d2/dd/d63/f77 [1052925,71006] 0 2024-04-25T15:57:45.159 INFO:tasks.workunit.client.1.smithi155.stdout:7/858: mknod d2/dd/d63/c126 0 2024-04-25T15:57:45.160 INFO:tasks.workunit.client.1.smithi155.stdout:9/689: write dc/d13/fa7 [1193303,3373] 0 2024-04-25T15:57:45.160 INFO:tasks.workunit.client.1.smithi155.stdout:7/859: stat d2/dd/d13/d24/ffd 0 2024-04-25T15:57:45.160 INFO:tasks.workunit.client.1.smithi155.stdout:4/772: dread da/fa1 [0,4194304] 0 2024-04-25T15:57:45.161 INFO:tasks.workunit.client.1.smithi155.stdout:2/897: sync 2024-04-25T15:57:45.162 INFO:tasks.workunit.client.1.smithi155.stdout:9/690: write dc/d13/d2e/f57 [3643373,14010] 0 2024-04-25T15:57:45.162 INFO:tasks.workunit.client.1.smithi155.stdout:4/773: chown da/d23/d3a/ff7 13 1 2024-04-25T15:57:45.163 INFO:tasks.workunit.client.1.smithi155.stdout:4/774: readlink da/l101 0 2024-04-25T15:57:45.165 INFO:tasks.workunit.client.1.smithi155.stdout:9/691: creat dc/d17/dc0/dc9/fe7 x:0 0 0 2024-04-25T15:57:45.167 INFO:tasks.workunit.client.1.smithi155.stdout:4/775: creat da/d23/d3f/dc6/f10f x:0 0 0 2024-04-25T15:57:45.168 INFO:tasks.workunit.client.1.smithi155.stdout:9/692: chown dc/d13/d59/f5d 1296611 1 2024-04-25T15:57:45.170 INFO:tasks.workunit.client.1.smithi155.stdout:5/833: write d0/d3/d15/d1f/d50/fac [810376,33204] 0 2024-04-25T15:57:45.171 INFO:tasks.workunit.client.1.smithi155.stdout:6/934: dread d0/d13/d34/d38/d7a/fd8 [0,4194304] 0 2024-04-25T15:57:45.171 INFO:tasks.workunit.client.1.smithi155.stdout:2/898: dwrite d7/d23/f87 [0,4194304] 0 2024-04-25T15:57:45.177 INFO:tasks.workunit.client.1.smithi155.stdout:5/834: rename d0/d3/d15/d30/ff3 to d0/d58/d63/f110 0 2024-04-25T15:57:45.178 INFO:tasks.workunit.client.1.smithi155.stdout:8/586: dwrite d2/d5/d40/f58 [0,4194304] 0 2024-04-25T15:57:45.181 INFO:tasks.workunit.client.1.smithi155.stdout:4/776: dread da/d23/d3f/d56/d69/d4a/d78/f39 [0,4194304] 0 2024-04-25T15:57:45.181 INFO:tasks.workunit.client.1.smithi155.stdout:2/899: mkdir d7/db/dd/d15/d124 0 2024-04-25T15:57:45.183 INFO:tasks.workunit.client.1.smithi155.stdout:9/693: dread dc/d11/d30/dd2/fd9 [0,4194304] 0 2024-04-25T15:57:45.185 INFO:tasks.workunit.client.1.smithi155.stdout:5/835: mkdir d0/d3/d2c/d94/d111 0 2024-04-25T15:57:45.186 INFO:tasks.workunit.client.1.smithi155.stdout:8/587: creat d2/d15/d18/d23/d2d/fba x:0 0 0 2024-04-25T15:57:45.187 INFO:tasks.workunit.client.1.smithi155.stdout:8/588: rename d2 to d2/d41/d5d/dbb 22 2024-04-25T15:57:45.189 INFO:tasks.workunit.client.1.smithi155.stdout:5/836: creat d0/d47/de4/f112 x:0 0 0 2024-04-25T15:57:45.189 INFO:tasks.workunit.client.1.smithi155.stdout:4/777: getdents da/d23/d3f/d56/d69/d4a/de0 0 2024-04-25T15:57:45.191 INFO:tasks.workunit.client.1.smithi155.stdout:8/589: write d2/d15/d35/d3d/fac [632169,60894] 0 2024-04-25T15:57:45.191 INFO:tasks.workunit.client.1.smithi155.stdout:9/694: creat dc/d13/de5/fe8 x:0 0 0 2024-04-25T15:57:45.192 INFO:tasks.workunit.client.1.smithi155.stdout:2/900: link d7/db/l7e d7/db/d29/d83/dc8/l125 0 2024-04-25T15:57:45.195 INFO:tasks.workunit.client.1.smithi155.stdout:7/860: dwrite d2/d26/d3d/d6d/f5d [0,4194304] 0 2024-04-25T15:57:45.196 INFO:tasks.workunit.client.1.smithi155.stdout:8/590: write d2/d15/d18/d23/d3c/fb5 [70063,23738] 0 2024-04-25T15:57:45.203 INFO:tasks.workunit.client.1.smithi155.stdout:9/695: creat dc/d17/fe9 x:0 0 0 2024-04-25T15:57:45.205 INFO:tasks.workunit.client.1.smithi155.stdout:8/591: rename d2/d5/fa7 to d2/d15/da1/fbc 0 2024-04-25T15:57:45.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 Processor -- start 2024-04-25T15:57:45.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 -- start start 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9501517d0 0x7fe9500c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9500c9ae0 0x7fe9501578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9500c5290 con 0x7fe950157df0 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe9500c5e80 con 0x7fe9501517d0 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe9550ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe950154fd0 con 0x7fe9500c9ae0 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe94f59e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe950157df0 0x7fe95006ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45636/0 (socket says 172.21.15.87:45636) 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe94f59e640 1 -- 172.21.15.87:0/2336052731 learned_addr learned my addr 172.21.15.87:0/2336052731 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe947fff640 1 --2- 172.21.15.87:0/2336052731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9500c9ae0 0x7fe9501578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe94ed9d640 1 --2- 172.21.15.87:0/2336052731 >> v2:172.21.15.155:3300/0 conn(0x7fe9501517d0 0x7fe9500c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:45.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe94e59c640 1 -- 172.21.15.87:0/2336052731 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116594715 0 0) 0x7fe9500c5290 con 0x7fe950157df0 2024-04-25T15:57:45.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe94e59c640 1 -- 172.21.15.87:0/2336052731 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe93c003530 con 0x7fe950157df0 2024-04-25T15:57:45.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe947fff640 1 -- 172.21.15.87:0/2336052731 >> v2:172.21.15.155:3300/0 conn(0x7fe9501517d0 msgr2=0x7fe9500c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:45.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe947fff640 1 --2- 172.21.15.87:0/2336052731 >> v2:172.21.15.155:3300/0 conn(0x7fe9501517d0 0x7fe9500c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe947fff640 1 -- 172.21.15.87:0/2336052731 >> v1:172.21.15.87:6789/0 conn(0x7fe950157df0 legacy=0x7fe95006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:45.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe947fff640 1 -- 172.21.15.87:0/2336052731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9500c5550 con 0x7fe9500c9ae0 2024-04-25T15:57:45.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.203+0000 7fe94ed9d640 1 --2- 172.21.15.87:0/2336052731 >> v2:172.21.15.155:3300/0 conn(0x7fe9501517d0 0x7fe9500c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:57:45.209 INFO:tasks.workunit.client.1.smithi155.stdout:5/837: dwrite d0/d3/d15/d1f/d50/fac [0,4194304] 0 2024-04-25T15:57:45.210 INFO:tasks.workunit.client.1.smithi155.stdout:4/778: write da/d23/d3f/d56/f7c [667041,96847] 0 2024-04-25T15:57:45.210 INFO:tasks.workunit.client.1.smithi155.stdout:7/861: dread d2/dd/f23 [0,4194304] 0 2024-04-25T15:57:45.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe947fff640 1 --2- 172.21.15.87:0/2336052731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9500c9ae0 0x7fe9501578b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097c0 tx=0x7fe93801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1980e4e45464fd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:45.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe94e59c640 1 -- 172.21.15.87:0/2336052731 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9380b0070 con 0x7fe9500c9ae0 2024-04-25T15:57:45.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe94e59c640 1 -- 172.21.15.87:0/2336052731 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9380ab600 con 0x7fe9500c9ae0 2024-04-25T15:57:45.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe94e59c640 1 -- 172.21.15.87:0/2336052731 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9380ab9d0 con 0x7fe9500c9ae0 2024-04-25T15:57:45.211 INFO:tasks.workunit.client.1.smithi155.stdout:8/592: dread - d2/d15/da1/fbc zero size 2024-04-25T15:57:45.211 INFO:tasks.workunit.client.1.smithi155.stdout:2/901: dwrite d7/d23/f117 [0,4194304] 0 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 -- 172.21.15.87:0/2336052731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9500c9ae0 msgr2=0x7fe9501578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2336052731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9500c9ae0 0x7fe9501578b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097c0 tx=0x7fe93801c4a0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 -- 172.21.15.87:0/2336052731 shutdown_connections 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2336052731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9500c9ae0 0x7fe9501578b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2336052731 >> v2:172.21.15.155:3300/0 conn(0x7fe9501517d0 0x7fe9500c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 -- 172.21.15.87:0/2336052731 >> 172.21.15.87:0/2336052731 conn(0x7fe95006d780 msgr2=0x7fe95006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:45.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 -- 172.21.15.87:0/2336052731 shutdown_connections 2024-04-25T15:57:45.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.207+0000 7fe9550ab640 1 -- 172.21.15.87:0/2336052731 wait complete. 2024-04-25T15:57:45.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 Processor -- start 2024-04-25T15:57:45.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 -- start start 2024-04-25T15:57:45.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9500c9ae0 0x7fe9501536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9501517d0 0x7fe9501f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 0x7fe9500c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500a90f0 con 0x7fe950157df0 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9500a8f70 con 0x7fe9500c9ae0 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe95006c670 con 0x7fe9501517d0 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 0x7fe9500c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 0x7fe9500c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39812/0 (socket says 172.21.15.87:39812) 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 -- 172.21.15.87:0/2889915073 learned_addr learned my addr 172.21.15.87:0/2889915073 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 -- 172.21.15.87:0/2889915073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9501517d0 msgr2=0x7fe9501f12a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9501517d0 0x7fe9501f12a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 -- 172.21.15.87:0/2889915073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9500c9ae0 msgr2=0x7fe9501536e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T15:57:45.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9500c9ae0 0x7fe9501536e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 -- 172.21.15.87:0/2889915073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9500a9ee0 con 0x7fe950157df0 2024-04-25T15:57:45.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe94f59e640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 0x7fe9500c7440 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe94800ca20 tx=0x7fe94800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:45.217 INFO:tasks.workunit.client.1.smithi155.stdout:7/862: write d2/d26/d3d/d65/f9f [9142085,84275] 0 2024-04-25T15:57:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948017070 con 0x7fe950157df0 2024-04-25T15:57:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94800abf0 con 0x7fe950157df0 2024-04-25T15:57:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9501f0ae0 con 0x7fe950157df0 2024-04-25T15:57:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948012400 con 0x7fe950157df0 2024-04-25T15:57:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.211+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9501f0d80 con 0x7fe950157df0 2024-04-25T15:57:45.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.215+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe950069bb0 con 0x7fe950157df0 2024-04-25T15:57:45.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.215+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe94801a070 con 0x7fe950157df0 2024-04-25T15:57:45.219 INFO:tasks.workunit.client.1.smithi155.stdout:4/779: fsync da/d23/d3f/d56/d69/d83/fcf 0 2024-04-25T15:57:45.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.215+0000 7fe9477fe640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe93006f400 0x7fe930071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:45.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.215+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7fe94808f5b0 con 0x7fe950157df0 2024-04-25T15:57:45.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.215+0000 7fe94ed9d640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe93006f400 0x7fe930071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:45.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.215+0000 7fe94ed9d640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe93006f400 0x7fe930071910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe9500c3c00 tx=0x7fe940009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:45.223 INFO:tasks.workunit.client.1.smithi155.stdout:7/863: read - d2/dd/d13/d1c/ffb zero size 2024-04-25T15:57:45.224 INFO:tasks.workunit.client.1.smithi155.stdout:4/780: fdatasync da/d87/f9d 0 2024-04-25T15:57:45.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.223+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe94805bea0 con 0x7fe950157df0 2024-04-25T15:57:45.229 INFO:tasks.workunit.client.1.smithi155.stdout:9/696: dwrite dc/d13/d2e/f4a [0,4194304] 0 2024-04-25T15:57:45.230 INFO:tasks.workunit.client.1.smithi155.stdout:6/935: dwrite d0/d1a/d25/d2e/f67 [0,4194304] 0 2024-04-25T15:57:45.232 INFO:tasks.workunit.client.1.smithi155.stdout:5/838: dwrite d0/d3/d15/d30/ff2 [0,4194304] 0 2024-04-25T15:57:45.232 INFO:tasks.workunit.client.1.smithi155.stdout:8/593: dread d2/fa [0,4194304] 0 2024-04-25T15:57:45.233 INFO:tasks.workunit.client.1.smithi155.stdout:2/902: link d7/db/dd/l6a d7/l126 0 2024-04-25T15:57:45.234 INFO:tasks.workunit.client.1.smithi155.stdout:7/864: truncate d2/dd/d13/d1c/f40 4990206 0 2024-04-25T15:57:45.236 INFO:tasks.workunit.client.1.smithi155.stdout:6/936: truncate d0/d13/d6f/dae/f11c 211016 0 2024-04-25T15:57:45.236 INFO:tasks.workunit.client.1.smithi155.stdout:2/903: symlink d7/db/d2e/d44/d95/l127 0 2024-04-25T15:57:45.238 INFO:tasks.workunit.client.1.smithi155.stdout:4/781: rename da/d23/d3f/d56/d69/d83/d10c/d77 to da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110 0 2024-04-25T15:57:45.239 INFO:tasks.workunit.client.1.smithi155.stdout:7/865: creat d2/d26/d3d/d65/f127 x:0 0 0 2024-04-25T15:57:45.241 INFO:tasks.workunit.client.1.smithi155.stdout:2/904: creat d7/db/d29/d83/d86/db0/f128 x:0 0 0 2024-04-25T15:57:45.242 INFO:tasks.workunit.client.1.smithi155.stdout:2/905: fdatasync d7/db/d2e/d44/f7f 0 2024-04-25T15:57:45.245 INFO:tasks.workunit.client.1.smithi155.stdout:5/839: rename d0/d27/f69 to d0/d3/d15/d1f/d50/d7c/f113 0 2024-04-25T15:57:45.246 INFO:tasks.workunit.client.1.smithi155.stdout:2/906: fdatasync d7/db/d29/d83/d86/db0/ff5 0 2024-04-25T15:57:45.248 INFO:tasks.workunit.client.1.smithi155.stdout:2/907: write d7/db/d2e/def/ffd [165544,79214] 0 2024-04-25T15:57:45.249 INFO:tasks.workunit.client.1.smithi155.stdout:6/937: dread d0/d18/f48 [0,4194304] 0 2024-04-25T15:57:45.251 INFO:tasks.workunit.client.1.smithi155.stdout:8/594: rename d2/d15/d18/d23/d2d/l3b to d2/d15/d63/lbd 0 2024-04-25T15:57:45.251 INFO:tasks.workunit.client.1.smithi155.stdout:6/938: dread - d0/d13/d34/d38/f10f zero size 2024-04-25T15:57:45.252 INFO:tasks.workunit.client.1.smithi155.stdout:8/595: fsync d2/d15/d18/d95/fb0 0 2024-04-25T15:57:45.252 INFO:tasks.workunit.client.1.smithi155.stdout:5/840: fdatasync d0/d27/f98 0 2024-04-25T15:57:45.256 INFO:tasks.workunit.client.1.smithi155.stdout:2/908: creat d7/db/d2e/d44/d9e/f129 x:0 0 0 2024-04-25T15:57:45.256 INFO:tasks.workunit.client.1.smithi155.stdout:9/697: truncate dc/d17/d8e/dae/dd6/d56/fb3 203938 0 2024-04-25T15:57:45.257 INFO:tasks.workunit.client.1.smithi155.stdout:2/909: dread - d7/db/d29/d83/d86/db0/fd4 zero size 2024-04-25T15:57:45.257 INFO:tasks.workunit.client.1.smithi155.stdout:9/698: read - dc/d17/d2a/fc1 zero size 2024-04-25T15:57:45.259 INFO:tasks.workunit.client.1.smithi155.stdout:8/596: mknod d2/d15/d18/d23/d3c/cbe 0 2024-04-25T15:57:45.260 INFO:tasks.workunit.client.1.smithi155.stdout:8/597: stat d2/d15/d18/c8d 0 2024-04-25T15:57:45.260 INFO:tasks.workunit.client.1.smithi155.stdout:6/939: symlink d0/d1a/l128 0 2024-04-25T15:57:45.260 INFO:tasks.workunit.client.1.smithi155.stdout:1/785: sync 2024-04-25T15:57:45.261 INFO:tasks.workunit.client.1.smithi155.stdout:9/699: symlink dc/d13/d59/lea 0 2024-04-25T15:57:45.262 INFO:tasks.workunit.client.1.smithi155.stdout:6/940: readlink d0/d1a/d45/d61/l98 0 2024-04-25T15:57:45.266 INFO:tasks.workunit.client.1.smithi155.stdout:2/910: creat d7/db/d29/d83/d86/f12a x:0 0 0 2024-04-25T15:57:45.266 INFO:tasks.workunit.client.1.smithi155.stdout:9/700: read dc/d17/d2a/f8f [3656439,116447] 0 2024-04-25T15:57:45.268 INFO:tasks.workunit.client.1.smithi155.stdout:7/866: dwrite d2/dd/d13/d1c/fad [0,4194304] 0 2024-04-25T15:57:45.268 INFO:tasks.workunit.client.1.smithi155.stdout:2/911: readlink d7/db/l53 0 2024-04-25T15:57:45.270 INFO:tasks.workunit.client.1.smithi155.stdout:6/941: write d0/d1a/d25/f121 [11107,48213] 0 2024-04-25T15:57:45.271 INFO:tasks.workunit.client.1.smithi155.stdout:5/841: truncate d0/d3/d15/d30/ff2 2553886 0 2024-04-25T15:57:45.271 INFO:tasks.workunit.client.1.smithi155.stdout:4/782: dwrite da/f16 [0,4194304] 0 2024-04-25T15:57:45.273 INFO:tasks.workunit.client.1.smithi155.stdout:9/701: truncate dc/d17/d8e/dae/dd6/fc2 1134740 0 2024-04-25T15:57:45.278 INFO:tasks.workunit.client.1.smithi155.stdout:8/598: dwrite d2/d15/d18/d34/d48/d7f/fb1 [0,4194304] 0 2024-04-25T15:57:45.282 INFO:tasks.workunit.client.1.smithi155.stdout:4/783: mknod da/d23/d3f/dc6/c111 0 2024-04-25T15:57:45.282 INFO:tasks.workunit.client.1.smithi155.stdout:1/786: write d1/d16/d37/f69 [487014,80821] 0 2024-04-25T15:57:45.283 INFO:tasks.workunit.client.1.smithi155.stdout:2/912: unlink d7/d23/d104/l106 0 2024-04-25T15:57:45.285 INFO:tasks.workunit.client.1.smithi155.stdout:9/702: creat dc/d13/d48/feb x:0 0 0 2024-04-25T15:57:45.285 INFO:tasks.workunit.client.1.smithi155.stdout:6/942: dwrite d0/d18/ddd/fed [0,4194304] 0 2024-04-25T15:57:45.288 INFO:tasks.workunit.client.1.smithi155.stdout:0/775: sync 2024-04-25T15:57:45.288 INFO:tasks.workunit.client.1.smithi155.stdout:3/809: sync 2024-04-25T15:57:45.288 INFO:tasks.workunit.client.1.smithi155.stdout:7/867: dwrite d2/dd/d13/d1c/fca [0,4194304] 0 2024-04-25T15:57:45.291 INFO:tasks.workunit.client.1.smithi155.stdout:4/784: mkdir da/d87/d105/d112 0 2024-04-25T15:57:45.293 INFO:tasks.workunit.client.1.smithi155.stdout:9/703: rmdir dc/d17/d2a 39 2024-04-25T15:57:45.296 INFO:tasks.workunit.client.1.smithi155.stdout:4/785: rmdir da 39 2024-04-25T15:57:45.296 INFO:tasks.workunit.client.1.smithi155.stdout:9/704: chown dc/d74/c87 32 1 2024-04-25T15:57:45.297 INFO:tasks.workunit.client.1.smithi155.stdout:0/776: write d1/d6/fca [1103469,25606] 0 2024-04-25T15:57:45.298 INFO:tasks.workunit.client.1.smithi155.stdout:6/943: creat d0/d1a/d25/d2e/f129 x:0 0 0 2024-04-25T15:57:45.301 INFO:tasks.workunit.client.1.smithi155.stdout:1/787: dwrite d1/d16/d1d/d29/d3d/f9b [0,4194304] 0 2024-04-25T15:57:45.301 INFO:tasks.workunit.client.1.smithi155.stdout:7/868: symlink d2/dd/d13/d24/d35/l128 0 2024-04-25T15:57:45.301 INFO:tasks.workunit.client.1.smithi155.stdout:8/599: dwrite d2/d41/d5d/fb2 [0,4194304] 0 2024-04-25T15:57:45.304 INFO:tasks.workunit.client.1.smithi155.stdout:3/810: unlink d1/d4/d10/d21/d73/la9 0 2024-04-25T15:57:45.306 INFO:tasks.workunit.client.1.smithi155.stdout:8/600: chown d2/d15/d18/d34/f53 198 1 2024-04-25T15:57:45.306 INFO:tasks.workunit.client.1.smithi155.stdout:5/842: dwrite d0/d3/d2c/f2f [0,4194304] 0 2024-04-25T15:57:45.307 INFO:tasks.workunit.client.1.smithi155.stdout:1/788: truncate d1/d6/db4/fea 677954 0 2024-04-25T15:57:45.308 INFO:tasks.workunit.client.1.smithi155.stdout:2/913: creat d7/f12b x:0 0 0 2024-04-25T15:57:45.314 INFO:tasks.workunit.client.1.smithi155.stdout:6/944: dwrite d0/d13/d6f/fe2 [0,4194304] 0 2024-04-25T15:57:45.315 INFO:tasks.workunit.client.1.smithi155.stdout:9/705: rmdir dc/d13/d60/d7a 39 2024-04-25T15:57:45.320 INFO:tasks.workunit.client.1.smithi155.stdout:7/869: symlink d2/dd/d30/d44/d7f/l129 0 2024-04-25T15:57:45.322 INFO:tasks.workunit.client.1.smithi155.stdout:3/811: rename d1/d4/db/d28/d58/de6/cfc to d1/d4/d10/d21/d73/d77/d5f/dee/c117 0 2024-04-25T15:57:45.322 INFO:tasks.workunit.client.1.smithi155.stdout:6/945: chown d0/d1a/l68 727463605 1 2024-04-25T15:57:45.326 INFO:tasks.workunit.client.1.smithi155.stdout:2/914: rename d7/db/d2e/d44/d70/fa3 to d7/db/dd/d15/d124/f12c 0 2024-04-25T15:57:45.329 INFO:tasks.workunit.client.1.smithi155.stdout:8/601: creat d2/fbf x:0 0 0 2024-04-25T15:57:45.330 INFO:tasks.workunit.client.1.smithi155.stdout:0/777: getdents d1/d85/d8c/d9e 0 2024-04-25T15:57:45.332 INFO:tasks.workunit.client.1.smithi155.stdout:5/843: dwrite d0/f105 [0,4194304] 0 2024-04-25T15:57:45.333 INFO:tasks.workunit.client.1.smithi155.stdout:3/812: symlink d1/d4/db/d91/dc9/l118 0 2024-04-25T15:57:45.333 INFO:tasks.workunit.client.1.smithi155.stdout:9/706: dwrite dc/d13/d2e/fb1 [0,4194304] 0 2024-04-25T15:57:45.340 INFO:tasks.workunit.client.1.smithi155.stdout:1/789: getdents d1/d16/d37 0 2024-04-25T15:57:45.340 INFO:tasks.workunit.client.1.smithi155.stdout:4/786: write da/d23/fbc [4879691,61568] 0 2024-04-25T15:57:45.341 INFO:tasks.workunit.client.1.smithi155.stdout:2/915: symlink d7/db/d29/d83/d86/d8b/l12d 0 2024-04-25T15:57:45.342 INFO:tasks.workunit.client.1.smithi155.stdout:8/602: mkdir d2/d15/d63/dc0 0 2024-04-25T15:57:45.344 INFO:tasks.workunit.client.1.smithi155.stdout:6/946: dwrite d0/d1a/da1/f10e [0,4194304] 0 2024-04-25T15:57:45.345 INFO:tasks.workunit.client.1.smithi155.stdout:5/844: symlink d0/d47/l114 0 2024-04-25T15:57:45.345 INFO:tasks.workunit.client.1.smithi155.stdout:4/787: fdatasync da/d23/d3f/d56/d69/d83/d10c/d18/f27 0 2024-04-25T15:57:45.347 INFO:tasks.workunit.client.1.smithi155.stdout:7/870: creat d2/dd/d66/db2/f12a x:0 0 0 2024-04-25T15:57:45.348 INFO:tasks.workunit.client.1.smithi155.stdout:9/707: write dc/d13/fa7 [498724,87342] 0 2024-04-25T15:57:45.350 INFO:tasks.workunit.client.1.smithi155.stdout:2/916: write d7/db/d2e/d90/fe6 [841278,38528] 0 2024-04-25T15:57:45.354 INFO:tasks.workunit.client.1.smithi155.stdout:8/603: creat d2/d15/d63/dc0/fc1 x:0 0 0 2024-04-25T15:57:45.355 INFO:tasks.workunit.client.1.smithi155.stdout:0/778: dwrite d1/d3/d3d/dcb/fce [0,4194304] 0 2024-04-25T15:57:45.355 INFO:tasks.workunit.client.1.smithi155.stdout:4/788: unlink da/d23/d3a/d7b/c106 0 2024-04-25T15:57:45.358 INFO:tasks.workunit.client.1.smithi155.stdout:3/813: dwrite d1/d4/db/d91/dc4/dd9/d86/f9b [0,4194304] 0 2024-04-25T15:57:45.358 INFO:tasks.workunit.client.1.smithi155.stdout:7/871: mkdir d2/d26/d3d/d12b 0 2024-04-25T15:57:45.364 INFO:tasks.workunit.client.1.smithi155.stdout:7/872: dread - d2/dd/d30/d44/d7f/f108 zero size 2024-04-25T15:57:45.367 INFO:tasks.workunit.client.1.smithi155.stdout:4/789: fdatasync da/d23/d3f/d56/d69/d4a/d78/f2e 0 2024-04-25T15:57:45.367 INFO:tasks.workunit.client.1.smithi155.stdout:0/779: symlink d1/d3/d5/d5b/dc4/d60/l102 0 2024-04-25T15:57:45.369 INFO:tasks.workunit.client.1.smithi155.stdout:1/790: creat d1/d16/d1d/d29/d5f/d34/d68/d93/ff7 x:0 0 0 2024-04-25T15:57:45.370 INFO:tasks.workunit.client.1.smithi155.stdout:0/780: chown d1/d85/d8c/d9e/ce3 1051209132 1 2024-04-25T15:57:45.371 INFO:tasks.workunit.client.1.smithi155.stdout:9/708: dwrite dc/d17/d2a/fdc [0,4194304] 0 2024-04-25T15:57:45.372 INFO:tasks.workunit.client.1.smithi155.stdout:4/790: chown da/ce 2 1 2024-04-25T15:57:45.372 INFO:tasks.workunit.client.1.smithi155.stdout:9/709: readlink l2 0 2024-04-25T15:57:45.374 INFO:tasks.workunit.client.1.smithi155.stdout:8/604: getdents d2/d15/d18/d49 0 2024-04-25T15:57:45.376 INFO:tasks.workunit.client.1.smithi155.stdout:1/791: rename d1/d16/d1d/d5e/dd0 to d1/d16/d37/df8 0 2024-04-25T15:57:45.376 INFO:tasks.workunit.client.1.smithi155.stdout:3/814: dread d1/d4/d10/d21/d73/d77/d5f/f7e [0,4194304] 0 2024-04-25T15:57:45.379 INFO:tasks.workunit.client.1.smithi155.stdout:7/873: truncate d2/dd/d12/d76/f106 2835042 0 2024-04-25T15:57:45.382 INFO:tasks.workunit.client.1.smithi155.stdout:0/781: dwrite d1/d3/d5/d5b/dc4/f88 [0,4194304] 0 2024-04-25T15:57:45.382 INFO:tasks.workunit.client.1.smithi155.stdout:6/947: dread d0/d1a/f1c [4194304,4194304] 0 2024-04-25T15:57:45.384 INFO:tasks.workunit.client.1.smithi155.stdout:8/605: creat d2/d15/d18/d23/d2d/fc2 x:0 0 0 2024-04-25T15:57:45.385 INFO:tasks.workunit.client.1.smithi155.stdout:6/948: fsync d0/d13/d6f/dae/f11c 0 2024-04-25T15:57:45.387 INFO:tasks.workunit.client.1.smithi155.stdout:3/815: mkdir d1/d4/d10/d21/d73/d77/d57/d80/d119 0 2024-04-25T15:57:45.389 INFO:tasks.workunit.client.1.smithi155.stdout:4/791: fdatasync da/d23/d3f/d56/d69/d4a/d78/d62/f68 0 2024-04-25T15:57:45.391 INFO:tasks.workunit.client.1.smithi155.stdout:0/782: dread d1/d41/df4/f3a [0,4194304] 0 2024-04-25T15:57:45.392 INFO:tasks.workunit.client.1.smithi155.stdout:9/710: rename dc/d11/f27 to dc/d11/d30/dd2/fec 0 2024-04-25T15:57:45.392 INFO:tasks.workunit.client.1.smithi155.stdout:2/917: write d7/db/dd/f72 [254228,34734] 0 2024-04-25T15:57:45.393 INFO:tasks.workunit.client.1.smithi155.stdout:9/711: fsync dc/d17/f2b 0 2024-04-25T15:57:45.394 INFO:tasks.workunit.client.1.smithi155.stdout:2/918: readlink d7/l43 0 2024-04-25T15:57:45.394 INFO:tasks.workunit.client.1.smithi155.stdout:6/949: symlink d0/d13/d7c/dd7/l12a 0 2024-04-25T15:57:45.395 INFO:tasks.workunit.client.1.smithi155.stdout:0/783: fsync d1/d3/d5/d5b/dc4/f8d 0 2024-04-25T15:57:45.397 INFO:tasks.workunit.client.1.smithi155.stdout:3/816: unlink d1/d4/d10/d21/d73/fe1 0 2024-04-25T15:57:45.397 INFO:tasks.workunit.client.1.smithi155.stdout:0/784: stat d1/d3/c57 0 2024-04-25T15:57:45.397 INFO:tasks.workunit.client.1.smithi155.stdout:1/792: dwrite d1/fb [0,4194304] 0 2024-04-25T15:57:45.399 INFO:tasks.workunit.client.1.smithi155.stdout:9/712: write dc/d11/d30/d46/da0/fa5 [1695860,88877] 0 2024-04-25T15:57:45.399 INFO:tasks.workunit.client.1.smithi155.stdout:4/792: unlink da/d30/fe1 0 2024-04-25T15:57:45.400 INFO:tasks.workunit.client.1.smithi155.stdout:3/817: stat d1/d4/d10/d21/d73/d77/de9/lef 0 2024-04-25T15:57:45.403 INFO:tasks.workunit.client.1.smithi155.stdout:6/950: creat d0/d13/d34/d6c/d9d/f12b x:0 0 0 2024-04-25T15:57:45.404 INFO:tasks.workunit.client.1.smithi155.stdout:8/606: dread d2/f60 [0,4194304] 0 2024-04-25T15:57:45.410 INFO:tasks.workunit.client.1.smithi155.stdout:2/919: symlink d7/db/d29/d83/dbe/d101/l12e 0 2024-04-25T15:57:45.415 INFO:tasks.workunit.client.1.smithi155.stdout:9/713: creat dc/d13/d59/fed x:0 0 0 2024-04-25T15:57:45.415 INFO:tasks.workunit.client.1.smithi155.stdout:9/714: readlink dc/d13/d59/lea 0 2024-04-25T15:57:45.416 INFO:tasks.workunit.client.1.smithi155.stdout:3/818: mkdir d1/d4/d10/d21/d73/d77/d5f/db3/d11a 0 2024-04-25T15:57:45.424 INFO:tasks.workunit.client.1.smithi155.stdout:2/920: write d7/d8e/db9/f114 [2236417,49928] 0 2024-04-25T15:57:45.424 INFO:tasks.workunit.client.1.smithi155.stdout:1/793: symlink d1/d16/df6/lf9 0 2024-04-25T15:57:45.424 INFO:tasks.workunit.client.1.smithi155.stdout:8/607: dread d2/d15/d18/d23/d3c/f4b [0,4194304] 0 2024-04-25T15:57:45.427 INFO:tasks.workunit.client.1.smithi155.stdout:9/715: fsync dc/d17/d8e/dae/dd6/f9e 0 2024-04-25T15:57:45.428 INFO:tasks.workunit.client.1.smithi155.stdout:3/819: mkdir d1/d4/db/d20/d44/d52/d61/d11b 0 2024-04-25T15:57:45.429 INFO:tasks.workunit.client.1.smithi155.stdout:6/951: mknod d0/d1a/da1/dac/d10d/c12c 0 2024-04-25T15:57:45.429 INFO:tasks.workunit.client.1.smithi155.stdout:6/952: fsync d0/d13/d6f/f114 0 2024-04-25T15:57:45.431 INFO:tasks.workunit.client.1.smithi155.stdout:8/608: unlink d2/c3f 0 2024-04-25T15:57:45.433 INFO:tasks.workunit.client.1.smithi155.stdout:9/716: mkdir dc/d13/d59/dee 0 2024-04-25T15:57:45.434 INFO:tasks.workunit.client.1.smithi155.stdout:3/820: mkdir d1/d4/db/d91/dc9/d11c 0 2024-04-25T15:57:45.435 INFO:tasks.workunit.client.1.smithi155.stdout:0/785: getdents d1/d3f 0 2024-04-25T15:57:45.440 INFO:tasks.workunit.client.1.smithi155.stdout:8/609: dwrite d2/d15/d18/d34/d48/d4e/f90 [0,4194304] 0 2024-04-25T15:57:45.441 INFO:tasks.workunit.client.1.smithi155.stdout:9/717: unlink dc/d11/d30/dd2/fec 0 2024-04-25T15:57:45.442 INFO:tasks.workunit.client.1.smithi155.stdout:8/610: write d2/d15/d18/d23/d2d/f39 [989963,13650] 0 2024-04-25T15:57:45.443 INFO:tasks.workunit.client.1.smithi155.stdout:2/921: getdents d7/db/d2e/d90/ddd 0 2024-04-25T15:57:45.444 INFO:tasks.workunit.client.1.smithi155.stdout:3/821: creat d1/d4/db/d28/d58/d113/f11d x:0 0 0 2024-04-25T15:57:45.445 INFO:tasks.workunit.client.1.smithi155.stdout:9/718: rename dc/d13/d2e/d4c/f61 to dc/d13/d2e/d4c/fef 0 2024-04-25T15:57:45.446 INFO:tasks.workunit.client.1.smithi155.stdout:4/793: truncate da/f11 7308159 0 2024-04-25T15:57:45.447 INFO:tasks.workunit.client.1.smithi155.stdout:9/719: truncate dc/d17/f51 4670227 0 2024-04-25T15:57:45.448 INFO:tasks.workunit.client.1.smithi155.stdout:6/953: dread d0/d1a/d21/f47 [0,4194304] 0 2024-04-25T15:57:45.468 INFO:tasks.workunit.client.1.smithi155.stdout:2/922: unlink d7/db/d2e/def/cfa 0 2024-04-25T15:57:45.469 INFO:tasks.workunit.client.1.smithi155.stdout:3/822: mkdir d1/d4/db/d91/dc4/d10b/d11e 0 2024-04-25T15:57:45.472 INFO:tasks.workunit.client.1.smithi155.stdout:9/720: unlink dc/d17/d8e/dae/dd6/la8 0 2024-04-25T15:57:45.474 INFO:tasks.workunit.client.1.smithi155.stdout:6/954: creat d0/d18/d112/f12d x:0 0 0 2024-04-25T15:57:45.474 INFO:tasks.workunit.client.1.smithi155.stdout:2/923: fdatasync d7/db/d2e/d44/f6b 0 2024-04-25T15:57:45.475 INFO:tasks.workunit.client.1.smithi155.stdout:9/721: write dc/d13/fa7 [950792,115932] 0 2024-04-25T15:57:45.478 INFO:tasks.workunit.client.1.smithi155.stdout:1/794: dwrite d1/d16/d1d/d29/d5f/f5d [0,4194304] 0 2024-04-25T15:57:45.479 INFO:tasks.workunit.client.1.smithi155.stdout:4/794: rename da/d23/d3f/d56/d69/d4a/ff3 to da/d23/f113 0 2024-04-25T15:57:45.479 INFO:tasks.workunit.client.1.smithi155.stdout:9/722: dread - dc/d13/d60/fc7 zero size 2024-04-25T15:57:45.481 INFO:tasks.workunit.client.1.smithi155.stdout:4/795: readlink da/l101 0 2024-04-25T15:57:45.482 INFO:tasks.workunit.client.1.smithi155.stdout:3/823: dwrite d1/d4/d10/d21/d73/d77/d5f/db3/f106 [0,4194304] 0 2024-04-25T15:57:45.485 INFO:tasks.workunit.client.1.smithi155.stdout:4/796: chown da/d23/d3f/d56/d69/d83/d10c/f1d 105740380 1 2024-04-25T15:57:45.486 INFO:tasks.workunit.client.1.smithi155.stdout:2/924: mknod d7/db/d2e/d90/ddd/c12f 0 2024-04-25T15:57:45.487 INFO:tasks.workunit.client.1.smithi155.stdout:9/723: rmdir dc/d74 39 2024-04-25T15:57:45.487 INFO:tasks.workunit.client.1.smithi155.stdout:4/797: write da/d23/d3f/dc6/de2/fea [29304,70317] 0 2024-04-25T15:57:45.488 INFO:tasks.workunit.client.1.smithi155.stdout:6/955: dwrite d0/d1a/d25/fc2 [0,4194304] 0 2024-04-25T15:57:45.491 INFO:tasks.workunit.client.1.smithi155.stdout:3/824: symlink d1/d4/d10/d21/dab/l11f 0 2024-04-25T15:57:45.491 INFO:tasks.workunit.client.1.smithi155.stdout:4/798: dread da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fdf [0,4194304] 0 2024-04-25T15:57:45.492 INFO:tasks.workunit.client.1.smithi155.stdout:8/611: truncate d2/f33 281660 0 2024-04-25T15:57:45.494 INFO:tasks.workunit.client.1.smithi155.stdout:2/925: rmdir d7/db/d2e/d44/d95 39 2024-04-25T15:57:45.494 INFO:tasks.workunit.client.1.smithi155.stdout:9/724: creat dc/d11/d67/ff0 x:0 0 0 2024-04-25T15:57:45.499 INFO:tasks.workunit.client.1.smithi155.stdout:6/956: mkdir d0/d13/d6f/d12e 0 2024-04-25T15:57:45.502 INFO:tasks.workunit.client.1.smithi155.stdout:3/825: symlink d1/d4/db/d20/d44/d52/d93/l120 0 2024-04-25T15:57:45.504 INFO:tasks.workunit.client.1.smithi155.stdout:9/725: dwrite dc/d13/d59/fed [0,4194304] 0 2024-04-25T15:57:45.504 INFO:tasks.workunit.client.1.smithi155.stdout:6/957: unlink d0/d1a/c50 0 2024-04-25T15:57:45.505 INFO:tasks.workunit.client.1.smithi155.stdout:8/612: creat d2/d15/d35/fc3 x:0 0 0 2024-04-25T15:57:45.506 INFO:tasks.workunit.client.1.smithi155.stdout:6/958: fdatasync d0/d1a/d21/d73/f5a 0 2024-04-25T15:57:45.508 INFO:tasks.workunit.client.1.smithi155.stdout:4/799: creat da/d23/d3f/d56/d69/f114 x:0 0 0 2024-04-25T15:57:45.509 INFO:tasks.workunit.client.1.smithi155.stdout:9/726: unlink dc/d17/d8e/ca4 0 2024-04-25T15:57:45.511 INFO:tasks.workunit.client.1.smithi155.stdout:4/800: truncate f7 5113633 0 2024-04-25T15:57:45.512 INFO:tasks.workunit.client.1.smithi155.stdout:6/959: write d0/d1a/d37/f3e [4487682,7902] 0 2024-04-25T15:57:45.513 INFO:tasks.workunit.client.1.smithi155.stdout:1/795: truncate d1/f61 2063269 0 2024-04-25T15:57:45.514 INFO:tasks.workunit.client.1.smithi155.stdout:9/727: creat dc/d17/d2a/ff1 x:0 0 0 2024-04-25T15:57:45.517 INFO:tasks.workunit.client.1.smithi155.stdout:2/926: dread d7/f49 [0,4194304] 0 2024-04-25T15:57:45.517 INFO:tasks.workunit.client.1.smithi155.stdout:5/845: sync 2024-04-25T15:57:45.517 INFO:tasks.workunit.client.1.smithi155.stdout:1/796: write d1/d16/d1d/d33/f4f [1695735,95001] 0 2024-04-25T15:57:45.517 INFO:tasks.workunit.client.1.smithi155.stdout:6/960: rmdir d0/d1a/d25/d2e 39 2024-04-25T15:57:45.519 INFO:tasks.workunit.client.1.smithi155.stdout:8/613: dwrite d2/d15/d18/d34/d48/d7f/fb1 [0,4194304] 0 2024-04-25T15:57:45.520 INFO:tasks.workunit.client.1.smithi155.stdout:6/961: readlink d0/d18/l2a 0 2024-04-25T15:57:45.521 INFO:tasks.workunit.client.1.smithi155.stdout:2/927: chown d7/db/d2e/d44/d70/d7b/d9f/fa6 6 1 2024-04-25T15:57:45.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.519+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9500c4910 con 0x7fe950157df0 2024-04-25T15:57:45.526 INFO:tasks.workunit.client.1.smithi155.stdout:5/846: unlink d0/d3/d15/d1f/d50/f107 0 2024-04-25T15:57:45.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.523+0000 7fe9477fe640 1 -- 172.21.15.87:0/2889915073 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7fe94805b7a0 con 0x7fe950157df0 2024-04-25T15:57:45.527 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:45.527 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:45.527 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:45.527 INFO:tasks.workunit.client.1.smithi155.stdout:1/797: dwrite d1/d6/db4/fea [0,4194304] 0 2024-04-25T15:57:45.528 INFO:tasks.workunit.client.1.smithi155.stdout:8/614: unlink d2/d5/f9b 0 2024-04-25T15:57:45.529 INFO:tasks.workunit.client.1.smithi155.stdout:6/962: mknod d0/d13/d34/d6c/c12f 0 2024-04-25T15:57:45.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe93006f400 msgr2=0x7fe930071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:45.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe93006f400 0x7fe930071910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe9500c3c00 tx=0x7fe940009190 comp rx=0 tx=0).stop 2024-04-25T15:57:45.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 msgr2=0x7fe9500c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:45.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 0x7fe9500c7440 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe94800ca20 tx=0x7fe94800cee0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 shutdown_connections 2024-04-25T15:57:45.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe93006f400 0x7fe930071910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe950157df0 0x7fe9500c7440 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9501517d0 0x7fe9501f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 --2- 172.21.15.87:0/2889915073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9500c9ae0 0x7fe9501536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:45.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 >> 172.21.15.87:0/2889915073 conn(0x7fe95006d780 msgr2=0x7fe9501541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:45.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 shutdown_connections 2024-04-25T15:57:45.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:45.527+0000 7fe9550ab640 1 -- 172.21.15.87:0/2889915073 wait complete. 2024-04-25T15:57:45.533 INFO:tasks.workunit.client.1.smithi155.stdout:5/847: creat d0/d58/d9b/f115 x:0 0 0 2024-04-25T15:57:45.534 INFO:tasks.workunit.client.1.smithi155.stdout:5/848: chown d0/d47/fa4 288 1 2024-04-25T15:57:45.536 INFO:tasks.workunit.client.1.smithi155.stdout:8/615: rename d2/d15/d35/d3d/d6c/l92 to d2/d15/d18/d23/d2d/lc4 0 2024-04-25T15:57:45.538 INFO:tasks.workunit.client.1.smithi155.stdout:6/963: mkdir d0/d13/d6f/d12e/d130 0 2024-04-25T15:57:45.538 INFO:tasks.workunit.client.1.smithi155.stdout:5/849: symlink d0/d3/d15/d1f/d50/d7c/l116 0 2024-04-25T15:57:45.539 INFO:tasks.workunit.client.1.smithi155.stdout:6/964: dread - d0/d1a/d37/dda/dfe/f124 zero size 2024-04-25T15:57:45.540 INFO:tasks.workunit.client.1.smithi155.stdout:8/616: symlink d2/d15/d18/d34/d48/d7f/lc5 0 2024-04-25T15:57:45.559 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:45.610 INFO:tasks.workunit.client.1.smithi155.stdout:1/798: dread d1/d16/d1d/d29/d3d/d43/d88/f94 [0,4194304] 0 2024-04-25T15:57:45.613 INFO:tasks.workunit.client.1.smithi155.stdout:4/801: dread da/f11 [4194304,4194304] 0 2024-04-25T15:57:45.614 INFO:tasks.workunit.client.1.smithi155.stdout:6/965: creat d0/d18/f131 x:0 0 0 2024-04-25T15:57:45.618 INFO:tasks.workunit.client.1.smithi155.stdout:1/799: symlink d1/d16/df6/lfa 0 2024-04-25T15:57:45.620 INFO:tasks.workunit.client.1.smithi155.stdout:6/966: creat d0/d13/d6f/d12e/f132 x:0 0 0 2024-04-25T15:57:45.629 INFO:tasks.workunit.client.1.smithi155.stdout:5/850: dwrite d0/d47/de4/ff8 [0,4194304] 0 2024-04-25T15:57:45.630 INFO:tasks.workunit.client.1.smithi155.stdout:4/802: dread da/d23/d3f/d56/d69/d4a/d78/d62/f7e [0,4194304] 0 2024-04-25T15:57:45.633 INFO:tasks.workunit.client.1.smithi155.stdout:6/967: read d0/d13/d34/d38/f88 [4054866,54826] 0 2024-04-25T15:57:45.634 INFO:tasks.workunit.client.1.smithi155.stdout:5/851: stat d0/d47/de4 0 2024-04-25T15:57:45.639 INFO:tasks.workunit.client.1.smithi155.stdout:7/874: sync 2024-04-25T15:57:45.639 INFO:tasks.workunit.client.1.smithi155.stdout:4/803: write da/d23/da2/fb8 [336856,52730] 0 2024-04-25T15:57:45.642 INFO:tasks.workunit.client.1.smithi155.stdout:8/617: dwrite d2/d15/d18/d23/d3c/fb5 [0,4194304] 0 2024-04-25T15:57:45.643 INFO:tasks.workunit.client.1.smithi155.stdout:5/852: chown d0/d3/d2c/d94/lb1 46027 1 2024-04-25T15:57:45.644 INFO:tasks.workunit.client.1.smithi155.stdout:1/800: getdents d1/d16/d1d/d33/da1/de6 0 2024-04-25T15:57:45.646 INFO:tasks.workunit.client.1.smithi155.stdout:8/618: chown d2/f11 91455 1 2024-04-25T15:57:45.649 INFO:tasks.workunit.client.1.smithi155.stdout:5/853: chown d0/d3/d15/d9f/dc3/lfa 1309599 1 2024-04-25T15:57:45.650 INFO:tasks.workunit.client.1.smithi155.stdout:4/804: creat da/d23/d3f/d56/d69/d4a/de0/f115 x:0 0 0 2024-04-25T15:57:45.656 INFO:tasks.workunit.client.1.smithi155.stdout:5/854: creat d0/d58/d32/f117 x:0 0 0 2024-04-25T15:57:45.658 INFO:tasks.workunit.client.1.smithi155.stdout:1/801: truncate d1/d16/d37/f74 968404 0 2024-04-25T15:57:45.660 INFO:tasks.workunit.client.1.smithi155.stdout:5/855: write d0/d47/d59/fc5 [786232,28824] 0 2024-04-25T15:57:45.663 INFO:tasks.workunit.client.1.smithi155.stdout:4/805: creat da/d23/d3f/d56/d69/d4a/d78/d62/f116 x:0 0 0 2024-04-25T15:57:45.667 INFO:tasks.workunit.client.1.smithi155.stdout:5/856: creat d0/d47/d59/f118 x:0 0 0 2024-04-25T15:57:45.668 INFO:tasks.workunit.client.1.smithi155.stdout:1/802: rename d1/d16/d1d/d33/lcd to d1/d32/lfb 0 2024-04-25T15:57:45.670 INFO:tasks.workunit.client.1.smithi155.stdout:4/806: mkdir da/d117 0 2024-04-25T15:57:45.670 INFO:tasks.workunit.client.1.smithi155.stdout:8/619: dwrite d2/d15/d18/d34/d48/d7f/fb1 [0,4194304] 0 2024-04-25T15:57:45.676 INFO:tasks.workunit.client.1.smithi155.stdout:7/875: dwrite d2/d26/d3d/d65/f101 [0,4194304] 0 2024-04-25T15:57:45.676 INFO:tasks.workunit.client.1.smithi155.stdout:4/807: creat da/d23/d3f/dc6/f118 x:0 0 0 2024-04-25T15:57:45.678 INFO:tasks.workunit.client.1.smithi155.stdout:4/808: fdatasync da/d30/f85 0 2024-04-25T15:57:45.678 INFO:tasks.workunit.client.1.smithi155.stdout:7/876: stat d2/dd/d12/df3 0 2024-04-25T15:57:45.681 INFO:tasks.workunit.client.1.smithi155.stdout:1/803: mkdir d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/dfc 0 2024-04-25T15:57:45.682 INFO:tasks.workunit.client.1.smithi155.stdout:7/877: chown d2/dd/d13/d24/d35/l5c 274 1 2024-04-25T15:57:45.686 INFO:tasks.workunit.client.1.smithi155.stdout:7/878: fsync d2/dd/d12/f5e 0 2024-04-25T15:57:45.686 INFO:tasks.workunit.client.1.smithi155.stdout:4/809: symlink da/d23/d3f/d56/d69/d83/d10c/d18/d6e/l119 0 2024-04-25T15:57:45.690 INFO:tasks.workunit.client.1.smithi155.stdout:1/804: unlink d1/d16/d1d/d29/d5f/d34/d68/d93/da4/cb6 0 2024-04-25T15:57:45.691 INFO:tasks.workunit.client.1.smithi155.stdout:8/620: dwrite d2/d15/d18/d34/d48/d4e/d81/fb4 [0,4194304] 0 2024-04-25T15:57:45.693 INFO:tasks.workunit.client.1.smithi155.stdout:7/879: mknod d2/dd/d13/d24/d8b/c12c 0 2024-04-25T15:57:45.694 INFO:tasks.workunit.client.1.smithi155.stdout:4/810: creat da/d23/d3f/d56/d69/d4a/d78/f11a x:0 0 0 2024-04-25T15:57:45.695 INFO:tasks.workunit.client.1.smithi155.stdout:4/811: fsync da/d23/fb0 0 2024-04-25T15:57:45.695 INFO:tasks.workunit.client.1.smithi155.stdout:7/880: dread - d2/dd/d36/d46/faf zero size 2024-04-25T15:57:45.698 INFO:tasks.workunit.client.1.smithi155.stdout:7/881: stat d2/dd/d30/fcb 0 2024-04-25T15:57:45.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/812: symlink da/d23/d3f/l11b 0 2024-04-25T15:57:45.704 INFO:tasks.workunit.client.1.smithi155.stdout:7/882: dread d2/dd/d13/d1c/f59 [0,4194304] 0 2024-04-25T15:57:45.706 INFO:tasks.workunit.client.1.smithi155.stdout:1/805: dwrite d1/f11 [4194304,4194304] 0 2024-04-25T15:57:45.709 INFO:tasks.workunit.client.1.smithi155.stdout:7/883: symlink d2/dd/d63/l12d 0 2024-04-25T15:57:45.710 INFO:tasks.workunit.client.1.smithi155.stdout:8/621: write d2/d5/f67 [64009,78828] 0 2024-04-25T15:57:45.711 INFO:tasks.workunit.client.1.smithi155.stdout:1/806: mkdir d1/d16/d1d/d29/d3d/dfd 0 2024-04-25T15:57:45.714 INFO:tasks.workunit.client.1.smithi155.stdout:7/884: mknod d2/dd/d30/dbc/c12e 0 2024-04-25T15:57:45.715 INFO:tasks.workunit.client.1.smithi155.stdout:8/622: mkdir d2/d15/d18/d23/d3c/dc6 0 2024-04-25T15:57:45.716 INFO:tasks.workunit.client.1.smithi155.stdout:1/807: unlink d1/d16/d1d/d29/d5f/d34/f47 0 2024-04-25T15:57:45.720 INFO:tasks.workunit.client.1.smithi155.stdout:7/885: dread d2/dd/d13/d1c/f40 [4194304,4194304] 0 2024-04-25T15:57:45.720 INFO:tasks.workunit.client.1.smithi155.stdout:8/623: symlink d2/d41/lc7 0 2024-04-25T15:57:45.720 INFO:tasks.workunit.client.1.smithi155.stdout:1/808: stat d1/d16/l71 0 2024-04-25T15:57:45.721 INFO:tasks.workunit.client.1.smithi155.stdout:4/813: dwrite da/d23/d3a/ff7 [4194304,4194304] 0 2024-04-25T15:57:45.723 INFO:tasks.workunit.client.1.smithi155.stdout:7/886: chown d2/d26/f112 691748300 1 2024-04-25T15:57:45.725 INFO:tasks.workunit.client.1.smithi155.stdout:1/809: creat d1/d6/db4/ffe x:0 0 0 2024-04-25T15:57:45.726 INFO:tasks.workunit.client.1.smithi155.stdout:0/786: sync 2024-04-25T15:57:45.726 INFO:tasks.workunit.client.1.smithi155.stdout:7/887: read d2/dd/fc4 [138811,2149] 0 2024-04-25T15:57:45.727 INFO:tasks.workunit.client.1.smithi155.stdout:7/888: stat d2/dd/d12/f78 0 2024-04-25T15:57:45.727 INFO:tasks.workunit.client.1.smithi155.stdout:4/814: chown da/d23/d3f/d56/d69/d4a/d78/d62/l82 7386023 1 2024-04-25T15:57:45.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/624: unlink d2/d15/d18/d23/d2d/lc4 0 2024-04-25T15:57:45.734 INFO:tasks.workunit.client.1.smithi155.stdout:0/787: mknod d1/d3/d6a/dfb/c103 0 2024-04-25T15:57:45.735 INFO:tasks.workunit.client.1.smithi155.stdout:0/788: stat d1/d41/df4/d47/fe2 0 2024-04-25T15:57:45.737 INFO:tasks.workunit.client.1.smithi155.stdout:1/810: mknod d1/d16/d1d/d29/d5f/db8/cff 0 2024-04-25T15:57:45.747 INFO:tasks.workunit.client.1.smithi155.stdout:8/625: dread d2/f14 [0,4194304] 0 2024-04-25T15:57:45.748 INFO:tasks.workunit.client.1.smithi155.stdout:0/789: mkdir d1/d3/d12/d92/d104 0 2024-04-25T15:57:45.750 INFO:tasks.workunit.client.1.smithi155.stdout:1/811: rmdir d1/d16/d1d/d29/d3d/d43 39 2024-04-25T15:57:45.750 INFO:tasks.workunit.client.1.smithi155.stdout:1/812: stat d1/d16/d1d/d29/d3d/dfd 0 2024-04-25T15:57:45.751 INFO:tasks.workunit.client.1.smithi155.stdout:1/813: chown d1/d16/d1d/d29/d5f/d34/d68/d93/db7/fda 63 1 2024-04-25T15:57:45.752 INFO:tasks.workunit.client.1.smithi155.stdout:4/815: creat da/d117/f11c x:0 0 0 2024-04-25T15:57:45.752 INFO:tasks.workunit.client.1.smithi155.stdout:1/814: fsync d1/d16/d1d/d33/f4f 0 2024-04-25T15:57:45.753 INFO:tasks.workunit.client.1.smithi155.stdout:1/815: dread - d1/d16/d1d/d29/d5f/d34/d68/feb zero size 2024-04-25T15:57:45.754 INFO:tasks.workunit.client.1.smithi155.stdout:1/816: stat d1/da0/caa 0 2024-04-25T15:57:45.759 INFO:tasks.workunit.client.1.smithi155.stdout:4/816: dwrite da/d23/d3f/fa7 [0,4194304] 0 2024-04-25T15:57:45.766 INFO:tasks.workunit.client.1.smithi155.stdout:0/790: write d1/d6/f14 [1225198,26117] 0 2024-04-25T15:57:45.766 INFO:tasks.workunit.client.1.smithi155.stdout:4/817: chown da/d23/d3f/d56/d69/d83/d10c/d18/d97/c108 0 1 2024-04-25T15:57:45.769 INFO:tasks.workunit.client.1.smithi155.stdout:1/817: getdents d1/d6/db4 0 2024-04-25T15:57:45.769 INFO:tasks.workunit.client.1.smithi155.stdout:7/889: dwrite d2/dd/d36/d46/f51 [0,4194304] 0 2024-04-25T15:57:45.770 INFO:tasks.workunit.client.1.smithi155.stdout:8/626: dwrite d2/d5/d40/fa6 [0,4194304] 0 2024-04-25T15:57:45.771 INFO:tasks.workunit.client.1.smithi155.stdout:7/890: readlink d2/dd/d36/d46/lcf 0 2024-04-25T15:57:45.772 INFO:tasks.workunit.client.1.smithi155.stdout:4/818: mkdir da/d30/d11d 0 2024-04-25T15:57:45.775 INFO:tasks.workunit.client.1.smithi155.stdout:1/818: rmdir d1/d16/d1d/d29/d5f 39 2024-04-25T15:57:45.781 INFO:tasks.workunit.client.1.smithi155.stdout:7/891: mkdir d2/d26/d3d/d115/d12f 0 2024-04-25T15:57:45.782 INFO:tasks.workunit.client.1.smithi155.stdout:4/819: dwrite da/d23/d3f/d56/d69/d83/d10c/f2f [0,4194304] 0 2024-04-25T15:57:45.785 INFO:tasks.workunit.client.1.smithi155.stdout:1/819: dwrite d1/f15 [0,4194304] 0 2024-04-25T15:57:45.787 INFO:tasks.workunit.client.1.smithi155.stdout:7/892: creat d2/dd/d30/dbc/f130 x:0 0 0 2024-04-25T15:57:45.791 INFO:tasks.workunit.client.1.smithi155.stdout:8/627: rmdir d2/d15/d18/d34/d48/d4e/daf 0 2024-04-25T15:57:45.791 INFO:tasks.workunit.client.1.smithi155.stdout:0/791: getdents d1/d3/d5/d5b/dc4/d6e 0 2024-04-25T15:57:45.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/792: creat d1/d41/df4/f105 x:0 0 0 2024-04-25T15:57:45.800 INFO:tasks.workunit.client.1.smithi155.stdout:0/793: link d1/d3/d6a/lc2 d1/d3/d5/d5b/dd4/l106 0 2024-04-25T15:57:45.803 INFO:tasks.workunit.client.1.smithi155.stdout:3/826: sync 2024-04-25T15:57:45.803 INFO:tasks.workunit.client.1.smithi155.stdout:9/728: sync 2024-04-25T15:57:45.803 INFO:tasks.workunit.client.1.smithi155.stdout:4/820: dread da/d23/d3f/d56/d69/d83/d10c/d18/f5f [0,4194304] 0 2024-04-25T15:57:45.804 INFO:tasks.workunit.client.1.smithi155.stdout:0/794: rename d1/d6 to d1/d3/d5/d5b/dc4/d6e/d107 0 2024-04-25T15:57:45.805 INFO:tasks.workunit.client.1.smithi155.stdout:8/628: write d2/d15/d18/d49/f5e [418432,114943] 0 2024-04-25T15:57:45.805 INFO:tasks.workunit.client.1.smithi155.stdout:1/820: write d1/d16/d1d/d29/f9a [2645747,11740] 0 2024-04-25T15:57:45.807 INFO:tasks.workunit.client.1.smithi155.stdout:0/795: chown d1/d41/ce8 28413907 1 2024-04-25T15:57:45.807 INFO:tasks.workunit.client.1.smithi155.stdout:9/729: chown dc/d13/d60/d7a/f94 15411 1 2024-04-25T15:57:45.808 INFO:tasks.workunit.client.1.smithi155.stdout:3/827: write d1/d4/d10/d21/d73/d8d/fda [4281450,123816] 0 2024-04-25T15:57:45.810 INFO:tasks.workunit.client.1.smithi155.stdout:8/629: write d2/d15/d35/f78 [108409,113906] 0 2024-04-25T15:57:45.810 INFO:tasks.workunit.client.1.smithi155.stdout:1/821: dread - d1/d32/d77/fdf zero size 2024-04-25T15:57:45.810 INFO:tasks.workunit.client.1.smithi155.stdout:4/821: chown da/d23/d3f/d56/d69/d83/d10c/d18/d97/cba 92230585 1 2024-04-25T15:57:45.812 INFO:tasks.workunit.client.1.smithi155.stdout:9/730: chown dc/d17/d8e/de1 2 1 2024-04-25T15:57:45.813 INFO:tasks.workunit.client.1.smithi155.stdout:0/796: dread - d1/d3/d3d/d46/da4/faf zero size 2024-04-25T15:57:45.814 INFO:tasks.workunit.client.1.smithi155.stdout:8/630: dread - d2/d15/d35/d3d/f6b zero size 2024-04-25T15:57:45.815 INFO:tasks.workunit.client.1.smithi155.stdout:7/893: dwrite d2/dd/d36/f89 [0,4194304] 0 2024-04-25T15:57:45.817 INFO:tasks.workunit.client.1.smithi155.stdout:8/631: dread - d2/d15/d63/dc0/fc1 zero size 2024-04-25T15:57:45.817 INFO:tasks.workunit.client.1.smithi155.stdout:3/828: symlink d1/d4/d10/d21/d73/d8d/l121 0 2024-04-25T15:57:45.818 INFO:tasks.workunit.client.1.smithi155.stdout:0/797: dread d1/d41/df4/d47/db0/dd1/fd7 [0,4194304] 0 2024-04-25T15:57:45.819 INFO:tasks.workunit.client.1.smithi155.stdout:9/731: creat dc/d17/dc0/dc9/ff2 x:0 0 0 2024-04-25T15:57:45.821 INFO:tasks.workunit.client.1.smithi155.stdout:8/632: symlink d2/d15/d63/lc8 0 2024-04-25T15:57:45.821 INFO:tasks.workunit.client.1.smithi155.stdout:3/829: chown d1/d4/d10/d21/d73/d77/cd7 47828557 1 2024-04-25T15:57:45.823 INFO:tasks.workunit.client.1.smithi155.stdout:1/822: write d1/d16/d1d/d29/d3d/d43/f48 [3606463,119441] 0 2024-04-25T15:57:45.823 INFO:tasks.workunit.client.1.smithi155.stdout:5/857: sync 2024-04-25T15:57:45.824 INFO:tasks.workunit.client.1.smithi155.stdout:6/968: sync 2024-04-25T15:57:45.824 INFO:tasks.workunit.client.1.smithi155.stdout:2/928: sync 2024-04-25T15:57:45.824 INFO:tasks.workunit.client.1.smithi155.stdout:8/633: readlink d2/d15/d18/d49/l62 0 2024-04-25T15:57:45.824 INFO:tasks.workunit.client.1.smithi155.stdout:9/732: rmdir dc/d13/d59/dee 0 2024-04-25T15:57:45.825 INFO:tasks.workunit.client.1.smithi155.stdout:4/822: dwrite da/d30/f38 [0,4194304] 0 2024-04-25T15:57:45.826 INFO:tasks.workunit.client.1.smithi155.stdout:0/798: getdents d1/d3/d3d 0 2024-04-25T15:57:45.831 INFO:tasks.workunit.client.1.smithi155.stdout:8/634: chown d2/d15/d18/d23/d3c/d76/d7e/cb9 443 1 2024-04-25T15:57:45.833 INFO:tasks.workunit.client.1.smithi155.stdout:9/733: symlink dc/d17/d8e/dae/lf3 0 2024-04-25T15:57:45.835 INFO:tasks.workunit.client.1.smithi155.stdout:3/830: rename d1/d4/db/d20/d44/d52/d61/db5/f38 to d1/d4/d10/d21/d73/d8d/f122 0 2024-04-25T15:57:45.837 INFO:tasks.workunit.client.1.smithi155.stdout:8/635: stat d2/d15/d18/d23/d3c/f47 0 2024-04-25T15:57:45.838 INFO:tasks.workunit.client.1.smithi155.stdout:0/799: mkdir d1/d85/d98/d101/d108 0 2024-04-25T15:57:45.839 INFO:tasks.workunit.client.1.smithi155.stdout:9/734: read dc/d13/d2e/d4c/fa2 [205475,7409] 0 2024-04-25T15:57:45.841 INFO:tasks.workunit.client.1.smithi155.stdout:2/929: creat d7/db/d2e/d44/f130 x:0 0 0 2024-04-25T15:57:45.842 INFO:tasks.workunit.client.1.smithi155.stdout:6/969: dwrite d0/d13/d43/f64 [0,4194304] 0 2024-04-25T15:57:45.843 INFO:tasks.workunit.client.1.smithi155.stdout:0/800: chown d1/d41/df4/d47/fc0 435526567 1 2024-04-25T15:57:45.846 INFO:tasks.workunit.client.1.smithi155.stdout:4/823: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/fdd [0,4194304] 0 2024-04-25T15:57:45.846 INFO:tasks.workunit.client.1.smithi155.stdout:1/823: creat d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/dfc/f100 x:0 0 0 2024-04-25T15:57:45.847 INFO:tasks.workunit.client.1.smithi155.stdout:2/930: truncate d7/d23/f40 4783333 0 2024-04-25T15:57:45.851 INFO:tasks.workunit.client.1.smithi155.stdout:7/894: dread d2/dd/d12/d76/fa3 [0,4194304] 0 2024-04-25T15:57:45.851 INFO:tasks.workunit.client.1.smithi155.stdout:8/636: rename d2/d15/d18/d34/d48/d4e/d81/dae to d2/d15/d18/d49/dc9 0 2024-04-25T15:57:45.853 INFO:tasks.workunit.client.1.smithi155.stdout:2/931: write d7/db/d29/f3c [1873579,23818] 0 2024-04-25T15:57:45.856 INFO:tasks.workunit.client.1.smithi155.stdout:5/858: dread d0/d58/d63/da0/fab [0,4194304] 0 2024-04-25T15:57:45.858 INFO:tasks.workunit.client.1.smithi155.stdout:4/824: mkdir da/d23/d3f/d56/d69/d4a/d78/d62/d11e 0 2024-04-25T15:57:45.861 INFO:tasks.workunit.client.1.smithi155.stdout:0/801: creat d1/d3/d5/d5b/dc4/dfc/f109 x:0 0 0 2024-04-25T15:57:45.861 INFO:tasks.workunit.client.1.smithi155.stdout:9/735: dwrite dc/d17/d2a/f35 [4194304,4194304] 0 2024-04-25T15:57:45.862 INFO:tasks.workunit.client.1.smithi155.stdout:4/825: fsync da/d23/d3f/d56/d69/f114 0 2024-04-25T15:57:45.862 INFO:tasks.workunit.client.1.smithi155.stdout:6/970: write d0/d1a/d25/d51/f3b [1639320,94343] 0 2024-04-25T15:57:45.864 INFO:tasks.workunit.client.1.smithi155.stdout:1/824: dwrite d1/d6/faf [0,4194304] 0 2024-04-25T15:57:45.865 INFO:tasks.workunit.client.1.smithi155.stdout:5/859: mkdir d0/d3/d15/d1f/d50/d7c/d119 0 2024-04-25T15:57:45.867 INFO:tasks.workunit.client.1.smithi155.stdout:7/895: rename d2/dd/d12/d76/f106 to d2/d26/d3d/d6d/f131 0 2024-04-25T15:57:45.868 INFO:tasks.workunit.client.1.smithi155.stdout:8/637: link d2/fa d2/d15/d18/d95/fca 0 2024-04-25T15:57:45.871 INFO:tasks.workunit.client.1.smithi155.stdout:1/825: write d1/d32/d77/fb1 [3458112,122066] 0 2024-04-25T15:57:45.872 INFO:tasks.workunit.client.1.smithi155.stdout:4/826: stat da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110/f96 0 2024-04-25T15:57:45.873 INFO:tasks.workunit.client.1.smithi155.stdout:8/638: fsync d2/d15/d18/d49/f3a 0 2024-04-25T15:57:45.875 INFO:tasks.workunit.client.1.smithi155.stdout:7/896: write d2/d26/d3d/d65/f11e [943299,39064] 0 2024-04-25T15:57:45.875 INFO:tasks.workunit.client.1.smithi155.stdout:5/860: mknod d0/d3/d15/d1f/d50/d10a/c11a 0 2024-04-25T15:57:45.879 INFO:tasks.workunit.client.1.smithi155.stdout:1/826: mknod d1/d16/d1d/d33/c101 0 2024-04-25T15:57:45.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/802: dwrite d1/d41/fff [0,4194304] 0 2024-04-25T15:57:45.881 INFO:tasks.workunit.client.1.smithi155.stdout:8/639: mknod d2/d15/da1/ccb 0 2024-04-25T15:57:45.883 INFO:tasks.workunit.client.1.smithi155.stdout:2/932: dread d7/d23/f34 [0,4194304] 0 2024-04-25T15:57:45.883 INFO:tasks.workunit.client.1.smithi155.stdout:4/827: mknod da/d23/d3f/d56/d69/d4a/d78/d62/dc0/c11f 0 2024-04-25T15:57:45.884 INFO:tasks.workunit.client.1.smithi155.stdout:5/861: readlink d0/d3/d15/d1f/d50/d60/lbd 0 2024-04-25T15:57:45.887 INFO:tasks.workunit.client.1.smithi155.stdout:6/971: rename d0/d1a/d25/d2e/c89 to d0/d13/d34/d38/d4c/c133 0 2024-04-25T15:57:45.888 INFO:tasks.workunit.client.1.smithi155.stdout:5/862: read d0/d58/d32/d6a/d78/f87 [310060,8370] 0 2024-04-25T15:57:45.889 INFO:tasks.workunit.client.1.smithi155.stdout:0/803: dread d1/d41/df4/d47/db0/dd1/fd7 [0,4194304] 0 2024-04-25T15:57:45.890 INFO:tasks.workunit.client.1.smithi155.stdout:6/972: chown d0/d1a/d37/dda/d11b 42039 1 2024-04-25T15:57:45.890 INFO:tasks.workunit.client.1.smithi155.stdout:8/640: mkdir d2/d15/d18/d34/d48/d4e/d81/dcc 0 2024-04-25T15:57:45.891 INFO:tasks.workunit.client.1.smithi155.stdout:7/897: dread d2/dd/d30/d44/ddd/fe6 [0,4194304] 0 2024-04-25T15:57:45.892 INFO:tasks.workunit.client.1.smithi155.stdout:5/863: write d0/d47/d59/f118 [334635,36504] 0 2024-04-25T15:57:45.893 INFO:tasks.workunit.client.1.smithi155.stdout:1/827: creat d1/d16/d1d/d29/dcf/f102 x:0 0 0 2024-04-25T15:57:45.893 INFO:tasks.workunit.client.1.smithi155.stdout:9/736: dwrite dc/d17/d8e/dae/dd6/f23 [4194304,4194304] 0 2024-04-25T15:57:45.894 INFO:tasks.workunit.client.1.smithi155.stdout:4/828: mknod da/d87/ddc/c120 0 2024-04-25T15:57:45.895 INFO:tasks.workunit.client.1.smithi155.stdout:0/804: truncate d1/d41/f7c 1827549 0 2024-04-25T15:57:45.895 INFO:tasks.workunit.client.1.smithi155.stdout:6/973: truncate d0/d18/d112/fbc 950696 0 2024-04-25T15:57:45.895 INFO:tasks.workunit.client.1.smithi155.stdout:2/933: creat d7/db/d29/d83/dc8/f131 x:0 0 0 2024-04-25T15:57:45.897 INFO:tasks.workunit.client.1.smithi155.stdout:8/641: truncate d2/d15/d35/d3d/fac 979601 0 2024-04-25T15:57:45.898 INFO:tasks.workunit.client.1.smithi155.stdout:9/737: write dc/d11/dc4/fd3 [822176,12537] 0 2024-04-25T15:57:45.900 INFO:tasks.workunit.client.1.smithi155.stdout:8/642: dread - d2/d15/d35/fc3 zero size 2024-04-25T15:57:45.901 INFO:tasks.workunit.client.1.smithi155.stdout:6/974: read d0/d1a/d87/fa3 [110116,114463] 0 2024-04-25T15:57:45.903 INFO:tasks.workunit.client.1.smithi155.stdout:1/828: fdatasync d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 0 2024-04-25T15:57:45.904 INFO:tasks.workunit.client.1.smithi155.stdout:9/738: mknod dc/d11/d67/cf4 0 2024-04-25T15:57:45.906 INFO:tasks.workunit.client.1.smithi155.stdout:4/829: dread da/d23/d3f/f79 [4194304,4194304] 0 2024-04-25T15:57:45.906 INFO:tasks.workunit.client.1.smithi155.stdout:6/975: write d0/d1a/d21/f32 [5383941,69372] 0 2024-04-25T15:57:45.911 INFO:tasks.workunit.client.1.smithi155.stdout:5/864: dwrite d0/d3/d15/d1f/f70 [0,4194304] 0 2024-04-25T15:57:45.911 INFO:tasks.workunit.client.1.smithi155.stdout:8/643: creat d2/d15/fcd x:0 0 0 2024-04-25T15:57:45.912 INFO:tasks.workunit.client.1.smithi155.stdout:2/934: dwrite d7/db/d29/d83/dc8/f131 [0,4194304] 0 2024-04-25T15:57:45.913 INFO:tasks.workunit.client.1.smithi155.stdout:1/829: getdents d1/d6/db4 0 2024-04-25T15:57:45.913 INFO:tasks.workunit.client.1.smithi155.stdout:6/976: mknod d0/d13/dd1/c134 0 2024-04-25T15:57:45.917 INFO:tasks.workunit.client.1.smithi155.stdout:8/644: truncate d2/d5/d40/f65 1192188 0 2024-04-25T15:57:45.918 INFO:tasks.workunit.client.1.smithi155.stdout:6/977: creat d0/d1a/d21/f135 x:0 0 0 2024-04-25T15:57:45.922 INFO:tasks.workunit.client.1.smithi155.stdout:9/739: dwrite dc/d17/dc0/dc9/ff2 [0,4194304] 0 2024-04-25T15:57:45.922 INFO:tasks.workunit.client.1.smithi155.stdout:3/831: sync 2024-04-25T15:57:45.924 INFO:tasks.workunit.client.1.smithi155.stdout:9/740: chown dc/d11/d30/dd2 0 1 2024-04-25T15:57:45.924 INFO:tasks.workunit.client.1.smithi155.stdout:1/830: unlink d1/d16/d1d/d33/da1/lb9 0 2024-04-25T15:57:45.928 INFO:tasks.workunit.client.1.smithi155.stdout:5/865: dwrite d0/d58/f90 [0,4194304] 0 2024-04-25T15:57:45.928 INFO:tasks.workunit.client.1.smithi155.stdout:6/978: write d0/d1a/d21/f47 [356776,10672] 0 2024-04-25T15:57:45.930 INFO:tasks.workunit.client.1.smithi155.stdout:4/830: write da/d23/d3f/d56/d69/d4a/d78/f2e [553435,76072] 0 2024-04-25T15:57:45.934 INFO:tasks.workunit.client.1.smithi155.stdout:9/741: unlink dc/d17/d8e/dae/dd6/f91 0 2024-04-25T15:57:45.935 INFO:tasks.workunit.client.1.smithi155.stdout:6/979: write d0/d1a/d45/f92 [5448017,37828] 0 2024-04-25T15:57:45.938 INFO:tasks.workunit.client.1.smithi155.stdout:0/805: dread d1/d3/d5/d5b/dc4/d6e/d107/f22 [0,4194304] 0 2024-04-25T15:57:45.940 INFO:tasks.workunit.client.1.smithi155.stdout:9/742: write dc/d11/d30/d46/fcd [562773,75295] 0 2024-04-25T15:57:45.940 INFO:tasks.workunit.client.1.smithi155.stdout:7/898: dread d2/dd/d36/f73 [0,4194304] 0 2024-04-25T15:57:45.944 INFO:tasks.workunit.client.1.smithi155.stdout:9/743: mkdir dc/df5 0 2024-04-25T15:57:45.949 INFO:tasks.workunit.client.1.smithi155.stdout:1/831: dwrite d1/d6/db4/fd3 [0,4194304] 0 2024-04-25T15:57:45.954 INFO:tasks.workunit.client.1.smithi155.stdout:7/899: creat d2/dd/d13/d24/d35/db4/f132 x:0 0 0 2024-04-25T15:57:45.955 INFO:tasks.workunit.client.1.smithi155.stdout:9/744: read - dc/d13/d60/fe6 zero size 2024-04-25T15:57:45.957 INFO:tasks.workunit.client.1.smithi155.stdout:5/866: dwrite d0/d58/d63/f110 [0,4194304] 0 2024-04-25T15:57:45.960 INFO:tasks.workunit.client.1.smithi155.stdout:2/935: dread d7/d8e/fc1 [0,4194304] 0 2024-04-25T15:57:45.961 INFO:tasks.workunit.client.1.smithi155.stdout:9/745: stat dc/d11/f80 0 2024-04-25T15:57:45.962 INFO:tasks.workunit.client.1.smithi155.stdout:5/867: dread - d0/d3/d2c/f106 zero size 2024-04-25T15:57:45.966 INFO:tasks.workunit.client.1.smithi155.stdout:6/980: write d0/d13/d34/d38/f88 [3737703,102235] 0 2024-04-25T15:57:45.966 INFO:tasks.workunit.client.1.smithi155.stdout:4/831: rename da/d23/d3f/d56/d69/d83/d10c/d18/f4c to da/d23/d3f/d56/d69/d4a/d78/d62/d11e/f121 0 2024-04-25T15:57:45.967 INFO:tasks.workunit.client.1.smithi155.stdout:3/832: dwrite d1/d4/d10/d21/d73/d77/d57/d7c/f83 [0,4194304] 0 2024-04-25T15:57:45.969 INFO:tasks.workunit.client.1.smithi155.stdout:8/645: dwrite d2/fa [0,4194304] 0 2024-04-25T15:57:45.969 INFO:tasks.workunit.client.1.smithi155.stdout:9/746: symlink dc/df5/lf6 0 2024-04-25T15:57:45.970 INFO:tasks.workunit.client.1.smithi155.stdout:2/936: write d7/db/d2e/fe9 [3842438,66870] 0 2024-04-25T15:57:45.974 INFO:tasks.workunit.client.1.smithi155.stdout:7/900: link d2/dd/d13/d24/c84 d2/dd/d66/d71/c133 0 2024-04-25T15:57:45.974 INFO:tasks.workunit.client.1.smithi155.stdout:3/833: fdatasync d1/d4/db/d28/d58/f92 0 2024-04-25T15:57:45.976 INFO:tasks.workunit.client.1.smithi155.stdout:4/832: creat da/d23/d3f/d56/d69/d4a/d78/f122 x:0 0 0 2024-04-25T15:57:45.977 INFO:tasks.workunit.client.1.smithi155.stdout:8/646: chown d2/d15/d35/fa4 1 1 2024-04-25T15:57:45.979 INFO:tasks.workunit.client.1.smithi155.stdout:6/981: link d0/d13/d43/l11e d0/d1a/da1/dac/l136 0 2024-04-25T15:57:45.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/832: dwrite d1/d16/d1d/d29/f9a [0,4194304] 0 2024-04-25T15:57:45.981 INFO:tasks.workunit.client.1.smithi155.stdout:7/901: chown d2/dd/d13/d24/d35/f117 903784 1 2024-04-25T15:57:45.982 INFO:tasks.workunit.client.1.smithi155.stdout:3/834: dread - d1/d4/db/d91/de4/f10c zero size 2024-04-25T15:57:45.983 INFO:tasks.workunit.client.1.smithi155.stdout:0/806: dwrite d1/d41/df4/f59 [0,4194304] 0 2024-04-25T15:57:45.987 INFO:tasks.workunit.client.1.smithi155.stdout:4/833: creat da/d23/d3f/dc6/dc8/f123 x:0 0 0 2024-04-25T15:57:45.988 INFO:tasks.workunit.client.1.smithi155.stdout:0/807: fdatasync d1/d3/d5/f26 0 2024-04-25T15:57:45.988 INFO:tasks.workunit.client.1.smithi155.stdout:6/982: dread - d0/d13/d7c/ff4 zero size 2024-04-25T15:57:45.989 INFO:tasks.workunit.client.1.smithi155.stdout:1/833: readlink d1/d16/d1d/d29/d5f/d34/lab 0 2024-04-25T15:57:45.991 INFO:tasks.workunit.client.1.smithi155.stdout:2/937: getdents d7/d8e 0 2024-04-25T15:57:45.994 INFO:tasks.workunit.client.1.smithi155.stdout:5/868: dwrite d0/d3/d15/d30/ff2 [0,4194304] 0 2024-04-25T15:57:45.995 INFO:tasks.workunit.client.1.smithi155.stdout:9/747: getdents dc/d17/d8e/dae/dd6/d72 0 2024-04-25T15:57:45.996 INFO:tasks.workunit.client.1.smithi155.stdout:8/647: rename d2/c3 to d2/d15/d18/cce 0 2024-04-25T15:57:45.997 INFO:tasks.workunit.client.1.smithi155.stdout:8/648: chown d2/d5/d40 381516 1 2024-04-25T15:57:45.998 INFO:tasks.workunit.client.1.smithi155.stdout:4/834: read da/d23/d3f/d56/d69/d4a/d78/d62/d11e/f121 [2352288,71108] 0 2024-04-25T15:57:45.999 INFO:tasks.workunit.client.1.smithi155.stdout:9/748: write dc/d11/d67/f83 [1121301,94387] 0 2024-04-25T15:57:45.999 INFO:tasks.workunit.client.1.smithi155.stdout:3/835: truncate d1/d4/d10/d21/d73/d77/d57/d80/fb7 886900 0 2024-04-25T15:57:46.000 INFO:tasks.workunit.client.1.smithi155.stdout:0/808: rename d1/d3/d6a/lae to d1/d3/d5/d5b/dc4/d6e/l10a 0 2024-04-25T15:57:46.007 INFO:tasks.workunit.client.1.smithi155.stdout:8/649: truncate d2/f14 287021 0 2024-04-25T15:57:46.008 INFO:tasks.workunit.client.1.smithi155.stdout:9/749: mknod dc/df5/cf7 0 2024-04-25T15:57:46.010 INFO:tasks.workunit.client.1.smithi155.stdout:6/983: rename d0/d1a/d37/dda/c62 to d0/d1a/d25/d51/c137 0 2024-04-25T15:57:46.011 INFO:tasks.workunit.client.1.smithi155.stdout:3/836: dread d1/d4/d10/d21/d73/f59 [0,4194304] 0 2024-04-25T15:57:46.012 INFO:tasks.workunit.client.1.smithi155.stdout:0/809: mkdir d1/d3f/d10b 0 2024-04-25T15:57:46.012 INFO:tasks.workunit.client.1.smithi155.stdout:7/902: dread d2/dd/d13/d1c/f60 [0,4194304] 0 2024-04-25T15:57:46.012 INFO:tasks.workunit.client.1.smithi155.stdout:6/984: write d0/d13/dd1/fd6 [754870,89293] 0 2024-04-25T15:57:46.013 INFO:tasks.workunit.client.1.smithi155.stdout:5/869: creat d0/d3/d15/d1f/f11b x:0 0 0 2024-04-25T15:57:46.014 INFO:tasks.workunit.client.1.smithi155.stdout:0/810: read - d1/d41/df4/d47/db0/dd1/ffe zero size 2024-04-25T15:57:46.015 INFO:tasks.workunit.client.1.smithi155.stdout:9/750: mknod dc/d11/d30/d46/cf8 0 2024-04-25T15:57:46.015 INFO:tasks.workunit.client.1.smithi155.stdout:6/985: chown d0/d13/d7c/c95 3 1 2024-04-25T15:57:46.018 INFO:tasks.workunit.client.1.smithi155.stdout:3/837: creat d1/d4/d10/d21/d73/d8d/f123 x:0 0 0 2024-04-25T15:57:46.018 INFO:tasks.workunit.client.1.smithi155.stdout:1/834: dread d1/f8 [0,4194304] 0 2024-04-25T15:57:46.022 INFO:tasks.workunit.client.1.smithi155.stdout:5/870: mknod d0/d58/d63/da0/dd6/c11c 0 2024-04-25T15:57:46.024 INFO:tasks.workunit.client.1.smithi155.stdout:8/650: rename d2/d15/d18/l30 to d2/d15/d18/d49/lcf 0 2024-04-25T15:57:46.025 INFO:tasks.workunit.client.1.smithi155.stdout:9/751: rmdir dc/d17/d8e/dae 39 2024-04-25T15:57:46.026 INFO:tasks.workunit.client.1.smithi155.stdout:6/986: symlink d0/d1a/d37/dda/dfe/df0/l138 0 2024-04-25T15:57:46.027 INFO:tasks.workunit.client.1.smithi155.stdout:6/987: write d0/d1a/d21/d73/f5a [3203968,3307] 0 2024-04-25T15:57:46.027 INFO:tasks.workunit.client.1.smithi155.stdout:2/938: link d7/db/d2e/d6f/d91/dad/de0/l11f d7/db/d2e/d44/d70/l132 0 2024-04-25T15:57:46.027 INFO:tasks.workunit.client.1.smithi155.stdout:0/811: dread d1/f80 [0,4194304] 0 2024-04-25T15:57:46.029 INFO:tasks.workunit.client.1.smithi155.stdout:2/939: read d7/f77 [339114,26163] 0 2024-04-25T15:57:46.030 INFO:tasks.workunit.client.1.smithi155.stdout:1/835: unlink d1/d16/d1d/d29/d3d/cbc 0 2024-04-25T15:57:46.031 INFO:tasks.workunit.client.1.smithi155.stdout:3/838: creat d1/d4/d10/d21/d73/d77/d57/d80/f124 x:0 0 0 2024-04-25T15:57:46.031 INFO:tasks.workunit.client.1.smithi155.stdout:4/835: truncate da/d23/da2/fb8 526658 0 2024-04-25T15:57:46.033 INFO:tasks.workunit.client.1.smithi155.stdout:0/812: dread d1/d3/d5/d5b/dc4/d6e/d107/f22 [0,4194304] 0 2024-04-25T15:57:46.034 INFO:tasks.workunit.client.1.smithi155.stdout:8/651: truncate d2/f16 7628660 0 2024-04-25T15:57:46.034 INFO:tasks.workunit.client.1.smithi155.stdout:8/652: stat d2/d15/d18/d34/l96 0 2024-04-25T15:57:46.035 INFO:tasks.workunit.client.1.smithi155.stdout:8/653: stat d2/d15/d18/d34/l96 0 2024-04-25T15:57:46.035 INFO:tasks.workunit.client.1.smithi155.stdout:6/988: symlink d0/d1a/d25/d51/l139 0 2024-04-25T15:57:46.036 INFO:tasks.workunit.client.1.smithi155.stdout:2/940: mkdir d7/db/d2e/d90/d133 0 2024-04-25T15:57:46.037 INFO:tasks.workunit.client.1.smithi155.stdout:2/941: write d7/db/d2e/d44/f4b [5212828,3619] 0 2024-04-25T15:57:46.038 INFO:tasks.workunit.client.1.smithi155.stdout:7/903: getdents d2/dd/d30/d113 0 2024-04-25T15:57:46.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/836: mknod d1/d16/d1d/d29/d5f/d34/c103 0 2024-04-25T15:57:46.044 INFO:tasks.workunit.client.1.smithi155.stdout:8/654: truncate d2/f14 676845 0 2024-04-25T15:57:46.044 INFO:tasks.workunit.client.1.smithi155.stdout:6/989: dwrite d0/d1a/d25/d2e/f31 [4194304,4194304] 0 2024-04-25T15:57:46.050 INFO:tasks.workunit.client.1.smithi155.stdout:8/655: dread d2/d15/d35/d3d/fac [0,4194304] 0 2024-04-25T15:57:46.050 INFO:tasks.workunit.client.1.smithi155.stdout:3/839: dread d1/d4/db/d20/f3b [0,4194304] 0 2024-04-25T15:57:46.051 INFO:tasks.workunit.client.1.smithi155.stdout:8/656: chown d2/d15/d18/d34/ca0 93 1 2024-04-25T15:57:46.052 INFO:tasks.workunit.client.1.smithi155.stdout:8/657: fdatasync d2/d15/d18/d23/d3c/f61 0 2024-04-25T15:57:46.053 INFO:tasks.workunit.client.1.smithi155.stdout:6/990: mkdir d0/d1a/d37/dec/d13a 0 2024-04-25T15:57:46.054 INFO:tasks.workunit.client.1.smithi155.stdout:4/836: getdents da/d23/d3f/dc6 0 2024-04-25T15:57:46.054 INFO:tasks.workunit.client.1.smithi155.stdout:5/871: link d0/d3/c2e d0/d3/c11d 0 2024-04-25T15:57:46.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/840: creat d1/d4/db/d28/d58/f125 x:0 0 0 2024-04-25T15:57:46.057 INFO:tasks.workunit.client.1.smithi155.stdout:2/942: getdents d7/db/d29/d83/d86/d8b/dbf 0 2024-04-25T15:57:46.058 INFO:tasks.workunit.client.1.smithi155.stdout:3/841: dread - d1/d4/d10/d21/d73/d77/d5f/db3/fd8 zero size 2024-04-25T15:57:46.059 INFO:tasks.workunit.client.1.smithi155.stdout:6/991: creat d0/d13/d34/d38/d90/da5/f13b x:0 0 0 2024-04-25T15:57:46.060 INFO:tasks.workunit.client.1.smithi155.stdout:8/658: rename d2/d15/d18/d34/d48/d4e/f90 to d2/d15/da1/fd0 0 2024-04-25T15:57:46.062 INFO:tasks.workunit.client.1.smithi155.stdout:6/992: dread d0/d13/d34/d38/d7a/df5/ffd [0,4194304] 0 2024-04-25T15:57:46.063 INFO:tasks.workunit.client.1.smithi155.stdout:7/904: truncate d2/dd/d66/d8c/fc8 307292 0 2024-04-25T15:57:46.064 INFO:tasks.workunit.client.1.smithi155.stdout:7/905: dread - d2/dd/d30/d44/ffa zero size 2024-04-25T15:57:46.068 INFO:tasks.workunit.client.1.smithi155.stdout:8/659: rename d2/d5/c37 to d2/d15/d35/d3d/d6c/cd1 0 2024-04-25T15:57:46.069 INFO:tasks.workunit.client.1.smithi155.stdout:8/660: dread - d2/d15/d18/d23/d3c/fa9 zero size 2024-04-25T15:57:46.071 INFO:tasks.workunit.client.1.smithi155.stdout:2/943: link d7/f82 d7/db/d2e/d44/d70/d7b/f134 0 2024-04-25T15:57:46.071 INFO:tasks.workunit.client.1.smithi155.stdout:7/906: dwrite d2/dd/d13/d24/d8b/ff8 [0,4194304] 0 2024-04-25T15:57:46.071 INFO:tasks.workunit.client.1.smithi155.stdout:5/872: write d0/d27/f98 [910309,44767] 0 2024-04-25T15:57:46.073 INFO:tasks.workunit.client.1.smithi155.stdout:2/944: chown d7/db/dd/d15/d60/d94/fc4 225319 1 2024-04-25T15:57:46.073 INFO:tasks.workunit.client.1.smithi155.stdout:5/873: chown d0/d58/d32/d6a/d78/lca 2759 1 2024-04-25T15:57:46.074 INFO:tasks.workunit.client.1.smithi155.stdout:6/993: fdatasync d0/d1a/d25/d51/f84 0 2024-04-25T15:57:46.075 INFO:tasks.workunit.client.1.smithi155.stdout:5/874: chown d0/d3/d15/d1f/d50/d60/c73 3621 1 2024-04-25T15:57:46.076 INFO:tasks.workunit.client.1.smithi155.stdout:4/837: creat da/d23/d3f/d56/f124 x:0 0 0 2024-04-25T15:57:46.077 INFO:tasks.workunit.client.1.smithi155.stdout:6/994: write d0/d13/d34/d38/d7a/fa6 [458673,129005] 0 2024-04-25T15:57:46.078 INFO:tasks.workunit.client.1.smithi155.stdout:8/661: mknod d2/d15/d18/d49/cd2 0 2024-04-25T15:57:46.079 INFO:tasks.workunit.client.1.smithi155.stdout:8/662: chown d2/d15/d18/d34/d48/d4e/l71 77344 1 2024-04-25T15:57:46.083 INFO:tasks.workunit.client.1.smithi155.stdout:3/842: rmdir d1/d4/db/d20/d44/d52/d61/d11b 0 2024-04-25T15:57:46.084 INFO:tasks.workunit.client.1.smithi155.stdout:3/843: write d1/d4/db/d28/d58/faf [258907,130322] 0 2024-04-25T15:57:46.085 INFO:tasks.workunit.client.1.smithi155.stdout:6/995: creat d0/d13/d7c/d99/f13c x:0 0 0 2024-04-25T15:57:46.087 INFO:tasks.workunit.client.1.smithi155.stdout:8/663: rmdir d2/d15/d18/d34/d48/d59 39 2024-04-25T15:57:46.090 INFO:tasks.workunit.client.1.smithi155.stdout:7/907: write d2/dd/d13/d1c/f40 [4183244,115590] 0 2024-04-25T15:57:46.091 INFO:tasks.workunit.client.1.smithi155.stdout:7/908: write d2/dd/d13/d1c/dd9/f121 [342873,306] 0 2024-04-25T15:57:46.094 INFO:tasks.workunit.client.1.smithi155.stdout:3/844: unlink d1/d4/db/d20/d44/fe0 0 2024-04-25T15:57:46.096 INFO:tasks.workunit.client.1.smithi155.stdout:2/945: truncate d7/d23/f20 980973 0 2024-04-25T15:57:46.097 INFO:tasks.workunit.client.1.smithi155.stdout:6/996: truncate d0/d13/d43/f33 92977 0 2024-04-25T15:57:46.099 INFO:tasks.workunit.client.1.smithi155.stdout:3/845: creat d1/d4/db/d91/dc4/dd9/d86/f126 x:0 0 0 2024-04-25T15:57:46.099 INFO:tasks.workunit.client.1.smithi155.stdout:8/664: fdatasync d2/d15/d18/fb7 0 2024-04-25T15:57:46.100 INFO:tasks.workunit.client.1.smithi155.stdout:2/946: creat d7/d8e/db9/f135 x:0 0 0 2024-04-25T15:57:46.100 INFO:tasks.workunit.client.1.smithi155.stdout:4/838: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110/f96 [0,4194304] 0 2024-04-25T15:57:46.102 INFO:tasks.workunit.client.1.smithi155.stdout:2/947: stat d7/d8e/db9/f114 0 2024-04-25T15:57:46.104 INFO:tasks.workunit.client.1.smithi155.stdout:3/846: dread d1/d4/d10/d21/d73/d77/d57/d80/fb7 [0,4194304] 0 2024-04-25T15:57:46.105 INFO:tasks.workunit.client.1.smithi155.stdout:7/909: creat d2/dd/f134 x:0 0 0 2024-04-25T15:57:46.106 INFO:tasks.workunit.client.1.smithi155.stdout:7/910: truncate d2/dd/d13/d24/ffd 282608 0 2024-04-25T15:57:46.107 INFO:tasks.workunit.client.1.smithi155.stdout:6/997: creat d0/d13/d34/d38/d7a/df5/f13d x:0 0 0 2024-04-25T15:57:46.109 INFO:tasks.workunit.client.1.smithi155.stdout:4/839: write f7 [655068,21450] 0 2024-04-25T15:57:46.112 INFO:tasks.workunit.client.1.smithi155.stdout:8/665: rename d2/d5/f67 to d2/d15/d18/d34/d48/d7f/fd3 0 2024-04-25T15:57:46.114 INFO:tasks.workunit.client.1.smithi155.stdout:6/998: mknod d0/d18/d54/c13e 0 2024-04-25T15:57:46.115 INFO:tasks.workunit.client.1.smithi155.stdout:6/999: stat d0/d13/dd1/fd6 0 2024-04-25T15:57:46.116 INFO:tasks.workunit.client.1.smithi155.stdout:4/840: mknod da/d23/d3f/d56/d69/d4a/c125 0 2024-04-25T15:57:46.119 INFO:tasks.workunit.client.1.smithi155.stdout:7/911: mkdir d2/dd/d12/d76/db6/d111/d135 0 2024-04-25T15:57:46.127 INFO:tasks.workunit.client.1.smithi155.stdout:2/948: truncate d7/db/dd/fab 1103564 0 2024-04-25T15:57:46.128 INFO:tasks.workunit.client.1.smithi155.stdout:4/841: dwrite da/d23/d3a/d7b/d93/fc5 [0,4194304] 0 2024-04-25T15:57:46.132 INFO:tasks.workunit.client.1.smithi155.stdout:8/666: truncate d2/d15/d18/d95/fca 983995 0 2024-04-25T15:57:46.132 INFO:tasks.workunit.client.1.smithi155.stdout:8/667: chown d2/d15/d18/d23/d3c/f86 61318425 1 2024-04-25T15:57:46.140 INFO:tasks.workunit.client.1.smithi155.stdout:7/912: fdatasync d2/dd/d36/d46/ff4 0 2024-04-25T15:57:46.141 INFO:tasks.workunit.client.1.smithi155.stdout:2/949: mknod d7/d8e/db9/c136 0 2024-04-25T15:57:46.142 INFO:tasks.workunit.client.1.smithi155.stdout:4/842: mknod da/d23/d3f/d56/d69/d4a/d78/d62/d11e/c126 0 2024-04-25T15:57:46.144 INFO:tasks.workunit.client.1.smithi155.stdout:8/668: mkdir d2/d15/d18/d23/dd4 0 2024-04-25T15:57:46.145 INFO:tasks.workunit.client.1.smithi155.stdout:4/843: symlink da/d23/d3f/d56/dca/l127 0 2024-04-25T15:57:46.147 INFO:tasks.workunit.client.1.smithi155.stdout:8/669: symlink d2/ld5 0 2024-04-25T15:57:46.147 INFO:tasks.workunit.client.1.smithi155.stdout:2/950: dread d7/f77 [0,4194304] 0 2024-04-25T15:57:46.148 INFO:tasks.workunit.client.1.smithi155.stdout:4/844: mknod da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110/c128 0 2024-04-25T15:57:46.149 INFO:tasks.workunit.client.1.smithi155.stdout:8/670: creat d2/d15/d63/dc0/fd6 x:0 0 0 2024-04-25T15:57:46.150 INFO:tasks.workunit.client.1.smithi155.stdout:8/671: fdatasync d2/d15/d18/d49/f9e 0 2024-04-25T15:57:46.152 INFO:tasks.workunit.client.1.smithi155.stdout:2/951: rename d7/db/dd/d15/d60/f76 to d7/db/d29/d83/d86/d8b/f137 0 2024-04-25T15:57:46.153 INFO:tasks.workunit.client.1.smithi155.stdout:2/952: truncate d7/db/d2e/d44/f105 670421 0 2024-04-25T15:57:46.156 INFO:tasks.workunit.client.1.smithi155.stdout:2/953: chown d7/db/d2e/d44/d70/l132 211921 1 2024-04-25T15:57:46.157 INFO:tasks.workunit.client.1.smithi155.stdout:8/672: truncate d2/f33 1067004 0 2024-04-25T15:57:46.158 INFO:tasks.workunit.client.1.smithi155.stdout:8/673: write d2/d15/d18/d23/d2d/fc2 [253102,55234] 0 2024-04-25T15:57:46.159 INFO:tasks.workunit.client.1.smithi155.stdout:4/845: truncate da/d30/f6d 734689 0 2024-04-25T15:57:46.160 INFO:tasks.workunit.client.1.smithi155.stdout:8/674: mkdir d2/d15/d63/dd7 0 2024-04-25T15:57:46.161 INFO:tasks.workunit.client.1.smithi155.stdout:2/954: dread d7/d23/fb3 [0,4194304] 0 2024-04-25T15:57:46.162 INFO:tasks.workunit.client.1.smithi155.stdout:4/846: mkdir da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/d129 0 2024-04-25T15:57:46.163 INFO:tasks.workunit.client.1.smithi155.stdout:4/847: chown da/d23/d3f/d56/d69/d4a/d78/d62/f68 40971234 1 2024-04-25T15:57:46.163 INFO:tasks.workunit.client.1.smithi155.stdout:4/848: fsync f7 0 2024-04-25T15:57:46.164 INFO:tasks.workunit.client.1.smithi155.stdout:4/849: chown da/d23/d3f/d56/dca/ff4 204528 1 2024-04-25T15:57:46.164 INFO:tasks.workunit.client.1.smithi155.stdout:2/955: rename d7/d8e/db9/l11e to d7/db/d29/d83/l138 0 2024-04-25T15:57:46.166 INFO:tasks.workunit.client.1.smithi155.stdout:2/956: write d7/db/d29/d83/dc8/f131 [2972727,29704] 0 2024-04-25T15:57:46.166 INFO:tasks.workunit.client.1.smithi155.stdout:8/675: link d2/d15/d18/d34/d48/f8b d2/d15/fd8 0 2024-04-25T15:57:46.167 INFO:tasks.workunit.client.1.smithi155.stdout:2/957: truncate d7/db/d2e/d6f/fb2 4941252 0 2024-04-25T15:57:46.167 INFO:tasks.workunit.client.1.smithi155.stdout:8/676: chown d2/d15/d35/f78 5 1 2024-04-25T15:57:46.169 INFO:tasks.workunit.client.1.smithi155.stdout:2/958: write d7/db/d29/d83/d86/db0/fd9 [905299,1438] 0 2024-04-25T15:57:46.169 INFO:tasks.workunit.client.1.smithi155.stdout:4/850: symlink da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/l12a 0 2024-04-25T15:57:46.172 INFO:tasks.workunit.client.1.smithi155.stdout:4/851: symlink da/d23/d3f/d56/d69/d4a/de0/l12b 0 2024-04-25T15:57:46.176 INFO:tasks.workunit.client.1.smithi155.stdout:8/677: creat d2/d15/d18/d34/d48/fd9 x:0 0 0 2024-04-25T15:57:46.181 INFO:tasks.workunit.client.1.smithi155.stdout:8/678: fdatasync d2/d15/d35/f78 0 2024-04-25T15:57:46.183 INFO:tasks.workunit.client.1.smithi155.stdout:8/679: write d2/d15/d18/d34/d48/d4e/d81/fa3 [285189,51840] 0 2024-04-25T15:57:46.183 INFO:tasks.workunit.client.1.smithi155.stdout:2/959: dread d7/db/d29/d83/d86/d8b/f137 [0,4194304] 0 2024-04-25T15:57:46.186 INFO:tasks.workunit.client.1.smithi155.stdout:8/680: mknod d2/d15/cda 0 2024-04-25T15:57:46.187 INFO:tasks.workunit.client.1.smithi155.stdout:2/960: dread d7/d23/f21 [0,4194304] 0 2024-04-25T15:57:46.189 INFO:tasks.workunit.client.1.smithi155.stdout:2/961: rmdir d7/db/d29/d83/d86 39 2024-04-25T15:57:46.190 INFO:tasks.workunit.client.1.smithi155.stdout:4/852: truncate da/d23/d3f/d56/dca/ff4 1646326 0 2024-04-25T15:57:46.191 INFO:tasks.workunit.client.1.smithi155.stdout:4/853: chown da/d23/da2 102719758 1 2024-04-25T15:57:46.192 INFO:tasks.workunit.client.1.smithi155.stdout:4/854: fsync da/d23/da2/fae 0 2024-04-25T15:57:46.194 INFO:tasks.workunit.client.1.smithi155.stdout:8/681: dwrite d2/d5/d40/f65 [0,4194304] 0 2024-04-25T15:57:46.195 INFO:tasks.workunit.client.1.smithi155.stdout:4/855: write da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110/f96 [1892411,111258] 0 2024-04-25T15:57:46.196 INFO:tasks.workunit.client.1.smithi155.stdout:8/682: chown d2/d15/d18/d23/d3c/d76/d7e/cb9 243190 1 2024-04-25T15:57:46.196 INFO:tasks.workunit.client.1.smithi155.stdout:2/962: write d7/db/d2e/d6f/fa7 [701927,1943] 0 2024-04-25T15:57:46.199 INFO:tasks.workunit.client.1.smithi155.stdout:4/856: symlink da/d30/d11d/l12c 0 2024-04-25T15:57:46.199 INFO:tasks.workunit.client.1.smithi155.stdout:9/752: sync 2024-04-25T15:57:46.200 INFO:tasks.workunit.client.1.smithi155.stdout:8/683: mkdir d2/d15/d18/d23/d3c/d76/d7e/ddb 0 2024-04-25T15:57:46.202 INFO:tasks.workunit.client.1.smithi155.stdout:2/963: creat d7/db/dd/d15/d60/d94/f139 x:0 0 0 2024-04-25T15:57:46.203 INFO:tasks.workunit.client.1.smithi155.stdout:2/964: fdatasync d7/db/d2e/d6f/d91/faf 0 2024-04-25T15:57:46.203 INFO:tasks.workunit.client.1.smithi155.stdout:4/857: unlink da/d23/d3f/d56/d69/d4a/lb7 0 2024-04-25T15:57:46.204 INFO:tasks.workunit.client.1.smithi155.stdout:9/753: stat dc/d17/d2a/c84 0 2024-04-25T15:57:46.204 INFO:tasks.workunit.client.1.smithi155.stdout:2/965: truncate d7/db/f51 4356144 0 2024-04-25T15:57:46.205 INFO:tasks.workunit.client.1.smithi155.stdout:8/684: creat d2/d15/da1/fdc x:0 0 0 2024-04-25T15:57:46.206 INFO:tasks.workunit.client.1.smithi155.stdout:4/858: creat da/d23/d3f/d56/d69/d4a/d78/d62/f12d x:0 0 0 2024-04-25T15:57:46.207 INFO:tasks.workunit.client.1.smithi155.stdout:9/754: mknod dc/d13/d60/d7a/cf9 0 2024-04-25T15:57:46.208 INFO:tasks.workunit.client.1.smithi155.stdout:9/755: chown dc/ff 459264 1 2024-04-25T15:57:46.209 INFO:tasks.workunit.client.1.smithi155.stdout:9/756: chown dc/d13/f26 13 1 2024-04-25T15:57:46.209 INFO:tasks.workunit.client.1.smithi155.stdout:8/685: truncate d2/f16 6656239 0 2024-04-25T15:57:46.211 INFO:tasks.workunit.client.1.smithi155.stdout:9/757: rmdir dc/d13/d60/d7a 39 2024-04-25T15:57:46.211 INFO:tasks.workunit.client.1.smithi155.stdout:8/686: write d2/d5/d40/fa6 [1795646,95761] 0 2024-04-25T15:57:46.215 INFO:tasks.workunit.client.1.smithi155.stdout:8/687: truncate d2/d15/d35/d3d/f6b 292612 0 2024-04-25T15:57:46.217 INFO:tasks.workunit.client.1.smithi155.stdout:4/859: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/fed [0,4194304] 0 2024-04-25T15:57:46.218 INFO:tasks.workunit.client.1.smithi155.stdout:8/688: creat d2/d15/d63/fdd x:0 0 0 2024-04-25T15:57:46.219 INFO:tasks.workunit.client.1.smithi155.stdout:8/689: chown d2/d15/d18/d23/l7c 2 1 2024-04-25T15:57:46.221 INFO:tasks.workunit.client.1.smithi155.stdout:4/860: unlink da/d30/l9c 0 2024-04-25T15:57:46.223 INFO:tasks.workunit.client.1.smithi155.stdout:2/966: dread d7/db/d29/f3c [0,4194304] 0 2024-04-25T15:57:46.226 INFO:tasks.workunit.client.1.smithi155.stdout:9/758: write dc/d13/d2e/d4c/fef [4172643,86170] 0 2024-04-25T15:57:46.231 INFO:tasks.workunit.client.1.smithi155.stdout:9/759: write dc/d13/d60/d7a/fd7 [808429,65745] 0 2024-04-25T15:57:46.233 INFO:tasks.workunit.client.1.smithi155.stdout:9/760: fsync dc/d11/d30/d46/da0/fa5 0 2024-04-25T15:57:46.238 INFO:tasks.workunit.client.1.smithi155.stdout:4/861: dread da/d23/d3f/d56/d69/d4a/d78/d62/d11e/f121 [0,4194304] 0 2024-04-25T15:57:46.238 INFO:tasks.workunit.client.1.smithi155.stdout:8/690: dread d2/d15/d18/d34/f9f [0,4194304] 0 2024-04-25T15:57:46.238 INFO:tasks.workunit.client.1.smithi155.stdout:9/761: unlink dc/d13/d59/c89 0 2024-04-25T15:57:46.240 INFO:tasks.workunit.client.1.smithi155.stdout:8/691: rename d2/d5 to d2/d15/da1/dde 0 2024-04-25T15:57:46.241 INFO:tasks.workunit.client.1.smithi155.stdout:9/762: creat dc/d11/d30/d46/ffa x:0 0 0 2024-04-25T15:57:46.242 INFO:tasks.workunit.client.1.smithi155.stdout:9/763: stat dc/d17/dc0 0 2024-04-25T15:57:46.244 INFO:tasks.workunit.client.1.smithi155.stdout:4/862: rename da/d23/d3f/d56/d69/cee to da/d23/d3a/d7b/d93/c12e 0 2024-04-25T15:57:46.245 INFO:tasks.workunit.client.1.smithi155.stdout:4/863: readlink da/d23/d3f/d56/d69/d83/d10c/d18/l2c 0 2024-04-25T15:57:46.245 INFO:tasks.workunit.client.1.smithi155.stdout:8/692: truncate d2/f16 4901147 0 2024-04-25T15:57:46.248 INFO:tasks.workunit.client.1.smithi155.stdout:2/967: dwrite d7/db/d2e/d44/d95/f102 [0,4194304] 0 2024-04-25T15:57:46.250 INFO:tasks.workunit.client.1.smithi155.stdout:9/764: rename dc/d13/d59/lea to dc/d17/d8e/dae/dd6/lfb 0 2024-04-25T15:57:46.251 INFO:tasks.workunit.client.1.smithi155.stdout:8/693: write d2/d15/d18/d34/f9f [578525,64699] 0 2024-04-25T15:57:46.253 INFO:tasks.workunit.client.1.smithi155.stdout:4/864: symlink da/d23/d3f/d56/d69/d83/d10c/d18/l12f 0 2024-04-25T15:57:46.254 INFO:tasks.workunit.client.1.smithi155.stdout:2/968: write d7/d23/f34 [5212145,19360] 0 2024-04-25T15:57:46.254 INFO:tasks.workunit.client.1.smithi155.stdout:4/865: chown da/d23/d3f/d56/d69/d83/d10c/d18/l1c 38 1 2024-04-25T15:57:46.256 INFO:tasks.workunit.client.1.smithi155.stdout:9/765: stat dc/d74/c87 0 2024-04-25T15:57:46.261 INFO:tasks.workunit.client.1.smithi155.stdout:2/969: write d7/d8e/fc1 [2807162,129610] 0 2024-04-25T15:57:46.262 INFO:tasks.workunit.client.1.smithi155.stdout:4/866: rmdir da/d23/d3f/d56/d69/d83 39 2024-04-25T15:57:46.262 INFO:tasks.workunit.client.1.smithi155.stdout:2/970: read - d7/db/dd/d15/fee zero size 2024-04-25T15:57:46.263 INFO:tasks.workunit.client.1.smithi155.stdout:8/694: symlink d2/d15/d18/d23/d3c/d76/d7e/ddb/ldf 0 2024-04-25T15:57:46.265 INFO:tasks.workunit.client.1.smithi155.stdout:8/695: stat d2/d15/d18/d34/d48/l74 0 2024-04-25T15:57:46.270 INFO:tasks.workunit.client.1.smithi155.stdout:4/867: mkdir da/d23/d3f/d56/d69/d83/d10c/d18/d6e/d130 0 2024-04-25T15:57:46.271 INFO:tasks.workunit.client.1.smithi155.stdout:9/766: getdents dc/d74 0 2024-04-25T15:57:46.272 INFO:tasks.workunit.client.1.smithi155.stdout:9/767: chown dc/d13/d60 436 1 2024-04-25T15:57:46.272 INFO:tasks.workunit.client.1.smithi155.stdout:8/696: getdents d2/d15/d35 0 2024-04-25T15:57:46.273 INFO:tasks.workunit.client.1.smithi155.stdout:4/868: chown da/d23/d3f/d56/d69/d83/d10c/d18/d97/c108 936 1 2024-04-25T15:57:46.275 INFO:tasks.workunit.client.1.smithi155.stdout:4/869: mknod da/d87/ddc/c131 0 2024-04-25T15:57:46.276 INFO:tasks.workunit.client.1.smithi155.stdout:8/697: unlink d2/d15/d18/d23/d2d/f31 0 2024-04-25T15:57:46.277 INFO:tasks.workunit.client.1.smithi155.stdout:2/971: dread d7/db/d2e/d44/f4b [0,4194304] 0 2024-04-25T15:57:46.278 INFO:tasks.workunit.client.1.smithi155.stdout:4/870: dread - da/d23/d3f/d56/d69/d4a/d78/d62/f116 zero size 2024-04-25T15:57:46.280 INFO:tasks.workunit.client.1.smithi155.stdout:4/871: fdatasync da/d23/d3a/fd6 0 2024-04-25T15:57:46.280 INFO:tasks.workunit.client.1.smithi155.stdout:8/698: mkdir d2/d15/d18/d23/d3c/de0 0 2024-04-25T15:57:46.280 INFO:tasks.workunit.client.1.smithi155.stdout:2/972: creat d7/db/d2e/d44/d95/f13a x:0 0 0 2024-04-25T15:57:46.281 INFO:tasks.workunit.client.1.smithi155.stdout:9/768: dwrite dc/d13/d2e/d4c/fef [0,4194304] 0 2024-04-25T15:57:46.283 INFO:tasks.workunit.client.1.smithi155.stdout:8/699: write d2/d15/da1/dde/d40/fa6 [4150536,57120] 0 2024-04-25T15:57:46.285 INFO:tasks.workunit.client.1.smithi155.stdout:2/973: read d7/db/d2e/d44/d70/d7b/d9f/fa6 [510416,109587] 0 2024-04-25T15:57:46.286 INFO:tasks.workunit.client.1.smithi155.stdout:4/872: mknod da/d23/d3f/d56/d69/d83/d10c/d18/c132 0 2024-04-25T15:57:46.287 INFO:tasks.workunit.client.1.smithi155.stdout:4/873: read da/d23/d3f/dc6/de2/fea [35264,21292] 0 2024-04-25T15:57:46.287 INFO:tasks.workunit.client.1.smithi155.stdout:9/769: read dc/d13/d2e/f6d [4017981,14137] 0 2024-04-25T15:57:46.290 INFO:tasks.workunit.client.1.smithi155.stdout:8/700: creat d2/d15/d18/d34/d48/d4e/d81/fe1 x:0 0 0 2024-04-25T15:57:46.293 INFO:tasks.workunit.client.1.smithi155.stdout:4/874: creat da/d23/d3f/d56/d69/d83/d10c/d18/d6e/f133 x:0 0 0 2024-04-25T15:57:46.296 INFO:tasks.workunit.client.1.smithi155.stdout:8/701: mknod d2/d15/d18/d23/dd4/ce2 0 2024-04-25T15:57:46.297 INFO:tasks.workunit.client.1.smithi155.stdout:4/875: creat da/d23/d3f/dc6/de2/f134 x:0 0 0 2024-04-25T15:57:46.297 INFO:tasks.workunit.client.1.smithi155.stdout:2/974: dwrite d7/db/d29/d83/d86/db0/f128 [0,4194304] 0 2024-04-25T15:57:46.299 INFO:tasks.workunit.client.1.smithi155.stdout:4/876: rmdir da 39 2024-04-25T15:57:46.299 INFO:tasks.workunit.client.1.smithi155.stdout:8/702: truncate d2/d15/d63/dc0/fc1 585927 0 2024-04-25T15:57:46.301 INFO:tasks.workunit.client.1.smithi155.stdout:2/975: creat d7/db/dd/d15/dff/f13b x:0 0 0 2024-04-25T15:57:46.303 INFO:tasks.workunit.client.1.smithi155.stdout:4/877: rename da/d23/d3f/d56/c9b to da/d23/d3f/dc6/de2/c135 0 2024-04-25T15:57:46.305 INFO:tasks.workunit.client.1.smithi155.stdout:1/837: sync 2024-04-25T15:57:46.305 INFO:tasks.workunit.client.1.smithi155.stdout:0/813: sync 2024-04-25T15:57:46.305 INFO:tasks.workunit.client.1.smithi155.stdout:8/703: rename d2/d15/d18/d34/d48/d4e/d81/fa3 to d2/d15/d18/d49/dc9/fe3 0 2024-04-25T15:57:46.308 INFO:tasks.workunit.client.1.smithi155.stdout:0/814: dread d1/d41/df4/d47/db0/dd1/fd7 [0,4194304] 0 2024-04-25T15:57:46.308 INFO:tasks.workunit.client.1.smithi155.stdout:4/878: rename da/d23/d3a/cf8 to da/d23/d3f/d56/d69/d83/d10c/d18/d6e/c136 0 2024-04-25T15:57:46.309 INFO:tasks.workunit.client.1.smithi155.stdout:8/704: dread d2/fa [0,4194304] 0 2024-04-25T15:57:46.310 INFO:tasks.workunit.client.1.smithi155.stdout:2/976: dwrite d7/db/d2e/fe9 [4194304,4194304] 0 2024-04-25T15:57:46.311 INFO:tasks.workunit.client.1.smithi155.stdout:8/705: readlink d2/d15/d18/d34/d48/d7f/lc5 0 2024-04-25T15:57:46.312 INFO:tasks.workunit.client.1.smithi155.stdout:8/706: stat d2/d15/d18/d23/d2d/fba 0 2024-04-25T15:57:46.316 INFO:tasks.workunit.client.1.smithi155.stdout:2/977: rename d7/db/d2e/f61 to d7/db/d2e/d44/d9e/dbd/f13c 0 2024-04-25T15:57:46.317 INFO:tasks.workunit.client.1.smithi155.stdout:8/707: mknod d2/d15/d18/d49/dc9/ce4 0 2024-04-25T15:57:46.318 INFO:tasks.workunit.client.1.smithi155.stdout:4/879: dread da/d23/f43 [0,4194304] 0 2024-04-25T15:57:46.324 INFO:tasks.workunit.client.1.smithi155.stdout:4/880: mknod da/d23/d3a/d7b/d93/c137 0 2024-04-25T15:57:46.326 INFO:tasks.workunit.client.1.smithi155.stdout:8/708: symlink d2/d15/d18/d23/d3c/de0/le5 0 2024-04-25T15:57:46.327 INFO:tasks.workunit.client.1.smithi155.stdout:8/709: chown d2/d15/d18/d95 45908 1 2024-04-25T15:57:46.331 INFO:tasks.workunit.client.1.smithi155.stdout:8/710: truncate d2/d15/d18/d23/d3c/fa9 943280 0 2024-04-25T15:57:46.333 INFO:tasks.workunit.client.1.smithi155.stdout:0/815: dwrite d1/d41/df4/d47/db0/dd1/fd7 [0,4194304] 0 2024-04-25T15:57:46.338 INFO:tasks.workunit.client.1.smithi155.stdout:2/978: dread d7/db/d2e/fe9 [0,4194304] 0 2024-04-25T15:57:46.339 INFO:tasks.workunit.client.1.smithi155.stdout:8/711: dread d2/d15/d18/d49/dc9/fe3 [0,4194304] 0 2024-04-25T15:57:46.340 INFO:tasks.workunit.client.1.smithi155.stdout:4/881: dwrite da/d23/d3f/d56/f103 [0,4194304] 0 2024-04-25T15:57:46.341 INFO:tasks.workunit.client.1.smithi155.stdout:0/816: rmdir d1/d3/d5/d5b/dc4/d6e 39 2024-04-25T15:57:46.342 INFO:tasks.workunit.client.1.smithi155.stdout:4/882: fsync da/d23/d3f/d56/f124 0 2024-04-25T15:57:46.344 INFO:tasks.workunit.client.1.smithi155.stdout:4/883: write da/d23/d3f/d56/d69/d4a/d78/f2e [421178,51888] 0 2024-04-25T15:57:46.345 INFO:tasks.workunit.client.1.smithi155.stdout:8/712: creat d2/fe6 x:0 0 0 2024-04-25T15:57:46.349 INFO:tasks.workunit.client.1.smithi155.stdout:0/817: rename d1/d85/d98/d101/d108 to d1/d10c 0 2024-04-25T15:57:46.351 INFO:tasks.workunit.client.1.smithi155.stdout:8/713: creat d2/d15/d18/d23/fe7 x:0 0 0 2024-04-25T15:57:46.351 INFO:tasks.workunit.client.1.smithi155.stdout:2/979: truncate d7/d23/fb3 1106695 0 2024-04-25T15:57:46.354 INFO:tasks.workunit.client.1.smithi155.stdout:8/714: creat d2/d15/d18/d95/fe8 x:0 0 0 2024-04-25T15:57:46.355 INFO:tasks.workunit.client.1.smithi155.stdout:2/980: mkdir d7/db/d13d 0 2024-04-25T15:57:46.355 INFO:tasks.workunit.client.1.smithi155.stdout:2/981: dread - d7/db/dd/f120 zero size 2024-04-25T15:57:46.356 INFO:tasks.workunit.client.1.smithi155.stdout:8/715: unlink d2/d15/da1/dde/c1f 0 2024-04-25T15:57:46.357 INFO:tasks.workunit.client.1.smithi155.stdout:8/716: readlink d2/d15/da1/dde/lf 0 2024-04-25T15:57:46.359 INFO:tasks.workunit.client.1.smithi155.stdout:2/982: rename d7/db/d2e/d90/ddd/c12f to d7/db/d2e/d44/d70/d7b/c13e 0 2024-04-25T15:57:46.364 INFO:tasks.workunit.client.1.smithi155.stdout:2/983: rename d7/db/d2e/d44/d70/cac to d7/c13f 0 2024-04-25T15:57:46.364 INFO:tasks.workunit.client.1.smithi155.stdout:8/717: dwrite d2/d15/d18/d23/d3c/fa9 [0,4194304] 0 2024-04-25T15:57:46.365 INFO:tasks.workunit.client.1.smithi155.stdout:2/984: readlink d7/db/d29/d83/d86/d8b/dbf/l109 0 2024-04-25T15:57:46.367 INFO:tasks.workunit.client.1.smithi155.stdout:0/818: truncate d1/d41/df4/d47/db0/dd1/fd7 2151146 0 2024-04-25T15:57:46.368 INFO:tasks.workunit.client.1.smithi155.stdout:8/718: creat d2/d41/d5d/fe9 x:0 0 0 2024-04-25T15:57:46.372 INFO:tasks.workunit.client.1.smithi155.stdout:8/719: creat d2/d15/da1/dde/fea x:0 0 0 2024-04-25T15:57:46.376 INFO:tasks.workunit.client.1.smithi155.stdout:0/819: dwrite d1/d3/d5/d5b/dd4/fd9 [0,4194304] 0 2024-04-25T15:57:46.379 INFO:tasks.workunit.client.1.smithi155.stdout:0/820: write d1/d3/d5/f26 [10118228,20124] 0 2024-04-25T15:57:46.380 INFO:tasks.workunit.client.1.smithi155.stdout:8/720: rename d2/d15/d18/d34/d48/c56 to d2/d15/d35/ceb 0 2024-04-25T15:57:46.382 INFO:tasks.workunit.client.1.smithi155.stdout:2/985: dwrite d7/db/d2e/d44/d95/f9c [0,4194304] 0 2024-04-25T15:57:46.385 INFO:tasks.workunit.client.1.smithi155.stdout:0/821: unlink d1/d41/df4/d47/fee 0 2024-04-25T15:57:46.388 INFO:tasks.workunit.client.1.smithi155.stdout:2/986: creat d7/db/d13d/f140 x:0 0 0 2024-04-25T15:57:46.388 INFO:tasks.workunit.client.1.smithi155.stdout:8/721: dread d2/f33 [0,4194304] 0 2024-04-25T15:57:46.391 INFO:tasks.workunit.client.1.smithi155.stdout:2/987: creat d7/db/dd/d15/dff/f141 x:0 0 0 2024-04-25T15:57:46.392 INFO:tasks.workunit.client.1.smithi155.stdout:8/722: symlink d2/d15/d18/d49/dc9/lec 0 2024-04-25T15:57:46.396 INFO:tasks.workunit.client.1.smithi155.stdout:2/988: read d7/db/d2e/d44/d9e/dbd/f13c [554146,111668] 0 2024-04-25T15:57:46.401 INFO:tasks.workunit.client.1.smithi155.stdout:2/989: unlink d7/db/d2e/def/c11c 0 2024-04-25T15:57:46.404 INFO:tasks.workunit.client.1.smithi155.stdout:2/990: creat d7/db/d29/d83/d86/d8b/dbf/f142 x:0 0 0 2024-04-25T15:57:46.406 INFO:tasks.workunit.client.1.smithi155.stdout:2/991: creat d7/db/d29/d83/dc8/f143 x:0 0 0 2024-04-25T15:57:46.407 INFO:tasks.workunit.client.1.smithi155.stdout:8/723: write d2/d15/d18/d23/d3c/f47 [756780,94566] 0 2024-04-25T15:57:46.409 INFO:tasks.workunit.client.1.smithi155.stdout:2/992: creat d7/db/d29/d83/dbe/d101/f144 x:0 0 0 2024-04-25T15:57:46.412 INFO:tasks.workunit.client.1.smithi155.stdout:2/993: link d7/db/d2e/f47 d7/db/d2e/def/f145 0 2024-04-25T15:57:46.414 INFO:tasks.workunit.client.1.smithi155.stdout:3/847: sync 2024-04-25T15:57:46.414 INFO:tasks.workunit.client.1.smithi155.stdout:5/875: sync 2024-04-25T15:57:46.414 INFO:tasks.workunit.client.1.smithi155.stdout:7/913: sync 2024-04-25T15:57:46.415 INFO:tasks.workunit.client.1.smithi155.stdout:8/724: dwrite d2/d15/d18/d95/fe8 [0,4194304] 0 2024-04-25T15:57:46.419 INFO:tasks.workunit.client.1.smithi155.stdout:3/848: mknod d1/d4/d10/d21/d73/d77/d5f/dee/c127 0 2024-04-25T15:57:46.421 INFO:tasks.workunit.client.1.smithi155.stdout:7/914: rename d2/d26/d3d/d6d/f97 to d2/dd/d12/d76/db6/d111/d135/f136 0 2024-04-25T15:57:46.422 INFO:tasks.workunit.client.1.smithi155.stdout:5/876: dread d0/d3/d15/d9f/dc3/fd3 [0,4194304] 0 2024-04-25T15:57:46.423 INFO:tasks.workunit.client.1.smithi155.stdout:8/725: symlink d2/d15/d18/d23/d3c/d76/d7e/led 0 2024-04-25T15:57:46.427 INFO:tasks.workunit.client.1.smithi155.stdout:3/849: unlink d1/d4/db/d20/f46 0 2024-04-25T15:57:46.428 INFO:tasks.workunit.client.1.smithi155.stdout:2/994: truncate d7/db/d2e/f8a 1370181 0 2024-04-25T15:57:46.428 INFO:tasks.workunit.client.1.smithi155.stdout:3/850: chown d1/d4/db/d91/dc4/d6c/fc0 2071962 1 2024-04-25T15:57:46.429 INFO:tasks.workunit.client.1.smithi155.stdout:8/726: creat d2/d41/d5d/fee x:0 0 0 2024-04-25T15:57:46.430 INFO:tasks.workunit.client.1.smithi155.stdout:5/877: truncate d0/d3/d15/d30/d4f/f6b 4534321 0 2024-04-25T15:57:46.431 INFO:tasks.workunit.client.1.smithi155.stdout:3/851: mkdir d1/d4/db/d28/d128 0 2024-04-25T15:57:46.432 INFO:tasks.workunit.client.1.smithi155.stdout:5/878: creat d0/d58/d63/da0/dd6/f11e x:0 0 0 2024-04-25T15:57:46.433 INFO:tasks.workunit.client.1.smithi155.stdout:5/879: stat d0/d58/l23 0 2024-04-25T15:57:46.434 INFO:tasks.workunit.client.1.smithi155.stdout:5/880: write d0/d58/d32/f49 [4565372,1212] 0 2024-04-25T15:57:46.434 INFO:tasks.workunit.client.1.smithi155.stdout:3/852: unlink d1/d4/d10/d21/d73/d8d/fa4 0 2024-04-25T15:57:46.435 INFO:tasks.workunit.client.1.smithi155.stdout:3/853: stat d1/d4/db/ld 0 2024-04-25T15:57:46.436 INFO:tasks.workunit.client.1.smithi155.stdout:7/915: dread - d2/dd/d12/d76/db6/d111/d135/f136 zero size 2024-04-25T15:57:46.438 INFO:tasks.workunit.client.1.smithi155.stdout:2/995: getdents d7/db/d2e/d6f/d91 0 2024-04-25T15:57:46.440 INFO:tasks.workunit.client.1.smithi155.stdout:5/881: rename d0/l89 to d0/d3/d15/d1f/d50/d10a/l11f 0 2024-04-25T15:57:46.440 INFO:tasks.workunit.client.1.smithi155.stdout:3/854: rename d1/d4/db/d91 to d1/d4/db/d91/dc4/dd9/d129 22 2024-04-25T15:57:46.441 INFO:tasks.workunit.client.1.smithi155.stdout:8/727: getdents d2/d15/da1 0 2024-04-25T15:57:46.443 INFO:tasks.workunit.client.1.smithi155.stdout:2/996: creat d7/db/d2e/d6f/dc6/f146 x:0 0 0 2024-04-25T15:57:46.444 INFO:tasks.workunit.client.1.smithi155.stdout:7/916: rename d2/dd/d63 to d2/d26/d3d/d6d/d137 0 2024-04-25T15:57:46.449 INFO:tasks.workunit.client.1.smithi155.stdout:5/882: rename d0/d58/l23 to d0/d3/d15/d9f/dc3/l120 0 2024-04-25T15:57:46.449 INFO:tasks.workunit.client.1.smithi155.stdout:2/997: write d7/f49 [1562394,20404] 0 2024-04-25T15:57:46.450 INFO:tasks.workunit.client.1.smithi155.stdout:7/917: symlink d2/dd/d13/d1c/dd9/l138 0 2024-04-25T15:57:46.451 INFO:tasks.workunit.client.1.smithi155.stdout:8/728: dwrite d2/d15/da1/fdc [0,4194304] 0 2024-04-25T15:57:46.454 INFO:tasks.workunit.client.1.smithi155.stdout:2/998: creat d7/db/dd/d15/dd7/f147 x:0 0 0 2024-04-25T15:57:46.455 INFO:tasks.workunit.client.1.smithi155.stdout:7/918: symlink d2/d26/d3d/d6d/l139 0 2024-04-25T15:57:46.460 INFO:tasks.workunit.client.1.smithi155.stdout:2/999: dread d7/d8e/db9/fc9 [0,4194304] 0 2024-04-25T15:57:46.460 INFO:tasks.workunit.client.1.smithi155.stdout:7/919: rename d2/dd/d13/f9b to d2/dd/d66/d8c/f13a 0 2024-04-25T15:57:46.461 INFO:tasks.workunit.client.1.smithi155.stdout:5/883: getdents d0/d3/d15/d9f 0 2024-04-25T15:57:46.462 INFO:tasks.workunit.client.1.smithi155.stdout:3/855: dwrite d1/d4/d10/d21/d73/d77/d5f/fae [0,4194304] 0 2024-04-25T15:57:46.463 INFO:tasks.workunit.client.1.smithi155.stdout:5/884: chown d0/d3/d15/d30/d4f/ff1 213 1 2024-04-25T15:57:46.464 INFO:tasks.workunit.client.1.smithi155.stdout:3/856: read d1/d4/d10/d21/d73/d77/d57/d7c/f83 [1480874,66035] 0 2024-04-25T15:57:46.465 INFO:tasks.workunit.client.1.smithi155.stdout:8/729: truncate d2/d15/d18/d23/d3c/fa9 2532526 0 2024-04-25T15:57:46.465 INFO:tasks.workunit.client.1.smithi155.stdout:5/885: rmdir d0/d47 39 2024-04-25T15:57:46.468 INFO:tasks.workunit.client.1.smithi155.stdout:3/857: write d1/f100 [271676,111466] 0 2024-04-25T15:57:46.468 INFO:tasks.workunit.client.1.smithi155.stdout:5/886: unlink d0/d27/l55 0 2024-04-25T15:57:46.469 INFO:tasks.workunit.client.1.smithi155.stdout:7/920: link d2/dd/d66/d71/la9 d2/dd/d12/d76/l13b 0 2024-04-25T15:57:46.470 INFO:tasks.workunit.client.1.smithi155.stdout:5/887: fdatasync d0/d3/d15/d9f/dc3/fd3 0 2024-04-25T15:57:46.470 INFO:tasks.workunit.client.1.smithi155.stdout:7/921: chown d2/dd/d66/d8c/f13a 31483 1 2024-04-25T15:57:46.471 INFO:tasks.workunit.client.1.smithi155.stdout:8/730: getdents d2/d15/d18/d34/d48/d4e 0 2024-04-25T15:57:46.474 INFO:tasks.workunit.client.1.smithi155.stdout:5/888: chown d0/d3/d15/d9f/cb4 0 1 2024-04-25T15:57:46.475 INFO:tasks.workunit.client.1.smithi155.stdout:7/922: write d2/dd/d13/d24/d35/f114 [786151,126611] 0 2024-04-25T15:57:46.480 INFO:tasks.workunit.client.1.smithi155.stdout:3/858: dwrite d1/f100 [0,4194304] 0 2024-04-25T15:57:46.480 INFO:tasks.workunit.client.1.smithi155.stdout:7/923: mknod d2/dd/d36/dcd/c13c 0 2024-04-25T15:57:46.484 INFO:tasks.workunit.client.1.smithi155.stdout:3/859: rmdir d1/d4/db/d91/de4 39 2024-04-25T15:57:46.485 INFO:tasks.workunit.client.1.smithi155.stdout:5/889: getdents d0/d3/d15/d1f/d50 0 2024-04-25T15:57:46.485 INFO:tasks.workunit.client.1.smithi155.stdout:5/890: readlink d0/d3/d15/ldd 0 2024-04-25T15:57:46.488 INFO:tasks.workunit.client.1.smithi155.stdout:5/891: write d0/d58/d32/f117 [548777,24100] 0 2024-04-25T15:57:46.491 INFO:tasks.workunit.client.1.smithi155.stdout:5/892: fsync d0/d3/d2c/ff4 0 2024-04-25T15:57:46.495 INFO:tasks.workunit.client.1.smithi155.stdout:3/860: write d1/d4/d10/d21/d73/f99 [435248,79503] 0 2024-04-25T15:57:46.495 INFO:tasks.workunit.client.1.smithi155.stdout:7/924: dwrite d2/dd/d13/d1c/f31 [0,4194304] 0 2024-04-25T15:57:46.495 INFO:tasks.workunit.client.1.smithi155.stdout:8/731: dread d2/d15/d18/d23/d2d/f39 [0,4194304] 0 2024-04-25T15:57:46.496 INFO:tasks.workunit.client.1.smithi155.stdout:7/925: stat d2/dd/fc4 0 2024-04-25T15:57:46.498 INFO:tasks.workunit.client.1.smithi155.stdout:8/732: symlink d2/d15/d18/d23/d3c/d76/d7e/lef 0 2024-04-25T15:57:46.500 INFO:tasks.workunit.client.1.smithi155.stdout:7/926: chown d2/dd/d13/d24/d35/db4/l110 73 1 2024-04-25T15:57:46.501 INFO:tasks.workunit.client.1.smithi155.stdout:7/927: write d2/f94 [2083952,120419] 0 2024-04-25T15:57:46.501 INFO:tasks.workunit.client.1.smithi155.stdout:5/893: dwrite d0/d3/d15/d1f/d50/fee [0,4194304] 0 2024-04-25T15:57:46.509 INFO:tasks.workunit.client.1.smithi155.stdout:5/894: dwrite d0/d3/d15/d1f/d50/d7c/fc4 [0,4194304] 0 2024-04-25T15:57:46.511 INFO:tasks.workunit.client.1.smithi155.stdout:5/895: truncate d0/d3/d15/d1f/d50/d60/fc6 23259 0 2024-04-25T15:57:46.523 INFO:tasks.workunit.client.1.smithi155.stdout:5/896: dwrite d0/d3/d15/d1f/d50/d7c/fb5 [4194304,4194304] 0 2024-04-25T15:57:46.526 INFO:tasks.workunit.client.1.smithi155.stdout:5/897: write d0/d47/db3/fda [1003603,37983] 0 2024-04-25T15:57:46.531 INFO:tasks.workunit.client.1.smithi155.stdout:5/898: read d0/d3/d15/d30/d4f/f97 [3114252,29298] 0 2024-04-25T15:57:46.533 INFO:tasks.workunit.client.1.smithi155.stdout:5/899: mknod d0/d58/d63/da0/c121 0 2024-04-25T15:57:46.539 INFO:tasks.workunit.client.1.smithi155.stdout:5/900: dwrite d0/d3/d15/d30/ff2 [0,4194304] 0 2024-04-25T15:57:46.541 INFO:tasks.workunit.client.1.smithi155.stdout:5/901: truncate d0/d58/d32/d6a/d78/f10f 976896 0 2024-04-25T15:57:46.544 INFO:tasks.workunit.client.1.smithi155.stdout:5/902: rename d0/d58/d9b/laf to d0/d58/d63/da0/dd6/l122 0 2024-04-25T15:57:46.544 INFO:tasks.workunit.client.1.smithi155.stdout:5/903: read d0/d58/d63/f110 [219654,4208] 0 2024-04-25T15:57:46.549 INFO:tasks.workunit.client.1.smithi155.stdout:9/770: sync 2024-04-25T15:57:46.550 INFO:tasks.workunit.client.1.smithi155.stdout:9/771: fdatasync dc/d17/d8e/dae/dd6/fc2 0 2024-04-25T15:57:46.554 INFO:tasks.workunit.client.1.smithi155.stdout:9/772: mknod dc/d13/d60/d7a/cfc 0 2024-04-25T15:57:46.557 INFO:tasks.workunit.client.1.smithi155.stdout:9/773: unlink dc/d11/d30/d46/da0/fa5 0 2024-04-25T15:57:46.566 INFO:tasks.workunit.client.1.smithi155.stdout:9/774: rename dc/d13/d48/c90 to dc/d13/d60/d7a/cfd 0 2024-04-25T15:57:46.569 INFO:tasks.workunit.client.1.smithi155.stdout:5/904: dread d0/d3/d15/d30/d4f/f62 [0,4194304] 0 2024-04-25T15:57:46.646 INFO:tasks.workunit.client.1.smithi155.stdout:9/775: dwrite dc/d17/d2a/ff1 [0,4194304] 0 2024-04-25T15:57:46.647 INFO:tasks.workunit.client.1.smithi155.stdout:5/905: truncate d0/d3/d15/d9f/dc3/fd3 847681 0 2024-04-25T15:57:46.650 INFO:tasks.workunit.client.1.smithi155.stdout:9/776: chown dc/d17/d8e/dae/dd6/d56/fb3 85651673 1 2024-04-25T15:57:46.653 INFO:tasks.workunit.client.1.smithi155.stdout:5/906: symlink d0/d58/d63/da0/dd6/l123 0 2024-04-25T15:57:46.654 INFO:tasks.workunit.client.1.smithi155.stdout:5/907: chown d0/d58/f29 55534 1 2024-04-25T15:57:46.659 INFO:tasks.workunit.client.1.smithi155.stdout:5/908: creat d0/d58/f124 x:0 0 0 2024-04-25T15:57:46.664 INFO:tasks.workunit.client.1.smithi155.stdout:5/909: creat d0/d58/dea/f125 x:0 0 0 2024-04-25T15:57:46.668 INFO:tasks.workunit.client.1.smithi155.stdout:5/910: mknod d0/d3/d2c/c126 0 2024-04-25T15:57:46.670 INFO:tasks.workunit.client.1.smithi155.stdout:5/911: fdatasync d0/d58/d63/da0/fab 0 2024-04-25T15:57:46.699 INFO:tasks.workunit.client.1.smithi155.stdout:1/838: sync 2024-04-25T15:57:46.703 INFO:tasks.workunit.client.1.smithi155.stdout:1/839: chown d1/d16/d37/df8/lf3 371779 1 2024-04-25T15:57:46.704 INFO:tasks.workunit.client.1.smithi155.stdout:5/912: truncate d0/d3/d2c/ff4 8773285 0 2024-04-25T15:57:46.706 INFO:tasks.workunit.client.1.smithi155.stdout:5/913: readlink d0/d3/d15/d1f/l6f 0 2024-04-25T15:57:46.709 INFO:tasks.workunit.client.1.smithi155.stdout:5/914: write d0/d3/d15/d1f/d50/d7c/fc4 [1770032,880] 0 2024-04-25T15:57:46.717 INFO:tasks.workunit.client.1.smithi155.stdout:1/840: creat d1/d16/d1d/d29/d5f/d34/d68/d93/db7/f104 x:0 0 0 2024-04-25T15:57:46.717 INFO:tasks.workunit.client.1.smithi155.stdout:5/915: rmdir d0/d58/d32 39 2024-04-25T15:57:46.724 INFO:tasks.workunit.client.1.smithi155.stdout:5/916: write d0/d58/d32/d6a/d78/fe3 [159086,108615] 0 2024-04-25T15:57:46.725 INFO:tasks.workunit.client.1.smithi155.stdout:5/917: chown d0/d47/lcd 4611 1 2024-04-25T15:57:46.738 INFO:tasks.workunit.client.1.smithi155.stdout:1/841: dwrite d1/d16/d1d/d29/d3d/d43/d88/fe8 [0,4194304] 0 2024-04-25T15:57:46.748 INFO:tasks.workunit.client.1.smithi155.stdout:5/918: dwrite d0/d3/d15/d1f/d50/d7c/f7d [0,4194304] 0 2024-04-25T15:57:46.750 INFO:tasks.workunit.client.1.smithi155.stdout:5/919: chown d0/d3/d15/d1f 51 1 2024-04-25T15:57:46.761 INFO:tasks.workunit.client.1.smithi155.stdout:5/920: creat d0/d3/d15/d1f/d50/d7c/d119/f127 x:0 0 0 2024-04-25T15:57:46.765 INFO:tasks.workunit.client.1.smithi155.stdout:0/822: sync 2024-04-25T15:57:46.765 INFO:tasks.workunit.client.1.smithi155.stdout:4/884: sync 2024-04-25T15:57:46.765 INFO:tasks.workunit.client.1.smithi155.stdout:3/861: sync 2024-04-25T15:57:46.765 INFO:tasks.workunit.client.1.smithi155.stdout:1/842: truncate d1/d16/d1d/d29/d3d/f9b 1169332 0 2024-04-25T15:57:46.767 INFO:tasks.workunit.client.1.smithi155.stdout:5/921: mkdir d0/d3/d15/d1f/d50/d128 0 2024-04-25T15:57:46.774 INFO:tasks.workunit.client.1.smithi155.stdout:1/843: rename d1/d6/faf to d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc6/f105 0 2024-04-25T15:57:46.776 INFO:tasks.workunit.client.1.smithi155.stdout:4/885: creat da/d23/d3f/d56/d69/d83/d10c/d18/d6e/d130/f138 x:0 0 0 2024-04-25T15:57:46.777 INFO:tasks.workunit.client.1.smithi155.stdout:4/886: readlink da/d23/d3f/d56/d69/d4a/l65 0 2024-04-25T15:57:46.782 INFO:tasks.workunit.client.1.smithi155.stdout:0/823: mkdir d1/d3/d5/d5b/dc4/d6e/d107/d10d 0 2024-04-25T15:57:46.791 INFO:tasks.workunit.client.1.smithi155.stdout:1/844: mknod d1/d16/d1d/d29/d5f/d34/d68/d93/c106 0 2024-04-25T15:57:46.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/824: fsync d1/d3/d3d/dcb/fd2 0 2024-04-25T15:57:46.800 INFO:tasks.workunit.client.1.smithi155.stdout:4/887: symlink da/d23/da2/l139 0 2024-04-25T15:57:46.811 INFO:tasks.workunit.client.1.smithi155.stdout:0/825: creat d1/d41/df4/d47/f10e x:0 0 0 2024-04-25T15:57:46.812 INFO:tasks.workunit.client.1.smithi155.stdout:4/888: fdatasync da/d23/d3a/d7b/d93/fa8 0 2024-04-25T15:57:46.820 INFO:tasks.workunit.client.1.smithi155.stdout:0/826: unlink d1/ff9 0 2024-04-25T15:57:46.823 INFO:tasks.workunit.client.1.smithi155.stdout:4/889: unlink da/d23/f113 0 2024-04-25T15:57:46.825 INFO:tasks.workunit.client.1.smithi155.stdout:1/845: creat d1/d16/d1d/d29/d3d/f107 x:0 0 0 2024-04-25T15:57:46.828 INFO:tasks.workunit.client.1.smithi155.stdout:5/922: link d0/d3/d15/f8d d0/d3/d15/d1f/d50/d7c/d119/f129 0 2024-04-25T15:57:46.829 INFO:tasks.workunit.client.1.smithi155.stdout:9/777: sync 2024-04-25T15:57:46.829 INFO:tasks.workunit.client.1.smithi155.stdout:8/733: sync 2024-04-25T15:57:46.829 INFO:tasks.workunit.client.1.smithi155.stdout:7/928: sync 2024-04-25T15:57:46.831 INFO:tasks.workunit.client.1.smithi155.stdout:4/890: unlink da/d23/d3f/d56/d69/le9 0 2024-04-25T15:57:46.835 INFO:tasks.workunit.client.1.smithi155.stdout:5/923: chown d0/d3/l24 0 1 2024-04-25T15:57:46.838 INFO:tasks.workunit.client.1.smithi155.stdout:7/929: symlink d2/d26/d3d/d6d/daa/l13d 0 2024-04-25T15:57:46.842 INFO:tasks.workunit.client.1.smithi155.stdout:1/846: symlink d1/d16/d1d/d5e/d8e/l108 0 2024-04-25T15:57:46.843 INFO:tasks.workunit.client.1.smithi155.stdout:1/847: chown d1/d16/d1d/d33/l4a 201550 1 2024-04-25T15:57:46.844 INFO:tasks.workunit.client.1.smithi155.stdout:0/827: creat d1/d3/d12/f10f x:0 0 0 2024-04-25T15:57:46.846 INFO:tasks.workunit.client.1.smithi155.stdout:5/924: creat d0/d3/d15/d1f/d50/d7c/f12a x:0 0 0 2024-04-25T15:57:46.848 INFO:tasks.workunit.client.1.smithi155.stdout:5/925: write d0/d3/d15/d1f/d50/d7c/f7d [2039374,96733] 0 2024-04-25T15:57:46.849 INFO:tasks.workunit.client.1.smithi155.stdout:4/891: mkdir da/d23/d3f/d56/d69/d13a 0 2024-04-25T15:57:46.849 INFO:tasks.workunit.client.1.smithi155.stdout:5/926: read - d0/d58/d63/da0/dd6/fe9 zero size 2024-04-25T15:57:46.851 INFO:tasks.workunit.client.1.smithi155.stdout:7/930: symlink d2/dd/d30/d44/d7f/l13e 0 2024-04-25T15:57:46.854 INFO:tasks.workunit.client.1.smithi155.stdout:1/848: creat d1/d32/d86/f109 x:0 0 0 2024-04-25T15:57:46.854 INFO:tasks.workunit.client.1.smithi155.stdout:5/927: truncate d0/d58/d32/d6a/d78/fe3 998607 0 2024-04-25T15:57:46.856 INFO:tasks.workunit.client.1.smithi155.stdout:9/778: dread dc/d13/d48/f88 [0,4194304] 0 2024-04-25T15:57:46.857 INFO:tasks.workunit.client.1.smithi155.stdout:1/849: fdatasync d1/d16/d1d/d29/d5f/d34/d68/d93/db7/f104 0 2024-04-25T15:57:46.857 INFO:tasks.workunit.client.1.smithi155.stdout:4/892: mknod da/d23/d3a/d7b/d93/c13b 0 2024-04-25T15:57:46.858 INFO:tasks.workunit.client.1.smithi155.stdout:7/931: rmdir d2/d26/d3d/d6d/daa 39 2024-04-25T15:57:46.858 INFO:tasks.workunit.client.1.smithi155.stdout:4/893: chown da/d23/da2/l139 6 1 2024-04-25T15:57:46.860 INFO:tasks.workunit.client.1.smithi155.stdout:7/932: readlink d2/d26/d3d/d6d/db3/l123 0 2024-04-25T15:57:46.860 INFO:tasks.workunit.client.1.smithi155.stdout:0/828: mkdir d1/d3/d12/d92/d104/d110 0 2024-04-25T15:57:46.863 INFO:tasks.workunit.client.1.smithi155.stdout:9/779: chown dc/d13/d60/d7a/cf9 6787141 1 2024-04-25T15:57:46.866 INFO:tasks.workunit.client.1.smithi155.stdout:9/780: write dc/d11/d67/fc8 [237556,825] 0 2024-04-25T15:57:46.866 INFO:tasks.workunit.client.1.smithi155.stdout:4/894: rename da/d23/da2/dad/cde to da/d23/d3f/dc6/c13c 0 2024-04-25T15:57:46.868 INFO:tasks.workunit.client.1.smithi155.stdout:7/933: creat d2/d26/f13f x:0 0 0 2024-04-25T15:57:46.870 INFO:tasks.workunit.client.1.smithi155.stdout:1/850: dread d1/d16/d1d/d33/f4f [0,4194304] 0 2024-04-25T15:57:46.870 INFO:tasks.workunit.client.1.smithi155.stdout:4/895: readlink da/d30/lfe 0 2024-04-25T15:57:46.871 INFO:tasks.workunit.client.1.smithi155.stdout:9/781: chown dc/d11/d30/d46 16327515 1 2024-04-25T15:57:46.876 INFO:tasks.workunit.client.1.smithi155.stdout:5/928: dwrite d0/d58/d32/d6a/d78/fe3 [0,4194304] 0 2024-04-25T15:57:46.876 INFO:tasks.workunit.client.1.smithi155.stdout:1/851: mkdir d1/d16/d1d/d33/d10a 0 2024-04-25T15:57:46.878 INFO:tasks.workunit.client.1.smithi155.stdout:9/782: symlink dc/d17/d8e/de1/lfe 0 2024-04-25T15:57:46.882 INFO:tasks.workunit.client.1.smithi155.stdout:0/829: dread d1/d3/d5/f32 [0,4194304] 0 2024-04-25T15:57:46.886 INFO:tasks.workunit.client.1.smithi155.stdout:0/830: write d1/d3/d3d/dcb/fcc [729878,77737] 0 2024-04-25T15:57:46.886 INFO:tasks.workunit.client.1.smithi155.stdout:7/934: dwrite d2/dd/d36/d46/f51 [0,4194304] 0 2024-04-25T15:57:46.888 INFO:tasks.workunit.client.1.smithi155.stdout:4/896: truncate da/d87/f9d 3318083 0 2024-04-25T15:57:46.890 INFO:tasks.workunit.client.1.smithi155.stdout:1/852: mkdir d1/d16/d1d/d29/d3d/d43/d88/d10b 0 2024-04-25T15:57:46.892 INFO:tasks.workunit.client.1.smithi155.stdout:0/831: fdatasync d1/d41/df4/fa6 0 2024-04-25T15:57:46.894 INFO:tasks.workunit.client.1.smithi155.stdout:0/832: fdatasync d1/d3/d5/d5b/dc4/d60/f6d 0 2024-04-25T15:57:46.897 INFO:tasks.workunit.client.1.smithi155.stdout:1/853: read d1/d16/f27 [3424019,11881] 0 2024-04-25T15:57:46.898 INFO:tasks.workunit.client.1.smithi155.stdout:1/854: readlink d1/d6/lef 0 2024-04-25T15:57:46.908 INFO:tasks.workunit.client.1.smithi155.stdout:7/935: creat d2/d26/d3d/d6d/daa/f140 x:0 0 0 2024-04-25T15:57:46.909 INFO:tasks.workunit.client.1.smithi155.stdout:7/936: dread - d2/dd/d30/d113/f116 zero size 2024-04-25T15:57:46.917 INFO:tasks.workunit.client.1.smithi155.stdout:8/734: sync 2024-04-25T15:57:46.917 INFO:tasks.workunit.client.1.smithi155.stdout:3/862: sync 2024-04-25T15:57:46.917 INFO:tasks.workunit.client.1.smithi155.stdout:4/897: link da/d23/d3f/d56/d69/d83/d10c/d18/f9f da/d23/d3f/d56/d69/d83/f13d 0 2024-04-25T15:57:46.918 INFO:tasks.workunit.client.1.smithi155.stdout:3/863: fsync d1/d4/db/d28/d58/de6/f10e 0 2024-04-25T15:57:46.919 INFO:tasks.workunit.client.1.smithi155.stdout:8/735: truncate d2/d15/d35/fc3 1033365 0 2024-04-25T15:57:46.919 INFO:tasks.workunit.client.1.smithi155.stdout:8/736: dread - d2/fe6 zero size 2024-04-25T15:57:46.920 INFO:tasks.workunit.client.1.smithi155.stdout:8/737: chown d2/d41/c85 10 1 2024-04-25T15:57:46.925 INFO:tasks.workunit.client.1.smithi155.stdout:7/937: creat d2/dd/d13/d24/d8b/f141 x:0 0 0 2024-04-25T15:57:46.929 INFO:tasks.workunit.client.1.smithi155.stdout:9/783: link dc/d17/d8e/dae/dd6/d72/ce4 dc/d74/cff 0 2024-04-25T15:57:46.930 INFO:tasks.workunit.client.1.smithi155.stdout:9/784: readlink dc/d2f/lb4 0 2024-04-25T15:57:46.930 INFO:tasks.workunit.client.1.smithi155.stdout:9/785: stat dc/d13/d59 0 2024-04-25T15:57:46.931 INFO:tasks.workunit.client.1.smithi155.stdout:9/786: fsync dc/d11/d30/d46/ffa 0 2024-04-25T15:57:46.936 INFO:tasks.workunit.client.1.smithi155.stdout:4/898: creat da/d23/d3f/d56/dca/f13e x:0 0 0 2024-04-25T15:57:46.937 INFO:tasks.workunit.client.1.smithi155.stdout:4/899: write da/d23/d3f/dc6/f118 [215124,15961] 0 2024-04-25T15:57:46.940 INFO:tasks.workunit.client.1.smithi155.stdout:1/855: truncate d1/d16/d1d/d29/d5f/d34/f36 3528110 0 2024-04-25T15:57:46.945 INFO:tasks.workunit.client.1.smithi155.stdout:4/900: dwrite da/d23/d3f/dc6/f118 [0,4194304] 0 2024-04-25T15:57:46.945 INFO:tasks.workunit.client.1.smithi155.stdout:8/738: fdatasync d2/d15/d18/d34/d48/f50 0 2024-04-25T15:57:46.946 INFO:tasks.workunit.client.1.smithi155.stdout:4/901: chown da/d23/d3a/l8a 438392 1 2024-04-25T15:57:46.948 INFO:tasks.workunit.client.1.smithi155.stdout:0/833: link d1/d1a/c7d d1/d3/d12/d92/d104/c111 0 2024-04-25T15:57:46.950 INFO:tasks.workunit.client.1.smithi155.stdout:0/834: write d1/d3/d5/d5b/dd4/fd9 [4211279,90545] 0 2024-04-25T15:57:46.951 INFO:tasks.workunit.client.1.smithi155.stdout:0/835: fsync d1/d3/d5/d5b/dc4/d6e/d107/f90 0 2024-04-25T15:57:46.953 INFO:tasks.workunit.client.1.smithi155.stdout:7/938: dread d2/dd/d12/d76/f85 [0,4194304] 0 2024-04-25T15:57:46.959 INFO:tasks.workunit.client.1.smithi155.stdout:0/836: dwrite d1/d41/fff [4194304,4194304] 0 2024-04-25T15:57:46.962 INFO:tasks.workunit.client.1.smithi155.stdout:9/787: dread dc/d11/fd0 [0,4194304] 0 2024-04-25T15:57:46.968 INFO:tasks.workunit.client.1.smithi155.stdout:1/856: fsync d1/d16/d1d/d5e/f7b 0 2024-04-25T15:57:46.969 INFO:tasks.workunit.client.1.smithi155.stdout:5/929: truncate d0/d3/d15/d1f/d50/d7c/f113 640004 0 2024-04-25T15:57:46.970 INFO:tasks.workunit.client.1.smithi155.stdout:3/864: mknod d1/d4/db/c12a 0 2024-04-25T15:57:46.973 INFO:tasks.workunit.client.1.smithi155.stdout:3/865: dread d1/d4/db/d91/dc4/d6c/fe3 [0,4194304] 0 2024-04-25T15:57:46.976 INFO:tasks.workunit.client.1.smithi155.stdout:8/739: creat d2/d15/d18/d23/d3c/de0/ff0 x:0 0 0 2024-04-25T15:57:46.978 INFO:tasks.workunit.client.1.smithi155.stdout:5/930: dwrite d0/d3/d15/d1f/d50/d7c/d119/f127 [0,4194304] 0 2024-04-25T15:57:46.979 INFO:tasks.workunit.client.1.smithi155.stdout:5/931: write d0/d47/d59/fc5 [2615053,33815] 0 2024-04-25T15:57:46.980 INFO:tasks.workunit.client.1.smithi155.stdout:4/902: unlink da/d23/d3f/d56/d69/c41 0 2024-04-25T15:57:46.986 INFO:tasks.workunit.client.1.smithi155.stdout:7/939: truncate d2/dd/d12/f20 1728421 0 2024-04-25T15:57:46.988 INFO:tasks.workunit.client.1.smithi155.stdout:3/866: dread d1/d4/db/f35 [0,4194304] 0 2024-04-25T15:57:46.989 INFO:tasks.workunit.client.1.smithi155.stdout:7/940: write d2/dd/d30/d113/f116 [7997,80521] 0 2024-04-25T15:57:46.992 INFO:tasks.workunit.client.1.smithi155.stdout:4/903: dwrite da/d23/d3f/d56/d69/d4a/d78/f8d [4194304,4194304] 0 2024-04-25T15:57:46.993 INFO:tasks.workunit.client.1.smithi155.stdout:4/904: fdatasync da/d23/d3f/d56/d69/d83/d10c/f2f 0 2024-04-25T15:57:47.006 INFO:tasks.workunit.client.1.smithi155.stdout:5/932: fsync d0/f37 0 2024-04-25T15:57:47.007 INFO:tasks.workunit.client.1.smithi155.stdout:5/933: chown d0/d3/d15/d1f 60 1 2024-04-25T15:57:47.012 INFO:tasks.workunit.client.1.smithi155.stdout:3/867: creat d1/d4/db/d91/dc9/f12b x:0 0 0 2024-04-25T15:57:47.013 INFO:tasks.workunit.client.1.smithi155.stdout:5/934: dwrite d0/d58/d63/da0/fab [0,4194304] 0 2024-04-25T15:57:47.014 INFO:tasks.workunit.client.1.smithi155.stdout:0/837: rename d1/d3/d12/d83/lb4 to d1/d1a/l112 0 2024-04-25T15:57:47.015 INFO:tasks.workunit.client.1.smithi155.stdout:0/838: stat d1/d3/d3d/d46/da4/lc7 0 2024-04-25T15:57:47.025 INFO:tasks.workunit.client.1.smithi155.stdout:5/935: creat d0/d3/d15/d9f/dc3/f12b x:0 0 0 2024-04-25T15:57:47.031 INFO:tasks.workunit.client.1.smithi155.stdout:9/788: truncate dc/d2f/f7b 3988694 0 2024-04-25T15:57:47.034 INFO:tasks.workunit.client.1.smithi155.stdout:3/868: creat d1/d4/db/d91/dc9/d11c/f12c x:0 0 0 2024-04-25T15:57:47.034 INFO:tasks.workunit.client.1.smithi155.stdout:3/869: dread - d1/d4/db/d20/d44/d52/fea zero size 2024-04-25T15:57:47.035 INFO:tasks.workunit.client.1.smithi155.stdout:4/905: creat da/d23/d3f/f13f x:0 0 0 2024-04-25T15:57:47.036 INFO:tasks.workunit.client.1.smithi155.stdout:1/857: link d1/d16/d1d/c57 d1/d16/d1d/d5e/c10c 0 2024-04-25T15:57:47.036 INFO:tasks.workunit.client.1.smithi155.stdout:8/740: getdents d2/d15/d18/d23/d3c/d76/d7e/ddb 0 2024-04-25T15:57:47.037 INFO:tasks.workunit.client.1.smithi155.stdout:7/941: getdents d2/dd/d66/d71 0 2024-04-25T15:57:47.038 INFO:tasks.workunit.client.1.smithi155.stdout:1/858: write d1/d16/d1d/d29/d5f/d34/d68/d93/fdc [371698,112865] 0 2024-04-25T15:57:47.038 INFO:tasks.workunit.client.1.smithi155.stdout:5/936: mkdir d0/d3/d15/d30/d10e/d12c 0 2024-04-25T15:57:47.041 INFO:tasks.workunit.client.1.smithi155.stdout:0/839: getdents d1/d3/d5/d5b/dc4/d6e/d107 0 2024-04-25T15:57:47.043 INFO:tasks.workunit.client.1.smithi155.stdout:1/859: chown d1/d6/c67 17 1 2024-04-25T15:57:47.045 INFO:tasks.workunit.client.1.smithi155.stdout:9/789: getdents dc/d11/d67 0 2024-04-25T15:57:47.045 INFO:tasks.workunit.client.1.smithi155.stdout:4/906: creat da/d23/d3f/f140 x:0 0 0 2024-04-25T15:57:47.046 INFO:tasks.workunit.client.1.smithi155.stdout:5/937: fsync d0/d3/d2c/f85 0 2024-04-25T15:57:47.047 INFO:tasks.workunit.client.1.smithi155.stdout:8/741: link d2/d15/d18/d49/dc9/lec d2/d15/da1/dde/d40/d5b/lf1 0 2024-04-25T15:57:47.048 INFO:tasks.workunit.client.1.smithi155.stdout:9/790: rmdir dc/d74 39 2024-04-25T15:57:47.048 INFO:tasks.workunit.client.1.smithi155.stdout:3/870: dwrite d1/d4/d10/d21/d73/d8d/fda [0,4194304] 0 2024-04-25T15:57:47.051 INFO:tasks.workunit.client.1.smithi155.stdout:1/860: mkdir d1/d10d 0 2024-04-25T15:57:47.054 INFO:tasks.workunit.client.1.smithi155.stdout:4/907: mkdir da/d23/d3f/d56/d69/d4a/d141 0 2024-04-25T15:57:47.054 INFO:tasks.workunit.client.1.smithi155.stdout:7/942: dwrite d2/f91 [0,4194304] 0 2024-04-25T15:57:47.057 INFO:tasks.workunit.client.1.smithi155.stdout:0/840: rename d1/d85/d8c/cf5 to d1/d3/d3d/d46/c113 0 2024-04-25T15:57:47.060 INFO:tasks.workunit.client.1.smithi155.stdout:4/908: fsync da/d23/d3f/d56/d69/d4a/de0/f115 0 2024-04-25T15:57:47.061 INFO:tasks.workunit.client.1.smithi155.stdout:1/861: symlink d1/d16/d1d/d33/da1/de6/l10e 0 2024-04-25T15:57:47.065 INFO:tasks.workunit.client.1.smithi155.stdout:3/871: creat d1/f12d x:0 0 0 2024-04-25T15:57:47.066 INFO:tasks.workunit.client.1.smithi155.stdout:5/938: dwrite d0/d3/d2c/fe2 [0,4194304] 0 2024-04-25T15:57:47.067 INFO:tasks.workunit.client.1.smithi155.stdout:0/841: mkdir d1/d85/d8c/d114 0 2024-04-25T15:57:47.068 INFO:tasks.workunit.client.1.smithi155.stdout:9/791: dwrite dc/d13/d60/fe6 [0,4194304] 0 2024-04-25T15:57:47.072 INFO:tasks.workunit.client.1.smithi155.stdout:7/943: creat d2/dd/d36/dcd/f142 x:0 0 0 2024-04-25T15:57:47.073 INFO:tasks.workunit.client.1.smithi155.stdout:8/742: link d2/d15/da1/dde/d40/d5b/lf1 d2/d15/d18/d23/d3c/lf2 0 2024-04-25T15:57:47.076 INFO:tasks.workunit.client.1.smithi155.stdout:5/939: stat d0/d3/d15/d30/d4f/l64 0 2024-04-25T15:57:47.076 INFO:tasks.workunit.client.1.smithi155.stdout:9/792: chown dc/d17/d8e/dae/dd6/f9e 302011751 1 2024-04-25T15:57:47.080 INFO:tasks.workunit.client.1.smithi155.stdout:4/909: dwrite da/d23/d3f/dc6/dc8/f123 [0,4194304] 0 2024-04-25T15:57:47.081 INFO:tasks.workunit.client.1.smithi155.stdout:9/793: write dc/d17/d8e/dae/dd6/f9e [3365165,85572] 0 2024-04-25T15:57:47.081 INFO:tasks.workunit.client.1.smithi155.stdout:9/794: stat dc/d13 0 2024-04-25T15:57:47.083 INFO:tasks.workunit.client.1.smithi155.stdout:4/910: fsync da/d23/d3f/d56/d69/d83/d10c/fd 0 2024-04-25T15:57:47.083 INFO:tasks.workunit.client.1.smithi155.stdout:0/842: dread d1/d3/d5/d5b/dc4/d6e/fab [0,4194304] 0 2024-04-25T15:57:47.085 INFO:tasks.workunit.client.1.smithi155.stdout:1/862: write d1/d32/f95 [499042,42308] 0 2024-04-25T15:57:47.089 INFO:tasks.workunit.client.1.smithi155.stdout:9/795: rename dc/d13/d60/fe6 to dc/d11/d30/dd2/ddf/f100 0 2024-04-25T15:57:47.092 INFO:tasks.workunit.client.1.smithi155.stdout:7/944: dwrite d2/dd/d36/f73 [0,4194304] 0 2024-04-25T15:57:47.092 INFO:tasks.workunit.client.1.smithi155.stdout:8/743: creat d2/d15/d18/d23/d3c/dc6/ff3 x:0 0 0 2024-04-25T15:57:47.093 INFO:tasks.workunit.client.1.smithi155.stdout:8/744: truncate d2/d41/d5d/fee 612718 0 2024-04-25T15:57:47.097 INFO:tasks.workunit.client.1.smithi155.stdout:7/945: symlink d2/d26/l143 0 2024-04-25T15:57:47.097 INFO:tasks.workunit.client.1.smithi155.stdout:8/745: truncate d2/d15/da1/dde/d40/f58 5321999 0 2024-04-25T15:57:47.097 INFO:tasks.workunit.client.1.smithi155.stdout:3/872: write d1/d4/d10/d21/d73/d8d/f122 [777514,36352] 0 2024-04-25T15:57:47.100 INFO:tasks.workunit.client.1.smithi155.stdout:9/796: dwrite dc/d11/d67/ff0 [0,4194304] 0 2024-04-25T15:57:47.100 INFO:tasks.workunit.client.1.smithi155.stdout:7/946: chown d2/d26/d3d/d65/f72 5703 1 2024-04-25T15:57:47.102 INFO:tasks.workunit.client.1.smithi155.stdout:3/873: write d1/d4/db/d20/d44/d52/fea [610088,54285] 0 2024-04-25T15:57:47.103 INFO:tasks.workunit.client.1.smithi155.stdout:9/797: rmdir dc/d11/d67 39 2024-04-25T15:57:47.103 INFO:tasks.workunit.client.1.smithi155.stdout:8/746: dread d2/d15/d35/d3d/f6b [0,4194304] 0 2024-04-25T15:57:47.104 INFO:tasks.workunit.client.1.smithi155.stdout:9/798: readlink dc/d13/l82 0 2024-04-25T15:57:47.105 INFO:tasks.workunit.client.1.smithi155.stdout:5/940: write d0/d3/f4a [842279,98883] 0 2024-04-25T15:57:47.108 INFO:tasks.workunit.client.1.smithi155.stdout:3/874: unlink d1/d4/d10/d21/d73/d77/c67 0 2024-04-25T15:57:47.109 INFO:tasks.workunit.client.1.smithi155.stdout:4/911: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110/f96 [0,4194304] 0 2024-04-25T15:57:47.111 INFO:tasks.workunit.client.1.smithi155.stdout:4/912: chown da/d23/d3f/d56/dca/l127 38 1 2024-04-25T15:57:47.112 INFO:tasks.workunit.client.1.smithi155.stdout:7/947: rename d2/d26/ld5 to d2/dd/d12/d76/db6/d111/d135/l144 0 2024-04-25T15:57:47.112 INFO:tasks.workunit.client.1.smithi155.stdout:9/799: mkdir dc/d11/d30/d46/da0/d101 0 2024-04-25T15:57:47.114 INFO:tasks.workunit.client.1.smithi155.stdout:1/863: dwrite d1/d16/d1d/d29/d5f/d34/f36 [0,4194304] 0 2024-04-25T15:57:47.114 INFO:tasks.workunit.client.1.smithi155.stdout:4/913: dread - da/d23/d3f/d56/d69/d83/d10c/fcc zero size 2024-04-25T15:57:47.118 INFO:tasks.workunit.client.1.smithi155.stdout:9/800: fsync dc/d17/d8e/dae/fcc 0 2024-04-25T15:57:47.121 INFO:tasks.workunit.client.1.smithi155.stdout:3/875: dwrite d1/d4/d10/d21/dab/f108 [0,4194304] 0 2024-04-25T15:57:47.123 INFO:tasks.workunit.client.1.smithi155.stdout:3/876: write d1/d4/d10/d21/d73/fa5 [609383,101196] 0 2024-04-25T15:57:47.132 INFO:tasks.workunit.client.1.smithi155.stdout:3/877: fdatasync d1/d4/db/f8a 0 2024-04-25T15:57:47.132 INFO:tasks.workunit.client.1.smithi155.stdout:1/864: rename d1/d32/d86/la5 to d1/d16/d1d/d29/l10f 0 2024-04-25T15:57:47.135 INFO:tasks.workunit.client.1.smithi155.stdout:4/914: fsync da/f21 0 2024-04-25T15:57:47.136 INFO:tasks.workunit.client.1.smithi155.stdout:7/948: write d2/dd/d30/dbc/fee [402524,99916] 0 2024-04-25T15:57:47.136 INFO:tasks.workunit.client.1.smithi155.stdout:4/915: stat da/d23/d3f/d56/d69/d4a/d78/d62/f7e 0 2024-04-25T15:57:47.141 INFO:tasks.workunit.client.1.smithi155.stdout:9/801: truncate dc/d13/d59/f5f 3933992 0 2024-04-25T15:57:47.158 INFO:tasks.workunit.client.1.smithi155.stdout:7/949: unlink d2/d26/d3d/d6d/d137/l99 0 2024-04-25T15:57:47.160 INFO:tasks.workunit.client.1.smithi155.stdout:9/802: mkdir dc/d17/d8e/dae/dd6/d56/d102 0 2024-04-25T15:57:47.164 INFO:tasks.workunit.client.1.smithi155.stdout:4/916: link da/d23/d3f/d56/d69/d83/d10c/d18/fed da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/d129/f142 0 2024-04-25T15:57:47.166 INFO:tasks.workunit.client.1.smithi155.stdout:1/865: dread d1/d32/d86/f87 [0,4194304] 0 2024-04-25T15:57:47.166 INFO:tasks.workunit.client.1.smithi155.stdout:9/803: creat dc/d17/d8e/de1/f103 x:0 0 0 2024-04-25T15:57:47.167 INFO:tasks.workunit.client.1.smithi155.stdout:4/917: readlink da/l29 0 2024-04-25T15:57:47.167 INFO:tasks.workunit.client.1.smithi155.stdout:4/918: fsync da/d23/d3f/dc6/f118 0 2024-04-25T15:57:47.168 INFO:tasks.workunit.client.1.smithi155.stdout:7/950: creat d2/dd/d12/f145 x:0 0 0 2024-04-25T15:57:47.172 INFO:tasks.workunit.client.1.smithi155.stdout:9/804: mkdir dc/d11/d67/d104 0 2024-04-25T15:57:47.174 INFO:tasks.workunit.client.1.smithi155.stdout:9/805: fdatasync dc/d17/f51 0 2024-04-25T15:57:47.174 INFO:tasks.workunit.client.1.smithi155.stdout:1/866: getdents d1/d16/d1d/d33/da1/de0 0 2024-04-25T15:57:47.175 INFO:tasks.workunit.client.1.smithi155.stdout:4/919: dwrite da/d23/da2/fae [0,4194304] 0 2024-04-25T15:57:47.178 INFO:tasks.workunit.client.1.smithi155.stdout:9/806: mkdir dc/d17/d8e/dae/dd6/d105 0 2024-04-25T15:57:47.179 INFO:tasks.workunit.client.1.smithi155.stdout:1/867: mknod d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc6/c110 0 2024-04-25T15:57:47.182 INFO:tasks.workunit.client.1.smithi155.stdout:9/807: creat dc/d17/d2a/f106 x:0 0 0 2024-04-25T15:57:47.186 INFO:tasks.workunit.client.1.smithi155.stdout:9/808: mknod dc/d17/dc0/dc9/c107 0 2024-04-25T15:57:47.186 INFO:tasks.workunit.client.1.smithi155.stdout:4/920: dwrite da/d23/d3f/d56/d69/d83/d10c/f1d [4194304,4194304] 0 2024-04-25T15:57:47.187 INFO:tasks.workunit.client.1.smithi155.stdout:9/809: dread - dc/d11/d5a/fca zero size 2024-04-25T15:57:47.188 INFO:tasks.workunit.client.1.smithi155.stdout:7/951: dread d2/f8 [8388608,4194304] 0 2024-04-25T15:57:47.189 INFO:tasks.workunit.client.1.smithi155.stdout:3/878: write d1/d4/db/d20/f4c [1309339,44875] 0 2024-04-25T15:57:47.190 INFO:tasks.workunit.client.1.smithi155.stdout:9/810: stat dc/d74/fdb 0 2024-04-25T15:57:47.193 INFO:tasks.workunit.client.1.smithi155.stdout:1/868: link d1/d16/d1d/d29/l6f d1/d32/d77/l111 0 2024-04-25T15:57:47.194 INFO:tasks.workunit.client.1.smithi155.stdout:1/869: stat d1/d16/l46 0 2024-04-25T15:57:47.195 INFO:tasks.workunit.client.1.smithi155.stdout:9/811: rmdir dc/d13/d48 39 2024-04-25T15:57:47.196 INFO:tasks.workunit.client.1.smithi155.stdout:7/952: getdents d2/dd/d30/d113 0 2024-04-25T15:57:47.197 INFO:tasks.workunit.client.1.smithi155.stdout:4/921: dread da/d23/d3f/d56/d69/d4a/d78/d62/d11e/f121 [0,4194304] 0 2024-04-25T15:57:47.197 INFO:tasks.workunit.client.1.smithi155.stdout:9/812: mknod dc/d3c/c108 0 2024-04-25T15:57:47.200 INFO:tasks.workunit.client.1.smithi155.stdout:3/879: rename d1/d4/d10/d21/d73/d77/de9 to d1/d4/db/d91/d12e 0 2024-04-25T15:57:47.201 INFO:tasks.workunit.client.1.smithi155.stdout:4/922: symlink da/d23/d3f/d56/d69/d102/l143 0 2024-04-25T15:57:47.204 INFO:tasks.workunit.client.1.smithi155.stdout:1/870: rename d1/f12 to d1/d16/d1d/d29/d5f/f112 0 2024-04-25T15:57:47.205 INFO:tasks.workunit.client.1.smithi155.stdout:3/880: readlink d1/d4/db/d91/d12e/lf6 0 2024-04-25T15:57:47.208 INFO:tasks.workunit.client.1.smithi155.stdout:7/953: dwrite d2/dd/d13/d24/d35/f117 [0,4194304] 0 2024-04-25T15:57:47.208 INFO:tasks.workunit.client.1.smithi155.stdout:1/871: chown d1/d16/d1d/d29/d3d/d43/d88 1651320614 1 2024-04-25T15:57:47.210 INFO:tasks.workunit.client.1.smithi155.stdout:9/813: dwrite dc/d13/d59/fbf [0,4194304] 0 2024-04-25T15:57:47.210 INFO:tasks.workunit.client.1.smithi155.stdout:4/923: rename da/d23/d3f/d56/d69/d4a/d78/f122 to da/d23/d3f/d56/dca/f144 0 2024-04-25T15:57:47.211 INFO:tasks.workunit.client.1.smithi155.stdout:3/881: write d1/d4/d10/d21/d73/d77/d57/d80/f124 [440139,48363] 0 2024-04-25T15:57:47.213 INFO:tasks.workunit.client.1.smithi155.stdout:7/954: symlink d2/dd/d30/d44/l146 0 2024-04-25T15:57:47.217 INFO:tasks.workunit.client.1.smithi155.stdout:7/955: symlink d2/dd/d30/dbc/l147 0 2024-04-25T15:57:47.221 INFO:tasks.workunit.client.1.smithi155.stdout:3/882: mknod d1/d4/db/d91/dc9/c12f 0 2024-04-25T15:57:47.223 INFO:tasks.workunit.client.1.smithi155.stdout:1/872: getdents d1/d16 0 2024-04-25T15:57:47.224 INFO:tasks.workunit.client.1.smithi155.stdout:4/924: creat da/d23/d3f/d56/d69/f145 x:0 0 0 2024-04-25T15:57:47.226 INFO:tasks.workunit.client.1.smithi155.stdout:7/956: dwrite d2/d26/f112 [0,4194304] 0 2024-04-25T15:57:47.227 INFO:tasks.workunit.client.1.smithi155.stdout:0/843: sync 2024-04-25T15:57:47.228 INFO:tasks.workunit.client.1.smithi155.stdout:0/844: dread - d1/d41/df4/d47/f10e zero size 2024-04-25T15:57:47.230 INFO:tasks.workunit.client.1.smithi155.stdout:0/845: readlink d1/d3/d12/d83/l89 0 2024-04-25T15:57:47.231 INFO:tasks.workunit.client.1.smithi155.stdout:0/846: write d1/d3/d6a/f73 [4797874,15675] 0 2024-04-25T15:57:47.232 INFO:tasks.workunit.client.1.smithi155.stdout:4/925: creat da/d23/d3f/d56/d69/d4a/d78/d62/dc0/f146 x:0 0 0 2024-04-25T15:57:47.234 INFO:tasks.workunit.client.1.smithi155.stdout:3/883: read d1/d4/d10/d21/d73/d77/d5f/db3/f106 [3499025,78976] 0 2024-04-25T15:57:47.236 INFO:tasks.workunit.client.1.smithi155.stdout:4/926: dread - da/d23/d3f/d56/d69/f114 zero size 2024-04-25T15:57:47.238 INFO:tasks.workunit.client.1.smithi155.stdout:0/847: mknod d1/d85/d8c/d9e/c115 0 2024-04-25T15:57:47.239 INFO:tasks.workunit.client.1.smithi155.stdout:7/957: dwrite d2/dd/d30/ffc [0,4194304] 0 2024-04-25T15:57:47.241 INFO:tasks.workunit.client.1.smithi155.stdout:3/884: mknod d1/d4/d10/d21/d73/d77/d5f/dee/c130 0 2024-04-25T15:57:47.242 INFO:tasks.workunit.client.1.smithi155.stdout:7/958: dread - d2/d26/d3d/fff zero size 2024-04-25T15:57:47.245 INFO:tasks.workunit.client.1.smithi155.stdout:3/885: stat d1/d4/db/d91/dc9/c12f 0 2024-04-25T15:57:47.250 INFO:tasks.workunit.client.1.smithi155.stdout:9/814: dread dc/d17/d8e/dae/dd6/f23 [4194304,4194304] 0 2024-04-25T15:57:47.250 INFO:tasks.workunit.client.1.smithi155.stdout:7/959: fdatasync d2/dd/d66/d8c/fc8 0 2024-04-25T15:57:47.250 INFO:tasks.workunit.client.1.smithi155.stdout:4/927: write da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/d129/f142 [3193930,107960] 0 2024-04-25T15:57:47.251 INFO:tasks.workunit.client.1.smithi155.stdout:1/873: dwrite d1/d16/f27 [0,4194304] 0 2024-04-25T15:57:47.253 INFO:tasks.workunit.client.1.smithi155.stdout:0/848: dwrite d1/d3/d5/d5b/dc4/d6e/d107/f75 [0,4194304] 0 2024-04-25T15:57:47.253 INFO:tasks.workunit.client.1.smithi155.stdout:3/886: getdents d1/d4/db/d91/dc4/d6c/d111 0 2024-04-25T15:57:47.256 INFO:tasks.workunit.client.1.smithi155.stdout:1/874: write d1/d16/d1d/d33/fec [986413,124349] 0 2024-04-25T15:57:47.256 INFO:tasks.workunit.client.1.smithi155.stdout:0/849: chown d1/d41/df4/fa6 122 1 2024-04-25T15:57:47.256 INFO:tasks.workunit.client.1.smithi155.stdout:4/928: rmdir da/d23/d3f/dc6 39 2024-04-25T15:57:47.256 INFO:tasks.workunit.client.1.smithi155.stdout:7/960: mknod d2/dd/d30/dbc/c148 0 2024-04-25T15:57:47.258 INFO:tasks.workunit.client.1.smithi155.stdout:1/875: readlink d1/d16/d1d/d33/da1/de6/l10e 0 2024-04-25T15:57:47.259 INFO:tasks.workunit.client.1.smithi155.stdout:7/961: stat d2/dd/d30/d44/d7f/l129 0 2024-04-25T15:57:47.261 INFO:tasks.workunit.client.1.smithi155.stdout:8/747: sync 2024-04-25T15:57:47.261 INFO:tasks.workunit.client.1.smithi155.stdout:5/941: sync 2024-04-25T15:57:47.262 INFO:tasks.workunit.client.1.smithi155.stdout:4/929: symlink da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/l147 0 2024-04-25T15:57:47.263 INFO:tasks.workunit.client.1.smithi155.stdout:8/748: chown d2/d15/d35/fc3 0 1 2024-04-25T15:57:47.263 INFO:tasks.workunit.client.1.smithi155.stdout:3/887: link d1/d4/ff3 d1/d4/d10/d21/d73/d77/d57/d80/d109/f131 0 2024-04-25T15:57:47.264 INFO:tasks.workunit.client.1.smithi155.stdout:1/876: symlink d1/d16/d1d/d29/d3d/dfd/l113 0 2024-04-25T15:57:47.265 INFO:tasks.workunit.client.1.smithi155.stdout:5/942: readlink d0/d58/d63/da0/lb0 0 2024-04-25T15:57:47.265 INFO:tasks.workunit.client.1.smithi155.stdout:4/930: write da/d23/d3a/d7b/d93/fc5 [651018,107687] 0 2024-04-25T15:57:47.265 INFO:tasks.workunit.client.1.smithi155.stdout:7/962: truncate d2/dd/d13/d24/d35/db4/f132 261728 0 2024-04-25T15:57:47.266 INFO:tasks.workunit.client.1.smithi155.stdout:8/749: chown d2/d15/d18/d34/f9f 0 1 2024-04-25T15:57:47.267 INFO:tasks.workunit.client.1.smithi155.stdout:7/963: stat d2/dd/d13/d24/d8b/fbf 0 2024-04-25T15:57:47.268 INFO:tasks.workunit.client.1.smithi155.stdout:1/877: chown d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc6 98 1 2024-04-25T15:57:47.268 INFO:tasks.workunit.client.1.smithi155.stdout:3/888: creat d1/d4/db/d20/f132 x:0 0 0 2024-04-25T15:57:47.269 INFO:tasks.workunit.client.1.smithi155.stdout:0/850: dread d1/d3/d12/f84 [0,4194304] 0 2024-04-25T15:57:47.272 INFO:tasks.workunit.client.1.smithi155.stdout:7/964: read d2/f37 [4580208,111969] 0 2024-04-25T15:57:47.272 INFO:tasks.workunit.client.1.smithi155.stdout:0/851: write d1/d3/d5/d5b/dc4/dfc/f109 [1042595,50212] 0 2024-04-25T15:57:47.273 INFO:tasks.workunit.client.1.smithi155.stdout:8/750: unlink d2/d15/d18/d34/d48/f8f 0 2024-04-25T15:57:47.274 INFO:tasks.workunit.client.1.smithi155.stdout:3/889: write d1/d4/db/d91/dc4/f3c [6426516,13561] 0 2024-04-25T15:57:47.276 INFO:tasks.workunit.client.1.smithi155.stdout:0/852: unlink d1/d1a/cef 0 2024-04-25T15:57:47.276 INFO:tasks.workunit.client.1.smithi155.stdout:7/965: readlink d2/dd/d66/db2/db9/lbe 0 2024-04-25T15:57:47.277 INFO:tasks.workunit.client.1.smithi155.stdout:5/943: getdents d0/d58/d63/da0/dd6 0 2024-04-25T15:57:47.278 INFO:tasks.workunit.client.1.smithi155.stdout:7/966: chown d2/dd/d30/d44/d7f/c10b 6586198 1 2024-04-25T15:57:47.278 INFO:tasks.workunit.client.1.smithi155.stdout:7/967: dread - d2/dd/d30/f122 zero size 2024-04-25T15:57:47.279 INFO:tasks.workunit.client.1.smithi155.stdout:0/853: symlink d1/d41/df4/d47/l116 0 2024-04-25T15:57:47.281 INFO:tasks.workunit.client.1.smithi155.stdout:3/890: symlink d1/d4/d10/d21/deb/l133 0 2024-04-25T15:57:47.282 INFO:tasks.workunit.client.1.smithi155.stdout:7/968: creat d2/dd/d12/df3/f149 x:0 0 0 2024-04-25T15:57:47.284 INFO:tasks.workunit.client.1.smithi155.stdout:7/969: stat d2/dd/f2f 0 2024-04-25T15:57:47.284 INFO:tasks.workunit.client.1.smithi155.stdout:0/854: fsync d1/d41/df4/d47/fa3 0 2024-04-25T15:57:47.286 INFO:tasks.workunit.client.1.smithi155.stdout:8/751: getdents d2/d15/da1/dde/d40/d5b 0 2024-04-25T15:57:47.286 INFO:tasks.workunit.client.1.smithi155.stdout:5/944: dwrite d0/d58/f56 [0,4194304] 0 2024-04-25T15:57:47.286 INFO:tasks.workunit.client.1.smithi155.stdout:1/878: write d1/d32/d86/f87 [1845057,693] 0 2024-04-25T15:57:47.288 INFO:tasks.workunit.client.1.smithi155.stdout:0/855: readlink d1/d3/d5/da/l76 0 2024-04-25T15:57:47.293 INFO:tasks.workunit.client.1.smithi155.stdout:1/879: write d1/d32/d86/fb2 [759669,31421] 0 2024-04-25T15:57:47.293 INFO:tasks.workunit.client.1.smithi155.stdout:8/752: write d2/d15/da1/fbc [869216,78724] 0 2024-04-25T15:57:47.294 INFO:tasks.workunit.client.1.smithi155.stdout:3/891: rename d1/d4/d10/d21/d73/d77/d57/d80/fa0 to d1/d4/db/d91/f134 0 2024-04-25T15:57:47.297 INFO:tasks.workunit.client.1.smithi155.stdout:0/856: write d1/d3/d5/d5b/dc4/d6e/d107/f75 [3673082,94055] 0 2024-04-25T15:57:47.297 INFO:tasks.workunit.client.1.smithi155.stdout:1/880: rmdir d1/d16/d1d/d5e 39 2024-04-25T15:57:47.299 INFO:tasks.workunit.client.1.smithi155.stdout:8/753: write d2/d15/d18/d23/d2d/f5a [262247,10286] 0 2024-04-25T15:57:47.300 INFO:tasks.workunit.client.1.smithi155.stdout:5/945: rename d0/d58/d32/d6a/d78/f87 to d0/d3/d15/d30/f12d 0 2024-04-25T15:57:47.301 INFO:tasks.workunit.client.1.smithi155.stdout:9/815: dread dc/d13/d59/f5f [0,4194304] 0 2024-04-25T15:57:47.302 INFO:tasks.workunit.client.1.smithi155.stdout:4/931: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/d6e/f4e [0,4194304] 0 2024-04-25T15:57:47.303 INFO:tasks.workunit.client.1.smithi155.stdout:0/857: write d1/d3/d6a/d9b/fe1 [2631683,12488] 0 2024-04-25T15:57:47.304 INFO:tasks.workunit.client.1.smithi155.stdout:7/970: dwrite d2/dd/d30/d113/f116 [0,4194304] 0 2024-04-25T15:57:47.305 INFO:tasks.workunit.client.1.smithi155.stdout:1/881: creat d1/d16/d37/f114 x:0 0 0 2024-04-25T15:57:47.306 INFO:tasks.workunit.client.1.smithi155.stdout:5/946: write d0/d3/d15/d1f/d50/d7c/fb5 [7003169,6451] 0 2024-04-25T15:57:47.308 INFO:tasks.workunit.client.1.smithi155.stdout:4/932: dread - da/d23/d3f/d56/d69/d83/d10c/d18/fda zero size 2024-04-25T15:57:47.310 INFO:tasks.workunit.client.1.smithi155.stdout:8/754: rename d2/d15/d35/d3d to d2/d15/d18/d49/df4 0 2024-04-25T15:57:47.310 INFO:tasks.workunit.client.1.smithi155.stdout:1/882: chown d1/d16/d1d/d29/d5f/f7c 48689266 1 2024-04-25T15:57:47.313 INFO:tasks.workunit.client.1.smithi155.stdout:8/755: creat d2/d41/ff5 x:0 0 0 2024-04-25T15:57:47.314 INFO:tasks.workunit.client.1.smithi155.stdout:7/971: rename d2/dd/d36/dcd/f142 to d2/dd/d36/dcd/dc9/f14a 0 2024-04-25T15:57:47.315 INFO:tasks.workunit.client.1.smithi155.stdout:1/883: symlink d1/l115 0 2024-04-25T15:57:47.316 INFO:tasks.workunit.client.1.smithi155.stdout:5/947: truncate d0/d3/d15/d1f/fbf 813678 0 2024-04-25T15:57:47.316 INFO:tasks.workunit.client.1.smithi155.stdout:8/756: write d2/d15/d18/d34/d48/d7f/fb1 [1968828,36513] 0 2024-04-25T15:57:47.317 INFO:tasks.workunit.client.1.smithi155.stdout:1/884: write d1/d32/d86/f87 [445246,10326] 0 2024-04-25T15:57:47.319 INFO:tasks.workunit.client.1.smithi155.stdout:0/858: dread d1/d3/d5/faa [0,4194304] 0 2024-04-25T15:57:47.319 INFO:tasks.workunit.client.1.smithi155.stdout:7/972: mkdir d2/dd/d30/d44/ddd/d14b 0 2024-04-25T15:57:47.319 INFO:tasks.workunit.client.1.smithi155.stdout:8/757: write d2/d15/d18/d23/d2d/f5a [706631,30888] 0 2024-04-25T15:57:47.320 INFO:tasks.workunit.client.1.smithi155.stdout:1/885: fdatasync d1/d16/d1d/d29/d3d/fbd 0 2024-04-25T15:57:47.321 INFO:tasks.workunit.client.1.smithi155.stdout:0/859: write d1/d85/d8c/fe0 [369394,19565] 0 2024-04-25T15:57:47.323 INFO:tasks.workunit.client.1.smithi155.stdout:1/886: read d1/d16/d37/f69 [3462262,41752] 0 2024-04-25T15:57:47.323 INFO:tasks.workunit.client.1.smithi155.stdout:9/816: dread fa [0,4194304] 0 2024-04-25T15:57:47.324 INFO:tasks.workunit.client.1.smithi155.stdout:8/758: mkdir d2/d15/d18/d23/d2d/da5/df6 0 2024-04-25T15:57:47.325 INFO:tasks.workunit.client.1.smithi155.stdout:9/817: write dc/d13/de5/fe8 [555416,59501] 0 2024-04-25T15:57:47.327 INFO:tasks.workunit.client.1.smithi155.stdout:0/860: rename d1/d3/d5/d5b/dc4/d6e/d107/c19 to d1/d41/df4/c117 0 2024-04-25T15:57:47.327 INFO:tasks.workunit.client.1.smithi155.stdout:8/759: read d2/d15/d35/f78 [44835,104051] 0 2024-04-25T15:57:47.327 INFO:tasks.workunit.client.1.smithi155.stdout:9/818: dread - dc/d17/d2a/fc5 zero size 2024-04-25T15:57:47.329 INFO:tasks.workunit.client.1.smithi155.stdout:8/760: chown d2/d15/da1/dde/d40 466 1 2024-04-25T15:57:47.329 INFO:tasks.workunit.client.1.smithi155.stdout:1/887: creat d1/d16/d1d/d29/d3d/d43/d88/f116 x:0 0 0 2024-04-25T15:57:47.330 INFO:tasks.workunit.client.1.smithi155.stdout:7/973: getdents d2/dd/d13/d24/d35/db4 0 2024-04-25T15:57:47.333 INFO:tasks.workunit.client.1.smithi155.stdout:9/819: rename dc/d13/d2e/d4c/c7c to dc/d13/d59/c109 0 2024-04-25T15:57:47.335 INFO:tasks.workunit.client.1.smithi155.stdout:1/888: mkdir d1/d16/d1d/d33/da1/de6/d117 0 2024-04-25T15:57:47.335 INFO:tasks.workunit.client.1.smithi155.stdout:4/933: dread da/d87/ddc/ff9 [0,4194304] 0 2024-04-25T15:57:47.336 INFO:tasks.workunit.client.1.smithi155.stdout:7/974: mkdir d2/dd/d36/d14c 0 2024-04-25T15:57:47.339 INFO:tasks.workunit.client.1.smithi155.stdout:9/820: rmdir dc/d17/d8e 39 2024-04-25T15:57:47.342 INFO:tasks.workunit.client.1.smithi155.stdout:0/861: truncate d1/d3/d5/d5b/dc4/d60/f6d 3418765 0 2024-04-25T15:57:47.343 INFO:tasks.workunit.client.1.smithi155.stdout:4/934: dwrite da/d87/ddc/f10a [0,4194304] 0 2024-04-25T15:57:47.343 INFO:tasks.workunit.client.1.smithi155.stdout:0/862: chown d1/d3/d6a/f73 132076 1 2024-04-25T15:57:47.344 INFO:tasks.workunit.client.1.smithi155.stdout:7/975: mkdir d2/dd/d12/d76/db6/d111/d14d 0 2024-04-25T15:57:47.345 INFO:tasks.workunit.client.1.smithi155.stdout:5/948: truncate d0/d3/d15/d30/d4f/ff1 280479 0 2024-04-25T15:57:47.346 INFO:tasks.workunit.client.1.smithi155.stdout:1/889: creat d1/d16/d1d/d29/d3d/d43/d88/d10b/f118 x:0 0 0 2024-04-25T15:57:47.347 INFO:tasks.workunit.client.1.smithi155.stdout:5/949: fsync d0/d58/d63/da0/dd6/fe9 0 2024-04-25T15:57:47.348 INFO:tasks.workunit.client.1.smithi155.stdout:5/950: fdatasync d0/d47/db3/fda 0 2024-04-25T15:57:47.350 INFO:tasks.workunit.client.1.smithi155.stdout:0/863: unlink d1/d41/df4/d47/lb3 0 2024-04-25T15:57:47.352 INFO:tasks.workunit.client.1.smithi155.stdout:7/976: creat d2/dd/d13/d1c/f14e x:0 0 0 2024-04-25T15:57:47.352 INFO:tasks.workunit.client.1.smithi155.stdout:4/935: dread da/d23/d3f/d56/d69/d4a/d78/d62/dc0/fdf [0,4194304] 0 2024-04-25T15:57:47.353 INFO:tasks.workunit.client.1.smithi155.stdout:7/977: fdatasync d2/dd/d13/d24/d35/f3f 0 2024-04-25T15:57:47.354 INFO:tasks.workunit.client.1.smithi155.stdout:8/761: getdents d2/d15/d18/d49/df4/d6c 0 2024-04-25T15:57:47.354 INFO:tasks.workunit.client.1.smithi155.stdout:4/936: chown da/d23/fbc 479547 1 2024-04-25T15:57:47.356 INFO:tasks.workunit.client.1.smithi155.stdout:5/951: mknod d0/d58/d63/da0/dd6/c12e 0 2024-04-25T15:57:47.361 INFO:tasks.workunit.client.1.smithi155.stdout:7/978: creat d2/dd/d36/d46/f14f x:0 0 0 2024-04-25T15:57:47.362 INFO:tasks.workunit.client.1.smithi155.stdout:8/762: dwrite d2/d15/d18/d23/d2d/fba [0,4194304] 0 2024-04-25T15:57:47.363 INFO:tasks.workunit.client.1.smithi155.stdout:7/979: stat d2/dd/d30/d44/fe7 0 2024-04-25T15:57:47.364 INFO:tasks.workunit.client.1.smithi155.stdout:7/980: chown d2/dd/d12/d76/db6/d111/d14d 1839 1 2024-04-25T15:57:47.374 INFO:tasks.workunit.client.1.smithi155.stdout:7/981: creat d2/dd/d30/d44/ddd/d14b/f150 x:0 0 0 2024-04-25T15:57:47.374 INFO:tasks.workunit.client.1.smithi155.stdout:7/982: chown d2/d26/d3d/d6d/f5d 42 1 2024-04-25T15:57:47.376 INFO:tasks.workunit.client.1.smithi155.stdout:4/937: truncate da/d23/d3f/d56/f76 3685810 0 2024-04-25T15:57:47.378 INFO:tasks.workunit.client.1.smithi155.stdout:7/983: chown d2/dd/d30/d44/lf0 36398 1 2024-04-25T15:57:47.378 INFO:tasks.workunit.client.1.smithi155.stdout:5/952: dread d0/d3/d15/d1f/d50/f101 [0,4194304] 0 2024-04-25T15:57:47.379 INFO:tasks.workunit.client.1.smithi155.stdout:7/984: write d2/dd/d13/d1c/f14e [268978,95354] 0 2024-04-25T15:57:47.379 INFO:tasks.workunit.client.1.smithi155.stdout:4/938: symlink da/d23/d3f/d56/d69/d4a/d78/l148 0 2024-04-25T15:57:47.386 INFO:tasks.workunit.client.1.smithi155.stdout:0/864: truncate d1/d3/d5/d5b/dc4/d6e/d107/f75 3915543 0 2024-04-25T15:57:47.388 INFO:tasks.workunit.client.1.smithi155.stdout:7/985: creat d2/d26/d3d/d115/d12f/f151 x:0 0 0 2024-04-25T15:57:47.388 INFO:tasks.workunit.client.1.smithi155.stdout:8/763: dwrite d2/d15/fd8 [0,4194304] 0 2024-04-25T15:57:47.390 INFO:tasks.workunit.client.1.smithi155.stdout:0/865: chown d1/d41/df4/d47/db0/dd1/ffe 57300627 1 2024-04-25T15:57:47.391 INFO:tasks.workunit.client.1.smithi155.stdout:5/953: rename d0/d3/d15/d9f/cb4 to d0/d3/d15/d1f/c12f 0 2024-04-25T15:57:47.395 INFO:tasks.workunit.client.1.smithi155.stdout:0/866: mknod d1/d85/c118 0 2024-04-25T15:57:47.398 INFO:tasks.workunit.client.1.smithi155.stdout:0/867: write d1/f71 [1231396,39384] 0 2024-04-25T15:57:47.400 INFO:tasks.workunit.client.1.smithi155.stdout:5/954: truncate d0/d58/d63/f110 3672224 0 2024-04-25T15:57:47.401 INFO:tasks.workunit.client.1.smithi155.stdout:0/868: write d1/d41/f44 [921321,18348] 0 2024-04-25T15:57:47.403 INFO:tasks.workunit.client.1.smithi155.stdout:4/939: dwrite da/d23/da2/fb8 [0,4194304] 0 2024-04-25T15:57:47.404 INFO:tasks.workunit.client.1.smithi155.stdout:0/869: stat d1/d41/df4/d47 0 2024-04-25T15:57:47.405 INFO:tasks.workunit.client.1.smithi155.stdout:5/955: readlink d0/d3/d15/d9f/dc3/lcb 0 2024-04-25T15:57:47.405 INFO:tasks.workunit.client.1.smithi155.stdout:8/764: dread d2/f11 [0,4194304] 0 2024-04-25T15:57:47.409 INFO:tasks.workunit.client.1.smithi155.stdout:0/870: creat d1/d10c/f119 x:0 0 0 2024-04-25T15:57:47.412 INFO:tasks.workunit.client.1.smithi155.stdout:4/940: dread da/d87/ddc/f10a [0,4194304] 0 2024-04-25T15:57:47.412 INFO:tasks.workunit.client.1.smithi155.stdout:8/765: creat d2/d15/d63/dc0/ff7 x:0 0 0 2024-04-25T15:57:47.413 INFO:tasks.workunit.client.1.smithi155.stdout:8/766: stat d2/d15/c52 0 2024-04-25T15:57:47.413 INFO:tasks.workunit.client.1.smithi155.stdout:7/986: dread d2/dd/d13/d1c/f22 [0,4194304] 0 2024-04-25T15:57:47.414 INFO:tasks.workunit.client.1.smithi155.stdout:0/871: unlink d1/d3/d5/da/l5a 0 2024-04-25T15:57:47.417 INFO:tasks.workunit.client.1.smithi155.stdout:8/767: mkdir d2/d15/da1/dde/d40/d5b/df8 0 2024-04-25T15:57:47.418 INFO:tasks.workunit.client.1.smithi155.stdout:5/956: rename d0/d47/d59/f9a to d0/d58/f130 0 2024-04-25T15:57:47.420 INFO:tasks.workunit.client.1.smithi155.stdout:8/768: mkdir d2/d15/d18/d34/d48/d4e/d81/df9 0 2024-04-25T15:57:47.422 INFO:tasks.workunit.client.1.smithi155.stdout:7/987: link d2/dd/d30/d44/d7f/fc6 d2/dd/d30/d113/f152 0 2024-04-25T15:57:47.423 INFO:tasks.workunit.client.1.smithi155.stdout:0/872: mknod d1/d85/d8c/d114/c11a 0 2024-04-25T15:57:47.424 INFO:tasks.workunit.client.1.smithi155.stdout:8/769: fdatasync d2/d15/d18/d49/df4/fac 0 2024-04-25T15:57:47.427 INFO:tasks.workunit.client.1.smithi155.stdout:5/957: link d0/d58/d32/d6a/l96 d0/d27/l131 0 2024-04-25T15:57:47.428 INFO:tasks.workunit.client.1.smithi155.stdout:8/770: mkdir d2/d15/d18/d23/dfa 0 2024-04-25T15:57:47.432 INFO:tasks.workunit.client.1.smithi155.stdout:0/873: dwrite d1/d41/df4/d47/fc0 [0,4194304] 0 2024-04-25T15:57:47.433 INFO:tasks.workunit.client.1.smithi155.stdout:5/958: symlink d0/l132 0 2024-04-25T15:57:47.434 INFO:tasks.workunit.client.1.smithi155.stdout:3/892: sync 2024-04-25T15:57:47.436 INFO:tasks.workunit.client.1.smithi155.stdout:0/874: rmdir d1/d3/d12/d92/d104 39 2024-04-25T15:57:47.436 INFO:tasks.workunit.client.1.smithi155.stdout:5/959: write d0/d27/fdc [475237,40363] 0 2024-04-25T15:57:47.439 INFO:tasks.workunit.client.1.smithi155.stdout:5/960: chown d0/d3/d2c 13 1 2024-04-25T15:57:47.440 INFO:tasks.workunit.client.1.smithi155.stdout:5/961: dread - d0/d58/f10d zero size 2024-04-25T15:57:47.440 INFO:tasks.workunit.client.1.smithi155.stdout:8/771: dwrite d2/d15/fd8 [0,4194304] 0 2024-04-25T15:57:47.441 INFO:tasks.workunit.client.1.smithi155.stdout:4/941: dread da/d23/f42 [0,4194304] 0 2024-04-25T15:57:47.442 INFO:tasks.workunit.client.1.smithi155.stdout:8/772: chown d2/d15/d18/l70 9824 1 2024-04-25T15:57:47.443 INFO:tasks.workunit.client.1.smithi155.stdout:0/875: creat d1/d3/d5/f11b x:0 0 0 2024-04-25T15:57:47.445 INFO:tasks.workunit.client.1.smithi155.stdout:4/942: rmdir da/d23/da2/dad 39 2024-04-25T15:57:47.445 INFO:tasks.workunit.client.1.smithi155.stdout:8/773: rename d2/d15/d18 to d2/d15/d18/d23/dfb 22 2024-04-25T15:57:47.445 INFO:tasks.workunit.client.1.smithi155.stdout:0/876: dread - d1/d41/df4/d47/db0/dd1/ffe zero size 2024-04-25T15:57:47.447 INFO:tasks.workunit.client.1.smithi155.stdout:8/774: fdatasync d2/d15/d18/d34/f53 0 2024-04-25T15:57:47.449 INFO:tasks.workunit.client.1.smithi155.stdout:0/877: mknod d1/d3f/c11c 0 2024-04-25T15:57:47.451 INFO:tasks.workunit.client.1.smithi155.stdout:7/988: dread d2/f5b [0,4194304] 0 2024-04-25T15:57:47.453 INFO:tasks.workunit.client.1.smithi155.stdout:8/775: creat d2/d15/d18/d23/d2d/da5/ffc x:0 0 0 2024-04-25T15:57:47.453 INFO:tasks.workunit.client.1.smithi155.stdout:4/943: truncate da/d23/d3f/d56/f76 3813533 0 2024-04-25T15:57:47.453 INFO:tasks.workunit.client.1.smithi155.stdout:7/989: write d2/f94 [5234187,120976] 0 2024-04-25T15:57:47.455 INFO:tasks.workunit.client.1.smithi155.stdout:0/878: rename d1/d85/d98/fb7 to d1/d85/d8c/d114/f11d 0 2024-04-25T15:57:47.456 INFO:tasks.workunit.client.1.smithi155.stdout:8/776: write d2/fc [3674010,128906] 0 2024-04-25T15:57:47.458 INFO:tasks.workunit.client.1.smithi155.stdout:5/962: dwrite d0/d3/d2c/f2f [0,4194304] 0 2024-04-25T15:57:47.459 INFO:tasks.workunit.client.1.smithi155.stdout:4/944: write da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/feb [791495,129791] 0 2024-04-25T15:57:47.460 INFO:tasks.workunit.client.1.smithi155.stdout:8/777: fsync d2/d15/d18/d49/f5e 0 2024-04-25T15:57:47.464 INFO:tasks.workunit.client.1.smithi155.stdout:3/893: dread d1/d4/db/d28/d58/f92 [0,4194304] 0 2024-04-25T15:57:47.465 INFO:tasks.workunit.client.1.smithi155.stdout:7/990: truncate d2/d26/d3d/d6d/f131 1966609 0 2024-04-25T15:57:47.467 INFO:tasks.workunit.client.1.smithi155.stdout:8/778: readlink d2/d15/d18/d49/dc9/lec 0 2024-04-25T15:57:47.469 INFO:tasks.workunit.client.1.smithi155.stdout:3/894: rename d1/d4/db/d20/d44/d52 to d1/d4/db/d20/d44/d52/d61/d135 22 2024-04-25T15:57:47.470 INFO:tasks.workunit.client.1.smithi155.stdout:8/779: rmdir d2/d15/d18 39 2024-04-25T15:57:47.472 INFO:tasks.workunit.client.1.smithi155.stdout:5/963: getdents d0/d3/d15 0 2024-04-25T15:57:47.476 INFO:tasks.workunit.client.1.smithi155.stdout:8/780: mknod d2/d15/d18/d23/d3c/d76/cfd 0 2024-04-25T15:57:47.479 INFO:tasks.workunit.client.1.smithi155.stdout:7/991: dwrite d2/dd/d13/d1c/f40 [4194304,4194304] 0 2024-04-25T15:57:47.479 INFO:tasks.workunit.client.1.smithi155.stdout:3/895: rename d1/d4/db/d91/dc4/dd9/d86/f126 to d1/d4/db/d20/d44/d52/f136 0 2024-04-25T15:57:47.479 INFO:tasks.workunit.client.1.smithi155.stdout:5/964: dread d0/d3/fcc [0,4194304] 0 2024-04-25T15:57:47.480 INFO:tasks.workunit.client.1.smithi155.stdout:8/781: mknod d2/d15/d63/cfe 0 2024-04-25T15:57:47.481 INFO:tasks.workunit.client.1.smithi155.stdout:0/879: dread d1/d3/d3d/dcb/fe6 [0,4194304] 0 2024-04-25T15:57:47.482 INFO:tasks.workunit.client.1.smithi155.stdout:3/896: creat d1/d4/d10/d21/d73/d8d/f137 x:0 0 0 2024-04-25T15:57:47.483 INFO:tasks.workunit.client.1.smithi155.stdout:7/992: creat d2/d26/d3d/d6d/f153 x:0 0 0 2024-04-25T15:57:47.484 INFO:tasks.workunit.client.1.smithi155.stdout:4/945: dread da/d23/d3f/d56/d69/d83/d10c/fd [0,4194304] 0 2024-04-25T15:57:47.484 INFO:tasks.workunit.client.1.smithi155.stdout:0/880: read d1/d85/d8c/fe0 [576758,121591] 0 2024-04-25T15:57:47.485 INFO:tasks.workunit.client.1.smithi155.stdout:3/897: symlink d1/d4/db/d91/dc4/d10b/d11e/l138 0 2024-04-25T15:57:47.487 INFO:tasks.workunit.client.1.smithi155.stdout:0/881: read d1/d3/d3d/dcb/fcc [513283,120962] 0 2024-04-25T15:57:47.489 INFO:tasks.workunit.client.1.smithi155.stdout:7/993: rename d2/dd/d12/f38 to d2/dd/d66/db2/f154 0 2024-04-25T15:57:47.490 INFO:tasks.workunit.client.1.smithi155.stdout:0/882: rmdir d1/d3/d12/d83 39 2024-04-25T15:57:47.493 INFO:tasks.workunit.client.1.smithi155.stdout:4/946: rename da/d23/da2/dad/cb6 to da/d23/d3f/d56/d69/d83/d10c/d18/c149 0 2024-04-25T15:57:47.494 INFO:tasks.workunit.client.1.smithi155.stdout:7/994: creat d2/dd/d36/d104/f155 x:0 0 0 2024-04-25T15:57:47.495 INFO:tasks.workunit.client.1.smithi155.stdout:0/883: unlink d1/d3/d5/d5b/dc4/d6e/d107/f75 0 2024-04-25T15:57:47.496 INFO:tasks.workunit.client.1.smithi155.stdout:4/947: rename da/d23/d3f/d56/d69/d4a/d78/c8b to da/d87/d105/c14a 0 2024-04-25T15:57:47.499 INFO:tasks.workunit.client.1.smithi155.stdout:7/995: dread d2/d26/d3d/d6d/d137/f11a [0,4194304] 0 2024-04-25T15:57:47.500 INFO:tasks.workunit.client.1.smithi155.stdout:4/948: mkdir da/d23/d3f/d56/d69/d83/d14b 0 2024-04-25T15:57:47.503 INFO:tasks.workunit.client.1.smithi155.stdout:7/996: creat d2/dd/d13/d1c/dd9/f156 x:0 0 0 2024-04-25T15:57:47.503 INFO:tasks.workunit.client.1.smithi155.stdout:7/997: fsync d2/dd/d36/f62 0 2024-04-25T15:57:47.505 INFO:tasks.workunit.client.1.smithi155.stdout:0/884: link d1/f3c d1/d3/d3d/dcb/f11e 0 2024-04-25T15:57:47.505 INFO:tasks.workunit.client.1.smithi155.stdout:7/998: mknod d2/dd/d13/c157 0 2024-04-25T15:57:47.507 INFO:tasks.workunit.client.1.smithi155.stdout:3/898: write d1/d4/d10/d21/f5a [4850164,8897] 0 2024-04-25T15:57:47.507 INFO:tasks.workunit.client.1.smithi155.stdout:7/999: mkdir d2/d26/d3d/d65/d158 0 2024-04-25T15:57:47.515 INFO:tasks.workunit.client.1.smithi155.stdout:3/899: dwrite d1/d4/db/d91/dc9/ff4 [0,4194304] 0 2024-04-25T15:57:47.520 INFO:tasks.workunit.client.1.smithi155.stdout:4/949: dwrite da/d23/d3f/d56/d69/d83/f13d [0,4194304] 0 2024-04-25T15:57:47.522 INFO:tasks.workunit.client.1.smithi155.stdout:3/900: getdents d1/d4/db/d20/d44 0 2024-04-25T15:57:47.522 INFO:tasks.workunit.client.1.smithi155.stdout:4/950: write da/d23/d3a/d7b/d93/fa8 [397186,2225] 0 2024-04-25T15:57:47.525 INFO:tasks.workunit.client.1.smithi155.stdout:4/951: symlink da/d23/d3a/l14c 0 2024-04-25T15:57:47.526 INFO:tasks.workunit.client.1.smithi155.stdout:3/901: fdatasync d1/d4/db/d91/dc4/d6c/fc6 0 2024-04-25T15:57:47.527 INFO:tasks.workunit.client.1.smithi155.stdout:0/885: dwrite d1/d3/d3d/dcb/f11e [0,4194304] 0 2024-04-25T15:57:47.531 INFO:tasks.workunit.client.1.smithi155.stdout:0/886: rmdir d1/d3/d5/d5b/dc4/d6e 39 2024-04-25T15:57:47.532 INFO:tasks.workunit.client.1.smithi155.stdout:0/887: write d1/d3/d12/fec [814131,9086] 0 2024-04-25T15:57:47.534 INFO:tasks.workunit.client.1.smithi155.stdout:4/952: link da/d23/d3f/d56/d69/d83/d10c/d18/d6e/l119 da/d23/d3f/d56/d69/d4a/d78/l14d 0 2024-04-25T15:57:47.535 INFO:tasks.workunit.client.1.smithi155.stdout:4/953: dread - da/d23/d3f/d56/d69/d4a/d78/d62/f116 zero size 2024-04-25T15:57:47.535 INFO:tasks.workunit.client.1.smithi155.stdout:0/888: creat d1/d3/f11f x:0 0 0 2024-04-25T15:57:47.536 INFO:tasks.workunit.client.1.smithi155.stdout:4/954: dread - da/d117/f11c zero size 2024-04-25T15:57:47.536 INFO:tasks.workunit.client.1.smithi155.stdout:0/889: write d1/f71 [1433119,114167] 0 2024-04-25T15:57:47.541 INFO:tasks.workunit.client.1.smithi155.stdout:3/902: write d1/f1f [1396010,7250] 0 2024-04-25T15:57:47.541 INFO:tasks.workunit.client.1.smithi155.stdout:0/890: dread d1/d41/df4/fa6 [0,4194304] 0 2024-04-25T15:57:47.543 INFO:tasks.workunit.client.1.smithi155.stdout:4/955: link da/d30/f6d da/d23/d3f/d56/d69/d4a/d78/d62/dc0/f14e 0 2024-04-25T15:57:47.543 INFO:tasks.workunit.client.1.smithi155.stdout:0/891: dread - d1/d41/df4/d47/f10e zero size 2024-04-25T15:57:47.543 INFO:tasks.workunit.client.1.smithi155.stdout:3/903: chown d1/d4/db/d20/d44/d52/d61/db5/l5d 87 1 2024-04-25T15:57:47.545 INFO:tasks.workunit.client.1.smithi155.stdout:4/956: truncate da/d23/d3f/d56/d69/f145 59370 0 2024-04-25T15:57:47.553 INFO:tasks.workunit.client.1.smithi155.stdout:0/892: dwrite d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:47.553 INFO:tasks.workunit.client.1.smithi155.stdout:3/904: dwrite d1/d4/db/d91/f9d [4194304,4194304] 0 2024-04-25T15:57:47.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:47.561 INFO:tasks.workunit.client.1.smithi155.stdout:3/905: read - d1/d4/db/f8a zero size 2024-04-25T15:57:47.562 INFO:tasks.workunit.client.1.smithi155.stdout:4/957: dwrite da/d23/d3f/d56/d69/d83/fbd [4194304,4194304] 0 2024-04-25T15:57:47.562 INFO:tasks.workunit.client.1.smithi155.stdout:0/893: dread d1/d1a/f34 [0,4194304] 0 2024-04-25T15:57:47.569 INFO:tasks.workunit.client.1.smithi155.stdout:9/821: sync 2024-04-25T15:57:47.569 INFO:tasks.workunit.client.1.smithi155.stdout:4/958: dread da/f16 [0,4194304] 0 2024-04-25T15:57:47.570 INFO:tasks.workunit.client.1.smithi155.stdout:4/959: dread - da/d23/d3a/d7b/fb2 zero size 2024-04-25T15:57:47.570 INFO:tasks.workunit.client.1.smithi155.stdout:0/894: creat d1/d3/d3d/d46/f120 x:0 0 0 2024-04-25T15:57:47.572 INFO:tasks.workunit.client.1.smithi155.stdout:9/822: creat dc/d11/d67/f10a x:0 0 0 2024-04-25T15:57:47.573 INFO:tasks.workunit.client.1.smithi155.stdout:4/960: write da/d23/d3f/d56/d69/d83/f13d [3822470,47049] 0 2024-04-25T15:57:47.573 INFO:tasks.workunit.client.1.smithi155.stdout:0/895: creat d1/d3/d6a/dfb/f121 x:0 0 0 2024-04-25T15:57:47.576 INFO:tasks.workunit.client.1.smithi155.stdout:3/906: dread d1/d4/d10/d21/d73/d8d/fcd [0,4194304] 0 2024-04-25T15:57:47.577 INFO:tasks.workunit.client.1.smithi155.stdout:0/896: unlink d1/d3/d6a/d9b/fe1 0 2024-04-25T15:57:47.578 INFO:tasks.workunit.client.1.smithi155.stdout:0/897: readlink d1/d3/d6a/d9b/ld3 0 2024-04-25T15:57:47.579 INFO:tasks.workunit.client.1.smithi155.stdout:3/907: mkdir d1/d4/db/d20/d44/d52/d93/d139 0 2024-04-25T15:57:47.579 INFO:tasks.workunit.client.1.smithi155.stdout:0/898: rmdir d1/d41/df4/d47/db0 39 2024-04-25T15:57:47.580 INFO:tasks.workunit.client.1.smithi155.stdout:3/908: fsync d1/d4/d10/d21/ffe 0 2024-04-25T15:57:47.582 INFO:tasks.workunit.client.1.smithi155.stdout:4/961: read da/d30/f38 [3148890,40850] 0 2024-04-25T15:57:47.584 INFO:tasks.workunit.client.1.smithi155.stdout:3/909: rename d1/d4/db/d20/d44/lc2 to d1/d4/db/d91/dc4/d6c/l13a 0 2024-04-25T15:57:47.586 INFO:tasks.workunit.client.1.smithi155.stdout:9/823: dread dc/d11/d30/d46/f8d [0,4194304] 0 2024-04-25T15:57:47.587 INFO:tasks.workunit.client.1.smithi155.stdout:9/824: dread - dc/d11/d67/f10a zero size 2024-04-25T15:57:47.587 INFO:tasks.workunit.client.1.smithi155.stdout:9/825: stat dc/d17/dc0/dc9/c107 0 2024-04-25T15:57:47.589 INFO:tasks.workunit.client.1.smithi155.stdout:4/962: getdents da/d23/d3f/d56/d69 0 2024-04-25T15:57:47.590 INFO:tasks.workunit.client.1.smithi155.stdout:3/910: rename d1/d4/d10/d21/d73/d8d/l90 to d1/d4/d10/d21/d73/l13b 0 2024-04-25T15:57:47.591 INFO:tasks.workunit.client.1.smithi155.stdout:9/826: mknod dc/d11/dc4/c10b 0 2024-04-25T15:57:47.593 INFO:tasks.workunit.client.1.smithi155.stdout:4/963: unlink da/d23/d3f/d56/d69/d83/d10c/d18/f5f 0 2024-04-25T15:57:47.598 INFO:tasks.workunit.client.1.smithi155.stdout:3/911: dwrite d1/d4/d10/d21/dab/f108 [0,4194304] 0 2024-04-25T15:57:47.600 INFO:tasks.workunit.client.1.smithi155.stdout:4/964: rename da/d23/d3f/dc6/dc8/f123 to da/d23/d3f/d56/d69/d4a/de0/f14f 0 2024-04-25T15:57:47.608 INFO:tasks.workunit.client.1.smithi155.stdout:4/965: write da/d87/f9d [1243711,18437] 0 2024-04-25T15:57:47.610 INFO:tasks.workunit.client.1.smithi155.stdout:3/912: dwrite d1/d4/d10/d21/d73/d8d/f122 [0,4194304] 0 2024-04-25T15:57:47.614 INFO:tasks.workunit.client.1.smithi155.stdout:0/899: dwrite d1/d41/df4/f3a [0,4194304] 0 2024-04-25T15:57:47.615 INFO:tasks.workunit.client.1.smithi155.stdout:9/827: dwrite dc/d13/d60/d7a/f94 [0,4194304] 0 2024-04-25T15:57:47.616 INFO:tasks.workunit.client.1.smithi155.stdout:3/913: dread - d1/d4/db/d28/d58/de6/f10e zero size 2024-04-25T15:57:47.617 INFO:tasks.workunit.client.1.smithi155.stdout:4/966: mkdir da/d23/d3f/d56/d69/d150 0 2024-04-25T15:57:47.618 INFO:tasks.workunit.client.1.smithi155.stdout:0/900: unlink d1/d3/d12/l15 0 2024-04-25T15:57:47.621 INFO:tasks.workunit.client.1.smithi155.stdout:3/914: creat d1/d4/db/d20/d44/d52/d61/db5/f13c x:0 0 0 2024-04-25T15:57:47.621 INFO:tasks.workunit.client.1.smithi155.stdout:0/901: rmdir d1/d3/d3d/dcb 39 2024-04-25T15:57:47.624 INFO:tasks.workunit.client.1.smithi155.stdout:0/902: chown d1/d41/df4/d47/db0/dd1/lf6 895898 1 2024-04-25T15:57:47.626 INFO:tasks.workunit.client.1.smithi155.stdout:0/903: creat d1/d1a/f122 x:0 0 0 2024-04-25T15:57:47.629 INFO:tasks.workunit.client.1.smithi155.stdout:0/904: chown d1/d3/d3d/d46/ff7 231 1 2024-04-25T15:57:47.629 INFO:tasks.workunit.client.1.smithi155.stdout:0/905: chown d1/d85/l91 2 1 2024-04-25T15:57:47.630 INFO:tasks.workunit.client.1.smithi155.stdout:4/967: dwrite da/d23/f6c [0,4194304] 0 2024-04-25T15:57:47.633 INFO:tasks.workunit.client.1.smithi155.stdout:4/968: rename da/f16 to da/d23/d3a/f151 0 2024-04-25T15:57:47.634 INFO:tasks.workunit.client.1.smithi155.stdout:0/906: symlink d1/d3/d12/l123 0 2024-04-25T15:57:47.638 INFO:tasks.workunit.client.1.smithi155.stdout:0/907: link d1/d3/d12/cbf d1/d3/d6a/c124 0 2024-04-25T15:57:47.639 INFO:tasks.workunit.client.1.smithi155.stdout:0/908: dread - d1/d41/df4/d47/db0/fe4 zero size 2024-04-25T15:57:47.642 INFO:tasks.workunit.client.1.smithi155.stdout:3/915: write d1/d4/ff3 [2493094,111454] 0 2024-04-25T15:57:47.643 INFO:tasks.workunit.client.1.smithi155.stdout:4/969: creat da/d23/d3f/d56/d69/d102/f152 x:0 0 0 2024-04-25T15:57:47.643 INFO:tasks.workunit.client.1.smithi155.stdout:5/965: sync 2024-04-25T15:57:47.643 INFO:tasks.workunit.client.1.smithi155.stdout:8/782: sync 2024-04-25T15:57:47.643 INFO:tasks.workunit.client.1.smithi155.stdout:1/890: sync 2024-04-25T15:57:47.644 INFO:tasks.workunit.client.1.smithi155.stdout:9/828: truncate dc/d17/dc0/dc9/ff2 133257 0 2024-04-25T15:57:47.644 INFO:tasks.workunit.client.1.smithi155.stdout:0/909: creat d1/d3/d6a/dfb/ded/f125 x:0 0 0 2024-04-25T15:57:47.646 INFO:tasks.workunit.client.1.smithi155.stdout:0/910: write d1/d3/f11f [287151,128539] 0 2024-04-25T15:57:47.646 INFO:tasks.workunit.client.1.smithi155.stdout:5/966: truncate d0/d3/d15/d1f/f11b 818930 0 2024-04-25T15:57:47.647 INFO:tasks.workunit.client.1.smithi155.stdout:8/783: mknod d2/d15/d18/d95/cff 0 2024-04-25T15:57:47.662 INFO:tasks.workunit.client.1.smithi155.stdout:4/970: fdatasync da/d23/d3f/d56/d69/d4a/d78/f4f 0 2024-04-25T15:57:47.662 INFO:tasks.workunit.client.1.smithi155.stdout:0/911: dread - d1/d3/d3d/d46/f120 zero size 2024-04-25T15:57:47.663 INFO:tasks.workunit.client.1.smithi155.stdout:5/967: fdatasync d0/d3/d15/d1f/d50/fee 0 2024-04-25T15:57:47.664 INFO:tasks.workunit.client.1.smithi155.stdout:9/829: write dc/d13/d59/f5d [1605911,123794] 0 2024-04-25T15:57:47.664 INFO:tasks.workunit.client.1.smithi155.stdout:8/784: fdatasync d2/d15/d18/d23/d3c/d76/d7e/f9a 0 2024-04-25T15:57:47.667 INFO:tasks.workunit.client.1.smithi155.stdout:1/891: link d1/d16/d1d/d33/le7 d1/d16/d1d/d33/da1/de6/d117/l119 0 2024-04-25T15:57:47.667 INFO:tasks.workunit.client.1.smithi155.stdout:9/830: write dc/d13/d60/f8a [4872471,90285] 0 2024-04-25T15:57:47.669 INFO:tasks.workunit.client.1.smithi155.stdout:1/892: write d1/d16/d1d/d29/d5f/f7c [457810,95182] 0 2024-04-25T15:57:47.670 INFO:tasks.workunit.client.1.smithi155.stdout:0/912: rename d1/d10c/f119 to d1/d3/d5/d5b/dc4/d60/f126 0 2024-04-25T15:57:47.672 INFO:tasks.workunit.client.1.smithi155.stdout:1/893: truncate d1/d16/d37/f114 873179 0 2024-04-25T15:57:47.675 INFO:tasks.workunit.client.1.smithi155.stdout:4/971: dwrite da/d23/d3f/d56/d69/d4a/d78/d62/f116 [0,4194304] 0 2024-04-25T15:57:47.677 INFO:tasks.workunit.client.1.smithi155.stdout:1/894: truncate d1/d16/d1d/d29/d5f/d34/d68/feb 946182 0 2024-04-25T15:57:47.677 INFO:tasks.workunit.client.1.smithi155.stdout:8/785: write d2/d15/d18/fb7 [1151674,43505] 0 2024-04-25T15:57:47.679 INFO:tasks.workunit.client.1.smithi155.stdout:0/913: write d1/d3/d3d/d46/ff7 [1140432,30115] 0 2024-04-25T15:57:47.680 INFO:tasks.workunit.client.1.smithi155.stdout:8/786: rmdir d2/d15 39 2024-04-25T15:57:47.681 INFO:tasks.workunit.client.1.smithi155.stdout:1/895: mknod d1/d32/d9d/c11a 0 2024-04-25T15:57:47.682 INFO:tasks.workunit.client.1.smithi155.stdout:4/972: dread - da/d23/d3f/d56/d69/d83/d10c/fcc zero size 2024-04-25T15:57:47.684 INFO:tasks.workunit.client.1.smithi155.stdout:8/787: unlink d2/f60 0 2024-04-25T15:57:47.685 INFO:tasks.workunit.client.1.smithi155.stdout:5/968: dwrite d0/d3/d15/d30/d4f/ff1 [0,4194304] 0 2024-04-25T15:57:47.685 INFO:tasks.workunit.client.1.smithi155.stdout:4/973: write da/d23/d3f/d56/dca/f13e [671924,116829] 0 2024-04-25T15:57:47.687 INFO:tasks.workunit.client.1.smithi155.stdout:1/896: mknod d1/d16/d1d/d29/dcf/c11b 0 2024-04-25T15:57:47.691 INFO:tasks.workunit.client.1.smithi155.stdout:4/974: rmdir da/d23/d3f/d56/d69/d4a/d78/d62 39 2024-04-25T15:57:47.692 INFO:tasks.workunit.client.1.smithi155.stdout:4/975: chown da/d23/fa0 9448488 1 2024-04-25T15:57:47.700 INFO:tasks.workunit.client.1.smithi155.stdout:5/969: write d0/d3/d2c/f85 [754915,99558] 0 2024-04-25T15:57:47.700 INFO:tasks.workunit.client.1.smithi155.stdout:1/897: link d1/cd d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc6/c11c 0 2024-04-25T15:57:47.700 INFO:tasks.workunit.client.1.smithi155.stdout:4/976: dwrite da/d87/ffa [0,4194304] 0 2024-04-25T15:57:47.701 INFO:tasks.workunit.client.1.smithi155.stdout:8/788: getdents d2/d15/d18/d23/dd4 0 2024-04-25T15:57:47.703 INFO:tasks.workunit.client.1.smithi155.stdout:0/914: dread d1/d3/d5/d5b/dc4/d6e/d107/fca [0,4194304] 0 2024-04-25T15:57:47.707 INFO:tasks.workunit.client.1.smithi155.stdout:5/970: creat d0/d58/dea/f133 x:0 0 0 2024-04-25T15:57:47.709 INFO:tasks.workunit.client.1.smithi155.stdout:8/789: mkdir d2/d15/da1/dde/d100 0 2024-04-25T15:57:47.711 INFO:tasks.workunit.client.1.smithi155.stdout:4/977: symlink da/d23/d3f/d56/d69/d4a/de0/l153 0 2024-04-25T15:57:47.711 INFO:tasks.workunit.client.1.smithi155.stdout:8/790: read d2/d41/d5d/fb2 [437269,75785] 0 2024-04-25T15:57:47.711 INFO:tasks.workunit.client.1.smithi155.stdout:4/978: truncate da/fa1 1300087 0 2024-04-25T15:57:47.712 INFO:tasks.workunit.client.1.smithi155.stdout:1/898: mknod d1/d16/d1d/d29/d3d/d43/d88/c11d 0 2024-04-25T15:57:47.717 INFO:tasks.workunit.client.1.smithi155.stdout:8/791: creat d2/d15/d18/d49/f101 x:0 0 0 2024-04-25T15:57:47.718 INFO:tasks.workunit.client.1.smithi155.stdout:1/899: dread - d1/d16/d1d/d5e/fdb zero size 2024-04-25T15:57:47.719 INFO:tasks.workunit.client.1.smithi155.stdout:1/900: fsync d1/d16/d1d/d29/dcf/f102 0 2024-04-25T15:57:47.723 INFO:tasks.workunit.client.1.smithi155.stdout:4/979: truncate da/d23/d3f/d56/dca/ff4 2463146 0 2024-04-25T15:57:47.726 INFO:tasks.workunit.client.1.smithi155.stdout:8/792: creat d2/d15/d18/d34/d48/d4e/d81/df9/f102 x:0 0 0 2024-04-25T15:57:47.727 INFO:tasks.workunit.client.1.smithi155.stdout:8/793: write d2/d15/da1/fbc [375597,64139] 0 2024-04-25T15:57:47.727 INFO:tasks.workunit.client.1.smithi155.stdout:1/901: symlink d1/d16/d1d/d29/l11e 0 2024-04-25T15:57:47.728 INFO:tasks.workunit.client.1.smithi155.stdout:0/915: truncate d1/d1a/f34 233224 0 2024-04-25T15:57:47.731 INFO:tasks.workunit.client.1.smithi155.stdout:4/980: symlink da/d23/d3f/d56/d69/d83/d10c/d18/d97/dd8/d129/l154 0 2024-04-25T15:57:47.733 INFO:tasks.workunit.client.1.smithi155.stdout:1/902: creat d1/d16/d1d/d29/f11f x:0 0 0 2024-04-25T15:57:47.734 INFO:tasks.workunit.client.1.smithi155.stdout:8/794: getdents d2 0 2024-04-25T15:57:47.736 INFO:tasks.workunit.client.1.smithi155.stdout:4/981: creat da/d23/d3f/f155 x:0 0 0 2024-04-25T15:57:47.737 INFO:tasks.workunit.client.1.smithi155.stdout:5/971: dwrite d0/d3/d15/d1f/d50/d7c/f113 [0,4194304] 0 2024-04-25T15:57:47.737 INFO:tasks.workunit.client.1.smithi155.stdout:8/795: write d2/d15/d18/d23/d2d/fc2 [943322,27995] 0 2024-04-25T15:57:47.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f590e0ed640 1 Processor -- start 2024-04-25T15:57:47.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f590e0ed640 1 -- start start 2024-04-25T15:57:47.739 INFO:tasks.workunit.client.1.smithi155.stdout:1/903: creat d1/d16/d1d/d29/d3d/dfd/f120 x:0 0 0 2024-04-25T15:57:47.739 INFO:tasks.workunit.client.1.smithi155.stdout:8/796: dread - d2/d15/d18/d34/d48/d4e/d81/fe1 zero size 2024-04-25T15:57:47.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f590e0ed640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5908154ae0 0x7f5908157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:47.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f590e0ed640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59080c9ad0 con 0x7f59080c92b0 2024-04-25T15:57:47.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f590e0ed640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5908158380 con 0x7f59080c96c0 2024-04-25T15:57:47.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f590e0ed640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f590815a9e0 con 0x7f5908154ae0 2024-04-25T15:57:47.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f5906ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f59080c92b0 0x7f59080cac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45644/0 (socket says 172.21.15.87:45644) 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f5906ffd640 1 -- 172.21.15.87:0/3982569374 learned_addr learned my addr 172.21.15.87:0/3982569374 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f59077fe640 1 --2- 172.21.15.87:0/3982569374 >> v2:172.21.15.87:3300/0 conn(0x7f5908154ae0 0x7f5908157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f59067fc640 1 -- 172.21.15.87:0/3982569374 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720063691 0 0) 0x7f59080c9ad0 con 0x7f59080c92b0 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f59067fc640 1 -- 172.21.15.87:0/3982569374 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58f0003530 con 0x7f59080c92b0 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f59077fe640 1 -- 172.21.15.87:0/3982569374 >> v1:172.21.15.155:6789/0 conn(0x7f59080c96c0 legacy=0x7f59080b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f59077fe640 1 -- 172.21.15.87:0/3982569374 >> v1:172.21.15.87:6789/0 conn(0x7f59080c92b0 legacy=0x7f59080cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:47.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.735+0000 7f59077fe640 1 -- 172.21.15.87:0/3982569374 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59080c7d40 con 0x7f5908154ae0 2024-04-25T15:57:47.743 INFO:tasks.workunit.client.1.smithi155.stdout:5/972: symlink d0/d58/d32/l134 0 2024-04-25T15:57:47.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.739+0000 7f59077fe640 1 --2- 172.21.15.87:0/3982569374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908154ae0 0x7f5908157e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f58f80097c0 tx=0x7f58f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907bd49921cb28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:47.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.739+0000 7f59067fc640 1 -- 172.21.15.87:0/3982569374 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80b0070 con 0x7f5908154ae0 2024-04-25T15:57:47.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.739+0000 7f59067fc640 1 -- 172.21.15.87:0/3982569374 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f80ab600 con 0x7f5908154ae0 2024-04-25T15:57:47.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.739+0000 7f59067fc640 1 -- 172.21.15.87:0/3982569374 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80ab9b0 con 0x7f5908154ae0 2024-04-25T15:57:47.747 INFO:tasks.workunit.client.1.smithi155.stdout:1/904: dwrite d1/d16/d1d/d29/d3d/d43/d88/fe8 [0,4194304] 0 2024-04-25T15:57:47.749 INFO:tasks.workunit.client.1.smithi155.stdout:4/982: truncate da/d23/d3f/d56/dca/ff6 1808762 0 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 -- 172.21.15.87:0/3982569374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908154ae0 msgr2=0x7f5908157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 --2- 172.21.15.87:0/3982569374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908154ae0 0x7f5908157e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f58f80097c0 tx=0x7f58f801c3d0 comp rx=0 tx=0).stop 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 -- 172.21.15.87:0/3982569374 shutdown_connections 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 --2- 172.21.15.87:0/3982569374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908154ae0 0x7f5908157e40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 -- 172.21.15.87:0/3982569374 >> 172.21.15.87:0/3982569374 conn(0x7f59080ae490 msgr2=0x7f59080ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 -- 172.21.15.87:0/3982569374 shutdown_connections 2024-04-25T15:57:47.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.743+0000 7f590e0ed640 1 -- 172.21.15.87:0/3982569374 wait complete. 2024-04-25T15:57:47.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 Processor -- start 2024-04-25T15:57:47.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 -- start start 2024-04-25T15:57:47.751 INFO:tasks.workunit.client.1.smithi155.stdout:8/797: symlink d2/d15/da1/dde/d40/d5b/df8/l103 0 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59080c92b0 0x7f590814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 0x7f590814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5908154ae0 0x7f5908147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59080cb370 con 0x7f59080c96c0 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f59080ca820 con 0x7f59080c92b0 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f590e0ed640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f59080cb4f0 con 0x7f5908154ae0 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 0x7f590814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:47.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 0x7f590814d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39832/0 (socket says 172.21.15.87:39832) 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 -- 172.21.15.87:0/1441524076 learned_addr learned my addr 172.21.15.87:0/1441524076 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f59077fe640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59080c92b0 0x7f590814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5907fff640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5908154ae0 0x7f5908147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 -- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5908154ae0 msgr2=0x7f5908147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5908154ae0 0x7f5908147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 -- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59080c92b0 msgr2=0x7f590814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59080c92b0 0x7f590814ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.747+0000 7f5906ffd640 1 -- 172.21.15.87:0/1441524076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59081f0e20 con 0x7f59080c96c0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f5906ffd640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 0x7f590814d940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c430 tx=0x7f58fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc017070 con 0x7f59080c96c0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58fc005cf0 con 0x7f59080c96c0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59081f1100 con 0x7f59080c96c0 2024-04-25T15:57:47.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0072d0 con 0x7f59080c96c0 2024-04-25T15:57:47.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59081f16c0 con 0x7f59080c96c0 2024-04-25T15:57:47.756 INFO:tasks.workunit.client.1.smithi155.stdout:8/798: dread d2/d15/d35/fc3 [0,4194304] 0 2024-04-25T15:57:47.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5908069bb0 con 0x7f59080c96c0 2024-04-25T15:57:47.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f58fc01a070 con 0x7f59080c96c0 2024-04-25T15:57:47.757 INFO:tasks.workunit.client.1.smithi155.stdout:1/905: getdents d1/d16/d1d/d5e/d8e 0 2024-04-25T15:57:47.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f58effff640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f58f406f400 0x7f58f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:47.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f58fc08ea30 con 0x7f59080c96c0 2024-04-25T15:57:47.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.751+0000 7f59077fe640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f58f406f400 0x7f58f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:47.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.755+0000 7f59077fe640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f58f406f400 0x7f58f4071910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ad000 tx=0x7f58f8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:47.759 INFO:tasks.workunit.client.1.smithi155.stdout:4/983: dread da/d23/d3f/d56/d69/d83/f13d [0,4194304] 0 2024-04-25T15:57:47.760 INFO:tasks.workunit.client.1.smithi155.stdout:8/799: rename d2/fbf to d2/d15/da1/dde/d40/d5b/f104 0 2024-04-25T15:57:47.761 INFO:tasks.workunit.client.1.smithi155.stdout:4/984: readlink da/d23/d3f/d56/d69/d4a/d78/l148 0 2024-04-25T15:57:47.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:47.759+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58fc05af40 con 0x7f59080c96c0 2024-04-25T15:57:47.764 INFO:tasks.workunit.client.1.smithi155.stdout:1/906: dwrite d1/f11 [0,4194304] 0 2024-04-25T15:57:47.768 INFO:tasks.workunit.client.1.smithi155.stdout:1/907: read d1/d16/d1d/d29/d3d/d43/f48 [2581784,54122] 0 2024-04-25T15:57:47.768 INFO:tasks.workunit.client.1.smithi155.stdout:4/985: dread da/d23/d3f/f100 [0,4194304] 0 2024-04-25T15:57:47.770 INFO:tasks.workunit.client.1.smithi155.stdout:5/973: dread d0/d3/f5c [0,4194304] 0 2024-04-25T15:57:47.770 INFO:tasks.workunit.client.1.smithi155.stdout:8/800: fsync d2/f16 0 2024-04-25T15:57:47.770 INFO:tasks.workunit.client.1.smithi155.stdout:1/908: stat d1/d16/d1d/d29/l10f 0 2024-04-25T15:57:47.773 INFO:tasks.workunit.client.1.smithi155.stdout:4/986: unlink da/d23/d3f/dc6/de2/c135 0 2024-04-25T15:57:47.778 INFO:tasks.workunit.client.1.smithi155.stdout:1/909: dwrite d1/d6/f14 [0,4194304] 0 2024-04-25T15:57:47.779 INFO:tasks.workunit.client.1.smithi155.stdout:8/801: truncate d2/d15/d18/d23/d3c/fa9 2695188 0 2024-04-25T15:57:47.784 INFO:tasks.workunit.client.1.smithi155.stdout:8/802: mknod d2/d15/da1/dde/d40/d5b/df8/c105 0 2024-04-25T15:57:47.784 INFO:tasks.workunit.client.1.smithi155.stdout:4/987: dwrite da/d23/d3f/d56/d69/d83/d10c/d18/fda [0,4194304] 0 2024-04-25T15:57:47.785 INFO:tasks.workunit.client.1.smithi155.stdout:1/910: creat d1/d16/d1d/d29/d3d/dfd/f121 x:0 0 0 2024-04-25T15:57:47.786 INFO:tasks.workunit.client.1.smithi155.stdout:1/911: stat d1/d32/fbb 0 2024-04-25T15:57:47.787 INFO:tasks.workunit.client.1.smithi155.stdout:1/912: write d1/d32/d86/f109 [165980,68994] 0 2024-04-25T15:57:47.789 INFO:tasks.workunit.client.1.smithi155.stdout:4/988: rmdir da/d23/d3f/d56/d69/d102 39 2024-04-25T15:57:47.790 INFO:tasks.workunit.client.1.smithi155.stdout:8/803: fsync d2/d41/d5d/fb2 0 2024-04-25T15:57:47.795 INFO:tasks.workunit.client.1.smithi155.stdout:8/804: symlink d2/d15/d18/d95/l106 0 2024-04-25T15:57:47.797 INFO:tasks.workunit.client.1.smithi155.stdout:5/974: dread d0/d3/f5a [0,4194304] 0 2024-04-25T15:57:47.798 INFO:tasks.workunit.client.1.smithi155.stdout:8/805: fdatasync d2/d15/d18/d23/d3c/fa9 0 2024-04-25T15:57:47.801 INFO:tasks.workunit.client.1.smithi155.stdout:5/975: getdents d0/d58/d32/d6a 0 2024-04-25T15:57:47.802 INFO:tasks.workunit.client.1.smithi155.stdout:8/806: symlink d2/d15/d63/dc0/l107 0 2024-04-25T15:57:47.803 INFO:tasks.workunit.client.1.smithi155.stdout:5/976: fsync d0/d3/d2c/d94/fc8 0 2024-04-25T15:57:47.804 INFO:tasks.workunit.client.1.smithi155.stdout:1/913: dwrite d1/d16/d1d/d29/d5f/f112 [0,4194304] 0 2024-04-25T15:57:47.806 INFO:tasks.workunit.client.1.smithi155.stdout:5/977: write d0/d58/f90 [5159095,88884] 0 2024-04-25T15:57:47.808 INFO:tasks.workunit.client.1.smithi155.stdout:1/914: read - d1/d16/d1d/d29/d3d/f107 zero size 2024-04-25T15:57:47.809 INFO:tasks.workunit.client.1.smithi155.stdout:4/989: dwrite da/f11 [4194304,4194304] 0 2024-04-25T15:57:47.809 INFO:tasks.workunit.client.1.smithi155.stdout:8/807: rename d2/d15/d18/d95 to d2/d15/d63/dd7/d108 0 2024-04-25T15:57:47.809 INFO:tasks.workunit.client.1.smithi155.stdout:1/915: dread - d1/fc8 zero size 2024-04-25T15:57:47.811 INFO:tasks.workunit.client.1.smithi155.stdout:8/808: readlink d2/d15/d18/d23/d2d/l4c 0 2024-04-25T15:57:47.811 INFO:tasks.workunit.client.1.smithi155.stdout:1/916: stat d1/d16/d1d/d29/d3d/d43/d88/c11d 0 2024-04-25T15:57:47.812 INFO:tasks.workunit.client.1.smithi155.stdout:5/978: mknod d0/d3/d15/d1f/d50/d10a/c135 0 2024-04-25T15:57:47.814 INFO:tasks.workunit.client.1.smithi155.stdout:1/917: mkdir d1/d16/d1d/d29/d3d/d43/d88/d10b/d122 0 2024-04-25T15:57:47.817 INFO:tasks.workunit.client.1.smithi155.stdout:5/979: creat d0/d3/d2c/d94/d111/f136 x:0 0 0 2024-04-25T15:57:47.818 INFO:tasks.workunit.client.1.smithi155.stdout:4/990: creat da/d23/d3f/d56/d69/d4a/d78/d62/f156 x:0 0 0 2024-04-25T15:57:47.820 INFO:tasks.workunit.client.1.smithi155.stdout:5/980: creat d0/d3/d15/d9f/dc3/f137 x:0 0 0 2024-04-25T15:57:47.821 INFO:tasks.workunit.client.1.smithi155.stdout:1/918: dwrite d1/d16/d37/f114 [0,4194304] 0 2024-04-25T15:57:47.822 INFO:tasks.workunit.client.1.smithi155.stdout:4/991: symlink da/d23/d3f/d56/d69/d4a/l157 0 2024-04-25T15:57:47.822 INFO:tasks.workunit.client.1.smithi155.stdout:5/981: write d0/d3/d2c/f2f [3074774,35108] 0 2024-04-25T15:57:47.826 INFO:tasks.workunit.client.1.smithi155.stdout:5/982: dread d0/d3/d15/d1f/d50/d60/fc6 [0,4194304] 0 2024-04-25T15:57:47.827 INFO:tasks.workunit.client.1.smithi155.stdout:1/919: creat d1/d16/d1d/d29/d5f/d34/d68/d93/da4/f123 x:0 0 0 2024-04-25T15:57:47.830 INFO:tasks.workunit.client.1.smithi155.stdout:5/983: mknod d0/d3/d15/d1f/d50/d10a/c138 0 2024-04-25T15:57:47.831 INFO:tasks.workunit.client.1.smithi155.stdout:5/984: write d0/d3/d2c/f9e [871753,107382] 0 2024-04-25T15:57:47.832 INFO:tasks.workunit.client.1.smithi155.stdout:5/985: chown d0/d3/d15/c99 90 1 2024-04-25T15:57:47.833 INFO:tasks.workunit.client.1.smithi155.stdout:5/986: write d0/d58/d9b/f115 [93750,115891] 0 2024-04-25T15:57:47.836 INFO:tasks.workunit.client.1.smithi155.stdout:3/916: sync 2024-04-25T15:57:47.842 INFO:tasks.workunit.client.1.smithi155.stdout:4/992: write da/d23/d3f/d56/d69/d83/f7d [1097441,110107] 0 2024-04-25T15:57:47.843 INFO:tasks.workunit.client.1.smithi155.stdout:1/920: write d1/d16/d1d/d29/d5f/d34/d68/d93/db7/fde [722993,33579] 0 2024-04-25T15:57:47.846 INFO:tasks.workunit.client.1.smithi155.stdout:3/917: dwrite d1/d4/d10/d21/d73/d77/d5f/f107 [0,4194304] 0 2024-04-25T15:57:47.847 INFO:tasks.workunit.client.1.smithi155.stdout:3/918: dread - d1/d4/db/d28/d58/de6/f10e zero size 2024-04-25T15:57:47.851 INFO:tasks.workunit.client.1.smithi155.stdout:3/919: truncate d1/d4/db/d20/fa8 3376984 0 2024-04-25T15:57:47.851 INFO:tasks.workunit.client.1.smithi155.stdout:4/993: chown da/d23/d3f/d56/d69/d83/d10c/d18/d97/d110/c88 2306 1 2024-04-25T15:57:47.853 INFO:tasks.workunit.client.1.smithi155.stdout:5/987: dread d0/d3/d2c/f48 [0,4194304] 0 2024-04-25T15:57:47.857 INFO:tasks.workunit.client.1.smithi155.stdout:1/921: dwrite d1/d16/d1d/d29/d5f/d34/d68/d93/db7/f104 [0,4194304] 0 2024-04-25T15:57:47.857 INFO:tasks.workunit.client.1.smithi155.stdout:4/994: creat da/d23/d3f/d56/d69/d83/d10c/d18/d6e/f158 x:0 0 0 2024-04-25T15:57:47.861 INFO:tasks.workunit.client.1.smithi155.stdout:5/988: dread d0/d58/d32/f117 [0,4194304] 0 2024-04-25T15:57:47.862 INFO:tasks.workunit.client.1.smithi155.stdout:4/995: stat da/d23/d3f/d56/d69/d102/f152 0 2024-04-25T15:57:47.866 INFO:tasks.workunit.client.1.smithi155.stdout:4/996: creat da/d23/f159 x:0 0 0 2024-04-25T15:57:47.868 INFO:tasks.workunit.client.1.smithi155.stdout:5/989: rename d0/d3/l24 to d0/d3/d15/d1f/d50/l139 0 2024-04-25T15:57:47.869 INFO:tasks.workunit.client.1.smithi155.stdout:4/997: unlink da/d23/d3f/d56/d69/d83/d10c/d18/d6e/l5b 0 2024-04-25T15:57:47.870 INFO:tasks.workunit.client.1.smithi155.stdout:5/990: dread d0/d3/fcc [0,4194304] 0 2024-04-25T15:57:47.873 INFO:tasks.workunit.client.1.smithi155.stdout:5/991: mkdir d0/d3/d15/d30/d13a 0 2024-04-25T15:57:47.874 INFO:tasks.workunit.client.1.smithi155.stdout:5/992: truncate d0/d3/d2c/f48 5051484 0 2024-04-25T15:57:47.876 INFO:tasks.workunit.client.1.smithi155.stdout:5/993: read d0/d27/f98 [120615,33878] 0 2024-04-25T15:57:47.878 INFO:tasks.workunit.client.1.smithi155.stdout:5/994: unlink d0/d58/ccf 0 2024-04-25T15:57:47.879 INFO:tasks.workunit.client.1.smithi155.stdout:3/920: dread d1/d4/db/d20/d44/d52/d93/da6/fb4 [0,4194304] 0 2024-04-25T15:57:47.880 INFO:tasks.workunit.client.1.smithi155.stdout:3/921: truncate d1/f12d 411441 0 2024-04-25T15:57:47.882 INFO:tasks.workunit.client.1.smithi155.stdout:5/995: mknod d0/d3/d15/d9f/dc3/c13b 0 2024-04-25T15:57:47.882 INFO:tasks.workunit.client.1.smithi155.stdout:4/998: write da/d23/d3f/dc6/de2/fea [796853,28776] 0 2024-04-25T15:57:47.885 INFO:tasks.workunit.client.1.smithi155.stdout:1/922: dread d1/d16/d1d/d29/f9a [0,4194304] 0 2024-04-25T15:57:47.885 INFO:tasks.workunit.client.1.smithi155.stdout:4/999: dread da/d30/f5c [0,4194304] 0 2024-04-25T15:57:47.886 INFO:tasks.workunit.client.1.smithi155.stdout:5/996: truncate d0/d47/fa4 3574033 0 2024-04-25T15:57:47.892 INFO:tasks.workunit.client.1.smithi155.stdout:1/923: write d1/d16/d1d/d29/d5f/d34/d68/f8a [59700,8921] 0 2024-04-25T15:57:47.894 INFO:tasks.workunit.client.1.smithi155.stdout:1/924: truncate d1/fc8 427373 0 2024-04-25T15:57:47.897 INFO:tasks.workunit.client.1.smithi155.stdout:1/925: getdents d1/d32 0 2024-04-25T15:57:47.898 INFO:tasks.workunit.client.1.smithi155.stdout:5/997: dwrite d0/d58/d63/da0/fb2 [0,4194304] 0 2024-04-25T15:57:47.901 INFO:tasks.workunit.client.1.smithi155.stdout:1/926: mkdir d1/d16/d1d/d29/dcf/d124 0 2024-04-25T15:57:47.903 INFO:tasks.workunit.client.1.smithi155.stdout:1/927: write d1/d16/d1d/d33/da1/de6/ff1 [515118,32717] 0 2024-04-25T15:57:47.904 INFO:tasks.workunit.client.1.smithi155.stdout:5/998: creat d0/d3/d15/d1f/d50/f13c x:0 0 0 2024-04-25T15:57:47.905 INFO:tasks.workunit.client.1.smithi155.stdout:1/928: mknod d1/d16/d1d/d29/d5f/d34/d68/c125 0 2024-04-25T15:57:47.906 INFO:tasks.workunit.client.1.smithi155.stdout:1/929: readlink d1/d16/d1d/d33/l4a 0 2024-04-25T15:57:47.908 INFO:tasks.workunit.client.1.smithi155.stdout:1/930: symlink d1/d16/d1d/d33/l126 0 2024-04-25T15:57:47.909 INFO:tasks.workunit.client.1.smithi155.stdout:1/931: chown d1/d16/d1d/d29/l6f 5013 1 2024-04-25T15:57:47.916 INFO:tasks.workunit.client.1.smithi155.stdout:1/932: dwrite d1/f15 [4194304,4194304] 0 2024-04-25T15:57:47.918 INFO:tasks.workunit.client.1.smithi155.stdout:5/999: dwrite d0/d3/d15/d9f/dc3/fd3 [0,4194304] 0 2024-04-25T15:57:47.925 INFO:tasks.workunit.client.1.smithi155.stdout:1/933: dwrite d1/d16/d1d/d33/fec [0,4194304] 0 2024-04-25T15:57:47.927 INFO:tasks.workunit.client.1.smithi155.stdout:1/934: mkdir d1/d16/d1d/d33/d10a/d127 0 2024-04-25T15:57:47.935 INFO:tasks.workunit.client.1.smithi155.stdout:1/935: dwrite d1/d16/f27 [4194304,4194304] 0 2024-04-25T15:57:47.942 INFO:tasks.workunit.client.1.smithi155.stdout:1/936: dwrite d1/d16/d37/f114 [0,4194304] 0 2024-04-25T15:57:47.943 INFO:tasks.workunit.client.1.smithi155.stdout:1/937: readlink d1/d16/d1d/d29/l6f 0 2024-04-25T15:57:47.946 INFO:tasks.workunit.client.1.smithi155.stdout:1/938: read d1/d6/f31 [4487468,67462] 0 2024-04-25T15:57:47.946 INFO:tasks.workunit.client.1.smithi155.stdout:1/939: chown d1/f7a 2125591712 1 2024-04-25T15:57:47.954 INFO:tasks.workunit.client.1.smithi155.stdout:9/831: sync 2024-04-25T15:57:47.957 INFO:tasks.workunit.client.1.smithi155.stdout:9/832: creat dc/d17/d8e/de1/f10c x:0 0 0 2024-04-25T15:57:47.958 INFO:tasks.workunit.client.1.smithi155.stdout:9/833: readlink dc/d11/lb9 0 2024-04-25T15:57:47.958 INFO:tasks.workunit.client.1.smithi155.stdout:1/940: write d1/d16/d1d/d29/d5f/fae [639197,41817] 0 2024-04-25T15:57:47.960 INFO:tasks.workunit.client.1.smithi155.stdout:1/941: read d1/d16/f3e [1187506,30439] 0 2024-04-25T15:57:47.960 INFO:tasks.workunit.client.1.smithi155.stdout:9/834: creat dc/d11/d30/dd2/f10d x:0 0 0 2024-04-25T15:57:47.963 INFO:tasks.workunit.client.1.smithi155.stdout:9/835: dread dc/d11/d30/d46/f8d [0,4194304] 0 2024-04-25T15:57:47.967 INFO:tasks.workunit.client.1.smithi155.stdout:1/942: truncate d1/d16/d8f/fce 616246 0 2024-04-25T15:57:47.967 INFO:tasks.workunit.client.1.smithi155.stdout:9/836: write dc/d2f/f7b [4262358,113876] 0 2024-04-25T15:57:47.968 INFO:tasks.workunit.client.1.smithi155.stdout:1/943: fdatasync d1/d16/d1d/d5e/fe2 0 2024-04-25T15:57:47.969 INFO:tasks.workunit.client.1.smithi155.stdout:1/944: rmdir d1/d16/d37 39 2024-04-25T15:57:47.971 INFO:tasks.workunit.client.1.smithi155.stdout:9/837: creat dc/d17/dc0/f10e x:0 0 0 2024-04-25T15:57:47.972 INFO:tasks.workunit.client.1.smithi155.stdout:9/838: chown dc/d17/d8e/de2 0 1 2024-04-25T15:57:47.974 INFO:tasks.workunit.client.1.smithi155.stdout:9/839: creat dc/d17/d8e/de2/f10f x:0 0 0 2024-04-25T15:57:47.977 INFO:tasks.workunit.client.1.smithi155.stdout:1/945: dread d1/d16/d1d/d29/d5f/d34/d68/d93/da4/fd1 [0,4194304] 0 2024-04-25T15:57:47.977 INFO:tasks.workunit.client.1.smithi155.stdout:9/840: creat dc/d17/d8e/dae/dd6/d56/d102/f110 x:0 0 0 2024-04-25T15:57:47.978 INFO:tasks.workunit.client.1.smithi155.stdout:1/946: fdatasync d1/d16/d1d/d33/da1/de6/ff1 0 2024-04-25T15:57:47.979 INFO:tasks.workunit.client.1.smithi155.stdout:1/947: stat d1/d32 0 2024-04-25T15:57:47.979 INFO:tasks.workunit.client.1.smithi155.stdout:9/841: write dc/d11/d30/dd2/ddf/f100 [1849292,130880] 0 2024-04-25T15:57:47.981 INFO:tasks.workunit.client.1.smithi155.stdout:1/948: truncate d1/d16/d1d/d29/d5f/fd7 246308 0 2024-04-25T15:57:47.981 INFO:tasks.workunit.client.1.smithi155.stdout:9/842: unlink dc/d11/d30/d46/f8d 0 2024-04-25T15:57:47.983 INFO:tasks.workunit.client.1.smithi155.stdout:9/843: read dc/d11/d30/d46/fcd [136968,43888] 0 2024-04-25T15:57:47.990 INFO:tasks.workunit.client.1.smithi155.stdout:1/949: dread d1/d16/f3e [0,4194304] 0 2024-04-25T15:57:47.990 INFO:tasks.workunit.client.1.smithi155.stdout:9/844: dwrite dc/d13/f26 [0,4194304] 0 2024-04-25T15:57:47.997 INFO:tasks.workunit.client.1.smithi155.stdout:9/845: rename dc/d3c/d9b/fb2 to dc/f111 0 2024-04-25T15:57:48.019 INFO:tasks.workunit.client.1.smithi155.stdout:0/916: sync 2024-04-25T15:57:48.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.019+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59080caa40 con 0x7f59080c96c0 2024-04-25T15:57:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.019+0000 7f58effff640 1 -- 172.21.15.87:0/1441524076 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f58fc05f240 con 0x7f59080c96c0 2024-04-25T15:57:48.023 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:48.023 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f58f406f400 msgr2=0x7f58f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f58f406f400 0x7f58f4071910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ad000 tx=0x7f58f8004740 comp rx=0 tx=0).stop 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 msgr2=0x7f590814d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 0x7f590814d940 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c430 tx=0x7f58fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 shutdown_connections 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f58f406f400 0x7f58f4071910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5908154ae0 0x7f5908147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59080c96c0 0x7f590814d940 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 --2- 172.21.15.87:0/1441524076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59080c92b0 0x7f590814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 >> 172.21.15.87:0/1441524076 conn(0x7f59080ae490 msgr2=0x7f59080ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 shutdown_connections 2024-04-25T15:57:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:48.023+0000 7f590e0ed640 1 -- 172.21.15.87:0/1441524076 wait complete. 2024-04-25T15:57:48.040 INFO:tasks.workunit.client.1.smithi155.stdout:1/950: rename d1/d16/d37/l6c to d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/l128 0 2024-04-25T15:57:48.043 INFO:tasks.workunit.client.1.smithi155.stdout:0/917: chown d1/d3/d6a/c124 7927054 1 2024-04-25T15:57:48.048 INFO:tasks.workunit.client.1.smithi155.stdout:8/809: sync 2024-04-25T15:57:48.048 INFO:tasks.workunit.client.1.smithi155.stdout:3/922: sync 2024-04-25T15:57:48.049 INFO:tasks.workunit.client.1.smithi155.stdout:3/923: readlink d1/d4/lf 0 2024-04-25T15:57:48.055 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:48.055 INFO:tasks.workunit.client.1.smithi155.stdout:1/951: link d1/d16/d1d/d33/l4a d1/d32/d86/l129 0 2024-04-25T15:57:48.056 INFO:tasks.workunit.client.1.smithi155.stdout:1/952: chown d1/c2e 1505621224 1 2024-04-25T15:57:48.056 INFO:tasks.workunit.client.1.smithi155.stdout:3/924: truncate d1/d4/d10/d21/d73/d77/d57/d80/fb7 1796857 0 2024-04-25T15:57:48.057 INFO:tasks.workunit.client.1.smithi155.stdout:3/925: chown d1/d4/db/d20 14648 1 2024-04-25T15:57:48.059 INFO:tasks.workunit.client.1.smithi155.stdout:1/953: dread - d1/d16/d1d/d29/d5f/d34/d68/fbf zero size 2024-04-25T15:57:48.086 INFO:tasks.workunit.client.1.smithi155.stdout:3/926: creat d1/d4/d10/d21/d73/d77/d5f/f13d x:0 0 0 2024-04-25T15:57:48.091 INFO:tasks.workunit.client.1.smithi155.stdout:8/810: link d2/d15/d63/cfe d2/d15/d18/d23/d3c/c109 0 2024-04-25T15:57:48.096 INFO:tasks.workunit.client.1.smithi155.stdout:9/846: truncate dc/d17/d2a/ff1 3881560 0 2024-04-25T15:57:48.097 INFO:tasks.workunit.client.1.smithi155.stdout:9/847: write dc/d13/fa7 [1931432,63706] 0 2024-04-25T15:57:48.098 INFO:tasks.workunit.client.1.smithi155.stdout:0/918: write d1/d3/d12/f84 [2048222,46313] 0 2024-04-25T15:57:48.100 INFO:tasks.workunit.client.1.smithi155.stdout:0/919: dread - d1/d1a/fba zero size 2024-04-25T15:57:48.102 INFO:tasks.workunit.client.1.smithi155.stdout:9/848: truncate dc/d17/dc0/dc9/ff2 103075 0 2024-04-25T15:57:48.102 INFO:tasks.workunit.client.1.smithi155.stdout:9/849: stat dc/d17/d2a/f35 0 2024-04-25T15:57:48.103 INFO:tasks.workunit.client.1.smithi155.stdout:0/920: symlink d1/d3/d5/da/l127 0 2024-04-25T15:57:48.106 INFO:tasks.workunit.client.1.smithi155.stdout:0/921: symlink d1/d3/d6a/dfb/ded/l128 0 2024-04-25T15:57:48.108 INFO:tasks.workunit.client.1.smithi155.stdout:1/954: truncate d1/f11 4405511 0 2024-04-25T15:57:48.109 INFO:tasks.workunit.client.1.smithi155.stdout:0/922: dread d1/d3/f11f [0,4194304] 0 2024-04-25T15:57:48.109 INFO:tasks.workunit.client.1.smithi155.stdout:1/955: mknod d1/d32/d9d/c12a 0 2024-04-25T15:57:48.110 INFO:tasks.workunit.client.1.smithi155.stdout:0/923: chown d1/d3/d5/d5b/dc4/d6e/d107/f2f 93 1 2024-04-25T15:57:48.112 INFO:tasks.workunit.client.1.smithi155.stdout:0/924: mknod d1/d3/d3d/d46/da4/db6/c129 0 2024-04-25T15:57:48.113 INFO:tasks.workunit.client.1.smithi155.stdout:3/927: rmdir d1/d4/d10 39 2024-04-25T15:57:48.113 INFO:tasks.workunit.client.1.smithi155.stdout:3/928: stat d1/d4/db/d91/dc4/d6c/lf1 0 2024-04-25T15:57:48.115 INFO:tasks.workunit.client.1.smithi155.stdout:1/956: dread d1/f24 [0,4194304] 0 2024-04-25T15:57:48.119 INFO:tasks.workunit.client.1.smithi155.stdout:3/929: creat d1/d4/db/d20/d44/d52/d93/d139/f13e x:0 0 0 2024-04-25T15:57:48.121 INFO:tasks.workunit.client.1.smithi155.stdout:1/957: creat d1/d16/d1d/d29/d5f/d34/f12b x:0 0 0 2024-04-25T15:57:48.122 INFO:tasks.workunit.client.1.smithi155.stdout:3/930: symlink d1/d4/db/d91/dc4/dd9/d86/l13f 0 2024-04-25T15:57:48.124 INFO:tasks.workunit.client.1.smithi155.stdout:1/958: mknod d1/d16/d8f/c12c 0 2024-04-25T15:57:48.127 INFO:tasks.workunit.client.1.smithi155.stdout:8/811: truncate d2/d15/d63/dd7/d108/fe8 703077 0 2024-04-25T15:57:48.130 INFO:tasks.workunit.client.1.smithi155.stdout:8/812: write d2/d15/d18/d23/d3c/f61 [828615,36358] 0 2024-04-25T15:57:48.131 INFO:tasks.workunit.client.1.smithi155.stdout:9/850: truncate dc/d13/d48/f88 3311519 0 2024-04-25T15:57:48.140 INFO:tasks.workunit.client.1.smithi155.stdout:0/925: truncate d1/d41/fff 6394893 0 2024-04-25T15:57:48.144 INFO:tasks.workunit.client.1.smithi155.stdout:1/959: dwrite d1/fcc [0,4194304] 0 2024-04-25T15:57:48.146 INFO:tasks.workunit.client.1.smithi155.stdout:1/960: fdatasync d1/d16/d1d/d29/d5f/f7c 0 2024-04-25T15:57:48.149 INFO:tasks.workunit.client.1.smithi155.stdout:3/931: dwrite d1/d4/db/d91/dc4/d6c/fe3 [0,4194304] 0 2024-04-25T15:57:48.159 INFO:tasks.workunit.client.1.smithi155.stdout:3/932: dwrite d1/f12d [0,4194304] 0 2024-04-25T15:57:48.168 INFO:tasks.workunit.client.1.smithi155.stdout:0/926: symlink d1/d10c/l12a 0 2024-04-25T15:57:48.174 INFO:tasks.workunit.client.1.smithi155.stdout:1/961: creat d1/d16/d1d/d29/d3d/d43/d88/f12d x:0 0 0 2024-04-25T15:57:48.176 INFO:tasks.workunit.client.1.smithi155.stdout:3/933: rmdir d1/d4/db/d20/d44/d52/d61/d89 39 2024-04-25T15:57:48.179 INFO:tasks.workunit.client.1.smithi155.stdout:9/851: rename dc/d17/f20 to dc/d17/d8e/dae/dd6/f112 0 2024-04-25T15:57:48.182 INFO:tasks.workunit.client.1.smithi155.stdout:3/934: truncate d1/d4/db/d91/de4/f10c 495634 0 2024-04-25T15:57:48.182 INFO:tasks.workunit.client.1.smithi155.stdout:1/962: mknod d1/d16/d1d/d29/d3d/d43/d88/d10b/d122/c12e 0 2024-04-25T15:57:48.184 INFO:tasks.workunit.client.1.smithi155.stdout:0/927: rename d1/d85/fa1 to d1/d3/d6a/f12b 0 2024-04-25T15:57:48.185 INFO:tasks.workunit.client.1.smithi155.stdout:9/852: unlink dc/d17/d8e/cb5 0 2024-04-25T15:57:48.185 INFO:tasks.workunit.client.1.smithi155.stdout:8/813: getdents d2/d41 0 2024-04-25T15:57:48.186 INFO:tasks.workunit.client.1.smithi155.stdout:9/853: write dc/d17/f51 [5593593,91807] 0 2024-04-25T15:57:48.187 INFO:tasks.workunit.client.1.smithi155.stdout:8/814: readlink d2/d15/da1/dde/l27 0 2024-04-25T15:57:48.188 INFO:tasks.workunit.client.1.smithi155.stdout:3/935: fsync d1/d4/d10/d21/d73/fa5 0 2024-04-25T15:57:48.189 INFO:tasks.workunit.client.1.smithi155.stdout:1/963: rename d1/d16/d1d/d33/f4f to d1/d10d/f12f 0 2024-04-25T15:57:48.189 INFO:tasks.workunit.client.1.smithi155.stdout:9/854: write dc/d13/d60/fc7 [251123,118837] 0 2024-04-25T15:57:48.190 INFO:tasks.workunit.client.1.smithi155.stdout:8/815: chown d2/d15/d18/c1e 859 1 2024-04-25T15:57:48.190 INFO:tasks.workunit.client.1.smithi155.stdout:0/928: creat d1/d3/d12/d92/d9d/f12c x:0 0 0 2024-04-25T15:57:48.194 INFO:tasks.workunit.client.1.smithi155.stdout:8/816: mknod d2/d15/d18/d23/d3c/d76/d7e/ddb/c10a 0 2024-04-25T15:57:48.195 INFO:tasks.workunit.client.1.smithi155.stdout:3/936: truncate d1/d4/db/d20/fa8 3734071 0 2024-04-25T15:57:48.197 INFO:tasks.workunit.client.1.smithi155.stdout:3/937: write d1/d4/db/d28/d58/de6/f10e [66081,4426] 0 2024-04-25T15:57:48.198 INFO:tasks.workunit.client.1.smithi155.stdout:3/938: write d1/d4/f2d [397205,20583] 0 2024-04-25T15:57:48.202 INFO:tasks.workunit.client.1.smithi155.stdout:1/964: rename d1/d16/d1d/d29/d5f/d34/d68/d93/da4/f123 to d1/d16/f130 0 2024-04-25T15:57:48.204 INFO:tasks.workunit.client.1.smithi155.stdout:9/855: getdents dc/d3c 0 2024-04-25T15:57:48.206 INFO:tasks.workunit.client.1.smithi155.stdout:0/929: rmdir d1/d3/d12/d92/d104/d110 0 2024-04-25T15:57:48.207 INFO:tasks.workunit.client.1.smithi155.stdout:1/965: truncate d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc6/f105 5042752 0 2024-04-25T15:57:48.208 INFO:tasks.workunit.client.1.smithi155.stdout:1/966: chown d1/d16/d1d/d29/dcf/c11b 7452325 1 2024-04-25T15:57:48.208 INFO:tasks.workunit.client.1.smithi155.stdout:3/939: rename d1/d94/fd5 to d1/d4/db/d20/d44/d52/d61/db5/f140 0 2024-04-25T15:57:48.209 INFO:tasks.workunit.client.1.smithi155.stdout:9/856: creat dc/d13/d48/f113 x:0 0 0 2024-04-25T15:57:48.211 INFO:tasks.workunit.client.1.smithi155.stdout:0/930: symlink d1/d3/d12/d92/l12d 0 2024-04-25T15:57:48.216 INFO:tasks.workunit.client.1.smithi155.stdout:8/817: dread d2/d15/d18/d49/df4/f42 [0,4194304] 0 2024-04-25T15:57:48.218 INFO:tasks.workunit.client.1.smithi155.stdout:3/940: dread d1/d4/db/d91/dc4/dd9/fcb [0,4194304] 0 2024-04-25T15:57:48.218 INFO:tasks.workunit.client.1.smithi155.stdout:9/857: rename dc/d13/d2e/fb1 to dc/d17/d8e/f114 0 2024-04-25T15:57:48.218 INFO:tasks.workunit.client.1.smithi155.stdout:1/967: dwrite d1/d32/fee [0,4194304] 0 2024-04-25T15:57:48.219 INFO:tasks.workunit.client.1.smithi155.stdout:8/818: readlink d2/d15/d18/d23/d3c/de0/le5 0 2024-04-25T15:57:48.221 INFO:tasks.workunit.client.1.smithi155.stdout:8/819: chown d2/d15/da1/ccb 627948919 1 2024-04-25T15:57:48.221 INFO:tasks.workunit.client.1.smithi155.stdout:3/941: chown d1/d4/d10/d21/d73/d77/d5f/fae 1 1 2024-04-25T15:57:48.227 INFO:tasks.workunit.client.1.smithi155.stdout:8/820: mkdir d2/d15/d63/dc0/d10b 0 2024-04-25T15:57:48.229 INFO:tasks.workunit.client.1.smithi155.stdout:3/942: rename d1/d4/db/f7d to d1/d4/db/d91/dc4/d10b/f141 0 2024-04-25T15:57:48.232 INFO:tasks.workunit.client.1.smithi155.stdout:3/943: chown d1/d4/db/d28/d58/faf 743807682 1 2024-04-25T15:57:48.232 INFO:tasks.workunit.client.1.smithi155.stdout:9/858: dwrite dc/d11/fd0 [0,4194304] 0 2024-04-25T15:57:48.233 INFO:tasks.workunit.client.1.smithi155.stdout:8/821: symlink d2/d15/d18/d34/d48/d7f/l10c 0 2024-04-25T15:57:48.233 INFO:tasks.workunit.client.1.smithi155.stdout:3/944: chown d1/d4/db/d20/f3b 401379 1 2024-04-25T15:57:48.235 INFO:tasks.workunit.client.1.smithi155.stdout:8/822: rmdir d2/d15/da1/dde/d40/d5b 39 2024-04-25T15:57:48.236 INFO:tasks.workunit.client.1.smithi155.stdout:1/968: link d1/d16/c17 d1/d16/d1d/d33/da1/de0/c131 0 2024-04-25T15:57:48.236 INFO:tasks.workunit.client.1.smithi155.stdout:9/859: dread dc/d17/dc0/dc9/ff2 [0,4194304] 0 2024-04-25T15:57:48.236 INFO:tasks.workunit.client.1.smithi155.stdout:3/945: truncate d1/d4/d10/d21/d73/fb2 4110361 0 2024-04-25T15:57:48.237 INFO:tasks.workunit.client.1.smithi155.stdout:8/823: chown d2/d15/d63/lbd 3 1 2024-04-25T15:57:48.238 INFO:tasks.workunit.client.1.smithi155.stdout:3/946: chown d1/d4/db/d91/de4/d104 67422127 1 2024-04-25T15:57:48.241 INFO:tasks.workunit.client.1.smithi155.stdout:9/860: rename dc/d11/fd0 to dc/d17/d8e/dae/dd6/d56/d102/f115 0 2024-04-25T15:57:48.242 INFO:tasks.workunit.client.1.smithi155.stdout:3/947: rmdir d1/d4/db/d28/d58/d113 39 2024-04-25T15:57:48.242 INFO:tasks.workunit.client.1.smithi155.stdout:8/824: mkdir d2/d15/da1/dde/d40/d5b/d10d 0 2024-04-25T15:57:48.244 INFO:tasks.workunit.client.1.smithi155.stdout:0/931: dread d1/d3/d5/d5b/dc4/d6e/d107/f8a [0,4194304] 0 2024-04-25T15:57:48.244 INFO:tasks.workunit.client.1.smithi155.stdout:8/825: stat d2/d15/d18/d23/d3c/d76/d7e/ddb/c10a 0 2024-04-25T15:57:48.245 INFO:tasks.workunit.client.1.smithi155.stdout:3/948: creat d1/d4/db/d20/d44/d52/d93/d139/f142 x:0 0 0 2024-04-25T15:57:48.246 INFO:tasks.workunit.client.1.smithi155.stdout:8/826: rmdir d2/d15/d18/d23/d2d/da5 39 2024-04-25T15:57:48.247 INFO:tasks.workunit.client.1.smithi155.stdout:0/932: creat d1/d3f/d10b/f12e x:0 0 0 2024-04-25T15:57:48.248 INFO:tasks.workunit.client.1.smithi155.stdout:3/949: rename d1/d4/db/d28/f87 to d1/d4/d10/d21/deb/f143 0 2024-04-25T15:57:48.248 INFO:tasks.workunit.client.1.smithi155.stdout:8/827: rmdir d2/d15/da1/dde/d40/d5b 39 2024-04-25T15:57:48.252 INFO:tasks.workunit.client.1.smithi155.stdout:0/933: getdents d1/d85 0 2024-04-25T15:57:48.254 INFO:tasks.workunit.client.1.smithi155.stdout:8/828: dread d2/f11 [0,4194304] 0 2024-04-25T15:57:48.254 INFO:tasks.workunit.client.1.smithi155.stdout:3/950: getdents d1/d4/d10/d21/d73/d77/d5f/db3 0 2024-04-25T15:57:48.255 INFO:tasks.workunit.client.1.smithi155.stdout:0/934: mkdir d1/d3/d6a/d9b/d12f 0 2024-04-25T15:57:48.256 INFO:tasks.workunit.client.1.smithi155.stdout:3/951: dread d1/d4/d10/d21/d73/d77/d5f/f7e [0,4194304] 0 2024-04-25T15:57:48.257 INFO:tasks.workunit.client.1.smithi155.stdout:0/935: mkdir d1/d1a/d130 0 2024-04-25T15:57:48.258 INFO:tasks.workunit.client.1.smithi155.stdout:0/936: chown d1/d3/d12/d92/l12d 248665302 1 2024-04-25T15:57:48.258 INFO:tasks.workunit.client.1.smithi155.stdout:3/952: read d1/d4/db/d91/dc4/f3c [3242041,59279] 0 2024-04-25T15:57:48.259 INFO:tasks.workunit.client.1.smithi155.stdout:9/861: dread dc/d11/d67/fbb [0,4194304] 0 2024-04-25T15:57:48.261 INFO:tasks.workunit.client.1.smithi155.stdout:3/953: creat d1/d4/db/d28/d58/de6/f144 x:0 0 0 2024-04-25T15:57:48.263 INFO:tasks.workunit.client.1.smithi155.stdout:9/862: dread dc/d11/d5a/f65 [0,4194304] 0 2024-04-25T15:57:48.267 INFO:tasks.workunit.client.1.smithi155.stdout:9/863: dread dc/d17/d8e/dae/dd6/f41 [0,4194304] 0 2024-04-25T15:57:48.270 INFO:tasks.workunit.client.1.smithi155.stdout:9/864: symlink dc/d17/dc0/l116 0 2024-04-25T15:57:48.272 INFO:tasks.workunit.client.1.smithi155.stdout:9/865: creat dc/d3c/f117 x:0 0 0 2024-04-25T15:57:48.273 INFO:tasks.workunit.client.1.smithi155.stdout:0/937: write d1/d41/df4/f74 [2380682,59640] 0 2024-04-25T15:57:48.275 INFO:tasks.workunit.client.1.smithi155.stdout:3/954: write d1/d4/d10/d21/d73/d77/d57/d7c/fce [665973,43003] 0 2024-04-25T15:57:48.275 INFO:tasks.workunit.client.1.smithi155.stdout:0/938: symlink d1/d3f/d10b/l131 0 2024-04-25T15:57:48.276 INFO:tasks.workunit.client.1.smithi155.stdout:9/866: dread dc/d11/d30/d46/f4b [0,4194304] 0 2024-04-25T15:57:48.277 INFO:tasks.workunit.client.1.smithi155.stdout:0/939: symlink d1/d3f/l132 0 2024-04-25T15:57:48.278 INFO:tasks.workunit.client.1.smithi155.stdout:9/867: creat dc/d13/de5/f118 x:0 0 0 2024-04-25T15:57:48.279 INFO:tasks.workunit.client.1.smithi155.stdout:3/955: rename d1/d4/db/d20/d44/d52/d61/f110 to d1/d4/d10/d21/dab/f145 0 2024-04-25T15:57:48.280 INFO:tasks.workunit.client.1.smithi155.stdout:0/940: mkdir d1/d10c/d133 0 2024-04-25T15:57:48.280 INFO:tasks.workunit.client.1.smithi155.stdout:3/956: fdatasync d1/d4/d10/d21/d73/d8d/f122 0 2024-04-25T15:57:48.281 INFO:tasks.workunit.client.1.smithi155.stdout:3/957: stat d1/d4/db/d91/dc4/d6c/d111 0 2024-04-25T15:57:48.282 INFO:tasks.workunit.client.1.smithi155.stdout:0/941: mkdir d1/d41/df4/d134 0 2024-04-25T15:57:48.283 INFO:tasks.workunit.client.1.smithi155.stdout:9/868: creat dc/d11/f119 x:0 0 0 2024-04-25T15:57:48.285 INFO:tasks.workunit.client.1.smithi155.stdout:3/958: symlink d1/d4/l146 0 2024-04-25T15:57:48.286 INFO:tasks.workunit.client.1.smithi155.stdout:0/942: symlink d1/d3/d3d/l135 0 2024-04-25T15:57:48.289 INFO:tasks.workunit.client.1.smithi155.stdout:3/959: rename d1/d4/d10/d21/d73/fa5 to d1/d4/d10/d21/d73/d77/d57/dcf/f147 0 2024-04-25T15:57:48.290 INFO:tasks.workunit.client.1.smithi155.stdout:3/960: readlink d1/d4/d10/d21/dab/lb1 0 2024-04-25T15:57:48.295 INFO:tasks.workunit.client.1.smithi155.stdout:0/943: dread d1/d3/d5/d5b/dc4/d6e/d107/f2f [0,4194304] 0 2024-04-25T15:57:48.295 INFO:tasks.workunit.client.1.smithi155.stdout:9/869: write dc/d13/d48/f88 [1699920,112822] 0 2024-04-25T15:57:48.297 INFO:tasks.workunit.client.1.smithi155.stdout:0/944: write d1/d85/d8c/d114/f11d [4566571,24109] 0 2024-04-25T15:57:48.302 INFO:tasks.workunit.client.1.smithi155.stdout:0/945: getdents d1/d41/df4 0 2024-04-25T15:57:48.311 INFO:tasks.workunit.client.1.smithi155.stdout:0/946: dwrite d1/d85/d98/fc3 [0,4194304] 0 2024-04-25T15:57:48.312 INFO:tasks.workunit.client.1.smithi155.stdout:9/870: dread dc/d17/d2a/ff1 [0,4194304] 0 2024-04-25T15:57:48.313 INFO:tasks.workunit.client.1.smithi155.stdout:3/961: dread d1/d4/db/d20/d44/d52/d61/d89/f8c [0,4194304] 0 2024-04-25T15:57:48.315 INFO:tasks.workunit.client.1.smithi155.stdout:9/871: mkdir dc/d13/d48/d11a 0 2024-04-25T15:57:48.316 INFO:tasks.workunit.client.1.smithi155.stdout:0/947: rename d1/d3/d5/d5b/dc4/d60/f126 to d1/d3/d6a/d9b/d12f/f136 0 2024-04-25T15:57:48.318 INFO:tasks.workunit.client.1.smithi155.stdout:9/872: creat dc/d17/d8e/de1/f11b x:0 0 0 2024-04-25T15:57:48.318 INFO:tasks.workunit.client.1.smithi155.stdout:3/962: mknod d1/d4/db/d91/de4/d104/c148 0 2024-04-25T15:57:48.319 INFO:tasks.workunit.client.1.smithi155.stdout:9/873: dread - dc/d17/fe9 zero size 2024-04-25T15:57:48.321 INFO:tasks.workunit.client.1.smithi155.stdout:0/948: dread d1/d3/d12/fec [0,4194304] 0 2024-04-25T15:57:48.321 INFO:tasks.workunit.client.1.smithi155.stdout:3/963: write d1/d4/d10/d21/d73/d77/d57/dcf/ff2 [406272,41701] 0 2024-04-25T15:57:48.322 INFO:tasks.workunit.client.1.smithi155.stdout:9/874: mknod dc/d17/dc0/dc9/c11c 0 2024-04-25T15:57:48.323 INFO:tasks.workunit.client.1.smithi155.stdout:3/964: dread - d1/d4/db/d20/d44/d52/d93/d139/f13e zero size 2024-04-25T15:57:48.325 INFO:tasks.workunit.client.1.smithi155.stdout:3/965: symlink d1/d4/db/d20/d44/d52/d61/l149 0 2024-04-25T15:57:48.329 INFO:tasks.workunit.client.1.smithi155.stdout:3/966: creat d1/d4/db/d91/f14a x:0 0 0 2024-04-25T15:57:48.329 INFO:tasks.workunit.client.1.smithi155.stdout:9/875: dwrite dc/d11/d5a/fca [0,4194304] 0 2024-04-25T15:57:48.338 INFO:tasks.workunit.client.1.smithi155.stdout:9/876: dwrite dc/d17/d2a/f8b [4194304,4194304] 0 2024-04-25T15:57:48.342 INFO:tasks.workunit.client.1.smithi155.stdout:9/877: mkdir dc/d17/d8e/dae/dd6/d56/d102/d11d 0 2024-04-25T15:57:48.344 INFO:tasks.workunit.client.1.smithi155.stdout:9/878: getdents dc/d11/d30/d46/da0/d101 0 2024-04-25T15:57:48.346 INFO:tasks.workunit.client.1.smithi155.stdout:3/967: read d1/d4/d10/d21/d73/f99 [3731471,109561] 0 2024-04-25T15:57:48.352 INFO:tasks.workunit.client.1.smithi155.stdout:3/968: dwrite d1/d4/db/d20/d44/d52/fad [0,4194304] 0 2024-04-25T15:57:48.357 INFO:tasks.workunit.client.1.smithi155.stdout:3/969: creat d1/d4/db/d28/d58/de6/f14b x:0 0 0 2024-04-25T15:57:48.360 INFO:tasks.workunit.client.1.smithi155.stdout:3/970: dread d1/d4/db/d91/dc4/dd9/fcb [0,4194304] 0 2024-04-25T15:57:48.364 INFO:tasks.workunit.client.1.smithi155.stdout:3/971: rename d1/d4/d10/d21/d73/d77/d5f/dee/c127 to d1/d4/d10/d21/d73/d77/d57/dcf/c14c 0 2024-04-25T15:57:48.368 INFO:tasks.workunit.client.1.smithi155.stdout:3/972: rename d1/d4/fc7 to d1/d4/d10/d21/d73/d77/d5f/dee/f14d 0 2024-04-25T15:57:48.369 INFO:tasks.workunit.client.1.smithi155.stdout:3/973: truncate d1/d4/db/d20/d44/d52/f136 234586 0 2024-04-25T15:57:48.371 INFO:tasks.workunit.client.1.smithi155.stdout:3/974: symlink d1/d4/d10/d21/d73/d77/d5f/l14e 0 2024-04-25T15:57:48.390 INFO:tasks.workunit.client.1.smithi155.stdout:3/975: dread d1/d4/d10/d21/d73/f99 [0,4194304] 0 2024-04-25T15:57:48.395 INFO:tasks.workunit.client.1.smithi155.stdout:3/976: dread d1/d4/db/d91/f134 [0,4194304] 0 2024-04-25T15:57:48.409 INFO:tasks.workunit.client.1.smithi155.stdout:3/977: dwrite d1/d4/f18 [0,4194304] 0 2024-04-25T15:57:48.418 INFO:tasks.workunit.client.1.smithi155.stdout:3/978: dwrite d1/d4/d10/d21/f5a [0,4194304] 0 2024-04-25T15:57:48.419 INFO:tasks.workunit.client.1.smithi155.stdout:3/979: stat d1/d4/db/d91/dc4/dd9/d86/d9e 0 2024-04-25T15:57:48.421 INFO:tasks.workunit.client.1.smithi155.stdout:3/980: mknod d1/d4/db/d91/dc4/d10b/d11e/c14f 0 2024-04-25T15:57:48.428 INFO:tasks.workunit.client.1.smithi155.stdout:3/981: write d1/d4/db/d20/d44/d52/d61/db5/f2b [4725742,123553] 0 2024-04-25T15:57:48.431 INFO:tasks.workunit.client.1.smithi155.stdout:3/982: symlink d1/d4/d10/d21/dab/l150 0 2024-04-25T15:57:48.432 INFO:tasks.workunit.client.1.smithi155.stdout:3/983: chown d1/d4/db/d91/dc4/c30 1437616695 1 2024-04-25T15:57:48.435 INFO:tasks.workunit.client.1.smithi155.stdout:3/984: mknod d1/d4/d10/d21/d73/d77/d5f/db3/c151 0 2024-04-25T15:57:48.436 INFO:tasks.workunit.client.1.smithi155.stdout:3/985: mknod d1/d4/d10/c152 0 2024-04-25T15:57:48.438 INFO:tasks.workunit.client.1.smithi155.stdout:3/986: mknod d1/c153 0 2024-04-25T15:57:48.441 INFO:tasks.workunit.client.1.smithi155.stdout:3/987: rename d1/d4/db/d91/c105 to d1/d4/d10/d21/d73/c154 0 2024-04-25T15:57:48.443 INFO:tasks.workunit.client.1.smithi155.stdout:3/988: creat d1/d4/db/d20/d44/d52/d93/d139/f155 x:0 0 0 2024-04-25T15:57:48.447 INFO:tasks.workunit.client.1.smithi155.stdout:3/989: link d1/d4/c69 d1/d4/d10/d21/d73/d77/d5f/dee/df8/c156 0 2024-04-25T15:57:48.447 INFO:tasks.workunit.client.1.smithi155.stdout:3/990: read d1/d4/db/d91/f134 [589260,74682] 0 2024-04-25T15:57:48.451 INFO:tasks.workunit.client.1.smithi155.stdout:1/969: sync 2024-04-25T15:57:48.454 INFO:tasks.workunit.client.1.smithi155.stdout:1/970: creat d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/f132 x:0 0 0 2024-04-25T15:57:48.456 INFO:tasks.workunit.client.1.smithi155.stdout:1/971: mkdir d1/d16/d1d/d33/da1/de6/d133 0 2024-04-25T15:57:48.457 INFO:tasks.workunit.client.1.smithi155.stdout:1/972: write d1/d6/db4/ffe [93035,26140] 0 2024-04-25T15:57:48.459 INFO:tasks.workunit.client.1.smithi155.stdout:1/973: mkdir d1/d16/d37/d134 0 2024-04-25T15:57:48.461 INFO:tasks.workunit.client.1.smithi155.stdout:1/974: chown d1/d16/d1d/d29/d5f/f112 8101 1 2024-04-25T15:57:48.462 INFO:tasks.workunit.client.1.smithi155.stdout:3/991: dwrite d1/d4/db/d20/d44/d52/d61/db5/f140 [0,4194304] 0 2024-04-25T15:57:48.464 INFO:tasks.workunit.client.1.smithi155.stdout:1/975: unlink d1/d16/d1d/d5e/f63 0 2024-04-25T15:57:48.466 INFO:tasks.workunit.client.1.smithi155.stdout:1/976: rmdir d1/da0 39 2024-04-25T15:57:48.468 INFO:tasks.workunit.client.1.smithi155.stdout:1/977: stat d1/d16/d1d/d5e/c10c 0 2024-04-25T15:57:48.468 INFO:tasks.workunit.client.1.smithi155.stdout:1/978: stat d1/f7a 0 2024-04-25T15:57:48.469 INFO:tasks.workunit.client.1.smithi155.stdout:1/979: symlink d1/d16/d1d/d29/d3d/dfd/l135 0 2024-04-25T15:57:48.471 INFO:tasks.workunit.client.1.smithi155.stdout:1/980: write d1/d16/d1d/d29/d3d/d43/d88/f12d [349024,45784] 0 2024-04-25T15:57:48.476 INFO:tasks.workunit.client.1.smithi155.stdout:1/981: rename d1/d16/d1d/d33/d10a/d127 to d1/d16/d1d/d29/d5f/d136 0 2024-04-25T15:57:48.480 INFO:tasks.workunit.client.1.smithi155.stdout:1/982: rename d1/d6/lef to d1/d16/d1d/d33/da1/de6/l137 0 2024-04-25T15:57:48.482 INFO:tasks.workunit.client.1.smithi155.stdout:1/983: truncate d1/d16/d1d/d29/d3d/d43/d88/f12d 535458 0 2024-04-25T15:57:48.483 INFO:tasks.workunit.client.1.smithi155.stdout:1/984: write d1/d16/d1d/d29/f11f [889001,102744] 0 2024-04-25T15:57:48.484 INFO:tasks.workunit.client.1.smithi155.stdout:1/985: chown d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/dfc/f100 0 1 2024-04-25T15:57:48.485 INFO:tasks.workunit.client.1.smithi155.stdout:1/986: write d1/d6/db4/ffe [389036,111593] 0 2024-04-25T15:57:48.493 INFO:tasks.workunit.client.1.smithi155.stdout:1/987: dread d1/d32/d86/f87 [0,4194304] 0 2024-04-25T15:57:48.494 INFO:tasks.workunit.client.1.smithi155.stdout:1/988: truncate d1/d16/f130 834142 0 2024-04-25T15:57:48.496 INFO:tasks.workunit.client.1.smithi155.stdout:1/989: rmdir d1/d16/d1d/d29/d3d/dfd 39 2024-04-25T15:57:48.502 INFO:tasks.workunit.client.1.smithi155.stdout:1/990: creat d1/d16/d1d/d33/da1/de6/d117/f138 x:0 0 0 2024-04-25T15:57:48.507 INFO:tasks.workunit.client.1.smithi155.stdout:1/991: getdents d1/d16/d1d/d29/d3d 0 2024-04-25T15:57:48.515 INFO:tasks.workunit.client.1.smithi155.stdout:1/992: dwrite d1/d16/d1d/d29/d5f/d34/d68/d93/db7/dc2/fcb [0,4194304] 0 2024-04-25T15:57:48.523 INFO:tasks.workunit.client.1.smithi155.stdout:1/993: dwrite d1/d16/d1d/d29/d3d/d43/d88/fe8 [0,4194304] 0 2024-04-25T15:57:48.531 INFO:tasks.workunit.client.1.smithi155.stdout:1/994: dwrite d1/d6/db4/fea [0,4194304] 0 2024-04-25T15:57:48.532 INFO:tasks.workunit.client.1.smithi155.stdout:1/995: chown d1/c9e 134902972 1 2024-04-25T15:57:48.545 INFO:tasks.workunit.client.1.smithi155.stdout:8/829: sync 2024-04-25T15:57:48.545 INFO:tasks.workunit.client.1.smithi155.stdout:1/996: dwrite d1/f61 [0,4194304] 0 2024-04-25T15:57:48.547 INFO:tasks.workunit.client.1.smithi155.stdout:8/830: rmdir d2/d41/d5d 39 2024-04-25T15:57:48.549 INFO:tasks.workunit.client.1.smithi155.stdout:8/831: dread - d2/d15/d18/d23/d3c/dc6/ff3 zero size 2024-04-25T15:57:48.553 INFO:tasks.workunit.client.1.smithi155.stdout:1/997: write d1/d32/fc5 [923545,105746] 0 2024-04-25T15:57:48.554 INFO:tasks.workunit.client.1.smithi155.stdout:8/832: mkdir d2/d15/da1/dde/d40/d5b/d10d/d10e 0 2024-04-25T15:57:48.555 INFO:tasks.workunit.client.1.smithi155.stdout:1/998: chown d1/d16/d1d/d29/d5f/l4d 1958 1 2024-04-25T15:57:48.555 INFO:tasks.workunit.client.1.smithi155.stdout:8/833: dread - d2/d15/d18/d49/f101 zero size 2024-04-25T15:57:48.556 INFO:tasks.workunit.client.1.smithi155.stdout:8/834: fsync d2/d15/d18/d23/d3c/fb5 0 2024-04-25T15:57:48.559 INFO:tasks.workunit.client.1.smithi155.stdout:8/835: rmdir d2/d15/d18/d23/d3c/dc6 39 2024-04-25T15:57:48.560 INFO:tasks.workunit.client.1.smithi155.stdout:1/999: dread d1/d10d/f12f [0,4194304] 0 2024-04-25T15:57:48.560 INFO:tasks.workunit.client.1.smithi155.stdout:8/836: fsync d2/d15/d18/d23/d2d/fba 0 2024-04-25T15:57:48.566 INFO:tasks.workunit.client.1.smithi155.stdout:8/837: write d2/f7a [3328343,119026] 0 2024-04-25T15:57:48.570 INFO:tasks.workunit.client.1.smithi155.stdout:8/838: creat d2/d15/d18/d34/d48/d4e/f10f x:0 0 0 2024-04-25T15:57:48.575 INFO:tasks.workunit.client.1.smithi155.stdout:8/839: rename d2/d15/d63/fdd to d2/d15/d18/d23/d3c/f110 0 2024-04-25T15:57:48.576 INFO:tasks.workunit.client.1.smithi155.stdout:8/840: write d2/d15/d18/d23/d3c/d76/d7e/f9a [4314019,51220] 0 2024-04-25T15:57:48.578 INFO:tasks.workunit.client.1.smithi155.stdout:9/879: sync 2024-04-25T15:57:48.578 INFO:tasks.workunit.client.1.smithi155.stdout:0/949: sync 2024-04-25T15:57:48.579 INFO:tasks.workunit.client.1.smithi155.stdout:8/841: creat d2/d15/d18/d34/d48/d4e/f111 x:0 0 0 2024-04-25T15:57:48.582 INFO:tasks.workunit.client.1.smithi155.stdout:0/950: rename d1/d85/d8c/cc8 to d1/d3/d12/d92/d104/c137 0 2024-04-25T15:57:48.585 INFO:tasks.workunit.client.1.smithi155.stdout:0/951: mknod d1/d3/d5/d5b/dc4/c138 0 2024-04-25T15:57:48.586 INFO:tasks.workunit.client.1.smithi155.stdout:0/952: readlink d1/d3/d12/d92/lfa 0 2024-04-25T15:57:48.586 INFO:tasks.workunit.client.1.smithi155.stdout:9/880: write dc/d17/d8e/dae/dd6/d72/faa [414484,129114] 0 2024-04-25T15:57:48.588 INFO:tasks.workunit.client.1.smithi155.stdout:9/881: truncate dc/ff 2798212 0 2024-04-25T15:57:48.593 INFO:tasks.workunit.client.1.smithi155.stdout:9/882: creat dc/d13/d2e/f11e x:0 0 0 2024-04-25T15:57:48.598 INFO:tasks.workunit.client.1.smithi155.stdout:0/953: truncate d1/d3/d5/d5b/dc4/d6e/d107/f14 727618 0 2024-04-25T15:57:48.602 INFO:tasks.workunit.client.1.smithi155.stdout:0/954: rename d1/d3f/f7b to d1/d3/d6a/d9b/f139 0 2024-04-25T15:57:48.607 INFO:tasks.workunit.client.1.smithi155.stdout:9/883: truncate dc/d11/d5a/f78 3882177 0 2024-04-25T15:57:48.607 INFO:tasks.workunit.client.1.smithi155.stdout:9/884: chown dc/d11/d30/c96 12 1 2024-04-25T15:57:48.608 INFO:tasks.workunit.client.1.smithi155.stdout:0/955: creat d1/d10c/d133/f13a x:0 0 0 2024-04-25T15:57:48.610 INFO:tasks.workunit.client.1.smithi155.stdout:9/885: write dc/d13/d60/d7a/fd7 [1091324,23980] 0 2024-04-25T15:57:48.614 INFO:tasks.workunit.client.1.smithi155.stdout:9/886: creat dc/d11/d30/d46/f11f x:0 0 0 2024-04-25T15:57:48.615 INFO:tasks.workunit.client.1.smithi155.stdout:9/887: rmdir dc 39 2024-04-25T15:57:48.618 INFO:tasks.workunit.client.1.smithi155.stdout:9/888: rmdir dc/d17/d2a 39 2024-04-25T15:57:48.618 INFO:tasks.workunit.client.1.smithi155.stdout:0/956: dread d1/d3/d3d/dcb/fe6 [0,4194304] 0 2024-04-25T15:57:48.620 INFO:tasks.workunit.client.1.smithi155.stdout:0/957: truncate d1/d41/df4/f66 995774 0 2024-04-25T15:57:48.626 INFO:tasks.workunit.client.1.smithi155.stdout:9/889: dread dc/d11/fa1 [4194304,4194304] 0 2024-04-25T15:57:48.627 INFO:tasks.workunit.client.1.smithi155.stdout:0/958: dwrite d1/d41/df4/d47/f10e [0,4194304] 0 2024-04-25T15:57:48.627 INFO:tasks.workunit.client.1.smithi155.stdout:9/890: dread - dc/d17/d8e/de1/f10c zero size 2024-04-25T15:57:48.628 INFO:tasks.workunit.client.1.smithi155.stdout:0/959: chown d1/d3/d12/cbf 671073180 1 2024-04-25T15:57:48.640 INFO:tasks.workunit.client.1.smithi155.stdout:0/960: fsync d1/d41/fff 0 2024-04-25T15:57:48.641 INFO:tasks.workunit.client.1.smithi155.stdout:0/961: read - d1/d41/df4/d47/fe2 zero size 2024-04-25T15:57:48.648 INFO:tasks.workunit.client.1.smithi155.stdout:0/962: rename d1/d3/d12/d83/l89 to d1/d3/d5/d5b/dc4/d6e/l13b 0 2024-04-25T15:57:48.649 INFO:tasks.workunit.client.1.smithi155.stdout:9/891: write dc/d11/f42 [1246872,63817] 0 2024-04-25T15:57:48.657 INFO:tasks.workunit.client.1.smithi155.stdout:0/963: link d1/d3/d3d/d46/lcd d1/d41/df4/d47/db0/l13c 0 2024-04-25T15:57:48.657 INFO:tasks.workunit.client.1.smithi155.stdout:0/964: read d1/d3/d5/f54 [62595,88573] 0 2024-04-25T15:57:48.659 INFO:tasks.workunit.client.1.smithi155.stdout:9/892: creat dc/d17/d8e/f120 x:0 0 0 2024-04-25T15:57:48.660 INFO:tasks.workunit.client.1.smithi155.stdout:9/893: write dc/fd8 [197120,97236] 0 2024-04-25T15:57:48.672 INFO:tasks.workunit.client.1.smithi155.stdout:0/965: dread d1/d3/f17 [0,4194304] 0 2024-04-25T15:57:48.676 INFO:tasks.workunit.client.1.smithi155.stdout:9/894: dread dc/d17/d8e/f114 [0,4194304] 0 2024-04-25T15:57:48.677 INFO:tasks.workunit.client.1.smithi155.stdout:3/992: sync 2024-04-25T15:57:48.677 INFO:tasks.workunit.client.1.smithi155.stdout:0/966: truncate d1/d3/d5/d5b/dc4/d6e/d107/f14 857129 0 2024-04-25T15:57:48.678 INFO:tasks.workunit.client.1.smithi155.stdout:0/967: chown d1/d41/df4/f59 3 1 2024-04-25T15:57:48.679 INFO:tasks.workunit.client.1.smithi155.stdout:9/895: symlink dc/d3c/d9b/l121 0 2024-04-25T15:57:48.681 INFO:tasks.workunit.client.1.smithi155.stdout:3/993: mkdir d1/d4/db/d91/dc4/d6c/d157 0 2024-04-25T15:57:48.681 INFO:tasks.workunit.client.1.smithi155.stdout:3/994: fsync d1/d4/db/d91/dc4/d6c/fc6 0 2024-04-25T15:57:48.684 INFO:tasks.workunit.client.1.smithi155.stdout:3/995: chown d1/d4/d10/d21/d73/d77/d57/dcf/c14c 42 1 2024-04-25T15:57:48.686 INFO:tasks.workunit.client.1.smithi155.stdout:3/996: rmdir d1/d4/db/d28 39 2024-04-25T15:57:48.687 INFO:tasks.workunit.client.1.smithi155.stdout:0/968: dwrite d1/d85/d8c/fe0 [0,4194304] 0 2024-04-25T15:57:48.689 INFO:tasks.workunit.client.1.smithi155.stdout:3/997: dread d1/d4/db/d20/d44/d52/f136 [0,4194304] 0 2024-04-25T15:57:48.692 INFO:tasks.workunit.client.1.smithi155.stdout:3/998: creat d1/d4/db/d20/f158 x:0 0 0 2024-04-25T15:57:48.695 INFO:tasks.workunit.client.1.smithi155.stdout:8/842: sync 2024-04-25T15:57:48.696 INFO:tasks.workunit.client.1.smithi155.stdout:9/896: dread f5 [0,4194304] 0 2024-04-25T15:57:48.700 INFO:tasks.workunit.client.1.smithi155.stdout:0/969: creat d1/d3/d5/d5b/dc4/f13d x:0 0 0 2024-04-25T15:57:48.705 INFO:tasks.workunit.client.1.smithi155.stdout:3/999: symlink d1/l159 0 2024-04-25T15:57:48.708 INFO:tasks.workunit.client.1.smithi155.stdout:0/970: creat d1/d85/d8c/f13e x:0 0 0 2024-04-25T15:57:48.710 INFO:tasks.workunit.client.1.smithi155.stdout:0/971: truncate d1/d41/df4/d47/db0/fe4 621261 0 2024-04-25T15:57:48.711 INFO:tasks.workunit.client.1.smithi155.stdout:0/972: read d1/f1b [3931932,88840] 0 2024-04-25T15:57:48.712 INFO:tasks.workunit.client.1.smithi155.stdout:8/843: dread d2/d15/da1/fd0 [0,4194304] 0 2024-04-25T15:57:48.716 INFO:tasks.workunit.client.1.smithi155.stdout:0/973: symlink d1/d3/d5/d5b/dc4/l13f 0 2024-04-25T15:57:48.724 INFO:tasks.workunit.client.1.smithi155.stdout:0/974: mknod d1/d1a/d130/c140 0 2024-04-25T15:57:48.726 INFO:tasks.workunit.client.1.smithi155.stdout:9/897: truncate dc/d13/d48/f88 1634508 0 2024-04-25T15:57:48.730 INFO:tasks.workunit.client.1.smithi155.stdout:0/975: unlink d1/d3/d5/d5b/dc4/d6e/d107/f2f 0 2024-04-25T15:57:48.734 INFO:tasks.workunit.client.1.smithi155.stdout:8/844: truncate d2/fc 2468035 0 2024-04-25T15:57:48.735 INFO:tasks.workunit.client.1.smithi155.stdout:8/845: read d2/d15/f69 [1211295,73291] 0 2024-04-25T15:57:48.736 INFO:tasks.workunit.client.1.smithi155.stdout:8/846: dread d2/f11 [0,4194304] 0 2024-04-25T15:57:48.738 INFO:tasks.workunit.client.1.smithi155.stdout:9/898: mkdir dc/d11/d67/d104/d122 0 2024-04-25T15:57:48.743 INFO:tasks.workunit.client.1.smithi155.stdout:8/847: dwrite d2/d15/d35/fa4 [0,4194304] 0 2024-04-25T15:57:48.744 INFO:tasks.workunit.client.1.smithi155.stdout:0/976: link d1/d3/d3d/dcb/fcc d1/d3/d6a/d9b/f141 0 2024-04-25T15:57:48.745 INFO:tasks.workunit.client.1.smithi155.stdout:0/977: write d1/d3/d3d/d46/da4/db6/fdb [4175795,34020] 0 2024-04-25T15:57:48.764 INFO:tasks.workunit.client.1.smithi155.stdout:0/978: symlink d1/d3f/d10b/l142 0 2024-04-25T15:57:48.764 INFO:tasks.workunit.client.1.smithi155.stdout:0/979: readlink d1/d41/df4/d47/l116 0 2024-04-25T15:57:48.765 INFO:tasks.workunit.client.1.smithi155.stdout:9/899: mknod dc/d13/d48/d11a/c123 0 2024-04-25T15:57:48.766 INFO:tasks.workunit.client.1.smithi155.stdout:9/900: write dc/d11/dc4/fd3 [741478,43349] 0 2024-04-25T15:57:48.767 INFO:tasks.workunit.client.1.smithi155.stdout:8/848: creat d2/d15/da1/dde/d100/f112 x:0 0 0 2024-04-25T15:57:48.768 INFO:tasks.workunit.client.1.smithi155.stdout:8/849: fdatasync d2/d15/fd8 0 2024-04-25T15:57:48.770 INFO:tasks.workunit.client.1.smithi155.stdout:0/980: mknod d1/d3/d5/da/c143 0 2024-04-25T15:57:48.770 INFO:tasks.workunit.client.1.smithi155.stdout:0/981: chown d1/d41/df4/l2e 7119350 1 2024-04-25T15:57:48.779 INFO:tasks.workunit.client.1.smithi155.stdout:0/982: creat d1/d41/f144 x:0 0 0 2024-04-25T15:57:48.787 INFO:tasks.workunit.client.1.smithi155.stdout:8/850: getdents d2/d15/d18/d23/d3c/d76 0 2024-04-25T15:57:48.788 INFO:tasks.workunit.client.1.smithi155.stdout:0/983: dread d1/f70 [0,4194304] 0 2024-04-25T15:57:48.793 INFO:tasks.workunit.client.1.smithi155.stdout:0/984: creat d1/d41/df4/d47/f145 x:0 0 0 2024-04-25T15:57:48.793 INFO:tasks.workunit.client.1.smithi155.stdout:9/901: dwrite dc/d13/d2e/d4c/fa2 [0,4194304] 0 2024-04-25T15:57:48.796 INFO:tasks.workunit.client.1.smithi155.stdout:8/851: dwrite d2/d15/fd8 [4194304,4194304] 0 2024-04-25T15:57:48.796 INFO:tasks.workunit.client.1.smithi155.stdout:0/985: write d1/d41/df4/d47/fa5 [1027094,111794] 0 2024-04-25T15:57:48.796 INFO:tasks.workunit.client.1.smithi155.stdout:9/902: chown dc/d11/d30/d46/ffa 3948391 1 2024-04-25T15:57:48.801 INFO:tasks.workunit.client.1.smithi155.stdout:0/986: readlink d1/d3/d3d/d46/lcd 0 2024-04-25T15:57:48.803 INFO:tasks.workunit.client.1.smithi155.stdout:9/903: rename dc/d17/d8e/de2 to dc/d11/d67/d104/d124 0 2024-04-25T15:57:48.808 INFO:tasks.workunit.client.1.smithi155.stdout:8/852: dread d2/d15/d18/d34/f53 [0,4194304] 0 2024-04-25T15:57:48.812 INFO:tasks.workunit.client.1.smithi155.stdout:8/853: mknod d2/d15/d18/d23/d2d/da5/c113 0 2024-04-25T15:57:48.813 INFO:tasks.workunit.client.1.smithi155.stdout:9/904: getdents dc/d13/d59 0 2024-04-25T15:57:48.814 INFO:tasks.workunit.client.1.smithi155.stdout:9/905: stat dc/d13/d60/d7a/cf9 0 2024-04-25T15:57:48.818 INFO:tasks.workunit.client.1.smithi155.stdout:0/987: truncate d1/d41/f44 2899136 0 2024-04-25T15:57:48.820 INFO:tasks.workunit.client.1.smithi155.stdout:9/906: link dc/d13/d2e/d4c/fef dc/d11/d67/d104/f125 0 2024-04-25T15:57:48.821 INFO:tasks.workunit.client.1.smithi155.stdout:8/854: dwrite d2/d15/da1/dde/d40/d5b/f91 [0,4194304] 0 2024-04-25T15:57:48.821 INFO:tasks.workunit.client.1.smithi155.stdout:9/907: chown dc/d13/d48/d11a 460148 1 2024-04-25T15:57:48.822 INFO:tasks.workunit.client.1.smithi155.stdout:9/908: read dc/d13/d60/fc7 [254075,25110] 0 2024-04-25T15:57:48.828 INFO:tasks.workunit.client.1.smithi155.stdout:9/909: mknod dc/d11/d30/d46/da0/c126 0 2024-04-25T15:57:48.829 INFO:tasks.workunit.client.1.smithi155.stdout:9/910: readlink dc/d17/d8e/de1/lfe 0 2024-04-25T15:57:48.831 INFO:tasks.workunit.client.1.smithi155.stdout:9/911: write dc/d13/d59/f5d [3427531,22106] 0 2024-04-25T15:57:48.831 INFO:tasks.workunit.client.1.smithi155.stdout:0/988: dwrite d1/d41/df4/fa6 [0,4194304] 0 2024-04-25T15:57:48.837 INFO:tasks.workunit.client.1.smithi155.stdout:0/989: symlink d1/d3/d6a/d9b/l146 0 2024-04-25T15:57:48.839 INFO:tasks.workunit.client.1.smithi155.stdout:9/912: unlink dc/d17/d8e/dae/dd6/f112 0 2024-04-25T15:57:48.842 INFO:tasks.workunit.client.1.smithi155.stdout:8/855: write d2/d41/d5d/fb2 [4925820,7123] 0 2024-04-25T15:57:48.843 INFO:tasks.workunit.client.1.smithi155.stdout:9/913: write dc/d17/d8e/dae/dd6/d56/d102/f115 [3077331,98537] 0 2024-04-25T15:57:48.845 INFO:tasks.workunit.client.1.smithi155.stdout:8/856: creat d2/d15/d18/d49/dc9/f114 x:0 0 0 2024-04-25T15:57:48.849 INFO:tasks.workunit.client.1.smithi155.stdout:9/914: creat dc/d13/d60/f127 x:0 0 0 2024-04-25T15:57:48.850 INFO:tasks.workunit.client.1.smithi155.stdout:8/857: symlink d2/d15/d18/d49/df4/l115 0 2024-04-25T15:57:48.851 INFO:tasks.workunit.client.1.smithi155.stdout:9/915: chown dc/d11/d30/d46/da0/cda 113584177 1 2024-04-25T15:57:48.853 INFO:tasks.workunit.client.1.smithi155.stdout:0/990: dwrite d1/d3/d3d/dcb/fce [4194304,4194304] 0 2024-04-25T15:57:48.853 INFO:tasks.workunit.client.1.smithi155.stdout:8/858: unlink d2/d15/d18/d23/d2d/fc2 0 2024-04-25T15:57:48.856 INFO:tasks.workunit.client.1.smithi155.stdout:0/991: symlink d1/d3/d5/d5b/dc4/l147 0 2024-04-25T15:57:48.861 INFO:tasks.workunit.client.1.smithi155.stdout:9/916: dwrite dc/d17/dc0/f10e [0,4194304] 0 2024-04-25T15:57:48.862 INFO:tasks.workunit.client.1.smithi155.stdout:9/917: chown dc/d13/d59/c109 5 1 2024-04-25T15:57:48.865 INFO:tasks.workunit.client.1.smithi155.stdout:0/992: link d1/d3/d6a/d9b/l146 d1/d3/d6a/d9b/d12f/l148 0 2024-04-25T15:57:48.868 INFO:tasks.workunit.client.1.smithi155.stdout:0/993: rmdir d1/d41/df4/d47 39 2024-04-25T15:57:48.870 INFO:tasks.workunit.client.1.smithi155.stdout:9/918: dwrite dc/d13/d2e/f57 [0,4194304] 0 2024-04-25T15:57:48.872 INFO:tasks.workunit.client.1.smithi155.stdout:9/919: truncate dc/f111 783896 0 2024-04-25T15:57:48.873 INFO:tasks.workunit.client.1.smithi155.stdout:8/859: dread d2/d15/d18/d34/d48/d4e/d81/fb4 [0,4194304] 0 2024-04-25T15:57:48.875 INFO:tasks.workunit.client.1.smithi155.stdout:9/920: mkdir dc/d17/d8e/de1/d128 0 2024-04-25T15:57:48.877 INFO:tasks.workunit.client.1.smithi155.stdout:9/921: unlink dc/d17/d8e/cb6 0 2024-04-25T15:57:48.878 INFO:tasks.workunit.client.1.smithi155.stdout:8/860: link d2/d15/da1/dde/fea d2/d15/d18/d23/d2d/da5/f116 0 2024-04-25T15:57:48.881 INFO:tasks.workunit.client.1.smithi155.stdout:9/922: chown dc/d74/c85 2815581 1 2024-04-25T15:57:48.881 INFO:tasks.workunit.client.1.smithi155.stdout:0/994: truncate d1/d3/d6a/d9b/f139 1650068 0 2024-04-25T15:57:48.883 INFO:tasks.workunit.client.1.smithi155.stdout:8/861: write d2/fa [1813010,7613] 0 2024-04-25T15:57:48.886 INFO:tasks.workunit.client.1.smithi155.stdout:0/995: mknod d1/d85/d8c/c149 0 2024-04-25T15:57:48.886 INFO:tasks.workunit.client.1.smithi155.stdout:0/996: write d1/d41/f7c [2729053,3894] 0 2024-04-25T15:57:48.888 INFO:tasks.workunit.client.1.smithi155.stdout:8/862: truncate d2/d15/d18/d34/d48/d4e/d81/df9/f102 930912 0 2024-04-25T15:57:48.889 INFO:tasks.workunit.client.1.smithi155.stdout:0/997: creat d1/d3/d6a/d9b/f14a x:0 0 0 2024-04-25T15:57:48.890 INFO:tasks.workunit.client.1.smithi155.stdout:9/923: dwrite dc/d17/d8e/dae/dd6/d56/d102/f115 [0,4194304] 0 2024-04-25T15:57:48.890 INFO:tasks.workunit.client.1.smithi155.stdout:8/863: truncate d2/d15/d63/dc0/ff7 831444 0 2024-04-25T15:57:48.892 INFO:tasks.workunit.client.1.smithi155.stdout:0/998: truncate d1/d3/d6a/dfb/ded/f125 691238 0 2024-04-25T15:57:48.893 INFO:tasks.workunit.client.1.smithi155.stdout:9/924: creat dc/d11/d30/d46/da0/f129 x:0 0 0 2024-04-25T15:57:48.894 INFO:tasks.workunit.client.1.smithi155.stdout:0/999: rmdir d1/d3/d6a/d9b 39 2024-04-25T15:57:48.895 INFO:tasks.workunit.client.1.smithi155.stdout:9/925: mkdir dc/d11/d67/d104/d12a 0 2024-04-25T15:57:48.896 INFO:tasks.workunit.client.1.smithi155.stdout:8/864: getdents d2/d15/d18/d23/d3c/d76 0 2024-04-25T15:57:48.897 INFO:tasks.workunit.client.1.smithi155.stdout:9/926: fdatasync dc/d17/d2a/fc5 0 2024-04-25T15:57:48.898 INFO:tasks.workunit.client.1.smithi155.stdout:8/865: creat d2/d15/d18/d49/df4/f117 x:0 0 0 2024-04-25T15:57:48.899 INFO:tasks.workunit.client.1.smithi155.stdout:8/866: chown d2/d15/d18/d23/d2d/da5/ffc 10448 1 2024-04-25T15:57:48.904 INFO:tasks.workunit.client.1.smithi155.stdout:9/927: dwrite dc/d11/d30/d46/da0/fcf [0,4194304] 0 2024-04-25T15:57:48.905 INFO:tasks.workunit.client.1.smithi155.stdout:8/867: link d2/d15/d18/d23/d2d/da5/c113 d2/d15/d63/c118 0 2024-04-25T15:57:48.907 INFO:tasks.workunit.client.1.smithi155.stdout:9/928: truncate dc/d11/d30/dd2/fd9 2510721 0 2024-04-25T15:57:48.908 INFO:tasks.workunit.client.1.smithi155.stdout:9/929: write dc/d13/d60/d7a/f94 [897452,13703] 0 2024-04-25T15:57:48.915 INFO:tasks.workunit.client.1.smithi155.stdout:9/930: rename dc/d17/d8e/dae/dd6/d56/d102/d11d to dc/d74/d12b 0 2024-04-25T15:57:48.917 INFO:tasks.workunit.client.1.smithi155.stdout:9/931: write dc/d17/d8e/de1/f10c [53546,89099] 0 2024-04-25T15:57:48.922 INFO:tasks.workunit.client.1.smithi155.stdout:9/932: link f5 dc/d11/d5a/f12c 0 2024-04-25T15:57:48.928 INFO:tasks.workunit.client.1.smithi155.stdout:8/868: write d2/d15/d18/d34/d48/d59/f66 [1443688,39973] 0 2024-04-25T15:57:48.929 INFO:tasks.workunit.client.1.smithi155.stdout:9/933: dwrite dc/d11/d67/f10a [0,4194304] 0 2024-04-25T15:57:48.930 INFO:tasks.workunit.client.1.smithi155.stdout:8/869: write d2/d15/d18/d34/d48/f8b [6293249,42746] 0 2024-04-25T15:57:48.935 INFO:tasks.workunit.client.1.smithi155.stdout:9/934: truncate dc/ff 1900128 0 2024-04-25T15:57:48.939 INFO:tasks.workunit.client.1.smithi155.stdout:8/870: dwrite d2/fa [0,4194304] 0 2024-04-25T15:57:48.942 INFO:tasks.workunit.client.1.smithi155.stdout:8/871: mkdir d2/d15/da1/dde/d40/d5b/d10d/d119 0 2024-04-25T15:57:48.948 INFO:tasks.workunit.client.1.smithi155.stdout:9/935: truncate dc/d13/d2e/f57 285977 0 2024-04-25T15:57:48.950 INFO:tasks.workunit.client.1.smithi155.stdout:8/872: dwrite d2/d15/d18/d23/d3c/f110 [0,4194304] 0 2024-04-25T15:57:48.952 INFO:tasks.workunit.client.1.smithi155.stdout:9/936: creat dc/d11/d30/d46/f12d x:0 0 0 2024-04-25T15:57:48.953 INFO:tasks.workunit.client.1.smithi155.stdout:8/873: rmdir d2/d15/d18/d34/d48/d4e 39 2024-04-25T15:57:48.957 INFO:tasks.workunit.client.1.smithi155.stdout:8/874: chown d2/d15/d18/d34/d48/d4e/d81 3622495 1 2024-04-25T15:57:48.959 INFO:tasks.workunit.client.1.smithi155.stdout:9/937: mkdir dc/d17/d8e/d12e 0 2024-04-25T15:57:48.959 INFO:tasks.workunit.client.1.smithi155.stdout:9/938: write dc/d13/d48/feb [143234,36703] 0 2024-04-25T15:57:48.960 INFO:tasks.workunit.client.1.smithi155.stdout:9/939: write dc/d11/d67/fc8 [1853363,126405] 0 2024-04-25T15:57:48.963 INFO:tasks.workunit.client.1.smithi155.stdout:8/875: link d2/f16 d2/d15/d18/d34/d48/d59/f11a 0 2024-04-25T15:57:48.967 INFO:tasks.workunit.client.1.smithi155.stdout:8/876: getdents d2/d41 0 2024-04-25T15:57:48.971 INFO:tasks.workunit.client.1.smithi155.stdout:9/940: truncate dc/d13/f26 554969 0 2024-04-25T15:57:48.972 INFO:tasks.workunit.client.1.smithi155.stdout:9/941: write dc/d17/d2a/fdc [3678087,99270] 0 2024-04-25T15:57:48.975 INFO:tasks.workunit.client.1.smithi155.stdout:8/877: dwrite d2/d15/d18/d49/dc9/f114 [0,4194304] 0 2024-04-25T15:57:48.976 INFO:tasks.workunit.client.1.smithi155.stdout:9/942: creat dc/d17/d8e/de1/d128/f12f x:0 0 0 2024-04-25T15:57:48.976 INFO:tasks.workunit.client.1.smithi155.stdout:8/878: dread - d2/d15/d18/d23/fe7 zero size 2024-04-25T15:57:48.983 INFO:tasks.workunit.client.1.smithi155.stdout:8/879: dread d2/d15/d18/d23/d2d/f39 [0,4194304] 0 2024-04-25T15:57:48.985 INFO:tasks.workunit.client.1.smithi155.stdout:8/880: mkdir d2/d15/d18/d34/d48/d4e/d11b 0 2024-04-25T15:57:48.991 INFO:tasks.workunit.client.1.smithi155.stdout:8/881: dwrite d2/d15/d18/d34/d48/f8b [4194304,4194304] 0 2024-04-25T15:57:48.993 INFO:tasks.workunit.client.1.smithi155.stdout:8/882: truncate d2/d15/d18/d23/d2d/da5/ffc 754588 0 2024-04-25T15:57:48.993 INFO:tasks.workunit.client.1.smithi155.stdout:8/883: readlink d2/d15/d63/lbd 0 2024-04-25T15:57:48.994 INFO:tasks.workunit.client.1.smithi155.stdout:8/884: stat d2/d15/d18/d23/d3c/f4b 0 2024-04-25T15:57:49.001 INFO:tasks.workunit.client.1.smithi155.stdout:8/885: dwrite d2/d15/d18/fb7 [0,4194304] 0 2024-04-25T15:57:49.003 INFO:tasks.workunit.client.1.smithi155.stdout:8/886: readlink d2/d15/d18/d34/d48/d4e/d81/l9d 0 2024-04-25T15:57:49.005 INFO:tasks.workunit.client.1.smithi155.stdout:8/887: truncate d2/d15/d18/d23/d3c/de0/ff0 559755 0 2024-04-25T15:57:49.006 INFO:tasks.workunit.client.1.smithi155.stdout:8/888: rmdir d2/d15/d18/d34 39 2024-04-25T15:57:49.007 INFO:tasks.workunit.client.1.smithi155.stdout:8/889: fsync d2/d15/d18/d49/f9e 0 2024-04-25T15:57:49.020 INFO:tasks.workunit.client.1.smithi155.stdout:8/890: truncate d2/d15/d18/d23/d3c/f86 1004381 0 2024-04-25T15:57:49.023 INFO:tasks.workunit.client.1.smithi155.stdout:8/891: mkdir d2/d15/d18/d49/df4/d6c/d11c 0 2024-04-25T15:57:49.026 INFO:tasks.workunit.client.1.smithi155.stdout:8/892: mkdir d2/d15/d18/d34/d48/d4e/d81/df9/d11d 0 2024-04-25T15:57:49.029 INFO:tasks.workunit.client.1.smithi155.stdout:8/893: creat d2/d15/d18/d34/d48/d4e/f11e x:0 0 0 2024-04-25T15:57:49.039 INFO:tasks.workunit.client.1.smithi155.stdout:8/894: getdents d2/d15/d18/d34/d48/d4e 0 2024-04-25T15:57:49.045 INFO:tasks.workunit.client.1.smithi155.stdout:8/895: link d2/d15/d63/dd7/d108/cff d2/d15/d18/c11f 0 2024-04-25T15:57:49.056 INFO:tasks.workunit.client.1.smithi155.stdout:8/896: dwrite d2/d15/da1/dde/f17 [0,4194304] 0 2024-04-25T15:57:49.058 INFO:tasks.workunit.client.1.smithi155.stdout:8/897: dread d2/d15/d18/d49/df4/f42 [4194304,4194304] 0 2024-04-25T15:57:49.065 INFO:tasks.workunit.client.1.smithi155.stdout:8/898: rename d2/d15/da1/dde/d40/d5b/lf1 to d2/d15/d18/d23/d3c/de0/l120 0 2024-04-25T15:57:49.068 INFO:tasks.workunit.client.1.smithi155.stdout:8/899: symlink d2/d15/d18/l121 0 2024-04-25T15:57:49.074 INFO:tasks.workunit.client.1.smithi155.stdout:8/900: dwrite d2/d15/da1/dde/d40/d5b/f91 [4194304,4194304] 0 2024-04-25T15:57:49.076 INFO:tasks.workunit.client.1.smithi155.stdout:8/901: write d2/d15/d18/d49/df4/f117 [787244,22742] 0 2024-04-25T15:57:49.077 INFO:tasks.workunit.client.1.smithi155.stdout:8/902: write d2/d15/d18/d34/d48/d4e/f111 [359012,67459] 0 2024-04-25T15:57:49.081 INFO:tasks.workunit.client.1.smithi155.stdout:8/903: mkdir d2/d15/da1/dde/d40/d5b/df8/d122 0 2024-04-25T15:57:49.085 INFO:tasks.workunit.client.1.smithi155.stdout:8/904: mknod d2/d15/d18/d23/dfa/c123 0 2024-04-25T15:57:49.092 INFO:tasks.workunit.client.1.smithi155.stdout:8/905: dwrite d2/d15/d18/d34/d48/d7f/fb1 [0,4194304] 0 2024-04-25T15:57:49.097 INFO:tasks.workunit.client.1.smithi155.stdout:8/906: rename d2/d15/da1/dde/d40/f58 to d2/d15/da1/dde/d40/d5b/df8/d122/f124 0 2024-04-25T15:57:49.103 INFO:tasks.workunit.client.1.smithi155.stdout:8/907: dwrite d2/d15/d18/d34/d48/d4e/d81/df9/f102 [0,4194304] 0 2024-04-25T15:57:49.104 INFO:tasks.workunit.client.1.smithi155.stdout:8/908: readlink d2/d15/d18/d23/d3c/d76/d7e/led 0 2024-04-25T15:57:49.104 INFO:tasks.workunit.client.1.smithi155.stdout:9/943: sync 2024-04-25T15:57:49.105 INFO:tasks.workunit.client.1.smithi155.stdout:8/909: dread - d2/d15/d18/d49/f101 zero size 2024-04-25T15:57:49.105 INFO:tasks.workunit.client.1.smithi155.stdout:9/944: chown dc/d13/d48/l98 58685 1 2024-04-25T15:57:49.107 INFO:tasks.workunit.client.1.smithi155.stdout:8/910: chown d2/d15/d18/d34/f9f 5017697 1 2024-04-25T15:57:49.111 INFO:tasks.workunit.client.1.smithi155.stdout:9/945: rename dc/d17/d8e/dae/dd6/d56/d102/f115 to dc/d11/d30/d46/da0/f130 0 2024-04-25T15:57:49.111 INFO:tasks.workunit.client.1.smithi155.stdout:9/946: chown dc/d13/f54 185005501 1 2024-04-25T15:57:49.112 INFO:tasks.workunit.client.1.smithi155.stdout:9/947: dread - dc/d11/d67/d104/d124/f10f zero size 2024-04-25T15:57:49.114 INFO:tasks.workunit.client.1.smithi155.stdout:8/911: rename d2/d15/d18/d34/d48/d59 to d2/d15/d18/d34/d48/d4e/d81/df9/d125 0 2024-04-25T15:57:49.116 INFO:tasks.workunit.client.1.smithi155.stdout:9/948: creat dc/d11/d30/dd2/f131 x:0 0 0 2024-04-25T15:57:49.117 INFO:tasks.workunit.client.1.smithi155.stdout:8/912: write d2/d15/d18/d34/d48/d4e/f93 [3188059,39972] 0 2024-04-25T15:57:49.121 INFO:tasks.workunit.client.1.smithi155.stdout:8/913: mkdir d2/d15/da1/dde/d40/d5b/d126 0 2024-04-25T15:57:49.129 INFO:tasks.workunit.client.1.smithi155.stdout:8/914: dread d2/d15/d18/d23/d3c/fa9 [0,4194304] 0 2024-04-25T15:57:49.131 INFO:tasks.workunit.client.1.smithi155.stdout:8/915: read - d2/d15/d18/d23/d3c/dc6/ff3 zero size 2024-04-25T15:57:49.134 INFO:tasks.workunit.client.1.smithi155.stdout:8/916: mknod d2/d15/d18/d34/d48/d4e/d81/df9/c127 0 2024-04-25T15:57:49.136 INFO:tasks.workunit.client.1.smithi155.stdout:8/917: symlink d2/d15/d18/d23/d3c/de0/l128 0 2024-04-25T15:57:49.136 INFO:tasks.workunit.client.1.smithi155.stdout:8/918: chown d2/d15/d18/d34/d48/d4e/f93 487185 1 2024-04-25T15:57:49.147 INFO:tasks.workunit.client.1.smithi155.stdout:8/919: dwrite d2/d15/d18/d34/f9f [0,4194304] 0 2024-04-25T15:57:49.171 INFO:tasks.workunit.client.1.smithi155.stdout:9/949: sync 2024-04-25T15:57:49.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:49.202 INFO:tasks.workunit.client.1.smithi155.stdout:8/920: symlink d2/d15/da1/dde/d40/d5b/d10d/d119/l129 0 2024-04-25T15:57:49.206 INFO:tasks.workunit.client.1.smithi155.stdout:8/921: rename d2/d15/d18/d34/d48/d4e/d81/fb4 to d2/d15/d18/d34/d48/d4e/d81/dcc/f12a 0 2024-04-25T15:57:49.210 INFO:tasks.workunit.client.1.smithi155.stdout:8/922: symlink d2/d15/d35/l12b 0 2024-04-25T15:57:49.212 INFO:tasks.workunit.client.1.smithi155.stdout:8/923: readlink d2/l13 0 2024-04-25T15:57:49.215 INFO:tasks.workunit.client.1.smithi155.stdout:8/924: mknod d2/d15/c12c 0 2024-04-25T15:57:49.218 INFO:tasks.workunit.client.1.smithi155.stdout:8/925: mknod d2/d15/da1/dde/c12d 0 2024-04-25T15:57:49.225 INFO:tasks.workunit.client.1.smithi155.stdout:8/926: getdents d2/d15/d18/d23/dfa 0 2024-04-25T15:57:49.226 INFO:tasks.workunit.client.1.smithi155.stdout:8/927: read d2/d15/d18/d34/d48/d7f/fb1 [203825,2874] 0 2024-04-25T15:57:49.235 INFO:tasks.workunit.client.1.smithi155.stdout:8/928: dwrite d2/d41/ff5 [0,4194304] 0 2024-04-25T15:57:49.255 INFO:tasks.workunit.client.1.smithi155.stdout:9/950: write dc/d11/d30/d46/f4b [573929,45756] 0 2024-04-25T15:57:49.259 INFO:tasks.workunit.client.1.smithi155.stdout:9/951: creat dc/d17/d8e/dae/dd6/d72/f132 x:0 0 0 2024-04-25T15:57:49.262 INFO:tasks.workunit.client.1.smithi155.stdout:9/952: unlink dc/d17/d8e/dae/dd6/f9e 0 2024-04-25T15:57:49.267 INFO:tasks.workunit.client.1.smithi155.stdout:8/929: dwrite d2/d15/da1/dde/d40/d5b/df8/d122/f124 [0,4194304] 0 2024-04-25T15:57:49.272 INFO:tasks.workunit.client.1.smithi155.stdout:8/930: truncate d2/d15/d18/d49/df4/fac 1840712 0 2024-04-25T15:57:49.288 INFO:tasks.workunit.client.1.smithi155.stdout:8/931: write d2/d15/d18/d34/d48/d4e/d81/df9/d125/f11a [3355501,98251] 0 2024-04-25T15:57:49.291 INFO:tasks.workunit.client.1.smithi155.stdout:8/932: symlink d2/l12e 0 2024-04-25T15:57:49.293 INFO:tasks.workunit.client.1.smithi155.stdout:8/933: chown d2/d15/d18/d34/d48/d4e 2996261 1 2024-04-25T15:57:49.300 INFO:tasks.workunit.client.1.smithi155.stdout:8/934: dwrite d2/d15/d18/d34/d48/d4e/d81/df9/d125/f66 [0,4194304] 0 2024-04-25T15:57:49.304 INFO:tasks.workunit.client.1.smithi155.stdout:8/935: rename d2/d15/da1/dde/d40/c79 to d2/d15/da1/dde/d100/c12f 0 2024-04-25T15:57:49.308 INFO:tasks.workunit.client.1.smithi155.stdout:8/936: rename d2/d15/d18/c5f to d2/d15/d18/c130 0 2024-04-25T15:57:49.315 INFO:tasks.workunit.client.1.smithi155.stdout:8/937: dwrite d2/d15/d18/fb7 [4194304,4194304] 0 2024-04-25T15:57:49.317 INFO:tasks.workunit.client.1.smithi155.stdout:8/938: fdatasync d2/d15/da1/dde/d40/d5b/f104 0 2024-04-25T15:57:49.328 INFO:tasks.workunit.client.1.smithi155.stdout:8/939: dwrite d2/f33 [0,4194304] 0 2024-04-25T15:57:49.332 INFO:tasks.workunit.client.1.smithi155.stdout:9/953: sync 2024-04-25T15:57:49.332 INFO:tasks.workunit.client.1.smithi155.stdout:8/940: mkdir d2/d15/d18/d34/d48/d4e/d131 0 2024-04-25T15:57:49.336 INFO:tasks.workunit.client.1.smithi155.stdout:8/941: creat d2/d15/d18/d23/d2d/da5/df6/f132 x:0 0 0 2024-04-25T15:57:49.337 INFO:tasks.workunit.client.1.smithi155.stdout:9/954: stat dc/d11/d30/dd2/fd9 0 2024-04-25T15:57:49.337 INFO:tasks.workunit.client.1.smithi155.stdout:8/942: stat d2/d15/da1/dde/d40/d5b/d10d 0 2024-04-25T15:57:49.344 INFO:tasks.workunit.client.1.smithi155.stdout:8/943: dwrite d2/d15/d18/d23/d3c/dc6/ff3 [0,4194304] 0 2024-04-25T15:57:49.346 INFO:tasks.workunit.client.1.smithi155.stdout:8/944: rmdir d2/d15/da1/dde 39 2024-04-25T15:57:49.350 INFO:tasks.workunit.client.1.smithi155.stdout:8/945: write d2/d15/d18/d34/d48/d4e/d81/dcc/f12a [4297390,99200] 0 2024-04-25T15:57:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac067db640 1 Processor -- start 2024-04-25T15:57:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac067db640 1 -- start start 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac067db640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac001556c0 0x7fac00155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac067db640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac0006da90 con 0x7fac00156010 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac067db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac00157860 con 0x7fac001540d0 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac067db640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fac00157b40 con 0x7fac001556c0 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fabff7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac001556c0 0x7fac00155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac04d78640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fac00156010 0x7fac0015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45656/0 (socket says 172.21.15.87:45656) 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.347+0000 7fac04d78640 1 -- 172.21.15.87:0/1912780307 learned_addr learned my addr 172.21.15.87:0/1912780307 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabfeffd640 1 -- 172.21.15.87:0/1912780307 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858968850 0 0) 0x7fac00157860 con 0x7fac001540d0 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabfeffd640 1 -- 172.21.15.87:0/1912780307 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabe8003530 con 0x7fac001540d0 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabff7fe640 1 -- 172.21.15.87:0/1912780307 >> v1:172.21.15.155:6789/0 conn(0x7fac001540d0 legacy=0x7fac000c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabff7fe640 1 -- 172.21.15.87:0/1912780307 >> v1:172.21.15.87:6789/0 conn(0x7fac00156010 legacy=0x7fac0015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabff7fe640 1 -- 172.21.15.87:0/1912780307 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac00157e20 con 0x7fac001556c0 2024-04-25T15:57:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabff7fe640 1 --2- 172.21.15.87:0/1912780307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00155ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fabf40097c0 tx=0x7fabf401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5826a040bf2cf6cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabfeffd640 1 -- 172.21.15.87:0/1912780307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40b0070 con 0x7fac001556c0 2024-04-25T15:57:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabfeffd640 1 -- 172.21.15.87:0/1912780307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf40ab600 con 0x7fac001556c0 2024-04-25T15:57:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fabfeffd640 1 -- 172.21.15.87:0/1912780307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40ab9b0 con 0x7fac001556c0 2024-04-25T15:57:49.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 -- 172.21.15.87:0/1912780307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 msgr2=0x7fac00155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 --2- 172.21.15.87:0/1912780307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00155ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fabf40097c0 tx=0x7fabf401c380 comp rx=0 tx=0).stop 2024-04-25T15:57:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 -- 172.21.15.87:0/1912780307 shutdown_connections 2024-04-25T15:57:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 --2- 172.21.15.87:0/1912780307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00155ad0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 -- 172.21.15.87:0/1912780307 >> 172.21.15.87:0/1912780307 conn(0x7fac0006c840 msgr2=0x7fac0006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 -- 172.21.15.87:0/1912780307 shutdown_connections 2024-04-25T15:57:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.351+0000 7fac067db640 1 -- 172.21.15.87:0/1912780307 wait complete. 2024-04-25T15:57:49.358 INFO:tasks.workunit.client.1.smithi155.stdout:8/946: dwrite d2/d15/d63/dd7/d108/fb0 [0,4194304] 0 2024-04-25T15:57:49.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 Processor -- start 2024-04-25T15:57:49.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 -- start start 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac001540d0 0x7fac001f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac00156010 0x7fac0013e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fac000ab5d0 con 0x7fac001556c0 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac000ab450 con 0x7fac00156010 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac067db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fac000c4ff0 con 0x7fac001540d0 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39852/0 (socket says 172.21.15.87:39852) 2024-04-25T15:57:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 -- 172.21.15.87:0/4015391384 learned_addr learned my addr 172.21.15.87:0/4015391384 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabfffff640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac001540d0 0x7fac001f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fac04d78640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac00156010 0x7fac0013e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 -- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac001540d0 msgr2=0x7fac001f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac001540d0 0x7fac001f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 -- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac00156010 msgr2=0x7fac0013e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac00156010 0x7fac0013e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 -- 172.21.15.87:0/4015391384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac00164270 con 0x7fac001556c0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.355+0000 7fabff7fe640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00149110 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fabf401c860 tx=0x7fabf401abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40b0070 con 0x7fac001556c0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf40ba070 con 0x7fac001556c0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac00164550 con 0x7fac001556c0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40abdc0 con 0x7fac001556c0 2024-04-25T15:57:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0014a1c0 con 0x7fac001556c0 2024-04-25T15:57:49.364 INFO:tasks.workunit.client.1.smithi155.stdout:8/947: symlink d2/d15/d18/l133 0 2024-04-25T15:57:49.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac00069bb0 con 0x7fac001556c0 2024-04-25T15:57:49.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fabf40ab4c0 con 0x7fac001556c0 2024-04-25T15:57:49.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfcff9640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fabec06f400 0x7fabec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfffff640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fabec06f400 0x7fabec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7fabf41295d0 con 0x7fac001556c0 2024-04-25T15:57:49.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.359+0000 7fabfffff640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fabec06f400 0x7fabec071910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fabf00011f0 tx=0x7fabf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:49.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.363+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fabf4016090 con 0x7fac001556c0 2024-04-25T15:57:49.461 INFO:tasks.workunit.client.1.smithi155.stdout:9/955: sync 2024-04-25T15:57:49.471 INFO:tasks.workunit.client.1.smithi155.stdout:9/956: write dc/d13/d48/f88 [969189,7665] 0 2024-04-25T15:57:49.481 INFO:tasks.workunit.client.1.smithi155.stdout:9/957: link dc/d17/d2a/f8b dc/d11/d67/d104/f133 0 2024-04-25T15:57:49.497 INFO:tasks.workunit.client.1.smithi155.stdout:9/958: dread dc/d11/d30/dd2/ddf/f100 [0,4194304] 0 2024-04-25T15:57:49.499 INFO:tasks.workunit.client.1.smithi155.stdout:9/959: fdatasync dc/d11/d30/d46/f11f 0 2024-04-25T15:57:49.502 INFO:tasks.workunit.client.1.smithi155.stdout:9/960: write dc/d11/f42 [3037616,46883] 0 2024-04-25T15:57:49.505 INFO:tasks.workunit.client.1.smithi155.stdout:8/948: sync 2024-04-25T15:57:49.508 INFO:tasks.workunit.client.1.smithi155.stdout:9/961: unlink dc/d11/d67/ff0 0 2024-04-25T15:57:49.510 INFO:tasks.workunit.client.1.smithi155.stdout:9/962: read - dc/d17/d2a/fc5 zero size 2024-04-25T15:57:49.514 INFO:tasks.workunit.client.1.smithi155.stdout:9/963: mknod dc/d11/d67/c134 0 2024-04-25T15:57:49.518 INFO:tasks.workunit.client.1.smithi155.stdout:8/949: dwrite d2/d15/fcd [0,4194304] 0 2024-04-25T15:57:49.524 INFO:tasks.workunit.client.1.smithi155.stdout:9/964: link dc/d13/d48/c86 dc/d13/de5/c135 0 2024-04-25T15:57:49.532 INFO:tasks.workunit.client.1.smithi155.stdout:9/965: dwrite dc/d13/d59/fbf [0,4194304] 0 2024-04-25T15:57:49.542 INFO:tasks.workunit.client.1.smithi155.stdout:9/966: write f5 [4454125,121010] 0 2024-04-25T15:57:49.545 INFO:tasks.workunit.client.1.smithi155.stdout:9/967: rmdir dc/d17/d8e/dae 39 2024-04-25T15:57:49.547 INFO:tasks.workunit.client.1.smithi155.stdout:9/968: mkdir dc/d11/d67/d104/d12a/d136 0 2024-04-25T15:57:49.548 INFO:tasks.workunit.client.1.smithi155.stdout:9/969: dread - dc/d13/d48/f113 zero size 2024-04-25T15:57:49.554 INFO:tasks.workunit.client.1.smithi155.stdout:9/970: getdents dc/d11/dc4 0 2024-04-25T15:57:49.555 INFO:tasks.workunit.client.1.smithi155.stdout:9/971: stat dc/d13/d2e/f4a 0 2024-04-25T15:57:49.558 INFO:tasks.workunit.client.1.smithi155.stdout:9/972: creat dc/d17/d2a/f137 x:0 0 0 2024-04-25T15:57:49.560 INFO:tasks.workunit.client.1.smithi155.stdout:9/973: read dc/d11/dc4/fd3 [22553,41624] 0 2024-04-25T15:57:49.564 INFO:tasks.workunit.client.1.smithi155.stdout:9/974: creat dc/d13/d59/f138 x:0 0 0 2024-04-25T15:57:49.566 INFO:tasks.workunit.client.1.smithi155.stdout:9/975: getdents dc/d17/d8e/d12e 0 2024-04-25T15:57:49.571 INFO:tasks.workunit.client.1.smithi155.stdout:9/976: mknod dc/d17/d8e/dae/dd6/d72/c139 0 2024-04-25T15:57:49.572 INFO:tasks.workunit.client.1.smithi155.stdout:8/950: sync 2024-04-25T15:57:49.574 INFO:tasks.workunit.client.1.smithi155.stdout:9/977: dread dc/d11/d67/fe0 [0,4194304] 0 2024-04-25T15:57:49.576 INFO:tasks.workunit.client.1.smithi155.stdout:8/951: mknod d2/d15/d18/d23/d2d/c134 0 2024-04-25T15:57:49.576 INFO:tasks.workunit.client.1.smithi155.stdout:8/952: chown d2/d15/d18/d23/l9c 15157216 1 2024-04-25T15:57:49.578 INFO:tasks.workunit.client.1.smithi155.stdout:8/953: chown d2/d15/d18/d34/d48/d4e/d81/df9/d125/l68 1676377 1 2024-04-25T15:57:49.582 INFO:tasks.workunit.client.1.smithi155.stdout:8/954: getdents d2/d15/da1 0 2024-04-25T15:57:49.585 INFO:tasks.workunit.client.1.smithi155.stdout:9/978: dwrite dc/d3c/f117 [0,4194304] 0 2024-04-25T15:57:49.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.583+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac0006dc60 con 0x7fac001556c0 2024-04-25T15:57:49.590 INFO:tasks.workunit.client.1.smithi155.stdout:9/979: symlink dc/d17/d8e/de1/l13a 0 2024-04-25T15:57:49.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.587+0000 7fabfcff9640 1 -- 172.21.15.87:0/4015391384 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7fabf40f5ab0 con 0x7fac001556c0 2024-04-25T15:57:49.591 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:49.591 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:49.591 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:49.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fabec06f400 msgr2=0x7fabec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fabec06f400 0x7fabec071910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fabf00011f0 tx=0x7fabf0009040 comp rx=0 tx=0).stop 2024-04-25T15:57:49.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 msgr2=0x7fac00149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00149110 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fabf401c860 tx=0x7fabf401abc0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 shutdown_connections 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fabec06f400 0x7fabec071910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac00156010 0x7fac0013e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac001556c0 0x7fac00149110 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 --2- 172.21.15.87:0/4015391384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac001540d0 0x7fac001f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 >> 172.21.15.87:0/4015391384 conn(0x7fac0006c840 msgr2=0x7fac00156530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 shutdown_connections 2024-04-25T15:57:49.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.591+0000 7fac067db640 1 -- 172.21.15.87:0/4015391384 wait complete. 2024-04-25T15:57:49.596 INFO:tasks.workunit.client.1.smithi155.stdout:8/955: dwrite d2/d15/d18/d34/d48/d4e/d81/dcc/f12a [4194304,4194304] 0 2024-04-25T15:57:49.597 INFO:tasks.workunit.client.1.smithi155.stdout:9/980: creat dc/d17/d8e/dae/dd6/d105/f13b x:0 0 0 2024-04-25T15:57:49.601 INFO:tasks.workunit.client.1.smithi155.stdout:9/981: creat dc/d17/dc0/dc9/f13c x:0 0 0 2024-04-25T15:57:49.613 INFO:tasks.workunit.client.1.smithi155.stdout:8/956: dwrite d2/d15/d18/d34/d48/d4e/d81/fe1 [0,4194304] 0 2024-04-25T15:57:49.617 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-04-25T15:57:49.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T15:57:49.617 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:57:49.617 INFO:tasks.workunit.client.1.smithi155.stdout:9/982: getdents dc/d17/d8e/dae/dd6/d105 0 2024-04-25T15:57:49.641 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T15:57:49.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 Processor -- start 2024-04-25T15:57:49.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 -- start start 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 0x7f10d006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10d006fa10 0x7f10d015e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d0154fc0 con 0x7f10d00ad160 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f10d006ed60 con 0x7f10d006fa10 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10d5a68640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10d00acb20 con 0x7f10d01518b0 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ceffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f10d00ad160 0x7f10d00c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45658/0 (socket says 172.21.15.87:45658) 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ceffd640 1 -- 172.21.15.87:0/22380285 learned_addr learned my addr 172.21.15.87:0/22380285 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 --2- 172.21.15.87:0/22380285 >> v2:172.21.15.155:3300/0 conn(0x7f10d006fa10 0x7f10d015e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cf7fe640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 0x7f10d006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704803504 0 0) 0x7f10d0154fc0 con 0x7f10d00ad160 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10b8003530 con 0x7f10d00ad160 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2235222035 0 0) 0x7f10b8003530 con 0x7f10d00ad160 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 msgr2=0x7f10d006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 0x7f10d006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 >> v2:172.21.15.155:3300/0 conn(0x7f10d006fa10 msgr2=0x7f10d015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 --2- 172.21.15.87:0/22380285 >> v2:172.21.15.155:3300/0 conn(0x7f10d006fa10 0x7f10d015e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d00ace00 con 0x7f10d00ad160 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f10c4001680 con 0x7f10d00ad160 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 >> v1:172.21.15.87:6789/0 conn(0x7f10d00ad160 legacy=0x7f10d00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80039c0 0x7f10b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 0x7f10b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b8004d50 0x7f10b8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f10d006ed60 con 0x7f10b8004d50 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10d00acb20 con 0x7f10b80039c0 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10b800b9d0 con 0x7f10d01518b0 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b8004d50 0x7f10b8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cf7fe640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80039c0 0x7f10b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10ceffd640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 0x7f10b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 -- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 msgr2=0x7f10b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d01518b0 0x7f10b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 -- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80039c0 msgr2=0x7f10b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80039c0 0x7f10b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.835+0000 7f10cffff640 1 -- 172.21.15.87:0/22380285 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b8003530 con 0x7f10b8004d50 2024-04-25T15:57:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10cffff640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b8004d50 0x7f10b8005160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f10d00753c0 tx=0x7f10c801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc696e2c6a1490 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c80b2070 con 0x7f10b8004d50 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c80a5c30 con 0x7f10b8004d50 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10ce7fc640 1 -- 172.21.15.87:0/22380285 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8009c10 con 0x7f10b8004d50 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10d5a68640 1 -- 172.21.15.87:0/22380285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b8004d50 msgr2=0x7f10b8005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10d5a68640 1 --2- 172.21.15.87:0/22380285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b8004d50 0x7f10b8005160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f10d00753c0 tx=0x7f10c801cc20 comp rx=0 tx=0).stop 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10cffff640 1 -- 172.21.15.87:0/22380285 reap_dead start 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10d5a68640 1 -- 172.21.15.87:0/22380285 shutdown_connections 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10d5a68640 1 -- 172.21.15.87:0/22380285 >> 172.21.15.87:0/22380285 conn(0x7f10d00c8770 msgr2=0x7f10d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10d5a68640 1 -- 172.21.15.87:0/22380285 shutdown_connections 2024-04-25T15:57:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.839+0000 7f10d5a68640 1 -- 172.21.15.87:0/22380285 wait complete. 2024-04-25T15:57:49.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 Processor -- start 2024-04-25T15:57:49.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- start start 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d00c7f70 0x7f10d01e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 0x7f10d014a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d014aa90 0x7f10d01dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f10d00c4970 con 0x7f10d01e0dd0 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10d00c47f0 con 0x7f10d014aa90 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10d0071e50 con 0x7f10d00c7f70 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 0x7f10d014a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 0x7f10d014a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39864/0 (socket says 172.21.15.87:39864) 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 -- 172.21.15.87:0/1937434948 learned_addr learned my addr 172.21.15.87:0/1937434948 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10cf7fe640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d00c7f70 0x7f10d01e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10cffff640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d014aa90 0x7f10d01dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 -- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d00c7f70 msgr2=0x7f10d01e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d00c7f70 0x7f10d01e0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 -- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d014aa90 msgr2=0x7f10d01dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d014aa90 0x7f10d01dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 -- 172.21.15.87:0/1937434948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d01eb610 con 0x7f10d01e0dd0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10cffff640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d014aa90 0x7f10d01dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10ceffd640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 0x7f10d014a550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10c400eb20 tx=0x7f10c40016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c400c8d0 con 0x7f10d01e0dd0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c4018070 con 0x7f10d01e0dd0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d01dfc50 con 0x7f10d01e0dd0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c400cc90 con 0x7f10d01e0dd0 2024-04-25T15:57:49.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d01e1800 con 0x7f10d01e0dd0 2024-04-25T15:57:49.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.843+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d01eb0d0 con 0x7f10d01e0dd0 2024-04-25T15:57:49.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.847+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f10c401d460 con 0x7f10d01e0dd0 2024-04-25T15:57:49.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.847+0000 7f10b7fff640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f10bc06f430 0x7f10bc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:49.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.847+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f10c408f670 con 0x7f10d01e0dd0 2024-04-25T15:57:49.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.847+0000 7f10cf7fe640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f10bc06f430 0x7f10bc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:49.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.847+0000 7f10cf7fe640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f10bc06f430 0x7f10bc071940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10d00aad60 tx=0x7f10c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:49.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:49.851+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10c405c120 con 0x7f10d01e0dd0 2024-04-25T15:57:50.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.047+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10d014b330 con 0x7f10d01e0dd0 2024-04-25T15:57:50.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.047+0000 7f10b7fff640 1 -- 172.21.15.87:0/1937434948 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f10c4064110 con 0x7f10d01e0dd0 2024-04-25T15:57:50.052 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:50.052 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:50.053 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:50.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f10bc06f430 msgr2=0x7f10bc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f10bc06f430 0x7f10bc071940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10d00aad60 tx=0x7f10c0008040 comp rx=0 tx=0).stop 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 msgr2=0x7f10d014a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 0x7f10d014a550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f10c400eb20 tx=0x7f10c40016d0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 shutdown_connections 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f10bc06f430 0x7f10bc071940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10d014aa90 0x7f10d01dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10d01e0dd0 0x7f10d014a550 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 --2- 172.21.15.87:0/1937434948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10d00c7f70 0x7f10d01e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 >> 172.21.15.87:0/1937434948 conn(0x7f10d00c8770 msgr2=0x7f10d0152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 shutdown_connections 2024-04-25T15:57:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.051+0000 7f10d5a68640 1 -- 172.21.15.87:0/1937434948 wait complete. 2024-04-25T15:57:50.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:50.077 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:57:50.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.195+0000 7f5cf6949640 1 Processor -- start 2024-04-25T15:57:50.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cf6949640 1 -- start start 2024-04-25T15:57:50.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cf6949640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5cf01509a0 0x7f5cf0153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:50.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cf6949640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf0150db0 con 0x7f5cf01575f0 2024-04-25T15:57:50.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cf6949640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf00aace0 con 0x7f5cf01538c0 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cf6949640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf00ab2a0 con 0x7f5cf01509a0 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5cf01509a0 0x7f5cf0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5ceffff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5cf01575f0 0x7f5cf006ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45664/0 (socket says 172.21.15.87:45664) 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5ceffff640 1 -- 172.21.15.87:0/2876527254 learned_addr learned my addr 172.21.15.87:0/2876527254 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cef7fe640 1 -- 172.21.15.87:0/2876527254 >> v1:172.21.15.155:6789/0 conn(0x7f5cf01538c0 legacy=0x7f5cf015dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cef7fe640 1 -- 172.21.15.87:0/2876527254 >> v1:172.21.15.87:6789/0 conn(0x7f5cf01575f0 legacy=0x7f5cf006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5cef7fe640 1 -- 172.21.15.87:0/2876527254 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf00aafc0 con 0x7f5cf01509a0 2024-04-25T15:57:50.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.199+0000 7f5ceeffd640 1 -- 172.21.15.87:0/2876527254 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066223050 0 0) 0x7f5cf0150db0 con 0x7f5cf01575f0 2024-04-25T15:57:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cef7fe640 1 --2- 172.21.15.87:0/2876527254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01509a0 0x7f5cf0153380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000a960 tx=0x7f5ce001d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112fea017c98bc37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5ceeffd640 1 -- 172.21.15.87:0/2876527254 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00b3070 con 0x7f5cf01509a0 2024-04-25T15:57:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5ceeffd640 1 -- 172.21.15.87:0/2876527254 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00a6740 con 0x7f5cf01509a0 2024-04-25T15:57:50.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5ceeffd640 1 -- 172.21.15.87:0/2876527254 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000b040 con 0x7f5cf01509a0 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 -- 172.21.15.87:0/2876527254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01509a0 msgr2=0x7f5cf0153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 --2- 172.21.15.87:0/2876527254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01509a0 0x7f5cf0153380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000a960 tx=0x7f5ce001d7a0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 -- 172.21.15.87:0/2876527254 shutdown_connections 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 --2- 172.21.15.87:0/2876527254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01509a0 0x7f5cf0153380 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 -- 172.21.15.87:0/2876527254 >> 172.21.15.87:0/2876527254 conn(0x7f5cf00c8770 msgr2=0x7f5cf00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 -- 172.21.15.87:0/2876527254 shutdown_connections 2024-04-25T15:57:50.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 -- 172.21.15.87:0/2876527254 wait complete. 2024-04-25T15:57:50.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 Processor -- start 2024-04-25T15:57:50.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.203+0000 7f5cf6949640 1 -- start start 2024-04-25T15:57:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf01509a0 0x7f5cf01f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf01538c0 0x7f5cf014f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 0x7f5cf013f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf00ac060 con 0x7f5cf01575f0 2024-04-25T15:57:50.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf00c4930 con 0x7f5cf01538c0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf006f610 con 0x7f5cf01509a0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 0x7f5cf013f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 0x7f5cf013f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39884/0 (socket says 172.21.15.87:39884) 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 -- 172.21.15.87:0/632752224 learned_addr learned my addr 172.21.15.87:0/632752224 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cef7fe640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf01538c0 0x7f5cf014f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5ceffff640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf01509a0 0x7f5cf01f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 -- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf01509a0 msgr2=0x7f5cf01f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf01509a0 0x7f5cf01f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 -- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf01538c0 msgr2=0x7f5cf014f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf01538c0 0x7f5cf014f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 -- 172.21.15.87:0/632752224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf01f2b60 con 0x7f5cf01575f0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf4ee6640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 0x7f5cf013f650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b9a0 tx=0x7f5ce800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8019070 con 0x7f5cf01575f0 2024-04-25T15:57:50.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce800cba0 con 0x7f5cf01575f0 2024-04-25T15:57:50.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01f2e40 con 0x7f5cf01575f0 2024-04-25T15:57:50.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8014440 con 0x7f5cf01575f0 2024-04-25T15:57:50.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf01442c0 con 0x7f5cf01575f0 2024-04-25T15:57:50.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf0069bb0 con 0x7f5cf01575f0 2024-04-25T15:57:50.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ce801c070 con 0x7f5cf01575f0 2024-04-25T15:57:50.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5cecff9640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5cdc06f430 0x7f5cdc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:50.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.207+0000 7f5ceffff640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5cdc06f430 0x7f5cdc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:50.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.211+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f5ce808f520 con 0x7f5cf01575f0 2024-04-25T15:57:50.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.211+0000 7f5ceffff640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5cdc06f430 0x7f5cdc071940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00c2df0 tx=0x7f5ce4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:50.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.215+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ce805bf30 con 0x7f5cf01575f0 2024-04-25T15:57:50.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.411+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cf015f200 con 0x7f5cf01575f0 2024-04-25T15:57:50.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.411+0000 7f5cecff9640 1 -- 172.21.15.87:0/632752224 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f5ce805b830 con 0x7f5cf01575f0 2024-04-25T15:57:50.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:50.418 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:50.418 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5cdc06f430 msgr2=0x7f5cdc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5cdc06f430 0x7f5cdc071940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00c2df0 tx=0x7f5ce4008040 comp rx=0 tx=0).stop 2024-04-25T15:57:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 msgr2=0x7f5cf013f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 0x7f5cf013f650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b9a0 tx=0x7f5ce800be60 comp rx=0 tx=0).stop 2024-04-25T15:57:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 shutdown_connections 2024-04-25T15:57:50.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5cdc06f430 0x7f5cdc071940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf01575f0 0x7f5cf013f650 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf01538c0 0x7f5cf014f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 --2- 172.21.15.87:0/632752224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cf01509a0 0x7f5cf01f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:50.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 >> 172.21.15.87:0/632752224 conn(0x7f5cf00c8770 msgr2=0x7f5cf0146f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:50.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 shutdown_connections 2024-04-25T15:57:50.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:50.415+0000 7f5cf6949640 1 -- 172.21.15.87:0/632752224 wait complete. 2024-04-25T15:57:50.441 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:52.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:52.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 Processor -- start 2024-04-25T15:57:52.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 -- start start 2024-04-25T15:57:52.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f702815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7028160230 0x7f7028162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70280c7570 con 0x7f702815ad90 2024-04-25T15:57:52.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f702815b8b0 con 0x7f7028160230 2024-04-25T15:57:52.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702e5f8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f702815b5d0 con 0x7f70280cb030 2024-04-25T15:57:52.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7027fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f702815ad90 0x7f70280ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41580/0 (socket says 172.21.15.87:41580) 2024-04-25T15:57:52.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7027fff640 1 -- 172.21.15.87:0/2706429584 learned_addr learned my addr 172.21.15.87:0/2706429584 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:52.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556814820 0 0) 0x7f70280c7570 con 0x7f702815ad90 2024-04-25T15:57:52.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7010003530 con 0x7f702815ad90 2024-04-25T15:57:52.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f70277fe640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f702815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f702cb95640 1 --2- 172.21.15.87:0/2706429584 >> v2:172.21.15.155:3300/0 conn(0x7f7028160230 0x7f7028162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4191804817 0 0) 0x7f7010003530 con 0x7f702815ad90 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 msgr2=0x7f702815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7026ffd640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f702815fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.235+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 >> v2:172.21.15.155:3300/0 conn(0x7f7028160230 msgr2=0x7f7028162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 --2- 172.21.15.87:0/2706429584 >> v2:172.21.15.155:3300/0 conn(0x7f7028160230 0x7f7028162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70280c2290 con 0x7f702815ad90 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f7018001680 con 0x7f702815ad90 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 >> v1:172.21.15.87:6789/0 conn(0x7f702815ad90 legacy=0x7f70280ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70100039c0 0x7f7010003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7010004810 0x7f7010004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f701000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f702815b8b0 con 0x7f7010004810 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f702815b5d0 con 0x7f70100039c0 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70100055b0 con 0x7f70280cb030 2024-04-25T15:57:52.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7010004810 0x7f7010004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7027fff640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70100039c0 0x7f7010003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702cb95640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f701000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 -- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 msgr2=0x7f701000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f701000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 -- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70100039c0 msgr2=0x7f7010003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70100039c0 0x7f7010003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 -- 172.21.15.87:0/2706429584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010003530 con 0x7f7010004810 2024-04-25T15:57:52.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702cb95640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70280cb030 0x7f701000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:57:52.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f70277fe640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7010004810 0x7f7010004c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f701c00ba30 tx=0x7f701c01c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8ffd1a0423d884 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:52.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0b3070 con 0x7f7010004810 2024-04-25T15:57:52.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701c0a8030 con 0x7f7010004810 2024-04-25T15:57:52.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f7026ffd640 1 -- 172.21.15.87:0/2706429584 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c00b600 con 0x7f7010004810 2024-04-25T15:57:52.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702e5f8640 1 -- 172.21.15.87:0/2706429584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7010004810 msgr2=0x7f7010004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702e5f8640 1 --2- 172.21.15.87:0/2706429584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7010004810 0x7f7010004c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f701c00ba30 tx=0x7f701c01c6c0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702cb95640 1 -- 172.21.15.87:0/2706429584 reap_dead start 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702e5f8640 1 -- 172.21.15.87:0/2706429584 shutdown_connections 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702e5f8640 1 -- 172.21.15.87:0/2706429584 >> 172.21.15.87:0/2706429584 conn(0x7f70280c9330 msgr2=0x7f70280c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702e5f8640 1 -- 172.21.15.87:0/2706429584 shutdown_connections 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.239+0000 7f702e5f8640 1 -- 172.21.15.87:0/2706429584 wait complete. 2024-04-25T15:57:52.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 Processor -- start 2024-04-25T15:57:52.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 -- start start 2024-04-25T15:57:52.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004810 0x7f7028159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 0x7f70281609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702814d830 0x7f702814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f70280ca2e0 con 0x7f7028151df0 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70280ca160 con 0x7f7010004810 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f702815b1a0 con 0x7f702814d830 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 0x7f70281609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 0x7f70281609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34430/0 (socket says 172.21.15.87:34430) 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 -- 172.21.15.87:0/1035967397 learned_addr learned my addr 172.21.15.87:0/1035967397 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702cb95640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702814d830 0x7f702814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f7027fff640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004810 0x7f7028159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 -- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702814d830 msgr2=0x7f702814cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702814d830 0x7f702814cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 -- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004810 msgr2=0x7f7028159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004810 0x7f7028159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 -- 172.21.15.87:0/1035967397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70281f0b60 con 0x7f7028151df0 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f70277fe640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 0x7f70281609b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f701c01c4f0 tx=0x7f7010005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0b3040 con 0x7f7028151df0 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701c0aecc0 con 0x7f7028151df0 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70281f0e40 con 0x7f7028151df0 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c004220 con 0x7f7028151df0 2024-04-25T15:57:52.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.243+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70281f1400 con 0x7f7028151df0 2024-04-25T15:57:52.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.247+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70280c1f90 con 0x7f7028151df0 2024-04-25T15:57:52.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.247+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f701c0c1060 con 0x7f7028151df0 2024-04-25T15:57:52.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.247+0000 7f7024ff9640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701406f400 0x7f7014071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.247+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f701c1296e0 con 0x7f7028151df0 2024-04-25T15:57:52.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.247+0000 7f7027fff640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701406f400 0x7f7014071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.247+0000 7f7027fff640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701406f400 0x7f7014071910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f70180017c0 tx=0x7f7018000f60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:52.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.251+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f701c0163d0 con 0x7f7028151df0 2024-04-25T15:57:52.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:52.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.451+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7028069bb0 con 0x7f7028151df0 2024-04-25T15:57:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.451+0000 7f7024ff9640 1 -- 172.21.15.87:0/1035967397 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f701c0f6260 con 0x7f7028151df0 2024-04-25T15:57:52.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:52.456 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701406f400 msgr2=0x7f7014071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701406f400 0x7f7014071910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f70180017c0 tx=0x7f7018000f60 comp rx=0 tx=0).stop 2024-04-25T15:57:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 msgr2=0x7f70281609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 0x7f70281609b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f701c01c4f0 tx=0x7f7010005840 comp rx=0 tx=0).stop 2024-04-25T15:57:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 shutdown_connections 2024-04-25T15:57:52.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701406f400 0x7f7014071910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702814d830 0x7f702814cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028151df0 0x7f70281609b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 --2- 172.21.15.87:0/1035967397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7010004810 0x7f7028159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 >> 172.21.15.87:0/1035967397 conn(0x7f70280c9330 msgr2=0x7f702806deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 shutdown_connections 2024-04-25T15:57:52.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.455+0000 7f702e5f8640 1 -- 172.21.15.87:0/1035967397 wait complete. 2024-04-25T15:57:52.479 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:57:52.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.587+0000 7f79ee0cb640 1 Processor -- start 2024-04-25T15:57:52.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.587+0000 7f79ee0cb640 1 -- start start 2024-04-25T15:57:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79ee0cb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79e81518b0 0x7f79e806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79ee0cb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79e80ad160 0x7f79e80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79ee0cb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e8154fc0 con 0x7f79e80c4620 2024-04-25T15:57:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79ee0cb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f79e806ed60 con 0x7f79e80ad160 2024-04-25T15:57:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79ee0cb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f79e80acb20 con 0x7f79e81518b0 2024-04-25T15:57:52.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79dffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79e80ad160 0x7f79e80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79e7fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f79e80c4620 0x7f79e8157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41588/0 (socket says 172.21.15.87:41588) 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79e7fff640 1 -- 172.21.15.87:0/2500426042 learned_addr learned my addr 172.21.15.87:0/2500426042 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79e77fe640 1 --2- 172.21.15.87:0/2500426042 >> v2:172.21.15.155:3300/0 conn(0x7f79e81518b0 0x7f79e806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79dffff640 1 -- 172.21.15.87:0/2500426042 >> v2:172.21.15.155:3300/0 conn(0x7f79e81518b0 msgr2=0x7f79e806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79dffff640 1 --2- 172.21.15.87:0/2500426042 >> v2:172.21.15.155:3300/0 conn(0x7f79e81518b0 0x7f79e806f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79dffff640 1 -- 172.21.15.87:0/2500426042 >> v1:172.21.15.87:6789/0 conn(0x7f79e80c4620 legacy=0x7f79e8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79dffff640 1 -- 172.21.15.87:0/2500426042 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e80ace00 con 0x7f79e80ad160 2024-04-25T15:57:52.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79e6ffd640 1 -- 172.21.15.87:0/2500426042 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766983418 0 0) 0x7f79e8154fc0 con 0x7f79e80c4620 2024-04-25T15:57:52.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.591+0000 7f79dffff640 1 --2- 172.21.15.87:0/2500426042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e80ad160 0x7f79e80c40e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c4c70 tx=0x7f79d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df4d7e2d342712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:52.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79e6ffd640 1 -- 172.21.15.87:0/2500426042 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d00aa600 con 0x7f79e80ad160 2024-04-25T15:57:52.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79e6ffd640 1 -- 172.21.15.87:0/2500426042 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d00af070 con 0x7f79e80ad160 2024-04-25T15:57:52.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79e6ffd640 1 -- 172.21.15.87:0/2500426042 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d00aa9c0 con 0x7f79e80ad160 2024-04-25T15:57:52.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2500426042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e80ad160 msgr2=0x7f79e80c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2500426042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e80ad160 0x7f79e80c40e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c4c70 tx=0x7f79d001c480 comp rx=0 tx=0).stop 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2500426042 shutdown_connections 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2500426042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e80ad160 0x7f79e80c40e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2500426042 >> v2:172.21.15.155:3300/0 conn(0x7f79e81518b0 0x7f79e806f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2500426042 >> 172.21.15.87:0/2500426042 conn(0x7f79e80c8770 msgr2=0x7f79e80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2500426042 shutdown_connections 2024-04-25T15:57:52.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2500426042 wait complete. 2024-04-25T15:57:52.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 Processor -- start 2024-04-25T15:57:52.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- start start 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79e80ad160 0x7f79e81533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e80c4620 0x7f79e814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 0x7f79e81ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8161d60 con 0x7f79e81518b0 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8161be0 con 0x7f79e80ad160 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79ee0cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79e8161ee0 con 0x7f79e80c4620 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 0x7f79e81ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79e7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 0x7f79e81ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34442/0 (socket says 172.21.15.87:34442) 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.595+0000 7f79e7fff640 1 -- 172.21.15.87:0/2472790693 learned_addr learned my addr 172.21.15.87:0/2472790693 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79dffff640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e80c4620 0x7f79e814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e77fe640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79e80ad160 0x7f79e81533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e7fff640 1 -- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e80c4620 msgr2=0x7f79e814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e7fff640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e80c4620 0x7f79e814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e7fff640 1 -- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79e80ad160 msgr2=0x7f79e81533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e7fff640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79e80ad160 0x7f79e81533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e7fff640 1 -- 172.21.15.87:0/2472790693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e814c330 con 0x7f79e81518b0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e7fff640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 0x7f79e81ee6a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c780 tx=0x7f79e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0018070 con 0x7f79e81518b0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e000ce30 con 0x7f79e81518b0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e000a800 con 0x7f79e81518b0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e81f2a70 con 0x7f79e81518b0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81f1cb0 con 0x7f79e81518b0 2024-04-25T15:57:52.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e8069bb0 con 0x7f79e81518b0 2024-04-25T15:57:52.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f79e001b070 con 0x7f79e81518b0 2024-04-25T15:57:52.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e4ff9640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f79c806f430 0x7f79c8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:52.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6953+0+0 (secure 0 0 0) 0x7f79e008ef30 con 0x7f79e81518b0 2024-04-25T15:57:52.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e77fe640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f79c806f430 0x7f79c8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:52.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.599+0000 7f79e77fe640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f79c806f430 0x7f79c8071940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79e80aad60 tx=0x7f79d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:52.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.603+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79e005bab0 con 0x7f79e81518b0 2024-04-25T15:57:52.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.799+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79e8153950 con 0x7f79e81518b0 2024-04-25T15:57:52.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.799+0000 7f79e4ff9640 1 -- 172.21.15.87:0/2472790693 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6492 (secure 0 0 0) 0x7f79e005b3b0 con 0x7f79e81518b0 2024-04-25T15:57:52.804 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:52.804 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:05.509401+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":23,"addr":"172.21.15.87:6837/4061291849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":4061291849},{"type":"v1","addr":"172.21.15.87:6837","nonce":4061291849}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5331,"qdb_cluster":[5331]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:52.804 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-04-25T15:57:52.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f79c806f430 msgr2=0x7f79c8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f79c806f430 0x7f79c8071940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79e80aad60 tx=0x7f79d8008040 comp rx=0 tx=0).stop 2024-04-25T15:57:52.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 msgr2=0x7f79e81ee6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:52.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 0x7f79e81ee6a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c780 tx=0x7f79e000cc40 comp rx=0 tx=0).stop 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 shutdown_connections 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f79c806f430 0x7f79c8071940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79e81518b0 0x7f79e81ee6a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79e80c4620 0x7f79e814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 --2- 172.21.15.87:0/2472790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79e80ad160 0x7f79e81533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 >> 172.21.15.87:0/2472790693 conn(0x7f79e80c8770 msgr2=0x7f79e80c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 shutdown_connections 2024-04-25T15:57:52.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:52.803+0000 7f79ee0cb640 1 -- 172.21.15.87:0/2472790693 wait complete. 2024-04-25T15:57:52.826 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:57:54.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.627+0000 7f8b817b7640 1 Processor -- start 2024-04-25T15:57:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.627+0000 7f8b817b7640 1 -- start start 2024-04-25T15:57:54.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b817b7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b7c1529a0 0x7f8b7c071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b817b7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7c0ae1b0 con 0x7f8b7c0ad990 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b817b7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7c072430 con 0x7f8b7c0adda0 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b817b7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8b7c074730 con 0x7f8b7c1529a0 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b7affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b7c1529a0 0x7f8b7c071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b7a7fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8b7c0ad990 0x7f8b7c0c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41600/0 (socket says 172.21.15.87:41600) 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b7a7fc640 1 -- 172.21.15.87:0/2024041176 learned_addr learned my addr 172.21.15.87:0/2024041176 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b7affd640 1 -- 172.21.15.87:0/2024041176 >> v1:172.21.15.155:6789/0 conn(0x7f8b7c0adda0 legacy=0x7f8b7c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b7affd640 1 -- 172.21.15.87:0/2024041176 >> v1:172.21.15.87:6789/0 conn(0x7f8b7c0ad990 legacy=0x7f8b7c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b7affd640 1 -- 172.21.15.87:0/2024041176 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c074a10 con 0x7f8b7c1529a0 2024-04-25T15:57:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.631+0000 7f8b79ffb640 1 -- 172.21.15.87:0/2024041176 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192725115 0 0) 0x7f8b7c0ae1b0 con 0x7f8b7c0ad990 2024-04-25T15:57:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b7affd640 1 --2- 172.21.15.87:0/2024041176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c071e50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097c0 tx=0x7f8b6c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adea2bbd9a155cdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b79ffb640 1 -- 172.21.15.87:0/2024041176 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0b0070 con 0x7f8b7c1529a0 2024-04-25T15:57:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b79ffb640 1 -- 172.21.15.87:0/2024041176 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6c0ab600 con 0x7f8b7c1529a0 2024-04-25T15:57:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b79ffb640 1 -- 172.21.15.87:0/2024041176 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0ab9d0 con 0x7f8b7c1529a0 2024-04-25T15:57:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 -- 172.21.15.87:0/2024041176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c1529a0 msgr2=0x7f8b7c071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2024041176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c071e50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097c0 tx=0x7f8b6c01c410 comp rx=0 tx=0).stop 2024-04-25T15:57:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 -- 172.21.15.87:0/2024041176 shutdown_connections 2024-04-25T15:57:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2024041176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c071e50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 -- 172.21.15.87:0/2024041176 >> 172.21.15.87:0/2024041176 conn(0x7f8b7c0c8770 msgr2=0x7f8b7c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 -- 172.21.15.87:0/2024041176 shutdown_connections 2024-04-25T15:57:54.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 -- 172.21.15.87:0/2024041176 wait complete. 2024-04-25T15:57:54.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 Processor -- start 2024-04-25T15:57:54.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.635+0000 7f8b817b7640 1 -- start start 2024-04-25T15:57:54.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 0x7f8b7c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0adda0 0x7f8b7c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c1f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c163890 con 0x7f8b7c0ad990 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c163710 con 0x7f8b7c1529a0 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c163a10 con 0x7f8b7c0adda0 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 0x7f8b7c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 0x7f8b7c149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34474/0 (socket says 172.21.15.87:34474) 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 -- 172.21.15.87:0/2945146561 learned_addr learned my addr 172.21.15.87:0/2945146561 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7a7fc640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0adda0 0x7f8b7c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7b7fe640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c1f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 -- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0adda0 msgr2=0x7f8b7c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0adda0 0x7f8b7c0c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 -- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c1529a0 msgr2=0x7f8b7c1f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c1f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 -- 172.21.15.87:0/2945146561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c06acc0 con 0x7f8b7c0ad990 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b7affd640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 0x7f8b7c149310 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0ae040 tx=0x7f8b6c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0b0050 con 0x7f8b7c0ad990 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6c0bc070 con 0x7f8b7c0ad990 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c1f5010 con 0x7f8b7c0ad990 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0b5a70 con 0x7f8b7c0ad990 2024-04-25T15:57:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c1f52b0 con 0x7f8b7c0ad990 2024-04-25T15:57:54.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c069bb0 con 0x7f8b7c0ad990 2024-04-25T15:57:54.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b6c0ab4c0 con 0x7f8b7c0ad990 2024-04-25T15:57:54.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.639+0000 7f8b737fe640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8b5c06f400 0x7f8b5c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.643+0000 7f8b7a7fc640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8b5c06f400 0x7f8b5c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.643+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7f8b6c12a150 con 0x7f8b7c0ad990 2024-04-25T15:57:54.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.643+0000 7f8b7a7fc640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8b5c06f400 0x7f8b5c071910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b64007bc0 tx=0x7f8b64007b10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:54.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.647+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b6c016090 con 0x7f8b7c0ad990 2024-04-25T15:57:54.828 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:54.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.843+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b7c0c3760 con 0x7f8b7c0ad990 2024-04-25T15:57:54.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.843+0000 7f8b737fe640 1 -- 172.21.15.87:0/2945146561 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5659 (secure 0 0 0) 0x7f8b6c0f6a90 con 0x7f8b7c0ad990 2024-04-25T15:57:54.849 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:54.850 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:54.269153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:54.850 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 32 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8b5c06f400 msgr2=0x7f8b5c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8b5c06f400 0x7f8b5c071910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b64007bc0 tx=0x7f8b64007b10 comp rx=0 tx=0).stop 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 msgr2=0x7f8b7c149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 0x7f8b7c149310 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0ae040 tx=0x7f8b6c01ac50 comp rx=0 tx=0).stop 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 shutdown_connections 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8b5c06f400 0x7f8b5c071910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c1529a0 0x7f8b7c1f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0adda0 0x7f8b7c0c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 --2- 172.21.15.87:0/2945146561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b7c0ad990 0x7f8b7c149310 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 >> 172.21.15.87:0/2945146561 conn(0x7f8b7c0c8770 msgr2=0x7f8b7c160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 shutdown_connections 2024-04-25T15:57:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.847+0000 7f8b817b7640 1 -- 172.21.15.87:0/2945146561 wait complete. 2024-04-25T15:57:54.874 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:57:54.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 Processor -- start 2024-04-25T15:57:54.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 -- start start 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45d40cb030 0x7f45d415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45d4160230 0x7f45d4162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d40c7570 con 0x7f45d415ad90 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f45d415b8b0 con 0x7f45d4160230 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d9423640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f45d415b5d0 con 0x7f45d40cb030 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45d4160230 0x7f45d4162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45d4160230 0x7f45d4162650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34486/0 (socket says 172.21.15.87:34486) 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 -- 172.21.15.87:0/2893289721 learned_addr learned my addr 172.21.15.87:0/2893289721 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45cbfff640 1 --2- 172.21.15.87:0/2893289721 >> v2:172.21.15.155:3300/0 conn(0x7f45d40cb030 0x7f45d415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 -- 172.21.15.87:0/2893289721 >> v2:172.21.15.155:3300/0 conn(0x7f45d40cb030 msgr2=0x7f45d415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 --2- 172.21.15.87:0/2893289721 >> v2:172.21.15.155:3300/0 conn(0x7f45d40cb030 0x7f45d415fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 -- 172.21.15.87:0/2893289721 >> v1:172.21.15.155:6789/0 conn(0x7f45d415ad90 legacy=0x7f45d40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45d37fe640 1 -- 172.21.15.87:0/2893289721 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40c2290 con 0x7f45d4160230 2024-04-25T15:57:54.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.971+0000 7f45cbfff640 1 --2- 172.21.15.87:0/2893289721 >> v2:172.21.15.155:3300/0 conn(0x7f45d40cb030 0x7f45d415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:54.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d37fe640 1 --2- 172.21.15.87:0/2893289721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4162650 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f45d408e060 tx=0x7f45cc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddb06459587bda4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:54.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d27fc640 1 -- 172.21.15.87:0/2893289721 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0a5590 con 0x7f45d4160230 2024-04-25T15:57:54.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d27fc640 1 -- 172.21.15.87:0/2893289721 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc0a5730 con 0x7f45d4160230 2024-04-25T15:57:54.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d27fc640 1 -- 172.21.15.87:0/2893289721 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0a5b00 con 0x7f45d4160230 2024-04-25T15:57:54.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 -- 172.21.15.87:0/2893289721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 msgr2=0x7f45d4162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 --2- 172.21.15.87:0/2893289721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4162650 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f45d408e060 tx=0x7f45cc01c8d0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 -- 172.21.15.87:0/2893289721 shutdown_connections 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 --2- 172.21.15.87:0/2893289721 >> v2:172.21.15.155:3300/0 conn(0x7f45d40cb030 0x7f45d415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 --2- 172.21.15.87:0/2893289721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4162650 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 -- 172.21.15.87:0/2893289721 >> 172.21.15.87:0/2893289721 conn(0x7f45d40c9330 msgr2=0x7f45d40c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 -- 172.21.15.87:0/2893289721 shutdown_connections 2024-04-25T15:57:54.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 -- 172.21.15.87:0/2893289721 wait complete. 2024-04-25T15:57:54.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 Processor -- start 2024-04-25T15:57:54.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.975+0000 7f45d9423640 1 -- start start 2024-04-25T15:57:54.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45d40cb030 0x7f45d4150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45d415ad90 0x7f45d41f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f45d415b1a0 con 0x7f45d4160230 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40ca190 con 0x7f45d40cb030 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f45d415b320 con 0x7f45d415ad90 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4161860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34488/0 (socket says 172.21.15.87:34488) 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 -- 172.21.15.87:0/3806455412 learned_addr learned my addr 172.21.15.87:0/3806455412 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45cbfff640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45d415ad90 0x7f45d41f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d2ffd640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45d40cb030 0x7f45d4150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 -- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45d415ad90 msgr2=0x7f45d41f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45d415ad90 0x7f45d41f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 -- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45d40cb030 msgr2=0x7f45d4150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45d40cb030 0x7f45d4150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 -- 172.21.15.87:0/3806455412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d41f3a70 con 0x7f45d4160230 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d37fe640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4161860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0194e0 tx=0x7f45cc019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0bc020 con 0x7f45d4160230 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc0b8690 con 0x7f45d4160230 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d41f0330 con 0x7f45d4160230 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc009510 con 0x7f45d4160230 2024-04-25T15:57:54.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.979+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d4152d50 con 0x7f45d4160230 2024-04-25T15:57:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.983+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d406e750 con 0x7f45d4160230 2024-04-25T15:57:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.983+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f45cc0bf020 con 0x7f45d4160230 2024-04-25T15:57:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.983+0000 7f45cb7fe640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f45b406f430 0x7f45b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.983+0000 7f45d2ffd640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f45b406f430 0x7f45b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:54.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.983+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7f45cc12a170 con 0x7f45d4160230 2024-04-25T15:57:54.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.983+0000 7f45d2ffd640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f45b406f430 0x7f45b4071940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f45c4007fd0 tx=0x7f45c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:54.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:54.987+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45d406e750 con 0x7f45d4160230 2024-04-25T15:57:55.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.187+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45d4069bb0 con 0x7f45d4160230 2024-04-25T15:57:55.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.187+0000 7f45cb7fe640 1 -- 172.21.15.87:0/3806455412 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5659 (secure 0 0 0) 0x7f45cc0c6070 con 0x7f45d4160230 2024-04-25T15:57:55.193 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:55.193 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:54.269153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:55.193 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 32 2024-04-25T15:57:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f45b406f430 msgr2=0x7f45b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f45b406f430 0x7f45b4071940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f45c4007fd0 tx=0x7f45c4009040 comp rx=0 tx=0).stop 2024-04-25T15:57:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 msgr2=0x7f45d4161860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4161860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0194e0 tx=0x7f45cc019670 comp rx=0 tx=0).stop 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 shutdown_connections 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f45b406f430 0x7f45b4071940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45d4160230 0x7f45d4161860 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45d415ad90 0x7f45d41f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 --2- 172.21.15.87:0/3806455412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45d40cb030 0x7f45d4150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 >> 172.21.15.87:0/3806455412 conn(0x7f45d40c9330 msgr2=0x7f45d40c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 shutdown_connections 2024-04-25T15:57:55.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.191+0000 7f45d9423640 1 -- 172.21.15.87:0/3806455412 wait complete. 2024-04-25T15:57:55.216 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-04-25T15:57:55.216 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T15:57:55.216 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:55.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a41d3e640 1 Processor -- start 2024-04-25T15:57:55.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a41d3e640 1 -- start start 2024-04-25T15:57:55.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a41d3e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a3c071e50 0x7f6a3c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a41d3e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c072430 con 0x7f6a3c0c4720 2024-04-25T15:57:55.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a41d3e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c074730 con 0x7f6a3c1529a0 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a41d3e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c074a10 con 0x7f6a3c071e50 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6a3c0c4720 0x7f6a3c15fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41610/0 (socket says 172.21.15.87:41610) 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 -- 172.21.15.87:0/1694848592 learned_addr learned my addr 172.21.15.87:0/1694848592 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a32ffd640 1 --2- 172.21.15.87:0/1694848592 >> v2:172.21.15.155:3300/0 conn(0x7f6a3c071e50 0x7f6a3c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681763829 0 0) 0x7f6a3c072430 con 0x7f6a3c0c4720 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a28003530 con 0x7f6a3c0c4720 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320690993 0 0) 0x7f6a3c074730 con 0x7f6a3c1529a0 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a3c072430 con 0x7f6a3c1529a0 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3783336809 0 0) 0x7f6a28003530 con 0x7f6a3c0c4720 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 >> v2:172.21.15.155:3300/0 conn(0x7f6a3c071e50 msgr2=0x7f6a3c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 --2- 172.21.15.87:0/1694848592 >> v2:172.21.15.155:3300/0 conn(0x7f6a3c071e50 0x7f6a3c0c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 >> v1:172.21.15.155:6789/0 conn(0x7f6a3c1529a0 legacy=0x7f6a3c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c074cf0 con 0x7f6a3c0c4720 2024-04-25T15:57:55.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f6a34001a00 con 0x7f6a3c0c4720 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 >> v1:172.21.15.87:6789/0 conn(0x7f6a3c0c4720 legacy=0x7f6a3c15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28003b50 0x7f6a28003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a28004810 0x7f6a28004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a28005270 0x7f6a2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c074a10 con 0x7f6a28005270 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2800c1d0 con 0x7f6a28004810 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2800c3d0 con 0x7f6a28003b50 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a28005270 0x7f6a2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a32ffd640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a28004810 0x7f6a28004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3b7fe640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28003b50 0x7f6a28003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 -- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28003b50 msgr2=0x7f6a28003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28003b50 0x7f6a28003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 -- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a28004810 msgr2=0x7f6a28004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a28004810 0x7f6a28004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.363+0000 7f6a3bfff640 1 -- 172.21.15.87:0/1694848592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a28003530 con 0x7f6a28005270 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a3bfff640 1 -- 172.21.15.87:0/1694848592 reap_dead start 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a3bfff640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a28005270 0x7f6a2800b9d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0c3300 tx=0x7f6a3401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850c5aa147f4e98e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400a450 con 0x7f6a28005270 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a340ac640 con 0x7f6a28005270 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a3affd640 1 -- 172.21.15.87:0/1694848592 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a340aca30 con 0x7f6a28005270 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 -- 172.21.15.87:0/1694848592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a28005270 msgr2=0x7f6a2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a28005270 0x7f6a2800b9d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0c3300 tx=0x7f6a3401d2a0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 -- 172.21.15.87:0/1694848592 shutdown_connections 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/1694848592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a28005270 0x7f6a2800b9d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 -- 172.21.15.87:0/1694848592 >> 172.21.15.87:0/1694848592 conn(0x7f6a3c0c8770 msgr2=0x7f6a3c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 -- 172.21.15.87:0/1694848592 shutdown_connections 2024-04-25T15:57:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.367+0000 7f6a41d3e640 1 -- 172.21.15.87:0/1694848592 wait complete. 2024-04-25T15:57:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 Processor -- start 2024-04-25T15:57:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 -- start start 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28005270 0x7f6a3c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 0x7f6a3c1ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a3c14e0c0 0x7f6a3c1eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c0ab1a0 con 0x7f6a3c144df0 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c072260 con 0x7f6a3c14e0c0 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c0c4b30 con 0x7f6a28005270 2024-04-25T15:57:55.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 0x7f6a3c1ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 0x7f6a3c1ee840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34514/0 (socket says 172.21.15.87:34514) 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 -- 172.21.15.87:0/2449680045 learned_addr learned my addr 172.21.15.87:0/2449680045 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a3bfff640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a3c14e0c0 0x7f6a3c1eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a3b7fe640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28005270 0x7f6a3c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 -- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28005270 msgr2=0x7f6a3c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28005270 0x7f6a3c14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 -- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a3c14e0c0 msgr2=0x7f6a3c1eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a3c14e0c0 0x7f6a3c1eed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 -- 172.21.15.87:0/2449680045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c1ef530 con 0x7f6a3c144df0 2024-04-25T15:57:55.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a32ffd640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 0x7f6a3c1ee840 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a24011960 tx=0x7f6a24011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:55.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24019070 con 0x7f6a3c144df0 2024-04-25T15:57:55.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24004240 con 0x7f6a3c144df0 2024-04-25T15:57:55.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400f820 con 0x7f6a3c144df0 2024-04-25T15:57:55.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c155aa0 con 0x7f6a3c144df0 2024-04-25T15:57:55.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.371+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c1448a0 con 0x7f6a3c144df0 2024-04-25T15:57:55.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.375+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6a2401c070 con 0x7f6a3c144df0 2024-04-25T15:57:55.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.375+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c069bb0 con 0x7f6a3c144df0 2024-04-25T15:57:55.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.375+0000 7f6a38ff9640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6a1c073840 0x7f6a1c075d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:55.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.375+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7f6a2408fa10 con 0x7f6a3c144df0 2024-04-25T15:57:55.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.375+0000 7f6a3b7fe640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6a1c073840 0x7f6a1c075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:55.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.375+0000 7f6a3b7fe640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6a1c073840 0x7f6a1c075d50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c005630 tx=0x7f6a2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:55.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.383+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a2405be10 con 0x7f6a3c144df0 2024-04-25T15:57:55.566 INFO:tasks.workunit.client.0.smithi087.stdout:4/0: sync 2024-04-25T15:57:55.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/1: rmdir - no directory 2024-04-25T15:57:55.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/2: rename - no filename 2024-04-25T15:57:55.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/3: dread - no filename 2024-04-25T15:57:55.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/4: read - no filename 2024-04-25T15:57:55.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.583+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a3c1ef2c0 con 0x7f6a3c144df0 2024-04-25T15:57:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.583+0000 7f6a38ff9640 1 -- 172.21.15.87:0/2449680045 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5659 (secure 0 0 0) 0x7f6a24060110 con 0x7f6a3c144df0 2024-04-25T15:57:55.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:55.588 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:54.269153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 32 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.583+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6a1c073840 msgr2=0x7f6a1c075d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.583+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6a1c073840 0x7f6a1c075d50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c005630 tx=0x7f6a2c009040 comp rx=0 tx=0).stop 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.583+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 msgr2=0x7f6a3c1ee840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.583+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 0x7f6a3c1ee840 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a24011960 tx=0x7f6a24011e20 comp rx=0 tx=0).stop 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 shutdown_connections 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6a1c073840 0x7f6a1c075d50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a3c14e0c0 0x7f6a3c1eed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c144df0 0x7f6a3c1ee840 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 --2- 172.21.15.87:0/2449680045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a28005270 0x7f6a3c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:55.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 >> 172.21.15.87:0/2449680045 conn(0x7f6a3c0c8770 msgr2=0x7f6a3c145890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:55.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 shutdown_connections 2024-04-25T15:57:55.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:55.587+0000 7f6a41d3e640 1 -- 172.21.15.87:0/2449680045 wait complete. 2024-04-25T15:57:55.611 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 32, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 32, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4966": { "addr": "172.21.15.155:6833/2576881209", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 2576881209, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 2576881209, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4966, "incarnation": 32, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:57:54.269153+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4966 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 24, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5262": { "addr": "172.21.15.87:6835/1293807006", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 1293807006, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 1293807006, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5262, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:55:37.257991+0000", "qdb_cluster": [ 5262 ], "qdb_leader": 5262, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5262 } } } ], "standbys": [ { "addr": "172.21.15.155:6835/630698588", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 630698588, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 630698588, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T15:57:55.667 INFO:tasks.workunit.client.0.smithi087.stdout:6/22: sync 2024-04-25T15:57:55.667 INFO:tasks.workunit.client.0.smithi087.stdout:5/15: sync 2024-04-25T15:57:55.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/7: sync 2024-04-25T15:57:55.667 INFO:tasks.workunit.client.0.smithi087.stdout:9/34: sync 2024-04-25T15:57:55.667 INFO:tasks.workunit.client.0.smithi087.stdout:7/7: sync 2024-04-25T15:57:56.874 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:57.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 Processor -- start 2024-04-25T15:57:57.035 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 -- start start 2024-04-25T15:57:57.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 0x7ff900071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000adda0 0x7ff9000c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9000c4e30 con 0x7ff9000ad990 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9000ae1b0 con 0x7ff9001529a0 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff90547b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff900072430 con 0x7ff9000adda0 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff8feffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 0x7ff900071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff8ff7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000adda0 0x7ff9000c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff8feffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 0x7ff900071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:58966/0 (socket says 172.21.15.87:58966) 2024-04-25T15:57:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.031+0000 7ff8feffd640 1 -- 172.21.15.87:0/1692961320 learned_addr learned my addr 172.21.15.87:0/1692961320 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8ff7fe640 1 -- 172.21.15.87:0/1692961320 >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 msgr2=0x7ff900071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8ff7fe640 1 --2- 172.21.15.87:0/1692961320 >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 0x7ff900071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8ff7fe640 1 -- 172.21.15.87:0/1692961320 >> v1:172.21.15.155:6789/0 conn(0x7ff9000ad990 legacy=0x7ff9000c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8ff7fe640 1 -- 172.21.15.87:0/1692961320 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff900074730 con 0x7ff9000adda0 2024-04-25T15:57:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8feffd640 1 --2- 172.21.15.87:0/1692961320 >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 0x7ff900071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:57:57.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8ff7fe640 1 --2- 172.21.15.87:0/1692961320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000adda0 0x7ff9000c48f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009d90 tx=0x7ff8f801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04ea28753e965c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:57.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8fdffb640 1 -- 172.21.15.87:0/1692961320 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80b2070 con 0x7ff9000adda0 2024-04-25T15:57:57.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8fdffb640 1 -- 172.21.15.87:0/1692961320 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f80a57a0 con 0x7ff9000adda0 2024-04-25T15:57:57.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff8fdffb640 1 -- 172.21.15.87:0/1692961320 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80a5b70 con 0x7ff9000adda0 2024-04-25T15:57:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 -- 172.21.15.87:0/1692961320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000adda0 msgr2=0x7ff9000c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 --2- 172.21.15.87:0/1692961320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000adda0 0x7ff9000c48f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009d90 tx=0x7ff8f801c8e0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 -- 172.21.15.87:0/1692961320 shutdown_connections 2024-04-25T15:57:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 --2- 172.21.15.87:0/1692961320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000adda0 0x7ff9000c48f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 --2- 172.21.15.87:0/1692961320 >> v2:172.21.15.155:3300/0 conn(0x7ff9001529a0 0x7ff900071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 -- 172.21.15.87:0/1692961320 >> 172.21.15.87:0/1692961320 conn(0x7ff9000c8770 msgr2=0x7ff9000c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 -- 172.21.15.87:0/1692961320 shutdown_connections 2024-04-25T15:57:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.035+0000 7ff90547b640 1 -- 172.21.15.87:0/1692961320 wait complete. 2024-04-25T15:57:57.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 Processor -- start 2024-04-25T15:57:57.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 -- start start 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000ad990 0x7ff90015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 0x7ff90014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9001529a0 0x7ff90014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9001622f0 con 0x7ff9000adda0 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9000ab1a0 con 0x7ff9001529a0 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff900162470 con 0x7ff9000ad990 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 0x7ff90014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 0x7ff90014e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34526/0 (socket says 172.21.15.87:34526) 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 -- 172.21.15.87:0/4046508044 learned_addr learned my addr 172.21.15.87:0/4046508044 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:57.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8feffd640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000ad990 0x7ff90015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8ff7fe640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9001529a0 0x7ff90014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 -- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000ad990 msgr2=0x7ff90015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000ad990 0x7ff90015e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 -- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9001529a0 msgr2=0x7ff90014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9001529a0 0x7ff90014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 -- 172.21.15.87:0/4046508044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90014f3d0 con 0x7ff9000adda0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8fe7fc640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 0x7ff90014e1a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400c310 tx=0x7ff8f400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40052d0 con 0x7ff9000adda0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4005470 con 0x7ff9000adda0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90014f6b0 con 0x7ff9000adda0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4007260 con 0x7ff9000adda0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.039+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9000c7d70 con 0x7ff9000adda0 2024-04-25T15:57:57.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.043+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff900069bb0 con 0x7ff9000adda0 2024-04-25T15:57:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.043+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff8f4007400 con 0x7ff9000adda0 2024-04-25T15:57:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.043+0000 7ff8e77fe640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8ec06f430 0x7ff8ec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.043+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7ff8f408ebb0 con 0x7ff9000adda0 2024-04-25T15:57:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.043+0000 7ff8feffd640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8ec06f430 0x7ff8ec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.043+0000 7ff8feffd640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8ec06f430 0x7ff8ec071940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff900073d40 tx=0x7ff8f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:57.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.047+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9000c4e30 con 0x7ff9000adda0 2024-04-25T15:57:57.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.243+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9000c3760 con 0x7ff9000adda0 2024-04-25T15:57:57.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.243+0000 7ff8e77fe640 1 -- 172.21.15.87:0/4046508044 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5663 (secure 0 0 0) 0x7ff8f405b640 con 0x7ff9000adda0 2024-04-25T15:57:57.250 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:57.250 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:55.926353+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:57.250 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 33 2024-04-25T15:57:57.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8ec06f430 msgr2=0x7ff8ec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8ec06f430 0x7ff8ec071940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff900073d40 tx=0x7ff8f0008040 comp rx=0 tx=0).stop 2024-04-25T15:57:57.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 msgr2=0x7ff90014e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 0x7ff90014e1a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400c310 tx=0x7ff8f400c7d0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 shutdown_connections 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8ec06f430 0x7ff8ec071940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9001529a0 0x7ff90014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9000adda0 0x7ff90014e1a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 --2- 172.21.15.87:0/4046508044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9000ad990 0x7ff90015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 >> 172.21.15.87:0/4046508044 conn(0x7ff9000c8770 msgr2=0x7ff900153810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 shutdown_connections 2024-04-25T15:57:57.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.247+0000 7ff90547b640 1 -- 172.21.15.87:0/4046508044 wait complete. 2024-04-25T15:57:57.272 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:57:57.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:57.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.767+0000 7f47fce0b640 1 Processor -- start 2024-04-25T15:57:57.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.767+0000 7f47fce0b640 1 -- start start 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47fce0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f47f8071e50 0x7f47f80c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47fce0b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f8072430 con 0x7f47f81529a0 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47fce0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f8074730 con 0x7f47f80c4720 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47fce0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f47f8074a10 con 0x7f47f8071e50 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f659c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f47f81529a0 0x7f47f80ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41614/0 (socket says 172.21.15.87:41614) 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f659c640 1 -- 172.21.15.87:0/1932981647 learned_addr learned my addr 172.21.15.87:0/1932981647 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f5d9b640 1 --2- 172.21.15.87:0/1932981647 >> v2:172.21.15.155:3300/0 conn(0x7f47f8071e50 0x7f47f80c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222981924 0 0) 0x7f47f8072430 con 0x7f47f81529a0 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e0003530 con 0x7f47f81529a0 2024-04-25T15:57:57.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3927884228 0 0) 0x7f47e0003530 con 0x7f47f81529a0 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 >> v2:172.21.15.155:3300/0 conn(0x7f47f8071e50 msgr2=0x7f47f80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 --2- 172.21.15.87:0/1932981647 >> v2:172.21.15.155:3300/0 conn(0x7f47f8071e50 0x7f47f80c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 >> v1:172.21.15.155:6789/0 conn(0x7f47f80c4720 legacy=0x7f47f815fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f8074cf0 con 0x7f47f81529a0 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f47e8001680 con 0x7f47f81529a0 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 >> v1:172.21.15.87:6789/0 conn(0x7f47f81529a0 legacy=0x7f47f80ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e00039c0 0x7f47e0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0004810 0x7f47e0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47e0005260 0x7f47e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8074a10 con 0x7f47e0005260 2024-04-25T15:57:57.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f47e000c1f0 con 0x7f47e0004810 2024-04-25T15:57:57.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f47e000c3f0 con 0x7f47e00039c0 2024-04-25T15:57:57.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f6d9d640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47e0005260 0x7f47e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f5d9b640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0004810 0x7f47e0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f659c640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e00039c0 0x7f47e0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f6d9d640 1 -- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e00039c0 msgr2=0x7f47e0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:57.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f6d9d640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47e00039c0 0x7f47e0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f6d9d640 1 -- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0004810 msgr2=0x7f47e0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:57.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f6d9d640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0004810 0x7f47e0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.771+0000 7f47f6d9d640 1 -- 172.21.15.87:0/1932981647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e0003530 con 0x7f47e0005260 2024-04-25T15:57:57.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47f6d9d640 1 -- 172.21.15.87:0/1932981647 reap_dead start 2024-04-25T15:57:57.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47f6d9d640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47e0005260 0x7f47e000b9d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f47f80c2ce0 tx=0x7f47f001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bdefb98296978c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:57.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0001a90 con 0x7f47e0005260 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f0003b80 con 0x7f47e0005260 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47f559a640 1 -- 172.21.15.87:0/1932981647 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f00050d0 con 0x7f47e0005260 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 -- 172.21.15.87:0/1932981647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47e0005260 msgr2=0x7f47e000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47e0005260 0x7f47e000b9d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f47f80c2ce0 tx=0x7f47f001c720 comp rx=0 tx=0).stop 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 -- 172.21.15.87:0/1932981647 shutdown_connections 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1932981647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47e0005260 0x7f47e000b9d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 -- 172.21.15.87:0/1932981647 >> 172.21.15.87:0/1932981647 conn(0x7f47f80c8770 msgr2=0x7f47f80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 -- 172.21.15.87:0/1932981647 shutdown_connections 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.775+0000 7f47fce0b640 1 -- 172.21.15.87:0/1932981647 wait complete. 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 Processor -- start 2024-04-25T15:57:57.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- start start 2024-04-25T15:57:57.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0005260 0x7f47f8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 0x7f47f8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f81def90 0x7f47f81df3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f47f80ab1a0 con 0x7f47f8157bb0 2024-04-25T15:57:57.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8072260 con 0x7f47e0005260 2024-04-25T15:57:57.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f47f80c4b30 con 0x7f47f81def90 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 0x7f47f8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 0x7f47f8157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34556/0 (socket says 172.21.15.87:34556) 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 -- 172.21.15.87:0/1813423575 learned_addr learned my addr 172.21.15.87:0/1813423575 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f659c640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0005260 0x7f47f8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f6d9d640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f81def90 0x7f47f81df3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 -- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f81def90 msgr2=0x7f47f81df3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f81def90 0x7f47f81df3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 -- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0005260 msgr2=0x7f47f8155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0005260 0x7f47f8155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 -- 172.21.15.87:0/1813423575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f81de9e0 con 0x7f47f8157bb0 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47f5d9b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 0x7f47f8157fc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f47ec011990 tx=0x7f47ec011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec019070 con 0x7f47f8157bb0 2024-04-25T15:57:57.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ec004300 con 0x7f47f8157bb0 2024-04-25T15:57:57.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00f9c0 con 0x7f47f8157bb0 2024-04-25T15:57:57.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f8154060 con 0x7f47f8157bb0 2024-04-25T15:57:57.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f8150d20 con 0x7f47f8157bb0 2024-04-25T15:57:57.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.779+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f8069bb0 con 0x7f47f8157bb0 2024-04-25T15:57:57.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.783+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f47ec01c070 con 0x7f47f8157bb0 2024-04-25T15:57:57.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.783+0000 7f47e6ffd640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f47d806f400 0x7f47d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:57.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.783+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7f47ec08fb10 con 0x7f47f8157bb0 2024-04-25T15:57:57.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.783+0000 7f47f659c640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f47d806f400 0x7f47d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:57.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.783+0000 7f47f659c640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f47d806f400 0x7f47d8071910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f47f8073d40 tx=0x7f47e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:57.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.787+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47ec0044b0 con 0x7f47f8157bb0 2024-04-25T15:57:57.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47f80723e0 con 0x7f47f8157bb0 2024-04-25T15:57:57.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47e6ffd640 1 -- 172.21.15.87:0/1813423575 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5660 (secure 0 0 0) 0x7f47ec05c560 con 0x7f47f8157bb0 2024-04-25T15:57:57.992 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:57.992 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:56.477889+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":14,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:57.992 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 34 2024-04-25T15:57:57.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f47d806f400 msgr2=0x7f47d8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f47d806f400 0x7f47d8071910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f47f8073d40 tx=0x7f47e8009040 comp rx=0 tx=0).stop 2024-04-25T15:57:57.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 msgr2=0x7f47f8157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:57.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 0x7f47f8157fc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f47ec011990 tx=0x7f47ec011e50 comp rx=0 tx=0).stop 2024-04-25T15:57:57.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 shutdown_connections 2024-04-25T15:57:57.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f47d806f400 0x7f47d8071910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47f81def90 0x7f47f81df3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.987+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f8157bb0 0x7f47f8157fc0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.991+0000 7f47fce0b640 1 --2- 172.21.15.87:0/1813423575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47e0005260 0x7f47f8155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:57.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.991+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 >> 172.21.15.87:0/1813423575 conn(0x7f47f80c8770 msgr2=0x7f47f8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:57.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.991+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 shutdown_connections 2024-04-25T15:57:57.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:57.991+0000 7f47fce0b640 1 -- 172.21.15.87:0/1813423575 wait complete. 2024-04-25T15:57:58.015 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T15:57:59.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:57:59.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 Processor -- start 2024-04-25T15:57:59.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 -- start start 2024-04-25T15:57:59.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 0x7f7cd40ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cd40adfb0 0x7f7cd415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4063660 con 0x7f7cd4158e10 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd40c5470 con 0x7f7cd40adfb0 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cda61f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd40ab670 con 0x7f7cd4158a00 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7cd4158e10 0x7f7cd4152680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41626/0 (socket says 172.21.15.87:41626) 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd37fe640 1 -- 172.21.15.87:0/2026969817 learned_addr learned my addr 172.21.15.87:0/2026969817 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 0x7f7cd40ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd8bbc640 1 --2- 172.21.15.87:0/2026969817 >> v2:172.21.15.155:3300/0 conn(0x7f7cd40adfb0 0x7f7cd415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888993335 0 0) 0x7f7cd4063660 con 0x7f7cd4158e10 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc0003530 con 0x7f7cd4158e10 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3554515544 0 0) 0x7f7cc0003530 con 0x7f7cd4158e10 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 msgr2=0x7f7cd40ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 0x7f7cd40ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 >> v2:172.21.15.155:3300/0 conn(0x7f7cd40adfb0 msgr2=0x7f7cd415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:59.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 --2- 172.21.15.87:0/2026969817 >> v2:172.21.15.155:3300/0 conn(0x7f7cd40adfb0 0x7f7cd415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd40ab930 con 0x7f7cd4158e10 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.435+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f7cbc0016a0 con 0x7f7cd4158e10 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 >> v1:172.21.15.87:6789/0 conn(0x7f7cd4158e10 legacy=0x7f7cd4152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc00039c0 0x7f7cc0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0004810 0x7f7cc0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 0x7f7cc0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40c5470 con 0x7f7cc0004810 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40ab670 con 0x7f7cc00039c0 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc000b9d0 con 0x7f7cd4158a00 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0004810 0x7f7cc0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc00039c0 0x7f7cc0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd8bbc640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 0x7f7cc0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 -- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 msgr2=0x7f7cc0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd4158a00 0x7f7cc0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 -- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc00039c0 msgr2=0x7f7cc0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc00039c0 0x7f7cc0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 -- 172.21.15.87:0/2026969817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc0003530 con 0x7f7cc0004810 2024-04-25T15:57:59.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc00039c0 0x7f7cc0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd37fe640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0004810 0x7f7cc0004c20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00c210 tx=0x7f7cbc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c6baac08fbb57f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc007d60 con 0x7f7cc0004810 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc005b00 con 0x7f7cc0004810 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd2ffd640 1 -- 172.21.15.87:0/2026969817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc007070 con 0x7f7cc0004810 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cda61f640 1 -- 172.21.15.87:0/2026969817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0004810 msgr2=0x7f7cc0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cda61f640 1 --2- 172.21.15.87:0/2026969817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0004810 0x7f7cc0004c20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00c210 tx=0x7f7cbc01f3d0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cd8bbc640 1 -- 172.21.15.87:0/2026969817 reap_dead start 2024-04-25T15:57:59.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cda61f640 1 -- 172.21.15.87:0/2026969817 shutdown_connections 2024-04-25T15:57:59.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cda61f640 1 -- 172.21.15.87:0/2026969817 >> 172.21.15.87:0/2026969817 conn(0x7f7cd406d650 msgr2=0x7f7cd40c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:59.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cda61f640 1 -- 172.21.15.87:0/2026969817 shutdown_connections 2024-04-25T15:57:59.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.439+0000 7f7cda61f640 1 -- 172.21.15.87:0/2026969817 wait complete. 2024-04-25T15:57:59.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 Processor -- start 2024-04-25T15:57:59.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 -- start start 2024-04-25T15:57:59.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc0004810 0x7f7cd4153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd414d180 0x7f7cd41ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 0x7f7cd406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40ad1e0 con 0x7f7cd41dfb60 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd406de30 con 0x7f7cc0004810 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd40aef70 con 0x7f7cd414d180 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 0x7f7cd406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 0x7f7cd406efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34580/0 (socket says 172.21.15.87:34580) 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 -- 172.21.15.87:0/734941908 learned_addr learned my addr 172.21.15.87:0/734941908 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc0004810 0x7f7cd4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd37fe640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd414d180 0x7f7cd41ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 -- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd414d180 msgr2=0x7f7cd41ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd414d180 0x7f7cd41ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 -- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc0004810 msgr2=0x7f7cd4153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc0004810 0x7f7cd4153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 -- 172.21.15.87:0/734941908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd41492c0 con 0x7f7cd41dfb60 2024-04-25T15:57:59.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc0004810 0x7f7cd4153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd8bbc640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 0x7f7cd406efc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7cd406e420 tx=0x7f7cc4011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4019020 con 0x7f7cd41dfb60 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc4003620 con 0x7f7cd41dfb60 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd41495a0 con 0x7f7cd41dfb60 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4003a10 con 0x7f7cd41dfb60 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.443+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd41e1750 con 0x7f7cd41dfb60 2024-04-25T15:57:59.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.447+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd41e1990 con 0x7f7cd41dfb60 2024-04-25T15:57:59.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.447+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7cc401c020 con 0x7f7cd41dfb60 2024-04-25T15:57:59.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.447+0000 7f7cd0ff9640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7cb406f430 0x7f7cb4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:57:59.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.447+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7f7cc408fdc0 con 0x7f7cd41dfb60 2024-04-25T15:57:59.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.447+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7cb406f430 0x7f7cb4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:57:59.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.447+0000 7f7cd3fff640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7cb406f430 0x7f7cb4071940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc007440 tx=0x7f7ccc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:57:59.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.451+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7cd41e1990 con 0x7f7cd41dfb60 2024-04-25T15:57:59.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.655+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cd4069bb0 con 0x7f7cd41dfb60 2024-04-25T15:57:59.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.655+0000 7f7cd0ff9640 1 -- 172.21.15.87:0/734941908 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5667 (secure 0 0 0) 0x7f7cc4023020 con 0x7f7cd41dfb60 2024-04-25T15:57:59.659 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:57:59.659 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:57:59.659 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 35 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.655+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7cb406f430 msgr2=0x7f7cb4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.655+0000 7f7cda61f640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7cb406f430 0x7f7cb4071940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc007440 tx=0x7f7ccc00b040 comp rx=0 tx=0).stop 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.655+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 msgr2=0x7f7cd406efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.655+0000 7f7cda61f640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 0x7f7cd406efc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7cd406e420 tx=0x7f7cc4011920 comp rx=0 tx=0).stop 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 shutdown_connections 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7cb406f430 0x7f7cb4071940 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd41dfb60 0x7f7cd406efc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cd414d180 0x7f7cd41ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 --2- 172.21.15.87:0/734941908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cc0004810 0x7f7cd4153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:57:59.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 >> 172.21.15.87:0/734941908 conn(0x7f7cd406d650 msgr2=0x7f7cd4156340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:57:59.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 shutdown_connections 2024-04-25T15:57:59.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:57:59.659+0000 7f7cda61f640 1 -- 172.21.15.87:0/734941908 wait complete. 2024-04-25T15:57:59.683 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:57:59.938 INFO:tasks.workunit.client.0.smithi087.stdout:2/41: symlink d3/lc 0 2024-04-25T15:57:59.938 INFO:tasks.workunit.client.0.smithi087.stdout:9/35: rename d6 to d6/d8/dd 22 2024-04-25T15:57:59.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/37: readlink d4/l8 0 2024-04-25T15:57:59.942 INFO:tasks.workunit.client.0.smithi087.stdout:2/42: chown d3/lc 3048 1 2024-04-25T15:57:59.942 INFO:tasks.workunit.client.0.smithi087.stdout:1/24: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:00.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:00.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/5: creat f0 x:0 0 0 2024-04-25T15:58:00.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/36: read - f3 zero size 2024-04-25T15:58:00.067 INFO:tasks.workunit.client.0.smithi087.stdout:4/6: write f0 [844365,67816] 0 2024-04-25T15:58:00.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/7: creat f1 x:0 0 0 2024-04-25T15:58:00.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/23: getdents d7 0 2024-04-25T15:58:00.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/8: mknod c2 0 2024-04-25T15:58:00.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/9: stat f1 0 2024-04-25T15:58:00.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/10: dwrite f1 [0,4194304] 0 2024-04-25T15:58:00.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/11: rename c2 to c3 0 2024-04-25T15:58:00.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/37: dread d6/d8/fc [0,4194304] 0 2024-04-25T15:58:00.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/12: dread f0 [0,4194304] 0 2024-04-25T15:58:00.163 INFO:tasks.workunit.client.0.smithi087.stdout:5/16: chown f2 7726448 1 2024-04-25T15:58:00.194 INFO:tasks.workunit.client.0.smithi087.stdout:0/56: creat d1/d6/f1a x:0 0 0 2024-04-25T15:58:00.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 Processor -- start 2024-04-25T15:58:00.196 INFO:tasks.workunit.client.0.smithi087.stdout:2/43: getdents d3 0 2024-04-25T15:58:00.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 -- start start 2024-04-25T15:58:00.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba4c157530 0x7fba4c074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba4c0c9100 0x7fba4c15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fba4c157940 con 0x7fba4c157530 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fba4c0c53b0 con 0x7fba4c0c9100 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.191+0000 7fba51db6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c157b60 con 0x7fba4c0746a0 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba4c157530 0x7fba4c074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba4c157530 0x7fba4c074160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34596/0 (socket says 172.21.15.87:34596) 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 -- 172.21.15.87:0/801141857 learned_addr learned my addr 172.21.15.87:0/801141857 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba42ffd640 1 --2- 172.21.15.87:0/801141857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4bfff640 1 --2- 172.21.15.87:0/801141857 >> v2:172.21.15.155:3300/0 conn(0x7fba4c0c9100 0x7fba4c15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 -- 172.21.15.87:0/801141857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 msgr2=0x7fba4c0c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:00.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 --2- 172.21.15.87:0/801141857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c0c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 -- 172.21.15.87:0/801141857 >> v2:172.21.15.155:3300/0 conn(0x7fba4c0c9100 msgr2=0x7fba4c15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:00.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 --2- 172.21.15.87:0/801141857 >> v2:172.21.15.155:3300/0 conn(0x7fba4c0c9100 0x7fba4c15ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 -- 172.21.15.87:0/801141857 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c157e40 con 0x7fba4c157530 2024-04-25T15:58:00.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4bfff640 1 --2- 172.21.15.87:0/801141857 >> v2:172.21.15.155:3300/0 conn(0x7fba4c0c9100 0x7fba4c15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:58:00.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4b7fe640 1 --2- 172.21.15.87:0/801141857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c157530 0x7fba4c074160 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fba4c073f30 tx=0x7fba3c01c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832091dd121092ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:00.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/44: unlink f0 0 2024-04-25T15:58:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4affd640 1 -- 172.21.15.87:0/801141857 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0b0070 con 0x7fba4c157530 2024-04-25T15:58:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4affd640 1 -- 172.21.15.87:0/801141857 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c0ab600 con 0x7fba4c157530 2024-04-25T15:58:00.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.195+0000 7fba4affd640 1 -- 172.21.15.87:0/801141857 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0ab9d0 con 0x7fba4c157530 2024-04-25T15:58:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 -- 172.21.15.87:0/801141857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c157530 msgr2=0x7fba4c074160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 --2- 172.21.15.87:0/801141857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c157530 0x7fba4c074160 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fba4c073f30 tx=0x7fba3c01c110 comp rx=0 tx=0).stop 2024-04-25T15:58:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 -- 172.21.15.87:0/801141857 shutdown_connections 2024-04-25T15:58:00.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 --2- 172.21.15.87:0/801141857 >> v2:172.21.15.155:3300/0 conn(0x7fba4c0c9100 0x7fba4c15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 --2- 172.21.15.87:0/801141857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c0c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 --2- 172.21.15.87:0/801141857 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c157530 0x7fba4c074160 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 -- 172.21.15.87:0/801141857 >> 172.21.15.87:0/801141857 conn(0x7fba4c0ac550 msgr2=0x7fba4c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:00.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 -- 172.21.15.87:0/801141857 shutdown_connections 2024-04-25T15:58:00.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 -- 172.21.15.87:0/801141857 wait complete. 2024-04-25T15:58:00.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 Processor -- start 2024-04-25T15:58:00.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.199+0000 7fba51db6640 1 -- start start 2024-04-25T15:58:00.205 INFO:tasks.workunit.client.0.smithi087.stdout:0/57: dwrite d1/d6/f1a [0,4194304] 0 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 0x7fba4c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c157530 0x7fba4c14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c154df0 con 0x7fba4c0c9100 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0aa230 con 0x7fba4c157530 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c154f70 con 0x7fba4c0746a0 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 0x7fba4c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba4b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 0x7fba4c14e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34598/0 (socket says 172.21.15.87:34598) 2024-04-25T15:58:00.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 -- 172.21.15.87:0/487064148 learned_addr learned my addr 172.21.15.87:0/487064148 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:00.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba4bfff640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c157530 0x7fba4c14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/58: chown d1/da 34 1 2024-04-25T15:58:00.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 -- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 msgr2=0x7fba4c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:00.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 -- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c157530 msgr2=0x7fba4c14c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:00.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c157530 0x7fba4c14c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 -- 172.21.15.87:0/487064148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c1f4a20 con 0x7fba4c0c9100 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba4b7fe640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba42ffd640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 0x7fba4c14e9c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fba3400e8a0 tx=0x7fba3400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34017070 con 0x7fba4c0c9100 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3400c8e0 con 0x7fba4c0c9100 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1f4d00 con 0x7fba4c0c9100 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3400cc90 con 0x7fba4c0c9100 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c14f420 con 0x7fba4c0c9100 2024-04-25T15:58:00.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.203+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c069bb0 con 0x7fba4c0c9100 2024-04-25T15:58:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.207+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fba3401a070 con 0x7fba4c0c9100 2024-04-25T15:58:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.207+0000 7fba48ff9640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba2c06f400 0x7fba2c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.207+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7fba3408f8b0 con 0x7fba4c0c9100 2024-04-25T15:58:00.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.207+0000 7fba4b7fe640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba2c06f400 0x7fba2c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:00.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.207+0000 7fba4b7fe640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba2c06f400 0x7fba2c071910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0ad000 tx=0x7fba3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:00.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.215+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba3405bcb0 con 0x7fba4c0c9100 2024-04-25T15:58:00.235 INFO:tasks.workunit.client.0.smithi087.stdout:4/13: getdents . 0 2024-04-25T15:58:00.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/8: write f0 [144038,6641] 0 2024-04-25T15:58:00.236 INFO:tasks.workunit.client.0.smithi087.stdout:3/38: write d4/f6 [1113808,35872] 0 2024-04-25T15:58:00.238 INFO:tasks.workunit.client.0.smithi087.stdout:4/14: mkdir d4 0 2024-04-25T15:58:00.240 INFO:tasks.workunit.client.0.smithi087.stdout:5/17: symlink l5 0 2024-04-25T15:58:00.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/59: dread d1/f3 [4194304,4194304] 0 2024-04-25T15:58:00.242 INFO:tasks.workunit.client.0.smithi087.stdout:7/9: symlink d1/l2 0 2024-04-25T15:58:00.243 INFO:tasks.workunit.client.0.smithi087.stdout:1/25: rename f2 to d3/f9 0 2024-04-25T15:58:00.246 INFO:tasks.workunit.client.0.smithi087.stdout:9/38: dwrite f2 [0,4194304] 0 2024-04-25T15:58:00.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/15: creat d4/f5 x:0 0 0 2024-04-25T15:58:00.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/24: link f0 d7/fa 0 2024-04-25T15:58:00.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/16: chown d4 25161 1 2024-04-25T15:58:00.256 INFO:tasks.workunit.client.0.smithi087.stdout:8/8: dwrite f1 [0,4194304] 0 2024-04-25T15:58:00.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/60: mkdir d1/d6/d1b 0 2024-04-25T15:58:00.260 INFO:tasks.workunit.client.0.smithi087.stdout:4/17: creat d4/f6 x:0 0 0 2024-04-25T15:58:00.260 INFO:tasks.workunit.client.0.smithi087.stdout:6/25: readlink l2 0 2024-04-25T15:58:00.261 INFO:tasks.workunit.client.0.smithi087.stdout:2/45: dwrite f2 [0,4194304] 0 2024-04-25T15:58:00.262 INFO:tasks.workunit.client.0.smithi087.stdout:3/39: link d4/f6 d4/db/fe 0 2024-04-25T15:58:00.266 INFO:tasks.workunit.client.0.smithi087.stdout:1/26: creat d3/fa x:0 0 0 2024-04-25T15:58:00.269 INFO:tasks.workunit.client.0.smithi087.stdout:8/9: dwrite f1 [4194304,4194304] 0 2024-04-25T15:58:00.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/10: chown f1 916067262 1 2024-04-25T15:58:00.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/40: readlink d4/ld 0 2024-04-25T15:58:00.276 INFO:tasks.workunit.client.0.smithi087.stdout:4/18: write f0 [1053879,90673] 0 2024-04-25T15:58:00.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/61: fsync d1/f3 0 2024-04-25T15:58:00.278 INFO:tasks.workunit.client.0.smithi087.stdout:1/27: read d3/f4 [2296925,90951] 0 2024-04-25T15:58:00.278 INFO:tasks.workunit.client.0.smithi087.stdout:7/10: stat d1 0 2024-04-25T15:58:00.284 INFO:tasks.workunit.client.0.smithi087.stdout:0/62: dread d1/f18 [0,4194304] 0 2024-04-25T15:58:00.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/11: symlink d1/l3 0 2024-04-25T15:58:00.286 INFO:tasks.workunit.client.0.smithi087.stdout:4/19: fsync d4/f6 0 2024-04-25T15:58:00.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/39: symlink d6/d8/le 0 2024-04-25T15:58:00.286 INFO:tasks.workunit.client.0.smithi087.stdout:1/28: truncate d3/f6 267913 0 2024-04-25T15:58:00.288 INFO:tasks.workunit.client.0.smithi087.stdout:0/63: mkdir d1/d6/d1b/d1c 0 2024-04-25T15:58:00.289 INFO:tasks.workunit.client.0.smithi087.stdout:5/18: dread f2 [0,4194304] 0 2024-04-25T15:58:00.289 INFO:tasks.workunit.client.0.smithi087.stdout:4/20: write d4/f5 [871468,41010] 0 2024-04-25T15:58:00.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/12: mkdir d1/d4 0 2024-04-25T15:58:00.291 INFO:tasks.workunit.client.0.smithi087.stdout:5/19: chown f2 225578400 1 2024-04-25T15:58:00.291 INFO:tasks.workunit.client.0.smithi087.stdout:6/26: link c3 d7/cb 0 2024-04-25T15:58:00.292 INFO:tasks.workunit.client.0.smithi087.stdout:1/29: symlink d3/lb 0 2024-04-25T15:58:00.293 INFO:tasks.workunit.client.0.smithi087.stdout:7/13: unlink d1/l3 0 2024-04-25T15:58:00.295 INFO:tasks.workunit.client.0.smithi087.stdout:5/20: dread - f3 zero size 2024-04-25T15:58:00.296 INFO:tasks.workunit.client.0.smithi087.stdout:8/11: fdatasync f1 0 2024-04-25T15:58:00.298 INFO:tasks.workunit.client.0.smithi087.stdout:0/64: fsync d1/da/d11/f19 0 2024-04-25T15:58:00.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/40: dread d6/d8/fc [0,4194304] 0 2024-04-25T15:58:00.304 INFO:tasks.workunit.client.0.smithi087.stdout:1/30: fsync d3/f6 0 2024-04-25T15:58:00.304 INFO:tasks.workunit.client.0.smithi087.stdout:0/65: chown d1/c12 14110 1 2024-04-25T15:58:00.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/41: chown l4 0 1 2024-04-25T15:58:00.307 INFO:tasks.workunit.client.0.smithi087.stdout:4/21: dwrite d4/f6 [0,4194304] 0 2024-04-25T15:58:00.309 INFO:tasks.workunit.client.0.smithi087.stdout:7/14: creat d1/f5 x:0 0 0 2024-04-25T15:58:00.311 INFO:tasks.workunit.client.0.smithi087.stdout:4/22: read f1 [644255,20995] 0 2024-04-25T15:58:00.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/46: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:00.314 INFO:tasks.workunit.client.0.smithi087.stdout:0/66: readlink d1/d6/l17 0 2024-04-25T15:58:00.318 INFO:tasks.workunit.client.0.smithi087.stdout:4/23: mkdir d4/d7 0 2024-04-25T15:58:00.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/12: link f1 f2 0 2024-04-25T15:58:00.322 INFO:tasks.workunit.client.0.smithi087.stdout:5/21: link c4 c6 0 2024-04-25T15:58:00.322 INFO:tasks.workunit.client.0.smithi087.stdout:5/22: rmdir - no directory 2024-04-25T15:58:00.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/31: write d3/f7 [151176,94590] 0 2024-04-25T15:58:00.325 INFO:tasks.workunit.client.0.smithi087.stdout:9/42: rename d6/d8/le to d6/d8/lf 0 2024-04-25T15:58:00.326 INFO:tasks.workunit.client.0.smithi087.stdout:7/15: dwrite f0 [4194304,4194304] 0 2024-04-25T15:58:00.327 INFO:tasks.workunit.client.0.smithi087.stdout:6/27: dwrite d7/f8 [0,4194304] 0 2024-04-25T15:58:00.330 INFO:tasks.workunit.client.0.smithi087.stdout:1/32: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:00.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/67: rename d1/d6/cc to d1/d6/d1b/c1d 0 2024-04-25T15:58:00.338 INFO:tasks.workunit.client.0.smithi087.stdout:2/47: truncate d3/f7 970251 0 2024-04-25T15:58:00.338 INFO:tasks.workunit.client.0.smithi087.stdout:1/33: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:00.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/68: rmdir d1/d6/d1b 39 2024-04-25T15:58:00.340 INFO:tasks.workunit.client.0.smithi087.stdout:6/28: unlink d7/fa 0 2024-04-25T15:58:00.341 INFO:tasks.workunit.client.0.smithi087.stdout:5/23: creat f7 x:0 0 0 2024-04-25T15:58:00.341 INFO:tasks.workunit.client.0.smithi087.stdout:2/48: creat d3/fd x:0 0 0 2024-04-25T15:58:00.343 INFO:tasks.workunit.client.0.smithi087.stdout:4/24: rename c3 to d4/d7/c8 0 2024-04-25T15:58:00.343 INFO:tasks.workunit.client.0.smithi087.stdout:2/49: write d3/fd [473471,57752] 0 2024-04-25T15:58:00.343 INFO:tasks.workunit.client.0.smithi087.stdout:8/13: rename f2 to f3 0 2024-04-25T15:58:00.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/43: creat d6/f10 x:0 0 0 2024-04-25T15:58:00.346 INFO:tasks.workunit.client.0.smithi087.stdout:5/24: truncate f2 2170363 0 2024-04-25T15:58:00.349 INFO:tasks.workunit.client.0.smithi087.stdout:4/25: mkdir d4/d9 0 2024-04-25T15:58:00.354 INFO:tasks.workunit.client.0.smithi087.stdout:7/16: dread f0 [0,4194304] 0 2024-04-25T15:58:00.360 INFO:tasks.workunit.client.0.smithi087.stdout:1/34: dread d3/f5 [0,4194304] 0 2024-04-25T15:58:00.362 INFO:tasks.workunit.client.0.smithi087.stdout:6/29: creat d7/fc x:0 0 0 2024-04-25T15:58:00.363 INFO:tasks.workunit.client.0.smithi087.stdout:8/14: mkdir d4 0 2024-04-25T15:58:00.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/30: truncate d7/f8 4253729 0 2024-04-25T15:58:00.364 INFO:tasks.workunit.client.0.smithi087.stdout:2/50: mknod d3/ce 0 2024-04-25T15:58:00.364 INFO:tasks.workunit.client.0.smithi087.stdout:9/44: symlink d6/l11 0 2024-04-25T15:58:00.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/26: rmdir d4/d7 39 2024-04-25T15:58:00.365 INFO:tasks.workunit.client.0.smithi087.stdout:9/45: write d6/f10 [486051,56329] 0 2024-04-25T15:58:00.366 INFO:tasks.workunit.client.0.smithi087.stdout:4/27: chown f1 53940117 1 2024-04-25T15:58:00.367 INFO:tasks.workunit.client.0.smithi087.stdout:1/35: unlink d3/fa 0 2024-04-25T15:58:00.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/69: rename d1/d6/l17 to d1/da/l1e 0 2024-04-25T15:58:00.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/25: mknod c8 0 2024-04-25T15:58:00.371 INFO:tasks.workunit.client.0.smithi087.stdout:9/46: dread d6/f10 [0,4194304] 0 2024-04-25T15:58:00.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/28: dread d4/f5 [0,4194304] 0 2024-04-25T15:58:00.373 INFO:tasks.workunit.client.0.smithi087.stdout:1/36: truncate d3/f6 149725 0 2024-04-25T15:58:00.376 INFO:tasks.workunit.client.0.smithi087.stdout:4/29: fsync d4/f6 0 2024-04-25T15:58:00.378 INFO:tasks.workunit.client.0.smithi087.stdout:8/15: getdents d4 0 2024-04-25T15:58:00.378 INFO:tasks.workunit.client.0.smithi087.stdout:6/31: symlink d7/ld 0 2024-04-25T15:58:00.379 INFO:tasks.workunit.client.0.smithi087.stdout:0/70: dread d1/d6/fe [0,4194304] 0 2024-04-25T15:58:00.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/30: write f0 [1673997,97683] 0 2024-04-25T15:58:00.380 INFO:tasks.workunit.client.0.smithi087.stdout:2/51: mknod d3/cf 0 2024-04-25T15:58:00.381 INFO:tasks.workunit.client.0.smithi087.stdout:7/17: dwrite f0 [0,4194304] 0 2024-04-25T15:58:00.382 INFO:tasks.workunit.client.0.smithi087.stdout:5/26: fdatasync f0 0 2024-04-25T15:58:00.383 INFO:tasks.workunit.client.0.smithi087.stdout:4/31: chown d4/f6 149176 1 2024-04-25T15:58:00.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/37: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:00.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/32: fsync d4/f5 0 2024-04-25T15:58:00.392 INFO:tasks.workunit.client.0.smithi087.stdout:8/16: mknod d4/c5 0 2024-04-25T15:58:00.394 INFO:tasks.workunit.client.0.smithi087.stdout:5/27: mkdir d9 0 2024-04-25T15:58:00.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/33: chown d4/f6 6212 1 2024-04-25T15:58:00.395 INFO:tasks.workunit.client.0.smithi087.stdout:9/47: dwrite d6/f10 [0,4194304] 0 2024-04-25T15:58:00.396 INFO:tasks.workunit.client.0.smithi087.stdout:8/17: mkdir d4/d6 0 2024-04-25T15:58:00.402 INFO:tasks.workunit.client.0.smithi087.stdout:7/18: dread f0 [4194304,4194304] 0 2024-04-25T15:58:00.406 INFO:tasks.workunit.client.0.smithi087.stdout:9/48: chown d6/d8/lb 2 1 2024-04-25T15:58:00.406 INFO:tasks.workunit.client.0.smithi087.stdout:2/52: getdents d3 0 2024-04-25T15:58:00.408 INFO:tasks.workunit.client.0.smithi087.stdout:4/34: symlink d4/d7/la 0 2024-04-25T15:58:00.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/53: chown d3/l9 38605386 1 2024-04-25T15:58:00.409 INFO:tasks.workunit.client.0.smithi087.stdout:0/71: unlink d1/da/d11/f16 0 2024-04-25T15:58:00.411 INFO:tasks.workunit.client.0.smithi087.stdout:7/19: symlink d1/d4/l6 0 2024-04-25T15:58:00.414 INFO:tasks.workunit.client.0.smithi087.stdout:9/49: unlink d6/d8/lf 0 2024-04-25T15:58:00.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/18: dread f1 [0,4194304] 0 2024-04-25T15:58:00.415 INFO:tasks.workunit.client.0.smithi087.stdout:9/50: stat f2 0 2024-04-25T15:58:00.419 INFO:tasks.workunit.client.0.smithi087.stdout:6/32: dread f0 [0,4194304] 0 2024-04-25T15:58:00.420 INFO:tasks.workunit.client.0.smithi087.stdout:9/51: rmdir d6/d8 39 2024-04-25T15:58:00.421 INFO:tasks.workunit.client.0.smithi087.stdout:6/33: fdatasync d7/f8 0 2024-04-25T15:58:00.421 INFO:tasks.workunit.client.0.smithi087.stdout:4/35: creat d4/fb x:0 0 0 2024-04-25T15:58:00.423 INFO:tasks.workunit.client.0.smithi087.stdout:1/38: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:00.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/28: dread f0 [4194304,4194304] 0 2024-04-25T15:58:00.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/20: dread f0 [4194304,4194304] 0 2024-04-25T15:58:00.426 INFO:tasks.workunit.client.0.smithi087.stdout:8/19: rmdir d4/d6 0 2024-04-25T15:58:00.427 INFO:tasks.workunit.client.0.smithi087.stdout:2/54: truncate d3/f7 53640 0 2024-04-25T15:58:00.429 INFO:tasks.workunit.client.0.smithi087.stdout:9/52: truncate d6/d8/fc 3439371 0 2024-04-25T15:58:00.431 INFO:tasks.workunit.client.0.smithi087.stdout:6/34: mknod d7/ce 0 2024-04-25T15:58:00.431 INFO:tasks.workunit.client.0.smithi087.stdout:7/21: write f0 [1178304,25761] 0 2024-04-25T15:58:00.432 INFO:tasks.workunit.client.0.smithi087.stdout:4/36: creat d4/d9/fc x:0 0 0 2024-04-25T15:58:00.436 INFO:tasks.workunit.client.0.smithi087.stdout:7/22: truncate d1/f5 192264 0 2024-04-25T15:58:00.439 INFO:tasks.workunit.client.0.smithi087.stdout:0/72: dwrite d1/f14 [0,4194304] 0 2024-04-25T15:58:00.442 INFO:tasks.workunit.client.0.smithi087.stdout:8/20: write f1 [4558895,22654] 0 2024-04-25T15:58:00.443 INFO:tasks.workunit.client.0.smithi087.stdout:2/55: link d3/l9 d3/l10 0 2024-04-25T15:58:00.447 INFO:tasks.workunit.client.0.smithi087.stdout:0/73: dread d1/f14 [0,4194304] 0 2024-04-25T15:58:00.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/39: write d3/f9 [1635684,34848] 0 2024-04-25T15:58:00.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/23: symlink d1/l7 0 2024-04-25T15:58:00.452 INFO:tasks.workunit.client.0.smithi087.stdout:4/37: getdents d4 0 2024-04-25T15:58:00.455 INFO:tasks.workunit.client.0.smithi087.stdout:9/53: write d6/d8/fa [506498,44530] 0 2024-04-25T15:58:00.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/40: truncate d3/f4 2682737 0 2024-04-25T15:58:00.457 INFO:tasks.workunit.client.0.smithi087.stdout:6/35: write d7/f9 [786712,93851] 0 2024-04-25T15:58:00.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/54: readlink d6/d8/lb 0 2024-04-25T15:58:00.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/21: dwrite f1 [8388608,4194304] 0 2024-04-25T15:58:00.460 INFO:tasks.workunit.client.0.smithi087.stdout:1/41: write d3/f9 [3257597,87128] 0 2024-04-25T15:58:00.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/22: write f1 [2989411,24639] 0 2024-04-25T15:58:00.467 INFO:tasks.workunit.client.0.smithi087.stdout:4/38: rename d4/d7/c8 to d4/cd 0 2024-04-25T15:58:00.469 INFO:tasks.workunit.client.0.smithi087.stdout:9/55: dwrite f2 [0,4194304] 0 2024-04-25T15:58:00.471 INFO:tasks.workunit.client.0.smithi087.stdout:7/24: creat d1/f8 x:0 0 0 2024-04-25T15:58:00.473 INFO:tasks.workunit.client.0.smithi087.stdout:8/23: symlink d4/l7 0 2024-04-25T15:58:00.473 INFO:tasks.workunit.client.0.smithi087.stdout:1/42: fsync d3/f8 0 2024-04-25T15:58:00.473 INFO:tasks.workunit.client.0.smithi087.stdout:0/74: rmdir d1/d6/d1b/d1c 0 2024-04-25T15:58:00.474 INFO:tasks.workunit.client.0.smithi087.stdout:0/75: fdatasync d1/d6/f1a 0 2024-04-25T15:58:00.475 INFO:tasks.workunit.client.0.smithi087.stdout:8/24: write f3 [9948359,39922] 0 2024-04-25T15:58:00.478 INFO:tasks.workunit.client.0.smithi087.stdout:6/36: creat d7/ff x:0 0 0 2024-04-25T15:58:00.480 INFO:tasks.workunit.client.0.smithi087.stdout:0/76: chown d1/da/d11/f19 352078375 1 2024-04-25T15:58:00.480 INFO:tasks.workunit.client.0.smithi087.stdout:9/56: mkdir d6/d8/d12 0 2024-04-25T15:58:00.482 INFO:tasks.workunit.client.0.smithi087.stdout:6/37: fsync d7/f8 0 2024-04-25T15:58:00.487 INFO:tasks.workunit.client.0.smithi087.stdout:2/56: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:00.489 INFO:tasks.workunit.client.0.smithi087.stdout:0/77: unlink d1/f2 0 2024-04-25T15:58:00.490 INFO:tasks.workunit.client.0.smithi087.stdout:6/38: truncate d7/ff 996654 0 2024-04-25T15:58:00.493 INFO:tasks.workunit.client.0.smithi087.stdout:7/25: dwrite f0 [8388608,4194304] 0 2024-04-25T15:58:00.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/26: dread - d1/f8 zero size 2024-04-25T15:58:00.495 INFO:tasks.workunit.client.0.smithi087.stdout:1/43: dread d3/f8 [0,4194304] 0 2024-04-25T15:58:00.498 INFO:tasks.workunit.client.0.smithi087.stdout:9/57: link d6/l11 d6/d8/l13 0 2024-04-25T15:58:00.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/27: fsync d1/f8 0 2024-04-25T15:58:00.499 INFO:tasks.workunit.client.0.smithi087.stdout:7/28: fdatasync d1/f8 0 2024-04-25T15:58:00.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/29: stat d1/d4/l6 0 2024-04-25T15:58:00.502 INFO:tasks.workunit.client.0.smithi087.stdout:2/57: unlink d3/l9 0 2024-04-25T15:58:00.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/44: unlink d3/lb 0 2024-04-25T15:58:00.504 INFO:tasks.workunit.client.0.smithi087.stdout:0/78: chown d1/f5 867892 1 2024-04-25T15:58:00.504 INFO:tasks.workunit.client.0.smithi087.stdout:1/45: write d3/f7 [1278657,15001] 0 2024-04-25T15:58:00.508 INFO:tasks.workunit.client.0.smithi087.stdout:8/25: truncate f3 8372762 0 2024-04-25T15:58:00.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/79: dread - d1/da/f10 zero size 2024-04-25T15:58:00.513 INFO:tasks.workunit.client.0.smithi087.stdout:9/58: mkdir d6/d8/d14 0 2024-04-25T15:58:00.514 INFO:tasks.workunit.client.0.smithi087.stdout:9/59: read - f3 zero size 2024-04-25T15:58:00.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/30: mkdir d1/d9 0 2024-04-25T15:58:00.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/31: truncate f0 13086352 0 2024-04-25T15:58:00.518 INFO:tasks.workunit.client.0.smithi087.stdout:8/26: write f3 [2267863,32692] 0 2024-04-25T15:58:00.518 INFO:tasks.workunit.client.0.smithi087.stdout:8/27: chown f1 135138 1 2024-04-25T15:58:00.519 INFO:tasks.workunit.client.0.smithi087.stdout:8/28: read f1 [4174751,12929] 0 2024-04-25T15:58:00.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/60: truncate f3 630903 0 2024-04-25T15:58:00.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/58: mkdir d3/d11 0 2024-04-25T15:58:00.524 INFO:tasks.workunit.client.0.smithi087.stdout:8/29: write f1 [5956757,63253] 0 2024-04-25T15:58:00.524 INFO:tasks.workunit.client.0.smithi087.stdout:6/39: link f0 d7/f10 0 2024-04-25T15:58:00.529 INFO:tasks.workunit.client.0.smithi087.stdout:7/32: symlink d1/la 0 2024-04-25T15:58:00.530 INFO:tasks.workunit.client.0.smithi087.stdout:4/39: getdents d4/d9 0 2024-04-25T15:58:00.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/30: mkdir d4/d8 0 2024-04-25T15:58:00.536 INFO:tasks.workunit.client.0.smithi087.stdout:1/46: dwrite d3/f6 [0,4194304] 0 2024-04-25T15:58:00.537 INFO:tasks.ceph.mds.d.smithi155.stderr:2024-04-25T15:58:00.535+0000 7fdf7a4a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:58:00.538 INFO:tasks.workunit.client.0.smithi087.stdout:8/31: mkdir d4/d9 0 2024-04-25T15:58:00.543 INFO:tasks.workunit.client.0.smithi087.stdout:0/80: mkdir d1/d6/d1f 0 2024-04-25T15:58:00.543 INFO:tasks.workunit.client.0.smithi087.stdout:7/33: dwrite f0 [0,4194304] 0 2024-04-25T15:58:00.545 INFO:tasks.workunit.client.0.smithi087.stdout:6/40: link d7/ld d7/l11 0 2024-04-25T15:58:00.550 INFO:tasks.workunit.client.0.smithi087.stdout:8/32: fdatasync f3 0 2024-04-25T15:58:00.550 INFO:tasks.workunit.client.0.smithi087.stdout:1/47: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:00.551 INFO:tasks.workunit.client.0.smithi087.stdout:7/34: mknod d1/d4/cb 0 2024-04-25T15:58:00.552 INFO:tasks.workunit.client.0.smithi087.stdout:4/40: dread d4/f6 [0,4194304] 0 2024-04-25T15:58:00.552 INFO:tasks.workunit.client.0.smithi087.stdout:7/35: readlink d1/l2 0 2024-04-25T15:58:00.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/61: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:00.555 INFO:tasks.workunit.client.0.smithi087.stdout:2/59: truncate d3/f7 2740240 0 2024-04-25T15:58:00.565 INFO:tasks.workunit.client.0.smithi087.stdout:8/33: creat d4/fa x:0 0 0 2024-04-25T15:58:00.565 INFO:tasks.workunit.client.0.smithi087.stdout:7/36: rename d1/l7 to d1/d9/lc 0 2024-04-25T15:58:00.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/48: mknod d3/cc 0 2024-04-25T15:58:00.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/49: write d3/f8 [4905097,53296] 0 2024-04-25T15:58:00.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/62: symlink d6/d8/d14/l15 0 2024-04-25T15:58:00.567 INFO:tasks.workunit.client.0.smithi087.stdout:2/60: mknod d3/d11/c12 0 2024-04-25T15:58:00.567 INFO:tasks.workunit.client.0.smithi087.stdout:6/41: write d7/f10 [3719718,78368] 0 2024-04-25T15:58:00.569 INFO:tasks.workunit.client.0.smithi087.stdout:8/34: creat d4/d8/fb x:0 0 0 2024-04-25T15:58:00.569 INFO:tasks.workunit.client.0.smithi087.stdout:9/63: rmdir d6/d8 39 2024-04-25T15:58:00.572 INFO:tasks.workunit.client.0.smithi087.stdout:2/61: unlink d3/d11/c12 0 2024-04-25T15:58:00.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.571+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba4c0c9b30 con 0x7fba4c0c9100 2024-04-25T15:58:00.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.571+0000 7fba48ff9640 1 -- 172.21.15.87:0/487064148 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5667 (secure 0 0 0) 0x7fba3405ffb0 con 0x7fba4c0c9100 2024-04-25T15:58:00.576 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:00.576 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:58:00.577 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 35 2024-04-25T15:58:00.577 INFO:tasks.workunit.client.0.smithi087.stdout:4/41: dwrite f0 [0,4194304] 0 2024-04-25T15:58:00.578 INFO:tasks.workunit.client.0.smithi087.stdout:2/62: fdatasync d3/fd 0 2024-04-25T15:58:00.578 INFO:tasks.workunit.client.0.smithi087.stdout:6/42: creat d7/f12 x:0 0 0 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba2c06f400 msgr2=0x7fba2c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba2c06f400 0x7fba2c071910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0ad000 tx=0x7fba3c008040 comp rx=0 tx=0).stop 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 msgr2=0x7fba4c14e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 0x7fba4c14e9c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fba3400e8a0 tx=0x7fba3400eca0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 shutdown_connections 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba2c06f400 0x7fba2c071910 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fba3c0ad000 tx=0x7fba3c008040 comp rx=0 tx=0).stop 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c157530 0x7fba4c14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba4c0c9100 0x7fba4c14e9c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 --2- 172.21.15.87:0/487064148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba4c0746a0 0x7fba4c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 >> 172.21.15.87:0/487064148 conn(0x7fba4c0ac550 msgr2=0x7fba4c154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:00.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 shutdown_connections 2024-04-25T15:58:00.581 INFO:tasks.workunit.client.0.smithi087.stdout:1/50: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:00.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:00.575+0000 7fba51db6640 1 -- 172.21.15.87:0/487064148 wait complete. 2024-04-25T15:58:00.581 INFO:tasks.workunit.client.0.smithi087.stdout:8/35: write d4/d8/fb [776013,44625] 0 2024-04-25T15:58:00.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/36: stat d4 0 2024-04-25T15:58:00.585 INFO:tasks.workunit.client.0.smithi087.stdout:9/64: symlink d6/d8/d14/l16 0 2024-04-25T15:58:00.586 INFO:tasks.workunit.client.0.smithi087.stdout:0/81: dwrite d1/f5 [0,4194304] 0 2024-04-25T15:58:00.587 INFO:tasks.workunit.client.0.smithi087.stdout:9/65: chown d6 115262492 1 2024-04-25T15:58:00.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/51: read d3/f9 [1110142,105653] 0 2024-04-25T15:58:00.593 INFO:tasks.workunit.client.0.smithi087.stdout:7/37: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:58:00.593 INFO:tasks.workunit.client.0.smithi087.stdout:9/66: readlink d6/d8/d14/l16 0 2024-04-25T15:58:00.596 INFO:tasks.workunit.client.0.smithi087.stdout:7/38: write d1/f8 [2486673,17343] 0 2024-04-25T15:58:00.597 INFO:tasks.workunit.client.0.smithi087.stdout:8/37: symlink d4/d9/lc 0 2024-04-25T15:58:00.597 INFO:tasks.workunit.client.0.smithi087.stdout:6/43: dread d7/f9 [0,4194304] 0 2024-04-25T15:58:00.597 INFO:tasks.workunit.client.0.smithi087.stdout:0/82: creat d1/d6/d1b/f20 x:0 0 0 2024-04-25T15:58:00.601 INFO:tasks.workunit.client.0.smithi087.stdout:1/52: fdatasync d3/f7 0 2024-04-25T15:58:00.604 INFO:tasks.workunit.client.0.smithi087.stdout:4/42: dread f0 [0,4194304] 0 2024-04-25T15:58:00.604 INFO:tasks.workunit.client.0.smithi087.stdout:0/83: write d1/d6/d1b/f20 [711662,101897] 0 2024-04-25T15:58:00.606 INFO:tasks.workunit.client.0.smithi087.stdout:2/63: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:00.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/53: fdatasync d3/f4 0 2024-04-25T15:58:00.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/67: getdents d6 0 2024-04-25T15:58:00.612 INFO:tasks.workunit.client.0.smithi087.stdout:4/43: dread - d4/fb zero size 2024-04-25T15:58:00.612 INFO:tasks.workunit.client.0.smithi087.stdout:8/38: dread f3 [0,4194304] 0 2024-04-25T15:58:00.612 INFO:tasks.workunit.client.0.smithi087.stdout:9/68: read d6/d8/fc [719120,44030] 0 2024-04-25T15:58:00.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/39: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:00.615 INFO:tasks.workunit.client.0.smithi087.stdout:2/64: creat d3/d11/f13 x:0 0 0 2024-04-25T15:58:00.617 INFO:tasks.mds_thrash.fs.[a]:mds.d has gained rank=0, replacing gid=5331 2024-04-25T15:58:00.617 INFO:tasks.mds_thrash.fs.[a]:waiting for 7 secs before reviving mds.a 2024-04-25T15:58:00.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/54: unlink d3/f5 0 2024-04-25T15:58:00.620 INFO:tasks.workunit.client.0.smithi087.stdout:8/39: mkdir d4/d8/dd 0 2024-04-25T15:58:00.622 INFO:tasks.workunit.client.0.smithi087.stdout:2/65: chown d3/lb 888358 1 2024-04-25T15:58:00.622 INFO:tasks.workunit.client.0.smithi087.stdout:9/69: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:00.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/55: mknod d3/cd 0 2024-04-25T15:58:00.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/40: getdents d1 0 2024-04-25T15:58:00.631 INFO:tasks.workunit.client.0.smithi087.stdout:2/66: link d3/d11/f13 d3/d11/f14 0 2024-04-25T15:58:00.633 INFO:tasks.workunit.client.0.smithi087.stdout:9/70: creat d6/d8/f17 x:0 0 0 2024-04-25T15:58:00.637 INFO:tasks.workunit.client.0.smithi087.stdout:4/44: dwrite f0 [4194304,4194304] 0 2024-04-25T15:58:00.639 INFO:tasks.workunit.client.0.smithi087.stdout:7/41: write d1/f8 [4696530,121796] 0 2024-04-25T15:58:00.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/67: symlink d3/d11/l15 0 2024-04-25T15:58:00.642 INFO:tasks.workunit.client.0.smithi087.stdout:8/40: dwrite f1 [4194304,4194304] 0 2024-04-25T15:58:00.645 INFO:tasks.workunit.client.0.smithi087.stdout:0/84: dwrite d1/da/f10 [0,4194304] 0 2024-04-25T15:58:00.645 INFO:tasks.workunit.client.0.smithi087.stdout:4/45: read f1 [1580244,110869] 0 2024-04-25T15:58:00.646 INFO:tasks.workunit.client.0.smithi087.stdout:8/41: dread - d4/fa zero size 2024-04-25T15:58:00.646 INFO:tasks.workunit.client.0.smithi087.stdout:7/42: creat d1/fd x:0 0 0 2024-04-25T15:58:00.647 INFO:tasks.workunit.client.0.smithi087.stdout:1/56: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:00.647 INFO:tasks.workunit.client.0.smithi087.stdout:9/71: dread d6/d8/fa [0,4194304] 0 2024-04-25T15:58:00.649 INFO:tasks.workunit.client.0.smithi087.stdout:9/72: stat d6/f10 0 2024-04-25T15:58:00.651 INFO:tasks.workunit.client.0.smithi087.stdout:4/46: write d4/f5 [579017,64960] 0 2024-04-25T15:58:00.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/73: write d6/d8/fc [280279,24615] 0 2024-04-25T15:58:00.655 INFO:tasks.workunit.client.0.smithi087.stdout:4/47: creat d4/d9/fe x:0 0 0 2024-04-25T15:58:00.655 INFO:tasks.workunit.client.0.smithi087.stdout:8/42: dread d4/d8/fb [0,4194304] 0 2024-04-25T15:58:00.661 INFO:tasks.workunit.client.0.smithi087.stdout:4/48: truncate d4/f6 1859489 0 2024-04-25T15:58:00.665 INFO:tasks.workunit.client.0.smithi087.stdout:1/57: write d3/f9 [2515175,59476] 0 2024-04-25T15:58:00.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/49: rmdir d4/d9 39 2024-04-25T15:58:00.666 INFO:tasks.workunit.client.0.smithi087.stdout:7/43: symlink d1/d9/le 0 2024-04-25T15:58:00.670 INFO:tasks.workunit.client.0.smithi087.stdout:1/58: chown d3/f7 2996354 1 2024-04-25T15:58:00.670 INFO:tasks.workunit.client.0.smithi087.stdout:9/74: dwrite f0 [0,4194304] 0 2024-04-25T15:58:00.676 INFO:tasks.workunit.client.0.smithi087.stdout:8/43: dwrite d4/d8/fb [0,4194304] 0 2024-04-25T15:58:00.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/68: dwrite d3/d11/f13 [0,4194304] 0 2024-04-25T15:58:00.677 INFO:tasks.workunit.client.0.smithi087.stdout:4/50: unlink d4/f5 0 2024-04-25T15:58:00.677 INFO:tasks.workunit.client.0.smithi087.stdout:7/44: symlink d1/d4/lf 0 2024-04-25T15:58:00.680 INFO:tasks.workunit.client.0.smithi087.stdout:4/51: read d4/f6 [1598182,126129] 0 2024-04-25T15:58:00.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/44: rename d4/d9/lc to d4/d8/le 0 2024-04-25T15:58:00.683 INFO:tasks.workunit.client.0.smithi087.stdout:8/45: write d4/fa [319527,10586] 0 2024-04-25T15:58:00.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/69: symlink d3/l16 0 2024-04-25T15:58:00.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/59: getdents d3 0 2024-04-25T15:58:00.690 INFO:tasks.workunit.client.0.smithi087.stdout:9/75: link d6/l11 d6/d8/d14/l18 0 2024-04-25T15:58:00.696 INFO:tasks.workunit.client.0.smithi087.stdout:7/45: dwrite d1/f5 [0,4194304] 0 2024-04-25T15:58:00.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/52: dwrite f0 [8388608,4194304] 0 2024-04-25T15:58:00.698 INFO:tasks.workunit.client.0.smithi087.stdout:9/76: chown d6/d8/d14/l18 655 1 2024-04-25T15:58:00.703 INFO:tasks.workunit.client.0.smithi087.stdout:2/70: dwrite d3/d11/f13 [0,4194304] 0 2024-04-25T15:58:00.704 INFO:tasks.workunit.client.0.smithi087.stdout:4/53: chown d4/d9/fe 25750 1 2024-04-25T15:58:00.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/54: read - d4/fb zero size 2024-04-25T15:58:00.711 INFO:tasks.workunit.client.0.smithi087.stdout:7/46: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:00.712 INFO:tasks.workunit.client.0.smithi087.stdout:8/46: truncate d4/fa 36298 0 2024-04-25T15:58:00.713 INFO:tasks.workunit.client.0.smithi087.stdout:4/55: creat d4/d9/ff x:0 0 0 2024-04-25T15:58:00.713 INFO:tasks.workunit.client.0.smithi087.stdout:9/77: dwrite d6/d8/fc [4194304,4194304] 0 2024-04-25T15:58:00.714 INFO:tasks.workunit.client.0.smithi087.stdout:1/60: truncate d3/f6 873426 0 2024-04-25T15:58:00.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/47: rmdir d4/d8 39 2024-04-25T15:58:00.719 INFO:tasks.workunit.client.0.smithi087.stdout:8/48: mkdir d4/d9/df 0 2024-04-25T15:58:00.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/61: symlink d3/le 0 2024-04-25T15:58:00.720 INFO:tasks.workunit.client.0.smithi087.stdout:8/49: chown d4/d9/df 672363 1 2024-04-25T15:58:00.722 INFO:tasks.workunit.client.0.smithi087.stdout:2/71: fdatasync d3/d11/f14 0 2024-04-25T15:58:00.722 INFO:tasks.workunit.client.0.smithi087.stdout:4/56: fsync f0 0 2024-04-25T15:58:00.722 INFO:tasks.workunit.client.0.smithi087.stdout:7/47: dwrite f0 [12582912,4194304] 0 2024-04-25T15:58:00.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/50: rmdir d4/d8 39 2024-04-25T15:58:00.726 INFO:tasks.workunit.client.0.smithi087.stdout:2/72: unlink f2 0 2024-04-25T15:58:00.726 INFO:tasks.workunit.client.0.smithi087.stdout:9/78: dread d6/d8/fc [4194304,4194304] 0 2024-04-25T15:58:00.727 INFO:tasks.workunit.client.0.smithi087.stdout:4/57: chown d4/d7 28621695 1 2024-04-25T15:58:00.728 INFO:tasks.workunit.client.0.smithi087.stdout:7/48: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:00.730 INFO:tasks.workunit.client.0.smithi087.stdout:8/51: unlink f3 0 2024-04-25T15:58:00.733 INFO:tasks.workunit.client.0.smithi087.stdout:9/79: symlink d6/l19 0 2024-04-25T15:58:00.736 INFO:tasks.workunit.client.0.smithi087.stdout:7/49: readlink d1/d9/lc 0 2024-04-25T15:58:00.738 INFO:tasks.workunit.client.0.smithi087.stdout:2/73: mknod d3/c17 0 2024-04-25T15:58:00.739 INFO:tasks.workunit.client.0.smithi087.stdout:7/50: dread f0 [4194304,4194304] 0 2024-04-25T15:58:00.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/58: mkdir d4/d10 0 2024-04-25T15:58:00.741 INFO:tasks.workunit.client.0.smithi087.stdout:9/80: dread f3 [0,4194304] 0 2024-04-25T15:58:00.743 INFO:tasks.workunit.client.0.smithi087.stdout:9/81: dread d6/d8/fa [0,4194304] 0 2024-04-25T15:58:00.743 INFO:tasks.workunit.client.0.smithi087.stdout:7/51: creat d1/d4/f10 x:0 0 0 2024-04-25T15:58:00.745 INFO:tasks.workunit.client.0.smithi087.stdout:4/59: creat d4/d7/f11 x:0 0 0 2024-04-25T15:58:00.745 INFO:tasks.workunit.client.0.smithi087.stdout:1/62: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:00.746 INFO:tasks.workunit.client.0.smithi087.stdout:8/52: mknod d4/d8/dd/c10 0 2024-04-25T15:58:00.746 INFO:tasks.workunit.client.0.smithi087.stdout:4/60: dread - d4/d9/fc zero size 2024-04-25T15:58:00.746 INFO:tasks.workunit.client.0.smithi087.stdout:2/74: mknod d3/c18 0 2024-04-25T15:58:00.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/61: readlink d4/d7/la 0 2024-04-25T15:58:00.749 INFO:tasks.workunit.client.0.smithi087.stdout:7/52: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:00.751 INFO:tasks.workunit.client.0.smithi087.stdout:9/82: rename d6/d8/l13 to d6/d8/d14/l1a 0 2024-04-25T15:58:00.752 INFO:tasks.workunit.client.0.smithi087.stdout:4/62: mkdir d4/d9/d12 0 2024-04-25T15:58:00.753 INFO:tasks.workunit.client.0.smithi087.stdout:2/75: symlink d3/l19 0 2024-04-25T15:58:00.754 INFO:tasks.workunit.client.0.smithi087.stdout:8/53: dread f1 [0,4194304] 0 2024-04-25T15:58:00.754 INFO:tasks.workunit.client.0.smithi087.stdout:7/53: mknod d1/d4/c11 0 2024-04-25T15:58:00.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/83: rmdir d6/d8 39 2024-04-25T15:58:00.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/63: dread d3/f9 [0,4194304] 0 2024-04-25T15:58:00.755 INFO:tasks.workunit.client.0.smithi087.stdout:4/63: rmdir d4 39 2024-04-25T15:58:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:8/54: creat d4/d8/dd/f11 x:0 0 0 2024-04-25T15:58:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/84: dread f3 [0,4194304] 0 2024-04-25T15:58:00.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/54: creat d1/d4/f12 x:0 0 0 2024-04-25T15:58:00.757 INFO:tasks.workunit.client.0.smithi087.stdout:1/64: chown d3/f7 46580640 1 2024-04-25T15:58:00.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/55: dread - d1/fd zero size 2024-04-25T15:58:00.759 INFO:tasks.workunit.client.0.smithi087.stdout:2/76: rename d3/lb to d3/d11/l1a 0 2024-04-25T15:58:00.761 INFO:tasks.workunit.client.0.smithi087.stdout:7/56: creat d1/d4/f13 x:0 0 0 2024-04-25T15:58:00.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/77: stat d3/l10 0 2024-04-25T15:58:00.763 INFO:tasks.workunit.client.0.smithi087.stdout:9/85: mknod d6/d8/d14/c1b 0 2024-04-25T15:58:00.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/78: truncate d3/f7 2078991 0 2024-04-25T15:58:00.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/65: truncate d3/f6 1635361 0 2024-04-25T15:58:00.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/79: creat d3/d11/f1b x:0 0 0 2024-04-25T15:58:00.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/64: write f1 [709941,81521] 0 2024-04-25T15:58:00.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/86: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:00.772 INFO:tasks.workunit.client.0.smithi087.stdout:1/66: getdents d3 0 2024-04-25T15:58:00.772 INFO:tasks.workunit.client.0.smithi087.stdout:7/57: fsync d1/d4/f13 0 2024-04-25T15:58:00.774 INFO:tasks.workunit.client.0.smithi087.stdout:9/87: chown d6/l19 184 1 2024-04-25T15:58:00.774 INFO:tasks.workunit.client.0.smithi087.stdout:1/67: creat d3/ff x:0 0 0 2024-04-25T15:58:00.775 INFO:tasks.workunit.client.0.smithi087.stdout:7/58: write d1/d4/f12 [554795,130853] 0 2024-04-25T15:58:00.782 INFO:tasks.workunit.client.0.smithi087.stdout:9/88: creat d6/f1c x:0 0 0 2024-04-25T15:58:00.785 INFO:tasks.workunit.client.0.smithi087.stdout:2/80: dwrite d3/d11/f14 [0,4194304] 0 2024-04-25T15:58:00.785 INFO:tasks.workunit.client.0.smithi087.stdout:8/55: dwrite d4/fa [0,4194304] 0 2024-04-25T15:58:00.786 INFO:tasks.workunit.client.0.smithi087.stdout:1/68: read d3/f4 [2214013,35048] 0 2024-04-25T15:58:00.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/89: write d6/d8/fa [962300,19155] 0 2024-04-25T15:58:00.790 INFO:tasks.workunit.client.0.smithi087.stdout:9/90: read f0 [5084713,38968] 0 2024-04-25T15:58:00.790 INFO:tasks.workunit.client.0.smithi087.stdout:2/81: mkdir d3/d11/d1c 0 2024-04-25T15:58:00.791 INFO:tasks.workunit.client.0.smithi087.stdout:7/59: dwrite f0 [8388608,4194304] 0 2024-04-25T15:58:00.792 INFO:tasks.workunit.client.0.smithi087.stdout:7/60: dread - d1/fd zero size 2024-04-25T15:58:00.792 INFO:tasks.workunit.client.0.smithi087.stdout:1/69: write d3/f9 [1614676,74307] 0 2024-04-25T15:58:00.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/91: mkdir d6/d8/d14/d1d 0 2024-04-25T15:58:00.794 INFO:tasks.workunit.client.0.smithi087.stdout:1/70: fsync d3/ff 0 2024-04-25T15:58:00.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/92: write d6/d8/fa [431224,879] 0 2024-04-25T15:58:00.798 INFO:tasks.workunit.client.0.smithi087.stdout:7/61: rename d1/d4/lf to d1/d9/l14 0 2024-04-25T15:58:00.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/56: write f1 [5796779,85256] 0 2024-04-25T15:58:00.801 INFO:tasks.workunit.client.0.smithi087.stdout:1/71: symlink d3/l10 0 2024-04-25T15:58:00.803 INFO:tasks.workunit.client.0.smithi087.stdout:7/62: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:00.804 INFO:tasks.workunit.client.0.smithi087.stdout:7/63: readlink d1/d9/lc 0 2024-04-25T15:58:00.804 INFO:tasks.workunit.client.0.smithi087.stdout:7/64: fdatasync d1/fd 0 2024-04-25T15:58:00.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/72: dread d3/f6 [0,4194304] 0 2024-04-25T15:58:00.807 INFO:tasks.workunit.client.0.smithi087.stdout:1/73: read d3/f7 [4175446,81923] 0 2024-04-25T15:58:00.809 INFO:tasks.workunit.client.0.smithi087.stdout:7/65: dread f0 [12582912,4194304] 0 2024-04-25T15:58:00.810 INFO:tasks.workunit.client.0.smithi087.stdout:7/66: dread - d1/d4/f13 zero size 2024-04-25T15:58:00.814 INFO:tasks.workunit.client.0.smithi087.stdout:7/67: link d1/d4/l6 d1/d4/l15 0 2024-04-25T15:58:00.816 INFO:tasks.workunit.client.0.smithi087.stdout:1/74: dwrite d3/ff [0,4194304] 0 2024-04-25T15:58:00.816 INFO:tasks.workunit.client.0.smithi087.stdout:8/57: truncate f1 6190084 0 2024-04-25T15:58:00.818 INFO:tasks.workunit.client.0.smithi087.stdout:1/75: rmdir d3 39 2024-04-25T15:58:00.824 INFO:tasks.workunit.client.0.smithi087.stdout:8/58: dread d4/d8/fb [0,4194304] 0 2024-04-25T15:58:00.824 INFO:tasks.workunit.client.0.smithi087.stdout:1/76: rename d3/f6 to d3/f11 0 2024-04-25T15:58:00.825 INFO:tasks.workunit.client.0.smithi087.stdout:8/59: fsync d4/d8/dd/f11 0 2024-04-25T15:58:00.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/68: dwrite d1/d4/f10 [0,4194304] 0 2024-04-25T15:58:00.826 INFO:tasks.workunit.client.0.smithi087.stdout:8/60: read f1 [1951586,10328] 0 2024-04-25T15:58:00.830 INFO:tasks.workunit.client.0.smithi087.stdout:1/77: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:00.831 INFO:tasks.workunit.client.0.smithi087.stdout:8/61: rename d4/d8/dd/c10 to d4/d8/c12 0 2024-04-25T15:58:00.832 INFO:tasks.workunit.client.0.smithi087.stdout:7/69: mkdir d1/d16 0 2024-04-25T15:58:00.833 INFO:tasks.workunit.client.0.smithi087.stdout:8/62: symlink d4/d9/l13 0 2024-04-25T15:58:00.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/78: mkdir d3/d12 0 2024-04-25T15:58:00.834 INFO:tasks.workunit.client.0.smithi087.stdout:7/70: stat d1/d9/lc 0 2024-04-25T15:58:00.835 INFO:tasks.workunit.client.0.smithi087.stdout:8/63: mkdir d4/d9/df/d14 0 2024-04-25T15:58:00.835 INFO:tasks.workunit.client.0.smithi087.stdout:8/64: stat d4/d9/df 0 2024-04-25T15:58:00.836 INFO:tasks.workunit.client.0.smithi087.stdout:8/65: fsync d4/d8/dd/f11 0 2024-04-25T15:58:00.839 INFO:tasks.workunit.client.0.smithi087.stdout:8/66: creat d4/d9/f15 x:0 0 0 2024-04-25T15:58:00.842 INFO:tasks.workunit.client.0.smithi087.stdout:1/79: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:00.846 INFO:tasks.workunit.client.0.smithi087.stdout:7/71: dwrite d1/d4/f12 [0,4194304] 0 2024-04-25T15:58:00.847 INFO:tasks.workunit.client.0.smithi087.stdout:1/80: rename d3/l10 to d3/d12/l13 0 2024-04-25T15:58:00.852 INFO:tasks.workunit.client.0.smithi087.stdout:1/81: write d3/f9 [3613051,94887] 0 2024-04-25T15:58:00.852 INFO:tasks.workunit.client.0.smithi087.stdout:8/67: dwrite d4/d8/dd/f11 [0,4194304] 0 2024-04-25T15:58:00.852 INFO:tasks.workunit.client.0.smithi087.stdout:7/72: rename d1/f5 to d1/d9/f17 0 2024-04-25T15:58:00.854 INFO:tasks.workunit.client.0.smithi087.stdout:7/73: write d1/d4/f13 [476574,127439] 0 2024-04-25T15:58:00.857 INFO:tasks.workunit.client.0.smithi087.stdout:1/82: write d3/f8 [3056262,20713] 0 2024-04-25T15:58:00.858 INFO:tasks.workunit.client.0.smithi087.stdout:8/68: write f1 [6335444,30344] 0 2024-04-25T15:58:00.865 INFO:tasks.workunit.client.0.smithi087.stdout:8/69: dread d4/fa [0,4194304] 0 2024-04-25T15:58:00.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/74: rmdir d1/d16 0 2024-04-25T15:58:00.867 INFO:tasks.workunit.client.0.smithi087.stdout:1/83: dwrite d3/f8 [0,4194304] 0 2024-04-25T15:58:00.868 INFO:tasks.workunit.client.0.smithi087.stdout:7/75: mkdir d1/d4/d18 0 2024-04-25T15:58:00.873 INFO:tasks.workunit.client.0.smithi087.stdout:8/70: getdents d4 0 2024-04-25T15:58:00.873 INFO:tasks.workunit.client.0.smithi087.stdout:1/84: dread d3/ff [0,4194304] 0 2024-04-25T15:58:00.875 INFO:tasks.workunit.client.0.smithi087.stdout:8/71: mknod d4/d8/c16 0 2024-04-25T15:58:00.876 INFO:tasks.workunit.client.0.smithi087.stdout:1/85: mkdir d3/d12/d14 0 2024-04-25T15:58:00.877 INFO:tasks.workunit.client.0.smithi087.stdout:8/72: mkdir d4/d9/df/d17 0 2024-04-25T15:58:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:8/73: mknod d4/d8/dd/c18 0 2024-04-25T15:58:00.879 INFO:tasks.workunit.client.0.smithi087.stdout:7/76: truncate d1/f8 1576770 0 2024-04-25T15:58:00.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/74: mknod d4/c19 0 2024-04-25T15:58:00.885 INFO:tasks.workunit.client.0.smithi087.stdout:1/86: truncate d3/f8 3239178 0 2024-04-25T15:58:00.886 INFO:tasks.workunit.client.0.smithi087.stdout:1/87: rmdir d3/d12 39 2024-04-25T15:58:00.888 INFO:tasks.workunit.client.0.smithi087.stdout:7/77: write d1/d4/f12 [4198112,40342] 0 2024-04-25T15:58:00.891 INFO:tasks.workunit.client.0.smithi087.stdout:1/88: chown d3/d12/l13 369054 1 2024-04-25T15:58:00.893 INFO:tasks.workunit.client.0.smithi087.stdout:8/75: creat d4/d9/f1a x:0 0 0 2024-04-25T15:58:00.896 INFO:tasks.workunit.client.0.smithi087.stdout:8/76: creat d4/d9/df/f1b x:0 0 0 2024-04-25T15:58:00.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/78: creat d1/f19 x:0 0 0 2024-04-25T15:58:00.899 INFO:tasks.workunit.client.0.smithi087.stdout:8/77: creat d4/d9/f1c x:0 0 0 2024-04-25T15:58:00.900 INFO:tasks.workunit.client.0.smithi087.stdout:5/29: sync 2024-04-25T15:58:00.900 INFO:tasks.workunit.client.0.smithi087.stdout:3/41: sync 2024-04-25T15:58:00.900 INFO:tasks.workunit.client.0.smithi087.stdout:5/30: chown l5 63067 1 2024-04-25T15:58:00.901 INFO:tasks.workunit.client.0.smithi087.stdout:7/79: mkdir d1/d1a 0 2024-04-25T15:58:00.904 INFO:tasks.workunit.client.0.smithi087.stdout:1/89: link d3/cc d3/d12/c15 0 2024-04-25T15:58:00.904 INFO:tasks.workunit.client.0.smithi087.stdout:5/31: read - f1 zero size 2024-04-25T15:58:00.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/80: rename d1/d9/f17 to d1/d4/d18/f1b 0 2024-04-25T15:58:00.909 INFO:tasks.workunit.client.0.smithi087.stdout:5/32: dread f0 [4194304,4194304] 0 2024-04-25T15:58:00.909 INFO:tasks.workunit.client.0.smithi087.stdout:5/33: chown l5 1061342251 1 2024-04-25T15:58:00.910 INFO:tasks.workunit.client.0.smithi087.stdout:1/90: creat d3/d12/d14/f16 x:0 0 0 2024-04-25T15:58:00.912 INFO:tasks.workunit.client.0.smithi087.stdout:7/81: mknod d1/d1a/c1c 0 2024-04-25T15:58:00.912 INFO:tasks.workunit.client.0.smithi087.stdout:8/78: dwrite d4/d8/fb [0,4194304] 0 2024-04-25T15:58:00.914 INFO:tasks.workunit.client.0.smithi087.stdout:7/82: stat d1/d4/l6 0 2024-04-25T15:58:00.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/34: creat d9/fa x:0 0 0 2024-04-25T15:58:00.916 INFO:tasks.workunit.client.0.smithi087.stdout:5/35: write d9/fa [278065,92400] 0 2024-04-25T15:58:00.916 INFO:tasks.workunit.client.0.smithi087.stdout:8/79: rmdir d4/d8 39 2024-04-25T15:58:00.917 INFO:tasks.workunit.client.0.smithi087.stdout:1/91: truncate d3/f11 434102 0 2024-04-25T15:58:00.922 INFO:tasks.workunit.client.0.smithi087.stdout:7/83: mknod d1/c1d 0 2024-04-25T15:58:00.922 INFO:tasks.workunit.client.0.smithi087.stdout:5/36: truncate f2 2922721 0 2024-04-25T15:58:00.924 INFO:tasks.workunit.client.0.smithi087.stdout:1/92: link d3/f9 d3/d12/d14/f17 0 2024-04-25T15:58:00.924 INFO:tasks.workunit.client.0.smithi087.stdout:1/93: dread - d3/d12/d14/f16 zero size 2024-04-25T15:58:00.925 INFO:tasks.workunit.client.0.smithi087.stdout:7/84: write d1/d4/d18/f1b [2263595,50102] 0 2024-04-25T15:58:00.925 INFO:tasks.workunit.client.0.smithi087.stdout:1/94: readlink d3/d12/l13 0 2024-04-25T15:58:00.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/85: mknod d1/c1e 0 2024-04-25T15:58:00.931 INFO:tasks.workunit.client.0.smithi087.stdout:7/86: mknod d1/d9/c1f 0 2024-04-25T15:58:00.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/42: rename d4/l5 to d4/db/lf 0 2024-04-25T15:58:00.940 INFO:tasks.workunit.client.0.smithi087.stdout:3/43: chown l2 6 1 2024-04-25T15:58:00.944 INFO:tasks.workunit.client.0.smithi087.stdout:5/37: write f1 [1013961,65240] 0 2024-04-25T15:58:00.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/87: truncate d1/d4/f10 3915435 0 2024-04-25T15:58:00.947 INFO:tasks.workunit.client.0.smithi087.stdout:5/38: rename c4 to d9/cb 0 2024-04-25T15:58:00.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/88: creat d1/d1a/f20 x:0 0 0 2024-04-25T15:58:00.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/89: read f0 [11065596,121962] 0 2024-04-25T15:58:00.950 INFO:tasks.workunit.client.0.smithi087.stdout:1/95: link d3/f11 d3/d12/d14/f18 0 2024-04-25T15:58:00.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/90: truncate d1/d4/f13 1144490 0 2024-04-25T15:58:00.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/91: readlink d1/d4/l15 0 2024-04-25T15:58:00.959 INFO:tasks.workunit.client.0.smithi087.stdout:1/96: write d3/d12/d14/f18 [1286369,7027] 0 2024-04-25T15:58:00.960 INFO:tasks.workunit.client.0.smithi087.stdout:7/92: write d1/d4/f10 [1062899,110491] 0 2024-04-25T15:58:00.961 INFO:tasks.workunit.client.0.smithi087.stdout:7/93: chown d1/d1a 433 1 2024-04-25T15:58:00.962 INFO:tasks.workunit.client.0.smithi087.stdout:1/97: creat d3/d12/f19 x:0 0 0 2024-04-25T15:58:00.963 INFO:tasks.workunit.client.0.smithi087.stdout:7/94: symlink d1/l21 0 2024-04-25T15:58:00.965 INFO:tasks.workunit.client.0.smithi087.stdout:5/39: dwrite f2 [0,4194304] 0 2024-04-25T15:58:00.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/95: chown d1/d4/d18/f1b 93148557 1 2024-04-25T15:58:00.965 INFO:tasks.workunit.client.0.smithi087.stdout:3/44: dread d4/db/fe [0,4194304] 0 2024-04-25T15:58:00.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/96: write d1/d1a/f20 [63376,80398] 0 2024-04-25T15:58:00.967 INFO:tasks.workunit.client.0.smithi087.stdout:7/97: truncate d1/f19 1008734 0 2024-04-25T15:58:00.967 INFO:tasks.workunit.client.0.smithi087.stdout:5/40: rmdir d9 39 2024-04-25T15:58:00.968 INFO:tasks.workunit.client.0.smithi087.stdout:7/98: chown f0 1 1 2024-04-25T15:58:00.969 INFO:tasks.workunit.client.0.smithi087.stdout:3/45: write d4/db/fe [399498,38539] 0 2024-04-25T15:58:00.972 INFO:tasks.workunit.client.0.smithi087.stdout:1/98: dwrite d3/f11 [0,4194304] 0 2024-04-25T15:58:00.973 INFO:tasks.workunit.client.0.smithi087.stdout:3/46: rmdir d4 39 2024-04-25T15:58:00.975 INFO:tasks.workunit.client.0.smithi087.stdout:1/99: chown d3/d12/d14 0 1 2024-04-25T15:58:00.976 INFO:tasks.workunit.client.0.smithi087.stdout:7/99: rename d1/la to d1/d9/l22 0 2024-04-25T15:58:00.979 INFO:tasks.workunit.client.0.smithi087.stdout:7/100: rmdir d1/d4 39 2024-04-25T15:58:00.979 INFO:tasks.workunit.client.0.smithi087.stdout:3/47: fdatasync d4/db/fc 0 2024-04-25T15:58:00.981 INFO:tasks.workunit.client.0.smithi087.stdout:5/41: dwrite d9/fa [0,4194304] 0 2024-04-25T15:58:00.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/42: write f2 [3935708,65215] 0 2024-04-25T15:58:00.983 INFO:tasks.workunit.client.0.smithi087.stdout:7/101: creat d1/f23 x:0 0 0 2024-04-25T15:58:00.984 INFO:tasks.workunit.client.0.smithi087.stdout:3/48: creat d4/f10 x:0 0 0 2024-04-25T15:58:00.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/43: creat d9/fc x:0 0 0 2024-04-25T15:58:00.986 INFO:tasks.workunit.client.0.smithi087.stdout:5/44: readlink l5 0 2024-04-25T15:58:00.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/102: creat d1/d1a/f24 x:0 0 0 2024-04-25T15:58:00.986 INFO:tasks.workunit.client.0.smithi087.stdout:3/49: write d4/f10 [35635,106555] 0 2024-04-25T15:58:00.987 INFO:tasks.workunit.client.0.smithi087.stdout:7/103: read f0 [123859,31461] 0 2024-04-25T15:58:00.989 INFO:tasks.workunit.client.0.smithi087.stdout:7/104: stat d1/d4/l6 0 2024-04-25T15:58:00.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/105: truncate d1/d1a/f20 536674 0 2024-04-25T15:58:00.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/45: dread f2 [0,4194304] 0 2024-04-25T15:58:00.995 INFO:tasks.workunit.client.0.smithi087.stdout:3/50: dwrite d4/db/fc [0,4194304] 0 2024-04-25T15:58:00.996 INFO:tasks.workunit.client.0.smithi087.stdout:3/51: chown d4/f10 6662987 1 2024-04-25T15:58:00.997 INFO:tasks.workunit.client.0.smithi087.stdout:1/100: write d3/d12/d14/f17 [442509,93682] 0 2024-04-25T15:58:00.999 INFO:tasks.workunit.client.0.smithi087.stdout:3/52: truncate d4/f10 306480 0 2024-04-25T15:58:01.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/53: dread d4/f10 [0,4194304] 0 2024-04-25T15:58:01.005 INFO:tasks.workunit.client.0.smithi087.stdout:1/101: getdents d3/d12/d14 0 2024-04-25T15:58:01.005 INFO:tasks.workunit.client.0.smithi087.stdout:5/46: dwrite d9/fc [0,4194304] 0 2024-04-25T15:58:01.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/102: stat d3/d12/d14 0 2024-04-25T15:58:01.006 INFO:tasks.workunit.client.0.smithi087.stdout:3/54: rmdir d4 39 2024-04-25T15:58:01.007 INFO:tasks.workunit.client.0.smithi087.stdout:5/47: rmdir d9 39 2024-04-25T15:58:01.010 INFO:tasks.workunit.client.0.smithi087.stdout:1/103: mknod d3/d12/d14/c1a 0 2024-04-25T15:58:01.010 INFO:tasks.workunit.client.0.smithi087.stdout:1/104: chown d3/le 5687 1 2024-04-25T15:58:01.013 INFO:tasks.workunit.client.0.smithi087.stdout:1/105: rmdir d3/d12 39 2024-04-25T15:58:01.015 INFO:tasks.workunit.client.0.smithi087.stdout:5/48: mknod d9/cd 0 2024-04-25T15:58:01.015 INFO:tasks.workunit.client.0.smithi087.stdout:5/49: fdatasync f1 0 2024-04-25T15:58:01.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/106: write d3/d12/d14/f16 [345184,111543] 0 2024-04-25T15:58:01.018 INFO:tasks.workunit.client.0.smithi087.stdout:1/107: write d3/d12/d14/f17 [3564848,17659] 0 2024-04-25T15:58:01.018 INFO:tasks.workunit.client.0.smithi087.stdout:3/55: creat d4/db/f11 x:0 0 0 2024-04-25T15:58:01.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/50: mknod d9/ce 0 2024-04-25T15:58:01.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/51: fdatasync f1 0 2024-04-25T15:58:01.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/52: mknod d9/cf 0 2024-04-25T15:58:01.024 INFO:tasks.workunit.client.0.smithi087.stdout:5/53: creat d9/f10 x:0 0 0 2024-04-25T15:58:01.026 INFO:tasks.workunit.client.0.smithi087.stdout:1/108: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:01.032 INFO:tasks.workunit.client.0.smithi087.stdout:1/109: creat d3/f1b x:0 0 0 2024-04-25T15:58:01.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/56: truncate d4/db/fe 3812748 0 2024-04-25T15:58:01.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/57: chown d4/db 20 1 2024-04-25T15:58:01.038 INFO:tasks.workunit.client.0.smithi087.stdout:3/58: creat d4/f12 x:0 0 0 2024-04-25T15:58:01.039 INFO:tasks.workunit.client.0.smithi087.stdout:1/110: dwrite d3/d12/d14/f18 [0,4194304] 0 2024-04-25T15:58:01.042 INFO:tasks.workunit.client.0.smithi087.stdout:1/111: fsync d3/ff 0 2024-04-25T15:58:01.052 INFO:tasks.workunit.client.0.smithi087.stdout:1/112: write d3/f4 [2668375,121634] 0 2024-04-25T15:58:01.053 INFO:tasks.workunit.client.0.smithi087.stdout:5/54: dread f0 [0,4194304] 0 2024-04-25T15:58:01.054 INFO:tasks.workunit.client.0.smithi087.stdout:1/113: creat d3/d12/f1c x:0 0 0 2024-04-25T15:58:01.058 INFO:tasks.workunit.client.0.smithi087.stdout:1/114: getdents d3/d12 0 2024-04-25T15:58:01.060 INFO:tasks.workunit.client.0.smithi087.stdout:1/115: mknod d3/d12/d14/c1d 0 2024-04-25T15:58:01.096 INFO:tasks.workunit.client.0.smithi087.stdout:6/44: sync 2024-04-25T15:58:01.097 INFO:tasks.workunit.client.0.smithi087.stdout:1/116: chown d3/d12 15 1 2024-04-25T15:58:01.097 INFO:tasks.workunit.client.0.smithi087.stdout:3/59: dread d4/f6 [0,4194304] 0 2024-04-25T15:58:01.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/55: dwrite f0 [4194304,4194304] 0 2024-04-25T15:58:01.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/56: stat c8 0 2024-04-25T15:58:01.110 INFO:tasks.workunit.client.0.smithi087.stdout:1/117: unlink d3/f11 0 2024-04-25T15:58:01.111 INFO:tasks.workunit.client.0.smithi087.stdout:1/118: stat d3/d12/d14 0 2024-04-25T15:58:01.112 INFO:tasks.workunit.client.0.smithi087.stdout:5/57: rmdir d9 39 2024-04-25T15:58:01.112 INFO:tasks.workunit.client.0.smithi087.stdout:1/119: chown d3/f1b 114927161 1 2024-04-25T15:58:01.114 INFO:tasks.workunit.client.0.smithi087.stdout:3/60: mknod d4/db/c13 0 2024-04-25T15:58:01.115 INFO:tasks.workunit.client.0.smithi087.stdout:5/58: chown d9/cd 842867 1 2024-04-25T15:58:01.115 INFO:tasks.workunit.client.0.smithi087.stdout:5/59: chown f3 7606 1 2024-04-25T15:58:01.116 INFO:tasks.workunit.client.0.smithi087.stdout:6/45: creat d7/f13 x:0 0 0 2024-04-25T15:58:01.118 INFO:tasks.workunit.client.0.smithi087.stdout:5/60: mknod d9/c11 0 2024-04-25T15:58:01.123 INFO:tasks.workunit.client.0.smithi087.stdout:6/46: dread d7/f8 [0,4194304] 0 2024-04-25T15:58:01.130 INFO:tasks.workunit.client.0.smithi087.stdout:5/61: truncate f1 599533 0 2024-04-25T15:58:01.134 INFO:tasks.workunit.client.0.smithi087.stdout:5/62: creat d9/f12 x:0 0 0 2024-04-25T15:58:01.135 INFO:tasks.workunit.client.0.smithi087.stdout:6/47: creat d7/f14 x:0 0 0 2024-04-25T15:58:01.137 INFO:tasks.workunit.client.0.smithi087.stdout:6/48: write d7/f13 [931809,126322] 0 2024-04-25T15:58:01.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/63: chown f1 26203669 1 2024-04-25T15:58:01.140 INFO:tasks.workunit.client.0.smithi087.stdout:3/61: dwrite d4/f10 [0,4194304] 0 2024-04-25T15:58:01.140 INFO:tasks.workunit.client.0.smithi087.stdout:6/49: fsync d7/f13 0 2024-04-25T15:58:01.141 INFO:tasks.workunit.client.0.smithi087.stdout:3/62: chown d4/f12 15 1 2024-04-25T15:58:01.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/50: symlink d7/l15 0 2024-04-25T15:58:01.148 INFO:tasks.workunit.client.0.smithi087.stdout:3/63: mkdir d4/d14 0 2024-04-25T15:58:01.149 INFO:tasks.workunit.client.0.smithi087.stdout:5/64: link d9/c11 d9/c13 0 2024-04-25T15:58:01.151 INFO:tasks.workunit.client.0.smithi087.stdout:5/65: truncate d9/f10 916384 0 2024-04-25T15:58:01.152 INFO:tasks.workunit.client.0.smithi087.stdout:3/64: creat d4/d14/f15 x:0 0 0 2024-04-25T15:58:01.156 INFO:tasks.workunit.client.0.smithi087.stdout:6/51: rename d7/ld to d7/l16 0 2024-04-25T15:58:01.160 INFO:tasks.workunit.client.0.smithi087.stdout:6/52: symlink d7/l17 0 2024-04-25T15:58:01.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/53: write d7/f12 [682041,19753] 0 2024-04-25T15:58:01.162 INFO:tasks.workunit.client.0.smithi087.stdout:3/65: creat d4/f16 x:0 0 0 2024-04-25T15:58:01.167 INFO:tasks.workunit.client.0.smithi087.stdout:3/66: mkdir d4/d17 0 2024-04-25T15:58:01.169 INFO:tasks.workunit.client.0.smithi087.stdout:5/66: truncate f2 2221466 0 2024-04-25T15:58:01.170 INFO:tasks.workunit.client.0.smithi087.stdout:6/54: link d7/f13 d7/f18 0 2024-04-25T15:58:01.170 INFO:tasks.workunit.client.0.smithi087.stdout:6/55: stat d7/f18 0 2024-04-25T15:58:01.170 INFO:tasks.workunit.client.0.smithi087.stdout:3/67: mknod d4/d14/c18 0 2024-04-25T15:58:01.171 INFO:tasks.workunit.client.0.smithi087.stdout:6/56: creat d7/f19 x:0 0 0 2024-04-25T15:58:01.173 INFO:tasks.workunit.client.0.smithi087.stdout:6/57: write d7/ff [1743802,49737] 0 2024-04-25T15:58:01.177 INFO:tasks.workunit.client.0.smithi087.stdout:6/58: mkdir d7/d1a 0 2024-04-25T15:58:01.181 INFO:tasks.workunit.client.0.smithi087.stdout:6/59: write d7/f19 [277772,83255] 0 2024-04-25T15:58:01.185 INFO:tasks.workunit.client.0.smithi087.stdout:3/68: dwrite d4/f12 [0,4194304] 0 2024-04-25T15:58:01.185 INFO:tasks.workunit.client.0.smithi087.stdout:5/67: dwrite f7 [0,4194304] 0 2024-04-25T15:58:01.186 INFO:tasks.workunit.client.0.smithi087.stdout:6/60: write d7/f9 [308925,19850] 0 2024-04-25T15:58:01.192 INFO:tasks.workunit.client.0.smithi087.stdout:5/68: symlink d9/l14 0 2024-04-25T15:58:01.193 INFO:tasks.workunit.client.0.smithi087.stdout:5/69: chown d9/fa 237 1 2024-04-25T15:58:01.194 INFO:tasks.workunit.client.0.smithi087.stdout:6/61: symlink d7/d1a/l1b 0 2024-04-25T15:58:01.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/69: dwrite d4/f12 [4194304,4194304] 0 2024-04-25T15:58:01.200 INFO:tasks.workunit.client.0.smithi087.stdout:0/85: sync 2024-04-25T15:58:01.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/70: link f0 d9/f15 0 2024-04-25T15:58:01.202 INFO:tasks.workunit.client.0.smithi087.stdout:3/70: creat d4/f19 x:0 0 0 2024-04-25T15:58:01.202 INFO:tasks.workunit.client.0.smithi087.stdout:3/71: dread - d4/f16 zero size 2024-04-25T15:58:01.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/72: stat d4/db 0 2024-04-25T15:58:01.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/71: rmdir d9 39 2024-04-25T15:58:01.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/73: truncate d4/f19 64748 0 2024-04-25T15:58:01.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/86: unlink d1/da/f10 0 2024-04-25T15:58:01.210 INFO:tasks.workunit.client.0.smithi087.stdout:5/72: rmdir d9 39 2024-04-25T15:58:01.210 INFO:tasks.workunit.client.0.smithi087.stdout:0/87: chown d1/f14 2848147 1 2024-04-25T15:58:01.211 INFO:tasks.workunit.client.0.smithi087.stdout:0/88: chown d1/d6 3 1 2024-04-25T15:58:01.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/74: creat d4/f1a x:0 0 0 2024-04-25T15:58:01.212 INFO:tasks.workunit.client.0.smithi087.stdout:0/89: rmdir d1/d6 39 2024-04-25T15:58:01.214 INFO:tasks.workunit.client.0.smithi087.stdout:3/75: creat d4/d17/f1b x:0 0 0 2024-04-25T15:58:01.215 INFO:tasks.workunit.client.0.smithi087.stdout:3/76: write d4/f19 [352677,93049] 0 2024-04-25T15:58:01.215 INFO:tasks.workunit.client.0.smithi087.stdout:3/77: readlink l2 0 2024-04-25T15:58:01.215 INFO:tasks.workunit.client.0.smithi087.stdout:3/78: chown d4/f10 47092415 1 2024-04-25T15:58:01.216 INFO:tasks.workunit.client.0.smithi087.stdout:3/79: chown d4/db/f11 94572920 1 2024-04-25T15:58:01.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/80: write d4/db/f11 [948610,127992] 0 2024-04-25T15:58:01.220 INFO:tasks.workunit.client.0.smithi087.stdout:3/81: symlink d4/l1c 0 2024-04-25T15:58:01.221 INFO:tasks.workunit.client.0.smithi087.stdout:3/82: read d4/f6 [1936608,105651] 0 2024-04-25T15:58:01.224 INFO:tasks.workunit.client.0.smithi087.stdout:3/83: symlink d4/d17/l1d 0 2024-04-25T15:58:01.225 INFO:tasks.workunit.client.0.smithi087.stdout:3/84: stat d4/db/f11 0 2024-04-25T15:58:01.226 INFO:tasks.workunit.client.0.smithi087.stdout:5/73: dwrite f1 [0,4194304] 0 2024-04-25T15:58:01.230 INFO:tasks.workunit.client.0.smithi087.stdout:5/74: chown d9/c11 60 1 2024-04-25T15:58:01.230 INFO:tasks.workunit.client.0.smithi087.stdout:5/75: readlink d9/l14 0 2024-04-25T15:58:01.236 INFO:tasks.workunit.client.0.smithi087.stdout:5/76: write f2 [252178,113719] 0 2024-04-25T15:58:01.238 INFO:tasks.workunit.client.0.smithi087.stdout:5/77: rename f7 to d9/f16 0 2024-04-25T15:58:01.242 INFO:tasks.workunit.client.0.smithi087.stdout:5/78: dread f1 [0,4194304] 0 2024-04-25T15:58:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:5/79: mknod d9/c17 0 2024-04-25T15:58:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:5/80: stat d9/cb 0 2024-04-25T15:58:01.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/81: creat d9/f18 x:0 0 0 2024-04-25T15:58:01.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/82: fsync d9/fc 0 2024-04-25T15:58:01.252 INFO:tasks.workunit.client.0.smithi087.stdout:5/83: dwrite d9/f10 [0,4194304] 0 2024-04-25T15:58:01.252 INFO:tasks.workunit.client.0.smithi087.stdout:5/84: chown d9/c17 2243913 1 2024-04-25T15:58:01.253 INFO:tasks.workunit.client.0.smithi087.stdout:5/85: dread - f3 zero size 2024-04-25T15:58:01.255 INFO:tasks.workunit.client.0.smithi087.stdout:5/86: creat d9/f19 x:0 0 0 2024-04-25T15:58:01.263 INFO:tasks.workunit.client.0.smithi087.stdout:5/87: dwrite f2 [0,4194304] 0 2024-04-25T15:58:01.266 INFO:tasks.workunit.client.0.smithi087.stdout:5/88: creat d9/f1a x:0 0 0 2024-04-25T15:58:01.266 INFO:tasks.workunit.client.0.smithi087.stdout:5/89: chown d9/cd 49984 1 2024-04-25T15:58:01.292 INFO:tasks.workunit.client.0.smithi087.stdout:5/90: dwrite d9/f15 [4194304,4194304] 0 2024-04-25T15:58:01.292 INFO:tasks.workunit.client.0.smithi087.stdout:5/91: stat d9/fc 0 2024-04-25T15:58:01.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/92: mkdir d9/d1b 0 2024-04-25T15:58:01.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/93: rmdir d9/d1b 0 2024-04-25T15:58:01.298 INFO:tasks.workunit.client.0.smithi087.stdout:5/94: creat d9/f1c x:0 0 0 2024-04-25T15:58:01.299 INFO:tasks.workunit.client.0.smithi087.stdout:5/95: dread - d9/f19 zero size 2024-04-25T15:58:01.300 INFO:tasks.workunit.client.0.smithi087.stdout:5/96: unlink d9/f15 0 2024-04-25T15:58:01.304 INFO:tasks.workunit.client.0.smithi087.stdout:5/97: dread f0 [4194304,4194304] 0 2024-04-25T15:58:01.305 INFO:tasks.workunit.client.0.smithi087.stdout:5/98: stat d9/cd 0 2024-04-25T15:58:01.308 INFO:tasks.workunit.client.0.smithi087.stdout:5/99: dread d9/fc [0,4194304] 0 2024-04-25T15:58:01.320 INFO:tasks.workunit.client.0.smithi087.stdout:5/100: truncate f0 3729962 0 2024-04-25T15:58:01.323 INFO:tasks.workunit.client.0.smithi087.stdout:5/101: rename d9/cb to d9/c1d 0 2024-04-25T15:58:01.326 INFO:tasks.workunit.client.0.smithi087.stdout:5/102: creat d9/f1e x:0 0 0 2024-04-25T15:58:01.328 INFO:tasks.workunit.client.0.smithi087.stdout:5/103: creat d9/f1f x:0 0 0 2024-04-25T15:58:01.334 INFO:tasks.workunit.client.0.smithi087.stdout:4/65: sync 2024-04-25T15:58:01.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/82: sync 2024-04-25T15:58:01.334 INFO:tasks.workunit.client.0.smithi087.stdout:4/66: chown f1 38022 1 2024-04-25T15:58:01.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/83: symlink d3/d11/l1d 0 2024-04-25T15:58:01.340 INFO:tasks.workunit.client.0.smithi087.stdout:4/67: chown d4/fb 2341818 1 2024-04-25T15:58:01.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/68: truncate d4/f6 2881687 0 2024-04-25T15:58:01.343 INFO:tasks.workunit.client.0.smithi087.stdout:2/84: creat d3/f1e x:0 0 0 2024-04-25T15:58:01.346 INFO:tasks.workunit.client.0.smithi087.stdout:4/69: unlink d4/cd 0 2024-04-25T15:58:01.347 INFO:tasks.workunit.client.0.smithi087.stdout:5/104: truncate f0 2408684 0 2024-04-25T15:58:01.348 INFO:tasks.workunit.client.0.smithi087.stdout:5/105: read - d9/f1a zero size 2024-04-25T15:58:01.349 INFO:tasks.workunit.client.0.smithi087.stdout:4/70: mkdir d4/d9/d13 0 2024-04-25T15:58:01.350 INFO:tasks.workunit.client.0.smithi087.stdout:5/106: write f2 [2038539,22623] 0 2024-04-25T15:58:01.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/85: dwrite d3/d11/f1b [0,4194304] 0 2024-04-25T15:58:01.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/86: write d3/f1e [490152,115007] 0 2024-04-25T15:58:01.355 INFO:tasks.workunit.client.0.smithi087.stdout:2/87: write d3/d11/f1b [730345,109323] 0 2024-04-25T15:58:01.355 INFO:tasks.workunit.client.0.smithi087.stdout:5/107: symlink d9/l20 0 2024-04-25T15:58:01.356 INFO:tasks.workunit.client.0.smithi087.stdout:5/108: write d9/f1c [721885,98369] 0 2024-04-25T15:58:01.358 INFO:tasks.workunit.client.0.smithi087.stdout:4/71: link f1 d4/f14 0 2024-04-25T15:58:01.359 INFO:tasks.workunit.client.0.smithi087.stdout:4/72: write d4/d9/fe [650627,39157] 0 2024-04-25T15:58:01.361 INFO:tasks.workunit.client.0.smithi087.stdout:2/88: dread d3/d11/f1b [0,4194304] 0 2024-04-25T15:58:01.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/109: chown c6 7 1 2024-04-25T15:58:01.366 INFO:tasks.workunit.client.0.smithi087.stdout:2/89: dread d3/d11/f14 [0,4194304] 0 2024-04-25T15:58:01.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/110: dread d9/f1c [0,4194304] 0 2024-04-25T15:58:01.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/111: write d9/f19 [608241,77707] 0 2024-04-25T15:58:01.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/112: dread f2 [0,4194304] 0 2024-04-25T15:58:01.381 INFO:tasks.workunit.client.0.smithi087.stdout:5/113: creat d9/f21 x:0 0 0 2024-04-25T15:58:01.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/73: getdents d4/d9 0 2024-04-25T15:58:01.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/74: chown d4/d7/la 166612268 1 2024-04-25T15:58:01.383 INFO:tasks.workunit.client.0.smithi087.stdout:5/114: creat d9/f22 x:0 0 0 2024-04-25T15:58:01.385 INFO:tasks.workunit.client.0.smithi087.stdout:4/75: rename d4/d9 to d4/d7/d15 0 2024-04-25T15:58:01.388 INFO:tasks.workunit.client.0.smithi087.stdout:5/115: rename l5 to d9/l23 0 2024-04-25T15:58:01.388 INFO:tasks.workunit.client.0.smithi087.stdout:2/90: truncate d3/fd 4020708 0 2024-04-25T15:58:01.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/76: creat d4/f16 x:0 0 0 2024-04-25T15:58:01.392 INFO:tasks.workunit.client.0.smithi087.stdout:5/116: dread d9/fa [0,4194304] 0 2024-04-25T15:58:01.393 INFO:tasks.workunit.client.0.smithi087.stdout:5/117: truncate f1 5135169 0 2024-04-25T15:58:01.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/77: getdents d4/d7/d15 0 2024-04-25T15:58:01.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/118: unlink f0 0 2024-04-25T15:58:01.398 INFO:tasks.workunit.client.0.smithi087.stdout:5/119: symlink d9/l24 0 2024-04-25T15:58:01.399 INFO:tasks.workunit.client.0.smithi087.stdout:5/120: stat d9/f16 0 2024-04-25T15:58:01.399 INFO:tasks.workunit.client.0.smithi087.stdout:4/78: creat d4/d7/d15/d12/f17 x:0 0 0 2024-04-25T15:58:01.401 INFO:tasks.workunit.client.0.smithi087.stdout:5/121: creat d9/f25 x:0 0 0 2024-04-25T15:58:01.402 INFO:tasks.workunit.client.0.smithi087.stdout:5/122: stat d9/c17 0 2024-04-25T15:58:01.403 INFO:tasks.workunit.client.0.smithi087.stdout:4/79: getdents d4/d10 0 2024-04-25T15:58:01.403 INFO:tasks.workunit.client.0.smithi087.stdout:2/91: write d3/d11/f14 [3764125,47828] 0 2024-04-25T15:58:01.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/80: chown d4/f6 4042 1 2024-04-25T15:58:01.405 INFO:tasks.workunit.client.0.smithi087.stdout:4/81: chown d4 2124257 1 2024-04-25T15:58:01.407 INFO:tasks.workunit.client.0.smithi087.stdout:4/82: symlink d4/d7/d15/l18 0 2024-04-25T15:58:01.408 INFO:tasks.workunit.client.0.smithi087.stdout:5/123: dread f2 [0,4194304] 0 2024-04-25T15:58:01.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/92: dread d3/d11/f1b [0,4194304] 0 2024-04-25T15:58:01.409 INFO:tasks.workunit.client.0.smithi087.stdout:5/124: dread - d9/f18 zero size 2024-04-25T15:58:01.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/125: chown d9/l14 3 1 2024-04-25T15:58:01.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/126: write d9/f21 [776118,54645] 0 2024-04-25T15:58:01.411 INFO:tasks.workunit.client.0.smithi087.stdout:2/93: creat d3/d11/f1f x:0 0 0 2024-04-25T15:58:01.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/127: stat d9/f21 0 2024-04-25T15:58:01.412 INFO:tasks.workunit.client.0.smithi087.stdout:5/128: truncate d9/f18 546694 0 2024-04-25T15:58:01.414 INFO:tasks.workunit.client.0.smithi087.stdout:5/129: creat d9/f26 x:0 0 0 2024-04-25T15:58:01.417 INFO:tasks.workunit.client.0.smithi087.stdout:5/130: unlink d9/c1d 0 2024-04-25T15:58:01.418 INFO:tasks.workunit.client.0.smithi087.stdout:5/131: chown d9/l24 14 1 2024-04-25T15:58:01.420 INFO:tasks.workunit.client.0.smithi087.stdout:4/83: dwrite d4/f6 [0,4194304] 0 2024-04-25T15:58:01.420 INFO:tasks.workunit.client.0.smithi087.stdout:5/132: chown c8 6171 1 2024-04-25T15:58:01.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/94: dwrite d3/d11/f1f [0,4194304] 0 2024-04-25T15:58:01.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/133: symlink d9/l27 0 2024-04-25T15:58:01.424 INFO:tasks.workunit.client.0.smithi087.stdout:5/134: fsync d9/f1e 0 2024-04-25T15:58:01.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/106: sync 2024-04-25T15:58:01.425 INFO:tasks.workunit.client.0.smithi087.stdout:1/120: sync 2024-04-25T15:58:01.425 INFO:tasks.workunit.client.0.smithi087.stdout:9/93: sync 2024-04-25T15:58:01.425 INFO:tasks.workunit.client.0.smithi087.stdout:8/80: sync 2024-04-25T15:58:01.425 INFO:tasks.workunit.client.0.smithi087.stdout:2/95: chown d3/d11/l15 1847322360 1 2024-04-25T15:58:01.427 INFO:tasks.workunit.client.0.smithi087.stdout:7/107: stat d1/f23 0 2024-04-25T15:58:01.427 INFO:tasks.workunit.client.0.smithi087.stdout:9/94: chown d6/d8/d12 28233642 1 2024-04-25T15:58:01.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/108: stat d1/c1e 0 2024-04-25T15:58:01.433 INFO:tasks.workunit.client.0.smithi087.stdout:4/84: dwrite d4/d7/d15/fc [0,4194304] 0 2024-04-25T15:58:01.433 INFO:tasks.workunit.client.0.smithi087.stdout:1/121: chown d3/d12/c15 284366037 1 2024-04-25T15:58:01.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/135: dwrite d9/f19 [0,4194304] 0 2024-04-25T15:58:01.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/109: dread f0 [12582912,4194304] 0 2024-04-25T15:58:01.441 INFO:tasks.workunit.client.0.smithi087.stdout:9/95: mkdir d6/d8/d12/d1e 0 2024-04-25T15:58:01.441 INFO:tasks.workunit.client.0.smithi087.stdout:2/96: mkdir d3/d20 0 2024-04-25T15:58:01.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/85: dwrite f0 [0,4194304] 0 2024-04-25T15:58:01.448 INFO:tasks.workunit.client.0.smithi087.stdout:8/81: rename d4/d9/df to d4/d1d 0 2024-04-25T15:58:01.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/122: dwrite d3/f9 [0,4194304] 0 2024-04-25T15:58:01.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/136: creat d9/f28 x:0 0 0 2024-04-25T15:58:01.453 INFO:tasks.workunit.client.0.smithi087.stdout:9/96: creat d6/f1f x:0 0 0 2024-04-25T15:58:01.456 INFO:tasks.workunit.client.0.smithi087.stdout:2/97: dwrite d3/d11/f13 [0,4194304] 0 2024-04-25T15:58:01.458 INFO:tasks.workunit.client.0.smithi087.stdout:4/86: rmdir d4/d7/d15/d12 39 2024-04-25T15:58:01.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/123: symlink d3/d12/l1e 0 2024-04-25T15:58:01.459 INFO:tasks.workunit.client.0.smithi087.stdout:5/137: rename d9/f19 to d9/f29 0 2024-04-25T15:58:01.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/138: dread - d9/f26 zero size 2024-04-25T15:58:01.460 INFO:tasks.workunit.client.0.smithi087.stdout:8/82: mknod d4/d8/c1e 0 2024-04-25T15:58:01.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/87: write d4/d7/d15/ff [673872,123689] 0 2024-04-25T15:58:01.462 INFO:tasks.workunit.client.0.smithi087.stdout:5/139: write d9/f21 [1042901,45118] 0 2024-04-25T15:58:01.464 INFO:tasks.workunit.client.0.smithi087.stdout:9/97: rmdir d6/d8/d12/d1e 0 2024-04-25T15:58:01.465 INFO:tasks.workunit.client.0.smithi087.stdout:5/140: truncate d9/f1a 384799 0 2024-04-25T15:58:01.467 INFO:tasks.workunit.client.0.smithi087.stdout:2/98: dwrite d3/d11/f13 [0,4194304] 0 2024-04-25T15:58:01.467 INFO:tasks.workunit.client.0.smithi087.stdout:1/124: stat d3/d12/d14/f17 0 2024-04-25T15:58:01.468 INFO:tasks.workunit.client.0.smithi087.stdout:2/99: chown d3/d11 400 1 2024-04-25T15:58:01.469 INFO:tasks.workunit.client.0.smithi087.stdout:5/141: creat d9/f2a x:0 0 0 2024-04-25T15:58:01.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/83: dread d4/d8/fb [0,4194304] 0 2024-04-25T15:58:01.470 INFO:tasks.workunit.client.0.smithi087.stdout:5/142: stat d9/f1e 0 2024-04-25T15:58:01.470 INFO:tasks.workunit.client.0.smithi087.stdout:1/125: write d3/d12/d14/f17 [4710132,42748] 0 2024-04-25T15:58:01.470 INFO:tasks.workunit.client.0.smithi087.stdout:8/84: stat d4 0 2024-04-25T15:58:01.470 INFO:tasks.workunit.client.0.smithi087.stdout:4/88: rmdir d4/d7/d15/d12 39 2024-04-25T15:58:01.471 INFO:tasks.workunit.client.0.smithi087.stdout:1/126: dread - d3/d12/f1c zero size 2024-04-25T15:58:01.474 INFO:tasks.workunit.client.0.smithi087.stdout:5/143: rmdir d9 39 2024-04-25T15:58:01.481 INFO:tasks.workunit.client.0.smithi087.stdout:1/127: dwrite d3/d12/d14/f17 [4194304,4194304] 0 2024-04-25T15:58:01.482 INFO:tasks.workunit.client.0.smithi087.stdout:9/98: link d6/d8/d14/l16 d6/d8/d12/l20 0 2024-04-25T15:58:01.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/85: symlink d4/d1d/d17/l1f 0 2024-04-25T15:58:01.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/89: symlink d4/d7/d15/d12/l19 0 2024-04-25T15:58:01.486 INFO:tasks.workunit.client.0.smithi087.stdout:9/99: rename d6/l19 to d6/d8/d12/l21 0 2024-04-25T15:58:01.488 INFO:tasks.workunit.client.0.smithi087.stdout:5/144: rename d9/f10 to d9/f2b 0 2024-04-25T15:58:01.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/145: truncate d9/f28 121464 0 2024-04-25T15:58:01.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/86: symlink d4/d1d/l20 0 2024-04-25T15:58:01.491 INFO:tasks.workunit.client.0.smithi087.stdout:1/128: mknod d3/d12/d14/c1f 0 2024-04-25T15:58:01.493 INFO:tasks.workunit.client.0.smithi087.stdout:9/100: readlink d6/d8/d14/l16 0 2024-04-25T15:58:01.494 INFO:tasks.workunit.client.0.smithi087.stdout:8/87: rename d4/c19 to d4/d1d/c21 0 2024-04-25T15:58:01.496 INFO:tasks.workunit.client.0.smithi087.stdout:5/146: dwrite d9/f1e [0,4194304] 0 2024-04-25T15:58:01.498 INFO:tasks.workunit.client.0.smithi087.stdout:2/100: write d3/fd [200707,54402] 0 2024-04-25T15:58:01.498 INFO:tasks.workunit.client.0.smithi087.stdout:9/101: write d6/f10 [1307713,104517] 0 2024-04-25T15:58:01.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/101: chown d3/d11/f1f 8 1 2024-04-25T15:58:01.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/102: readlink d3/d11/l1d 0 2024-04-25T15:58:01.501 INFO:tasks.workunit.client.0.smithi087.stdout:4/90: link d4/d7/d15/fe d4/d7/d15/f1a 0 2024-04-25T15:58:01.502 INFO:tasks.workunit.client.0.smithi087.stdout:4/91: read f1 [3614012,49353] 0 2024-04-25T15:58:01.504 INFO:tasks.workunit.client.0.smithi087.stdout:5/147: mkdir d9/d2c 0 2024-04-25T15:58:01.505 INFO:tasks.workunit.client.0.smithi087.stdout:8/88: mkdir d4/d22 0 2024-04-25T15:58:01.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/89: chown d4/d1d/l20 5988968 1 2024-04-25T15:58:01.508 INFO:tasks.workunit.client.0.smithi087.stdout:9/102: dwrite d6/d8/f17 [0,4194304] 0 2024-04-25T15:58:01.508 INFO:tasks.workunit.client.0.smithi087.stdout:5/148: creat d9/f2d x:0 0 0 2024-04-25T15:58:01.509 INFO:tasks.workunit.client.0.smithi087.stdout:5/149: stat d9/l27 0 2024-04-25T15:58:01.513 INFO:tasks.workunit.client.0.smithi087.stdout:2/103: symlink d3/d20/l21 0 2024-04-25T15:58:01.513 INFO:tasks.workunit.client.0.smithi087.stdout:9/103: dread d6/d8/fc [4194304,4194304] 0 2024-04-25T15:58:01.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/90: rmdir d4/d9 39 2024-04-25T15:58:01.516 INFO:tasks.workunit.client.0.smithi087.stdout:4/92: link d4/fb d4/d7/d15/d13/f1b 0 2024-04-25T15:58:01.518 INFO:tasks.workunit.client.0.smithi087.stdout:5/150: creat d9/d2c/f2e x:0 0 0 2024-04-25T15:58:01.519 INFO:tasks.workunit.client.0.smithi087.stdout:1/129: dwrite d3/d12/d14/f18 [0,4194304] 0 2024-04-25T15:58:01.521 INFO:tasks.workunit.client.0.smithi087.stdout:8/91: read - d4/d9/f1a zero size 2024-04-25T15:58:01.522 INFO:tasks.workunit.client.0.smithi087.stdout:4/93: creat d4/d7/d15/d12/f1c x:0 0 0 2024-04-25T15:58:01.522 INFO:tasks.workunit.client.0.smithi087.stdout:9/104: write d6/d8/fc [1242277,1788] 0 2024-04-25T15:58:01.524 INFO:tasks.workunit.client.0.smithi087.stdout:5/151: write d9/f29 [2822407,5736] 0 2024-04-25T15:58:01.524 INFO:tasks.workunit.client.0.smithi087.stdout:9/105: read f0 [5091365,115300] 0 2024-04-25T15:58:01.525 INFO:tasks.workunit.client.0.smithi087.stdout:6/62: sync 2024-04-25T15:58:01.525 INFO:tasks.workunit.client.0.smithi087.stdout:3/85: sync 2024-04-25T15:58:01.525 INFO:tasks.workunit.client.0.smithi087.stdout:0/90: sync 2024-04-25T15:58:01.528 INFO:tasks.workunit.client.0.smithi087.stdout:2/104: dwrite d3/f1e [0,4194304] 0 2024-04-25T15:58:01.531 INFO:tasks.workunit.client.0.smithi087.stdout:3/86: creat d4/d17/f1e x:0 0 0 2024-04-25T15:58:01.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/130: link d3/d12/d14/c1a d3/c20 0 2024-04-25T15:58:01.534 INFO:tasks.workunit.client.0.smithi087.stdout:6/63: mknod d7/c1c 0 2024-04-25T15:58:01.536 INFO:tasks.workunit.client.0.smithi087.stdout:8/92: dread f1 [0,4194304] 0 2024-04-25T15:58:01.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/131: rmdir d3 39 2024-04-25T15:58:01.539 INFO:tasks.workunit.client.0.smithi087.stdout:5/152: dwrite d9/f18 [0,4194304] 0 2024-04-25T15:58:01.539 INFO:tasks.workunit.client.0.smithi087.stdout:6/64: mkdir d7/d1a/d1d 0 2024-04-25T15:58:01.540 INFO:tasks.workunit.client.0.smithi087.stdout:6/65: write d7/f14 [465572,78456] 0 2024-04-25T15:58:01.542 INFO:tasks.workunit.client.0.smithi087.stdout:4/94: truncate d4/f6 2729628 0 2024-04-25T15:58:01.547 INFO:tasks.workunit.client.0.smithi087.stdout:1/132: chown d3/ff 29854527 1 2024-04-25T15:58:01.548 INFO:tasks.workunit.client.0.smithi087.stdout:9/106: rename d6/d8/d12/l20 to d6/l22 0 2024-04-25T15:58:01.549 INFO:tasks.workunit.client.0.smithi087.stdout:2/105: truncate d3/d11/f1f 259772 0 2024-04-25T15:58:01.554 INFO:tasks.workunit.client.0.smithi087.stdout:0/91: dwrite d1/f18 [0,4194304] 0 2024-04-25T15:58:01.554 INFO:tasks.workunit.client.0.smithi087.stdout:4/95: getdents d4/d7/d15/d12 0 2024-04-25T15:58:01.560 INFO:tasks.workunit.client.0.smithi087.stdout:8/93: truncate f1 5460767 0 2024-04-25T15:58:01.561 INFO:tasks.workunit.client.0.smithi087.stdout:4/96: read - d4/d7/d15/d13/f1b zero size 2024-04-25T15:58:01.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/92: fsync d1/f3 0 2024-04-25T15:58:01.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/133: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:01.567 INFO:tasks.workunit.client.0.smithi087.stdout:2/106: truncate d3/f1e 3218169 0 2024-04-25T15:58:01.568 INFO:tasks.workunit.client.0.smithi087.stdout:5/153: dwrite f1 [0,4194304] 0 2024-04-25T15:58:01.570 INFO:tasks.workunit.client.0.smithi087.stdout:9/107: dwrite f2 [0,4194304] 0 2024-04-25T15:58:01.570 INFO:tasks.workunit.client.0.smithi087.stdout:5/154: stat d9 0 2024-04-25T15:58:01.571 INFO:tasks.workunit.client.0.smithi087.stdout:2/107: chown d3/d11/d1c 613513 1 2024-04-25T15:58:01.572 INFO:tasks.workunit.client.0.smithi087.stdout:5/155: readlink d9/l14 0 2024-04-25T15:58:01.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/134: symlink d3/d12/l21 0 2024-04-25T15:58:01.573 INFO:tasks.workunit.client.0.smithi087.stdout:6/66: dwrite d7/f18 [0,4194304] 0 2024-04-25T15:58:01.574 INFO:tasks.workunit.client.0.smithi087.stdout:9/108: write f2 [3046242,42318] 0 2024-04-25T15:58:01.579 INFO:tasks.workunit.client.0.smithi087.stdout:1/135: write d3/d12/d14/f17 [3909847,35185] 0 2024-04-25T15:58:01.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/156: mkdir d9/d2f 0 2024-04-25T15:58:01.581 INFO:tasks.workunit.client.0.smithi087.stdout:4/97: creat d4/d7/d15/f1d x:0 0 0 2024-04-25T15:58:01.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/94: dwrite d4/d9/f15 [0,4194304] 0 2024-04-25T15:58:01.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/98: dread - d4/fb zero size 2024-04-25T15:58:01.592 INFO:tasks.workunit.client.0.smithi087.stdout:5/157: mkdir d9/d2c/d30 0 2024-04-25T15:58:01.592 INFO:tasks.workunit.client.0.smithi087.stdout:6/67: mknod d7/c1e 0 2024-04-25T15:58:01.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/136: rmdir d3/d12 39 2024-04-25T15:58:01.596 INFO:tasks.workunit.client.0.smithi087.stdout:2/108: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:01.599 INFO:tasks.workunit.client.0.smithi087.stdout:0/93: dread d1/d6/f1a [0,4194304] 0 2024-04-25T15:58:01.601 INFO:tasks.workunit.client.0.smithi087.stdout:4/99: creat d4/f1e x:0 0 0 2024-04-25T15:58:01.601 INFO:tasks.workunit.client.0.smithi087.stdout:2/109: rmdir d3/d11 39 2024-04-25T15:58:01.602 INFO:tasks.workunit.client.0.smithi087.stdout:5/158: symlink d9/d2c/d30/l31 0 2024-04-25T15:58:01.602 INFO:tasks.workunit.client.0.smithi087.stdout:8/95: dwrite d4/d9/f1c [0,4194304] 0 2024-04-25T15:58:01.606 INFO:tasks.workunit.client.0.smithi087.stdout:5/159: write d9/f18 [4179050,120032] 0 2024-04-25T15:58:01.607 INFO:tasks.workunit.client.0.smithi087.stdout:5/160: read d9/fc [3489134,4635] 0 2024-04-25T15:58:01.608 INFO:tasks.workunit.client.0.smithi087.stdout:6/68: dwrite d7/f10 [0,4194304] 0 2024-04-25T15:58:01.608 INFO:tasks.workunit.client.0.smithi087.stdout:0/94: mkdir d1/d6/d21 0 2024-04-25T15:58:01.608 INFO:tasks.workunit.client.0.smithi087.stdout:9/109: dread d6/f10 [0,4194304] 0 2024-04-25T15:58:01.609 INFO:tasks.workunit.client.0.smithi087.stdout:9/110: chown f3 1 1 2024-04-25T15:58:01.609 INFO:tasks.workunit.client.0.smithi087.stdout:8/96: creat d4/d9/f23 x:0 0 0 2024-04-25T15:58:01.611 INFO:tasks.workunit.client.0.smithi087.stdout:4/100: truncate f1 1721635 0 2024-04-25T15:58:01.612 INFO:tasks.workunit.client.0.smithi087.stdout:2/110: mknod d3/d11/c22 0 2024-04-25T15:58:01.615 INFO:tasks.workunit.client.0.smithi087.stdout:9/111: unlink d6/f10 0 2024-04-25T15:58:01.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/97: symlink d4/d1d/d17/l24 0 2024-04-25T15:58:01.617 INFO:tasks.workunit.client.0.smithi087.stdout:7/110: sync 2024-04-25T15:58:01.618 INFO:tasks.workunit.client.0.smithi087.stdout:8/98: chown d4/d9/f15 47 1 2024-04-25T15:58:01.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/101: creat d4/d7/d15/d12/f1f x:0 0 0 2024-04-25T15:58:01.619 INFO:tasks.workunit.client.0.smithi087.stdout:4/102: rename d4/d7 to d4/d7/d15/d12/d20 22 2024-04-25T15:58:01.619 INFO:tasks.workunit.client.0.smithi087.stdout:6/69: mknod d7/c1f 0 2024-04-25T15:58:01.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/95: write d1/f14 [1431865,68692] 0 2024-04-25T15:58:01.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/112: fdatasync d6/d8/fc 0 2024-04-25T15:58:01.620 INFO:tasks.workunit.client.0.smithi087.stdout:4/103: chown d4/d7/f11 1941432 1 2024-04-25T15:58:01.621 INFO:tasks.workunit.client.0.smithi087.stdout:8/99: creat d4/d8/f25 x:0 0 0 2024-04-25T15:58:01.621 INFO:tasks.workunit.client.0.smithi087.stdout:2/111: truncate d3/f1e 4013109 0 2024-04-25T15:58:01.623 INFO:tasks.workunit.client.0.smithi087.stdout:4/104: read d4/d7/d15/fc [1536763,7251] 0 2024-04-25T15:58:01.624 INFO:tasks.workunit.client.0.smithi087.stdout:9/113: rename f3 to d6/d8/d14/d1d/f23 0 2024-04-25T15:58:01.625 INFO:tasks.workunit.client.0.smithi087.stdout:6/70: symlink d7/l20 0 2024-04-25T15:58:01.626 INFO:tasks.workunit.client.0.smithi087.stdout:7/111: getdents d1 0 2024-04-25T15:58:01.626 INFO:tasks.workunit.client.0.smithi087.stdout:8/100: symlink d4/d9/l26 0 2024-04-25T15:58:01.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/96: rename d1/d6/f1a to d1/d6/f22 0 2024-04-25T15:58:01.631 INFO:tasks.workunit.client.0.smithi087.stdout:4/105: dread d4/d7/d15/fc [0,4194304] 0 2024-04-25T15:58:01.632 INFO:tasks.workunit.client.0.smithi087.stdout:2/112: creat d3/f23 x:0 0 0 2024-04-25T15:58:01.634 INFO:tasks.workunit.client.0.smithi087.stdout:3/87: sync 2024-04-25T15:58:01.635 INFO:tasks.workunit.client.0.smithi087.stdout:6/71: mkdir d7/d1a/d1d/d21 0 2024-04-25T15:58:01.635 INFO:tasks.workunit.client.0.smithi087.stdout:6/72: stat d7/c1c 0 2024-04-25T15:58:01.636 INFO:tasks.workunit.client.0.smithi087.stdout:3/88: write d4/f16 [106157,70841] 0 2024-04-25T15:58:01.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/113: mkdir d3/d20/d24 0 2024-04-25T15:58:01.638 INFO:tasks.workunit.client.0.smithi087.stdout:4/106: dread d4/d7/d15/fc [0,4194304] 0 2024-04-25T15:58:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:9/114: link l4 d6/d8/d14/d1d/l24 0 2024-04-25T15:58:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:8/101: dwrite d4/d8/fb [0,4194304] 0 2024-04-25T15:58:01.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/114: write d3/f23 [862831,114162] 0 2024-04-25T15:58:01.640 INFO:tasks.workunit.client.0.smithi087.stdout:0/97: readlink d1/da/l1e 0 2024-04-25T15:58:01.641 INFO:tasks.workunit.client.0.smithi087.stdout:1/137: truncate d3/d12/d14/f17 5094702 0 2024-04-25T15:58:01.643 INFO:tasks.workunit.client.0.smithi087.stdout:8/102: write d4/d8/dd/f11 [4569993,64241] 0 2024-04-25T15:58:01.645 INFO:tasks.workunit.client.0.smithi087.stdout:1/138: write d3/d12/f1c [971679,3369] 0 2024-04-25T15:58:01.645 INFO:tasks.workunit.client.0.smithi087.stdout:3/89: symlink d4/l1f 0 2024-04-25T15:58:01.647 INFO:tasks.workunit.client.0.smithi087.stdout:1/139: dread - d3/d12/f19 zero size 2024-04-25T15:58:01.648 INFO:tasks.workunit.client.0.smithi087.stdout:6/73: creat d7/d1a/d1d/d21/f22 x:0 0 0 2024-04-25T15:58:01.649 INFO:tasks.workunit.client.0.smithi087.stdout:5/161: dwrite d9/f1c [0,4194304] 0 2024-04-25T15:58:01.649 INFO:tasks.workunit.client.0.smithi087.stdout:6/74: fdatasync d7/f14 0 2024-04-25T15:58:01.650 INFO:tasks.workunit.client.0.smithi087.stdout:1/140: write d3/f7 [4758967,21138] 0 2024-04-25T15:58:01.652 INFO:tasks.workunit.client.0.smithi087.stdout:4/107: mkdir d4/d7/d15/d21 0 2024-04-25T15:58:01.653 INFO:tasks.workunit.client.0.smithi087.stdout:8/103: rmdir d4/d8 39 2024-04-25T15:58:01.656 INFO:tasks.workunit.client.0.smithi087.stdout:3/90: dwrite d4/d14/f15 [0,4194304] 0 2024-04-25T15:58:01.657 INFO:tasks.workunit.client.0.smithi087.stdout:9/115: rename d6/d8/l9 to d6/d8/d12/l25 0 2024-04-25T15:58:01.674 INFO:tasks.workunit.client.0.smithi087.stdout:1/141: mkdir d3/d12/d22 0 2024-04-25T15:58:01.674 INFO:tasks.workunit.client.0.smithi087.stdout:2/115: dwrite d3/d11/f1b [0,4194304] 0 2024-04-25T15:58:01.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/75: mkdir d7/d1a/d1d/d21/d23 0 2024-04-25T15:58:01.678 INFO:tasks.workunit.client.0.smithi087.stdout:0/98: rename d1/f18 to d1/d6/d21/f23 0 2024-04-25T15:58:01.679 INFO:tasks.workunit.client.0.smithi087.stdout:9/116: symlink d6/d8/d12/l26 0 2024-04-25T15:58:01.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/112: dwrite d1/f8 [0,4194304] 0 2024-04-25T15:58:01.681 INFO:tasks.workunit.client.0.smithi087.stdout:1/142: fsync d3/d12/d14/f16 0 2024-04-25T15:58:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:8/104: write d4/fa [3608398,119218] 0 2024-04-25T15:58:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:7/113: chown d1/d1a 27455 1 2024-04-25T15:58:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:3/91: dread d4/f6 [0,4194304] 0 2024-04-25T15:58:01.683 INFO:tasks.workunit.client.0.smithi087.stdout:4/108: dread d4/f6 [0,4194304] 0 2024-04-25T15:58:01.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:01.684 INFO:tasks.workunit.client.0.smithi087.stdout:3/92: dread - d4/d17/f1b zero size 2024-04-25T15:58:01.684 INFO:tasks.workunit.client.0.smithi087.stdout:0/99: chown d1/da/d11/c15 281625250 1 2024-04-25T15:58:01.686 INFO:tasks.workunit.client.0.smithi087.stdout:9/117: mknod d6/d8/d12/c27 0 2024-04-25T15:58:01.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/116: creat d3/f25 x:0 0 0 2024-04-25T15:58:01.688 INFO:tasks.workunit.client.0.smithi087.stdout:2/117: write d3/f23 [1860223,56842] 0 2024-04-25T15:58:01.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/93: creat d4/d17/f20 x:0 0 0 2024-04-25T15:58:01.694 INFO:tasks.workunit.client.0.smithi087.stdout:3/94: readlink d4/l1c 0 2024-04-25T15:58:01.697 INFO:tasks.workunit.client.0.smithi087.stdout:3/95: write d4/f12 [2501983,4124] 0 2024-04-25T15:58:01.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/109: dwrite d4/d7/d15/d12/f1f [0,4194304] 0 2024-04-25T15:58:01.699 INFO:tasks.workunit.client.0.smithi087.stdout:2/118: rename d3/lc to d3/d11/l26 0 2024-04-25T15:58:01.700 INFO:tasks.workunit.client.0.smithi087.stdout:3/96: dread - d4/d17/f20 zero size 2024-04-25T15:58:01.700 INFO:tasks.workunit.client.0.smithi087.stdout:9/118: getdents d6/d8 0 2024-04-25T15:58:01.705 INFO:tasks.workunit.client.0.smithi087.stdout:8/105: dwrite d4/d8/f25 [0,4194304] 0 2024-04-25T15:58:01.705 INFO:tasks.workunit.client.0.smithi087.stdout:3/97: dread - d4/f1a zero size 2024-04-25T15:58:01.705 INFO:tasks.workunit.client.0.smithi087.stdout:9/119: rmdir d6/d8/d14 39 2024-04-25T15:58:01.705 INFO:tasks.workunit.client.0.smithi087.stdout:7/114: fdatasync d1/f8 0 2024-04-25T15:58:01.710 INFO:tasks.workunit.client.0.smithi087.stdout:4/110: mknod d4/d7/d15/d13/c22 0 2024-04-25T15:58:01.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/100: dwrite d1/f3 [4194304,4194304] 0 2024-04-25T15:58:01.710 INFO:tasks.workunit.client.0.smithi087.stdout:8/106: symlink d4/d8/l27 0 2024-04-25T15:58:01.716 INFO:tasks.workunit.client.0.smithi087.stdout:0/101: rmdir d1/d6/d21 39 2024-04-25T15:58:01.717 INFO:tasks.workunit.client.0.smithi087.stdout:2/119: truncate d3/d11/f14 4979267 0 2024-04-25T15:58:01.717 INFO:tasks.workunit.client.0.smithi087.stdout:7/115: getdents d1/d4/d18 0 2024-04-25T15:58:01.720 INFO:tasks.workunit.client.0.smithi087.stdout:4/111: dread d4/f6 [0,4194304] 0 2024-04-25T15:58:01.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/143: mknod d3/d12/d14/c23 0 2024-04-25T15:58:01.722 INFO:tasks.workunit.client.0.smithi087.stdout:7/116: chown d1/d1a/c1c 3 1 2024-04-25T15:58:01.722 INFO:tasks.workunit.client.0.smithi087.stdout:9/120: truncate d6/d8/d14/d1d/f23 919287 0 2024-04-25T15:58:01.725 INFO:tasks.workunit.client.0.smithi087.stdout:7/117: symlink d1/d9/l25 0 2024-04-25T15:58:01.725 INFO:tasks.workunit.client.0.smithi087.stdout:6/76: dwrite f6 [0,4194304] 0 2024-04-25T15:58:01.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/112: symlink d4/d10/l23 0 2024-04-25T15:58:01.727 INFO:tasks.workunit.client.0.smithi087.stdout:8/107: dread f1 [0,4194304] 0 2024-04-25T15:58:01.728 INFO:tasks.workunit.client.0.smithi087.stdout:8/108: write d4/d9/f23 [318241,34090] 0 2024-04-25T15:58:01.729 INFO:tasks.workunit.client.0.smithi087.stdout:7/118: mkdir d1/d9/d26 0 2024-04-25T15:58:01.730 INFO:tasks.workunit.client.0.smithi087.stdout:8/109: write d4/d1d/f1b [819737,62984] 0 2024-04-25T15:58:01.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/144: creat d3/f24 x:0 0 0 2024-04-25T15:58:01.732 INFO:tasks.workunit.client.0.smithi087.stdout:4/113: dread f1 [0,4194304] 0 2024-04-25T15:58:01.733 INFO:tasks.workunit.client.0.smithi087.stdout:1/145: truncate d3/d12/f19 321084 0 2024-04-25T15:58:01.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/77: creat d7/d1a/d1d/d21/d23/f24 x:0 0 0 2024-04-25T15:58:01.736 INFO:tasks.workunit.client.0.smithi087.stdout:2/120: write d3/f7 [2366754,61500] 0 2024-04-25T15:58:01.738 INFO:tasks.workunit.client.0.smithi087.stdout:4/114: creat d4/d7/f24 x:0 0 0 2024-04-25T15:58:01.739 INFO:tasks.workunit.client.0.smithi087.stdout:2/121: rmdir d3/d20 39 2024-04-25T15:58:01.740 INFO:tasks.workunit.client.0.smithi087.stdout:9/121: dread d6/d8/fa [0,4194304] 0 2024-04-25T15:58:01.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/78: write d7/f18 [860850,124773] 0 2024-04-25T15:58:01.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/115: read f1 [907067,120174] 0 2024-04-25T15:58:01.742 INFO:tasks.workunit.client.0.smithi087.stdout:8/110: rename d4/d8/f25 to d4/f28 0 2024-04-25T15:58:01.742 INFO:tasks.workunit.client.0.smithi087.stdout:2/122: chown d3/c17 16 1 2024-04-25T15:58:01.745 INFO:tasks.workunit.client.0.smithi087.stdout:9/122: symlink d6/l28 0 2024-04-25T15:58:01.746 INFO:tasks.workunit.client.0.smithi087.stdout:4/116: read d4/d7/d15/d12/f1f [1865414,58178] 0 2024-04-25T15:58:01.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/146: dwrite d3/d12/f19 [0,4194304] 0 2024-04-25T15:58:01.748 INFO:tasks.workunit.client.0.smithi087.stdout:4/117: stat d4/d7/d15/fe 0 2024-04-25T15:58:01.749 INFO:tasks.workunit.client.0.smithi087.stdout:6/79: mknod d7/d1a/d1d/d21/d23/c25 0 2024-04-25T15:58:01.753 INFO:tasks.workunit.client.0.smithi087.stdout:6/80: write d7/f10 [4595363,114595] 0 2024-04-25T15:58:01.755 INFO:tasks.workunit.client.0.smithi087.stdout:0/102: dread d1/f3 [0,4194304] 0 2024-04-25T15:58:01.756 INFO:tasks.workunit.client.0.smithi087.stdout:2/123: mkdir d3/d27 0 2024-04-25T15:58:01.756 INFO:tasks.workunit.client.0.smithi087.stdout:1/147: rename d3/d12/l1e to d3/d12/l25 0 2024-04-25T15:58:01.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/119: dread d1/d4/f12 [0,4194304] 0 2024-04-25T15:58:01.759 INFO:tasks.workunit.client.0.smithi087.stdout:8/111: dwrite d4/d9/f1a [0,4194304] 0 2024-04-25T15:58:01.762 INFO:tasks.workunit.client.0.smithi087.stdout:7/120: dread d1/f19 [0,4194304] 0 2024-04-25T15:58:01.764 INFO:tasks.workunit.client.0.smithi087.stdout:1/148: creat d3/d12/f26 x:0 0 0 2024-04-25T15:58:01.765 INFO:tasks.workunit.client.0.smithi087.stdout:7/121: dread d1/f19 [0,4194304] 0 2024-04-25T15:58:01.766 INFO:tasks.workunit.client.0.smithi087.stdout:2/124: dread d3/f23 [0,4194304] 0 2024-04-25T15:58:01.767 INFO:tasks.workunit.client.0.smithi087.stdout:7/122: write d1/d1a/f20 [908434,68155] 0 2024-04-25T15:58:01.767 INFO:tasks.workunit.client.0.smithi087.stdout:6/81: unlink d7/f13 0 2024-04-25T15:58:01.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/123: truncate f2 614234 0 2024-04-25T15:58:01.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/112: dwrite d4/d9/f23 [0,4194304] 0 2024-04-25T15:58:01.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/103: creat d1/d6/d21/f24 x:0 0 0 2024-04-25T15:58:01.777 INFO:tasks.workunit.client.0.smithi087.stdout:2/125: getdents d3/d27 0 2024-04-25T15:58:01.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/149: creat d3/d12/d14/f27 x:0 0 0 2024-04-25T15:58:01.783 INFO:tasks.workunit.client.0.smithi087.stdout:0/104: creat d1/da/d11/f25 x:0 0 0 2024-04-25T15:58:01.783 INFO:tasks.workunit.client.0.smithi087.stdout:4/118: dwrite d4/d7/d15/d13/f1b [0,4194304] 0 2024-04-25T15:58:01.786 INFO:tasks.workunit.client.0.smithi087.stdout:1/150: chown d3/d12/f26 39 1 2024-04-25T15:58:01.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/123: dwrite d1/fd [0,4194304] 0 2024-04-25T15:58:01.786 INFO:tasks.workunit.client.0.smithi087.stdout:8/113: dread d4/d8/fb [0,4194304] 0 2024-04-25T15:58:01.788 INFO:tasks.workunit.client.0.smithi087.stdout:2/126: dread d3/f23 [0,4194304] 0 2024-04-25T15:58:01.790 INFO:tasks.workunit.client.0.smithi087.stdout:1/151: write d3/f4 [357348,29238] 0 2024-04-25T15:58:01.792 INFO:tasks.workunit.client.0.smithi087.stdout:9/124: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:01.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/125: write d6/f1f [389067,61352] 0 2024-04-25T15:58:01.794 INFO:tasks.workunit.client.0.smithi087.stdout:6/82: link f5 d7/d1a/d1d/d21/f26 0 2024-04-25T15:58:01.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/114: mknod d4/d1d/c29 0 2024-04-25T15:58:01.799 INFO:tasks.workunit.client.0.smithi087.stdout:1/152: rmdir d3 39 2024-04-25T15:58:01.800 INFO:tasks.workunit.client.0.smithi087.stdout:7/124: fsync d1/d4/f12 0 2024-04-25T15:58:01.800 INFO:tasks.workunit.client.0.smithi087.stdout:8/115: chown d4/d8/dd/f11 5 1 2024-04-25T15:58:01.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/105: write d1/d6/fe [487944,72740] 0 2024-04-25T15:58:01.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/126: mkdir d6/d8/d29 0 2024-04-25T15:58:01.804 INFO:tasks.workunit.client.0.smithi087.stdout:7/125: read d1/d1a/f20 [395883,31607] 0 2024-04-25T15:58:01.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/153: write d3/d12/d14/f27 [441463,25307] 0 2024-04-25T15:58:01.806 INFO:tasks.workunit.client.0.smithi087.stdout:0/106: fsync d1/d6/f8 0 2024-04-25T15:58:01.806 INFO:tasks.workunit.client.0.smithi087.stdout:5/162: sync 2024-04-25T15:58:01.807 INFO:tasks.workunit.client.0.smithi087.stdout:9/127: fsync f0 0 2024-04-25T15:58:01.809 INFO:tasks.workunit.client.0.smithi087.stdout:7/126: creat d1/d1a/f27 x:0 0 0 2024-04-25T15:58:01.811 INFO:tasks.workunit.client.0.smithi087.stdout:1/154: chown d3/f1b 2 1 2024-04-25T15:58:01.811 INFO:tasks.workunit.client.0.smithi087.stdout:9/128: fdatasync d6/f1f 0 2024-04-25T15:58:01.812 INFO:tasks.workunit.client.0.smithi087.stdout:2/127: write d3/f1e [57039,20491] 0 2024-04-25T15:58:01.812 INFO:tasks.workunit.client.0.smithi087.stdout:4/119: dwrite d4/d7/d15/d12/f1f [0,4194304] 0 2024-04-25T15:58:01.815 INFO:tasks.workunit.client.0.smithi087.stdout:7/127: unlink d1/d1a/f27 0 2024-04-25T15:58:01.816 INFO:tasks.workunit.client.0.smithi087.stdout:0/107: creat d1/f26 x:0 0 0 2024-04-25T15:58:01.830 INFO:tasks.workunit.client.0.smithi087.stdout:5/163: dread d9/f1e [0,4194304] 0 2024-04-25T15:58:01.831 INFO:tasks.workunit.client.0.smithi087.stdout:4/120: symlink d4/d10/l25 0 2024-04-25T15:58:01.832 INFO:tasks.workunit.client.0.smithi087.stdout:6/83: mkdir d7/d1a/d1d/d21/d27 0 2024-04-25T15:58:01.832 INFO:tasks.workunit.client.0.smithi087.stdout:9/129: chown d6/d8/d14/l16 12440 1 2024-04-25T15:58:01.835 INFO:tasks.workunit.client.0.smithi087.stdout:9/130: stat d6/l28 0 2024-04-25T15:58:01.835 INFO:tasks.workunit.client.0.smithi087.stdout:8/116: dwrite f1 [0,4194304] 0 2024-04-25T15:58:01.835 INFO:tasks.workunit.client.0.smithi087.stdout:2/128: write d3/d11/f1f [703035,110446] 0 2024-04-25T15:58:01.837 INFO:tasks.workunit.client.0.smithi087.stdout:0/108: mkdir d1/d27 0 2024-04-25T15:58:01.839 INFO:tasks.workunit.client.0.smithi087.stdout:9/131: fsync d6/d8/fc 0 2024-04-25T15:58:01.840 INFO:tasks.workunit.client.0.smithi087.stdout:1/155: link d3/d12/c15 d3/d12/c28 0 2024-04-25T15:58:01.845 INFO:tasks.workunit.client.0.smithi087.stdout:7/128: dwrite d1/d1a/f24 [0,4194304] 0 2024-04-25T15:58:01.846 INFO:tasks.workunit.client.0.smithi087.stdout:8/117: creat d4/d22/f2a x:0 0 0 2024-04-25T15:58:01.848 INFO:tasks.workunit.client.0.smithi087.stdout:0/109: mknod d1/c28 0 2024-04-25T15:58:01.848 INFO:tasks.workunit.client.0.smithi087.stdout:6/84: dread f6 [0,4194304] 0 2024-04-25T15:58:01.848 INFO:tasks.workunit.client.0.smithi087.stdout:5/164: dwrite d9/f28 [0,4194304] 0 2024-04-25T15:58:01.848 INFO:tasks.workunit.client.0.smithi087.stdout:8/118: fdatasync d4/d22/f2a 0 2024-04-25T15:58:01.849 INFO:tasks.workunit.client.0.smithi087.stdout:5/165: fsync d9/d2c/f2e 0 2024-04-25T15:58:01.851 INFO:tasks.workunit.client.0.smithi087.stdout:5/166: read - d9/f1f zero size 2024-04-25T15:58:01.851 INFO:tasks.workunit.client.0.smithi087.stdout:1/156: mkdir d3/d12/d14/d29 0 2024-04-25T15:58:01.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/110: write d1/da/d11/f25 [360021,62158] 0 2024-04-25T15:58:01.856 INFO:tasks.workunit.client.0.smithi087.stdout:4/121: getdents d4/d7 0 2024-04-25T15:58:01.859 INFO:tasks.workunit.client.0.smithi087.stdout:2/129: truncate d3/d11/f14 4672105 0 2024-04-25T15:58:01.860 INFO:tasks.workunit.client.0.smithi087.stdout:6/85: read f5 [312456,36590] 0 2024-04-25T15:58:01.861 INFO:tasks.workunit.client.0.smithi087.stdout:1/157: write d3/f24 [287373,58546] 0 2024-04-25T15:58:01.861 INFO:tasks.workunit.client.0.smithi087.stdout:8/119: fsync d4/d8/fb 0 2024-04-25T15:58:01.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/129: dwrite d1/d4/f10 [0,4194304] 0 2024-04-25T15:58:01.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/158: mknod d3/d12/d14/c2a 0 2024-04-25T15:58:01.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/167: dwrite d9/f21 [0,4194304] 0 2024-04-25T15:58:01.881 INFO:tasks.workunit.client.0.smithi087.stdout:0/111: dwrite d1/d6/d1b/f20 [0,4194304] 0 2024-04-25T15:58:01.883 INFO:tasks.workunit.client.0.smithi087.stdout:6/86: rename d7/f9 to d7/d1a/d1d/f28 0 2024-04-25T15:58:01.884 INFO:tasks.workunit.client.0.smithi087.stdout:7/130: symlink d1/d9/d26/l28 0 2024-04-25T15:58:01.887 INFO:tasks.workunit.client.0.smithi087.stdout:2/130: dwrite d3/d11/f1f [0,4194304] 0 2024-04-25T15:58:01.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/168: mknod d9/d2f/c32 0 2024-04-25T15:58:01.889 INFO:tasks.workunit.client.0.smithi087.stdout:4/122: dwrite d4/d7/d15/d12/f1c [0,4194304] 0 2024-04-25T15:58:01.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f867a200640 1 Processor -- start 2024-04-25T15:58:01.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f867a200640 1 -- start start 2024-04-25T15:58:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:8/120: dwrite d4/d9/f1c [0,4194304] 0 2024-04-25T15:58:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f867a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 0x7f86740cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f867a200640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867415ba10 con 0x7f86740ca7a0 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f867a200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86740cabb0 con 0x7f867406d5f0 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f867a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f867415c8b0 con 0x7f86741592d0 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f8672ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f86740ca7a0 0x7f867415c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55352/0 (socket says 172.21.15.87:55352) 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f8672ffd640 1 -- 172.21.15.87:0/715941200 learned_addr learned my addr 172.21.15.87:0/715941200 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86737fe640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 0x7f86740cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227217218 0 0) 0x7f867415ba10 con 0x7f86740ca7a0 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f865c003530 con 0x7f86740ca7a0 2024-04-25T15:58:01.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689443492 0 0) 0x7f865c003530 con 0x7f86740ca7a0 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 msgr2=0x7f86740cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86727fc640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 0x7f86740cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.887+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 >> v1:172.21.15.155:6789/0 conn(0x7f867406d5f0 legacy=0x7f86741661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86740b2250 con 0x7f86740ca7a0 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f8664001680 con 0x7f86740ca7a0 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 >> v1:172.21.15.87:6789/0 conn(0x7f86740ca7a0 legacy=0x7f867415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:01.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f865c0039f0 0x7f865c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.894 INFO:tasks.workunit.client.0.smithi087.stdout:7/131: creat d1/d4/f29 x:0 0 0 2024-04-25T15:58:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f865c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 0x7f865c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f867415c8b0 con 0x7f865c004810 2024-04-25T15:58:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f865c00bb60 con 0x7f865c0039f0 2024-04-25T15:58:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f865c00bd30 con 0x7f86741592d0 2024-04-25T15:58:01.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f865c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8673fff640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 0x7f865c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 -- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 msgr2=0x7f865c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86741592d0 0x7f865c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 -- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f865c0039f0 msgr2=0x7f865c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f865c0039f0 0x7f865c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:01.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 -- 172.21.15.87:0/715941200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86740b2250 con 0x7f865c004810 2024-04-25T15:58:01.896 INFO:tasks.workunit.client.0.smithi087.stdout:5/169: read - f3 zero size 2024-04-25T15:58:01.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f8672ffd640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f865c004c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f866400c370 tx=0x7f866401cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f6bf1dc52557a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:01.897 INFO:tasks.workunit.client.0.smithi087.stdout:4/123: mkdir d4/d7/d26 0 2024-04-25T15:58:01.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664007e30 con 0x7f865c004810 2024-04-25T15:58:01.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86640a9070 con 0x7f865c004810 2024-04-25T15:58:01.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.891+0000 7f86727fc640 1 -- 172.21.15.87:0/715941200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664005d00 con 0x7f865c004810 2024-04-25T15:58:01.898 INFO:tasks.workunit.client.0.smithi087.stdout:5/170: fdatasync d9/f1a 0 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 -- 172.21.15.87:0/715941200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 msgr2=0x7f865c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 --2- 172.21.15.87:0/715941200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f865c004c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f866400c370 tx=0x7f866401cde0 comp rx=0 tx=0).stop 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f8673fff640 1 -- 172.21.15.87:0/715941200 reap_dead start 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 -- 172.21.15.87:0/715941200 shutdown_connections 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 -- 172.21.15.87:0/715941200 >> 172.21.15.87:0/715941200 conn(0x7f86740cc8a0 msgr2=0x7f86740cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 -- 172.21.15.87:0/715941200 shutdown_connections 2024-04-25T15:58:01.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 -- 172.21.15.87:0/715941200 wait complete. 2024-04-25T15:58:01.899 INFO:tasks.workunit.client.0.smithi087.stdout:0/112: dwrite d1/d6/d1b/f20 [0,4194304] 0 2024-04-25T15:58:01.900 INFO:tasks.workunit.client.0.smithi087.stdout:5/171: truncate d9/f22 142934 0 2024-04-25T15:58:01.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 Processor -- start 2024-04-25T15:58:01.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.895+0000 7f867a200640 1 -- start start 2024-04-25T15:58:01.901 INFO:tasks.workunit.client.0.smithi087.stdout:1/159: truncate d3/d12/d14/f16 130454 0 2024-04-25T15:58:01.901 INFO:tasks.workunit.client.0.smithi087.stdout:8/121: dread d4/d8/fb [0,4194304] 0 2024-04-25T15:58:01.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f86741f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8674153380 0x7f86740c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674153790 0x7f86740c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f867406de10 con 0x7f865c004810 2024-04-25T15:58:01.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86740cb780 con 0x7f8674153790 2024-04-25T15:58:01.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86740b27d0 con 0x7f8674153380 2024-04-25T15:58:01.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f86741f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:01.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f86741f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58106/0 (socket says 172.21.15.87:58106) 2024-04-25T15:58:01.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 -- 172.21.15.87:0/2739823071 learned_addr learned my addr 172.21.15.87:0/2739823071 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:01.904 INFO:tasks.workunit.client.0.smithi087.stdout:8/122: chown d4/d1d/d17/l24 126910731 1 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f8672ffd640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8674153380 0x7f86740c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 -- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8674153380 msgr2=0x7f86740c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8674153380 0x7f86740c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 -- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674153790 msgr2=0x7f86740c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674153790 0x7f86740c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 -- 172.21.15.87:0/2739823071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8674151540 con 0x7f865c004810 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f86737fe640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f86741f7b40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f866800e7c0 tx=0x7f866800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668017070 con 0x7f865c004810 2024-04-25T15:58:01.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866800c860 con 0x7f865c004810 2024-04-25T15:58:01.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866800cc50 con 0x7f865c004810 2024-04-25T15:58:01.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86740c3af0 con 0x7f865c004810 2024-04-25T15:58:01.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.899+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8674153e00 con 0x7f865c004810 2024-04-25T15:58:01.906 INFO:tasks.workunit.client.0.smithi087.stdout:7/132: dwrite d1/d4/d18/f1b [0,4194304] 0 2024-04-25T15:58:01.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.903+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8674069bb0 con 0x7f865c004810 2024-04-25T15:58:01.907 INFO:tasks.workunit.client.0.smithi087.stdout:2/131: link d3/f23 d3/d11/d1c/f28 0 2024-04-25T15:58:01.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.903+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f866801a070 con 0x7f865c004810 2024-04-25T15:58:01.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.903+0000 7f865bfff640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f866006f430 0x7f8660071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:01.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.903+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7039+0+0 (secure 0 0 0) 0x7f866808f9e0 con 0x7f865c004810 2024-04-25T15:58:01.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.903+0000 7f8672ffd640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f866006f430 0x7f8660071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:01.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.903+0000 7f8672ffd640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f866006f430 0x7f8660071940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f86640ab000 tx=0x7f86640b0040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:01.910 INFO:tasks.workunit.client.0.smithi087.stdout:0/113: fsync d1/f5 0 2024-04-25T15:58:01.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/124: mkdir d4/d27 0 2024-04-25T15:58:01.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/172: dwrite d9/f1f [0,4194304] 0 2024-04-25T15:58:01.914 INFO:tasks.workunit.client.0.smithi087.stdout:7/133: creat d1/d4/d18/f2a x:0 0 0 2024-04-25T15:58:01.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:01.911+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f866805c3b0 con 0x7f865c004810 2024-04-25T15:58:01.919 INFO:tasks.workunit.client.0.smithi087.stdout:8/123: link f1 d4/d8/dd/f2b 0 2024-04-25T15:58:01.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/173: creat d9/f33 x:0 0 0 2024-04-25T15:58:01.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/125: creat d4/d7/d15/d21/f28 x:0 0 0 2024-04-25T15:58:01.921 INFO:tasks.workunit.client.0.smithi087.stdout:8/124: rmdir d4/d22 39 2024-04-25T15:58:01.923 INFO:tasks.workunit.client.0.smithi087.stdout:5/174: readlink d9/d2c/d30/l31 0 2024-04-25T15:58:01.923 INFO:tasks.workunit.client.0.smithi087.stdout:1/160: creat d3/d12/d14/f2b x:0 0 0 2024-04-25T15:58:01.923 INFO:tasks.workunit.client.0.smithi087.stdout:0/114: rename d1/da/l1e to d1/l29 0 2024-04-25T15:58:01.924 INFO:tasks.workunit.client.0.smithi087.stdout:4/126: chown d4/d7/d15/f1a 24 1 2024-04-25T15:58:01.924 INFO:tasks.workunit.client.0.smithi087.stdout:8/125: write d4/fa [3506423,1715] 0 2024-04-25T15:58:01.927 INFO:tasks.workunit.client.0.smithi087.stdout:7/134: dwrite d1/d4/d18/f1b [0,4194304] 0 2024-04-25T15:58:01.927 INFO:tasks.workunit.client.0.smithi087.stdout:5/175: unlink d9/f18 0 2024-04-25T15:58:01.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/127: symlink d4/l29 0 2024-04-25T15:58:01.932 INFO:tasks.workunit.client.0.smithi087.stdout:5/176: mknod d9/d2c/d30/c34 0 2024-04-25T15:58:01.937 INFO:tasks.workunit.client.0.smithi087.stdout:1/161: dwrite d3/d12/f19 [0,4194304] 0 2024-04-25T15:58:01.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/177: mknod d9/c35 0 2024-04-25T15:58:01.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/135: dread f0 [12582912,4194304] 0 2024-04-25T15:58:01.938 INFO:tasks.workunit.client.0.smithi087.stdout:5/178: rename d9/d2c to d9/d2c/d36 22 2024-04-25T15:58:01.938 INFO:tasks.workunit.client.0.smithi087.stdout:8/126: dwrite d4/d9/f15 [0,4194304] 0 2024-04-25T15:58:01.942 INFO:tasks.workunit.client.0.smithi087.stdout:5/179: readlink d9/d2c/d30/l31 0 2024-04-25T15:58:01.944 INFO:tasks.workunit.client.0.smithi087.stdout:7/136: symlink d1/d4/d18/l2b 0 2024-04-25T15:58:01.948 INFO:tasks.workunit.client.0.smithi087.stdout:2/132: fsync d3/d11/d1c/f28 0 2024-04-25T15:58:01.948 INFO:tasks.workunit.client.0.smithi087.stdout:8/127: rename d4/d1d/f1b to d4/d1d/d14/f2c 0 2024-04-25T15:58:01.950 INFO:tasks.workunit.client.0.smithi087.stdout:0/115: readlink d1/l29 0 2024-04-25T15:58:01.951 INFO:tasks.workunit.client.0.smithi087.stdout:1/162: dwrite d3/d12/f1c [0,4194304] 0 2024-04-25T15:58:01.952 INFO:tasks.workunit.client.0.smithi087.stdout:7/137: rename d1/d4/l6 to d1/d4/d18/l2c 0 2024-04-25T15:58:01.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/180: dread d9/f1e [0,4194304] 0 2024-04-25T15:58:01.953 INFO:tasks.workunit.client.0.smithi087.stdout:8/128: unlink d4/d8/l27 0 2024-04-25T15:58:01.953 INFO:tasks.workunit.client.0.smithi087.stdout:7/138: dread - d1/d4/d18/f2a zero size 2024-04-25T15:58:01.956 INFO:tasks.workunit.client.0.smithi087.stdout:2/133: getdents d3/d20/d24 0 2024-04-25T15:58:01.956 INFO:tasks.workunit.client.0.smithi087.stdout:5/181: mknod d9/d2c/d30/c37 0 2024-04-25T15:58:01.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/163: getdents d3/d12/d14/d29 0 2024-04-25T15:58:01.957 INFO:tasks.workunit.client.0.smithi087.stdout:2/134: fsync d3/f1e 0 2024-04-25T15:58:01.957 INFO:tasks.workunit.client.0.smithi087.stdout:5/182: readlink d9/l24 0 2024-04-25T15:58:01.957 INFO:tasks.workunit.client.0.smithi087.stdout:8/129: creat d4/d1d/d17/f2d x:0 0 0 2024-04-25T15:58:01.961 INFO:tasks.workunit.client.0.smithi087.stdout:7/139: dread f0 [12582912,4194304] 0 2024-04-25T15:58:01.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/140: chown d1/d4/d18 15154137 1 2024-04-25T15:58:01.963 INFO:tasks.workunit.client.0.smithi087.stdout:8/130: creat d4/d1d/d17/f2e x:0 0 0 2024-04-25T15:58:01.964 INFO:tasks.workunit.client.0.smithi087.stdout:1/164: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:01.966 INFO:tasks.workunit.client.0.smithi087.stdout:1/165: fsync d3/f7 0 2024-04-25T15:58:01.966 INFO:tasks.workunit.client.0.smithi087.stdout:2/135: getdents d3/d20 0 2024-04-25T15:58:01.966 INFO:tasks.workunit.client.0.smithi087.stdout:4/128: dwrite d4/d7/d15/fe [0,4194304] 0 2024-04-25T15:58:01.966 INFO:tasks.workunit.client.0.smithi087.stdout:8/131: chown d4/d9/f15 5 1 2024-04-25T15:58:01.967 INFO:tasks.workunit.client.0.smithi087.stdout:7/141: truncate d1/d4/f29 987071 0 2024-04-25T15:58:01.968 INFO:tasks.workunit.client.0.smithi087.stdout:1/166: chown d3/f7 1 1 2024-04-25T15:58:01.969 INFO:tasks.workunit.client.0.smithi087.stdout:1/167: chown d3/f7 384649929 1 2024-04-25T15:58:01.973 INFO:tasks.workunit.client.0.smithi087.stdout:2/136: dread d3/fd [0,4194304] 0 2024-04-25T15:58:01.974 INFO:tasks.workunit.client.0.smithi087.stdout:7/142: rename d1/c1e to d1/d9/d26/c2d 0 2024-04-25T15:58:01.978 INFO:tasks.workunit.client.0.smithi087.stdout:8/132: dwrite d4/d22/f2a [0,4194304] 0 2024-04-25T15:58:01.980 INFO:tasks.workunit.client.0.smithi087.stdout:3/98: sync 2024-04-25T15:58:01.981 INFO:tasks.workunit.client.0.smithi087.stdout:8/133: rmdir d4/d8 39 2024-04-25T15:58:01.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/183: truncate d9/fa 2870112 0 2024-04-25T15:58:01.985 INFO:tasks.workunit.client.0.smithi087.stdout:3/99: creat d4/d14/f21 x:0 0 0 2024-04-25T15:58:01.986 INFO:tasks.workunit.client.0.smithi087.stdout:8/134: fsync d4/d8/dd/f11 0 2024-04-25T15:58:01.986 INFO:tasks.workunit.client.0.smithi087.stdout:5/184: mkdir d9/d2c/d38 0 2024-04-25T15:58:01.989 INFO:tasks.workunit.client.0.smithi087.stdout:2/137: write d3/d11/f14 [3386696,97227] 0 2024-04-25T15:58:01.990 INFO:tasks.workunit.client.0.smithi087.stdout:2/138: fdatasync d3/f23 0 2024-04-25T15:58:01.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/139: stat d3/d11/f14 0 2024-04-25T15:58:01.992 INFO:tasks.workunit.client.0.smithi087.stdout:1/168: link d3/d12/d14/c23 d3/c2c 0 2024-04-25T15:58:01.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/129: dwrite d4/f6 [0,4194304] 0 2024-04-25T15:58:01.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/185: symlink d9/d2f/l39 0 2024-04-25T15:58:01.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/186: fdatasync d9/f25 0 2024-04-25T15:58:01.997 INFO:tasks.workunit.client.0.smithi087.stdout:8/135: dwrite d4/fa [0,4194304] 0 2024-04-25T15:58:01.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/100: creat d4/db/f22 x:0 0 0 2024-04-25T15:58:01.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/101: readlink d4/l1f 0 2024-04-25T15:58:01.999 INFO:tasks.workunit.client.0.smithi087.stdout:2/140: mkdir d3/d27/d29 0 2024-04-25T15:58:01.999 INFO:tasks.workunit.client.0.smithi087.stdout:1/169: mkdir d3/d2d 0 2024-04-25T15:58:02.000 INFO:tasks.workunit.client.0.smithi087.stdout:8/136: stat d4/d1d/c21 0 2024-04-25T15:58:02.002 INFO:tasks.workunit.client.0.smithi087.stdout:7/143: dwrite d1/d1a/f24 [0,4194304] 0 2024-04-25T15:58:02.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/102: mkdir d4/d14/d23 0 2024-04-25T15:58:02.004 INFO:tasks.workunit.client.0.smithi087.stdout:3/103: chown d4/d17/f20 82 1 2024-04-25T15:58:02.014 INFO:tasks.workunit.client.0.smithi087.stdout:7/144: symlink d1/d4/d18/l2e 0 2024-04-25T15:58:02.094 INFO:tasks.workunit.client.0.smithi087.stdout:2/141: rename d3/d11 to d3/d2a 0 2024-04-25T15:58:02.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/130: write d4/d7/d15/fc [4675301,10368] 0 2024-04-25T15:58:02.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/137: truncate d4/fa 629276 0 2024-04-25T15:58:02.102 INFO:tasks.workunit.client.0.smithi087.stdout:3/104: write d4/db/fe [3254536,5288] 0 2024-04-25T15:58:02.104 INFO:tasks.workunit.client.0.smithi087.stdout:1/170: dread d3/f9 [4194304,4194304] 0 2024-04-25T15:58:02.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/105: mkdir d4/d17/d24 0 2024-04-25T15:58:02.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/106: chown d4/f12 4003 1 2024-04-25T15:58:02.115 INFO:tasks.workunit.client.0.smithi087.stdout:3/107: dread - d4/d17/f1e zero size 2024-04-25T15:58:02.116 INFO:tasks.workunit.client.0.smithi087.stdout:4/131: link d4/d7/d15/f1d d4/d7/d15/d12/f2a 0 2024-04-25T15:58:02.118 INFO:tasks.workunit.client.0.smithi087.stdout:1/171: symlink d3/d12/d22/l2e 0 2024-04-25T15:58:02.121 INFO:tasks.workunit.client.0.smithi087.stdout:2/142: dwrite d3/f23 [0,4194304] 0 2024-04-25T15:58:02.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/138: dread d4/d22/f2a [0,4194304] 0 2024-04-25T15:58:02.123 INFO:tasks.workunit.client.0.smithi087.stdout:2/143: fdatasync d3/f25 0 2024-04-25T15:58:02.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/139: chown d4/d1d/d17/f2e 32 1 2024-04-25T15:58:02.128 INFO:tasks.workunit.client.0.smithi087.stdout:9/132: sync 2024-04-25T15:58:02.128 INFO:tasks.workunit.client.0.smithi087.stdout:3/108: unlink d4/d14/f21 0 2024-04-25T15:58:02.129 INFO:tasks.workunit.client.0.smithi087.stdout:1/172: read d3/d12/d14/f18 [1042187,663] 0 2024-04-25T15:58:02.130 INFO:tasks.workunit.client.0.smithi087.stdout:7/145: getdents d1/d9/d26 0 2024-04-25T15:58:02.135 INFO:tasks.workunit.client.0.smithi087.stdout:4/132: write d4/d7/d15/f1d [279526,4859] 0 2024-04-25T15:58:02.136 INFO:tasks.workunit.client.0.smithi087.stdout:4/133: chown f1 0 1 2024-04-25T15:58:02.137 INFO:tasks.workunit.client.0.smithi087.stdout:4/134: write d4/d7/d15/d12/f2a [304438,27588] 0 2024-04-25T15:58:02.142 INFO:tasks.workunit.client.0.smithi087.stdout:8/140: mkdir d4/d8/dd/d2f 0 2024-04-25T15:58:02.143 INFO:tasks.workunit.client.0.smithi087.stdout:9/133: readlink l4 0 2024-04-25T15:58:02.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.147+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8674152cc0 con 0x7f865c004810 2024-04-25T15:58:02.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f865bfff640 1 -- 172.21.15.87:0/2739823071 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5667 (secure 0 0 0) 0x7f866805bcb0 con 0x7f865c004810 2024-04-25T15:58:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:02.154 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:55:37.257991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.87:6835/1293807006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1293807006},{"type":"v1","addr":"172.21.15.87:6835","nonce":1293807006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5262,"qdb_cluster":[5262]},"id":2}]} 2024-04-25T15:58:02.154 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 35 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f866006f430 msgr2=0x7f8660071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f866006f430 0x7f8660071940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f86640ab000 tx=0x7f86640b0040 comp rx=0 tx=0).stop 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 msgr2=0x7f86741f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f86741f7b40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f866800e7c0 tx=0x7f866800ec80 comp rx=0 tx=0).stop 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 shutdown_connections 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f866006f430 0x7f8660071940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:02.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8674153790 0x7f86740c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:02.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8674153380 0x7f86740c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:02.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 --2- 172.21.15.87:0/2739823071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f865c004810 0x7f86741f7b40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:02.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 >> 172.21.15.87:0/2739823071 conn(0x7f86740cc8a0 msgr2=0x7f86740cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:02.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 shutdown_connections 2024-04-25T15:58:02.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:02.151+0000 7f867a200640 1 -- 172.21.15.87:0/2739823071 wait complete. 2024-04-25T15:58:02.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/144: unlink d3/cf 0 2024-04-25T15:58:02.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/145: rename d3 to d3/d20/d2b 22 2024-04-25T15:58:02.158 INFO:tasks.workunit.client.0.smithi087.stdout:8/141: mknod d4/d22/c30 0 2024-04-25T15:58:02.160 INFO:tasks.workunit.client.0.smithi087.stdout:3/109: mkdir d4/d17/d24/d25 0 2024-04-25T15:58:02.165 INFO:tasks.workunit.client.0.smithi087.stdout:7/146: truncate d1/d4/f12 1703769 0 2024-04-25T15:58:02.167 INFO:tasks.workunit.client.0.smithi087.stdout:2/146: unlink d3/d2a/d1c/f28 0 2024-04-25T15:58:02.173 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T15:58:02.192 INFO:tasks.workunit.client.0.smithi087.stdout:9/134: creat d6/d8/d29/f2a x:0 0 0 2024-04-25T15:58:02.193 INFO:tasks.workunit.client.0.smithi087.stdout:8/142: unlink d4/d8/c1e 0 2024-04-25T15:58:02.193 INFO:tasks.workunit.client.0.smithi087.stdout:3/110: rmdir d4 39 2024-04-25T15:58:02.193 INFO:tasks.workunit.client.0.smithi087.stdout:7/147: mkdir d1/d1a/d2f 0 2024-04-25T15:58:02.193 INFO:tasks.workunit.client.0.smithi087.stdout:2/147: write d3/d2a/f1f [3309624,128606] 0 2024-04-25T15:58:02.194 INFO:tasks.workunit.client.0.smithi087.stdout:1/173: truncate d3/d12/f19 1289014 0 2024-04-25T15:58:02.195 INFO:tasks.workunit.client.0.smithi087.stdout:8/143: read d4/d1d/d14/f2c [236253,31727] 0 2024-04-25T15:58:02.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/148: creat d1/d9/d26/f30 x:0 0 0 2024-04-25T15:58:02.201 INFO:tasks.workunit.client.0.smithi087.stdout:3/111: dread d4/f19 [0,4194304] 0 2024-04-25T15:58:02.207 INFO:tasks.workunit.client.0.smithi087.stdout:9/135: unlink d6/d8/d12/c27 0 2024-04-25T15:58:02.208 INFO:tasks.workunit.client.0.smithi087.stdout:8/144: readlink d4/d8/le 0 2024-04-25T15:58:02.218 INFO:tasks.workunit.client.0.smithi087.stdout:7/149: unlink d1/d9/d26/l28 0 2024-04-25T15:58:02.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/145: creat d4/d1d/d14/f31 x:0 0 0 2024-04-25T15:58:02.225 INFO:tasks.workunit.client.0.smithi087.stdout:8/146: read d4/d9/f1c [4033558,79245] 0 2024-04-25T15:58:02.226 INFO:tasks.workunit.client.0.smithi087.stdout:2/148: rmdir d3/d20/d24 0 2024-04-25T15:58:02.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/174: dwrite d3/f9 [4194304,4194304] 0 2024-04-25T15:58:02.229 INFO:tasks.workunit.client.0.smithi087.stdout:3/112: link d4/db/f22 d4/d14/d23/f26 0 2024-04-25T15:58:02.231 INFO:tasks.workunit.client.0.smithi087.stdout:9/136: truncate f0 5127422 0 2024-04-25T15:58:02.233 INFO:tasks.workunit.client.0.smithi087.stdout:8/147: readlink d4/l7 0 2024-04-25T15:58:02.234 INFO:tasks.workunit.client.0.smithi087.stdout:7/150: symlink d1/d1a/d2f/l31 0 2024-04-25T15:58:02.236 INFO:tasks.workunit.client.0.smithi087.stdout:3/113: mkdir d4/d17/d27 0 2024-04-25T15:58:02.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/114: read - d4/d17/f1e zero size 2024-04-25T15:58:02.237 INFO:tasks.workunit.client.0.smithi087.stdout:9/137: rmdir d6/d8/d29 39 2024-04-25T15:58:02.239 INFO:tasks.workunit.client.0.smithi087.stdout:6/87: sync 2024-04-25T15:58:02.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/148: mknod d4/d1d/d17/c32 0 2024-04-25T15:58:02.242 INFO:tasks.workunit.client.0.smithi087.stdout:2/149: creat d3/d27/d29/f2c x:0 0 0 2024-04-25T15:58:02.244 INFO:tasks.workunit.client.0.smithi087.stdout:1/175: mkdir d3/d12/d14/d29/d2f 0 2024-04-25T15:58:02.247 INFO:tasks.workunit.client.0.smithi087.stdout:9/138: write d6/d8/d29/f2a [703692,62395] 0 2024-04-25T15:58:02.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/139: chown d6/d8/d14/l16 106078529 1 2024-04-25T15:58:02.251 INFO:tasks.workunit.client.0.smithi087.stdout:7/151: mknod d1/c32 0 2024-04-25T15:58:02.253 INFO:tasks.workunit.client.0.smithi087.stdout:2/150: unlink d3/l19 0 2024-04-25T15:58:02.255 INFO:tasks.workunit.client.0.smithi087.stdout:3/115: unlink d4/c7 0 2024-04-25T15:58:02.258 INFO:tasks.workunit.client.0.smithi087.stdout:8/149: dwrite d4/f28 [0,4194304] 0 2024-04-25T15:58:02.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/116: truncate d4/d14/f15 4971150 0 2024-04-25T15:58:02.260 INFO:tasks.workunit.client.0.smithi087.stdout:3/117: dread - d4/f1a zero size 2024-04-25T15:58:02.261 INFO:tasks.workunit.client.0.smithi087.stdout:1/176: creat d3/d12/d14/f30 x:0 0 0 2024-04-25T15:58:02.261 INFO:tasks.workunit.client.0.smithi087.stdout:6/88: dread d7/f14 [0,4194304] 0 2024-04-25T15:58:02.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/140: creat d6/f2b x:0 0 0 2024-04-25T15:58:02.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/141: fdatasync d6/d8/fa 0 2024-04-25T15:58:02.270 INFO:tasks.workunit.client.0.smithi087.stdout:3/118: mkdir d4/db/d28 0 2024-04-25T15:58:02.271 INFO:tasks.workunit.client.0.smithi087.stdout:3/119: dread - d4/d17/f1b zero size 2024-04-25T15:58:02.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/120: mkdir d4/d17/d24/d29 0 2024-04-25T15:58:02.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/151: dread d3/d2a/f13 [0,4194304] 0 2024-04-25T15:58:02.277 INFO:tasks.workunit.client.0.smithi087.stdout:9/142: getdents d6/d8/d14 0 2024-04-25T15:58:02.279 INFO:tasks.workunit.client.0.smithi087.stdout:1/177: truncate d3/d12/f19 2100896 0 2024-04-25T15:58:02.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/152: write d3/d2a/f13 [3291807,65860] 0 2024-04-25T15:58:02.281 INFO:tasks.workunit.client.0.smithi087.stdout:9/143: mknod d6/d8/d12/c2c 0 2024-04-25T15:58:02.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/178: dread d3/f7 [4194304,4194304] 0 2024-04-25T15:58:02.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/179: write d3/f8 [2726731,15074] 0 2024-04-25T15:58:02.287 INFO:tasks.workunit.client.0.smithi087.stdout:3/121: dwrite d4/d17/f1b [0,4194304] 0 2024-04-25T15:58:02.291 INFO:tasks.workunit.client.0.smithi087.stdout:2/153: mkdir d3/d27/d29/d2d 0 2024-04-25T15:58:02.291 INFO:tasks.workunit.client.0.smithi087.stdout:2/154: fsync d3/f1e 0 2024-04-25T15:58:02.294 INFO:tasks.workunit.client.0.smithi087.stdout:2/155: chown d3/d2a/f1f 0 1 2024-04-25T15:58:02.297 INFO:tasks.workunit.client.0.smithi087.stdout:1/180: creat d3/d12/d14/f31 x:0 0 0 2024-04-25T15:58:02.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/156: rename d3/f25 to d3/d27/d29/f2e 0 2024-04-25T15:58:02.302 INFO:tasks.workunit.client.0.smithi087.stdout:8/150: dwrite d4/d9/f23 [4194304,4194304] 0 2024-04-25T15:58:02.302 INFO:tasks.workunit.client.0.smithi087.stdout:3/122: dwrite d4/f12 [4194304,4194304] 0 2024-04-25T15:58:02.303 INFO:tasks.workunit.client.0.smithi087.stdout:1/181: unlink d3/d12/l21 0 2024-04-25T15:58:02.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/151: chown d4/d1d/d17/c32 168338812 1 2024-04-25T15:58:02.307 INFO:tasks.workunit.client.0.smithi087.stdout:1/182: readlink d3/d12/l13 0 2024-04-25T15:58:02.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/144: write d6/d8/fc [933935,42959] 0 2024-04-25T15:58:02.310 INFO:tasks.workunit.client.0.smithi087.stdout:1/183: chown d3/d12/f1c 400570 1 2024-04-25T15:58:02.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/89: dwrite f5 [0,4194304] 0 2024-04-25T15:58:02.310 INFO:tasks.workunit.client.0.smithi087.stdout:3/123: read d4/f10 [1534005,129336] 0 2024-04-25T15:58:02.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/90: stat f0 0 2024-04-25T15:58:02.311 INFO:tasks.workunit.client.0.smithi087.stdout:9/145: dread - d6/f1c zero size 2024-04-25T15:58:02.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/124: write d4/f1a [444028,1702] 0 2024-04-25T15:58:02.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/125: write d4/db/fc [1753835,13414] 0 2024-04-25T15:58:02.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/91: write d7/d1a/d1d/d21/f26 [2096436,108121] 0 2024-04-25T15:58:02.317 INFO:tasks.workunit.client.0.smithi087.stdout:2/157: link d3/d2a/l1a d3/d2a/d1c/l2f 0 2024-04-25T15:58:02.320 INFO:tasks.workunit.client.0.smithi087.stdout:9/146: link d6/d8/fa d6/d8/d14/d1d/f2d 0 2024-04-25T15:58:02.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/147: fsync d6/f2b 0 2024-04-25T15:58:02.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/158: getdents d3/d20 0 2024-04-25T15:58:02.330 INFO:tasks.workunit.client.0.smithi087.stdout:2/159: dread - d3/d27/d29/f2e zero size 2024-04-25T15:58:02.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/148: dwrite d6/f2b [0,4194304] 0 2024-04-25T15:58:02.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/160: mknod d3/d27/c30 0 2024-04-25T15:58:02.337 INFO:tasks.workunit.client.0.smithi087.stdout:8/152: dwrite d4/d9/f1c [4194304,4194304] 0 2024-04-25T15:58:02.340 INFO:tasks.workunit.client.0.smithi087.stdout:9/149: dread d6/d8/d14/d1d/f23 [0,4194304] 0 2024-04-25T15:58:02.340 INFO:tasks.workunit.client.0.smithi087.stdout:3/126: write d4/d14/d23/f26 [747111,34685] 0 2024-04-25T15:58:02.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/150: dread - d6/f1c zero size 2024-04-25T15:58:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:6/92: dread d7/f8 [0,4194304] 0 2024-04-25T15:58:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:3/127: link d4/d17/f20 d4/d17/f2a 0 2024-04-25T15:58:02.347 INFO:tasks.workunit.client.0.smithi087.stdout:2/161: dwrite d3/d2a/f13 [0,4194304] 0 2024-04-25T15:58:02.348 INFO:tasks.workunit.client.0.smithi087.stdout:9/151: creat d6/d8/f2e x:0 0 0 2024-04-25T15:58:02.348 INFO:tasks.workunit.client.0.smithi087.stdout:6/93: write d7/d1a/d1d/d21/f26 [3370961,40316] 0 2024-04-25T15:58:02.349 INFO:tasks.workunit.client.0.smithi087.stdout:3/128: mkdir d4/d17/d2b 0 2024-04-25T15:58:02.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/152: read d6/d8/fa [216412,75546] 0 2024-04-25T15:58:02.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/94: symlink d7/d1a/d1d/d21/d27/l29 0 2024-04-25T15:58:02.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/153: read f2 [27843,70108] 0 2024-04-25T15:58:02.355 INFO:tasks.workunit.client.0.smithi087.stdout:2/162: dwrite d3/d2a/f1f [0,4194304] 0 2024-04-25T15:58:02.358 INFO:tasks.workunit.client.0.smithi087.stdout:9/154: creat d6/d8/d12/f2f x:0 0 0 2024-04-25T15:58:02.358 INFO:tasks.workunit.client.0.smithi087.stdout:5/187: sync 2024-04-25T15:58:02.358 INFO:tasks.workunit.client.0.smithi087.stdout:0/116: sync 2024-04-25T15:58:02.358 INFO:tasks.workunit.client.0.smithi087.stdout:0/117: stat d1 0 2024-04-25T15:58:02.361 INFO:tasks.workunit.client.0.smithi087.stdout:5/188: creat d9/d2c/f3a x:0 0 0 2024-04-25T15:58:02.363 INFO:tasks.workunit.client.0.smithi087.stdout:6/95: dwrite d7/d1a/d1d/d21/f22 [0,4194304] 0 2024-04-25T15:58:02.363 INFO:tasks.workunit.client.0.smithi087.stdout:9/155: mkdir d6/d8/d14/d1d/d30 0 2024-04-25T15:58:02.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/189: unlink d9/fc 0 2024-04-25T15:58:02.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/118: dwrite d1/d6/fe [0,4194304] 0 2024-04-25T15:58:02.372 INFO:tasks.workunit.client.0.smithi087.stdout:6/96: write f6 [2313606,26921] 0 2024-04-25T15:58:02.376 INFO:tasks.workunit.client.0.smithi087.stdout:0/119: write d1/d6/fe [2844916,50344] 0 2024-04-25T15:58:02.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/129: dwrite d4/f19 [0,4194304] 0 2024-04-25T15:58:02.377 INFO:tasks.workunit.client.0.smithi087.stdout:2/163: dwrite d3/f23 [0,4194304] 0 2024-04-25T15:58:02.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/97: mkdir d7/d1a/d2a 0 2024-04-25T15:58:02.382 INFO:tasks.workunit.client.0.smithi087.stdout:0/120: rename d1/da/d11 to d1/d6/d21/d2a 0 2024-04-25T15:58:02.384 INFO:tasks.workunit.client.0.smithi087.stdout:6/98: fsync d7/ff 0 2024-04-25T15:58:02.385 INFO:tasks.workunit.client.0.smithi087.stdout:6/99: readlink d7/d1a/l1b 0 2024-04-25T15:58:02.385 INFO:tasks.workunit.client.0.smithi087.stdout:2/164: dread d3/d2a/f14 [0,4194304] 0 2024-04-25T15:58:02.385 INFO:tasks.workunit.client.0.smithi087.stdout:0/121: creat d1/d6/d1b/f2b x:0 0 0 2024-04-25T15:58:02.385 INFO:tasks.workunit.client.0.smithi087.stdout:6/100: chown d7/d1a 84132410 1 2024-04-25T15:58:02.385 INFO:tasks.workunit.client.0.smithi087.stdout:3/130: link d4/db/f11 d4/f2c 0 2024-04-25T15:58:02.386 INFO:tasks.workunit.client.0.smithi087.stdout:6/101: truncate d7/f14 1009041 0 2024-04-25T15:58:02.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/165: stat d3/ce 0 2024-04-25T15:58:02.389 INFO:tasks.workunit.client.0.smithi087.stdout:2/166: rmdir d3/d20 39 2024-04-25T15:58:02.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/131: mknod d4/c2d 0 2024-04-25T15:58:02.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/102: dread d7/f12 [0,4194304] 0 2024-04-25T15:58:02.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/132: symlink d4/d17/d27/l2e 0 2024-04-25T15:58:02.396 INFO:tasks.workunit.client.0.smithi087.stdout:6/103: getdents d7/d1a/d2a 0 2024-04-25T15:58:02.397 INFO:tasks.workunit.client.0.smithi087.stdout:2/167: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:02.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/104: chown d7/d1a/d1d/d21 2919450 1 2024-04-25T15:58:02.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/168: chown d3/d20/l21 2 1 2024-04-25T15:58:02.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/169: chown d3/d20 482 1 2024-04-25T15:58:02.402 INFO:tasks.workunit.client.0.smithi087.stdout:2/170: dread - d3/d27/d29/f2e zero size 2024-04-25T15:58:02.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/171: write d3/d27/d29/f2c [97338,102422] 0 2024-04-25T15:58:02.406 INFO:tasks.workunit.client.0.smithi087.stdout:3/133: dwrite d4/f1a [0,4194304] 0 2024-04-25T15:58:02.407 INFO:tasks.workunit.client.0.smithi087.stdout:3/134: readlink d4/d17/l1d 0 2024-04-25T15:58:02.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/172: chown d3/d2a/f14 31 1 2024-04-25T15:58:02.410 INFO:tasks.workunit.client.0.smithi087.stdout:6/105: dwrite d7/f10 [0,4194304] 0 2024-04-25T15:58:02.411 INFO:tasks.workunit.client.0.smithi087.stdout:0/122: truncate d1/d6/f22 43148 0 2024-04-25T15:58:02.412 INFO:tasks.workunit.client.0.smithi087.stdout:0/123: write d1/f5 [683261,80684] 0 2024-04-25T15:58:02.413 INFO:tasks.workunit.client.0.smithi087.stdout:2/173: creat d3/d27/f31 x:0 0 0 2024-04-25T15:58:02.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/135: creat d4/db/d28/f2f x:0 0 0 2024-04-25T15:58:02.415 INFO:tasks.workunit.client.0.smithi087.stdout:5/190: dread d9/f29 [0,4194304] 0 2024-04-25T15:58:02.416 INFO:tasks.workunit.client.0.smithi087.stdout:2/174: read d3/d27/d29/f2c [131109,80593] 0 2024-04-25T15:58:02.417 INFO:tasks.workunit.client.0.smithi087.stdout:6/106: dread d7/f10 [0,4194304] 0 2024-04-25T15:58:02.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/175: chown d3/ca 0 1 2024-04-25T15:58:02.420 INFO:tasks.workunit.client.0.smithi087.stdout:5/191: mkdir d9/d2f/d3b 0 2024-04-25T15:58:02.422 INFO:tasks.workunit.client.0.smithi087.stdout:6/107: dread d7/d1a/d1d/d21/f22 [0,4194304] 0 2024-04-25T15:58:02.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/124: getdents d1 0 2024-04-25T15:58:02.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/176: mknod d3/d27/c32 0 2024-04-25T15:58:02.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/136: rmdir d4/d17/d24/d25 0 2024-04-25T15:58:02.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/192: creat d9/d2f/f3c x:0 0 0 2024-04-25T15:58:02.426 INFO:tasks.workunit.client.0.smithi087.stdout:6/108: stat d7/fc 0 2024-04-25T15:58:02.427 INFO:tasks.workunit.client.0.smithi087.stdout:0/125: mknod d1/d6/d21/c2c 0 2024-04-25T15:58:02.428 INFO:tasks.workunit.client.0.smithi087.stdout:2/177: rename d3/l16 to d3/d27/l33 0 2024-04-25T15:58:02.429 INFO:tasks.workunit.client.0.smithi087.stdout:5/193: mknod d9/d2f/c3d 0 2024-04-25T15:58:02.431 INFO:tasks.workunit.client.0.smithi087.stdout:5/194: mkdir d9/d3e 0 2024-04-25T15:58:02.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/109: creat d7/f2b x:0 0 0 2024-04-25T15:58:02.436 INFO:tasks.workunit.client.0.smithi087.stdout:6/110: write d7/ff [606375,93328] 0 2024-04-25T15:58:02.436 INFO:tasks.workunit.client.0.smithi087.stdout:6/111: read f5 [1067326,62102] 0 2024-04-25T15:58:02.438 INFO:tasks.workunit.client.0.smithi087.stdout:6/112: truncate d7/fc 871912 0 2024-04-25T15:58:02.439 INFO:tasks.workunit.client.0.smithi087.stdout:6/113: truncate d7/f14 2037247 0 2024-04-25T15:58:02.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/195: symlink d9/d2f/d3b/l3f 0 2024-04-25T15:58:02.440 INFO:tasks.workunit.client.0.smithi087.stdout:5/196: write d9/f2a [877264,20177] 0 2024-04-25T15:58:02.443 INFO:tasks.workunit.client.0.smithi087.stdout:6/114: mkdir d7/d1a/d1d/d21/d27/d2c 0 2024-04-25T15:58:02.444 INFO:tasks.workunit.client.0.smithi087.stdout:6/115: fsync d7/f14 0 2024-04-25T15:58:02.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/137: getdents d4/d17/d24 0 2024-04-25T15:58:02.447 INFO:tasks.workunit.client.0.smithi087.stdout:5/197: mkdir d9/d2f/d40 0 2024-04-25T15:58:02.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/126: link d1/d6/d1b/c1d d1/da/c2d 0 2024-04-25T15:58:02.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/178: getdents d3/d27 0 2024-04-25T15:58:02.452 INFO:tasks.workunit.client.0.smithi087.stdout:3/138: rmdir d4/d17 39 2024-04-25T15:58:02.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/198: fdatasync d9/f16 0 2024-04-25T15:58:02.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/139: read d4/db/fc [2712321,34846] 0 2024-04-25T15:58:02.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/199: write f1 [3879679,64911] 0 2024-04-25T15:58:02.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/200: dread - d9/f26 zero size 2024-04-25T15:58:02.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/140: write d4/d14/f15 [3648134,90641] 0 2024-04-25T15:58:02.455 INFO:tasks.workunit.client.0.smithi087.stdout:5/201: chown d9/d3e 27 1 2024-04-25T15:58:02.455 INFO:tasks.workunit.client.0.smithi087.stdout:2/179: mknod d3/d2a/c34 0 2024-04-25T15:58:02.455 INFO:tasks.workunit.client.0.smithi087.stdout:5/202: stat d9/f25 0 2024-04-25T15:58:02.456 INFO:tasks.workunit.client.0.smithi087.stdout:3/141: dread - d4/db/d28/f2f zero size 2024-04-25T15:58:02.456 INFO:tasks.workunit.client.0.smithi087.stdout:2/180: chown d3/d20 562 1 2024-04-25T15:58:02.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/116: mknod d7/c2d 0 2024-04-25T15:58:02.457 INFO:tasks.workunit.client.0.smithi087.stdout:6/117: chown d7/d1a 1501 1 2024-04-25T15:58:02.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/181: stat d3/d2a/l15 0 2024-04-25T15:58:02.458 INFO:tasks.workunit.client.0.smithi087.stdout:6/118: fsync d7/fc 0 2024-04-25T15:58:02.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/182: chown d3/c17 592125708 1 2024-04-25T15:58:02.459 INFO:tasks.workunit.client.0.smithi087.stdout:0/127: link d1/f14 d1/d6/d21/f2e 0 2024-04-25T15:58:02.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/203: mkdir d9/d2c/d41 0 2024-04-25T15:58:02.461 INFO:tasks.workunit.client.0.smithi087.stdout:5/204: dread - d9/d2c/f2e zero size 2024-04-25T15:58:02.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/142: symlink d4/d14/l30 0 2024-04-25T15:58:02.462 INFO:tasks.workunit.client.0.smithi087.stdout:5/205: write d9/d2c/f2e [35807,104045] 0 2024-04-25T15:58:02.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/119: mknod d7/d1a/d2a/c2e 0 2024-04-25T15:58:02.468 INFO:tasks.workunit.client.0.smithi087.stdout:2/183: creat d3/f35 x:0 0 0 2024-04-25T15:58:02.493 INFO:tasks.workunit.client.0.smithi087.stdout:4/135: sync 2024-04-25T15:58:02.495 INFO:tasks.workunit.client.0.smithi087.stdout:4/136: fdatasync d4/d7/d15/d12/f1f 0 2024-04-25T15:58:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:4/137: creat d4/d10/f2b x:0 0 0 2024-04-25T15:58:02.499 INFO:tasks.workunit.client.0.smithi087.stdout:6/120: truncate d7/d1a/d1d/f28 675836 0 2024-04-25T15:58:02.501 INFO:tasks.workunit.client.0.smithi087.stdout:5/206: dread d9/fa [0,4194304] 0 2024-04-25T15:58:02.502 INFO:tasks.workunit.client.0.smithi087.stdout:4/138: creat d4/d7/f2c x:0 0 0 2024-04-25T15:58:02.504 INFO:tasks.workunit.client.0.smithi087.stdout:3/143: dread d4/db/fe [0,4194304] 0 2024-04-25T15:58:02.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/121: write d7/d1a/d1d/d21/d23/f24 [80820,99519] 0 2024-04-25T15:58:02.505 INFO:tasks.workunit.client.0.smithi087.stdout:4/139: stat d4/d7/d15/d13 0 2024-04-25T15:58:02.505 INFO:tasks.workunit.client.0.smithi087.stdout:0/128: dwrite d1/d6/f22 [0,4194304] 0 2024-04-25T15:58:02.507 INFO:tasks.workunit.client.0.smithi087.stdout:2/184: dwrite d3/d2a/f13 [0,4194304] 0 2024-04-25T15:58:02.510 INFO:tasks.workunit.client.0.smithi087.stdout:3/144: readlink d4/db/lf 0 2024-04-25T15:58:02.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/207: dread d9/f1a [0,4194304] 0 2024-04-25T15:58:02.510 INFO:tasks.workunit.client.0.smithi087.stdout:4/140: truncate d4/f1e 1040900 0 2024-04-25T15:58:02.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/122: read d7/d1a/d1d/d21/d23/f24 [100418,87272] 0 2024-04-25T15:58:02.511 INFO:tasks.workunit.client.0.smithi087.stdout:5/208: dread - d9/f26 zero size 2024-04-25T15:58:02.512 INFO:tasks.workunit.client.0.smithi087.stdout:4/141: read - d4/d7/f11 zero size 2024-04-25T15:58:02.513 INFO:tasks.workunit.client.0.smithi087.stdout:0/129: unlink d1/d6/f22 0 2024-04-25T15:58:02.513 INFO:tasks.workunit.client.0.smithi087.stdout:2/185: unlink d3/f35 0 2024-04-25T15:58:02.520 INFO:tasks.workunit.client.0.smithi087.stdout:6/123: dwrite d7/fc [0,4194304] 0 2024-04-25T15:58:02.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/186: unlink d3/d20/l21 0 2024-04-25T15:58:02.522 INFO:tasks.workunit.client.0.smithi087.stdout:5/209: dwrite d9/f2d [0,4194304] 0 2024-04-25T15:58:02.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/124: write d7/f8 [273515,93764] 0 2024-04-25T15:58:02.522 INFO:tasks.workunit.client.0.smithi087.stdout:3/145: mknod d4/d17/d27/c31 0 2024-04-25T15:58:02.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/187: readlink d3/d2a/l1a 0 2024-04-25T15:58:02.525 INFO:tasks.workunit.client.0.smithi087.stdout:2/188: write d3/f1e [2998371,89540] 0 2024-04-25T15:58:02.525 INFO:tasks.workunit.client.0.smithi087.stdout:5/210: mknod d9/d2f/c42 0 2024-04-25T15:58:02.525 INFO:tasks.workunit.client.0.smithi087.stdout:6/125: chown d7/ff 1567573 1 2024-04-25T15:58:02.526 INFO:tasks.workunit.client.0.smithi087.stdout:5/211: write d9/f12 [511643,116525] 0 2024-04-25T15:58:02.527 INFO:tasks.workunit.client.0.smithi087.stdout:6/126: truncate d7/f12 1554719 0 2024-04-25T15:58:02.528 INFO:tasks.workunit.client.0.smithi087.stdout:3/146: rename d4/f1a to d4/d17/d24/f32 0 2024-04-25T15:58:02.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/212: creat d9/d2c/d30/f43 x:0 0 0 2024-04-25T15:58:02.539 INFO:tasks.workunit.client.0.smithi087.stdout:6/127: write d7/f19 [826580,8727] 0 2024-04-25T15:58:02.542 INFO:tasks.workunit.client.0.smithi087.stdout:3/147: creat d4/d17/d24/d29/f33 x:0 0 0 2024-04-25T15:58:02.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/213: mkdir d9/d2c/d41/d44 0 2024-04-25T15:58:02.544 INFO:tasks.workunit.client.0.smithi087.stdout:0/130: dwrite d1/d6/d21/f2e [0,4194304] 0 2024-04-25T15:58:02.544 INFO:tasks.workunit.client.0.smithi087.stdout:0/131: readlink d1/l4 0 2024-04-25T15:58:02.545 INFO:tasks.workunit.client.0.smithi087.stdout:5/214: chown d9/f2a 119 1 2024-04-25T15:58:02.545 INFO:tasks.workunit.client.0.smithi087.stdout:0/132: dread - d1/f26 zero size 2024-04-25T15:58:02.545 INFO:tasks.workunit.client.0.smithi087.stdout:3/148: rmdir d4/db 39 2024-04-25T15:58:02.548 INFO:tasks.workunit.client.0.smithi087.stdout:0/133: chown d1/da/c2d 125103665 1 2024-04-25T15:58:02.549 INFO:tasks.workunit.client.0.smithi087.stdout:6/128: creat d7/f2f x:0 0 0 2024-04-25T15:58:02.551 INFO:tasks.workunit.client.0.smithi087.stdout:2/189: write d3/d27/d29/f2c [1090971,87769] 0 2024-04-25T15:58:02.554 INFO:tasks.workunit.client.0.smithi087.stdout:6/129: write d7/f10 [4816941,87848] 0 2024-04-25T15:58:02.554 INFO:tasks.workunit.client.0.smithi087.stdout:2/190: symlink d3/d27/l36 0 2024-04-25T15:58:02.557 INFO:tasks.workunit.client.0.smithi087.stdout:0/134: getdents d1/d6/d1b 0 2024-04-25T15:58:02.557 INFO:tasks.workunit.client.0.smithi087.stdout:5/215: dwrite d9/f26 [0,4194304] 0 2024-04-25T15:58:02.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/130: chown d7/c1e 3495356 1 2024-04-25T15:58:02.559 INFO:tasks.workunit.client.0.smithi087.stdout:2/191: write d3/d2a/f13 [3953538,54501] 0 2024-04-25T15:58:02.559 INFO:tasks.workunit.client.0.smithi087.stdout:3/149: dwrite d4/f12 [4194304,4194304] 0 2024-04-25T15:58:02.562 INFO:tasks.workunit.client.0.smithi087.stdout:0/135: symlink d1/d6/d21/l2f 0 2024-04-25T15:58:02.562 INFO:tasks.workunit.client.0.smithi087.stdout:5/216: symlink d9/d2f/l45 0 2024-04-25T15:58:02.564 INFO:tasks.workunit.client.0.smithi087.stdout:2/192: symlink d3/d20/l37 0 2024-04-25T15:58:02.568 INFO:tasks.workunit.client.0.smithi087.stdout:0/136: dread d1/f14 [0,4194304] 0 2024-04-25T15:58:02.570 INFO:tasks.workunit.client.0.smithi087.stdout:0/137: symlink d1/l30 0 2024-04-25T15:58:02.574 INFO:tasks.workunit.client.0.smithi087.stdout:5/217: dwrite d9/f28 [4194304,4194304] 0 2024-04-25T15:58:02.576 INFO:tasks.workunit.client.0.smithi087.stdout:3/150: dwrite d4/f6 [0,4194304] 0 2024-04-25T15:58:02.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/218: chown d9/f12 197 1 2024-04-25T15:58:02.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/219: mkdir d9/d2c/d41/d44/d46 0 2024-04-25T15:58:02.584 INFO:tasks.workunit.client.0.smithi087.stdout:6/131: dread d7/d1a/d1d/f28 [0,4194304] 0 2024-04-25T15:58:02.585 INFO:tasks.workunit.client.0.smithi087.stdout:5/220: creat d9/d2c/d41/d44/f47 x:0 0 0 2024-04-25T15:58:02.587 INFO:tasks.workunit.client.0.smithi087.stdout:6/132: mknod d7/d1a/d1d/d21/c30 0 2024-04-25T15:58:02.588 INFO:tasks.workunit.client.0.smithi087.stdout:0/138: unlink d1/d6/d21/f2e 0 2024-04-25T15:58:02.591 INFO:tasks.workunit.client.0.smithi087.stdout:0/139: read - d1/d6/d1b/f2b zero size 2024-04-25T15:58:02.592 INFO:tasks.workunit.client.0.smithi087.stdout:5/221: getdents d9 0 2024-04-25T15:58:02.593 INFO:tasks.workunit.client.0.smithi087.stdout:6/133: creat d7/d1a/d1d/d21/d23/f31 x:0 0 0 2024-04-25T15:58:02.593 INFO:tasks.workunit.client.0.smithi087.stdout:2/193: dread d3/f1e [0,4194304] 0 2024-04-25T15:58:02.594 INFO:tasks.workunit.client.0.smithi087.stdout:3/151: dwrite d4/db/f11 [0,4194304] 0 2024-04-25T15:58:02.594 INFO:tasks.workunit.client.0.smithi087.stdout:6/134: chown d7/f8 0 1 2024-04-25T15:58:02.595 INFO:tasks.workunit.client.0.smithi087.stdout:3/152: dread - d4/d17/f1e zero size 2024-04-25T15:58:02.597 INFO:tasks.workunit.client.0.smithi087.stdout:5/222: mkdir d9/d2f/d3b/d48 0 2024-04-25T15:58:02.598 INFO:tasks.workunit.client.0.smithi087.stdout:6/135: truncate d7/d1a/d1d/d21/f22 5203860 0 2024-04-25T15:58:02.598 INFO:tasks.workunit.client.0.smithi087.stdout:3/153: read d4/d14/f15 [3544374,14059] 0 2024-04-25T15:58:02.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/136: chown d7/d1a/d1d/d21/d27/l29 2474 1 2024-04-25T15:58:02.601 INFO:tasks.workunit.client.0.smithi087.stdout:0/140: dread d1/d6/d1b/f20 [0,4194304] 0 2024-04-25T15:58:02.605 INFO:tasks.workunit.client.0.smithi087.stdout:3/154: link d4/d17/d24/d29/f33 d4/d17/d27/f34 0 2024-04-25T15:58:02.605 INFO:tasks.workunit.client.0.smithi087.stdout:6/137: dread d7/f14 [0,4194304] 0 2024-04-25T15:58:02.607 INFO:tasks.workunit.client.0.smithi087.stdout:2/194: dwrite d3/d27/d29/f2e [0,4194304] 0 2024-04-25T15:58:02.607 INFO:tasks.workunit.client.0.smithi087.stdout:6/138: stat d7/c1f 0 2024-04-25T15:58:02.610 INFO:tasks.workunit.client.0.smithi087.stdout:6/139: unlink d7/d1a/l1b 0 2024-04-25T15:58:02.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/155: getdents d4/d17/d24 0 2024-04-25T15:58:02.612 INFO:tasks.workunit.client.0.smithi087.stdout:0/141: truncate d1/d6/d1b/f20 494909 0 2024-04-25T15:58:02.614 INFO:tasks.workunit.client.0.smithi087.stdout:6/140: symlink d7/d1a/d1d/d21/d27/l32 0 2024-04-25T15:58:02.614 INFO:tasks.workunit.client.0.smithi087.stdout:3/156: mknod d4/db/d28/c35 0 2024-04-25T15:58:02.615 INFO:tasks.workunit.client.0.smithi087.stdout:6/141: read d7/f8 [1016669,12786] 0 2024-04-25T15:58:02.616 INFO:tasks.workunit.client.0.smithi087.stdout:3/157: fsync d4/db/d28/f2f 0 2024-04-25T15:58:02.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/195: dwrite d3/f1e [4194304,4194304] 0 2024-04-25T15:58:02.617 INFO:tasks.workunit.client.0.smithi087.stdout:6/142: stat d7/d1a/d1d/d21/d23/c25 0 2024-04-25T15:58:02.618 INFO:tasks.workunit.client.0.smithi087.stdout:2/196: read d3/f23 [2311186,125699] 0 2024-04-25T15:58:02.618 INFO:tasks.workunit.client.0.smithi087.stdout:6/143: read - d7/f2b zero size 2024-04-25T15:58:02.619 INFO:tasks.workunit.client.0.smithi087.stdout:2/197: stat d3/d27/d29/f2e 0 2024-04-25T15:58:02.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/158: unlink d4/db/f22 0 2024-04-25T15:58:02.621 INFO:tasks.workunit.client.0.smithi087.stdout:6/144: chown d7/l15 7343 1 2024-04-25T15:58:02.622 INFO:tasks.workunit.client.0.smithi087.stdout:7/152: sync 2024-04-25T15:58:02.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/198: mkdir d3/d27/d38 0 2024-04-25T15:58:02.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/159: creat d4/d17/d24/f36 x:0 0 0 2024-04-25T15:58:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:0/142: write d1/d6/f8 [1013218,130549] 0 2024-04-25T15:58:02.628 INFO:tasks.workunit.client.0.smithi087.stdout:0/143: chown d1/d6/d21/l2f 289548624 1 2024-04-25T15:58:02.628 INFO:tasks.workunit.client.0.smithi087.stdout:7/153: write d1/d4/d18/f1b [2874835,108096] 0 2024-04-25T15:58:02.633 INFO:tasks.workunit.client.0.smithi087.stdout:6/145: dread d7/f8 [0,4194304] 0 2024-04-25T15:58:02.634 INFO:tasks.workunit.client.0.smithi087.stdout:7/154: mknod d1/d9/c33 0 2024-04-25T15:58:02.635 INFO:tasks.workunit.client.0.smithi087.stdout:3/160: dwrite d4/d17/f1e [0,4194304] 0 2024-04-25T15:58:02.636 INFO:tasks.workunit.client.0.smithi087.stdout:7/155: read d1/d4/d18/f1b [1735856,32628] 0 2024-04-25T15:58:02.636 INFO:tasks.workunit.client.0.smithi087.stdout:2/199: dread d3/f23 [0,4194304] 0 2024-04-25T15:58:02.636 INFO:tasks.workunit.client.0.smithi087.stdout:3/161: readlink d4/l1c 0 2024-04-25T15:58:02.637 INFO:tasks.workunit.client.0.smithi087.stdout:6/146: read f6 [2025799,97198] 0 2024-04-25T15:58:02.637 INFO:tasks.workunit.client.0.smithi087.stdout:0/144: creat d1/d6/d21/d2a/f31 x:0 0 0 2024-04-25T15:58:02.640 INFO:tasks.workunit.client.0.smithi087.stdout:6/147: dread f0 [4194304,4194304] 0 2024-04-25T15:58:02.642 INFO:tasks.workunit.client.0.smithi087.stdout:2/200: creat d3/d27/f39 x:0 0 0 2024-04-25T15:58:02.644 INFO:tasks.workunit.client.0.smithi087.stdout:3/162: rename d4/d17/d2b to d4/d14/d37 0 2024-04-25T15:58:02.651 INFO:tasks.workunit.client.0.smithi087.stdout:6/148: symlink d7/d1a/d1d/d21/d27/d2c/l33 0 2024-04-25T15:58:02.651 INFO:tasks.workunit.client.0.smithi087.stdout:6/149: chown d7/d1a/d1d/d21/d23 241818 1 2024-04-25T15:58:02.652 INFO:tasks.workunit.client.0.smithi087.stdout:2/201: mkdir d3/d27/d29/d2d/d3a 0 2024-04-25T15:58:02.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/156: write d1/f19 [123187,2979] 0 2024-04-25T15:58:02.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/157: readlink d1/l2 0 2024-04-25T15:58:02.654 INFO:tasks.workunit.client.0.smithi087.stdout:6/150: mknod d7/d1a/d2a/c34 0 2024-04-25T15:58:02.655 INFO:tasks.workunit.client.0.smithi087.stdout:2/202: mknod d3/d2a/d1c/c3b 0 2024-04-25T15:58:02.656 INFO:tasks.workunit.client.0.smithi087.stdout:3/163: link d4/f19 d4/db/f38 0 2024-04-25T15:58:02.658 INFO:tasks.workunit.client.0.smithi087.stdout:2/203: read d3/d27/d29/f2c [131871,130451] 0 2024-04-25T15:58:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/158: link d1/l2 d1/d9/d26/l34 0 2024-04-25T15:58:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:3/164: chown d4/ca 23589 1 2024-04-25T15:58:02.659 INFO:tasks.workunit.client.0.smithi087.stdout:2/204: chown d3/d2a/f1b 1809630681 1 2024-04-25T15:58:02.660 INFO:tasks.workunit.client.0.smithi087.stdout:0/145: dwrite d1/d6/d1b/f20 [0,4194304] 0 2024-04-25T15:58:02.662 INFO:tasks.workunit.client.0.smithi087.stdout:2/205: truncate d3/d27/f39 988914 0 2024-04-25T15:58:02.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/206: write d3/f23 [1126036,21504] 0 2024-04-25T15:58:02.667 INFO:tasks.workunit.client.0.smithi087.stdout:0/146: creat d1/f32 x:0 0 0 2024-04-25T15:58:02.669 INFO:tasks.workunit.client.0.smithi087.stdout:0/147: write d1/f32 [803523,22560] 0 2024-04-25T15:58:02.670 INFO:tasks.workunit.client.0.smithi087.stdout:3/165: write d4/d14/d23/f26 [64765,81297] 0 2024-04-25T15:58:02.670 INFO:tasks.workunit.client.0.smithi087.stdout:7/159: dwrite d1/d9/d26/f30 [0,4194304] 0 2024-04-25T15:58:02.671 INFO:tasks.workunit.client.0.smithi087.stdout:2/207: mkdir d3/d3c 0 2024-04-25T15:58:02.672 INFO:tasks.workunit.client.0.smithi087.stdout:2/208: chown d3/d2a/l1d 184236270 1 2024-04-25T15:58:02.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/151: dread f6 [0,4194304] 0 2024-04-25T15:58:02.675 INFO:tasks.workunit.client.0.smithi087.stdout:2/209: fsync d3/fd 0 2024-04-25T15:58:02.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/148: write d1/f3 [1311093,32693] 0 2024-04-25T15:58:02.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/152: mkdir d7/d1a/d1d/d21/d27/d2c/d35 0 2024-04-25T15:58:02.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/210: dread d3/fd [0,4194304] 0 2024-04-25T15:58:02.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/166: getdents d4 0 2024-04-25T15:58:02.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/167: dread - d4/d17/f2a zero size 2024-04-25T15:58:02.682 INFO:tasks.workunit.client.0.smithi087.stdout:3/168: stat d4/c2d 0 2024-04-25T15:58:02.682 INFO:tasks.workunit.client.0.smithi087.stdout:6/153: creat d7/d1a/d1d/d21/d27/d2c/d35/f36 x:0 0 0 2024-04-25T15:58:02.683 INFO:tasks.workunit.client.0.smithi087.stdout:0/149: mknod d1/d6/d21/d2a/c33 0 2024-04-25T15:58:02.685 INFO:tasks.workunit.client.0.smithi087.stdout:2/211: symlink d3/d27/d29/d2d/d3a/l3d 0 2024-04-25T15:58:02.685 INFO:tasks.workunit.client.0.smithi087.stdout:6/154: readlink d7/l17 0 2024-04-25T15:58:02.686 INFO:tasks.workunit.client.0.smithi087.stdout:6/155: write d7/f2f [371488,77086] 0 2024-04-25T15:58:02.686 INFO:tasks.workunit.client.0.smithi087.stdout:3/169: truncate d4/f19 1674397 0 2024-04-25T15:58:02.687 INFO:tasks.workunit.client.0.smithi087.stdout:3/170: write d4/f12 [7479338,50450] 0 2024-04-25T15:58:02.688 INFO:tasks.workunit.client.0.smithi087.stdout:3/171: readlink d4/l8 0 2024-04-25T15:58:02.689 INFO:tasks.workunit.client.0.smithi087.stdout:6/156: mkdir d7/d1a/d1d/d21/d37 0 2024-04-25T15:58:02.691 INFO:tasks.workunit.client.0.smithi087.stdout:2/212: link d3/d2a/f13 d3/d27/f3e 0 2024-04-25T15:58:02.695 INFO:tasks.workunit.client.0.smithi087.stdout:2/213: mknod d3/d27/d38/c3f 0 2024-04-25T15:58:02.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/214: read d3/fd [1300727,122306] 0 2024-04-25T15:58:02.697 INFO:tasks.workunit.client.0.smithi087.stdout:0/150: truncate d1/d6/d21/d2a/f25 336186 0 2024-04-25T15:58:02.698 INFO:tasks.workunit.client.0.smithi087.stdout:2/215: fdatasync d3/d2a/f1b 0 2024-04-25T15:58:02.698 INFO:tasks.workunit.client.0.smithi087.stdout:7/160: dwrite d1/d1a/f20 [0,4194304] 0 2024-04-25T15:58:02.699 INFO:tasks.workunit.client.0.smithi087.stdout:3/172: dwrite d4/f10 [0,4194304] 0 2024-04-25T15:58:02.702 INFO:tasks.workunit.client.0.smithi087.stdout:3/173: chown d4/db/f11 102894 1 2024-04-25T15:58:02.703 INFO:tasks.workunit.client.0.smithi087.stdout:0/151: fdatasync d1/d6/d21/f23 0 2024-04-25T15:58:02.704 INFO:tasks.workunit.client.0.smithi087.stdout:3/174: dread - d4/d17/d27/f34 zero size 2024-04-25T15:58:02.705 INFO:tasks.workunit.client.0.smithi087.stdout:2/216: rmdir d3/d27/d29/d2d 39 2024-04-25T15:58:02.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/217: write d3/d27/d29/f2e [5041081,5311] 0 2024-04-25T15:58:02.709 INFO:tasks.workunit.client.0.smithi087.stdout:6/157: dwrite d7/d1a/d1d/d21/d23/f24 [0,4194304] 0 2024-04-25T15:58:02.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/152: dread d1/f32 [0,4194304] 0 2024-04-25T15:58:02.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/153: fsync d1/f3 0 2024-04-25T15:58:02.712 INFO:tasks.workunit.client.0.smithi087.stdout:3/175: symlink d4/d17/l39 0 2024-04-25T15:58:02.713 INFO:tasks.workunit.client.0.smithi087.stdout:7/161: dread d1/f19 [0,4194304] 0 2024-04-25T15:58:02.716 INFO:tasks.workunit.client.0.smithi087.stdout:6/158: creat d7/d1a/d1d/d21/d27/d2c/f38 x:0 0 0 2024-04-25T15:58:02.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/154: write d1/f14 [2527886,105012] 0 2024-04-25T15:58:02.719 INFO:tasks.workunit.client.0.smithi087.stdout:0/155: truncate d1/d6/d21/d2a/f31 298614 0 2024-04-25T15:58:02.719 INFO:tasks.workunit.client.0.smithi087.stdout:3/176: dread d4/db/fc [0,4194304] 0 2024-04-25T15:58:02.721 INFO:tasks.workunit.client.0.smithi087.stdout:7/162: link d1/d9/d26/c2d d1/d4/c35 0 2024-04-25T15:58:02.722 INFO:tasks.workunit.client.0.smithi087.stdout:3/177: creat d4/db/d28/f3a x:0 0 0 2024-04-25T15:58:02.723 INFO:tasks.workunit.client.0.smithi087.stdout:3/178: chown d4/d17/l1d 0 1 2024-04-25T15:58:02.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/218: dwrite d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:02.731 INFO:tasks.workunit.client.0.smithi087.stdout:6/159: dwrite f0 [0,4194304] 0 2024-04-25T15:58:02.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/179: dwrite d4/db/d28/f2f [0,4194304] 0 2024-04-25T15:58:02.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/219: mkdir d3/d27/d29/d2d/d40 0 2024-04-25T15:58:02.739 INFO:tasks.workunit.client.0.smithi087.stdout:3/180: write d4/db/d28/f2f [1022394,59375] 0 2024-04-25T15:58:02.742 INFO:tasks.workunit.client.0.smithi087.stdout:0/156: dread d1/d6/d21/d2a/f19 [0,4194304] 0 2024-04-25T15:58:02.743 INFO:tasks.workunit.client.0.smithi087.stdout:6/160: dread d7/d1a/d1d/d21/f26 [0,4194304] 0 2024-04-25T15:58:02.744 INFO:tasks.workunit.client.0.smithi087.stdout:7/163: dread f0 [8388608,4194304] 0 2024-04-25T15:58:02.745 INFO:tasks.workunit.client.0.smithi087.stdout:3/181: rename d4/d17/d24/d29/f33 to d4/f3b 0 2024-04-25T15:58:02.746 INFO:tasks.workunit.client.0.smithi087.stdout:6/161: creat d7/d1a/f39 x:0 0 0 2024-04-25T15:58:02.747 INFO:tasks.workunit.client.0.smithi087.stdout:0/157: getdents d1/d6/d1f 0 2024-04-25T15:58:02.748 INFO:tasks.workunit.client.0.smithi087.stdout:2/220: dwrite d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:02.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/158: write d1/d6/d1b/f20 [2964037,54408] 0 2024-04-25T15:58:02.750 INFO:tasks.workunit.client.0.smithi087.stdout:7/164: mkdir d1/d4/d18/d36 0 2024-04-25T15:58:02.751 INFO:tasks.workunit.client.0.smithi087.stdout:6/162: creat d7/d1a/f3a x:0 0 0 2024-04-25T15:58:02.752 INFO:tasks.workunit.client.0.smithi087.stdout:2/221: rmdir d3/d2a 39 2024-04-25T15:58:02.752 INFO:tasks.workunit.client.0.smithi087.stdout:6/163: write d7/f19 [886228,58479] 0 2024-04-25T15:58:02.753 INFO:tasks.workunit.client.0.smithi087.stdout:2/222: fdatasync d3/d27/d29/f2e 0 2024-04-25T15:58:02.753 INFO:tasks.workunit.client.0.smithi087.stdout:1/184: sync 2024-04-25T15:58:02.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/159: getdents d1/d6/d1b 0 2024-04-25T15:58:02.754 INFO:tasks.workunit.client.0.smithi087.stdout:7/165: mkdir d1/d4/d18/d36/d37 0 2024-04-25T15:58:02.755 INFO:tasks.workunit.client.0.smithi087.stdout:2/223: write d3/d27/f3e [5334097,51810] 0 2024-04-25T15:58:02.756 INFO:tasks.workunit.client.0.smithi087.stdout:6/164: truncate d7/d1a/d1d/d21/f26 3220053 0 2024-04-25T15:58:02.758 INFO:tasks.workunit.client.0.smithi087.stdout:0/160: mkdir d1/d6/d1b/d34 0 2024-04-25T15:58:02.759 INFO:tasks.workunit.client.0.smithi087.stdout:7/166: creat d1/d9/d26/f38 x:0 0 0 2024-04-25T15:58:02.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/224: chown d3/d2a 0 1 2024-04-25T15:58:02.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/225: chown d3/d27/d29/d2d 276978 1 2024-04-25T15:58:02.762 INFO:tasks.workunit.client.0.smithi087.stdout:6/165: write d7/d1a/d1d/d21/f22 [5696457,18309] 0 2024-04-25T15:58:02.765 INFO:tasks.workunit.client.0.smithi087.stdout:6/166: symlink d7/d1a/d2a/l3b 0 2024-04-25T15:58:02.765 INFO:tasks.workunit.client.0.smithi087.stdout:6/167: chown d7/f14 537233909 1 2024-04-25T15:58:02.766 INFO:tasks.workunit.client.0.smithi087.stdout:2/226: rmdir d3/d3c 0 2024-04-25T15:58:02.767 INFO:tasks.workunit.client.0.smithi087.stdout:6/168: write d7/d1a/d1d/d21/d27/d2c/f38 [725552,109684] 0 2024-04-25T15:58:02.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/227: read d3/d2a/f13 [2577614,117356] 0 2024-04-25T15:58:02.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/228: creat d3/d27/f41 x:0 0 0 2024-04-25T15:58:02.770 INFO:tasks.workunit.client.0.smithi087.stdout:6/169: rename f0 to d7/d1a/d2a/f3c 0 2024-04-25T15:58:02.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/229: rmdir d3/d27 39 2024-04-25T15:58:02.771 INFO:tasks.workunit.client.0.smithi087.stdout:6/170: symlink d7/d1a/d1d/d21/l3d 0 2024-04-25T15:58:02.774 INFO:tasks.workunit.client.0.smithi087.stdout:2/230: creat d3/d27/f42 x:0 0 0 2024-04-25T15:58:02.774 INFO:tasks.workunit.client.0.smithi087.stdout:2/231: readlink d3/d27/l33 0 2024-04-25T15:58:02.776 INFO:tasks.workunit.client.0.smithi087.stdout:6/171: dread d7/ff [0,4194304] 0 2024-04-25T15:58:02.781 INFO:tasks.workunit.client.0.smithi087.stdout:2/232: dwrite d3/d2a/f1b [0,4194304] 0 2024-04-25T15:58:02.783 INFO:tasks.workunit.client.0.smithi087.stdout:6/172: dwrite d7/fc [0,4194304] 0 2024-04-25T15:58:02.787 INFO:tasks.workunit.client.0.smithi087.stdout:2/233: dread d3/d2a/f13 [0,4194304] 0 2024-04-25T15:58:02.789 INFO:tasks.workunit.client.0.smithi087.stdout:6/173: creat d7/d1a/f3e x:0 0 0 2024-04-25T15:58:02.791 INFO:tasks.workunit.client.0.smithi087.stdout:3/182: chown d4/f19 602329120 1 2024-04-25T15:58:02.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/234: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:02.797 INFO:tasks.workunit.client.0.smithi087.stdout:7/167: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:02.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/174: creat d7/d1a/d1d/d21/d37/f3f x:0 0 0 2024-04-25T15:58:02.798 INFO:tasks.workunit.client.0.smithi087.stdout:1/185: truncate d3/d12/f1c 2448305 0 2024-04-25T15:58:02.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/161: truncate d1/f14 352200 0 2024-04-25T15:58:02.800 INFO:tasks.workunit.client.0.smithi087.stdout:2/235: write d3/d2a/f14 [2509319,91511] 0 2024-04-25T15:58:02.802 INFO:tasks.workunit.client.0.smithi087.stdout:8/153: sync 2024-04-25T15:58:02.802 INFO:tasks.workunit.client.0.smithi087.stdout:9/156: sync 2024-04-25T15:58:02.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/142: sync 2024-04-25T15:58:02.803 INFO:tasks.workunit.client.0.smithi087.stdout:3/183: truncate d4/d17/f2a 295571 0 2024-04-25T15:58:02.807 INFO:tasks.workunit.client.0.smithi087.stdout:0/162: symlink d1/d6/d1b/l35 0 2024-04-25T15:58:02.808 INFO:tasks.workunit.client.0.smithi087.stdout:8/154: rmdir d4/d8/dd 39 2024-04-25T15:58:02.809 INFO:tasks.workunit.client.0.smithi087.stdout:6/175: dwrite d7/d1a/d1d/d21/d23/f24 [0,4194304] 0 2024-04-25T15:58:02.810 INFO:tasks.workunit.client.0.smithi087.stdout:9/157: symlink d6/d8/d29/l31 0 2024-04-25T15:58:02.811 INFO:tasks.workunit.client.0.smithi087.stdout:7/168: dwrite f0 [8388608,4194304] 0 2024-04-25T15:58:02.812 INFO:tasks.workunit.client.0.smithi087.stdout:2/236: dwrite d3/d2a/f1f [0,4194304] 0 2024-04-25T15:58:02.817 INFO:tasks.workunit.client.0.smithi087.stdout:2/237: truncate d3/d27/d29/f2e 5519829 0 2024-04-25T15:58:02.818 INFO:tasks.workunit.client.0.smithi087.stdout:4/143: getdents d4/d7/d15 0 2024-04-25T15:58:02.821 INFO:tasks.workunit.client.0.smithi087.stdout:6/176: truncate d7/fc 4235401 0 2024-04-25T15:58:02.821 INFO:tasks.workunit.client.0.smithi087.stdout:2/238: write d3/d2a/f1f [4048014,113716] 0 2024-04-25T15:58:02.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/177: stat d7/c2d 0 2024-04-25T15:58:02.823 INFO:tasks.workunit.client.0.smithi087.stdout:4/144: chown d4/d7/d15/d21/f28 6 1 2024-04-25T15:58:02.825 INFO:tasks.workunit.client.0.smithi087.stdout:0/163: read d1/f5 [2488382,63226] 0 2024-04-25T15:58:02.828 INFO:tasks.workunit.client.0.smithi087.stdout:9/158: dwrite d6/d8/d12/f2f [0,4194304] 0 2024-04-25T15:58:02.828 INFO:tasks.workunit.client.0.smithi087.stdout:8/155: dwrite d4/fa [0,4194304] 0 2024-04-25T15:58:02.830 INFO:tasks.workunit.client.0.smithi087.stdout:3/184: truncate d4/d17/f1e 3289632 0 2024-04-25T15:58:02.831 INFO:tasks.workunit.client.0.smithi087.stdout:2/239: symlink d3/d27/d29/d2d/d40/l43 0 2024-04-25T15:58:02.836 INFO:tasks.workunit.client.0.smithi087.stdout:4/145: dwrite d4/d7/d15/fc [0,4194304] 0 2024-04-25T15:58:02.837 INFO:tasks.workunit.client.0.smithi087.stdout:6/178: rename d7/d1a/d1d/d21/f22 to d7/f40 0 2024-04-25T15:58:02.838 INFO:tasks.workunit.client.0.smithi087.stdout:6/179: fsync d7/f14 0 2024-04-25T15:58:02.838 INFO:tasks.workunit.client.0.smithi087.stdout:9/159: mkdir d6/d8/d32 0 2024-04-25T15:58:02.840 INFO:tasks.workunit.client.0.smithi087.stdout:2/240: dread d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:02.840 INFO:tasks.workunit.client.0.smithi087.stdout:9/160: truncate d6/f1c 269106 0 2024-04-25T15:58:02.841 INFO:tasks.workunit.client.0.smithi087.stdout:3/185: mkdir d4/db/d28/d3c 0 2024-04-25T15:58:02.842 INFO:tasks.workunit.client.0.smithi087.stdout:2/241: stat d3/f23 0 2024-04-25T15:58:02.844 INFO:tasks.workunit.client.0.smithi087.stdout:4/146: dread d4/d7/d15/f1d [0,4194304] 0 2024-04-25T15:58:02.846 INFO:tasks.workunit.client.0.smithi087.stdout:3/186: chown d4/f6 3722503 1 2024-04-25T15:58:02.847 INFO:tasks.workunit.client.0.smithi087.stdout:7/169: truncate d1/d1a/f20 1276823 0 2024-04-25T15:58:02.847 INFO:tasks.workunit.client.0.smithi087.stdout:4/147: write d4/f1e [663085,5188] 0 2024-04-25T15:58:02.847 INFO:tasks.workunit.client.0.smithi087.stdout:3/187: fdatasync d4/d17/f1b 0 2024-04-25T15:58:02.850 INFO:tasks.workunit.client.0.smithi087.stdout:0/164: getdents d1/d6/d21 0 2024-04-25T15:58:02.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/156: dread d4/d9/f15 [0,4194304] 0 2024-04-25T15:58:02.851 INFO:tasks.workunit.client.0.smithi087.stdout:7/170: readlink d1/l21 0 2024-04-25T15:58:02.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/148: fdatasync d4/d7/f11 0 2024-04-25T15:58:02.854 INFO:tasks.workunit.client.0.smithi087.stdout:9/161: rmdir d6/d8/d14/d1d/d30 0 2024-04-25T15:58:02.856 INFO:tasks.workunit.client.0.smithi087.stdout:6/180: dwrite d7/d1a/d1d/d21/d23/f24 [0,4194304] 0 2024-04-25T15:58:02.857 INFO:tasks.workunit.client.0.smithi087.stdout:2/242: dwrite d3/d2a/f1b [0,4194304] 0 2024-04-25T15:58:02.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/188: creat d4/d14/f3d x:0 0 0 2024-04-25T15:58:02.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/171: creat d1/d1a/f39 x:0 0 0 2024-04-25T15:58:02.861 INFO:tasks.workunit.client.0.smithi087.stdout:6/181: mkdir d7/d1a/d41 0 2024-04-25T15:58:02.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/149: dread d4/d7/d15/d12/f2a [0,4194304] 0 2024-04-25T15:58:02.862 INFO:tasks.workunit.client.0.smithi087.stdout:0/165: creat d1/d6/f36 x:0 0 0 2024-04-25T15:58:02.863 INFO:tasks.workunit.client.0.smithi087.stdout:8/157: dread d4/d9/f23 [4194304,4194304] 0 2024-04-25T15:58:02.863 INFO:tasks.workunit.client.0.smithi087.stdout:3/189: creat d4/d17/d27/f3e x:0 0 0 2024-04-25T15:58:02.865 INFO:tasks.workunit.client.0.smithi087.stdout:3/190: chown d4/db/f11 64915 1 2024-04-25T15:58:02.868 INFO:tasks.workunit.client.0.smithi087.stdout:2/243: rename d3/f23 to d3/d27/d29/d2d/d3a/f44 0 2024-04-25T15:58:02.869 INFO:tasks.workunit.client.0.smithi087.stdout:7/172: creat d1/d4/d18/d36/f3a x:0 0 0 2024-04-25T15:58:02.872 INFO:tasks.workunit.client.0.smithi087.stdout:8/158: dread d4/f28 [0,4194304] 0 2024-04-25T15:58:02.873 INFO:tasks.workunit.client.0.smithi087.stdout:6/182: rmdir d7/d1a/d1d/d21/d27/d2c/d35 39 2024-04-25T15:58:02.873 INFO:tasks.workunit.client.0.smithi087.stdout:7/173: stat d1/d4/d18/l2b 0 2024-04-25T15:58:02.874 INFO:tasks.workunit.client.0.smithi087.stdout:2/244: creat d3/d20/f45 x:0 0 0 2024-04-25T15:58:02.875 INFO:tasks.workunit.client.0.smithi087.stdout:3/191: dread d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:02.876 INFO:tasks.workunit.client.0.smithi087.stdout:0/166: getdents d1/d6/d1b/d34 0 2024-04-25T15:58:02.876 INFO:tasks.workunit.client.0.smithi087.stdout:4/150: dwrite d4/d7/d15/d12/f1c [4194304,4194304] 0 2024-04-25T15:58:02.877 INFO:tasks.workunit.client.0.smithi087.stdout:8/159: truncate d4/d1d/d14/f31 935060 0 2024-04-25T15:58:02.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/174: readlink d1/d9/l22 0 2024-04-25T15:58:02.878 INFO:tasks.workunit.client.0.smithi087.stdout:7/175: dread - d1/d1a/f39 zero size 2024-04-25T15:58:02.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/162: truncate d6/f1c 85238 0 2024-04-25T15:58:02.881 INFO:tasks.workunit.client.0.smithi087.stdout:0/167: write d1/d6/d21/d2a/f31 [146747,9891] 0 2024-04-25T15:58:02.882 INFO:tasks.workunit.client.0.smithi087.stdout:8/160: truncate d4/d1d/d17/f2e 125269 0 2024-04-25T15:58:02.884 INFO:tasks.workunit.client.0.smithi087.stdout:2/245: dread d3/d27/d29/f2c [0,4194304] 0 2024-04-25T15:58:02.884 INFO:tasks.workunit.client.0.smithi087.stdout:3/192: getdents d4/d14/d37 0 2024-04-25T15:58:02.885 INFO:tasks.workunit.client.0.smithi087.stdout:2/246: readlink d3/d20/l37 0 2024-04-25T15:58:02.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/223: sync 2024-04-25T15:58:02.886 INFO:tasks.workunit.client.0.smithi087.stdout:9/163: rmdir d6/d8/d14 39 2024-04-25T15:58:02.887 INFO:tasks.workunit.client.0.smithi087.stdout:5/224: dread - d9/d2c/d41/d44/f47 zero size 2024-04-25T15:58:02.887 INFO:tasks.workunit.client.0.smithi087.stdout:5/225: fsync d9/f25 0 2024-04-25T15:58:02.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/226: stat d9/c11 0 2024-04-25T15:58:02.888 INFO:tasks.workunit.client.0.smithi087.stdout:3/193: unlink d4/f6 0 2024-04-25T15:58:02.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/227: fdatasync d9/f2d 0 2024-04-25T15:58:02.889 INFO:tasks.workunit.client.0.smithi087.stdout:2/247: rmdir d3 39 2024-04-25T15:58:02.889 INFO:tasks.workunit.client.0.smithi087.stdout:7/176: dwrite d1/d4/f29 [0,4194304] 0 2024-04-25T15:58:02.903 INFO:tasks.workunit.client.0.smithi087.stdout:0/168: rename d1/f3 to d1/d6/d1f/f37 0 2024-04-25T15:58:02.903 INFO:tasks.workunit.client.0.smithi087.stdout:4/151: link d4/d7/d15/d21/f28 d4/d7/d15/d21/f2d 0 2024-04-25T15:58:02.903 INFO:tasks.workunit.client.0.smithi087.stdout:6/183: truncate d7/d1a/d2a/f3c 4579335 0 2024-04-25T15:58:02.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/164: mknod d6/d8/d12/c33 0 2024-04-25T15:58:02.905 INFO:tasks.workunit.client.0.smithi087.stdout:6/184: write d7/f14 [740131,91560] 0 2024-04-25T15:58:02.905 INFO:tasks.workunit.client.0.smithi087.stdout:4/152: chown d4/d10/f2b 14081 1 2024-04-25T15:58:02.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/169: creat d1/d6/d1b/f38 x:0 0 0 2024-04-25T15:58:02.907 INFO:tasks.workunit.client.0.smithi087.stdout:2/248: write d3/f7 [5241588,117994] 0 2024-04-25T15:58:02.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/177: rename d1/d4/f13 to d1/d9/d26/f3b 0 2024-04-25T15:58:02.908 INFO:tasks.workunit.client.0.smithi087.stdout:9/165: chown d6/d8/f17 15251675 1 2024-04-25T15:58:02.909 INFO:tasks.workunit.client.0.smithi087.stdout:4/153: truncate d4/d7/d15/d12/f17 22031 0 2024-04-25T15:58:02.915 INFO:tasks.workunit.client.0.smithi087.stdout:2/249: creat d3/d20/f46 x:0 0 0 2024-04-25T15:58:02.916 INFO:tasks.workunit.client.0.smithi087.stdout:9/166: dread d6/f2b [0,4194304] 0 2024-04-25T15:58:02.916 INFO:tasks.workunit.client.0.smithi087.stdout:0/170: dwrite d1/d6/d1b/f2b [0,4194304] 0 2024-04-25T15:58:02.919 INFO:tasks.workunit.client.0.smithi087.stdout:9/167: write d6/d8/d12/f2f [1819015,111108] 0 2024-04-25T15:58:02.921 INFO:tasks.workunit.client.0.smithi087.stdout:5/228: dwrite f3 [0,4194304] 0 2024-04-25T15:58:02.927 INFO:tasks.workunit.client.0.smithi087.stdout:3/194: dwrite d4/db/f38 [0,4194304] 0 2024-04-25T15:58:02.929 INFO:tasks.workunit.client.0.smithi087.stdout:2/250: dwrite d3/d20/f45 [0,4194304] 0 2024-04-25T15:58:02.931 INFO:tasks.workunit.client.0.smithi087.stdout:2/251: write d3/d2a/f1f [3989107,109646] 0 2024-04-25T15:58:02.931 INFO:tasks.workunit.client.0.smithi087.stdout:5/229: mkdir d9/d2c/d49 0 2024-04-25T15:58:02.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/178: rename d1/d1a/d2f to d1/d3c 0 2024-04-25T15:58:02.943 INFO:tasks.workunit.client.0.smithi087.stdout:9/168: mknod d6/d8/d14/d1d/c34 0 2024-04-25T15:58:02.945 INFO:tasks.workunit.client.0.smithi087.stdout:0/171: rename d1/d6/d1b to d1/d6/d39 0 2024-04-25T15:58:02.946 INFO:tasks.workunit.client.0.smithi087.stdout:3/195: mkdir d4/d17/d24/d3f 0 2024-04-25T15:58:02.948 INFO:tasks.workunit.client.0.smithi087.stdout:5/230: link d9/f22 d9/d2c/d41/d44/f4a 0 2024-04-25T15:58:02.949 INFO:tasks.workunit.client.0.smithi087.stdout:7/179: truncate d1/f8 620793 0 2024-04-25T15:58:02.950 INFO:tasks.workunit.client.0.smithi087.stdout:9/169: truncate d6/f1c 300175 0 2024-04-25T15:58:02.950 INFO:tasks.workunit.client.0.smithi087.stdout:2/252: dwrite d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:02.951 INFO:tasks.workunit.client.0.smithi087.stdout:0/172: write d1/f26 [132280,127383] 0 2024-04-25T15:58:02.951 INFO:tasks.workunit.client.0.smithi087.stdout:9/170: chown d6 8 1 2024-04-25T15:58:02.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/196: creat d4/d14/d37/f40 x:0 0 0 2024-04-25T15:58:02.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/231: symlink d9/d2c/d49/l4b 0 2024-04-25T15:58:02.953 INFO:tasks.workunit.client.0.smithi087.stdout:5/232: chown d9/f29 239978 1 2024-04-25T15:58:02.953 INFO:tasks.workunit.client.0.smithi087.stdout:7/180: rename d1/d4/f29 to d1/d4/f3d 0 2024-04-25T15:58:02.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/197: dread d4/d17/f20 [0,4194304] 0 2024-04-25T15:58:02.959 INFO:tasks.workunit.client.0.smithi087.stdout:4/154: truncate d4/d7/d15/fe 810560 0 2024-04-25T15:58:02.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/233: rmdir d9 39 2024-04-25T15:58:02.965 INFO:tasks.workunit.client.0.smithi087.stdout:9/171: creat d6/d8/d32/f35 x:0 0 0 2024-04-25T15:58:02.965 INFO:tasks.workunit.client.0.smithi087.stdout:9/172: chown d6/d8/d12/l26 12692 1 2024-04-25T15:58:02.966 INFO:tasks.workunit.client.0.smithi087.stdout:6/185: truncate d7/f10 5060154 0 2024-04-25T15:58:02.970 INFO:tasks.workunit.client.0.smithi087.stdout:1/186: sync 2024-04-25T15:58:02.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/155: symlink d4/l2e 0 2024-04-25T15:58:02.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/198: dwrite d4/f12 [0,4194304] 0 2024-04-25T15:58:02.976 INFO:tasks.workunit.client.0.smithi087.stdout:4/156: write d4/d7/d15/fc [5338231,108493] 0 2024-04-25T15:58:02.979 INFO:tasks.workunit.client.0.smithi087.stdout:0/173: creat d1/da/f3a x:0 0 0 2024-04-25T15:58:02.979 INFO:tasks.workunit.client.0.smithi087.stdout:5/234: dwrite d9/f2a [0,4194304] 0 2024-04-25T15:58:02.979 INFO:tasks.workunit.client.0.smithi087.stdout:2/253: truncate d3/d27/d29/f2e 2210450 0 2024-04-25T15:58:02.980 INFO:tasks.workunit.client.0.smithi087.stdout:0/174: chown d1/d6/d21/d2a 33057 1 2024-04-25T15:58:02.982 INFO:tasks.workunit.client.0.smithi087.stdout:1/187: symlink d3/d12/d14/d29/l32 0 2024-04-25T15:58:02.983 INFO:tasks.workunit.client.0.smithi087.stdout:6/186: rename d7/l11 to d7/d1a/d1d/d21/l42 0 2024-04-25T15:58:02.983 INFO:tasks.workunit.client.0.smithi087.stdout:7/181: dread d1/fd [0,4194304] 0 2024-04-25T15:58:02.984 INFO:tasks.workunit.client.0.smithi087.stdout:3/199: unlink d4/d14/f15 0 2024-04-25T15:58:02.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/235: unlink d9/d2f/d3b/l3f 0 2024-04-25T15:58:02.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/236: stat d9/f2d 0 2024-04-25T15:58:02.986 INFO:tasks.workunit.client.0.smithi087.stdout:2/254: mkdir d3/d27/d29/d2d/d3a/d47 0 2024-04-25T15:58:02.987 INFO:tasks.workunit.client.0.smithi087.stdout:1/188: chown d3/d12/d14/c1a 30044 1 2024-04-25T15:58:02.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/157: creat d4/d27/f2f x:0 0 0 2024-04-25T15:58:02.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/187: mknod d7/d1a/d1d/d21/d37/c43 0 2024-04-25T15:58:02.989 INFO:tasks.workunit.client.0.smithi087.stdout:3/200: creat d4/d17/d24/d29/f41 x:0 0 0 2024-04-25T15:58:02.990 INFO:tasks.workunit.client.0.smithi087.stdout:6/188: read f6 [1612510,94563] 0 2024-04-25T15:58:02.990 INFO:tasks.workunit.client.0.smithi087.stdout:2/255: rmdir d3/d2a 39 2024-04-25T15:58:02.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/182: dread d1/d1a/f20 [0,4194304] 0 2024-04-25T15:58:02.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/158: creat d4/d7/d15/d13/f30 x:0 0 0 2024-04-25T15:58:02.993 INFO:tasks.workunit.client.0.smithi087.stdout:6/189: rmdir d7/d1a 39 2024-04-25T15:58:02.994 INFO:tasks.workunit.client.0.smithi087.stdout:1/189: mkdir d3/d12/d14/d33 0 2024-04-25T15:58:02.996 INFO:tasks.workunit.client.0.smithi087.stdout:0/175: getdents d1/d6/d39 0 2024-04-25T15:58:02.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/256: mkdir d3/d2a/d48 0 2024-04-25T15:58:02.998 INFO:tasks.workunit.client.0.smithi087.stdout:0/176: readlink d1/l30 0 2024-04-25T15:58:02.999 INFO:tasks.workunit.client.0.smithi087.stdout:4/159: read d4/d7/d15/d13/f1b [3036890,7336] 0 2024-04-25T15:58:03.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/201: rename d4/d17/d24/f36 to d4/db/d28/d3c/f42 0 2024-04-25T15:58:03.001 INFO:tasks.workunit.client.0.smithi087.stdout:1/190: symlink d3/d12/d14/d29/l34 0 2024-04-25T15:58:03.001 INFO:tasks.workunit.client.0.smithi087.stdout:5/237: dwrite d9/f2b [0,4194304] 0 2024-04-25T15:58:03.002 INFO:tasks.workunit.client.0.smithi087.stdout:7/183: dread d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:03.003 INFO:tasks.workunit.client.0.smithi087.stdout:1/191: truncate d3/f1b 771505 0 2024-04-25T15:58:03.005 INFO:tasks.workunit.client.0.smithi087.stdout:6/190: unlink d7/d1a/d1d/d21/f26 0 2024-04-25T15:58:03.008 INFO:tasks.workunit.client.0.smithi087.stdout:5/238: creat d9/d2f/d3b/f4c x:0 0 0 2024-04-25T15:58:03.008 INFO:tasks.workunit.client.0.smithi087.stdout:6/191: read d7/fc [2003122,87135] 0 2024-04-25T15:58:03.011 INFO:tasks.workunit.client.0.smithi087.stdout:5/239: truncate d9/f2d 5008026 0 2024-04-25T15:58:03.011 INFO:tasks.workunit.client.0.smithi087.stdout:3/202: symlink d4/d14/d23/l43 0 2024-04-25T15:58:03.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/257: dwrite d3/d27/f41 [0,4194304] 0 2024-04-25T15:58:03.014 INFO:tasks.workunit.client.0.smithi087.stdout:3/203: readlink d4/d14/d23/l43 0 2024-04-25T15:58:03.014 INFO:tasks.workunit.client.0.smithi087.stdout:5/240: chown d9/d2c/f2e 12 1 2024-04-25T15:58:03.014 INFO:tasks.workunit.client.0.smithi087.stdout:4/160: dwrite d4/d7/d15/d12/f1f [4194304,4194304] 0 2024-04-25T15:58:03.015 INFO:tasks.workunit.client.0.smithi087.stdout:5/241: read d9/fa [1294802,37989] 0 2024-04-25T15:58:03.015 INFO:tasks.workunit.client.0.smithi087.stdout:0/177: creat d1/d6/f3b x:0 0 0 2024-04-25T15:58:03.017 INFO:tasks.workunit.client.0.smithi087.stdout:4/161: write d4/f1e [1633897,11036] 0 2024-04-25T15:58:03.017 INFO:tasks.workunit.client.0.smithi087.stdout:3/204: fsync d4/d17/d24/d29/f41 0 2024-04-25T15:58:03.019 INFO:tasks.workunit.client.0.smithi087.stdout:1/192: creat d3/f35 x:0 0 0 2024-04-25T15:58:03.021 INFO:tasks.workunit.client.0.smithi087.stdout:5/242: write d9/f12 [1626180,21569] 0 2024-04-25T15:58:03.022 INFO:tasks.workunit.client.0.smithi087.stdout:2/258: mknod d3/d2a/c49 0 2024-04-25T15:58:03.024 INFO:tasks.workunit.client.0.smithi087.stdout:6/192: creat d7/d1a/d41/f44 x:0 0 0 2024-04-25T15:58:03.030 INFO:tasks.workunit.client.0.smithi087.stdout:2/259: rename d3/d27/d29/d2d/d3a to d3/d20/d4a 0 2024-04-25T15:58:03.030 INFO:tasks.workunit.client.0.smithi087.stdout:7/184: dwrite d1/d4/d18/f1b [0,4194304] 0 2024-04-25T15:58:03.031 INFO:tasks.workunit.client.0.smithi087.stdout:7/185: write d1/d1a/f39 [406642,39976] 0 2024-04-25T15:58:03.032 INFO:tasks.workunit.client.0.smithi087.stdout:4/162: mknod d4/c31 0 2024-04-25T15:58:03.033 INFO:tasks.workunit.client.0.smithi087.stdout:1/193: creat d3/d12/d14/d29/d2f/f36 x:0 0 0 2024-04-25T15:58:03.035 INFO:tasks.workunit.client.0.smithi087.stdout:2/260: unlink d3/d2a/f13 0 2024-04-25T15:58:03.036 INFO:tasks.workunit.client.0.smithi087.stdout:6/193: mkdir d7/d1a/d1d/d21/d27/d2c/d35/d45 0 2024-04-25T15:58:03.037 INFO:tasks.workunit.client.0.smithi087.stdout:4/163: chown d4/d7/d15/fe 657 1 2024-04-25T15:58:03.040 INFO:tasks.workunit.client.0.smithi087.stdout:6/194: write d7/ff [65481,99673] 0 2024-04-25T15:58:03.044 INFO:tasks.workunit.client.0.smithi087.stdout:1/194: link d3/d12/f26 d3/d12/d14/f37 0 2024-04-25T15:58:03.044 INFO:tasks.workunit.client.0.smithi087.stdout:7/186: dwrite d1/f23 [0,4194304] 0 2024-04-25T15:58:03.045 INFO:tasks.workunit.client.0.smithi087.stdout:1/195: write d3/d12/d14/f31 [836293,98086] 0 2024-04-25T15:58:03.047 INFO:tasks.workunit.client.0.smithi087.stdout:1/196: read - d3/f35 zero size 2024-04-25T15:58:03.050 INFO:tasks.workunit.client.0.smithi087.stdout:2/261: truncate d3/d27/f41 275828 0 2024-04-25T15:58:03.050 INFO:tasks.workunit.client.0.smithi087.stdout:1/197: chown d3/d12/f19 1 1 2024-04-25T15:58:03.051 INFO:tasks.workunit.client.0.smithi087.stdout:3/205: dwrite d4/d17/d27/f34 [0,4194304] 0 2024-04-25T15:58:03.053 INFO:tasks.workunit.client.0.smithi087.stdout:3/206: dread - d4/db/d28/d3c/f42 zero size 2024-04-25T15:58:03.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/198: creat d3/d2d/f38 x:0 0 0 2024-04-25T15:58:03.058 INFO:tasks.workunit.client.0.smithi087.stdout:2/262: dread d3/d2a/f1f [0,4194304] 0 2024-04-25T15:58:03.060 INFO:tasks.workunit.client.0.smithi087.stdout:6/195: dwrite d7/f8 [0,4194304] 0 2024-04-25T15:58:03.060 INFO:tasks.workunit.client.0.smithi087.stdout:2/263: creat d3/d2a/d1c/f4b x:0 0 0 2024-04-25T15:58:03.060 INFO:tasks.workunit.client.0.smithi087.stdout:1/199: getdents d3/d12/d14/d33 0 2024-04-25T15:58:03.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/207: dread d4/f16 [0,4194304] 0 2024-04-25T15:58:03.105 INFO:tasks.workunit.client.0.smithi087.stdout:8/161: sync 2024-04-25T15:58:03.126 INFO:tasks.workunit.client.0.smithi087.stdout:8/162: chown d4/d1d/d17 2575 1 2024-04-25T15:58:03.131 INFO:tasks.workunit.client.0.smithi087.stdout:6/196: dwrite d7/f2b [0,4194304] 0 2024-04-25T15:58:03.133 INFO:tasks.workunit.client.0.smithi087.stdout:3/208: getdents d4 0 2024-04-25T15:58:03.134 INFO:tasks.workunit.client.0.smithi087.stdout:2/264: dread d3/d20/f45 [0,4194304] 0 2024-04-25T15:58:03.135 INFO:tasks.workunit.client.0.smithi087.stdout:1/200: dwrite d3/f1b [0,4194304] 0 2024-04-25T15:58:03.141 INFO:tasks.workunit.client.0.smithi087.stdout:1/201: mkdir d3/d12/d39 0 2024-04-25T15:58:03.142 INFO:tasks.workunit.client.0.smithi087.stdout:1/202: dread - d3/f35 zero size 2024-04-25T15:58:03.145 INFO:tasks.workunit.client.0.smithi087.stdout:3/209: rename d4/d17/d27/f3e to d4/d17/d27/f44 0 2024-04-25T15:58:03.151 INFO:tasks.workunit.client.0.smithi087.stdout:1/203: rmdir d3/d12/d14 39 2024-04-25T15:58:03.152 INFO:tasks.workunit.client.0.smithi087.stdout:8/163: getdents d4/d22 0 2024-04-25T15:58:03.152 INFO:tasks.workunit.client.0.smithi087.stdout:1/204: truncate d3/d12/f26 864222 0 2024-04-25T15:58:03.153 INFO:tasks.workunit.client.0.smithi087.stdout:3/210: mknod d4/d14/c45 0 2024-04-25T15:58:03.154 INFO:tasks.workunit.client.0.smithi087.stdout:1/205: rename d3/d12 to d3/d12/d22/d3a 22 2024-04-25T15:58:03.155 INFO:tasks.workunit.client.0.smithi087.stdout:2/265: unlink d3/d27/c32 0 2024-04-25T15:58:03.159 INFO:tasks.workunit.client.0.smithi087.stdout:8/164: unlink d4/d8/le 0 2024-04-25T15:58:03.162 INFO:tasks.workunit.client.0.smithi087.stdout:3/211: unlink d4/ld 0 2024-04-25T15:58:03.168 INFO:tasks.workunit.client.0.smithi087.stdout:2/266: dwrite d3/f7 [4194304,4194304] 0 2024-04-25T15:58:03.170 INFO:tasks.workunit.client.0.smithi087.stdout:1/206: mkdir d3/d12/d14/d29/d3b 0 2024-04-25T15:58:03.171 INFO:tasks.workunit.client.0.smithi087.stdout:2/267: truncate d3/d2a/d1c/f4b 937535 0 2024-04-25T15:58:03.172 INFO:tasks.workunit.client.0.smithi087.stdout:2/268: write d3/d20/f46 [655074,23813] 0 2024-04-25T15:58:03.174 INFO:tasks.workunit.client.0.smithi087.stdout:8/165: link d4/d9/f1a d4/d1d/d17/f33 0 2024-04-25T15:58:03.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/166: rmdir d4/d1d 39 2024-04-25T15:58:03.182 INFO:tasks.workunit.client.0.smithi087.stdout:6/197: truncate d7/f40 1521649 0 2024-04-25T15:58:03.183 INFO:tasks.workunit.client.0.smithi087.stdout:1/207: symlink d3/d12/d39/l3c 0 2024-04-25T15:58:03.188 INFO:tasks.workunit.client.0.smithi087.stdout:6/198: rmdir d7/d1a/d1d/d21/d27/d2c 39 2024-04-25T15:58:03.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/167: rename f1 to d4/d8/dd/f34 0 2024-04-25T15:58:03.192 INFO:tasks.workunit.client.0.smithi087.stdout:1/208: symlink d3/d12/d14/l3d 0 2024-04-25T15:58:03.194 INFO:tasks.workunit.client.0.smithi087.stdout:2/269: dwrite d3/d27/f42 [0,4194304] 0 2024-04-25T15:58:03.194 INFO:tasks.workunit.client.0.smithi087.stdout:6/199: mknod d7/d1a/d2a/c46 0 2024-04-25T15:58:03.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/212: rmdir d4/db/d28/d3c 39 2024-04-25T15:58:03.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/209: rename d3/d12/c15 to d3/d12/d14/d29/d3b/c3e 0 2024-04-25T15:58:03.214 INFO:tasks.workunit.client.0.smithi087.stdout:6/200: truncate d7/f18 3316640 0 2024-04-25T15:58:03.218 INFO:tasks.workunit.client.0.smithi087.stdout:3/213: creat d4/d17/d24/f46 x:0 0 0 2024-04-25T15:58:03.218 INFO:tasks.workunit.client.0.smithi087.stdout:8/168: write d4/d1d/d17/f33 [1647329,119191] 0 2024-04-25T15:58:03.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/201: readlink d7/l20 0 2024-04-25T15:58:03.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/202: chown d7/f12 2740086 1 2024-04-25T15:58:03.221 INFO:tasks.workunit.client.0.smithi087.stdout:9/173: sync 2024-04-25T15:58:03.221 INFO:tasks.workunit.client.0.smithi087.stdout:2/270: fdatasync d3/d27/d29/f2e 0 2024-04-25T15:58:03.224 INFO:tasks.workunit.client.0.smithi087.stdout:9/174: read d6/d8/f17 [3499306,27111] 0 2024-04-25T15:58:03.225 INFO:tasks.workunit.client.0.smithi087.stdout:6/203: read d7/fc [374920,113889] 0 2024-04-25T15:58:03.231 INFO:tasks.workunit.client.0.smithi087.stdout:6/204: dread d7/d1a/d1d/f28 [0,4194304] 0 2024-04-25T15:58:03.232 INFO:tasks.workunit.client.0.smithi087.stdout:2/271: write d3/d20/f45 [3776700,87839] 0 2024-04-25T15:58:03.233 INFO:tasks.workunit.client.0.smithi087.stdout:2/272: chown d3/d2a/f1f 92511447 1 2024-04-25T15:58:03.233 INFO:tasks.workunit.client.0.smithi087.stdout:8/169: mknod d4/d8/dd/d2f/c35 0 2024-04-25T15:58:03.235 INFO:tasks.workunit.client.0.smithi087.stdout:9/175: creat d6/d8/d14/d1d/f36 x:0 0 0 2024-04-25T15:58:03.237 INFO:tasks.workunit.client.0.smithi087.stdout:6/205: mknod d7/d1a/d1d/d21/d37/c47 0 2024-04-25T15:58:03.242 INFO:tasks.workunit.client.0.smithi087.stdout:8/170: dread d4/f28 [0,4194304] 0 2024-04-25T15:58:03.245 INFO:tasks.workunit.client.0.smithi087.stdout:6/206: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/f48 x:0 0 0 2024-04-25T15:58:03.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/171: write d4/fa [3410244,78887] 0 2024-04-25T15:58:03.245 INFO:tasks.workunit.client.0.smithi087.stdout:3/214: dwrite d4/db/d28/d3c/f42 [0,4194304] 0 2024-04-25T15:58:03.249 INFO:tasks.workunit.client.0.smithi087.stdout:8/172: write d4/d1d/d17/f33 [3238209,15062] 0 2024-04-25T15:58:03.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/173: fdatasync d4/fa 0 2024-04-25T15:58:03.251 INFO:tasks.workunit.client.0.smithi087.stdout:9/176: dwrite d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:03.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/215: chown d4/l1f 24 1 2024-04-25T15:58:03.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/177: rmdir d6/d8/d14 39 2024-04-25T15:58:03.259 INFO:tasks.workunit.client.0.smithi087.stdout:8/174: symlink d4/d1d/d17/l36 0 2024-04-25T15:58:03.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/178: rmdir d6/d8/d29 39 2024-04-25T15:58:03.264 INFO:tasks.workunit.client.0.smithi087.stdout:8/175: write d4/d1d/d17/f33 [4133177,105972] 0 2024-04-25T15:58:03.264 INFO:tasks.workunit.client.0.smithi087.stdout:3/216: write d4/f16 [232447,6023] 0 2024-04-25T15:58:03.266 INFO:tasks.workunit.client.0.smithi087.stdout:8/176: write d4/d8/fb [1730195,106775] 0 2024-04-25T15:58:03.268 INFO:tasks.workunit.client.0.smithi087.stdout:6/207: dwrite d7/f40 [0,4194304] 0 2024-04-25T15:58:03.269 INFO:tasks.workunit.client.0.smithi087.stdout:3/217: creat d4/db/f47 x:0 0 0 2024-04-25T15:58:03.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/177: mkdir d4/d1d/d17/d37 0 2024-04-25T15:58:03.272 INFO:tasks.workunit.client.0.smithi087.stdout:8/178: fsync d4/d1d/d14/f2c 0 2024-04-25T15:58:03.275 INFO:tasks.workunit.client.0.smithi087.stdout:6/208: rename d7/c1e to d7/d1a/d1d/d21/d27/d2c/c49 0 2024-04-25T15:58:03.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/179: truncate f0 1535939 0 2024-04-25T15:58:03.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/180: stat d6/f2b 0 2024-04-25T15:58:03.276 INFO:tasks.workunit.client.0.smithi087.stdout:8/179: symlink d4/d9/l38 0 2024-04-25T15:58:03.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/209: dread d7/d1a/d1d/f28 [0,4194304] 0 2024-04-25T15:58:03.280 INFO:tasks.workunit.client.0.smithi087.stdout:9/181: creat d6/d8/d12/f37 x:0 0 0 2024-04-25T15:58:03.282 INFO:tasks.workunit.client.0.smithi087.stdout:6/210: creat d7/d1a/d1d/f4a x:0 0 0 2024-04-25T15:58:03.283 INFO:tasks.workunit.client.0.smithi087.stdout:3/218: dwrite d4/db/f11 [0,4194304] 0 2024-04-25T15:58:03.286 INFO:tasks.workunit.client.0.smithi087.stdout:3/219: truncate d4/db/d28/f3a 811366 0 2024-04-25T15:58:03.287 INFO:tasks.workunit.client.0.smithi087.stdout:9/182: rmdir d6/d8/d14/d1d 39 2024-04-25T15:58:03.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/211: dread d7/f12 [0,4194304] 0 2024-04-25T15:58:03.300 INFO:tasks.workunit.client.0.smithi087.stdout:3/220: dwrite d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:03.300 INFO:tasks.workunit.client.0.smithi087.stdout:8/180: dread d4/d9/f1c [0,4194304] 0 2024-04-25T15:58:03.301 INFO:tasks.workunit.client.0.smithi087.stdout:6/212: dread d7/f10 [4194304,4194304] 0 2024-04-25T15:58:03.303 INFO:tasks.workunit.client.0.smithi087.stdout:3/221: chown d4/d14/d37/f40 5712701 1 2024-04-25T15:58:03.304 INFO:tasks.workunit.client.0.smithi087.stdout:6/213: chown d7/d1a/d1d/d21/l3d 320436308 1 2024-04-25T15:58:03.306 INFO:tasks.workunit.client.0.smithi087.stdout:8/181: getdents d4/d9 0 2024-04-25T15:58:03.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/183: dwrite d6/f1c [0,4194304] 0 2024-04-25T15:58:03.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/214: symlink d7/d1a/d1d/d21/d27/d2c/l4b 0 2024-04-25T15:58:03.312 INFO:tasks.workunit.client.0.smithi087.stdout:9/184: stat d6/d8/d29 0 2024-04-25T15:58:03.313 INFO:tasks.workunit.client.0.smithi087.stdout:6/215: rmdir d7/d1a/d1d/d21/d27 39 2024-04-25T15:58:03.313 INFO:tasks.workunit.client.0.smithi087.stdout:8/182: dread d4/d9/f15 [0,4194304] 0 2024-04-25T15:58:03.316 INFO:tasks.workunit.client.0.smithi087.stdout:9/185: fdatasync f0 0 2024-04-25T15:58:03.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/183: fsync d4/d22/f2a 0 2024-04-25T15:58:03.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/184: chown d4/d9 503 1 2024-04-25T15:58:03.318 INFO:tasks.workunit.client.0.smithi087.stdout:8/185: stat d4/d9/f15 0 2024-04-25T15:58:03.318 INFO:tasks.workunit.client.0.smithi087.stdout:8/186: stat d4/f28 0 2024-04-25T15:58:03.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/216: dread d7/f40 [0,4194304] 0 2024-04-25T15:58:03.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/217: fsync d7/d1a/d41/f44 0 2024-04-25T15:58:03.322 INFO:tasks.workunit.client.0.smithi087.stdout:3/222: truncate d4/d17/d27/f34 277426 0 2024-04-25T15:58:03.323 INFO:tasks.workunit.client.0.smithi087.stdout:6/218: symlink d7/d1a/d1d/d21/d27/d2c/d35/d45/l4c 0 2024-04-25T15:58:03.324 INFO:tasks.workunit.client.0.smithi087.stdout:3/223: chown d4/l1c 3368 1 2024-04-25T15:58:03.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/187: dwrite d4/fa [0,4194304] 0 2024-04-25T15:58:03.328 INFO:tasks.workunit.client.0.smithi087.stdout:6/219: mknod d7/d1a/d1d/d21/d27/c4d 0 2024-04-25T15:58:03.329 INFO:tasks.workunit.client.0.smithi087.stdout:3/224: fdatasync d4/db/fe 0 2024-04-25T15:58:03.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/186: dwrite d6/d8/fa [0,4194304] 0 2024-04-25T15:58:03.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/225: truncate d4/db/d28/f3a 1348055 0 2024-04-25T15:58:03.333 INFO:tasks.workunit.client.0.smithi087.stdout:9/187: write d6/d8/d29/f2a [1540183,14607] 0 2024-04-25T15:58:03.335 INFO:tasks.workunit.client.0.smithi087.stdout:3/226: readlink d4/d17/l1d 0 2024-04-25T15:58:03.338 INFO:tasks.workunit.client.0.smithi087.stdout:8/188: dwrite d4/f28 [0,4194304] 0 2024-04-25T15:58:03.338 INFO:tasks.workunit.client.0.smithi087.stdout:6/220: rename d7/d1a/d1d/d21/d23 to d7/d4e 0 2024-04-25T15:58:03.340 INFO:tasks.workunit.client.0.smithi087.stdout:6/221: write d7/d1a/d41/f44 [434433,9750] 0 2024-04-25T15:58:03.340 INFO:tasks.workunit.client.0.smithi087.stdout:3/227: mknod d4/d14/c48 0 2024-04-25T15:58:03.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/188: dread d6/f1c [0,4194304] 0 2024-04-25T15:58:03.342 INFO:tasks.workunit.client.0.smithi087.stdout:8/189: symlink d4/d22/l39 0 2024-04-25T15:58:03.344 INFO:tasks.workunit.client.0.smithi087.stdout:6/222: creat d7/d1a/d41/f4f x:0 0 0 2024-04-25T15:58:03.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/189: symlink d6/d8/d29/l38 0 2024-04-25T15:58:03.346 INFO:tasks.workunit.client.0.smithi087.stdout:6/223: chown d7/cb 339634030 1 2024-04-25T15:58:03.347 INFO:tasks.workunit.client.0.smithi087.stdout:9/190: readlink d6/d8/d14/d1d/l24 0 2024-04-25T15:58:03.349 INFO:tasks.workunit.client.0.smithi087.stdout:8/190: getdents d4/d1d/d17 0 2024-04-25T15:58:03.349 INFO:tasks.workunit.client.0.smithi087.stdout:0/178: sync 2024-04-25T15:58:03.350 INFO:tasks.workunit.client.0.smithi087.stdout:8/191: read d4/d9/f15 [2204040,95397] 0 2024-04-25T15:58:03.350 INFO:tasks.workunit.client.0.smithi087.stdout:9/191: fdatasync f2 0 2024-04-25T15:58:03.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/224: dwrite d7/d4e/f31 [0,4194304] 0 2024-04-25T15:58:03.355 INFO:tasks.workunit.client.0.smithi087.stdout:8/192: creat d4/d8/f3a x:0 0 0 2024-04-25T15:58:03.357 INFO:tasks.workunit.client.0.smithi087.stdout:6/225: read f5 [1245630,72929] 0 2024-04-25T15:58:03.357 INFO:tasks.workunit.client.0.smithi087.stdout:8/193: stat d4/d22/c30 0 2024-04-25T15:58:03.359 INFO:tasks.workunit.client.0.smithi087.stdout:3/228: fdatasync d4/d17/d27/f34 0 2024-04-25T15:58:03.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/226: chown d7/d1a/d1d/d21/d27/d2c/l33 162160056 1 2024-04-25T15:58:03.362 INFO:tasks.workunit.client.0.smithi087.stdout:6/227: chown d7/d1a/d1d/f4a 205 1 2024-04-25T15:58:03.362 INFO:tasks.workunit.client.0.smithi087.stdout:3/229: mknod d4/db/d28/d3c/c49 0 2024-04-25T15:58:03.362 INFO:tasks.workunit.client.0.smithi087.stdout:9/192: dwrite d6/f2b [0,4194304] 0 2024-04-25T15:58:03.363 INFO:tasks.workunit.client.0.smithi087.stdout:0/179: write d1/d6/d21/d2a/f25 [1272034,117409] 0 2024-04-25T15:58:03.365 INFO:tasks.workunit.client.0.smithi087.stdout:8/194: write d4/d8/dd/f2b [3746205,18794] 0 2024-04-25T15:58:03.366 INFO:tasks.workunit.client.0.smithi087.stdout:0/180: stat d1/d6/d21/d2a/f19 0 2024-04-25T15:58:03.366 INFO:tasks.workunit.client.0.smithi087.stdout:6/228: rmdir d7/d1a/d41 39 2024-04-25T15:58:03.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/195: chown d4/d8/c16 1775 1 2024-04-25T15:58:03.367 INFO:tasks.workunit.client.0.smithi087.stdout:9/193: creat d6/d8/d14/d1d/f39 x:0 0 0 2024-04-25T15:58:03.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/230: creat d4/d17/d24/d3f/f4a x:0 0 0 2024-04-25T15:58:03.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/181: write d1/d6/d21/f24 [581109,23011] 0 2024-04-25T15:58:03.370 INFO:tasks.workunit.client.0.smithi087.stdout:3/231: truncate d4/d17/d24/f46 490855 0 2024-04-25T15:58:03.372 INFO:tasks.workunit.client.0.smithi087.stdout:8/196: link d4/f28 d4/d1d/d17/d37/f3b 0 2024-04-25T15:58:03.372 INFO:tasks.workunit.client.0.smithi087.stdout:0/182: creat d1/f3c x:0 0 0 2024-04-25T15:58:03.373 INFO:tasks.workunit.client.0.smithi087.stdout:3/232: creat d4/db/d28/d3c/f4b x:0 0 0 2024-04-25T15:58:03.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/233: chown d4/l1c 6017 1 2024-04-25T15:58:03.375 INFO:tasks.workunit.client.0.smithi087.stdout:6/229: dread d7/f14 [0,4194304] 0 2024-04-25T15:58:03.378 INFO:tasks.workunit.client.0.smithi087.stdout:8/197: link d4/d1d/d17/l36 d4/d1d/d14/l3c 0 2024-04-25T15:58:03.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/230: write d7/f40 [580320,95607] 0 2024-04-25T15:58:03.380 INFO:tasks.workunit.client.0.smithi087.stdout:0/183: truncate d1/d6/d21/d2a/f19 3080567 0 2024-04-25T15:58:03.381 INFO:tasks.workunit.client.0.smithi087.stdout:8/198: unlink d4/d8/f3a 0 2024-04-25T15:58:03.383 INFO:tasks.workunit.client.0.smithi087.stdout:6/231: truncate d7/d1a/f3a 283855 0 2024-04-25T15:58:03.387 INFO:tasks.workunit.client.0.smithi087.stdout:8/199: symlink d4/d1d/d17/d37/l3d 0 2024-04-25T15:58:03.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/232: link d7/f18 d7/d1a/d1d/d21/d27/d2c/d35/f50 0 2024-04-25T15:58:03.392 INFO:tasks.workunit.client.0.smithi087.stdout:8/200: dread d4/d9/f1c [4194304,4194304] 0 2024-04-25T15:58:03.394 INFO:tasks.workunit.client.0.smithi087.stdout:3/234: dwrite d4/d17/d27/f34 [0,4194304] 0 2024-04-25T15:58:03.394 INFO:tasks.workunit.client.0.smithi087.stdout:8/201: write d4/d8/dd/f34 [2403577,1534] 0 2024-04-25T15:58:03.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/184: write d1/d6/d21/d2a/f19 [1926776,8105] 0 2024-04-25T15:58:03.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/233: rename d7/f2b to d7/d1a/f51 0 2024-04-25T15:58:03.401 INFO:tasks.workunit.client.0.smithi087.stdout:3/235: dread d4/d17/d27/f34 [0,4194304] 0 2024-04-25T15:58:03.402 INFO:tasks.workunit.client.0.smithi087.stdout:8/202: getdents d4 0 2024-04-25T15:58:03.403 INFO:tasks.workunit.client.0.smithi087.stdout:6/234: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/c52 0 2024-04-25T15:58:03.404 INFO:tasks.workunit.client.0.smithi087.stdout:0/185: creat d1/f3d x:0 0 0 2024-04-25T15:58:03.406 INFO:tasks.workunit.client.0.smithi087.stdout:8/203: creat d4/d9/f3e x:0 0 0 2024-04-25T15:58:03.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/204: mkdir d4/d1d/d3f 0 2024-04-25T15:58:03.410 INFO:tasks.workunit.client.0.smithi087.stdout:8/205: symlink d4/d1d/d17/l40 0 2024-04-25T15:58:03.411 INFO:tasks.workunit.client.0.smithi087.stdout:3/236: dwrite d4/db/fc [0,4194304] 0 2024-04-25T15:58:03.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/237: dread - d4/d17/d24/d3f/f4a zero size 2024-04-25T15:58:03.413 INFO:tasks.workunit.client.0.smithi087.stdout:8/206: creat d4/d1d/d17/d37/f41 x:0 0 0 2024-04-25T15:58:03.415 INFO:tasks.workunit.client.0.smithi087.stdout:0/186: dread d1/f14 [0,4194304] 0 2024-04-25T15:58:03.416 INFO:tasks.workunit.client.0.smithi087.stdout:8/207: write d4/d1d/d17/d37/f41 [36267,3564] 0 2024-04-25T15:58:03.418 INFO:tasks.workunit.client.0.smithi087.stdout:8/208: fdatasync d4/d1d/d17/f2d 0 2024-04-25T15:58:03.420 INFO:tasks.workunit.client.0.smithi087.stdout:6/235: dwrite d7/fc [0,4194304] 0 2024-04-25T15:58:03.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/236: chown d7/d1a/d1d/d21/d27/d2c/d35/d45/l4c 70511478 1 2024-04-25T15:58:03.424 INFO:tasks.workunit.client.0.smithi087.stdout:3/238: fsync d4/db/fe 0 2024-04-25T15:58:03.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/187: dwrite d1/d6/f3b [0,4194304] 0 2024-04-25T15:58:03.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/239: stat d4/d14/l30 0 2024-04-25T15:58:03.435 INFO:tasks.workunit.client.0.smithi087.stdout:8/209: dread d4/d8/dd/f34 [0,4194304] 0 2024-04-25T15:58:03.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/188: unlink d1/d6/d39/l35 0 2024-04-25T15:58:03.437 INFO:tasks.workunit.client.0.smithi087.stdout:6/237: link d7/d1a/f3a d7/d1a/d1d/d21/d27/d2c/d35/f53 0 2024-04-25T15:58:03.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/240: write d4/f3b [1091861,57135] 0 2024-04-25T15:58:03.439 INFO:tasks.workunit.client.0.smithi087.stdout:3/241: truncate d4/f16 259493 0 2024-04-25T15:58:03.440 INFO:tasks.workunit.client.0.smithi087.stdout:6/238: mknod d7/d1a/d1d/d21/d27/d2c/d35/c54 0 2024-04-25T15:58:03.441 INFO:tasks.workunit.client.0.smithi087.stdout:0/189: mkdir d1/da/d3e 0 2024-04-25T15:58:03.441 INFO:tasks.workunit.client.0.smithi087.stdout:6/239: write d7/d1a/d1d/d21/d27/d2c/f38 [1401662,50701] 0 2024-04-25T15:58:03.442 INFO:tasks.workunit.client.0.smithi087.stdout:6/240: chown d7/c1f 0 1 2024-04-25T15:58:03.443 INFO:tasks.workunit.client.0.smithi087.stdout:3/242: unlink d4/d17/d24/d29/f41 0 2024-04-25T15:58:03.443 INFO:tasks.workunit.client.0.smithi087.stdout:3/243: chown d4/db/d28 152 1 2024-04-25T15:58:03.446 INFO:tasks.workunit.client.0.smithi087.stdout:0/190: mknod d1/d6/d21/d2a/c3f 0 2024-04-25T15:58:03.447 INFO:tasks.workunit.client.0.smithi087.stdout:0/191: dread - d1/da/f3a zero size 2024-04-25T15:58:03.447 INFO:tasks.workunit.client.0.smithi087.stdout:0/192: chown d1/d6 1 1 2024-04-25T15:58:03.448 INFO:tasks.workunit.client.0.smithi087.stdout:6/241: creat d7/d1a/d41/f55 x:0 0 0 2024-04-25T15:58:03.448 INFO:tasks.workunit.client.0.smithi087.stdout:6/242: write d7/f19 [226793,19594] 0 2024-04-25T15:58:03.449 INFO:tasks.workunit.client.0.smithi087.stdout:3/244: mknod d4/db/c4c 0 2024-04-25T15:58:03.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/245: fsync d4/db/d28/d3c/f42 0 2024-04-25T15:58:03.450 INFO:tasks.workunit.client.0.smithi087.stdout:8/210: truncate d4/d1d/d17/f33 1480447 0 2024-04-25T15:58:03.451 INFO:tasks.workunit.client.0.smithi087.stdout:0/193: creat d1/d6/d1f/f40 x:0 0 0 2024-04-25T15:58:03.451 INFO:tasks.workunit.client.0.smithi087.stdout:0/194: dread - d1/f3c zero size 2024-04-25T15:58:03.454 INFO:tasks.workunit.client.0.smithi087.stdout:6/243: link d7/d4e/f31 d7/d1a/d41/f56 0 2024-04-25T15:58:03.454 INFO:tasks.workunit.client.0.smithi087.stdout:8/211: symlink d4/d1d/d3f/l42 0 2024-04-25T15:58:03.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/246: dread d4/db/fc [0,4194304] 0 2024-04-25T15:58:03.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/244: chown d7/d1a/d2a/l3b 1378875 1 2024-04-25T15:58:03.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/247: dread - d4/d17/d27/f44 zero size 2024-04-25T15:58:03.456 INFO:tasks.workunit.client.0.smithi087.stdout:8/212: mkdir d4/d22/d43 0 2024-04-25T15:58:03.458 INFO:tasks.workunit.client.0.smithi087.stdout:8/213: creat d4/d22/f44 x:0 0 0 2024-04-25T15:58:03.463 INFO:tasks.workunit.client.0.smithi087.stdout:6/245: write d7/d1a/f3a [1199247,89592] 0 2024-04-25T15:58:03.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/214: truncate d4/d8/dd/f2b 4488356 0 2024-04-25T15:58:03.466 INFO:tasks.workunit.client.0.smithi087.stdout:8/215: dread - d4/d22/f44 zero size 2024-04-25T15:58:03.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/246: truncate d7/f18 3872444 0 2024-04-25T15:58:03.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/216: fdatasync d4/d8/dd/f2b 0 2024-04-25T15:58:03.470 INFO:tasks.workunit.client.0.smithi087.stdout:6/247: creat d7/d1a/d1d/d21/d27/d2c/f57 x:0 0 0 2024-04-25T15:58:03.470 INFO:tasks.workunit.client.0.smithi087.stdout:4/164: sync 2024-04-25T15:58:03.470 INFO:tasks.workunit.client.0.smithi087.stdout:5/243: sync 2024-04-25T15:58:03.471 INFO:tasks.workunit.client.0.smithi087.stdout:6/248: readlink d7/d1a/d1d/d21/d27/l29 0 2024-04-25T15:58:03.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/244: write d9/d2c/f3a [289266,25727] 0 2024-04-25T15:58:03.473 INFO:tasks.workunit.client.0.smithi087.stdout:4/165: creat d4/d7/f32 x:0 0 0 2024-04-25T15:58:03.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/249: read d7/f10 [1934286,40752] 0 2024-04-25T15:58:03.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/245: read d9/f22 [23225,21848] 0 2024-04-25T15:58:03.473 INFO:tasks.workunit.client.0.smithi087.stdout:4/166: chown d4/d7/f24 746601022 1 2024-04-25T15:58:03.475 INFO:tasks.workunit.client.0.smithi087.stdout:8/217: getdents d4/d22 0 2024-04-25T15:58:03.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/167: dread - d4/d7/f24 zero size 2024-04-25T15:58:03.475 INFO:tasks.workunit.client.0.smithi087.stdout:6/250: write d7/d1a/d41/f44 [556837,79707] 0 2024-04-25T15:58:03.475 INFO:tasks.workunit.client.0.smithi087.stdout:5/246: dread - d9/d2c/d41/d44/f47 zero size 2024-04-25T15:58:03.476 INFO:tasks.workunit.client.0.smithi087.stdout:4/168: readlink d4/l29 0 2024-04-25T15:58:03.476 INFO:tasks.workunit.client.0.smithi087.stdout:5/247: chown d9/d2c/d30/c37 4 1 2024-04-25T15:58:03.477 INFO:tasks.workunit.client.0.smithi087.stdout:5/248: dread - d9/f25 zero size 2024-04-25T15:58:03.477 INFO:tasks.workunit.client.0.smithi087.stdout:6/251: mkdir d7/d1a/d1d/d58 0 2024-04-25T15:58:03.478 INFO:tasks.workunit.client.0.smithi087.stdout:5/249: chown d9/d2f/d3b/d48 15 1 2024-04-25T15:58:03.478 INFO:tasks.workunit.client.0.smithi087.stdout:6/252: write d7/f8 [403871,60607] 0 2024-04-25T15:58:03.478 INFO:tasks.workunit.client.0.smithi087.stdout:5/250: truncate f1 5149232 0 2024-04-25T15:58:03.479 INFO:tasks.workunit.client.0.smithi087.stdout:4/169: creat d4/d7/d15/d12/f33 x:0 0 0 2024-04-25T15:58:03.480 INFO:tasks.workunit.client.0.smithi087.stdout:8/218: link d4/d8/dd/c18 d4/d22/c45 0 2024-04-25T15:58:03.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/253: mkdir d7/d4e/d59 0 2024-04-25T15:58:03.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/251: rmdir d9/d2c/d41 39 2024-04-25T15:58:03.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/252: readlink d9/d2c/d30/l31 0 2024-04-25T15:58:03.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/170: rename d4/d7/f24 to d4/d10/f34 0 2024-04-25T15:58:03.483 INFO:tasks.workunit.client.0.smithi087.stdout:8/219: mknod d4/d9/c46 0 2024-04-25T15:58:03.485 INFO:tasks.workunit.client.0.smithi087.stdout:6/254: rename d7/d1a/d1d/d21/d27/d2c/f38 to d7/d1a/d1d/d58/f5a 0 2024-04-25T15:58:03.485 INFO:tasks.workunit.client.0.smithi087.stdout:5/253: mkdir d9/d2f/d40/d4d 0 2024-04-25T15:58:03.486 INFO:tasks.workunit.client.0.smithi087.stdout:6/255: fsync d7/f8 0 2024-04-25T15:58:03.486 INFO:tasks.workunit.client.0.smithi087.stdout:8/220: creat d4/d1d/f47 x:0 0 0 2024-04-25T15:58:03.487 INFO:tasks.workunit.client.0.smithi087.stdout:5/254: write f3 [663581,96385] 0 2024-04-25T15:58:03.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/256: chown d7/d1a/d1d/d21/d27/d2c/l33 0 1 2024-04-25T15:58:03.489 INFO:tasks.workunit.client.0.smithi087.stdout:5/255: write d9/f12 [2121987,86094] 0 2024-04-25T15:58:03.490 INFO:tasks.workunit.client.0.smithi087.stdout:8/221: creat d4/d9/f48 x:0 0 0 2024-04-25T15:58:03.492 INFO:tasks.workunit.client.0.smithi087.stdout:4/171: dwrite d4/d27/f2f [0,4194304] 0 2024-04-25T15:58:03.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/257: dread d7/ff [0,4194304] 0 2024-04-25T15:58:03.501 INFO:tasks.workunit.client.0.smithi087.stdout:4/172: creat d4/f35 x:0 0 0 2024-04-25T15:58:03.502 INFO:tasks.workunit.client.0.smithi087.stdout:4/173: dread - d4/d7/f32 zero size 2024-04-25T15:58:03.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/258: dwrite d7/d4e/f24 [0,4194304] 0 2024-04-25T15:58:03.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/222: dwrite d4/d1d/d17/f33 [0,4194304] 0 2024-04-25T15:58:03.512 INFO:tasks.workunit.client.0.smithi087.stdout:6/259: link d7/cb d7/d1a/d2a/c5b 0 2024-04-25T15:58:03.514 INFO:tasks.workunit.client.0.smithi087.stdout:4/174: dwrite d4/f16 [0,4194304] 0 2024-04-25T15:58:03.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/260: rmdir d7/d1a/d1d/d58 39 2024-04-25T15:58:03.518 INFO:tasks.workunit.client.0.smithi087.stdout:4/175: mkdir d4/d7/d15/d36 0 2024-04-25T15:58:03.519 INFO:tasks.workunit.client.0.smithi087.stdout:8/223: creat d4/d8/f49 x:0 0 0 2024-04-25T15:58:03.521 INFO:tasks.workunit.client.0.smithi087.stdout:5/256: dread d9/f1c [0,4194304] 0 2024-04-25T15:58:03.521 INFO:tasks.workunit.client.0.smithi087.stdout:4/176: creat d4/d7/d15/d21/f37 x:0 0 0 2024-04-25T15:58:03.525 INFO:tasks.workunit.client.0.smithi087.stdout:6/261: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/f48 [0,4194304] 0 2024-04-25T15:58:03.532 INFO:tasks.workunit.client.0.smithi087.stdout:6/262: dwrite d7/d1a/d1d/d21/d27/d2c/d35/f53 [0,4194304] 0 2024-04-25T15:58:03.538 INFO:tasks.workunit.client.0.smithi087.stdout:6/263: rename d7/d1a/d41/f56 to d7/d1a/d1d/d21/d27/d2c/f5c 0 2024-04-25T15:58:03.543 INFO:tasks.workunit.client.0.smithi087.stdout:6/264: creat d7/d1a/d1d/d21/d27/d2c/f5d x:0 0 0 2024-04-25T15:58:03.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/257: write d9/f21 [4565349,119427] 0 2024-04-25T15:58:03.547 INFO:tasks.workunit.client.0.smithi087.stdout:6/265: rename d7/d1a/d1d/d58 to d7/d1a/d2a/d5e 0 2024-04-25T15:58:03.548 INFO:tasks.workunit.client.0.smithi087.stdout:5/258: symlink d9/d2f/d40/l4e 0 2024-04-25T15:58:03.550 INFO:tasks.workunit.client.0.smithi087.stdout:8/224: dwrite d4/f28 [0,4194304] 0 2024-04-25T15:58:03.550 INFO:tasks.workunit.client.0.smithi087.stdout:6/266: chown d7/d1a/d1d/d21/d27/d2c/f57 2128642533 1 2024-04-25T15:58:03.553 INFO:tasks.workunit.client.0.smithi087.stdout:5/259: symlink d9/d2c/d41/l4f 0 2024-04-25T15:58:03.554 INFO:tasks.workunit.client.0.smithi087.stdout:5/260: write d9/f2d [5827313,32724] 0 2024-04-25T15:58:03.554 INFO:tasks.workunit.client.0.smithi087.stdout:5/261: stat f3 0 2024-04-25T15:58:03.555 INFO:tasks.workunit.client.0.smithi087.stdout:8/225: creat d4/f4a x:0 0 0 2024-04-25T15:58:03.556 INFO:tasks.workunit.client.0.smithi087.stdout:8/226: chown d4/d1d/d17 605169 1 2024-04-25T15:58:03.556 INFO:tasks.workunit.client.0.smithi087.stdout:6/267: write d7/d1a/d2a/d5e/f5a [381475,58823] 0 2024-04-25T15:58:03.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/268: write d7/d1a/d41/f55 [552647,13019] 0 2024-04-25T15:58:03.558 INFO:tasks.workunit.client.0.smithi087.stdout:5/262: link d9/f1f d9/d2c/d41/d44/f50 0 2024-04-25T15:58:03.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/227: mknod d4/d1d/d17/c4b 0 2024-04-25T15:58:03.561 INFO:tasks.workunit.client.0.smithi087.stdout:5/263: creat d9/d3e/f51 x:0 0 0 2024-04-25T15:58:03.562 INFO:tasks.workunit.client.0.smithi087.stdout:6/269: creat d7/d1a/d1d/d21/f5f x:0 0 0 2024-04-25T15:58:03.563 INFO:tasks.workunit.client.0.smithi087.stdout:5/264: unlink d9/f1e 0 2024-04-25T15:58:03.566 INFO:tasks.workunit.client.0.smithi087.stdout:5/265: mknod d9/d2c/d41/d44/c52 0 2024-04-25T15:58:03.567 INFO:tasks.workunit.client.0.smithi087.stdout:8/228: dwrite d4/d22/f44 [0,4194304] 0 2024-04-25T15:58:03.573 INFO:tasks.workunit.client.0.smithi087.stdout:6/270: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/f48 [0,4194304] 0 2024-04-25T15:58:03.575 INFO:tasks.workunit.client.0.smithi087.stdout:5/266: dwrite f3 [0,4194304] 0 2024-04-25T15:58:03.579 INFO:tasks.workunit.client.0.smithi087.stdout:5/267: creat d9/d2c/d41/f53 x:0 0 0 2024-04-25T15:58:03.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/268: write d9/f21 [2230653,48147] 0 2024-04-25T15:58:03.586 INFO:tasks.workunit.client.0.smithi087.stdout:5/269: dwrite d9/f2d [0,4194304] 0 2024-04-25T15:58:03.587 INFO:tasks.workunit.client.0.smithi087.stdout:6/271: rename d7/d1a/d41/f4f to d7/d1a/d1d/f60 0 2024-04-25T15:58:03.594 INFO:tasks.workunit.client.0.smithi087.stdout:5/270: dwrite d9/f12 [0,4194304] 0 2024-04-25T15:58:03.596 INFO:tasks.workunit.client.0.smithi087.stdout:6/272: dwrite d7/d1a/d2a/d5e/f5a [0,4194304] 0 2024-04-25T15:58:03.598 INFO:tasks.workunit.client.0.smithi087.stdout:7/187: sync 2024-04-25T15:58:03.598 INFO:tasks.workunit.client.0.smithi087.stdout:1/210: sync 2024-04-25T15:58:03.599 INFO:tasks.workunit.client.0.smithi087.stdout:6/273: creat d7/d4e/f61 x:0 0 0 2024-04-25T15:58:03.599 INFO:tasks.workunit.client.0.smithi087.stdout:7/188: mkdir d1/d4/d18/d3e 0 2024-04-25T15:58:03.614 INFO:tasks.workunit.client.0.smithi087.stdout:7/189: write d1/d1a/f20 [111808,84262] 0 2024-04-25T15:58:03.615 INFO:tasks.workunit.client.0.smithi087.stdout:6/274: truncate f6 847346 0 2024-04-25T15:58:03.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/211: dwrite d3/d12/d14/f37 [0,4194304] 0 2024-04-25T15:58:03.622 INFO:tasks.workunit.client.0.smithi087.stdout:5/271: dread d9/f1f [0,4194304] 0 2024-04-25T15:58:03.622 INFO:tasks.workunit.client.0.smithi087.stdout:6/275: rename d7/c1f to d7/d1a/d1d/d21/d27/d2c/c62 0 2024-04-25T15:58:03.622 INFO:tasks.workunit.client.0.smithi087.stdout:1/212: chown d3/d12/d14/c1a 557373110 1 2024-04-25T15:58:03.624 INFO:tasks.workunit.client.0.smithi087.stdout:5/272: dread - d9/d2c/d30/f43 zero size 2024-04-25T15:58:03.625 INFO:tasks.workunit.client.0.smithi087.stdout:6/276: write d7/d1a/d1d/d21/d27/d2c/f57 [660775,83573] 0 2024-04-25T15:58:03.625 INFO:tasks.workunit.client.0.smithi087.stdout:7/190: dwrite d1/d1a/f24 [0,4194304] 0 2024-04-25T15:58:03.626 INFO:tasks.workunit.client.0.smithi087.stdout:5/273: write d9/d2f/d3b/f4c [605485,66853] 0 2024-04-25T15:58:03.628 INFO:tasks.workunit.client.0.smithi087.stdout:1/213: creat d3/d12/d14/d29/d2f/f3f x:0 0 0 2024-04-25T15:58:03.631 INFO:tasks.workunit.client.0.smithi087.stdout:5/274: creat d9/d3e/f54 x:0 0 0 2024-04-25T15:58:03.633 INFO:tasks.workunit.client.0.smithi087.stdout:1/214: mkdir d3/d12/d14/d29/d2f/d40 0 2024-04-25T15:58:03.633 INFO:tasks.workunit.client.0.smithi087.stdout:5/275: read d9/f28 [1616474,112735] 0 2024-04-25T15:58:03.634 INFO:tasks.workunit.client.0.smithi087.stdout:6/277: symlink d7/d1a/d1d/d21/l63 0 2024-04-25T15:58:03.636 INFO:tasks.workunit.client.0.smithi087.stdout:5/276: unlink d9/cd 0 2024-04-25T15:58:03.639 INFO:tasks.workunit.client.0.smithi087.stdout:1/215: rename d3/c20 to d3/d12/c41 0 2024-04-25T15:58:03.640 INFO:tasks.workunit.client.0.smithi087.stdout:1/216: stat d3/d12/d14/f17 0 2024-04-25T15:58:03.640 INFO:tasks.workunit.client.0.smithi087.stdout:1/217: readlink d3/le 0 2024-04-25T15:58:03.643 INFO:tasks.workunit.client.0.smithi087.stdout:6/278: dwrite d7/f12 [0,4194304] 0 2024-04-25T15:58:03.645 INFO:tasks.workunit.client.0.smithi087.stdout:6/279: write d7/d1a/d1d/d21/d27/d2c/d35/f36 [911233,70733] 0 2024-04-25T15:58:03.646 INFO:tasks.workunit.client.0.smithi087.stdout:7/191: truncate d1/f19 424450 0 2024-04-25T15:58:03.648 INFO:tasks.workunit.client.0.smithi087.stdout:6/280: creat d7/d1a/d2a/f64 x:0 0 0 2024-04-25T15:58:03.649 INFO:tasks.workunit.client.0.smithi087.stdout:6/281: chown d7/d1a/d1d/d21/f5f 1540 1 2024-04-25T15:58:03.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/277: truncate f1 4571834 0 2024-04-25T15:58:03.652 INFO:tasks.workunit.client.0.smithi087.stdout:6/282: symlink d7/d1a/d41/l65 0 2024-04-25T15:58:03.655 INFO:tasks.workunit.client.0.smithi087.stdout:6/283: rename d7/d1a/d1d/d21/d27/l29 to d7/d1a/d1d/d21/d37/l66 0 2024-04-25T15:58:03.655 INFO:tasks.workunit.client.0.smithi087.stdout:5/278: getdents d9/d2c/d41 0 2024-04-25T15:58:03.656 INFO:tasks.workunit.client.0.smithi087.stdout:6/284: rmdir d7/d1a 39 2024-04-25T15:58:03.657 INFO:tasks.workunit.client.0.smithi087.stdout:5/279: mkdir d9/d2c/d30/d55 0 2024-04-25T15:58:03.658 INFO:tasks.workunit.client.0.smithi087.stdout:1/218: dread d3/ff [0,4194304] 0 2024-04-25T15:58:03.659 INFO:tasks.workunit.client.0.smithi087.stdout:6/285: symlink d7/d1a/d1d/l67 0 2024-04-25T15:58:03.662 INFO:tasks.workunit.client.0.smithi087.stdout:6/286: creat d7/d1a/d1d/d21/d27/d2c/f68 x:0 0 0 2024-04-25T15:58:03.662 INFO:tasks.workunit.client.0.smithi087.stdout:1/219: dread d3/ff [0,4194304] 0 2024-04-25T15:58:03.663 INFO:tasks.workunit.client.0.smithi087.stdout:6/287: write d7/d1a/d1d/d21/d37/f3f [352694,88630] 0 2024-04-25T15:58:03.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/220: write d3/f24 [35273,62690] 0 2024-04-25T15:58:03.668 INFO:tasks.workunit.client.0.smithi087.stdout:6/288: creat d7/d1a/d2a/f69 x:0 0 0 2024-04-25T15:58:03.669 INFO:tasks.workunit.client.0.smithi087.stdout:5/280: truncate f3 3721229 0 2024-04-25T15:58:03.670 INFO:tasks.workunit.client.0.smithi087.stdout:5/281: chown d9/d2c/d30/f43 834 1 2024-04-25T15:58:03.672 INFO:tasks.workunit.client.0.smithi087.stdout:5/282: write d9/f1c [1262494,19019] 0 2024-04-25T15:58:03.672 INFO:tasks.workunit.client.0.smithi087.stdout:5/283: dread - d9/d3e/f54 zero size 2024-04-25T15:58:03.673 INFO:tasks.workunit.client.0.smithi087.stdout:5/284: write d9/f2d [1930185,109221] 0 2024-04-25T15:58:03.673 INFO:tasks.workunit.client.0.smithi087.stdout:6/289: link d7/d1a/d1d/d21/d27/d2c/d35/d45/l4c d7/d1a/d1d/l6a 0 2024-04-25T15:58:03.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/290: dread - d7/d1a/f3e zero size 2024-04-25T15:58:03.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/291: chown f5 1597 1 2024-04-25T15:58:03.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/285: rename d9/d2f/d3b/d48 to d9/d2c/d30/d56 0 2024-04-25T15:58:03.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/286: dread - d9/d2f/f3c zero size 2024-04-25T15:58:03.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/221: dwrite d3/d12/f19 [0,4194304] 0 2024-04-25T15:58:03.680 INFO:tasks.workunit.client.0.smithi087.stdout:1/222: write d3/d12/d14/f31 [600603,90499] 0 2024-04-25T15:58:03.681 INFO:tasks.workunit.client.0.smithi087.stdout:1/223: write d3/d12/f19 [2496765,38413] 0 2024-04-25T15:58:03.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/224: symlink d3/d12/d39/l42 0 2024-04-25T15:58:03.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/225: creat d3/d12/f43 x:0 0 0 2024-04-25T15:58:03.691 INFO:tasks.workunit.client.0.smithi087.stdout:1/226: stat d3/d12/d14/d29/l34 0 2024-04-25T15:58:03.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/287: dwrite d9/d2c/d41/d44/f50 [0,4194304] 0 2024-04-25T15:58:03.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/288: chown d9/f2b 1 1 2024-04-25T15:58:03.694 INFO:tasks.workunit.client.0.smithi087.stdout:6/292: dwrite f6 [0,4194304] 0 2024-04-25T15:58:03.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/289: fdatasync d9/d2c/d30/f43 0 2024-04-25T15:58:03.697 INFO:tasks.workunit.client.0.smithi087.stdout:1/227: mknod d3/d12/d14/d33/c44 0 2024-04-25T15:58:03.699 INFO:tasks.workunit.client.0.smithi087.stdout:6/293: symlink d7/d1a/d2a/l6b 0 2024-04-25T15:58:03.700 INFO:tasks.workunit.client.0.smithi087.stdout:6/294: dread - d7/d1a/d1d/f4a zero size 2024-04-25T15:58:03.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/273: sync 2024-04-25T15:58:03.703 INFO:tasks.workunit.client.0.smithi087.stdout:6/295: unlink d7/ff 0 2024-04-25T15:58:03.704 INFO:tasks.workunit.client.0.smithi087.stdout:1/228: dwrite d3/d12/d14/d29/d2f/f36 [0,4194304] 0 2024-04-25T15:58:03.705 INFO:tasks.workunit.client.0.smithi087.stdout:6/296: truncate d7/d1a/d2a/f64 1012980 0 2024-04-25T15:58:03.706 INFO:tasks.workunit.client.0.smithi087.stdout:6/297: read - d7/d1a/d1d/d21/f5f zero size 2024-04-25T15:58:03.710 INFO:tasks.workunit.client.0.smithi087.stdout:6/298: symlink d7/d1a/d1d/d21/d27/d2c/d35/d45/l6c 0 2024-04-25T15:58:03.710 INFO:tasks.workunit.client.0.smithi087.stdout:6/299: chown d7/d1a/f51 500520 1 2024-04-25T15:58:03.714 INFO:tasks.workunit.client.0.smithi087.stdout:6/300: dread d7/d1a/d1d/d21/d27/d2c/d35/d45/f48 [0,4194304] 0 2024-04-25T15:58:03.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/229: dread d3/f9 [0,4194304] 0 2024-04-25T15:58:03.723 INFO:tasks.workunit.client.0.smithi087.stdout:5/290: truncate d9/f2b 2465000 0 2024-04-25T15:58:03.726 INFO:tasks.workunit.client.0.smithi087.stdout:5/291: creat d9/d2f/d40/d4d/f57 x:0 0 0 2024-04-25T15:58:03.727 INFO:tasks.workunit.client.0.smithi087.stdout:5/292: write d9/f12 [3115820,124133] 0 2024-04-25T15:58:03.730 INFO:tasks.workunit.client.0.smithi087.stdout:1/230: dwrite d3/d12/d14/f37 [0,4194304] 0 2024-04-25T15:58:03.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/301: dwrite d7/d1a/f3a [4194304,4194304] 0 2024-04-25T15:58:03.737 INFO:tasks.workunit.client.0.smithi087.stdout:5/293: dwrite d9/f2a [0,4194304] 0 2024-04-25T15:58:03.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/302: dread d7/f2f [0,4194304] 0 2024-04-25T15:58:03.742 INFO:tasks.workunit.client.0.smithi087.stdout:5/294: mkdir d9/d2f/d40/d4d/d58 0 2024-04-25T15:58:03.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/303: truncate d7/d1a/d1d/f28 1398799 0 2024-04-25T15:58:03.746 INFO:tasks.workunit.client.0.smithi087.stdout:5/295: rename d9/f22 to d9/d2f/f59 0 2024-04-25T15:58:03.746 INFO:tasks.workunit.client.0.smithi087.stdout:1/231: link d3/cc d3/d12/d14/d29/c45 0 2024-04-25T15:58:03.747 INFO:tasks.workunit.client.0.smithi087.stdout:5/296: fsync d9/d2c/d41/d44/f47 0 2024-04-25T15:58:03.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/304: write d7/d1a/d1d/d21/d27/d2c/d35/d45/f48 [591026,73486] 0 2024-04-25T15:58:03.748 INFO:tasks.workunit.client.0.smithi087.stdout:1/232: write d3/d12/d14/f30 [1042298,113020] 0 2024-04-25T15:58:03.748 INFO:tasks.workunit.client.0.smithi087.stdout:6/305: chown d7/d1a/d41 22132291 1 2024-04-25T15:58:03.751 INFO:tasks.workunit.client.0.smithi087.stdout:5/297: write d9/f33 [673772,87223] 0 2024-04-25T15:58:03.751 INFO:tasks.workunit.client.0.smithi087.stdout:1/233: chown d3/le 679408 1 2024-04-25T15:58:03.752 INFO:tasks.workunit.client.0.smithi087.stdout:1/234: mknod d3/d12/d14/d33/c46 0 2024-04-25T15:58:03.753 INFO:tasks.workunit.client.0.smithi087.stdout:1/235: chown d3/f35 29176701 1 2024-04-25T15:58:03.753 INFO:tasks.workunit.client.0.smithi087.stdout:6/306: creat d7/d1a/d1d/d21/f6d x:0 0 0 2024-04-25T15:58:03.756 INFO:tasks.workunit.client.0.smithi087.stdout:1/236: mknod d3/d2d/c47 0 2024-04-25T15:58:03.757 INFO:tasks.workunit.client.0.smithi087.stdout:1/237: rename d3 to d3/d12/d14/d33/d48 22 2024-04-25T15:58:03.758 INFO:tasks.workunit.client.0.smithi087.stdout:5/298: dwrite d9/d2c/f2e [0,4194304] 0 2024-04-25T15:58:03.764 INFO:tasks.workunit.client.0.smithi087.stdout:6/307: dwrite d7/d1a/d2a/d5e/f5a [0,4194304] 0 2024-04-25T15:58:03.764 INFO:tasks.workunit.client.0.smithi087.stdout:1/238: dread d3/d12/f26 [0,4194304] 0 2024-04-25T15:58:03.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/239: chown d3/d12/d14/f37 40845 1 2024-04-25T15:58:03.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/240: unlink d3/d12/l25 0 2024-04-25T15:58:03.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/308: dwrite d7/d1a/f39 [0,4194304] 0 2024-04-25T15:58:03.777 INFO:tasks.workunit.client.0.smithi087.stdout:1/241: dread d3/ff [0,4194304] 0 2024-04-25T15:58:03.777 INFO:tasks.workunit.client.0.smithi087.stdout:5/299: dread d9/f21 [0,4194304] 0 2024-04-25T15:58:03.778 INFO:tasks.workunit.client.0.smithi087.stdout:5/300: chown d9/f1a 25 1 2024-04-25T15:58:03.779 INFO:tasks.workunit.client.0.smithi087.stdout:1/242: creat d3/d12/d22/f49 x:0 0 0 2024-04-25T15:58:03.785 INFO:tasks.workunit.client.0.smithi087.stdout:1/243: getdents d3/d12/d14/d29/d2f/d40 0 2024-04-25T15:58:03.785 INFO:tasks.workunit.client.0.smithi087.stdout:6/309: dwrite d7/d1a/d2a/f64 [0,4194304] 0 2024-04-25T15:58:03.785 INFO:tasks.workunit.client.0.smithi087.stdout:5/301: write f2 [3608249,33023] 0 2024-04-25T15:58:03.787 INFO:tasks.workunit.client.0.smithi087.stdout:1/244: chown d3/d12/d14/l3d 1707 1 2024-04-25T15:58:03.789 INFO:tasks.workunit.client.0.smithi087.stdout:1/245: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:03.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/310: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/f6e x:0 0 0 2024-04-25T15:58:03.791 INFO:tasks.workunit.client.0.smithi087.stdout:5/302: mkdir d9/d2c/d41/d44/d46/d5a 0 2024-04-25T15:58:03.791 INFO:tasks.workunit.client.0.smithi087.stdout:6/311: fdatasync d7/d1a/d1d/d21/d27/d2c/d35/f36 0 2024-04-25T15:58:03.793 INFO:tasks.workunit.client.0.smithi087.stdout:1/246: mknod d3/c4a 0 2024-04-25T15:58:03.794 INFO:tasks.workunit.client.0.smithi087.stdout:5/303: creat d9/d2c/d38/f5b x:0 0 0 2024-04-25T15:58:03.795 INFO:tasks.workunit.client.0.smithi087.stdout:1/247: creat d3/d12/d14/d29/f4b x:0 0 0 2024-04-25T15:58:03.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/312: rename d7/d1a/d1d/d21/d27/d2c/d35/d45/c52 to d7/d1a/d1d/d21/c6f 0 2024-04-25T15:58:03.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/313: readlink d7/l17 0 2024-04-25T15:58:03.797 INFO:tasks.workunit.client.0.smithi087.stdout:1/248: mknod d3/d12/d14/d33/c4c 0 2024-04-25T15:58:03.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/304: getdents d9/d2c/d41/d44 0 2024-04-25T15:58:03.799 INFO:tasks.workunit.client.0.smithi087.stdout:6/314: mknod d7/d1a/d1d/d21/d27/d2c/c70 0 2024-04-25T15:58:03.800 INFO:tasks.workunit.client.0.smithi087.stdout:1/249: mkdir d3/d12/d4d 0 2024-04-25T15:58:03.800 INFO:tasks.workunit.client.0.smithi087.stdout:5/305: fsync d9/f28 0 2024-04-25T15:58:03.801 INFO:tasks.workunit.client.0.smithi087.stdout:5/306: stat d9/c11 0 2024-04-25T15:58:03.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/307: unlink d9/d2c/d30/c34 0 2024-04-25T15:58:03.804 INFO:tasks.workunit.client.0.smithi087.stdout:9/194: sync 2024-04-25T15:58:03.805 INFO:tasks.workunit.client.0.smithi087.stdout:6/315: rename d7/d4e to d7/d71 0 2024-04-25T15:58:03.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/250: creat d3/d12/d14/f4e x:0 0 0 2024-04-25T15:58:03.807 INFO:tasks.workunit.client.0.smithi087.stdout:5/308: mkdir d9/d3e/d5c 0 2024-04-25T15:58:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/309: readlink d9/d2f/l39 0 2024-04-25T15:58:03.808 INFO:tasks.workunit.client.0.smithi087.stdout:9/195: rmdir d6/d8/d32 39 2024-04-25T15:58:03.811 INFO:tasks.workunit.client.0.smithi087.stdout:1/251: symlink d3/d12/d22/l4f 0 2024-04-25T15:58:03.813 INFO:tasks.workunit.client.0.smithi087.stdout:9/196: truncate d6/d8/fc 1426572 0 2024-04-25T15:58:03.815 INFO:tasks.workunit.client.0.smithi087.stdout:6/316: symlink d7/d71/d59/l72 0 2024-04-25T15:58:03.816 INFO:tasks.workunit.client.0.smithi087.stdout:9/197: dread d6/d8/d14/d1d/f23 [0,4194304] 0 2024-04-25T15:58:03.816 INFO:tasks.workunit.client.0.smithi087.stdout:1/252: rename d3/d12/d39/l42 to d3/d12/d14/d29/d3b/l50 0 2024-04-25T15:58:03.817 INFO:tasks.workunit.client.0.smithi087.stdout:5/310: getdents d9/d2c/d30/d55 0 2024-04-25T15:58:03.817 INFO:tasks.workunit.client.0.smithi087.stdout:5/311: fsync d9/f1c 0 2024-04-25T15:58:03.818 INFO:tasks.workunit.client.0.smithi087.stdout:9/198: mkdir d6/d8/d29/d3a 0 2024-04-25T15:58:03.819 INFO:tasks.workunit.client.0.smithi087.stdout:5/312: write d9/f2a [742422,10145] 0 2024-04-25T15:58:03.820 INFO:tasks.workunit.client.0.smithi087.stdout:9/199: read d6/d8/d12/f2f [86144,8714] 0 2024-04-25T15:58:03.821 INFO:tasks.workunit.client.0.smithi087.stdout:5/313: chown d9/d2c/d41/d44/f50 487140938 1 2024-04-25T15:58:03.821 INFO:tasks.workunit.client.0.smithi087.stdout:6/317: creat d7/d1a/d1d/d21/d27/f73 x:0 0 0 2024-04-25T15:58:03.822 INFO:tasks.workunit.client.0.smithi087.stdout:5/314: write d9/f12 [2068818,106360] 0 2024-04-25T15:58:03.823 INFO:tasks.workunit.client.0.smithi087.stdout:9/200: stat d6/d8/d14/l18 0 2024-04-25T15:58:03.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/318: dread - d7/d1a/d1d/d21/f6d zero size 2024-04-25T15:58:03.826 INFO:tasks.workunit.client.0.smithi087.stdout:5/315: write d9/d2c/d38/f5b [54478,86603] 0 2024-04-25T15:58:03.826 INFO:tasks.workunit.client.0.smithi087.stdout:1/253: dwrite d3/d12/d14/f31 [0,4194304] 0 2024-04-25T15:58:03.826 INFO:tasks.workunit.client.0.smithi087.stdout:9/201: read d6/d8/d32/f35 [495992,65578] 0 2024-04-25T15:58:03.826 INFO:tasks.workunit.client.0.smithi087.stdout:6/319: dread - d7/d1a/d1d/d21/d27/d2c/f68 zero size 2024-04-25T15:58:03.828 INFO:tasks.workunit.client.0.smithi087.stdout:5/316: write d9/f1c [1622856,111581] 0 2024-04-25T15:58:03.829 INFO:tasks.workunit.client.0.smithi087.stdout:9/202: unlink d6/d8/d14/l18 0 2024-04-25T15:58:03.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/317: write d9/f26 [2071078,61153] 0 2024-04-25T15:58:03.830 INFO:tasks.workunit.client.0.smithi087.stdout:6/320: creat d7/d1a/d41/f74 x:0 0 0 2024-04-25T15:58:03.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/254: dread d3/d12/f26 [0,4194304] 0 2024-04-25T15:58:03.838 INFO:tasks.workunit.client.0.smithi087.stdout:5/318: link d9/d2f/d3b/f4c d9/d2c/d30/d56/f5d 0 2024-04-25T15:58:03.839 INFO:tasks.workunit.client.0.smithi087.stdout:9/203: getdents d6/d8 0 2024-04-25T15:58:03.843 INFO:tasks.workunit.client.0.smithi087.stdout:6/321: rename d7/d1a/d1d/d21/d27/d2c/d35/d45/l4c to d7/d1a/d1d/d21/d37/l75 0 2024-04-25T15:58:03.843 INFO:tasks.workunit.client.0.smithi087.stdout:1/255: creat d3/d12/d4d/f51 x:0 0 0 2024-04-25T15:58:03.846 INFO:tasks.workunit.client.0.smithi087.stdout:1/256: read - d3/d12/d22/f49 zero size 2024-04-25T15:58:03.846 INFO:tasks.workunit.client.0.smithi087.stdout:5/319: rename d9/d2c/d30/f43 to d9/d3e/d5c/f5e 0 2024-04-25T15:58:03.846 INFO:tasks.workunit.client.0.smithi087.stdout:6/322: rmdir d7/d1a/d1d 39 2024-04-25T15:58:03.847 INFO:tasks.workunit.client.0.smithi087.stdout:3/248: sync 2024-04-25T15:58:03.848 INFO:tasks.workunit.client.0.smithi087.stdout:0/195: sync 2024-04-25T15:58:03.848 INFO:tasks.workunit.client.0.smithi087.stdout:9/204: dwrite d6/d8/d29/f2a [0,4194304] 0 2024-04-25T15:58:03.849 INFO:tasks.workunit.client.0.smithi087.stdout:5/320: unlink d9/l14 0 2024-04-25T15:58:03.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/323: rmdir d7/d1a/d41 39 2024-04-25T15:58:03.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/196: rmdir d1 39 2024-04-25T15:58:03.853 INFO:tasks.workunit.client.0.smithi087.stdout:6/324: mkdir d7/d71/d76 0 2024-04-25T15:58:03.855 INFO:tasks.workunit.client.0.smithi087.stdout:5/321: read f3 [2530793,29029] 0 2024-04-25T15:58:03.856 INFO:tasks.workunit.client.0.smithi087.stdout:1/257: link d3/c2c d3/d12/d14/d29/c52 0 2024-04-25T15:58:03.862 INFO:tasks.workunit.client.0.smithi087.stdout:3/249: dwrite d4/d17/d27/f34 [4194304,4194304] 0 2024-04-25T15:58:03.863 INFO:tasks.workunit.client.0.smithi087.stdout:9/205: dwrite d6/d8/d14/d1d/f39 [0,4194304] 0 2024-04-25T15:58:03.869 INFO:tasks.workunit.client.0.smithi087.stdout:5/322: rename d9/d2c/d41 to d9/d3e/d5c/d5f 0 2024-04-25T15:58:03.869 INFO:tasks.workunit.client.0.smithi087.stdout:9/206: stat d6/d8/d14/c1b 0 2024-04-25T15:58:03.870 INFO:tasks.workunit.client.0.smithi087.stdout:0/197: dread d1/d6/f8 [0,4194304] 0 2024-04-25T15:58:03.872 INFO:tasks.workunit.client.0.smithi087.stdout:0/198: chown d1/d6/d39/f20 1 1 2024-04-25T15:58:03.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/323: mknod d9/d2f/d40/d4d/d58/c60 0 2024-04-25T15:58:03.874 INFO:tasks.workunit.client.0.smithi087.stdout:0/199: stat d1/f14 0 2024-04-25T15:58:03.875 INFO:tasks.workunit.client.0.smithi087.stdout:6/325: dwrite d7/f14 [0,4194304] 0 2024-04-25T15:58:03.876 INFO:tasks.workunit.client.0.smithi087.stdout:9/207: creat d6/f3b x:0 0 0 2024-04-25T15:58:03.877 INFO:tasks.workunit.client.0.smithi087.stdout:0/200: chown d1/f32 1 1 2024-04-25T15:58:03.878 INFO:tasks.workunit.client.0.smithi087.stdout:1/258: dwrite d3/d12/d14/d29/f4b [0,4194304] 0 2024-04-25T15:58:03.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/324: unlink d9/d2f/f59 0 2024-04-25T15:58:03.882 INFO:tasks.workunit.client.0.smithi087.stdout:6/326: rmdir d7/d1a/d1d 39 2024-04-25T15:58:03.882 INFO:tasks.workunit.client.0.smithi087.stdout:0/201: fsync d1/d6/f8 0 2024-04-25T15:58:03.883 INFO:tasks.workunit.client.0.smithi087.stdout:1/259: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:03.884 INFO:tasks.workunit.client.0.smithi087.stdout:3/250: dwrite d4/f19 [0,4194304] 0 2024-04-25T15:58:03.885 INFO:tasks.workunit.client.0.smithi087.stdout:3/251: read d4/f3b [7261841,18246] 0 2024-04-25T15:58:03.886 INFO:tasks.workunit.client.0.smithi087.stdout:5/325: mknod d9/d2c/d49/c61 0 2024-04-25T15:58:03.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/208: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:03.894 INFO:tasks.workunit.client.0.smithi087.stdout:1/260: dwrite d3/d12/d14/d29/f4b [0,4194304] 0 2024-04-25T15:58:03.895 INFO:tasks.workunit.client.0.smithi087.stdout:5/326: creat d9/d2c/d30/f62 x:0 0 0 2024-04-25T15:58:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/327: stat d9/d2c/d49 0 2024-04-25T15:58:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:1/261: chown d3/d12/d14/d33/c44 165208 1 2024-04-25T15:58:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:2/274: sync 2024-04-25T15:58:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:4/177: sync 2024-04-25T15:58:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:8/229: sync 2024-04-25T15:58:03.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/192: sync 2024-04-25T15:58:03.898 INFO:tasks.workunit.client.0.smithi087.stdout:5/328: chown d9/f33 3149 1 2024-04-25T15:58:03.901 INFO:tasks.workunit.client.0.smithi087.stdout:0/202: mkdir d1/d6/d21/d2a/d41 0 2024-04-25T15:58:03.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/275: creat d3/d20/d4a/f4c x:0 0 0 2024-04-25T15:58:03.904 INFO:tasks.workunit.client.0.smithi087.stdout:8/230: write d4/d9/f1a [710950,112133] 0 2024-04-25T15:58:03.906 INFO:tasks.workunit.client.0.smithi087.stdout:7/193: mknod d1/d4/d18/d36/c3f 0 2024-04-25T15:58:03.906 INFO:tasks.workunit.client.0.smithi087.stdout:3/252: creat d4/db/f4d x:0 0 0 2024-04-25T15:58:03.908 INFO:tasks.workunit.client.0.smithi087.stdout:9/209: rename d6/d8/d29/l31 to d6/d8/d29/l3c 0 2024-04-25T15:58:03.909 INFO:tasks.workunit.client.0.smithi087.stdout:2/276: readlink d3/d2a/d1c/l2f 0 2024-04-25T15:58:03.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/262: dread d3/f8 [4194304,4194304] 0 2024-04-25T15:58:03.914 INFO:tasks.workunit.client.0.smithi087.stdout:6/327: dwrite d7/d1a/d2a/f3c [4194304,4194304] 0 2024-04-25T15:58:03.915 INFO:tasks.workunit.client.0.smithi087.stdout:4/178: dwrite d4/d7/f2c [0,4194304] 0 2024-04-25T15:58:03.917 INFO:tasks.workunit.client.0.smithi087.stdout:1/263: write d3/d12/d14/f27 [1465457,117390] 0 2024-04-25T15:58:03.918 INFO:tasks.workunit.client.0.smithi087.stdout:2/277: mknod d3/d20/c4d 0 2024-04-25T15:58:03.921 INFO:tasks.workunit.client.0.smithi087.stdout:8/231: link d4/d9/f1c d4/d1d/f4c 0 2024-04-25T15:58:03.922 INFO:tasks.workunit.client.0.smithi087.stdout:5/329: truncate d9/f26 3945655 0 2024-04-25T15:58:03.923 INFO:tasks.workunit.client.0.smithi087.stdout:9/210: dread d6/d8/fc [0,4194304] 0 2024-04-25T15:58:03.923 INFO:tasks.workunit.client.0.smithi087.stdout:6/328: creat d7/d1a/d2a/d5e/f77 x:0 0 0 2024-04-25T15:58:03.924 INFO:tasks.workunit.client.0.smithi087.stdout:0/203: getdents d1/d6/d1f 0 2024-04-25T15:58:03.924 INFO:tasks.workunit.client.0.smithi087.stdout:2/278: unlink d3/l10 0 2024-04-25T15:58:03.926 INFO:tasks.workunit.client.0.smithi087.stdout:8/232: symlink d4/d1d/l4d 0 2024-04-25T15:58:03.927 INFO:tasks.workunit.client.0.smithi087.stdout:7/194: dwrite d1/fd [0,4194304] 0 2024-04-25T15:58:03.927 INFO:tasks.workunit.client.0.smithi087.stdout:4/179: creat d4/d7/d26/f38 x:0 0 0 2024-04-25T15:58:03.928 INFO:tasks.workunit.client.0.smithi087.stdout:6/329: rmdir d7/d71 39 2024-04-25T15:58:03.930 INFO:tasks.workunit.client.0.smithi087.stdout:9/211: chown c5 3523 1 2024-04-25T15:58:03.930 INFO:tasks.workunit.client.0.smithi087.stdout:3/253: getdents d4/d17/d27 0 2024-04-25T15:58:03.931 INFO:tasks.workunit.client.0.smithi087.stdout:8/233: symlink d4/l4e 0 2024-04-25T15:58:03.933 INFO:tasks.workunit.client.0.smithi087.stdout:2/279: chown d3/d27/d38/c3f 27935 1 2024-04-25T15:58:03.934 INFO:tasks.workunit.client.0.smithi087.stdout:0/204: mknod d1/da/c42 0 2024-04-25T15:58:03.935 INFO:tasks.workunit.client.0.smithi087.stdout:5/330: chown d9/d3e/d5c/d5f/d44/f50 517784744 1 2024-04-25T15:58:03.938 INFO:tasks.workunit.client.0.smithi087.stdout:1/264: dwrite d3/d12/d14/f30 [0,4194304] 0 2024-04-25T15:58:03.939 INFO:tasks.workunit.client.0.smithi087.stdout:1/265: truncate d3/f24 1096907 0 2024-04-25T15:58:03.940 INFO:tasks.workunit.client.0.smithi087.stdout:8/234: truncate d4/d1d/d17/f2d 801141 0 2024-04-25T15:58:03.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/205: fsync d1/d6/d21/d2a/f19 0 2024-04-25T15:58:03.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/180: rename d4/d7/d15/d12/f33 to d4/f39 0 2024-04-25T15:58:03.944 INFO:tasks.workunit.client.0.smithi087.stdout:8/235: chown d4/l7 3503463 1 2024-04-25T15:58:03.944 INFO:tasks.workunit.client.0.smithi087.stdout:1/266: fdatasync d3/d12/d14/f4e 0 2024-04-25T15:58:03.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/195: dread d1/d1a/f20 [0,4194304] 0 2024-04-25T15:58:03.946 INFO:tasks.workunit.client.0.smithi087.stdout:8/236: fdatasync d4/d1d/d17/f33 0 2024-04-25T15:58:03.947 INFO:tasks.workunit.client.0.smithi087.stdout:2/280: mknod d3/d2a/d48/c4e 0 2024-04-25T15:58:03.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/196: chown d1/d9/d26/f30 337 1 2024-04-25T15:58:03.948 INFO:tasks.workunit.client.0.smithi087.stdout:1/267: chown d3/d12/d14/d29/d2f/f3f 0 1 2024-04-25T15:58:03.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/212: dwrite d6/d8/d14/d1d/f39 [0,4194304] 0 2024-04-25T15:58:03.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/237: read d4/d1d/d17/f33 [883978,44211] 0 2024-04-25T15:58:03.949 INFO:tasks.workunit.client.0.smithi087.stdout:3/254: truncate d4/d17/f1b 501175 0 2024-04-25T15:58:03.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/197: chown d1/l21 1401661692 1 2024-04-25T15:58:03.951 INFO:tasks.workunit.client.0.smithi087.stdout:0/206: rename d1/d6/d21/d2a/f25 to d1/d6/d39/d34/f43 0 2024-04-25T15:58:03.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/207: dread d1/d6/d21/d2a/f31 [0,4194304] 0 2024-04-25T15:58:03.956 INFO:tasks.workunit.client.0.smithi087.stdout:9/213: unlink d6/f1f 0 2024-04-25T15:58:03.956 INFO:tasks.workunit.client.0.smithi087.stdout:9/214: chown c5 6676 1 2024-04-25T15:58:03.957 INFO:tasks.workunit.client.0.smithi087.stdout:8/238: mknod d4/d1d/c4f 0 2024-04-25T15:58:03.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/255: creat d4/d17/d24/f4e x:0 0 0 2024-04-25T15:58:03.960 INFO:tasks.workunit.client.0.smithi087.stdout:1/268: rmdir d3/d12/d14/d29/d2f 39 2024-04-25T15:58:03.960 INFO:tasks.workunit.client.0.smithi087.stdout:3/256: chown d4/db/d28/d3c 400307702 1 2024-04-25T15:58:03.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/239: read d4/fa [2607515,111103] 0 2024-04-25T15:58:03.961 INFO:tasks.workunit.client.0.smithi087.stdout:2/281: dwrite d3/d27/f39 [0,4194304] 0 2024-04-25T15:58:03.961 INFO:tasks.workunit.client.0.smithi087.stdout:3/257: chown d4/d14/d23 43 1 2024-04-25T15:58:03.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/198: chown d1/d4/f12 2975819 1 2024-04-25T15:58:03.963 INFO:tasks.workunit.client.0.smithi087.stdout:4/181: rename d4/d7/d15/d36 to d4/d7/d15/d21/d3a 0 2024-04-25T15:58:03.964 INFO:tasks.workunit.client.0.smithi087.stdout:6/330: getdents d7/d1a/d1d/d21/d37 0 2024-04-25T15:58:03.965 INFO:tasks.workunit.client.0.smithi087.stdout:9/215: symlink d6/d8/d29/l3d 0 2024-04-25T15:58:03.968 INFO:tasks.workunit.client.0.smithi087.stdout:9/216: chown d6/d8/d29 5390 1 2024-04-25T15:58:03.968 INFO:tasks.workunit.client.0.smithi087.stdout:8/240: symlink d4/l50 0 2024-04-25T15:58:03.972 INFO:tasks.workunit.client.0.smithi087.stdout:3/258: dwrite d4/db/d28/d3c/f4b [0,4194304] 0 2024-04-25T15:58:03.972 INFO:tasks.workunit.client.0.smithi087.stdout:5/331: rename d9/d3e/d5c/d5f/d44/d46/d5a to d9/d3e/d5c/d63 0 2024-04-25T15:58:03.974 INFO:tasks.workunit.client.0.smithi087.stdout:3/259: fdatasync d4/db/fc 0 2024-04-25T15:58:03.975 INFO:tasks.workunit.client.0.smithi087.stdout:3/260: write d4/db/f47 [823083,19393] 0 2024-04-25T15:58:03.976 INFO:tasks.workunit.client.0.smithi087.stdout:8/241: dread d4/d1d/d17/f33 [0,4194304] 0 2024-04-25T15:58:03.977 INFO:tasks.workunit.client.0.smithi087.stdout:6/331: truncate d7/d1a/d41/f44 1682245 0 2024-04-25T15:58:03.977 INFO:tasks.workunit.client.0.smithi087.stdout:6/332: chown d7/f40 0 1 2024-04-25T15:58:03.983 INFO:tasks.workunit.client.0.smithi087.stdout:8/242: dwrite d4/d1d/d17/f2d [0,4194304] 0 2024-04-25T15:58:03.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/269: rename d3/d12/d22 to d3/d12/d14/d29/d2f/d53 0 2024-04-25T15:58:03.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/199: dread d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:03.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/332: symlink d9/d3e/d5c/l64 0 2024-04-25T15:58:03.986 INFO:tasks.workunit.client.0.smithi087.stdout:0/208: mknod d1/d27/c44 0 2024-04-25T15:58:03.987 INFO:tasks.workunit.client.0.smithi087.stdout:0/209: write d1/d6/f36 [229810,26952] 0 2024-04-25T15:58:03.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/333: stat d7/d71 0 2024-04-25T15:58:03.990 INFO:tasks.workunit.client.0.smithi087.stdout:9/217: mkdir d6/d3e 0 2024-04-25T15:58:03.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/243: rename d4/d8/dd/f34 to d4/d1d/d17/f51 0 2024-04-25T15:58:03.994 INFO:tasks.workunit.client.0.smithi087.stdout:0/210: rename d1 to d1/d6/d39/d45 22 2024-04-25T15:58:03.996 INFO:tasks.workunit.client.0.smithi087.stdout:1/270: write d3/d12/d14/f37 [5177796,88958] 0 2024-04-25T15:58:03.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/261: mknod d4/db/c4f 0 2024-04-25T15:58:03.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/282: truncate d3/f1e 2593392 0 2024-04-25T15:58:03.999 INFO:tasks.workunit.client.0.smithi087.stdout:3/262: chown d4/db/d28/f2f 1848259556 1 2024-04-25T15:58:04.001 INFO:tasks.workunit.client.0.smithi087.stdout:6/334: dwrite d7/d1a/d1d/d21/d27/d2c/d35/f36 [0,4194304] 0 2024-04-25T15:58:04.003 INFO:tasks.workunit.client.0.smithi087.stdout:6/335: read d7/f19 [760826,38856] 0 2024-04-25T15:58:04.004 INFO:tasks.workunit.client.0.smithi087.stdout:4/182: truncate d4/d7/d15/ff 225025 0 2024-04-25T15:58:04.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/271: write d3/d12/d14/f17 [7610246,64092] 0 2024-04-25T15:58:04.007 INFO:tasks.workunit.client.0.smithi087.stdout:6/336: chown d7/d1a/d1d/d21/c30 233158 1 2024-04-25T15:58:04.007 INFO:tasks.workunit.client.0.smithi087.stdout:5/333: creat d9/d2c/f65 x:0 0 0 2024-04-25T15:58:04.010 INFO:tasks.workunit.client.0.smithi087.stdout:8/244: truncate d4/d9/f1c 5593372 0 2024-04-25T15:58:04.011 INFO:tasks.workunit.client.0.smithi087.stdout:1/272: write d3/d12/d4d/f51 [906763,9375] 0 2024-04-25T15:58:04.011 INFO:tasks.workunit.client.0.smithi087.stdout:9/218: dwrite d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:04.011 INFO:tasks.workunit.client.0.smithi087.stdout:1/273: chown d3/d12/f43 26159644 1 2024-04-25T15:58:04.013 INFO:tasks.workunit.client.0.smithi087.stdout:7/200: truncate d1/d1a/f24 3645164 0 2024-04-25T15:58:04.013 INFO:tasks.workunit.client.0.smithi087.stdout:3/263: dwrite d4/db/f4d [0,4194304] 0 2024-04-25T15:58:04.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/283: mkdir d3/d27/d29/d4f 0 2024-04-25T15:58:04.014 INFO:tasks.workunit.client.0.smithi087.stdout:8/245: read d4/d1d/d17/f2d [2526922,40930] 0 2024-04-25T15:58:04.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/334: fsync d9/f21 0 2024-04-25T15:58:04.019 INFO:tasks.workunit.client.0.smithi087.stdout:6/337: readlink d7/l16 0 2024-04-25T15:58:04.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/201: creat d1/d4/f40 x:0 0 0 2024-04-25T15:58:04.021 INFO:tasks.workunit.client.0.smithi087.stdout:9/219: write f0 [4936405,81642] 0 2024-04-25T15:58:04.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/202: readlink d1/d4/d18/l2e 0 2024-04-25T15:58:04.023 INFO:tasks.workunit.client.0.smithi087.stdout:8/246: fsync d4/d9/f23 0 2024-04-25T15:58:04.027 INFO:tasks.workunit.client.0.smithi087.stdout:1/274: dread d3/d12/d14/f31 [0,4194304] 0 2024-04-25T15:58:04.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/338: dwrite d7/f10 [4194304,4194304] 0 2024-04-25T15:58:04.031 INFO:tasks.workunit.client.0.smithi087.stdout:5/335: rename d9/d2c/d30/f62 to d9/d3e/d5c/d63/f66 0 2024-04-25T15:58:04.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/220: dwrite d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:04.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/264: fdatasync d4/db/f4d 0 2024-04-25T15:58:04.043 INFO:tasks.workunit.client.0.smithi087.stdout:4/183: dwrite d4/d7/d15/f1d [0,4194304] 0 2024-04-25T15:58:04.044 INFO:tasks.workunit.client.0.smithi087.stdout:6/339: getdents d7/d1a/d1d/d21/d37 0 2024-04-25T15:58:04.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/275: dwrite d3/ff [0,4194304] 0 2024-04-25T15:58:04.048 INFO:tasks.workunit.client.0.smithi087.stdout:5/336: dread d9/f1f [0,4194304] 0 2024-04-25T15:58:04.051 INFO:tasks.workunit.client.0.smithi087.stdout:4/184: symlink d4/d7/d26/l3b 0 2024-04-25T15:58:04.052 INFO:tasks.workunit.client.0.smithi087.stdout:2/284: dread d3/d27/f42 [0,4194304] 0 2024-04-25T15:58:04.053 INFO:tasks.workunit.client.0.smithi087.stdout:9/221: dread f2 [0,4194304] 0 2024-04-25T15:58:04.055 INFO:tasks.workunit.client.0.smithi087.stdout:6/340: chown d7/d1a/d1d/f28 74505342 1 2024-04-25T15:58:04.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/185: write d4/d7/d26/f38 [340647,91209] 0 2024-04-25T15:58:04.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/276: creat d3/d12/d14/d29/d2f/d40/f54 x:0 0 0 2024-04-25T15:58:04.060 INFO:tasks.workunit.client.0.smithi087.stdout:5/337: getdents d9/d2f/d40/d4d 0 2024-04-25T15:58:04.060 INFO:tasks.workunit.client.0.smithi087.stdout:1/277: rmdir d3/d12/d39 39 2024-04-25T15:58:04.060 INFO:tasks.workunit.client.0.smithi087.stdout:8/247: dwrite d4/d1d/f4c [0,4194304] 0 2024-04-25T15:58:04.061 INFO:tasks.workunit.client.0.smithi087.stdout:2/285: symlink d3/d27/d29/l50 0 2024-04-25T15:58:04.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/265: dwrite d4/d17/f2a [0,4194304] 0 2024-04-25T15:58:04.065 INFO:tasks.workunit.client.0.smithi087.stdout:1/278: chown d3/d12/d14/f30 427339862 1 2024-04-25T15:58:04.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/222: getdents d6 0 2024-04-25T15:58:04.066 INFO:tasks.workunit.client.0.smithi087.stdout:5/338: dread - d9/d3e/d5c/d5f/d44/f47 zero size 2024-04-25T15:58:04.067 INFO:tasks.workunit.client.0.smithi087.stdout:9/223: readlink l4 0 2024-04-25T15:58:04.067 INFO:tasks.workunit.client.0.smithi087.stdout:1/279: stat d3/d12/d14/d29/d2f/d53/f49 0 2024-04-25T15:58:04.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/286: creat d3/d27/d29/d4f/f51 x:0 0 0 2024-04-25T15:58:04.071 INFO:tasks.workunit.client.0.smithi087.stdout:3/266: mkdir d4/d14/d50 0 2024-04-25T15:58:04.072 INFO:tasks.workunit.client.0.smithi087.stdout:9/224: unlink d6/d8/fa 0 2024-04-25T15:58:04.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/280: symlink d3/d12/d14/d29/d2f/d53/l55 0 2024-04-25T15:58:04.075 INFO:tasks.workunit.client.0.smithi087.stdout:5/339: write d9/d3e/d5c/d63/f66 [567925,105299] 0 2024-04-25T15:58:04.075 INFO:tasks.workunit.client.0.smithi087.stdout:3/267: write d4/d17/d24/d3f/f4a [646960,39803] 0 2024-04-25T15:58:04.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/248: dwrite d4/d9/f48 [0,4194304] 0 2024-04-25T15:58:04.081 INFO:tasks.workunit.client.0.smithi087.stdout:2/287: rename d3/d27/d29/d4f/f51 to d3/d20/d4a/d47/f52 0 2024-04-25T15:58:04.081 INFO:tasks.workunit.client.0.smithi087.stdout:1/281: rmdir d3/d12 39 2024-04-25T15:58:04.082 INFO:tasks.workunit.client.0.smithi087.stdout:3/268: mkdir d4/d14/d37/d51 0 2024-04-25T15:58:04.082 INFO:tasks.workunit.client.0.smithi087.stdout:2/288: chown d3/d20/d4a 1636079442 1 2024-04-25T15:58:04.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/289: chown d3/fd 3 1 2024-04-25T15:58:04.085 INFO:tasks.workunit.client.0.smithi087.stdout:8/249: creat d4/d8/dd/f52 x:0 0 0 2024-04-25T15:58:04.085 INFO:tasks.workunit.client.0.smithi087.stdout:3/269: read d4/db/fe [3171433,991] 0 2024-04-25T15:58:04.086 INFO:tasks.workunit.client.0.smithi087.stdout:6/341: dwrite d7/d71/f31 [0,4194304] 0 2024-04-25T15:58:04.089 INFO:tasks.workunit.client.0.smithi087.stdout:8/250: rmdir d4/d8/dd 39 2024-04-25T15:58:04.091 INFO:tasks.workunit.client.0.smithi087.stdout:8/251: stat d4/d9/f1c 0 2024-04-25T15:58:04.093 INFO:tasks.workunit.client.0.smithi087.stdout:6/342: readlink d7/d1a/d1d/l6a 0 2024-04-25T15:58:04.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/270: rename d4/db/d28/d3c/f42 to d4/d14/d37/d51/f52 0 2024-04-25T15:58:04.095 INFO:tasks.workunit.client.0.smithi087.stdout:8/252: unlink d4/c5 0 2024-04-25T15:58:04.096 INFO:tasks.workunit.client.0.smithi087.stdout:5/340: dread d9/f29 [0,4194304] 0 2024-04-25T15:58:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:1/282: getdents d3/d2d 0 2024-04-25T15:58:04.098 INFO:tasks.workunit.client.0.smithi087.stdout:8/253: readlink d4/d1d/d17/l24 0 2024-04-25T15:58:04.099 INFO:tasks.workunit.client.0.smithi087.stdout:4/186: dread d4/d7/d15/d12/f1c [4194304,4194304] 0 2024-04-25T15:58:04.099 INFO:tasks.workunit.client.0.smithi087.stdout:2/290: dwrite d3/d20/f45 [0,4194304] 0 2024-04-25T15:58:04.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/341: readlink d9/d3e/d5c/d5f/l4f 0 2024-04-25T15:58:04.104 INFO:tasks.workunit.client.0.smithi087.stdout:1/283: readlink d3/d12/d14/l3d 0 2024-04-25T15:58:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/187: creat d4/d10/f3c x:0 0 0 2024-04-25T15:58:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:8/254: dread d4/d1d/d14/f31 [0,4194304] 0 2024-04-25T15:58:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:6/343: dread f6 [0,4194304] 0 2024-04-25T15:58:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/291: dread - d3/d27/f31 zero size 2024-04-25T15:58:04.109 INFO:tasks.workunit.client.0.smithi087.stdout:9/225: dread d6/d8/d12/f2f [0,4194304] 0 2024-04-25T15:58:04.112 INFO:tasks.workunit.client.0.smithi087.stdout:1/284: rename d3/d12/d39/l3c to d3/d12/d14/d33/l56 0 2024-04-25T15:58:04.113 INFO:tasks.workunit.client.0.smithi087.stdout:6/344: symlink d7/d1a/d1d/d21/d37/l78 0 2024-04-25T15:58:04.114 INFO:tasks.workunit.client.0.smithi087.stdout:9/226: write d6/f2b [2528239,34088] 0 2024-04-25T15:58:04.114 INFO:tasks.workunit.client.0.smithi087.stdout:3/271: dwrite d4/d17/f1e [0,4194304] 0 2024-04-25T15:58:04.118 INFO:tasks.workunit.client.0.smithi087.stdout:3/272: chown d4/l1c 589521 1 2024-04-25T15:58:04.119 INFO:tasks.workunit.client.0.smithi087.stdout:5/342: dwrite d9/d2c/f65 [0,4194304] 0 2024-04-25T15:58:04.119 INFO:tasks.workunit.client.0.smithi087.stdout:9/227: write d6/f3b [336782,119808] 0 2024-04-25T15:58:04.121 INFO:tasks.workunit.client.0.smithi087.stdout:6/345: mknod d7/d71/c79 0 2024-04-25T15:58:04.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/255: link d4/d8/c16 d4/d8/dd/c53 0 2024-04-25T15:58:04.126 INFO:tasks.workunit.client.0.smithi087.stdout:4/188: dwrite d4/f6 [0,4194304] 0 2024-04-25T15:58:04.127 INFO:tasks.workunit.client.0.smithi087.stdout:5/343: mknod d9/d2f/d40/d4d/c67 0 2024-04-25T15:58:04.127 INFO:tasks.workunit.client.0.smithi087.stdout:6/346: stat d7/d1a/d2a/c46 0 2024-04-25T15:58:04.129 INFO:tasks.workunit.client.0.smithi087.stdout:9/228: creat d6/d8/d29/f3f x:0 0 0 2024-04-25T15:58:04.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/256: rename d4/d9/l38 to d4/d22/d43/l54 0 2024-04-25T15:58:04.134 INFO:tasks.workunit.client.0.smithi087.stdout:5/344: truncate d9/d2c/d38/f5b 1076348 0 2024-04-25T15:58:04.136 INFO:tasks.workunit.client.0.smithi087.stdout:8/257: stat d4/d8/dd/d2f/c35 0 2024-04-25T15:58:04.138 INFO:tasks.workunit.client.0.smithi087.stdout:1/285: dwrite d3/d12/d14/d29/d2f/f3f [0,4194304] 0 2024-04-25T15:58:04.138 INFO:tasks.workunit.client.0.smithi087.stdout:9/229: creat d6/d8/d29/d3a/f40 x:0 0 0 2024-04-25T15:58:04.139 INFO:tasks.workunit.client.0.smithi087.stdout:2/292: dwrite d3/d27/f41 [0,4194304] 0 2024-04-25T15:58:04.140 INFO:tasks.workunit.client.0.smithi087.stdout:8/258: write d4/d8/dd/f52 [719058,119421] 0 2024-04-25T15:58:04.141 INFO:tasks.workunit.client.0.smithi087.stdout:5/345: creat d9/d2f/d3b/f68 x:0 0 0 2024-04-25T15:58:04.142 INFO:tasks.workunit.client.0.smithi087.stdout:4/189: link d4/l29 d4/l3d 0 2024-04-25T15:58:04.144 INFO:tasks.workunit.client.0.smithi087.stdout:9/230: creat d6/d8/d32/f41 x:0 0 0 2024-04-25T15:58:04.144 INFO:tasks.workunit.client.0.smithi087.stdout:9/231: truncate d6/d8/f2e 1008736 0 2024-04-25T15:58:04.146 INFO:tasks.workunit.client.0.smithi087.stdout:1/286: rename d3/f24 to d3/d12/d4d/f57 0 2024-04-25T15:58:04.147 INFO:tasks.workunit.client.0.smithi087.stdout:8/259: creat d4/d22/f55 x:0 0 0 2024-04-25T15:58:04.152 INFO:tasks.workunit.client.0.smithi087.stdout:4/190: dwrite d4/d7/d15/d13/f30 [0,4194304] 0 2024-04-25T15:58:04.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/232: mknod d6/d8/d14/c42 0 2024-04-25T15:58:04.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/293: rename d3/d27/l33 to d3/d27/d29/d2d/d40/l53 0 2024-04-25T15:58:04.161 INFO:tasks.workunit.client.0.smithi087.stdout:9/233: creat d6/d8/d12/f43 x:0 0 0 2024-04-25T15:58:04.162 INFO:tasks.workunit.client.0.smithi087.stdout:2/294: creat d3/d2a/d48/f54 x:0 0 0 2024-04-25T15:58:04.165 INFO:tasks.workunit.client.0.smithi087.stdout:6/347: dread d7/d1a/f3a [0,4194304] 0 2024-04-25T15:58:04.165 INFO:tasks.workunit.client.0.smithi087.stdout:1/287: rename d3/d12/d14/c2a to d3/d12/c58 0 2024-04-25T15:58:04.166 INFO:tasks.workunit.client.0.smithi087.stdout:6/348: readlink d7/d1a/d2a/l6b 0 2024-04-25T15:58:04.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/295: rmdir d3/d2a/d48 39 2024-04-25T15:58:04.168 INFO:tasks.workunit.client.0.smithi087.stdout:1/288: fdatasync d3/d12/d14/f18 0 2024-04-25T15:58:04.172 INFO:tasks.workunit.client.0.smithi087.stdout:6/349: symlink d7/d1a/d41/l7a 0 2024-04-25T15:58:04.172 INFO:tasks.workunit.client.0.smithi087.stdout:8/260: truncate d4/d9/f15 3344388 0 2024-04-25T15:58:04.173 INFO:tasks.workunit.client.0.smithi087.stdout:9/234: getdents d6/d8 0 2024-04-25T15:58:04.174 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:04.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/191: dread d4/fb [0,4194304] 0 2024-04-25T15:58:04.175 INFO:tasks.workunit.client.0.smithi087.stdout:9/235: write d6/d8/d32/f35 [1366433,51910] 0 2024-04-25T15:58:04.177 INFO:tasks.workunit.client.0.smithi087.stdout:8/261: mknod d4/d1d/d3f/c56 0 2024-04-25T15:58:04.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/296: write d3/d27/d29/f2e [2419822,89074] 0 2024-04-25T15:58:04.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/236: creat d6/d8/d12/f44 x:0 0 0 2024-04-25T15:58:04.183 INFO:tasks.workunit.client.0.smithi087.stdout:4/192: creat d4/d7/d15/d21/d3a/f3e x:0 0 0 2024-04-25T15:58:04.186 INFO:tasks.workunit.client.0.smithi087.stdout:8/262: unlink d4/fa 0 2024-04-25T15:58:04.189 INFO:tasks.workunit.client.0.smithi087.stdout:1/289: link d3/d12/d14/d29/l32 d3/d12/d14/d29/d2f/d40/l59 0 2024-04-25T15:58:04.190 INFO:tasks.workunit.client.0.smithi087.stdout:9/237: dwrite d6/d8/d12/f37 [0,4194304] 0 2024-04-25T15:58:04.192 INFO:tasks.workunit.client.0.smithi087.stdout:9/238: dread f2 [0,4194304] 0 2024-04-25T15:58:04.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/350: rename d7/d1a/d2a/d5e to d7/d1a/d7b 0 2024-04-25T15:58:04.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/193: dwrite d4/d7/d15/f1d [0,4194304] 0 2024-04-25T15:58:04.197 INFO:tasks.workunit.client.0.smithi087.stdout:8/263: readlink d4/d22/d43/l54 0 2024-04-25T15:58:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/297: truncate d3/d27/f3e 6308796 0 2024-04-25T15:58:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/298: chown d3 4071412 1 2024-04-25T15:58:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:7/203: sync 2024-04-25T15:58:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:0/211: sync 2024-04-25T15:58:04.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/351: rename d7/d1a/d1d/d21/c30 to d7/d1a/d1d/d21/d27/d2c/d35/d45/c7c 0 2024-04-25T15:58:04.203 INFO:tasks.workunit.client.0.smithi087.stdout:8/264: creat d4/f57 x:0 0 0 2024-04-25T15:58:04.203 INFO:tasks.workunit.client.0.smithi087.stdout:7/204: dread d1/d1a/f39 [0,4194304] 0 2024-04-25T15:58:04.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/212: fdatasync d1/f14 0 2024-04-25T15:58:04.207 INFO:tasks.workunit.client.0.smithi087.stdout:8/265: write d4/d22/f2a [1313384,46015] 0 2024-04-25T15:58:04.207 INFO:tasks.workunit.client.0.smithi087.stdout:2/299: rename d3/d2a/c49 to d3/d27/d29/d4f/c55 0 2024-04-25T15:58:04.209 INFO:tasks.workunit.client.0.smithi087.stdout:1/290: creat d3/f5a x:0 0 0 2024-04-25T15:58:04.210 INFO:tasks.workunit.client.0.smithi087.stdout:0/213: readlink d1/l4 0 2024-04-25T15:58:04.211 INFO:tasks.workunit.client.0.smithi087.stdout:9/239: dread d6/d8/d14/d1d/f23 [0,4194304] 0 2024-04-25T15:58:04.212 INFO:tasks.workunit.client.0.smithi087.stdout:4/194: dwrite d4/d7/d15/d12/f2a [0,4194304] 0 2024-04-25T15:58:04.215 INFO:tasks.workunit.client.0.smithi087.stdout:7/205: rmdir d1/d4/d18/d3e 0 2024-04-25T15:58:04.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/214: write d1/da/f3a [977408,89837] 0 2024-04-25T15:58:04.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/352: dwrite d7/d71/f61 [0,4194304] 0 2024-04-25T15:58:04.218 INFO:tasks.workunit.client.0.smithi087.stdout:4/195: mkdir d4/d7/d15/d12/d3f 0 2024-04-25T15:58:04.221 INFO:tasks.workunit.client.0.smithi087.stdout:8/266: rename d4/d1d/c29 to d4/d8/c58 0 2024-04-25T15:58:04.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/196: write d4/d7/d15/d12/f17 [210295,20264] 0 2024-04-25T15:58:04.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/300: dwrite d3/d2a/f1b [0,4194304] 0 2024-04-25T15:58:04.227 INFO:tasks.workunit.client.0.smithi087.stdout:4/197: dread - d4/f35 zero size 2024-04-25T15:58:04.230 INFO:tasks.workunit.client.0.smithi087.stdout:8/267: creat d4/d1d/f59 x:0 0 0 2024-04-25T15:58:04.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/291: rename d3/d12/c28 to d3/d12/d14/d29/d2f/d53/c5b 0 2024-04-25T15:58:04.233 INFO:tasks.workunit.client.0.smithi087.stdout:0/215: dwrite d1/d6/d21/f23 [0,4194304] 0 2024-04-25T15:58:04.237 INFO:tasks.workunit.client.0.smithi087.stdout:1/292: fdatasync d3/d12/d4d/f51 0 2024-04-25T15:58:04.237 INFO:tasks.workunit.client.0.smithi087.stdout:8/268: dread d4/d1d/d14/f31 [0,4194304] 0 2024-04-25T15:58:04.239 INFO:tasks.workunit.client.0.smithi087.stdout:6/353: link d7/d1a/d1d/d21/d37/l66 d7/d1a/d2a/l7d 0 2024-04-25T15:58:04.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/269: fsync d4/d8/dd/f11 0 2024-04-25T15:58:04.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/216: symlink d1/da/l46 0 2024-04-25T15:58:04.241 INFO:tasks.workunit.client.0.smithi087.stdout:7/206: rename d1/c32 to d1/d9/c41 0 2024-04-25T15:58:04.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/354: write d7/d1a/d1d/d21/d27/d2c/d35/d45/f6e [87106,28551] 0 2024-04-25T15:58:04.241 INFO:tasks.workunit.client.0.smithi087.stdout:8/270: unlink d4/d8/dd/d2f/c35 0 2024-04-25T15:58:04.244 INFO:tasks.workunit.client.0.smithi087.stdout:7/207: chown d1/d4/c11 797 1 2024-04-25T15:58:04.244 INFO:tasks.workunit.client.0.smithi087.stdout:1/293: mkdir d3/d12/d14/d29/d5c 0 2024-04-25T15:58:04.245 INFO:tasks.workunit.client.0.smithi087.stdout:6/355: write d7/d1a/d1d/d21/f5f [29990,73071] 0 2024-04-25T15:58:04.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/198: rename d4/d10/l23 to d4/d7/d15/d21/l40 0 2024-04-25T15:58:04.246 INFO:tasks.workunit.client.0.smithi087.stdout:8/271: mknod d4/d8/dd/d2f/c5a 0 2024-04-25T15:58:04.247 INFO:tasks.workunit.client.0.smithi087.stdout:8/272: fsync d4/d9/f3e 0 2024-04-25T15:58:04.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/273: fdatasync d4/d22/f44 0 2024-04-25T15:58:04.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/208: unlink d1/d9/l22 0 2024-04-25T15:58:04.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/217: dread d1/f32 [0,4194304] 0 2024-04-25T15:58:04.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/356: creat d7/d1a/d2a/f7e x:0 0 0 2024-04-25T15:58:04.251 INFO:tasks.workunit.client.0.smithi087.stdout:6/357: fsync d7/d71/f61 0 2024-04-25T15:58:04.251 INFO:tasks.workunit.client.0.smithi087.stdout:1/294: creat d3/d12/d14/d29/d2f/f5d x:0 0 0 2024-04-25T15:58:04.251 INFO:tasks.workunit.client.0.smithi087.stdout:0/218: read d1/d6/d21/f23 [986966,103182] 0 2024-04-25T15:58:04.253 INFO:tasks.workunit.client.0.smithi087.stdout:8/274: creat d4/d1d/f5b x:0 0 0 2024-04-25T15:58:04.254 INFO:tasks.workunit.client.0.smithi087.stdout:8/275: stat d4/d8 0 2024-04-25T15:58:04.255 INFO:tasks.workunit.client.0.smithi087.stdout:2/301: truncate d3/d2a/f1f 1238977 0 2024-04-25T15:58:04.256 INFO:tasks.workunit.client.0.smithi087.stdout:2/302: truncate d3/d20/d4a/d47/f52 907573 0 2024-04-25T15:58:04.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/295: chown d3/d12/d14/c1a 646434 1 2024-04-25T15:58:04.260 INFO:tasks.workunit.client.0.smithi087.stdout:4/199: creat d4/f41 x:0 0 0 2024-04-25T15:58:04.261 INFO:tasks.workunit.client.0.smithi087.stdout:7/209: mknod d1/c42 0 2024-04-25T15:58:04.263 INFO:tasks.workunit.client.0.smithi087.stdout:6/358: mknod d7/d1a/d1d/c7f 0 2024-04-25T15:58:04.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/296: unlink d3/d12/d14/f18 0 2024-04-25T15:58:04.266 INFO:tasks.workunit.client.0.smithi087.stdout:1/297: stat d3/d12/d14/f16 0 2024-04-25T15:58:04.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/298: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:04.269 INFO:tasks.workunit.client.0.smithi087.stdout:7/210: dwrite d1/d9/d26/f38 [0,4194304] 0 2024-04-25T15:58:04.272 INFO:tasks.workunit.client.0.smithi087.stdout:0/219: rename d1/d6/d21/d2a/f31 to d1/d6/f47 0 2024-04-25T15:58:04.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/359: mkdir d7/d1a/d1d/d80 0 2024-04-25T15:58:04.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/303: truncate d3/d2a/d1c/f4b 634059 0 2024-04-25T15:58:04.277 INFO:tasks.workunit.client.0.smithi087.stdout:1/299: rmdir d3 39 2024-04-25T15:58:04.278 INFO:tasks.workunit.client.0.smithi087.stdout:2/304: fsync d3/d27/d29/f2e 0 2024-04-25T15:58:04.278 INFO:tasks.workunit.client.0.smithi087.stdout:2/305: chown d3/d20/l37 304655762 1 2024-04-25T15:58:04.283 INFO:tasks.workunit.client.0.smithi087.stdout:7/211: chown d1/d4/c35 30023 1 2024-04-25T15:58:04.283 INFO:tasks.workunit.client.0.smithi087.stdout:7/212: stat d1/l21 0 2024-04-25T15:58:04.285 INFO:tasks.workunit.client.0.smithi087.stdout:6/360: dwrite d7/f8 [0,4194304] 0 2024-04-25T15:58:04.293 INFO:tasks.workunit.client.0.smithi087.stdout:8/276: rename d4/d1d/d3f/l42 to d4/l5c 0 2024-04-25T15:58:04.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/300: write d3/f8 [8233470,23597] 0 2024-04-25T15:58:04.295 INFO:tasks.workunit.client.0.smithi087.stdout:7/213: unlink d1/d1a/c1c 0 2024-04-25T15:58:04.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/200: getdents d4/d10 0 2024-04-25T15:58:04.297 INFO:tasks.workunit.client.0.smithi087.stdout:6/361: write d7/d1a/d1d/f60 [140890,45623] 0 2024-04-25T15:58:04.298 INFO:tasks.workunit.client.0.smithi087.stdout:0/220: mknod d1/d6/d21/d2a/c48 0 2024-04-25T15:58:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:7/214: write d1/d4/f40 [509644,71474] 0 2024-04-25T15:58:04.313 INFO:tasks.workunit.client.0.smithi087.stdout:2/306: truncate d3/d20/f46 61215 0 2024-04-25T15:58:04.315 INFO:tasks.workunit.client.0.smithi087.stdout:8/277: dwrite d4/d1d/d14/f2c [0,4194304] 0 2024-04-25T15:58:04.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/307: dread - d3/d27/f31 zero size 2024-04-25T15:58:04.317 INFO:tasks.workunit.client.0.smithi087.stdout:4/201: mkdir d4/d7/d15/d12/d3f/d42 0 2024-04-25T15:58:04.319 INFO:tasks.workunit.client.0.smithi087.stdout:2/308: stat d3/d20/d4a/d47/f52 0 2024-04-25T15:58:04.321 INFO:tasks.workunit.client.0.smithi087.stdout:6/362: dwrite d7/d1a/d1d/d21/d37/f3f [0,4194304] 0 2024-04-25T15:58:04.327 INFO:tasks.workunit.client.0.smithi087.stdout:2/309: symlink d3/d27/d29/d2d/l56 0 2024-04-25T15:58:04.329 INFO:tasks.workunit.client.0.smithi087.stdout:0/221: getdents d1/d6/d39/d34 0 2024-04-25T15:58:04.330 INFO:tasks.workunit.client.0.smithi087.stdout:4/202: dwrite d4/d27/f2f [0,4194304] 0 2024-04-25T15:58:04.332 INFO:tasks.workunit.client.0.smithi087.stdout:4/203: truncate d4/f41 46115 0 2024-04-25T15:58:04.335 INFO:tasks.workunit.client.0.smithi087.stdout:0/222: write d1/d6/f3b [4316897,12319] 0 2024-04-25T15:58:04.336 INFO:tasks.workunit.client.0.smithi087.stdout:1/301: write d3/d12/f1c [2174388,9014] 0 2024-04-25T15:58:04.338 INFO:tasks.workunit.client.0.smithi087.stdout:2/310: creat d3/d27/d29/d2d/f57 x:0 0 0 2024-04-25T15:58:04.344 INFO:tasks.workunit.client.0.smithi087.stdout:0/223: rename d1/d27/c44 to d1/d6/d1f/c49 0 2024-04-25T15:58:04.344 INFO:tasks.workunit.client.0.smithi087.stdout:0/224: dread - d1/f3c zero size 2024-04-25T15:58:04.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/302: dwrite d3/f8 [0,4194304] 0 2024-04-25T15:58:04.347 INFO:tasks.workunit.client.0.smithi087.stdout:0/225: write d1/d6/d39/f38 [845514,123041] 0 2024-04-25T15:58:04.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/311: mknod d3/d27/d29/d2d/c58 0 2024-04-25T15:58:04.352 INFO:tasks.workunit.client.0.smithi087.stdout:4/204: link d4/f6 d4/d7/f43 0 2024-04-25T15:58:04.355 INFO:tasks.workunit.client.0.smithi087.stdout:1/303: rename d3/d12/d14/d29/d2f/d53/f49 to d3/d12/d14/d29/d3b/f5e 0 2024-04-25T15:58:04.360 INFO:tasks.workunit.client.0.smithi087.stdout:3/273: sync 2024-04-25T15:58:04.360 INFO:tasks.workunit.client.0.smithi087.stdout:2/312: fdatasync d3/d27/f3e 0 2024-04-25T15:58:04.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/278: dwrite d4/d1d/d17/f2d [4194304,4194304] 0 2024-04-25T15:58:04.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/274: readlink d4/d14/d23/l43 0 2024-04-25T15:58:04.362 INFO:tasks.workunit.client.0.smithi087.stdout:3/275: fdatasync d4/d14/d23/f26 0 2024-04-25T15:58:04.366 INFO:tasks.workunit.client.0.smithi087.stdout:0/226: mkdir d1/d6/d39/d4a 0 2024-04-25T15:58:04.372 INFO:tasks.workunit.client.0.smithi087.stdout:7/215: dread d1/f23 [0,4194304] 0 2024-04-25T15:58:04.373 INFO:tasks.workunit.client.0.smithi087.stdout:6/363: truncate d7/d1a/d2a/f3c 5817804 0 2024-04-25T15:58:04.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1b570f640 1 Processor -- start 2024-04-25T15:58:04.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1b570f640 1 -- start start 2024-04-25T15:58:04.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1b570f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1b00cb030 0x7fa1b015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1b570f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b00c7570 con 0x7fa1b015ad90 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1b570f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b015b8b0 con 0x7fa1b0160230 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1b570f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b015b5d0 con 0x7fa1b00cb030 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1aeffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa1b015ad90 0x7fa1b00ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55358/0 (socket says 172.21.15.87:55358) 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1aeffd640 1 -- 172.21.15.87:0/3272849566 learned_addr learned my addr 172.21.15.87:0/3272849566 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 --2- 172.21.15.87:0/3272849566 >> v2:172.21.15.155:3300/0 conn(0x7fa1b00cb030 0x7fa1b015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795129760 0 0) 0x7fa1b00c7570 con 0x7fa1b015ad90 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa198003530 con 0x7fa1b015ad90 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3505317898 0 0) 0x7fa198003530 con 0x7fa1b015ad90 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 >> v2:172.21.15.155:3300/0 conn(0x7fa1b00cb030 msgr2=0x7fa1b015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 --2- 172.21.15.87:0/3272849566 >> v2:172.21.15.155:3300/0 conn(0x7fa1b00cb030 0x7fa1b015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 >> v1:172.21.15.155:6789/0 conn(0x7fa1b0160230 legacy=0x7fa1b0162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00c2290 con 0x7fa1b015ad90 2024-04-25T15:58:04.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fa1a0001680 con 0x7fa1b015ad90 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 >> v1:172.21.15.87:6789/0 conn(0x7fa1b015ad90 legacy=0x7fa1b00ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1980039c0 0x7fa198003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa198004810 0x7fa198004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198005360 0x7fa19800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b015b5d0 con 0x7fa198004810 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa19800c290 con 0x7fa198005360 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa19800c490 con 0x7fa1980039c0 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa198004810 0x7fa198004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1af7fe640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198005360 0x7fa19800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1aeffd640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1980039c0 0x7fa198003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.379 INFO:tasks.workunit.client.0.smithi087.stdout:3/276: mkdir d4/d14/d53 0 2024-04-25T15:58:04.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 -- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1980039c0 msgr2=0x7fa198003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:04.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1980039c0 0x7fa198003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 -- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198005360 msgr2=0x7fa19800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:04.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198005360 0x7fa19800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1af7fe640 1 -- 172.21.15.87:0/3272849566 reap_dead start 2024-04-25T15:58:04.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.371+0000 7fa1ae7fc640 1 -- 172.21.15.87:0/3272849566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa198003530 con 0x7fa198004810 2024-04-25T15:58:04.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/304: symlink d3/d12/d14/d29/d5c/l5f 0 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1ae7fc640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa198004810 0x7fa198004c20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ae0 tx=0x7fa1a401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e90721e8043912 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40096b0 con 0x7fa198004810 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a40a6450 con 0x7fa198004810 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1adffb640 1 -- 172.21.15.87:0/3272849566 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40a6840 con 0x7fa198004810 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 -- 172.21.15.87:0/3272849566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa198004810 msgr2=0x7fa198004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa198004810 0x7fa198004c20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ae0 tx=0x7fa1a401ca70 comp rx=0 tx=0).stop 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 -- 172.21.15.87:0/3272849566 shutdown_connections 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3272849566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa198004810 0x7fa198004c20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 -- 172.21.15.87:0/3272849566 >> 172.21.15.87:0/3272849566 conn(0x7fa1b00c9330 msgr2=0x7fa1b00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 -- 172.21.15.87:0/3272849566 shutdown_connections 2024-04-25T15:58:04.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.375+0000 7fa1b570f640 1 -- 172.21.15.87:0/3272849566 wait complete. 2024-04-25T15:58:04.383 INFO:tasks.workunit.client.0.smithi087.stdout:2/313: fdatasync d3/f1e 0 2024-04-25T15:58:04.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 Processor -- start 2024-04-25T15:58:04.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 -- start start 2024-04-25T15:58:04.384 INFO:tasks.workunit.client.0.smithi087.stdout:7/216: write d1/d1a/f20 [1454838,79028] 0 2024-04-25T15:58:04.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa198004810 0x7fa1b01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b00b1950 0x7fa1b015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b014ace0 0x7fa1b014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00ca2e0 con 0x7fa1b014ace0 2024-04-25T15:58:04.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00ca160 con 0x7fa1b00b1950 2024-04-25T15:58:04.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00cad30 con 0x7fa198004810 2024-04-25T15:58:04.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/217: dread - d1/d4/d18/d36/f3a zero size 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa198004810 0x7fa1b01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b014ace0 0x7fa1b014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1aeffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa198004810 0x7fa1b01569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:57404/0 (socket says 172.21.15.87:57404) 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1aeffd640 1 -- 172.21.15.87:0/3176611139 learned_addr learned my addr 172.21.15.87:0/3176611139 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1ae7fc640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b00b1950 0x7fa1b015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 -- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa198004810 msgr2=0x7fa1b01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa198004810 0x7fa1b01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 -- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b00b1950 msgr2=0x7fa1b015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b00b1950 0x7fa1b015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 -- 172.21.15.87:0/3176611139 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b014b780 con 0x7fa1b014ace0 2024-04-25T15:58:04.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1af7fe640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b014ace0 0x7fa1b014b0f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00c72e0 tx=0x7fa1a800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:04.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8019070 con 0x7fa1b014ace0 2024-04-25T15:58:04.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b00af5b0 con 0x7fa1b014ace0 2024-04-25T15:58:04.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a8006b60 con 0x7fa1b014ace0 2024-04-25T15:58:04.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8003980 con 0x7fa1b014ace0 2024-04-25T15:58:04.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.379+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b0154530 con 0x7fa1b014ace0 2024-04-25T15:58:04.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.383+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b006acd0 con 0x7fa1b014ace0 2024-04-25T15:58:04.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.383+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa1a801c070 con 0x7fa1b014ace0 2024-04-25T15:58:04.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.383+0000 7fa1977fe640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19c06f430 0x7fa19c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.383+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fa1a808ece0 con 0x7fa1b014ace0 2024-04-25T15:58:04.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.383+0000 7fa1aeffd640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19c06f430 0x7fa19c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.388 INFO:tasks.workunit.client.0.smithi087.stdout:3/277: write d4/f2c [2633274,124026] 0 2024-04-25T15:58:04.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.383+0000 7fa1aeffd640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19c06f430 0x7fa19c071940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0001ec0 tx=0x7fa1a0007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:04.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/305: creat d3/d12/d4d/f60 x:0 0 0 2024-04-25T15:58:04.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/205: write d4/f14 [700778,26411] 0 2024-04-25T15:58:04.392 INFO:tasks.workunit.client.0.smithi087.stdout:1/306: readlink d3/d12/d14/d29/l34 0 2024-04-25T15:58:04.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/364: dwrite d7/d1a/f51 [0,4194304] 0 2024-04-25T15:58:04.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/206: write d4/d7/f32 [263694,87087] 0 2024-04-25T15:58:04.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.391+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1a805b090 con 0x7fa1b014ace0 2024-04-25T15:58:04.396 INFO:tasks.workunit.client.0.smithi087.stdout:7/218: read d1/f8 [412038,20082] 0 2024-04-25T15:58:04.398 INFO:tasks.workunit.client.0.smithi087.stdout:6/365: truncate d7/d1a/d7b/f77 793488 0 2024-04-25T15:58:04.398 INFO:tasks.workunit.client.0.smithi087.stdout:7/219: write d1/d1a/f20 [2253320,110522] 0 2024-04-25T15:58:04.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/227: write d1/f14 [1218667,101552] 0 2024-04-25T15:58:04.399 INFO:tasks.workunit.client.0.smithi087.stdout:1/307: mkdir d3/d12/d14/d29/d2f/d61 0 2024-04-25T15:58:04.400 INFO:tasks.workunit.client.0.smithi087.stdout:1/308: chown d3/d12/d14/f31 1008658 1 2024-04-25T15:58:04.401 INFO:tasks.workunit.client.0.smithi087.stdout:1/309: write d3/d2d/f38 [584338,8665] 0 2024-04-25T15:58:04.407 INFO:tasks.workunit.client.0.smithi087.stdout:7/220: write d1/f23 [3630467,40461] 0 2024-04-25T15:58:04.407 INFO:tasks.workunit.client.0.smithi087.stdout:0/228: creat d1/d6/d39/d34/f4b x:0 0 0 2024-04-25T15:58:04.408 INFO:tasks.workunit.client.0.smithi087.stdout:3/278: dread d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:04.412 INFO:tasks.workunit.client.0.smithi087.stdout:1/310: dread d3/d2d/f38 [0,4194304] 0 2024-04-25T15:58:04.412 INFO:tasks.workunit.client.0.smithi087.stdout:2/314: truncate d3/f7 1054859 0 2024-04-25T15:58:04.414 INFO:tasks.workunit.client.0.smithi087.stdout:1/311: chown d3/d12/l13 6819070 1 2024-04-25T15:58:04.414 INFO:tasks.workunit.client.0.smithi087.stdout:6/366: dwrite d7/d1a/d2a/f69 [0,4194304] 0 2024-04-25T15:58:04.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/367: write d7/f40 [2928131,112834] 0 2024-04-25T15:58:04.415 INFO:tasks.workunit.client.0.smithi087.stdout:3/279: symlink d4/d17/d24/d3f/l54 0 2024-04-25T15:58:04.416 INFO:tasks.workunit.client.0.smithi087.stdout:6/368: stat d7/d1a/d2a/l3b 0 2024-04-25T15:58:04.416 INFO:tasks.workunit.client.0.smithi087.stdout:3/280: readlink d4/d17/d27/l2e 0 2024-04-25T15:58:04.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/315: creat d3/d27/d29/d4f/f59 x:0 0 0 2024-04-25T15:58:04.423 INFO:tasks.workunit.client.0.smithi087.stdout:1/312: creat d3/d12/d14/d29/d3b/f62 x:0 0 0 2024-04-25T15:58:04.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/281: fsync d4/d17/d27/f44 0 2024-04-25T15:58:04.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/282: dread - d4/d17/d27/f44 zero size 2024-04-25T15:58:04.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/369: dread d7/d1a/d1d/d21/d27/d2c/f57 [0,4194304] 0 2024-04-25T15:58:04.425 INFO:tasks.workunit.client.0.smithi087.stdout:4/207: truncate d4/d7/f2c 3492517 0 2024-04-25T15:58:04.428 INFO:tasks.workunit.client.0.smithi087.stdout:1/313: dread d3/f9 [0,4194304] 0 2024-04-25T15:58:04.429 INFO:tasks.workunit.client.0.smithi087.stdout:0/229: rmdir d1/d6/d21/d2a/d41 0 2024-04-25T15:58:04.429 INFO:tasks.workunit.client.0.smithi087.stdout:4/208: truncate d4/d7/d15/d21/f28 128781 0 2024-04-25T15:58:04.430 INFO:tasks.workunit.client.0.smithi087.stdout:6/370: dread d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:04.431 INFO:tasks.workunit.client.0.smithi087.stdout:2/316: mkdir d3/d27/d29/d4f/d5a 0 2024-04-25T15:58:04.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/283: dread d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:04.434 INFO:tasks.workunit.client.0.smithi087.stdout:6/371: readlink d7/d1a/d41/l7a 0 2024-04-25T15:58:04.435 INFO:tasks.workunit.client.0.smithi087.stdout:3/284: readlink d4/l1f 0 2024-04-25T15:58:04.441 INFO:tasks.workunit.client.0.smithi087.stdout:0/230: dread d1/d6/d39/d34/f43 [0,4194304] 0 2024-04-25T15:58:04.442 INFO:tasks.workunit.client.0.smithi087.stdout:2/317: symlink d3/d20/d4a/l5b 0 2024-04-25T15:58:04.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/231: write d1/f3c [927761,105652] 0 2024-04-25T15:58:04.442 INFO:tasks.workunit.client.0.smithi087.stdout:6/372: symlink d7/d71/d59/l81 0 2024-04-25T15:58:04.442 INFO:tasks.workunit.client.0.smithi087.stdout:4/209: dwrite d4/d7/d15/d13/f30 [4194304,4194304] 0 2024-04-25T15:58:04.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/285: creat d4/d14/f55 x:0 0 0 2024-04-25T15:58:04.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/314: link d3/d12/f43 d3/d12/d14/d29/d2f/f63 0 2024-04-25T15:58:04.451 INFO:tasks.workunit.client.0.smithi087.stdout:4/210: symlink d4/d7/d15/d12/d3f/l44 0 2024-04-25T15:58:04.451 INFO:tasks.workunit.client.0.smithi087.stdout:4/211: dread - d4/f39 zero size 2024-04-25T15:58:04.452 INFO:tasks.workunit.client.0.smithi087.stdout:3/286: creat d4/d17/d24/f56 x:0 0 0 2024-04-25T15:58:04.452 INFO:tasks.workunit.client.0.smithi087.stdout:0/232: dwrite d1/f26 [0,4194304] 0 2024-04-25T15:58:04.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/315: mkdir d3/d12/d39/d64 0 2024-04-25T15:58:04.456 INFO:tasks.workunit.client.0.smithi087.stdout:2/318: mknod d3/d2a/c5c 0 2024-04-25T15:58:04.458 INFO:tasks.workunit.client.0.smithi087.stdout:3/287: symlink d4/d17/d24/l57 0 2024-04-25T15:58:04.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/316: fdatasync d3/f1b 0 2024-04-25T15:58:04.459 INFO:tasks.workunit.client.0.smithi087.stdout:6/373: rename d7/d1a/f3a to d7/d1a/d1d/d21/d27/f82 0 2024-04-25T15:58:04.460 INFO:tasks.workunit.client.0.smithi087.stdout:1/317: write d3/d12/d4d/f51 [367269,77607] 0 2024-04-25T15:58:04.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/288: rmdir d4/d14/d23 39 2024-04-25T15:58:04.462 INFO:tasks.workunit.client.0.smithi087.stdout:6/374: chown d7/d1a/d1d/d21/l42 1 1 2024-04-25T15:58:04.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/212: dwrite d4/d7/d15/d21/f37 [0,4194304] 0 2024-04-25T15:58:04.464 INFO:tasks.workunit.client.0.smithi087.stdout:3/289: truncate d4/d17/d24/f4e 392189 0 2024-04-25T15:58:04.464 INFO:tasks.workunit.client.0.smithi087.stdout:0/233: rename d1/d6/d39/d4a to d1/d6/d21/d4c 0 2024-04-25T15:58:04.464 INFO:tasks.workunit.client.0.smithi087.stdout:4/213: chown d4/d7/d15/d13 25538 1 2024-04-25T15:58:04.465 INFO:tasks.workunit.client.0.smithi087.stdout:3/290: read d4/d17/f2a [1383164,128683] 0 2024-04-25T15:58:04.466 INFO:tasks.workunit.client.0.smithi087.stdout:3/291: truncate d4/d14/f55 269900 0 2024-04-25T15:58:04.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/375: creat d7/d1a/d1d/d21/d27/d2c/d35/f83 x:0 0 0 2024-04-25T15:58:04.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/376: chown d7/f19 24178 1 2024-04-25T15:58:04.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/377: dread - d7/d1a/d1d/d21/d27/d2c/d35/f83 zero size 2024-04-25T15:58:04.476 INFO:tasks.workunit.client.0.smithi087.stdout:4/214: rename d4/c31 to d4/d7/d15/d21/c45 0 2024-04-25T15:58:04.477 INFO:tasks.workunit.client.0.smithi087.stdout:3/292: mkdir d4/d17/d24/d29/d58 0 2024-04-25T15:58:04.478 INFO:tasks.workunit.client.0.smithi087.stdout:4/215: dread d4/f41 [0,4194304] 0 2024-04-25T15:58:04.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/293: chown d4/d17/f1b 24 1 2024-04-25T15:58:04.484 INFO:tasks.workunit.client.0.smithi087.stdout:0/234: creat d1/d6/f4d x:0 0 0 2024-04-25T15:58:04.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/216: dwrite f0 [8388608,4194304] 0 2024-04-25T15:58:04.490 INFO:tasks.workunit.client.0.smithi087.stdout:6/378: creat d7/d1a/d1d/f84 x:0 0 0 2024-04-25T15:58:04.491 INFO:tasks.workunit.client.0.smithi087.stdout:4/217: write d4/fb [2401344,63093] 0 2024-04-25T15:58:04.491 INFO:tasks.workunit.client.0.smithi087.stdout:0/235: symlink d1/l4e 0 2024-04-25T15:58:04.493 INFO:tasks.workunit.client.0.smithi087.stdout:0/236: write d1/d6/f8 [988896,41457] 0 2024-04-25T15:58:04.495 INFO:tasks.workunit.client.0.smithi087.stdout:4/218: creat d4/d27/f46 x:0 0 0 2024-04-25T15:58:04.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/379: fdatasync d7/d1a/d1d/d21/d27/d2c/d35/f53 0 2024-04-25T15:58:04.499 INFO:tasks.workunit.client.0.smithi087.stdout:1/318: truncate d3/ff 3276887 0 2024-04-25T15:58:04.502 INFO:tasks.workunit.client.0.smithi087.stdout:0/237: mkdir d1/d4f 0 2024-04-25T15:58:04.503 INFO:tasks.workunit.client.0.smithi087.stdout:4/219: mknod d4/d7/d15/d12/d3f/d42/c47 0 2024-04-25T15:58:04.505 INFO:tasks.workunit.client.0.smithi087.stdout:0/238: truncate d1/da/f3a 1623092 0 2024-04-25T15:58:04.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/380: dwrite d7/d1a/f39 [0,4194304] 0 2024-04-25T15:58:04.505 INFO:tasks.workunit.client.0.smithi087.stdout:4/220: read d4/d7/d15/d13/f30 [344964,39990] 0 2024-04-25T15:58:04.506 INFO:tasks.workunit.client.0.smithi087.stdout:0/239: chown d1/d6/d39/f20 16241097 1 2024-04-25T15:58:04.506 INFO:tasks.workunit.client.0.smithi087.stdout:6/381: write d7/d1a/f51 [3660997,34336] 0 2024-04-25T15:58:04.507 INFO:tasks.workunit.client.0.smithi087.stdout:1/319: mkdir d3/d12/d14/d29/d65 0 2024-04-25T15:58:04.508 INFO:tasks.workunit.client.0.smithi087.stdout:1/320: write d3/f35 [155771,111985] 0 2024-04-25T15:58:04.514 INFO:tasks.workunit.client.0.smithi087.stdout:0/240: mkdir d1/d6/d21/d4c/d50 0 2024-04-25T15:58:04.517 INFO:tasks.workunit.client.0.smithi087.stdout:6/382: dread d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:04.522 INFO:tasks.workunit.client.0.smithi087.stdout:0/241: creat d1/d6/d21/f51 x:0 0 0 2024-04-25T15:58:04.524 INFO:tasks.workunit.client.0.smithi087.stdout:4/221: link d4/d7/d15/d12/d3f/l44 d4/d10/l48 0 2024-04-25T15:58:04.526 INFO:tasks.workunit.client.0.smithi087.stdout:0/242: creat d1/d6/d21/f52 x:0 0 0 2024-04-25T15:58:04.528 INFO:tasks.workunit.client.0.smithi087.stdout:5/346: sync 2024-04-25T15:58:04.528 INFO:tasks.workunit.client.0.smithi087.stdout:6/383: rename d7/d1a/d1d/d21/d37/l66 to d7/d1a/d1d/d80/l85 0 2024-04-25T15:58:04.529 INFO:tasks.workunit.client.0.smithi087.stdout:6/384: stat d7/d1a/d7b/f5a 0 2024-04-25T15:58:04.531 INFO:tasks.workunit.client.0.smithi087.stdout:4/222: creat d4/d7/d15/d12/f49 x:0 0 0 2024-04-25T15:58:04.534 INFO:tasks.workunit.client.0.smithi087.stdout:6/385: symlink d7/d1a/d7b/l86 0 2024-04-25T15:58:04.534 INFO:tasks.workunit.client.0.smithi087.stdout:0/243: symlink d1/d6/d21/d4c/d50/l53 0 2024-04-25T15:58:04.535 INFO:tasks.workunit.client.0.smithi087.stdout:4/223: symlink d4/d7/d15/l4a 0 2024-04-25T15:58:04.535 INFO:tasks.workunit.client.0.smithi087.stdout:0/244: stat d1/d4f 0 2024-04-25T15:58:04.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/386: fsync d7/d71/f24 0 2024-04-25T15:58:04.537 INFO:tasks.workunit.client.0.smithi087.stdout:5/347: dwrite d9/f1a [0,4194304] 0 2024-04-25T15:58:04.539 INFO:tasks.workunit.client.0.smithi087.stdout:5/348: chown d9/d3e/d5c/d63/f66 243584544 1 2024-04-25T15:58:04.539 INFO:tasks.workunit.client.0.smithi087.stdout:5/349: stat d9/d2f/d40/l4e 0 2024-04-25T15:58:04.540 INFO:tasks.workunit.client.0.smithi087.stdout:5/350: fsync d9/d3e/d5c/d63/f66 0 2024-04-25T15:58:04.550 INFO:tasks.workunit.client.0.smithi087.stdout:0/245: dread d1/d6/fe [0,4194304] 0 2024-04-25T15:58:04.550 INFO:tasks.workunit.client.0.smithi087.stdout:0/246: stat d1/d6/d39/f38 0 2024-04-25T15:58:04.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/247: chown d1/d6/d39/d34/f43 97 1 2024-04-25T15:58:04.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/248: fsync d1/f3c 0 2024-04-25T15:58:04.552 INFO:tasks.workunit.client.0.smithi087.stdout:6/387: symlink d7/d71/l87 0 2024-04-25T15:58:04.552 INFO:tasks.workunit.client.0.smithi087.stdout:5/351: mknod d9/d2f/d3b/c69 0 2024-04-25T15:58:04.554 INFO:tasks.workunit.client.0.smithi087.stdout:0/249: rmdir d1/d6/d1f 39 2024-04-25T15:58:04.555 INFO:tasks.workunit.client.0.smithi087.stdout:0/250: chown d1/d6/d21/d4c 889896 1 2024-04-25T15:58:04.555 INFO:tasks.workunit.client.0.smithi087.stdout:6/388: dread d7/d1a/d1d/f60 [0,4194304] 0 2024-04-25T15:58:04.556 INFO:tasks.workunit.client.0.smithi087.stdout:1/321: dread d3/ff [0,4194304] 0 2024-04-25T15:58:04.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/251: rename d1/d6/d39 to d1/da/d3e/d54 0 2024-04-25T15:58:04.564 INFO:tasks.workunit.client.0.smithi087.stdout:4/224: dread d4/d7/d15/d12/f1f [4194304,4194304] 0 2024-04-25T15:58:04.566 INFO:tasks.workunit.client.0.smithi087.stdout:1/322: symlink d3/d12/d14/d29/d65/l66 0 2024-04-25T15:58:04.567 INFO:tasks.workunit.client.0.smithi087.stdout:0/252: mkdir d1/da/d3e/d54/d34/d55 0 2024-04-25T15:58:04.568 INFO:tasks.workunit.client.0.smithi087.stdout:5/352: write f3 [802201,130005] 0 2024-04-25T15:58:04.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/353: chown d9/fa 52665 1 2024-04-25T15:58:04.570 INFO:tasks.workunit.client.0.smithi087.stdout:0/253: chown d1/da/cb 727226 1 2024-04-25T15:58:04.570 INFO:tasks.workunit.client.0.smithi087.stdout:4/225: dread d4/fb [0,4194304] 0 2024-04-25T15:58:04.572 INFO:tasks.workunit.client.0.smithi087.stdout:5/354: mknod d9/d3e/d5c/c6a 0 2024-04-25T15:58:04.574 INFO:tasks.workunit.client.0.smithi087.stdout:4/226: creat d4/d27/f4b x:0 0 0 2024-04-25T15:58:04.576 INFO:tasks.workunit.client.0.smithi087.stdout:6/389: dwrite d7/f18 [0,4194304] 0 2024-04-25T15:58:04.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/254: creat d1/d6/f56 x:0 0 0 2024-04-25T15:58:04.581 INFO:tasks.workunit.client.0.smithi087.stdout:6/390: read d7/f19 [20412,87251] 0 2024-04-25T15:58:04.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/227: dread d4/d7/d15/fe [0,4194304] 0 2024-04-25T15:58:04.583 INFO:tasks.workunit.client.0.smithi087.stdout:5/355: dwrite d9/d3e/d5c/d5f/f53 [0,4194304] 0 2024-04-25T15:58:04.583 INFO:tasks.workunit.client.0.smithi087.stdout:6/391: write d7/d1a/d7b/f5a [1010752,65614] 0 2024-04-25T15:58:04.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/228: chown d4/d7/d15/d12/l19 27703 1 2024-04-25T15:58:04.585 INFO:tasks.workunit.client.0.smithi087.stdout:0/255: symlink d1/d6/d21/d4c/d50/l57 0 2024-04-25T15:58:04.590 INFO:tasks.workunit.client.0.smithi087.stdout:6/392: rename d7/d1a/d1d/d21/d37/l78 to d7/d71/l88 0 2024-04-25T15:58:04.593 INFO:tasks.workunit.client.0.smithi087.stdout:5/356: rename d9/d2f/d40/d4d/d58/c60 to d9/d3e/d5c/d5f/c6b 0 2024-04-25T15:58:04.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/323: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:04.594 INFO:tasks.workunit.client.0.smithi087.stdout:4/229: dwrite d4/d27/f2f [0,4194304] 0 2024-04-25T15:58:04.599 INFO:tasks.workunit.client.0.smithi087.stdout:5/357: symlink d9/d2c/d38/l6c 0 2024-04-25T15:58:04.599 INFO:tasks.workunit.client.0.smithi087.stdout:5/358: chown d9/d2f/c42 26878737 1 2024-04-25T15:58:04.600 INFO:tasks.workunit.client.0.smithi087.stdout:4/230: creat d4/d7/d26/f4c x:0 0 0 2024-04-25T15:58:04.601 INFO:tasks.workunit.client.0.smithi087.stdout:1/324: mkdir d3/d12/d14/d29/d67 0 2024-04-25T15:58:04.602 INFO:tasks.workunit.client.0.smithi087.stdout:1/325: chown d3/d12/d14/d33/c4c 22578 1 2024-04-25T15:58:04.603 INFO:tasks.workunit.client.0.smithi087.stdout:5/359: symlink d9/d2f/d40/d4d/l6d 0 2024-04-25T15:58:04.604 INFO:tasks.workunit.client.0.smithi087.stdout:1/326: write d3/d12/f1c [1576064,78813] 0 2024-04-25T15:58:04.604 INFO:tasks.workunit.client.0.smithi087.stdout:6/393: getdents d7/d1a/d1d/d80 0 2024-04-25T15:58:04.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/394: chown d7/d71/d59/l72 494 1 2024-04-25T15:58:04.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/395: readlink d7/l15 0 2024-04-25T15:58:04.607 INFO:tasks.workunit.client.0.smithi087.stdout:4/231: dread d4/d7/f43 [0,4194304] 0 2024-04-25T15:58:04.609 INFO:tasks.workunit.client.0.smithi087.stdout:4/232: chown d4/d7/d15/d21/d3a 454699 1 2024-04-25T15:58:04.611 INFO:tasks.workunit.client.0.smithi087.stdout:6/396: rmdir d7/d71 39 2024-04-25T15:58:04.613 INFO:tasks.workunit.client.0.smithi087.stdout:4/233: fsync d4/f41 0 2024-04-25T15:58:04.613 INFO:tasks.workunit.client.0.smithi087.stdout:5/360: dwrite d9/d3e/d5c/d63/f66 [0,4194304] 0 2024-04-25T15:58:04.615 INFO:tasks.workunit.client.0.smithi087.stdout:1/327: rename d3/d12/d14/f37 to d3/d12/d14/d29/d3b/f68 0 2024-04-25T15:58:04.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/234: chown d4/d7/d15/d12/d3f/l44 4203 1 2024-04-25T15:58:04.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/235: chown d4/d7 29624123 1 2024-04-25T15:58:04.624 INFO:tasks.workunit.client.0.smithi087.stdout:4/236: dwrite d4/d27/f4b [0,4194304] 0 2024-04-25T15:58:04.627 INFO:tasks.workunit.client.0.smithi087.stdout:5/361: creat d9/d3e/d5c/f6e x:0 0 0 2024-04-25T15:58:04.633 INFO:tasks.workunit.client.0.smithi087.stdout:4/237: creat d4/d7/d15/d21/d3a/f4d x:0 0 0 2024-04-25T15:58:04.636 INFO:tasks.workunit.client.0.smithi087.stdout:6/397: creat d7/d1a/d1d/f89 x:0 0 0 2024-04-25T15:58:04.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/362: creat d9/d2c/d30/d55/f6f x:0 0 0 2024-04-25T15:58:04.641 INFO:tasks.workunit.client.0.smithi087.stdout:6/398: mkdir d7/d1a/d1d/d8a 0 2024-04-25T15:58:04.648 INFO:tasks.workunit.client.0.smithi087.stdout:6/399: dwrite d7/d1a/d1d/d21/d27/f82 [4194304,4194304] 0 2024-04-25T15:58:04.660 INFO:tasks.workunit.client.0.smithi087.stdout:6/400: rename d7/d1a/d1d/d21/l42 to d7/l8b 0 2024-04-25T15:58:04.661 INFO:tasks.workunit.client.0.smithi087.stdout:4/238: dwrite d4/f41 [0,4194304] 0 2024-04-25T15:58:04.662 INFO:tasks.workunit.client.0.smithi087.stdout:4/239: chown f0 0 1 2024-04-25T15:58:04.662 INFO:tasks.workunit.client.0.smithi087.stdout:5/363: dwrite d9/d2f/d3b/f4c [0,4194304] 0 2024-04-25T15:58:04.665 INFO:tasks.workunit.client.0.smithi087.stdout:6/401: truncate f5 937197 0 2024-04-25T15:58:04.666 INFO:tasks.workunit.client.0.smithi087.stdout:6/402: readlink d7/d1a/d7b/l86 0 2024-04-25T15:58:04.668 INFO:tasks.workunit.client.0.smithi087.stdout:5/364: mkdir d9/d2c/d30/d70 0 2024-04-25T15:58:04.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.663+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1b0069bb0 con 0x7fa1b014ace0 2024-04-25T15:58:04.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.663+0000 7fa1977fe640 1 -- 172.21.15.87:0/3176611139 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+4837 (secure 0 0 0) 0x7fa1a805f390 con 0x7fa1b014ace0 2024-04-25T15:58:04.669 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:04.669 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:04.272250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:58:04.669 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-04-25T15:58:04.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/240: rename d4/f39 to d4/f4e 0 2024-04-25T15:58:04.672 INFO:tasks.workunit.client.0.smithi087.stdout:4/241: chown d4/d7/d15/d21/f2d 66058161 1 2024-04-25T15:58:04.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19c06f430 msgr2=0x7fa19c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19c06f430 0x7fa19c071940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0001ec0 tx=0x7fa1a0007040 comp rx=0 tx=0).stop 2024-04-25T15:58:04.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b014ace0 msgr2=0x7fa1b014b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b014ace0 0x7fa1b014b0f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00c72e0 tx=0x7fa1a800ec10 comp rx=0 tx=0).stop 2024-04-25T15:58:04.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 shutdown_connections 2024-04-25T15:58:04.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa19c06f430 0x7fa19c071940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.673 INFO:tasks.workunit.client.0.smithi087.stdout:6/403: creat d7/d71/d59/f8c x:0 0 0 2024-04-25T15:58:04.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1b014ace0 0x7fa1b014b0f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1b00b1950 0x7fa1b015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 --2- 172.21.15.87:0/3176611139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa198004810 0x7fa1b01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 >> 172.21.15.87:0/3176611139 conn(0x7fa1b00c9330 msgr2=0x7fa1b00c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:04.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 shutdown_connections 2024-04-25T15:58:04.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.667+0000 7fa1b570f640 1 -- 172.21.15.87:0/3176611139 wait complete. 2024-04-25T15:58:04.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/404: fsync d7/d1a/f39 0 2024-04-25T15:58:04.674 INFO:tasks.workunit.client.0.smithi087.stdout:9/240: sync 2024-04-25T15:58:04.675 INFO:tasks.workunit.client.0.smithi087.stdout:4/242: mknod d4/d7/d15/d21/c4f 0 2024-04-25T15:58:04.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/365: read d9/f1f [4112858,83797] 0 2024-04-25T15:58:04.678 INFO:tasks.workunit.client.0.smithi087.stdout:6/405: rename d7/d1a/d1d/d80 to d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d 0 2024-04-25T15:58:04.680 INFO:tasks.workunit.client.0.smithi087.stdout:6/406: fsync d7/d1a/d1d/d21/d27/f73 0 2024-04-25T15:58:04.682 INFO:tasks.workunit.client.0.smithi087.stdout:9/241: dwrite d6/d8/f2e [0,4194304] 0 2024-04-25T15:58:04.683 INFO:tasks.workunit.client.0.smithi087.stdout:5/366: creat d9/d2c/d30/d70/f71 x:0 0 0 2024-04-25T15:58:04.683 INFO:tasks.workunit.client.0.smithi087.stdout:9/242: chown f2 1 1 2024-04-25T15:58:04.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/407: creat d7/d71/d76/f8e x:0 0 0 2024-04-25T15:58:04.685 INFO:tasks.workunit.client.0.smithi087.stdout:9/243: rmdir d6/d8/d14 39 2024-04-25T15:58:04.686 INFO:tasks.workunit.client.0.smithi087.stdout:9/244: write d6/d8/d32/f41 [247793,11390] 0 2024-04-25T15:58:04.688 INFO:tasks.workunit.client.0.smithi087.stdout:5/367: rename d9/d2c/d30/d55/f6f to d9/d2f/d40/f72 0 2024-04-25T15:58:04.688 INFO:tasks.workunit.client.0.smithi087.stdout:9/245: chown d6/d8/d32/f41 3823552 1 2024-04-25T15:58:04.691 INFO:tasks.workunit.client.0.smithi087.stdout:6/408: rename d7/d71/c79 to d7/d71/d59/c8f 0 2024-04-25T15:58:04.694 INFO:tasks.workunit.client.0.smithi087.stdout:4/243: write d4/d7/d15/fe [85767,63438] 0 2024-04-25T15:58:04.697 INFO:tasks.workunit.client.0.smithi087.stdout:9/246: dwrite d6/d8/f2e [0,4194304] 0 2024-04-25T15:58:04.699 INFO:tasks.workunit.client.0.smithi087.stdout:6/409: chown d7/ce 20 1 2024-04-25T15:58:04.701 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-04-25T15:58:04.701 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T15:58:04.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:04.702 INFO:tasks.workunit.client.0.smithi087.stdout:4/244: write d4/d7/d15/d12/f1f [4997337,124659] 0 2024-04-25T15:58:04.702 INFO:tasks.workunit.client.0.smithi087.stdout:4/245: readlink d4/l2e 0 2024-04-25T15:58:04.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/246: write d4/d7/d15/d13/f30 [3544079,109226] 0 2024-04-25T15:58:04.708 INFO:tasks.workunit.client.0.smithi087.stdout:5/368: dwrite d9/d3e/d5c/d5f/d44/f50 [0,4194304] 0 2024-04-25T15:58:04.712 INFO:tasks.workunit.client.0.smithi087.stdout:4/247: mknod d4/c50 0 2024-04-25T15:58:04.714 INFO:tasks.workunit.client.0.smithi087.stdout:6/410: dwrite d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:04.716 INFO:tasks.workunit.client.0.smithi087.stdout:6/411: truncate d7/d71/d76/f8e 438331 0 2024-04-25T15:58:04.716 INFO:tasks.workunit.client.0.smithi087.stdout:6/412: chown d7/f19 131208613 1 2024-04-25T15:58:04.717 INFO:tasks.workunit.client.0.smithi087.stdout:6/413: dread - d7/d1a/d1d/d21/d27/d2c/f5d zero size 2024-04-25T15:58:04.718 INFO:tasks.workunit.client.0.smithi087.stdout:4/248: creat d4/d10/f51 x:0 0 0 2024-04-25T15:58:04.720 INFO:tasks.workunit.client.0.smithi087.stdout:4/249: mkdir d4/d27/d52 0 2024-04-25T15:58:04.721 INFO:tasks.workunit.client.0.smithi087.stdout:4/250: write d4/d7/f32 [1230891,121579] 0 2024-04-25T15:58:04.722 INFO:tasks.workunit.client.0.smithi087.stdout:4/251: fsync d4/d7/d15/d12/f2a 0 2024-04-25T15:58:04.723 INFO:tasks.workunit.client.0.smithi087.stdout:4/252: write d4/d7/f11 [822876,8239] 0 2024-04-25T15:58:04.725 INFO:tasks.workunit.client.0.smithi087.stdout:9/247: dread d6/d8/f17 [0,4194304] 0 2024-04-25T15:58:04.729 INFO:tasks.workunit.client.0.smithi087.stdout:9/248: dread d6/d8/d14/d1d/f23 [0,4194304] 0 2024-04-25T15:58:04.731 INFO:tasks.workunit.client.0.smithi087.stdout:4/253: dwrite d4/d7/d15/d21/d3a/f3e [0,4194304] 0 2024-04-25T15:58:04.732 INFO:tasks.workunit.client.0.smithi087.stdout:9/249: mkdir d6/d45 0 2024-04-25T15:58:04.733 INFO:tasks.workunit.client.0.smithi087.stdout:9/250: write d6/d8/d29/f3f [636110,59438] 0 2024-04-25T15:58:04.740 INFO:tasks.workunit.client.0.smithi087.stdout:9/251: symlink d6/d8/d32/l46 0 2024-04-25T15:58:04.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/254: mknod d4/d27/d52/c53 0 2024-04-25T15:58:04.742 INFO:tasks.workunit.client.0.smithi087.stdout:4/255: chown d4/d10/l48 49190 1 2024-04-25T15:58:04.742 INFO:tasks.workunit.client.0.smithi087.stdout:4/256: stat d4/f16 0 2024-04-25T15:58:04.743 INFO:tasks.workunit.client.0.smithi087.stdout:9/252: rmdir d6/d8/d29 39 2024-04-25T15:58:04.744 INFO:tasks.workunit.client.0.smithi087.stdout:5/369: truncate d9/d3e/d5c/d5f/f53 960969 0 2024-04-25T15:58:04.745 INFO:tasks.workunit.client.0.smithi087.stdout:9/253: write d6/d8/d12/f43 [655230,108055] 0 2024-04-25T15:58:04.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/257: rename d4/d7/d26/f38 to d4/d7/d15/d21/f54 0 2024-04-25T15:58:04.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/370: rename d9/f28 to d9/d3e/d5c/d5f/d44/d46/f73 0 2024-04-25T15:58:04.751 INFO:tasks.workunit.client.0.smithi087.stdout:4/258: creat d4/d7/d26/f55 x:0 0 0 2024-04-25T15:58:04.751 INFO:tasks.workunit.client.0.smithi087.stdout:5/371: mkdir d9/d3e/d74 0 2024-04-25T15:58:04.752 INFO:tasks.workunit.client.0.smithi087.stdout:4/259: rmdir d4/d7/d15/d13 39 2024-04-25T15:58:04.752 INFO:tasks.workunit.client.0.smithi087.stdout:4/260: read - d4/d10/f2b zero size 2024-04-25T15:58:04.753 INFO:tasks.workunit.client.0.smithi087.stdout:5/372: symlink d9/d2c/l75 0 2024-04-25T15:58:04.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/261: truncate d4/d7/d15/fe 1746407 0 2024-04-25T15:58:04.757 INFO:tasks.workunit.client.0.smithi087.stdout:5/373: link d9/d3e/f54 d9/d2f/f76 0 2024-04-25T15:58:04.761 INFO:tasks.workunit.client.0.smithi087.stdout:4/262: dwrite d4/f16 [0,4194304] 0 2024-04-25T15:58:04.762 INFO:tasks.workunit.client.0.smithi087.stdout:9/254: dread d6/d8/fc [0,4194304] 0 2024-04-25T15:58:04.764 INFO:tasks.workunit.client.0.smithi087.stdout:5/374: link d9/c17 d9/d3e/d5c/c77 0 2024-04-25T15:58:04.765 INFO:tasks.workunit.client.0.smithi087.stdout:9/255: readlink d6/d8/d12/l25 0 2024-04-25T15:58:04.766 INFO:tasks.workunit.client.0.smithi087.stdout:4/263: rename d4/d7/d26 to d4/d27/d56 0 2024-04-25T15:58:04.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/256: chown d6/d8/d29/l38 62909 1 2024-04-25T15:58:04.769 INFO:tasks.workunit.client.0.smithi087.stdout:5/375: truncate d9/f26 1537389 0 2024-04-25T15:58:04.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/264: rename d4/d7/d15/d12/f49 to d4/d27/d52/f57 0 2024-04-25T15:58:04.771 INFO:tasks.workunit.client.0.smithi087.stdout:9/257: rmdir d6/d8/d14/d1d 39 2024-04-25T15:58:04.771 INFO:tasks.workunit.client.0.smithi087.stdout:5/376: creat d9/d2c/d30/d56/f78 x:0 0 0 2024-04-25T15:58:04.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/258: dread f2 [0,4194304] 0 2024-04-25T15:58:04.773 INFO:tasks.workunit.client.0.smithi087.stdout:5/377: mkdir d9/d2c/d30/d70/d79 0 2024-04-25T15:58:04.777 INFO:tasks.workunit.client.0.smithi087.stdout:9/259: dread d6/d8/fc [0,4194304] 0 2024-04-25T15:58:04.778 INFO:tasks.workunit.client.0.smithi087.stdout:4/265: dwrite d4/d7/f32 [0,4194304] 0 2024-04-25T15:58:04.781 INFO:tasks.workunit.client.0.smithi087.stdout:5/378: chown d9/d3e/d5c/d5f/f53 992237728 1 2024-04-25T15:58:04.782 INFO:tasks.workunit.client.0.smithi087.stdout:5/379: read d9/f21 [241028,84097] 0 2024-04-25T15:58:04.783 INFO:tasks.workunit.client.0.smithi087.stdout:4/266: mkdir d4/d7/d15/d12/d3f/d58 0 2024-04-25T15:58:04.785 INFO:tasks.workunit.client.0.smithi087.stdout:4/267: chown d4/d7/d15/d13/c22 700048107 1 2024-04-25T15:58:04.786 INFO:tasks.workunit.client.0.smithi087.stdout:5/380: mkdir d9/d2f/d40/d4d/d7a 0 2024-04-25T15:58:04.787 INFO:tasks.workunit.client.0.smithi087.stdout:5/381: fdatasync d9/d3e/d5c/f6e 0 2024-04-25T15:58:04.787 INFO:tasks.workunit.client.0.smithi087.stdout:4/268: symlink d4/d7/d15/d12/d3f/d42/l59 0 2024-04-25T15:58:04.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/260: dwrite d6/f1c [4194304,4194304] 0 2024-04-25T15:58:04.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/261: chown d6/d3e 2951 1 2024-04-25T15:58:04.789 INFO:tasks.workunit.client.0.smithi087.stdout:5/382: write d9/d3e/d5c/f5e [946251,52343] 0 2024-04-25T15:58:04.793 INFO:tasks.workunit.client.0.smithi087.stdout:5/383: rename d9/d3e to d9/d2f/d40/d4d/d7b 0 2024-04-25T15:58:04.795 INFO:tasks.workunit.client.0.smithi087.stdout:5/384: mknod d9/d2f/d40/d4d/c7c 0 2024-04-25T15:58:04.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/262: unlink d6/d8/d14/d1d/c34 0 2024-04-25T15:58:04.797 INFO:tasks.workunit.client.0.smithi087.stdout:5/385: chown d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d46 2953 1 2024-04-25T15:58:04.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/386: unlink d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f47 0 2024-04-25T15:58:04.801 INFO:tasks.workunit.client.0.smithi087.stdout:5/387: write d9/d2f/d40/d4d/d7b/d5c/f5e [219152,114513] 0 2024-04-25T15:58:04.803 INFO:tasks.workunit.client.0.smithi087.stdout:4/269: dwrite d4/d7/f43 [0,4194304] 0 2024-04-25T15:58:04.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/263: fdatasync d6/f1c 0 2024-04-25T15:58:04.805 INFO:tasks.workunit.client.0.smithi087.stdout:4/270: fdatasync d4/d7/d15/d12/f2a 0 2024-04-25T15:58:04.809 INFO:tasks.workunit.client.0.smithi087.stdout:5/388: rename d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d46 to d9/d2c/d30/d70/d79/d7d 0 2024-04-25T15:58:04.809 INFO:tasks.workunit.client.0.smithi087.stdout:4/271: rmdir d4 39 2024-04-25T15:58:04.811 INFO:tasks.workunit.client.0.smithi087.stdout:4/272: chown d4/d7/d15/d12/d3f/d42/c47 2843755 1 2024-04-25T15:58:04.811 INFO:tasks.workunit.client.0.smithi087.stdout:9/264: dwrite d6/d8/d12/f43 [0,4194304] 0 2024-04-25T15:58:04.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/265: chown d6/d8/d12 413 1 2024-04-25T15:58:04.816 INFO:tasks.workunit.client.0.smithi087.stdout:9/266: rename d6/d8/d14/d1d/f23 to d6/d8/d29/d3a/f47 0 2024-04-25T15:58:04.817 INFO:tasks.workunit.client.0.smithi087.stdout:4/273: link d4/d7/d15/d12/f2a d4/d7/d15/d12/d3f/d58/f5a 0 2024-04-25T15:58:04.825 INFO:tasks.workunit.client.0.smithi087.stdout:9/267: dwrite d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:04.826 INFO:tasks.workunit.client.0.smithi087.stdout:4/274: dwrite d4/d7/d15/fe [0,4194304] 0 2024-04-25T15:58:04.827 INFO:tasks.workunit.client.0.smithi087.stdout:9/268: fdatasync d6/d8/f17 0 2024-04-25T15:58:04.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/269: mkdir d6/d8/d48 0 2024-04-25T15:58:04.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/275: dwrite d4/d27/d56/f55 [0,4194304] 0 2024-04-25T15:58:04.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/276: dread d4/f41 [0,4194304] 0 2024-04-25T15:58:04.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/277: stat d4/d7/f11 0 2024-04-25T15:58:04.844 INFO:tasks.workunit.client.0.smithi087.stdout:4/278: chown d4/l2e 364797 1 2024-04-25T15:58:04.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/279: dwrite d4/d10/f51 [0,4194304] 0 2024-04-25T15:58:04.852 INFO:tasks.workunit.client.0.smithi087.stdout:4/280: chown d4/d27/f4b 19 1 2024-04-25T15:58:04.857 INFO:tasks.workunit.client.0.smithi087.stdout:4/281: creat d4/f5b x:0 0 0 2024-04-25T15:58:04.860 INFO:tasks.workunit.client.0.smithi087.stdout:4/282: rename d4/d7/d15/d21 to d4/d27/d5c 0 2024-04-25T15:58:04.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/283: creat d4/d7/f5d x:0 0 0 2024-04-25T15:58:04.863 INFO:tasks.workunit.client.0.smithi087.stdout:4/284: dread - d4/d7/f5d zero size 2024-04-25T15:58:04.868 INFO:tasks.workunit.client.0.smithi087.stdout:4/285: dwrite d4/d27/f2f [0,4194304] 0 2024-04-25T15:58:04.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/286: chown d4/d27/d5c/c45 23043746 1 2024-04-25T15:58:04.880 INFO:tasks.workunit.client.0.smithi087.stdout:4/287: dwrite d4/d7/d15/fe [0,4194304] 0 2024-04-25T15:58:04.887 INFO:tasks.workunit.client.0.smithi087.stdout:4/288: dread d4/fb [0,4194304] 0 2024-04-25T15:58:04.895 INFO:tasks.workunit.client.0.smithi087.stdout:4/289: dwrite d4/f4e [0,4194304] 0 2024-04-25T15:58:04.899 INFO:tasks.workunit.client.0.smithi087.stdout:4/290: mkdir d4/d7/d15/d12/d3f/d58/d5e 0 2024-04-25T15:58:04.901 INFO:tasks.workunit.client.0.smithi087.stdout:4/291: symlink d4/d7/d15/d13/l5f 0 2024-04-25T15:58:04.902 INFO:tasks.workunit.client.0.smithi087.stdout:4/292: chown f0 1 1 2024-04-25T15:58:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.875+0000 7fbeb6e1a640 1 Processor -- start 2024-04-25T15:58:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.875+0000 7fbeb6e1a640 1 -- start start 2024-04-25T15:58:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb6e1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 0x7fbeb0074d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb6e1a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbeb0167cf0 0x7fbeb006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb6e1a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb0164ab0 con 0x7fbeb0070420 2024-04-25T15:58:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb6e1a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbeb0167580 con 0x7fbeb0167cf0 2024-04-25T15:58:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb6e1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb0167860 con 0x7fbeb00abd40 2024-04-25T15:58:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb4bb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 0x7fbeb0074d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb4bb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 0x7fbeb0074d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:57408/0 (socket says 172.21.15.87:57408) 2024-04-25T15:58:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeb4bb6640 1 -- 172.21.15.87:0/611909732 learned_addr learned my addr 172.21.15.87:0/611909732 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeaffff640 1 --2- 172.21.15.87:0/611909732 >> v2:172.21.15.155:3300/0 conn(0x7fbeb0167cf0 0x7fbeb006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.879+0000 7fbeaf7fe640 1 -- 172.21.15.87:0/611909732 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403696698 0 0) 0x7fbeb0164ab0 con 0x7fbeb0070420 2024-04-25T15:58:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeaf7fe640 1 -- 172.21.15.87:0/611909732 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea0003510 con 0x7fbeb0070420 2024-04-25T15:58:04.916 INFO:tasks.workunit.client.0.smithi087.stdout:8/279: sync 2024-04-25T15:58:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeb4bb6640 1 -- 172.21.15.87:0/611909732 >> v2:172.21.15.155:3300/0 conn(0x7fbeb0167cf0 msgr2=0x7fbeb006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeb4bb6640 1 --2- 172.21.15.87:0/611909732 >> v2:172.21.15.155:3300/0 conn(0x7fbeb0167cf0 0x7fbeb006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeb4bb6640 1 -- 172.21.15.87:0/611909732 >> v1:172.21.15.155:6789/0 conn(0x7fbeb0070420 legacy=0x7fbeb008d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeaf7fe640 1 -- 172.21.15.87:0/611909732 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 479528720 0 0) 0x7fbea0003510 con 0x7fbeb0070420 2024-04-25T15:58:04.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeb4bb6640 1 -- 172.21.15.87:0/611909732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb0164d90 con 0x7fbeb00abd40 2024-04-25T15:58:04.918 INFO:tasks.workunit.client.0.smithi087.stdout:8/280: dread - d4/d22/f55 zero size 2024-04-25T15:58:04.918 INFO:tasks.workunit.client.0.smithi087.stdout:4/293: truncate d4/d27/d5c/d3a/f3e 2820371 0 2024-04-25T15:58:04.918 INFO:tasks.workunit.client.0.smithi087.stdout:4/294: write d4/f4e [2833154,17214] 0 2024-04-25T15:58:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeb4bb6640 1 --2- 172.21.15.87:0/611909732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 0x7fbeb0074d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbea400b920 tx=0x7fbea401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718765839a175f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeaf7fe640 1 -- 172.21.15.87:0/611909732 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea40b2070 con 0x7fbeb00abd40 2024-04-25T15:58:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeaf7fe640 1 -- 172.21.15.87:0/611909732 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea40a5510 con 0x7fbeb00abd40 2024-04-25T15:58:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.911+0000 7fbeaf7fe640 1 -- 172.21.15.87:0/611909732 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8001a20 con 0x7fbeb00abd40 2024-04-25T15:58:04.920 INFO:tasks.workunit.client.0.smithi087.stdout:4/295: chown d4/l3d 7 1 2024-04-25T15:58:04.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/611909732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 msgr2=0x7fbeb0074d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/611909732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 0x7fbeb0074d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbea400b920 tx=0x7fbea401c800 comp rx=0 tx=0).stop 2024-04-25T15:58:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/611909732 shutdown_connections 2024-04-25T15:58:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/611909732 >> v2:172.21.15.155:3300/0 conn(0x7fbeb0167cf0 0x7fbeb006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/296: stat d4/f5b 0 2024-04-25T15:58:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/611909732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb00abd40 0x7fbeb0074d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/611909732 >> 172.21.15.87:0/611909732 conn(0x7fbeb00c8ba0 msgr2=0x7fbeb00c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/611909732 shutdown_connections 2024-04-25T15:58:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/611909732 wait complete. 2024-04-25T15:58:04.923 INFO:tasks.workunit.client.0.smithi087.stdout:4/297: chown d4/d7/d15/d12/d3f/d42/l59 19 1 2024-04-25T15:58:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 Processor -- start 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.915+0000 7fbeb6e1a640 1 -- start start 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb0070420 0x7fbeb01fe030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 0x7fbeb00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb0167cf0 0x7fbeb02015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb00aace0 con 0x7fbeb00abd40 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb00ab860 con 0x7fbeb0167cf0 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb00aae60 con 0x7fbeb0070420 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 0x7fbeb00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 0x7fbeb00c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58128/0 (socket says 172.21.15.87:58128) 2024-04-25T15:58:04.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 -- 172.21.15.87:0/2720126103 learned_addr learned my addr 172.21.15.87:0/2720126103 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb4bb6640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb0070420 0x7fbeb01fe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb53b7640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb0167cf0 0x7fbeb02015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.926 INFO:tasks.workunit.client.0.smithi087.stdout:8/281: dwrite d4/d9/f3e [0,4194304] 0 2024-04-25T15:58:04.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 -- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb0070420 msgr2=0x7fbeb01fe030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb0070420 0x7fbeb01fe030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 -- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb0167cf0 msgr2=0x7fbeb02015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb0167cf0 0x7fbeb02015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 -- 172.21.15.87:0/2720126103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb0072940 con 0x7fbeb00abd40 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeaffff640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 0x7fbeb00c7bd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00e8a0 tx=0x7fbe9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c017070 con 0x7fbeb00abd40 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00c940 con 0x7fbeb00abd40 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb0073100 con 0x7fbeb00abd40 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00cd10 con 0x7fbeb00abd40 2024-04-25T15:58:04.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb0089ae0 con 0x7fbeb00abd40 2024-04-25T15:58:04.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.919+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb0069bb0 con 0x7fbeb00abd40 2024-04-25T15:58:04.929 INFO:tasks.workunit.client.0.smithi087.stdout:4/298: rename d4/d27 to d4/d10/d60 0 2024-04-25T15:58:04.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.923+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbe9c01a070 con 0x7fbeb00abd40 2024-04-25T15:58:04.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.923+0000 7fbead7fa640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbe9406f400 0x7fbe94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:04.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.923+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fbe9c08f900 con 0x7fbeb00abd40 2024-04-25T15:58:04.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.923+0000 7fbeb4bb6640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbe9406f400 0x7fbe94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:04.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.927+0000 7fbeb4bb6640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbe9406f400 0x7fbe94071910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbea40af000 tx=0x7fbea40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:04.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:04.927+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe9c05bca0 con 0x7fbeb00abd40 2024-04-25T15:58:04.933 INFO:tasks.workunit.client.0.smithi087.stdout:8/282: dread d4/d1d/d17/f51 [0,4194304] 0 2024-04-25T15:58:04.933 INFO:tasks.workunit.client.0.smithi087.stdout:8/283: write d4/d8/f49 [103660,71771] 0 2024-04-25T15:58:04.936 INFO:tasks.workunit.client.0.smithi087.stdout:8/284: fsync d4/d8/f49 0 2024-04-25T15:58:04.943 INFO:tasks.workunit.client.0.smithi087.stdout:8/285: dwrite d4/d1d/d17/d37/f3b [4194304,4194304] 0 2024-04-25T15:58:04.944 INFO:tasks.workunit.client.0.smithi087.stdout:4/299: dread d4/d7/d15/d12/f1c [0,4194304] 0 2024-04-25T15:58:04.949 INFO:tasks.workunit.client.0.smithi087.stdout:4/300: rename d4/d7/d15/d12 to d4/d10/d60/d56/d61 0 2024-04-25T15:58:04.951 INFO:tasks.workunit.client.0.smithi087.stdout:8/286: dwrite d4/d1d/d17/f33 [0,4194304] 0 2024-04-25T15:58:04.951 INFO:tasks.workunit.client.0.smithi087.stdout:7/221: sync 2024-04-25T15:58:04.952 INFO:tasks.workunit.client.0.smithi087.stdout:8/287: readlink d4/d9/l13 0 2024-04-25T15:58:04.953 INFO:tasks.workunit.client.0.smithi087.stdout:8/288: fsync d4/d8/dd/f11 0 2024-04-25T15:58:04.954 INFO:tasks.workunit.client.0.smithi087.stdout:4/301: dread d4/f41 [0,4194304] 0 2024-04-25T15:58:04.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/302: chown d4/d10/d60/f4b 3583 1 2024-04-25T15:58:04.957 INFO:tasks.workunit.client.0.smithi087.stdout:7/222: creat d1/d4/d18/d36/d37/f43 x:0 0 0 2024-04-25T15:58:04.960 INFO:tasks.workunit.client.0.smithi087.stdout:4/303: link d4/d10/d60/d56/d61/f17 d4/d10/d60/d5c/d3a/f62 0 2024-04-25T15:58:04.960 INFO:tasks.workunit.client.0.smithi087.stdout:8/289: dwrite d4/d1d/d17/f2e [0,4194304] 0 2024-04-25T15:58:04.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/223: creat d1/d4/f44 x:0 0 0 2024-04-25T15:58:04.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/304: mknod d4/d10/d60/d56/d61/d3f/d58/c63 0 2024-04-25T15:58:04.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/224: unlink d1/d9/d26/f3b 0 2024-04-25T15:58:04.967 INFO:tasks.workunit.client.0.smithi087.stdout:7/225: chown d1/d4/f44 1010611531 1 2024-04-25T15:58:04.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/305: creat d4/d10/d60/f64 x:0 0 0 2024-04-25T15:58:04.969 INFO:tasks.workunit.client.0.smithi087.stdout:7/226: mkdir d1/d9/d26/d45 0 2024-04-25T15:58:04.972 INFO:tasks.workunit.client.0.smithi087.stdout:8/290: link d4/d22/c45 d4/c5d 0 2024-04-25T15:58:04.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/306: truncate d4/d7/f2c 2929773 0 2024-04-25T15:58:04.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/291: mkdir d4/d1d/d17/d37/d5e 0 2024-04-25T15:58:04.977 INFO:tasks.workunit.client.0.smithi087.stdout:4/307: mknod d4/d7/d15/c65 0 2024-04-25T15:58:04.978 INFO:tasks.workunit.client.0.smithi087.stdout:8/292: rmdir d4/d1d/d17 39 2024-04-25T15:58:04.983 INFO:tasks.workunit.client.0.smithi087.stdout:8/293: symlink d4/d1d/d17/d37/d5e/l5f 0 2024-04-25T15:58:04.987 INFO:tasks.workunit.client.0.smithi087.stdout:8/294: creat d4/d8/f60 x:0 0 0 2024-04-25T15:58:04.990 INFO:tasks.workunit.client.0.smithi087.stdout:7/227: dread d1/d4/d18/f1b [0,4194304] 0 2024-04-25T15:58:04.990 INFO:tasks.workunit.client.0.smithi087.stdout:8/295: creat d4/d22/d43/f61 x:0 0 0 2024-04-25T15:58:04.994 INFO:tasks.workunit.client.0.smithi087.stdout:8/296: rename d4/d9/f3e to d4/d22/f62 0 2024-04-25T15:58:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:8/297: chown d4/d1d/d17/d37/f41 426513750 1 2024-04-25T15:58:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:4/308: dwrite d4/d10/d60/d56/d61/f2a [4194304,4194304] 0 2024-04-25T15:58:04.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/228: getdents d1/d3c 0 2024-04-25T15:58:05.007 INFO:tasks.workunit.client.0.smithi087.stdout:7/229: dwrite d1/fd [4194304,4194304] 0 2024-04-25T15:58:05.128 INFO:tasks.workunit.client.0.smithi087.stdout:7/230: rename d1/d4/d18/l2c to d1/d4/l46 0 2024-04-25T15:58:05.129 INFO:tasks.workunit.client.0.smithi087.stdout:8/298: getdents d4/d22/d43 0 2024-04-25T15:58:05.131 INFO:tasks.workunit.client.0.smithi087.stdout:4/309: getdents d4/d10 0 2024-04-25T15:58:05.133 INFO:tasks.workunit.client.0.smithi087.stdout:2/319: sync 2024-04-25T15:58:05.133 INFO:tasks.workunit.client.0.smithi087.stdout:3/294: sync 2024-04-25T15:58:05.134 INFO:tasks.workunit.client.0.smithi087.stdout:4/310: rename d4/d7 to d4/d10/d60/d52/d66 0 2024-04-25T15:58:05.139 INFO:tasks.workunit.client.0.smithi087.stdout:3/295: mkdir d4/d17/d24/d29/d58/d59 0 2024-04-25T15:58:05.140 INFO:tasks.workunit.client.0.smithi087.stdout:4/311: creat d4/d10/d60/d5c/d3a/f67 x:0 0 0 2024-04-25T15:58:05.142 INFO:tasks.workunit.client.0.smithi087.stdout:3/296: chown d4/l1c 29 1 2024-04-25T15:58:05.143 INFO:tasks.workunit.client.0.smithi087.stdout:7/231: dwrite d1/d4/d18/d36/f3a [0,4194304] 0 2024-04-25T15:58:05.144 INFO:tasks.workunit.client.0.smithi087.stdout:4/312: fdatasync d4/d10/d60/d52/d66/d15/f1d 0 2024-04-25T15:58:05.151 INFO:tasks.workunit.client.0.smithi087.stdout:4/313: rmdir d4/d10 39 2024-04-25T15:58:05.155 INFO:tasks.workunit.client.0.smithi087.stdout:3/297: link d4/d17/d24/d3f/l54 d4/d17/l5a 0 2024-04-25T15:58:05.155 INFO:tasks.workunit.client.0.smithi087.stdout:7/232: dwrite d1/d9/d26/f30 [4194304,4194304] 0 2024-04-25T15:58:05.156 INFO:tasks.workunit.client.0.smithi087.stdout:3/298: chown d4/db/d28 7919986 1 2024-04-25T15:58:05.158 INFO:tasks.workunit.client.0.smithi087.stdout:2/320: dread d3/d20/d4a/f44 [0,4194304] 0 2024-04-25T15:58:05.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/299: read d4/d17/d24/f4e [357365,16330] 0 2024-04-25T15:58:05.161 INFO:tasks.workunit.client.0.smithi087.stdout:2/321: truncate d3/d27/f31 524688 0 2024-04-25T15:58:05.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.159+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeb0161fa0 con 0x7fbeb00abd40 2024-04-25T15:58:05.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.159+0000 7fbead7fa640 1 -- 172.21.15.87:0/2720126103 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+4837 (secure 0 0 0) 0x7fbe9c05ffa0 con 0x7fbeb00abd40 2024-04-25T15:58:05.164 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:05.164 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:04.272250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:58:05.164 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-04-25T15:58:05.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbe9406f400 msgr2=0x7fbe94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:05.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbe9406f400 0x7fbe94071910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbea40af000 tx=0x7fbea40a7070 comp rx=0 tx=0).stop 2024-04-25T15:58:05.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 msgr2=0x7fbeb00c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:05.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 0x7fbeb00c7bd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00e8a0 tx=0x7fbe9c00ed60 comp rx=0 tx=0).stop 2024-04-25T15:58:05.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 shutdown_connections 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbe9406f400 0x7fbe94071910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb0167cf0 0x7fbeb02015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbeb00abd40 0x7fbeb00c7bd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 --2- 172.21.15.87:0/2720126103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb0070420 0x7fbeb01fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 >> 172.21.15.87:0/2720126103 conn(0x7fbeb00c8ba0 msgr2=0x7fbeb006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 shutdown_connections 2024-04-25T15:58:05.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:05.163+0000 7fbeb6e1a640 1 -- 172.21.15.87:0/2720126103 wait complete. 2024-04-25T15:58:05.167 INFO:tasks.workunit.client.0.smithi087.stdout:4/314: dwrite d4/d10/d60/d52/d66/d15/f1d [0,4194304] 0 2024-04-25T15:58:05.169 INFO:tasks.workunit.client.0.smithi087.stdout:7/233: dwrite d1/d4/d18/d36/f3a [0,4194304] 0 2024-04-25T15:58:05.177 INFO:tasks.workunit.client.0.smithi087.stdout:7/234: creat d1/d4/f47 x:0 0 0 2024-04-25T15:58:05.181 INFO:tasks.workunit.client.0.smithi087.stdout:2/322: rename d3/d20/l37 to d3/d27/d29/l5d 0 2024-04-25T15:58:05.187 INFO:tasks.workunit.client.0.smithi087.stdout:2/323: chown d3/d2a/d48/f54 16179300 1 2024-04-25T15:58:05.189 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 36, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 35, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4966": { "addr": "172.21.15.155:6833/2576881209", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 2576881209, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 2576881209, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4966, "incarnation": 32, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 15 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:57:58.402845+0000", "qdb_cluster": [ 4966 ], "qdb_leader": 4966, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4966 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 36, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4235": { "addr": "172.21.15.155:6835/630698588", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 630698588, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 630698588, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 36, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:58:04.272250+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4235 } } } ], "standbys": [] } 2024-04-25T15:58:05.191 INFO:tasks.workunit.client.0.smithi087.stdout:4/315: rename f1 to d4/d10/d60/d52/d66/f68 0 2024-04-25T15:58:05.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/324: symlink d3/d27/d29/d4f/l5e 0 2024-04-25T15:58:05.193 INFO:tasks.workunit.client.0.smithi087.stdout:2/325: truncate d3/d2a/f1b 4781865 0 2024-04-25T15:58:05.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/326: read d3/d2a/f1f [59589,56897] 0 2024-04-25T15:58:05.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/327: dread d3/d2a/d1c/f4b [0,4194304] 0 2024-04-25T15:58:05.208 INFO:tasks.workunit.client.0.smithi087.stdout:2/328: creat d3/d27/d29/d4f/f5f x:0 0 0 2024-04-25T15:58:05.208 INFO:tasks.workunit.client.0.smithi087.stdout:4/316: dread d4/d10/d60/d52/d66/f2c [0,4194304] 0 2024-04-25T15:58:05.215 INFO:tasks.workunit.client.0.smithi087.stdout:4/317: dwrite d4/d10/d60/f46 [0,4194304] 0 2024-04-25T15:58:05.219 INFO:tasks.workunit.client.0.smithi087.stdout:4/318: unlink d4/d10/d60/d52/d66/d15/l18 0 2024-04-25T15:58:05.222 INFO:tasks.workunit.client.0.smithi087.stdout:4/319: symlink d4/d10/d60/d52/l69 0 2024-04-25T15:58:05.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/320: dwrite d4/d10/d60/d52/d66/d15/f1a [0,4194304] 0 2024-04-25T15:58:05.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/321: dread d4/d10/d60/d56/d61/f17 [0,4194304] 0 2024-04-25T15:58:05.238 INFO:tasks.workunit.client.0.smithi087.stdout:0/256: sync 2024-04-25T15:58:05.238 INFO:tasks.workunit.client.0.smithi087.stdout:4/322: dread d4/d10/d60/d52/d66/d15/f1a [0,4194304] 0 2024-04-25T15:58:05.238 INFO:tasks.workunit.client.0.smithi087.stdout:4/323: chown d4/d10/d60/d56 30857 1 2024-04-25T15:58:05.243 INFO:tasks.workunit.client.0.smithi087.stdout:4/324: link d4/d10/d60/d52/d66/f32 d4/d10/d60/d56/d61/d3f/d58/d5e/f6a 0 2024-04-25T15:58:05.246 INFO:tasks.workunit.client.0.smithi087.stdout:0/257: dwrite d1/d6/d21/f24 [0,4194304] 0 2024-04-25T15:58:05.252 INFO:tasks.workunit.client.0.smithi087.stdout:0/258: stat d1/d6/d1f/f37 0 2024-04-25T15:58:05.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/325: dwrite d4/f6 [4194304,4194304] 0 2024-04-25T15:58:05.268 INFO:tasks.workunit.client.0.smithi087.stdout:4/326: link d4/d10/d60/d56/d61/l19 d4/d10/d60/d5c/d3a/l6b 0 2024-04-25T15:58:05.277 INFO:tasks.workunit.client.0.smithi087.stdout:4/327: chown d4/d10/d60/d56/d61/l19 414 1 2024-04-25T15:58:05.279 INFO:tasks.workunit.client.0.smithi087.stdout:4/328: creat d4/d10/d60/f6c x:0 0 0 2024-04-25T15:58:05.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/329: readlink d4/d10/d60/d52/d66/d15/l4a 0 2024-04-25T15:58:05.281 INFO:tasks.workunit.client.0.smithi087.stdout:4/330: readlink d4/d10/d60/d5c/d3a/l6b 0 2024-04-25T15:58:05.283 INFO:tasks.workunit.client.0.smithi087.stdout:4/331: mkdir d4/d10/d60/d5c/d6d 0 2024-04-25T15:58:05.285 INFO:tasks.workunit.client.0.smithi087.stdout:4/332: creat d4/d10/d60/d56/d61/f6e x:0 0 0 2024-04-25T15:58:05.288 INFO:tasks.workunit.client.0.smithi087.stdout:3/300: write d4/d17/f2a [2450760,17505] 0 2024-04-25T15:58:05.302 INFO:tasks.workunit.client.0.smithi087.stdout:4/333: dread d4/d10/d60/d52/d66/d15/fc [0,4194304] 0 2024-04-25T15:58:05.308 INFO:tasks.workunit.client.0.smithi087.stdout:0/259: creat d1/f58 x:0 0 0 2024-04-25T15:58:05.308 INFO:tasks.workunit.client.0.smithi087.stdout:2/329: rmdir d3/d27 39 2024-04-25T15:58:05.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/260: chown d1/d6/d21/c2c 531384864 1 2024-04-25T15:58:05.309 INFO:tasks.workunit.client.0.smithi087.stdout:1/328: sync 2024-04-25T15:58:05.313 INFO:tasks.workunit.client.0.smithi087.stdout:2/330: creat d3/d27/d29/d4f/f60 x:0 0 0 2024-04-25T15:58:05.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/301: dread d4/f3b [4194304,4194304] 0 2024-04-25T15:58:05.317 INFO:tasks.workunit.client.0.smithi087.stdout:0/261: dwrite d1/f14 [0,4194304] 0 2024-04-25T15:58:05.320 INFO:tasks.workunit.client.0.smithi087.stdout:3/302: chown d4/d14/d23 7372 1 2024-04-25T15:58:05.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/331: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:05.322 INFO:tasks.workunit.client.0.smithi087.stdout:0/262: fsync d1/d6/d1f/f37 0 2024-04-25T15:58:05.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/303: chown l0 9833 1 2024-04-25T15:58:05.328 INFO:tasks.workunit.client.0.smithi087.stdout:3/304: chown d4/d14/f3d 1155104 1 2024-04-25T15:58:05.329 INFO:tasks.workunit.client.0.smithi087.stdout:2/332: write d3/d20/d4a/f44 [569927,91312] 0 2024-04-25T15:58:05.329 INFO:tasks.workunit.client.0.smithi087.stdout:3/305: readlink d4/d17/l39 0 2024-04-25T15:58:05.330 INFO:tasks.workunit.client.0.smithi087.stdout:1/329: dread d3/d12/d14/d29/d2f/f3f [0,4194304] 0 2024-04-25T15:58:05.331 INFO:tasks.workunit.client.0.smithi087.stdout:4/334: truncate d4/f14 1220199 0 2024-04-25T15:58:05.331 INFO:tasks.workunit.client.0.smithi087.stdout:1/330: dread - d3/d12/d14/d29/d2f/f5d zero size 2024-04-25T15:58:05.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/263: mknod d1/c59 0 2024-04-25T15:58:05.337 INFO:tasks.workunit.client.0.smithi087.stdout:3/306: creat d4/db/f5b x:0 0 0 2024-04-25T15:58:05.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/264: read d1/d6/d21/f23 [1069112,95543] 0 2024-04-25T15:58:05.341 INFO:tasks.workunit.client.0.smithi087.stdout:0/265: chown d1/l4e 9 1 2024-04-25T15:58:05.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/335: dwrite d4/d10/f3c [0,4194304] 0 2024-04-25T15:58:05.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/331: dwrite d3/d12/d14/d29/d2f/f5d [0,4194304] 0 2024-04-25T15:58:05.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/332: write d3/f5a [565455,109964] 0 2024-04-25T15:58:05.346 INFO:tasks.workunit.client.0.smithi087.stdout:3/307: truncate d4/f3b 2082598 0 2024-04-25T15:58:05.348 INFO:tasks.workunit.client.0.smithi087.stdout:0/266: unlink d1/f5 0 2024-04-25T15:58:05.351 INFO:tasks.workunit.client.0.smithi087.stdout:1/333: dread d3/d12/d14/f27 [0,4194304] 0 2024-04-25T15:58:05.360 INFO:tasks.workunit.client.0.smithi087.stdout:0/267: mknod d1/da/d3e/c5a 0 2024-04-25T15:58:05.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/334: symlink d3/d12/d39/l69 0 2024-04-25T15:58:05.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/268: mknod d1/d27/c5b 0 2024-04-25T15:58:05.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/269: chown d1/d6/d21/f52 19697 1 2024-04-25T15:58:05.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/270: write d1/da/d3e/d54/f2b [1372857,31913] 0 2024-04-25T15:58:05.369 INFO:tasks.workunit.client.0.smithi087.stdout:3/308: rename d4/d14/d50 to d4/db/d28/d5c 0 2024-04-25T15:58:05.370 INFO:tasks.workunit.client.0.smithi087.stdout:3/309: fdatasync d4/d14/d23/f26 0 2024-04-25T15:58:05.422 INFO:tasks.workunit.client.0.smithi087.stdout:1/335: getdents d3/d12/d14/d29/d2f/d61 0 2024-04-25T15:58:05.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/270: sync 2024-04-25T15:58:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/235: sync 2024-04-25T15:58:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/414: sync 2024-04-25T15:58:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:8/299: sync 2024-04-25T15:58:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:5/389: sync 2024-04-25T15:58:05.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/271: write d1/d6/d21/f23 [2141514,58307] 0 2024-04-25T15:58:05.427 INFO:tasks.workunit.client.0.smithi087.stdout:1/336: readlink d3/d12/d14/d29/d2f/d53/l4f 0 2024-04-25T15:58:05.428 INFO:tasks.workunit.client.0.smithi087.stdout:4/336: dread d4/d10/d60/d5c/f37 [0,4194304] 0 2024-04-25T15:58:05.429 INFO:tasks.workunit.client.0.smithi087.stdout:5/390: chown d9/d2c/d38/l6c 13384506 1 2024-04-25T15:58:05.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/272: symlink d1/d6/l5c 0 2024-04-25T15:58:05.431 INFO:tasks.workunit.client.0.smithi087.stdout:3/310: truncate d4/f12 2202314 0 2024-04-25T15:58:05.433 INFO:tasks.workunit.client.0.smithi087.stdout:6/415: mkdir d7/d71/d59/d90 0 2024-04-25T15:58:05.433 INFO:tasks.workunit.client.0.smithi087.stdout:6/416: chown d7/d1a/d1d/d21/d27 2052447 1 2024-04-25T15:58:05.437 INFO:tasks.workunit.client.0.smithi087.stdout:7/236: creat d1/d4/d18/d36/d37/f48 x:0 0 0 2024-04-25T15:58:05.439 INFO:tasks.workunit.client.0.smithi087.stdout:4/337: creat d4/d10/d60/d52/d66/f6f x:0 0 0 2024-04-25T15:58:05.446 INFO:tasks.workunit.client.0.smithi087.stdout:1/337: mknod d3/d12/d14/d29/d67/c6a 0 2024-04-25T15:58:05.448 INFO:tasks.workunit.client.0.smithi087.stdout:7/237: rmdir d1/d4/d18/d36/d37 39 2024-04-25T15:58:05.450 INFO:tasks.workunit.client.0.smithi087.stdout:7/238: dread d1/d1a/f39 [0,4194304] 0 2024-04-25T15:58:05.451 INFO:tasks.workunit.client.0.smithi087.stdout:5/391: mkdir d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e 0 2024-04-25T15:58:05.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/311: creat d4/d17/d24/d29/d58/d59/f5d x:0 0 0 2024-04-25T15:58:05.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/271: truncate d6/f2b 2146121 0 2024-04-25T15:58:05.458 INFO:tasks.workunit.client.0.smithi087.stdout:6/417: creat d7/d1a/d1d/d8a/f91 x:0 0 0 2024-04-25T15:58:05.461 INFO:tasks.workunit.client.0.smithi087.stdout:7/239: fdatasync d1/d4/d18/d36/d37/f48 0 2024-04-25T15:58:05.461 INFO:tasks.workunit.client.0.smithi087.stdout:5/392: symlink d9/d2c/d30/d70/d79/l7f 0 2024-04-25T15:58:05.463 INFO:tasks.workunit.client.0.smithi087.stdout:3/312: creat d4/d17/f5e x:0 0 0 2024-04-25T15:58:05.463 INFO:tasks.workunit.client.0.smithi087.stdout:3/313: fdatasync d4/d14/d37/f40 0 2024-04-25T15:58:05.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/300: link d4/d1d/d17/l24 d4/d8/l63 0 2024-04-25T15:58:05.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/301: stat d4/d1d/l20 0 2024-04-25T15:58:05.465 INFO:tasks.workunit.client.0.smithi087.stdout:7/240: dread d1/d4/f12 [0,4194304] 0 2024-04-25T15:58:05.465 INFO:tasks.workunit.client.0.smithi087.stdout:9/272: rename d6/d8/d12/c2c to d6/d3e/c49 0 2024-04-25T15:58:05.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/418: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/c92 0 2024-04-25T15:58:05.468 INFO:tasks.workunit.client.0.smithi087.stdout:1/338: dread d3/d12/d14/d29/d3b/f68 [0,4194304] 0 2024-04-25T15:58:05.472 INFO:tasks.workunit.client.0.smithi087.stdout:7/241: mknod d1/d4/c49 0 2024-04-25T15:58:05.472 INFO:tasks.workunit.client.0.smithi087.stdout:7/242: chown d1/d4/d18/d36/d37/f43 193021 1 2024-04-25T15:58:05.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/393: truncate d9/f26 1066351 0 2024-04-25T15:58:05.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/314: mknod d4/d14/c5f 0 2024-04-25T15:58:05.476 INFO:tasks.workunit.client.0.smithi087.stdout:4/338: truncate d4/d10/d60/d52/d66/d15/d13/f30 575945 0 2024-04-25T15:58:05.479 INFO:tasks.workunit.client.0.smithi087.stdout:5/394: chown c6 25828 1 2024-04-25T15:58:05.479 INFO:tasks.workunit.client.0.smithi087.stdout:3/315: mkdir d4/d17/d24/d29/d58/d59/d60 0 2024-04-25T15:58:05.480 INFO:tasks.workunit.client.0.smithi087.stdout:5/395: stat d9/d2f/d3b 0 2024-04-25T15:58:05.481 INFO:tasks.workunit.client.0.smithi087.stdout:8/302: rename d4/d9/f48 to d4/d8/f64 0 2024-04-25T15:58:05.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/339: dread d4/d10/d60/d52/d66/d15/f1d [0,4194304] 0 2024-04-25T15:58:05.488 INFO:tasks.workunit.client.0.smithi087.stdout:3/316: dwrite d4/db/fe [0,4194304] 0 2024-04-25T15:58:05.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/419: rename d7/ce to d7/d71/d76/c93 0 2024-04-25T15:58:05.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/243: dread d1/d4/f10 [0,4194304] 0 2024-04-25T15:58:05.490 INFO:tasks.workunit.client.0.smithi087.stdout:9/273: getdents d6/d8/d32 0 2024-04-25T15:58:05.497 INFO:tasks.workunit.client.0.smithi087.stdout:1/339: rename d3/d12/c41 to d3/d12/d14/d29/d3b/c6b 0 2024-04-25T15:58:05.498 INFO:tasks.workunit.client.0.smithi087.stdout:1/340: chown d3/d12/d14/d29/d2f/f3f 9619412 1 2024-04-25T15:58:05.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/274: write d6/d8/fc [1532291,85230] 0 2024-04-25T15:58:05.500 INFO:tasks.workunit.client.0.smithi087.stdout:1/341: truncate d3/d12/d14/d29/d2f/d40/f54 591236 0 2024-04-25T15:58:05.501 INFO:tasks.workunit.client.0.smithi087.stdout:6/420: symlink d7/d1a/d1d/d21/d27/d2c/d35/d45/l94 0 2024-04-25T15:58:05.501 INFO:tasks.workunit.client.0.smithi087.stdout:1/342: chown d3/f8 271794 1 2024-04-25T15:58:05.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/421: chown d7/d71/d59/l72 822881 1 2024-04-25T15:58:05.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/303: link d4/d22/f55 d4/f65 0 2024-04-25T15:58:05.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/422: chown d7/l20 272911 1 2024-04-25T15:58:05.503 INFO:tasks.workunit.client.0.smithi087.stdout:6/423: dread - d7/d1a/d1d/f4a zero size 2024-04-25T15:58:05.507 INFO:tasks.workunit.client.0.smithi087.stdout:1/343: mkdir d3/d2d/d6c 0 2024-04-25T15:58:05.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/304: unlink d4/d22/f2a 0 2024-04-25T15:58:05.509 INFO:tasks.workunit.client.0.smithi087.stdout:1/344: chown d3/d12/d14/d29/d2f/f5d 967322 1 2024-04-25T15:58:05.510 INFO:tasks.workunit.client.0.smithi087.stdout:3/317: link d4/d14/l30 d4/d17/d24/d29/d58/l61 0 2024-04-25T15:58:05.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/396: dwrite f1 [4194304,4194304] 0 2024-04-25T15:58:05.512 INFO:tasks.workunit.client.0.smithi087.stdout:5/397: readlink d9/d2f/l45 0 2024-04-25T15:58:05.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/318: chown d4/d14/c48 5 1 2024-04-25T15:58:05.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/319: chown d4/d17/d24/d3f 114111 1 2024-04-25T15:58:05.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/305: symlink d4/d22/l66 0 2024-04-25T15:58:05.515 INFO:tasks.workunit.client.0.smithi087.stdout:9/275: dwrite d6/d8/d14/d1d/f36 [0,4194304] 0 2024-04-25T15:58:05.519 INFO:tasks.workunit.client.0.smithi087.stdout:5/398: mkdir d9/d2c/d49/d80 0 2024-04-25T15:58:05.520 INFO:tasks.workunit.client.0.smithi087.stdout:9/276: fsync d6/d8/d12/f2f 0 2024-04-25T15:58:05.570 INFO:tasks.workunit.client.0.smithi087.stdout:2/333: sync 2024-04-25T15:58:05.575 INFO:tasks.workunit.client.0.smithi087.stdout:8/306: rename d4/d22/f62 to d4/d8/dd/d2f/f67 0 2024-04-25T15:58:05.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/345: dwrite d3/d2d/f38 [0,4194304] 0 2024-04-25T15:58:05.576 INFO:tasks.workunit.client.0.smithi087.stdout:3/320: dwrite d4/f19 [0,4194304] 0 2024-04-25T15:58:05.581 INFO:tasks.workunit.client.0.smithi087.stdout:5/399: creat d9/d2c/d30/f81 x:0 0 0 2024-04-25T15:58:05.582 INFO:tasks.workunit.client.0.smithi087.stdout:2/334: chown d3/d2a/d1c/f4b 461488 1 2024-04-25T15:58:05.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/307: read - d4/f4a zero size 2024-04-25T15:58:05.588 INFO:tasks.workunit.client.0.smithi087.stdout:8/308: dread - d4/d1d/f59 zero size 2024-04-25T15:58:05.588 INFO:tasks.workunit.client.0.smithi087.stdout:6/424: getdents d7/d1a/d1d/d21/d27/d2c/d35 0 2024-04-25T15:58:05.589 INFO:tasks.workunit.client.0.smithi087.stdout:1/346: symlink d3/d12/d14/d29/d2f/l6d 0 2024-04-25T15:58:05.591 INFO:tasks.workunit.client.0.smithi087.stdout:1/347: readlink d3/le 0 2024-04-25T15:58:05.592 INFO:tasks.workunit.client.0.smithi087.stdout:9/277: dwrite d6/f3b [0,4194304] 0 2024-04-25T15:58:05.592 INFO:tasks.workunit.client.0.smithi087.stdout:3/321: rename d4/d17/d27 to d4/db/d28/d3c/d62 0 2024-04-25T15:58:05.596 INFO:tasks.workunit.client.0.smithi087.stdout:6/425: unlink d7/d1a/d1d/l6a 0 2024-04-25T15:58:05.598 INFO:tasks.workunit.client.0.smithi087.stdout:9/278: symlink d6/d8/d32/l4a 0 2024-04-25T15:58:05.599 INFO:tasks.workunit.client.0.smithi087.stdout:3/322: creat d4/d17/f63 x:0 0 0 2024-04-25T15:58:05.607 INFO:tasks.workunit.client.0.smithi087.stdout:3/323: creat d4/db/d28/d3c/d62/f64 x:0 0 0 2024-04-25T15:58:05.607 INFO:tasks.workunit.client.0.smithi087.stdout:9/279: mknod d6/d8/d14/d1d/c4b 0 2024-04-25T15:58:05.608 INFO:tasks.workunit.client.0.smithi087.stdout:1/348: link d3/d12/d14/d29/l34 d3/d12/d14/d29/d67/l6e 0 2024-04-25T15:58:05.610 INFO:tasks.workunit.client.0.smithi087.stdout:6/426: getdents d7/d1a/d41 0 2024-04-25T15:58:05.613 INFO:tasks.workunit.client.0.smithi087.stdout:2/335: dwrite d3/d27/f3e [4194304,4194304] 0 2024-04-25T15:58:05.613 INFO:tasks.workunit.client.0.smithi087.stdout:3/324: stat d4/d17/d24/d29/d58 0 2024-04-25T15:58:05.616 INFO:tasks.workunit.client.0.smithi087.stdout:9/280: chown d6/d8/d14/d1d/c4b 15 1 2024-04-25T15:58:05.623 INFO:tasks.workunit.client.0.smithi087.stdout:9/281: stat d6/d8/d14/d1d/f36 0 2024-04-25T15:58:05.623 INFO:tasks.workunit.client.0.smithi087.stdout:3/325: truncate d4/db/f5b 13696 0 2024-04-25T15:58:05.624 INFO:tasks.workunit.client.0.smithi087.stdout:8/309: dwrite d4/f65 [0,4194304] 0 2024-04-25T15:58:05.625 INFO:tasks.workunit.client.0.smithi087.stdout:5/400: dread f3 [0,4194304] 0 2024-04-25T15:58:05.630 INFO:tasks.workunit.client.0.smithi087.stdout:3/326: truncate d4/d14/f3d 525268 0 2024-04-25T15:58:05.630 INFO:tasks.workunit.client.0.smithi087.stdout:9/282: mkdir d6/d8/d32/d4c 0 2024-04-25T15:58:05.631 INFO:tasks.workunit.client.0.smithi087.stdout:1/349: link d3/d12/d14/c23 d3/d12/d39/c6f 0 2024-04-25T15:58:05.632 INFO:tasks.workunit.client.0.smithi087.stdout:5/401: mkdir d9/d2c/d30/d70/d82 0 2024-04-25T15:58:05.633 INFO:tasks.workunit.client.0.smithi087.stdout:8/310: truncate d4/d22/d43/f61 239313 0 2024-04-25T15:58:05.636 INFO:tasks.workunit.client.0.smithi087.stdout:9/283: creat d6/d8/d32/f4d x:0 0 0 2024-04-25T15:58:05.641 INFO:tasks.workunit.client.0.smithi087.stdout:8/311: link d4/d1d/d17/c4b d4/d8/dd/c68 0 2024-04-25T15:58:05.642 INFO:tasks.workunit.client.0.smithi087.stdout:8/312: read - d4/d1d/f59 zero size 2024-04-25T15:58:05.653 INFO:tasks.workunit.client.0.smithi087.stdout:0/273: sync 2024-04-25T15:58:05.666 INFO:tasks.workunit.client.0.smithi087.stdout:9/284: getdents d6/d3e 0 2024-04-25T15:58:05.667 INFO:tasks.workunit.client.0.smithi087.stdout:3/327: write d4/f12 [1919815,68130] 0 2024-04-25T15:58:05.670 INFO:tasks.workunit.client.0.smithi087.stdout:0/274: mknod d1/da/d3e/c5d 0 2024-04-25T15:58:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:2/336: dread d3/d20/f45 [0,4194304] 0 2024-04-25T15:58:05.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/427: dread d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:05.673 INFO:tasks.workunit.client.0.smithi087.stdout:9/285: write d6/d8/d12/f43 [1028259,19581] 0 2024-04-25T15:58:05.673 INFO:tasks.workunit.client.0.smithi087.stdout:8/313: rename d4/d1d/l4d to d4/d8/dd/l69 0 2024-04-25T15:58:05.675 INFO:tasks.workunit.client.0.smithi087.stdout:1/350: dwrite d3/d12/d14/d29/d2f/f3f [0,4194304] 0 2024-04-25T15:58:05.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/328: creat d4/db/d28/d3c/d62/f65 x:0 0 0 2024-04-25T15:58:05.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/337: symlink d3/d2a/d48/l61 0 2024-04-25T15:58:05.679 INFO:tasks.workunit.client.0.smithi087.stdout:1/351: write d3/d12/d14/d29/f4b [1562373,19758] 0 2024-04-25T15:58:05.680 INFO:tasks.workunit.client.0.smithi087.stdout:3/329: dread d4/db/f5b [0,4194304] 0 2024-04-25T15:58:05.686 INFO:tasks.workunit.client.0.smithi087.stdout:9/286: creat d6/d8/d29/d3a/f4e x:0 0 0 2024-04-25T15:58:05.687 INFO:tasks.workunit.client.0.smithi087.stdout:3/330: dread d4/d14/d23/f26 [0,4194304] 0 2024-04-25T15:58:05.689 INFO:tasks.workunit.client.0.smithi087.stdout:3/331: truncate d4/db/d28/d3c/d62/f44 909851 0 2024-04-25T15:58:05.690 INFO:tasks.workunit.client.0.smithi087.stdout:0/275: truncate d1/f14 3005264 0 2024-04-25T15:58:05.693 INFO:tasks.workunit.client.0.smithi087.stdout:9/287: read d6/f2b [152478,99585] 0 2024-04-25T15:58:05.693 INFO:tasks.workunit.client.0.smithi087.stdout:8/314: creat d4/d8/f6a x:0 0 0 2024-04-25T15:58:05.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/288: write d6/d8/d29/f3f [1071300,74004] 0 2024-04-25T15:58:05.696 INFO:tasks.workunit.client.0.smithi087.stdout:1/352: rename d3/d12/d14/f30 to d3/d12/f70 0 2024-04-25T15:58:05.696 INFO:tasks.workunit.client.0.smithi087.stdout:8/315: write d4/d1d/d17/d37/f41 [763472,57011] 0 2024-04-25T15:58:05.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/276: rename d1/d6/d21/d2a/c33 to d1/d27/c5e 0 2024-04-25T15:58:05.699 INFO:tasks.workunit.client.0.smithi087.stdout:9/289: truncate d6/d8/d12/f44 1034878 0 2024-04-25T15:58:05.700 INFO:tasks.workunit.client.0.smithi087.stdout:8/316: creat d4/d1d/d14/f6b x:0 0 0 2024-04-25T15:58:05.701 INFO:tasks.workunit.client.0.smithi087.stdout:9/290: fdatasync d6/d8/d29/d3a/f4e 0 2024-04-25T15:58:05.701 INFO:tasks.workunit.client.0.smithi087.stdout:1/353: creat d3/d12/d14/d29/d2f/d40/f71 x:0 0 0 2024-04-25T15:58:05.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/317: chown d4/d22/f44 9095962 1 2024-04-25T15:58:05.705 INFO:tasks.workunit.client.0.smithi087.stdout:6/428: truncate d7/d1a/d41/f44 327574 0 2024-04-25T15:58:05.706 INFO:tasks.workunit.client.0.smithi087.stdout:1/354: mknod d3/d12/d14/d29/d3b/c72 0 2024-04-25T15:58:05.707 INFO:tasks.workunit.client.0.smithi087.stdout:1/355: stat d3/f7 0 2024-04-25T15:58:05.708 INFO:tasks.workunit.client.0.smithi087.stdout:2/338: truncate d3/d20/d4a/d47/f52 70471 0 2024-04-25T15:58:05.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/277: dwrite d1/d6/f8 [0,4194304] 0 2024-04-25T15:58:05.713 INFO:tasks.workunit.client.0.smithi087.stdout:8/318: rename d4/d9/l13 to d4/d8/l6c 0 2024-04-25T15:58:05.713 INFO:tasks.workunit.client.0.smithi087.stdout:6/429: creat d7/d71/d59/d90/f95 x:0 0 0 2024-04-25T15:58:05.714 INFO:tasks.workunit.client.0.smithi087.stdout:1/356: unlink d3/d12/d14/d29/f4b 0 2024-04-25T15:58:05.716 INFO:tasks.workunit.client.0.smithi087.stdout:2/339: symlink d3/d27/d29/d2d/d40/l62 0 2024-04-25T15:58:05.717 INFO:tasks.workunit.client.0.smithi087.stdout:2/340: stat d3/d27/d29/d2d/f57 0 2024-04-25T15:58:05.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/278: write d1/da/d3e/d54/d34/f43 [754783,49245] 0 2024-04-25T15:58:05.718 INFO:tasks.workunit.client.0.smithi087.stdout:2/341: chown d3/d2a/d48/l61 125 1 2024-04-25T15:58:05.718 INFO:tasks.workunit.client.0.smithi087.stdout:2/342: fsync d3/d2a/f1b 0 2024-04-25T15:58:05.719 INFO:tasks.workunit.client.0.smithi087.stdout:8/319: unlink d4/d22/l66 0 2024-04-25T15:58:05.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/430: mkdir d7/d1a/d1d/d21/d37/d96 0 2024-04-25T15:58:05.724 INFO:tasks.workunit.client.0.smithi087.stdout:2/343: fdatasync d3/d20/f45 0 2024-04-25T15:58:05.724 INFO:tasks.workunit.client.0.smithi087.stdout:8/320: rmdir d4/d9 39 2024-04-25T15:58:05.726 INFO:tasks.workunit.client.0.smithi087.stdout:0/279: symlink d1/l5f 0 2024-04-25T15:58:05.728 INFO:tasks.workunit.client.0.smithi087.stdout:2/344: write d3/d2a/f1b [395406,74402] 0 2024-04-25T15:58:05.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/431: creat d7/d1a/d1d/d21/d27/d2c/d35/f97 x:0 0 0 2024-04-25T15:58:05.728 INFO:tasks.workunit.client.0.smithi087.stdout:8/321: mkdir d4/d22/d43/d6d 0 2024-04-25T15:58:05.731 INFO:tasks.workunit.client.0.smithi087.stdout:6/432: readlink d7/d71/l88 0 2024-04-25T15:58:05.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/357: dread d3/f8 [4194304,4194304] 0 2024-04-25T15:58:05.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/345: stat d3/d27/d29/f2c 0 2024-04-25T15:58:05.732 INFO:tasks.workunit.client.0.smithi087.stdout:9/291: dwrite d6/d8/d29/f2a [4194304,4194304] 0 2024-04-25T15:58:05.732 INFO:tasks.workunit.client.0.smithi087.stdout:8/322: symlink d4/d1d/d17/d37/l6e 0 2024-04-25T15:58:05.738 INFO:tasks.workunit.client.0.smithi087.stdout:6/433: mknod d7/d1a/d1d/d8a/c98 0 2024-04-25T15:58:05.740 INFO:tasks.workunit.client.0.smithi087.stdout:1/358: mkdir d3/d12/d14/d29/d67/d73 0 2024-04-25T15:58:05.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/434: chown d7/d1a/d1d/d8a 177086781 1 2024-04-25T15:58:05.741 INFO:tasks.workunit.client.0.smithi087.stdout:0/280: dwrite d1/da/d3e/d54/d34/f43 [0,4194304] 0 2024-04-25T15:58:05.743 INFO:tasks.workunit.client.0.smithi087.stdout:8/323: mkdir d4/d8/dd/d2f/d6f 0 2024-04-25T15:58:05.746 INFO:tasks.workunit.client.0.smithi087.stdout:9/292: mkdir d6/d8/d32/d4c/d4f 0 2024-04-25T15:58:05.747 INFO:tasks.workunit.client.0.smithi087.stdout:8/324: unlink d4/f57 0 2024-04-25T15:58:05.748 INFO:tasks.workunit.client.0.smithi087.stdout:8/325: chown d4/d8/dd/d2f/d6f 51340 1 2024-04-25T15:58:05.750 INFO:tasks.workunit.client.0.smithi087.stdout:1/359: symlink d3/d12/l74 0 2024-04-25T15:58:05.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/360: chown d3/d12/d14/d29/d3b/c6b 30928682 1 2024-04-25T15:58:05.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/281: rename d1/c28 to d1/da/c60 0 2024-04-25T15:58:05.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/326: dwrite d4/d8/f6a [0,4194304] 0 2024-04-25T15:58:05.760 INFO:tasks.workunit.client.0.smithi087.stdout:1/361: write d3/d12/d14/d29/d3b/f5e [778741,47298] 0 2024-04-25T15:58:05.762 INFO:tasks.workunit.client.0.smithi087.stdout:9/293: getdents d6/d8/d29/d3a 0 2024-04-25T15:58:05.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/362: truncate d3/d12/d14/f16 256771 0 2024-04-25T15:58:05.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/294: mknod d6/d8/d29/d3a/c50 0 2024-04-25T15:58:05.769 INFO:tasks.workunit.client.0.smithi087.stdout:6/435: dwrite f5 [0,4194304] 0 2024-04-25T15:58:05.769 INFO:tasks.workunit.client.0.smithi087.stdout:0/282: creat d1/f61 x:0 0 0 2024-04-25T15:58:05.770 INFO:tasks.workunit.client.0.smithi087.stdout:0/283: dread - d1/f61 zero size 2024-04-25T15:58:05.771 INFO:tasks.workunit.client.0.smithi087.stdout:9/295: write d6/d8/d32/f4d [817768,89375] 0 2024-04-25T15:58:05.772 INFO:tasks.workunit.client.0.smithi087.stdout:1/363: mknod d3/d12/d14/d29/c75 0 2024-04-25T15:58:05.774 INFO:tasks.workunit.client.0.smithi087.stdout:6/436: unlink d7/f19 0 2024-04-25T15:58:05.775 INFO:tasks.workunit.client.0.smithi087.stdout:8/327: truncate d4/d1d/d17/f2e 274618 0 2024-04-25T15:58:05.776 INFO:tasks.workunit.client.0.smithi087.stdout:8/328: write d4/d1d/f4c [4933407,116900] 0 2024-04-25T15:58:05.778 INFO:tasks.workunit.client.0.smithi087.stdout:0/284: symlink d1/l62 0 2024-04-25T15:58:05.779 INFO:tasks.workunit.client.0.smithi087.stdout:0/285: fsync d1/da/f3a 0 2024-04-25T15:58:05.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/329: mknod d4/d1d/c70 0 2024-04-25T15:58:05.784 INFO:tasks.workunit.client.0.smithi087.stdout:8/330: write d4/d9/f1c [6497449,114224] 0 2024-04-25T15:58:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/244: sync 2024-04-25T15:58:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:4/340: sync 2024-04-25T15:58:05.785 INFO:tasks.workunit.client.0.smithi087.stdout:1/364: dwrite d3/d12/d14/f31 [0,4194304] 0 2024-04-25T15:58:05.792 INFO:tasks.workunit.client.0.smithi087.stdout:8/331: mknod d4/d1d/d17/d37/c71 0 2024-04-25T15:58:05.795 INFO:tasks.workunit.client.0.smithi087.stdout:0/286: dwrite d1/da/d3e/d54/d34/f4b [0,4194304] 0 2024-04-25T15:58:05.797 INFO:tasks.workunit.client.0.smithi087.stdout:0/287: fdatasync d1/d6/f56 0 2024-04-25T15:58:05.798 INFO:tasks.workunit.client.0.smithi087.stdout:8/332: mkdir d4/d1d/d17/d72 0 2024-04-25T15:58:05.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/288: write d1/d6/d1f/f37 [2497384,1672] 0 2024-04-25T15:58:05.801 INFO:tasks.workunit.client.0.smithi087.stdout:7/245: dwrite d1/d1a/f20 [0,4194304] 0 2024-04-25T15:58:05.802 INFO:tasks.workunit.client.0.smithi087.stdout:6/437: dread d7/f18 [0,4194304] 0 2024-04-25T15:58:05.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/289: fsync d1/d6/d21/f51 0 2024-04-25T15:58:05.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/365: dread d3/d2d/f38 [0,4194304] 0 2024-04-25T15:58:05.804 INFO:tasks.workunit.client.0.smithi087.stdout:4/341: truncate d4/d10/d60/f4b 2880034 0 2024-04-25T15:58:05.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/366: dread - d3/d12/f43 zero size 2024-04-25T15:58:05.806 INFO:tasks.workunit.client.0.smithi087.stdout:6/438: mknod d7/d1a/d41/c99 0 2024-04-25T15:58:05.806 INFO:tasks.workunit.client.0.smithi087.stdout:6/439: stat d7/d1a/d1d/d21/d37/d96 0 2024-04-25T15:58:05.807 INFO:tasks.workunit.client.0.smithi087.stdout:6/440: chown d7/f40 58774 1 2024-04-25T15:58:05.807 INFO:tasks.workunit.client.0.smithi087.stdout:6/441: dread - d7/d1a/d1d/d21/d27/d2c/f68 zero size 2024-04-25T15:58:05.810 INFO:tasks.workunit.client.0.smithi087.stdout:7/246: mknod d1/d4/d18/d36/c4a 0 2024-04-25T15:58:05.810 INFO:tasks.workunit.client.0.smithi087.stdout:4/342: rmdir d4/d10/d60/d56 39 2024-04-25T15:58:05.811 INFO:tasks.workunit.client.0.smithi087.stdout:0/290: symlink d1/da/d3e/d54/d34/d55/l63 0 2024-04-25T15:58:05.811 INFO:tasks.workunit.client.0.smithi087.stdout:4/343: truncate d4/d10/f34 1026675 0 2024-04-25T15:58:05.813 INFO:tasks.workunit.client.0.smithi087.stdout:6/442: symlink d7/d1a/d1d/d21/d27/d2c/l9a 0 2024-04-25T15:58:05.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/443: chown d7/d1a/d1d/d21/f5f 212551 1 2024-04-25T15:58:05.818 INFO:tasks.workunit.client.0.smithi087.stdout:0/291: link d1/d6/d21/f23 d1/da/f64 0 2024-04-25T15:58:05.818 INFO:tasks.workunit.client.0.smithi087.stdout:1/367: dwrite d3/d2d/f38 [4194304,4194304] 0 2024-04-25T15:58:05.824 INFO:tasks.workunit.client.0.smithi087.stdout:4/344: creat d4/d10/d60/d56/d61/d3f/d58/d5e/f70 x:0 0 0 2024-04-25T15:58:05.825 INFO:tasks.workunit.client.0.smithi087.stdout:8/333: truncate d4/d8/dd/d2f/f67 2704877 0 2024-04-25T15:58:05.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/292: mknod d1/da/d3e/c65 0 2024-04-25T15:58:05.827 INFO:tasks.workunit.client.0.smithi087.stdout:4/345: dread - d4/d10/d60/d56/d61/d3f/d58/d5e/f70 zero size 2024-04-25T15:58:05.828 INFO:tasks.workunit.client.0.smithi087.stdout:1/368: dwrite d3/d12/d14/f2b [0,4194304] 0 2024-04-25T15:58:05.831 INFO:tasks.workunit.client.0.smithi087.stdout:0/293: unlink d1/l4e 0 2024-04-25T15:58:05.834 INFO:tasks.workunit.client.0.smithi087.stdout:4/346: dread d4/d10/d60/d52/d66/f43 [4194304,4194304] 0 2024-04-25T15:58:05.837 INFO:tasks.workunit.client.0.smithi087.stdout:8/334: creat d4/f73 x:0 0 0 2024-04-25T15:58:05.838 INFO:tasks.workunit.client.0.smithi087.stdout:7/247: dwrite d1/f19 [0,4194304] 0 2024-04-25T15:58:05.841 INFO:tasks.workunit.client.0.smithi087.stdout:6/444: write d7/d1a/d41/f44 [359156,128980] 0 2024-04-25T15:58:05.842 INFO:tasks.workunit.client.0.smithi087.stdout:7/248: read - d1/d4/d18/d36/d37/f48 zero size 2024-04-25T15:58:05.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/294: dwrite d1/d6/d1f/f40 [0,4194304] 0 2024-04-25T15:58:05.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/347: unlink d4/d10/d60/d52/d66/d15/d13/l5f 0 2024-04-25T15:58:05.845 INFO:tasks.workunit.client.0.smithi087.stdout:8/335: readlink d4/d1d/d17/l24 0 2024-04-25T15:58:05.851 INFO:tasks.workunit.client.0.smithi087.stdout:7/249: creat d1/d9/d26/d45/f4b x:0 0 0 2024-04-25T15:58:05.854 INFO:tasks.workunit.client.0.smithi087.stdout:4/348: dwrite d4/d10/d60/d52/d66/f11 [0,4194304] 0 2024-04-25T15:58:05.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/336: dwrite d4/f73 [0,4194304] 0 2024-04-25T15:58:05.857 INFO:tasks.workunit.client.0.smithi087.stdout:6/445: creat d7/d1a/d1d/d21/d27/d2c/f9b x:0 0 0 2024-04-25T15:58:05.857 INFO:tasks.workunit.client.0.smithi087.stdout:0/295: creat d1/d6/d21/d2a/f66 x:0 0 0 2024-04-25T15:58:05.858 INFO:tasks.workunit.client.0.smithi087.stdout:7/250: mknod d1/d9/d26/c4c 0 2024-04-25T15:58:05.859 INFO:tasks.workunit.client.0.smithi087.stdout:8/337: symlink d4/d8/dd/l74 0 2024-04-25T15:58:05.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/251: rename d1 to d1/d4/d4d 22 2024-04-25T15:58:05.860 INFO:tasks.workunit.client.0.smithi087.stdout:4/349: readlink d4/d10/d60/d56/d61/l19 0 2024-04-25T15:58:05.861 INFO:tasks.workunit.client.0.smithi087.stdout:8/338: write d4/d22/f55 [3570980,30886] 0 2024-04-25T15:58:05.861 INFO:tasks.workunit.client.0.smithi087.stdout:6/446: dread d7/d1a/d7b/f77 [0,4194304] 0 2024-04-25T15:58:05.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/252: mknod d1/d9/d26/d45/c4e 0 2024-04-25T15:58:05.865 INFO:tasks.workunit.client.0.smithi087.stdout:8/339: fsync d4/d1d/d17/f51 0 2024-04-25T15:58:05.869 INFO:tasks.workunit.client.0.smithi087.stdout:8/340: creat d4/d8/dd/d2f/f75 x:0 0 0 2024-04-25T15:58:05.871 INFO:tasks.workunit.client.0.smithi087.stdout:1/369: truncate d3/d12/f70 2712055 0 2024-04-25T15:58:05.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/350: creat d4/d10/d60/f71 x:0 0 0 2024-04-25T15:58:05.874 INFO:tasks.workunit.client.0.smithi087.stdout:0/296: link d1/d27/c5e d1/da/d3e/d54/c67 0 2024-04-25T15:58:05.874 INFO:tasks.workunit.client.0.smithi087.stdout:0/297: readlink d1/l4 0 2024-04-25T15:58:05.875 INFO:tasks.workunit.client.0.smithi087.stdout:8/341: truncate d4/d1d/d17/f2e 191566 0 2024-04-25T15:58:05.876 INFO:tasks.workunit.client.0.smithi087.stdout:0/298: truncate d1/d6/d21/f23 4890400 0 2024-04-25T15:58:05.877 INFO:tasks.workunit.client.0.smithi087.stdout:4/351: rename d4/l2e to d4/d10/d60/d56/d61/d3f/d42/l72 0 2024-04-25T15:58:05.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/299: stat d1/f14 0 2024-04-25T15:58:05.880 INFO:tasks.workunit.client.0.smithi087.stdout:4/352: creat d4/d10/d60/d5c/d3a/f73 x:0 0 0 2024-04-25T15:58:05.882 INFO:tasks.workunit.client.0.smithi087.stdout:0/300: creat d1/d6/d1f/f68 x:0 0 0 2024-04-25T15:58:05.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/342: getdents d4/d8 0 2024-04-25T15:58:05.883 INFO:tasks.workunit.client.0.smithi087.stdout:4/353: fdatasync d4/d10/d60/d52/d66/d15/fc 0 2024-04-25T15:58:05.883 INFO:tasks.workunit.client.0.smithi087.stdout:0/301: rmdir d1/d6/d21 39 2024-04-25T15:58:05.885 INFO:tasks.workunit.client.0.smithi087.stdout:1/370: dread d3/d12/d14/f17 [0,4194304] 0 2024-04-25T15:58:05.885 INFO:tasks.workunit.client.0.smithi087.stdout:8/343: write d4/d1d/d17/f51 [2440449,87494] 0 2024-04-25T15:58:05.886 INFO:tasks.workunit.client.0.smithi087.stdout:4/354: unlink d4/d10/d60/d56/d61/f6e 0 2024-04-25T15:58:05.888 INFO:tasks.workunit.client.0.smithi087.stdout:6/447: truncate d7/d1a/d2a/f69 1360128 0 2024-04-25T15:58:05.888 INFO:tasks.workunit.client.0.smithi087.stdout:4/355: dread - d4/d10/d60/d52/d66/f6f zero size 2024-04-25T15:58:05.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/344: symlink d4/d8/l76 0 2024-04-25T15:58:05.891 INFO:tasks.workunit.client.0.smithi087.stdout:6/448: write d7/d1a/d2a/f7e [617593,74968] 0 2024-04-25T15:58:05.891 INFO:tasks.workunit.client.0.smithi087.stdout:1/371: getdents d3 0 2024-04-25T15:58:05.891 INFO:tasks.workunit.client.0.smithi087.stdout:4/356: mknod d4/d10/d60/c74 0 2024-04-25T15:58:05.893 INFO:tasks.workunit.client.0.smithi087.stdout:8/345: truncate d4/d1d/d14/f6b 155903 0 2024-04-25T15:58:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:6/449: mkdir d7/d1a/d41/d9c 0 2024-04-25T15:58:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:8/346: fsync d4/d1d/d17/f51 0 2024-04-25T15:58:05.895 INFO:tasks.workunit.client.0.smithi087.stdout:0/302: dwrite d1/d6/d1f/f68 [0,4194304] 0 2024-04-25T15:58:05.896 INFO:tasks.workunit.client.0.smithi087.stdout:6/450: readlink d7/d71/l87 0 2024-04-25T15:58:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:4/357: symlink d4/l75 0 2024-04-25T15:58:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/451: truncate d7/d1a/d1d/d21/d27/f73 451445 0 2024-04-25T15:58:05.902 INFO:tasks.workunit.client.0.smithi087.stdout:8/347: rename d4/d22/f44 to d4/d22/d43/d6d/f77 0 2024-04-25T15:58:05.903 INFO:tasks.workunit.client.0.smithi087.stdout:5/402: sync 2024-04-25T15:58:05.907 INFO:tasks.workunit.client.0.smithi087.stdout:6/452: dread d7/d1a/d1d/f60 [0,4194304] 0 2024-04-25T15:58:05.908 INFO:tasks.workunit.client.0.smithi087.stdout:1/372: creat d3/d12/d14/d29/f76 x:0 0 0 2024-04-25T15:58:05.908 INFO:tasks.workunit.client.0.smithi087.stdout:0/303: dwrite d1/d6/d1f/f68 [0,4194304] 0 2024-04-25T15:58:05.909 INFO:tasks.workunit.client.0.smithi087.stdout:6/453: chown d7/d1a/d1d/d8a/c98 12257362 1 2024-04-25T15:58:05.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/358: rename d4/d10/d60/d52/d66/f6f to d4/d10/d60/d56/d61/f76 0 2024-04-25T15:58:05.911 INFO:tasks.workunit.client.0.smithi087.stdout:1/373: chown d3/d12/d14/d29/d67/c6a 0 1 2024-04-25T15:58:05.912 INFO:tasks.workunit.client.0.smithi087.stdout:6/454: write d7/d1a/d41/f55 [1021342,58760] 0 2024-04-25T15:58:05.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/374: truncate d3/f4 3553486 0 2024-04-25T15:58:05.914 INFO:tasks.workunit.client.0.smithi087.stdout:6/455: readlink d7/d1a/d2a/l3b 0 2024-04-25T15:58:05.919 INFO:tasks.workunit.client.0.smithi087.stdout:6/456: write d7/d1a/d1d/d21/d37/f3f [432374,3101] 0 2024-04-25T15:58:05.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/359: dwrite f0 [0,4194304] 0 2024-04-25T15:58:05.923 INFO:tasks.workunit.client.0.smithi087.stdout:8/348: dread d4/d1d/d17/d37/f3b [0,4194304] 0 2024-04-25T15:58:05.925 INFO:tasks.workunit.client.0.smithi087.stdout:0/304: rename d1/d6/d21/d2a/c48 to d1/d6/d21/d4c/c69 0 2024-04-25T15:58:05.926 INFO:tasks.workunit.client.0.smithi087.stdout:1/375: symlink d3/d2d/d6c/l77 0 2024-04-25T15:58:05.928 INFO:tasks.workunit.client.0.smithi087.stdout:4/360: rmdir d4/d10/d60/d52/d66 39 2024-04-25T15:58:05.929 INFO:tasks.workunit.client.0.smithi087.stdout:8/349: rmdir d4/d1d/d3f 39 2024-04-25T15:58:05.930 INFO:tasks.workunit.client.0.smithi087.stdout:4/361: stat d4/d10/d60/d5c/d3a/l6b 0 2024-04-25T15:58:05.930 INFO:tasks.workunit.client.0.smithi087.stdout:5/403: dread d9/d2c/f2e [0,4194304] 0 2024-04-25T15:58:05.931 INFO:tasks.workunit.client.0.smithi087.stdout:8/350: write d4/f4a [355336,82410] 0 2024-04-25T15:58:05.931 INFO:tasks.workunit.client.0.smithi087.stdout:0/305: symlink d1/da/d3e/l6a 0 2024-04-25T15:58:05.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/362: chown d4/d10/d60/d52 254686 1 2024-04-25T15:58:05.932 INFO:tasks.workunit.client.0.smithi087.stdout:1/376: truncate d3/d12/f43 533880 0 2024-04-25T15:58:05.934 INFO:tasks.workunit.client.0.smithi087.stdout:4/363: stat d4/d10/d60/d56/d61/d3f/d58/d5e/f70 0 2024-04-25T15:58:05.934 INFO:tasks.workunit.client.0.smithi087.stdout:6/457: creat d7/d1a/f9d x:0 0 0 2024-04-25T15:58:05.934 INFO:tasks.workunit.client.0.smithi087.stdout:1/377: stat d3/d12/d14/d29/d2f/d53/l2e 0 2024-04-25T15:58:05.936 INFO:tasks.workunit.client.0.smithi087.stdout:6/458: write d7/f40 [3428733,74368] 0 2024-04-25T15:58:05.936 INFO:tasks.workunit.client.0.smithi087.stdout:8/351: rename d4/d9/f1c to d4/d1d/d17/d37/f78 0 2024-04-25T15:58:05.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/404: mkdir d9/d2f/d40/d4d/d7b/d74/d83 0 2024-04-25T15:58:05.939 INFO:tasks.workunit.client.0.smithi087.stdout:1/378: dread d3/d12/d14/d29/d2f/d40/f54 [0,4194304] 0 2024-04-25T15:58:05.940 INFO:tasks.workunit.client.0.smithi087.stdout:8/352: dread d4/d1d/d14/f31 [0,4194304] 0 2024-04-25T15:58:05.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/353: write d4/f4a [126542,35101] 0 2024-04-25T15:58:05.941 INFO:tasks.workunit.client.0.smithi087.stdout:1/379: write d3/d12/d14/d29/d2f/f36 [4126624,83306] 0 2024-04-25T15:58:05.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/459: mknod d7/d1a/d1d/d8a/c9e 0 2024-04-25T15:58:05.943 INFO:tasks.workunit.client.0.smithi087.stdout:1/380: write d3/d12/f19 [3552762,100235] 0 2024-04-25T15:58:05.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/306: write d1/f14 [2890689,15393] 0 2024-04-25T15:58:05.944 INFO:tasks.workunit.client.0.smithi087.stdout:6/460: chown d7/d1a/d41/d9c 2147 1 2024-04-25T15:58:05.944 INFO:tasks.workunit.client.0.smithi087.stdout:5/405: symlink d9/d2f/d40/d4d/l84 0 2024-04-25T15:58:05.945 INFO:tasks.workunit.client.0.smithi087.stdout:6/461: fdatasync d7/d1a/d41/f44 0 2024-04-25T15:58:05.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/364: link d4/f6 d4/d10/d60/d56/d61/f77 0 2024-04-25T15:58:05.952 INFO:tasks.workunit.client.0.smithi087.stdout:0/307: rmdir d1/d6 39 2024-04-25T15:58:05.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/406: dwrite d9/d2f/d40/d4d/d7b/d5c/f5e [0,4194304] 0 2024-04-25T15:58:05.956 INFO:tasks.workunit.client.0.smithi087.stdout:4/365: rmdir d4/d10/d60/d56 39 2024-04-25T15:58:05.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/308: dread - d1/d6/f4d zero size 2024-04-25T15:58:05.962 INFO:tasks.workunit.client.0.smithi087.stdout:5/407: rename d9/l20 to d9/d2f/d40/d4d/d7b/d74/l85 0 2024-04-25T15:58:05.962 INFO:tasks.workunit.client.0.smithi087.stdout:6/462: mknod d7/d1a/d41/d9c/c9f 0 2024-04-25T15:58:05.963 INFO:tasks.workunit.client.0.smithi087.stdout:6/463: chown d7/d71/d59 258816682 1 2024-04-25T15:58:05.965 INFO:tasks.workunit.client.0.smithi087.stdout:0/309: mkdir d1/d6/d21/d4c/d50/d6b 0 2024-04-25T15:58:05.966 INFO:tasks.workunit.client.0.smithi087.stdout:5/408: creat d9/d2f/d3b/f86 x:0 0 0 2024-04-25T15:58:05.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/366: symlink d4/d10/d60/d52/l78 0 2024-04-25T15:58:05.968 INFO:tasks.workunit.client.0.smithi087.stdout:8/354: getdents d4/d1d/d17/d37/d5e 0 2024-04-25T15:58:05.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/367: chown d4/d10/f3c 23717808 1 2024-04-25T15:58:05.970 INFO:tasks.workunit.client.0.smithi087.stdout:0/310: mknod d1/d6/d1f/c6c 0 2024-04-25T15:58:05.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/368: readlink d4/d10/d60/d52/l78 0 2024-04-25T15:58:05.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/381: dwrite d3/d12/d14/d29/d2f/f63 [0,4194304] 0 2024-04-25T15:58:05.978 INFO:tasks.workunit.client.0.smithi087.stdout:4/369: unlink d4/d10/f34 0 2024-04-25T15:58:05.979 INFO:tasks.workunit.client.0.smithi087.stdout:6/464: dread d7/f14 [0,4194304] 0 2024-04-25T15:58:05.979 INFO:tasks.workunit.client.0.smithi087.stdout:5/409: dwrite d9/f1f [0,4194304] 0 2024-04-25T15:58:05.980 INFO:tasks.workunit.client.0.smithi087.stdout:8/355: mknod d4/d8/dd/c79 0 2024-04-25T15:58:05.987 INFO:tasks.workunit.client.0.smithi087.stdout:1/382: symlink d3/d2d/d6c/l78 0 2024-04-25T15:58:05.987 INFO:tasks.workunit.client.0.smithi087.stdout:8/356: chown d4/d22/c30 1499 1 2024-04-25T15:58:05.987 INFO:tasks.workunit.client.0.smithi087.stdout:1/383: stat d3/d12/f43 0 2024-04-25T15:58:05.987 INFO:tasks.workunit.client.0.smithi087.stdout:1/384: readlink d3/d2d/d6c/l78 0 2024-04-25T15:58:05.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/370: rename d4/d10/l25 to d4/d10/d60/d52/d66/l79 0 2024-04-25T15:58:05.988 INFO:tasks.workunit.client.0.smithi087.stdout:1/385: write d3/d12/d14/f31 [2940711,71407] 0 2024-04-25T15:58:05.988 INFO:tasks.workunit.client.0.smithi087.stdout:8/357: rmdir d4/d1d/d17/d37 39 2024-04-25T15:58:05.991 INFO:tasks.workunit.client.0.smithi087.stdout:5/410: write d9/d2f/d40/d4d/d7b/f54 [496618,34920] 0 2024-04-25T15:58:05.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/371: creat d4/d10/f7a x:0 0 0 2024-04-25T15:58:05.994 INFO:tasks.workunit.client.0.smithi087.stdout:4/372: write d4/f16 [2660399,99527] 0 2024-04-25T15:58:05.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/465: rename d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/c92 to d7/d71/d76/ca0 0 2024-04-25T15:58:05.997 INFO:tasks.workunit.client.0.smithi087.stdout:1/386: unlink d3/cc 0 2024-04-25T15:58:05.997 INFO:tasks.workunit.client.0.smithi087.stdout:4/373: dread - d4/d10/d60/d5c/d3a/f73 zero size 2024-04-25T15:58:05.998 INFO:tasks.workunit.client.0.smithi087.stdout:0/311: dread d1/d6/d21/f23 [0,4194304] 0 2024-04-25T15:58:05.999 INFO:tasks.workunit.client.0.smithi087.stdout:8/358: dwrite d4/d22/f55 [0,4194304] 0 2024-04-25T15:58:06.001 INFO:tasks.workunit.client.0.smithi087.stdout:0/312: write d1/d6/f36 [1090209,72616] 0 2024-04-25T15:58:06.001 INFO:tasks.workunit.client.0.smithi087.stdout:8/359: stat d4/l7 0 2024-04-25T15:58:06.001 INFO:tasks.workunit.client.0.smithi087.stdout:4/374: chown d4/d10/d60/d52/d66/d15/l4a 7 1 2024-04-25T15:58:06.001 INFO:tasks.workunit.client.0.smithi087.stdout:4/375: fdatasync d4/d10/d60/f6c 0 2024-04-25T15:58:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:1/387: symlink d3/d12/d14/d29/d3b/l79 0 2024-04-25T15:58:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:8/360: chown d4/d8/dd/f2b 11 1 2024-04-25T15:58:06.004 INFO:tasks.workunit.client.0.smithi087.stdout:6/466: rename d7/d1a/d2a/f69 to d7/d71/d76/fa1 0 2024-04-25T15:58:06.005 INFO:tasks.workunit.client.0.smithi087.stdout:0/313: unlink d1/d6/d1f/f68 0 2024-04-25T15:58:06.007 INFO:tasks.workunit.client.0.smithi087.stdout:8/361: chown d4/d8/c58 27 1 2024-04-25T15:58:06.008 INFO:tasks.workunit.client.0.smithi087.stdout:4/376: write d4/d10/d60/d56/d61/f76 [461124,33814] 0 2024-04-25T15:58:06.009 INFO:tasks.workunit.client.0.smithi087.stdout:1/388: link d3/d12/d14/f4e d3/d12/d14/f7a 0 2024-04-25T15:58:06.011 INFO:tasks.workunit.client.0.smithi087.stdout:8/362: write d4/d22/d43/f61 [416909,4229] 0 2024-04-25T15:58:06.013 INFO:tasks.workunit.client.0.smithi087.stdout:4/377: chown d4/d10/d60/d56/d61/f76 3013 1 2024-04-25T15:58:06.015 INFO:tasks.workunit.client.0.smithi087.stdout:6/467: dwrite d7/d1a/d1d/d21/d27/d2c/d35/f83 [0,4194304] 0 2024-04-25T15:58:06.017 INFO:tasks.workunit.client.0.smithi087.stdout:6/468: stat d7/d1a/d1d/d21/d27/d2c/l9a 0 2024-04-25T15:58:06.017 INFO:tasks.workunit.client.0.smithi087.stdout:6/469: chown d7/d1a/d2a/c46 14 1 2024-04-25T15:58:06.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/378: symlink d4/d10/d60/d52/d66/d15/l7b 0 2024-04-25T15:58:06.023 INFO:tasks.workunit.client.0.smithi087.stdout:1/389: dread d3/d12/d14/d29/d3b/f5e [0,4194304] 0 2024-04-25T15:58:06.023 INFO:tasks.workunit.client.0.smithi087.stdout:5/411: dread f2 [0,4194304] 0 2024-04-25T15:58:06.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/470: dwrite d7/f8 [4194304,4194304] 0 2024-04-25T15:58:06.032 INFO:tasks.workunit.client.0.smithi087.stdout:4/379: link d4/d10/d60/d5c/d3a/f4d d4/f7c 0 2024-04-25T15:58:06.032 INFO:tasks.workunit.client.0.smithi087.stdout:4/380: stat d4/d10/d60/d56/d61/f1f 0 2024-04-25T15:58:06.036 INFO:tasks.workunit.client.0.smithi087.stdout:2/346: sync 2024-04-25T15:58:06.036 INFO:tasks.workunit.client.0.smithi087.stdout:3/332: sync 2024-04-25T15:58:06.036 INFO:tasks.workunit.client.0.smithi087.stdout:9/296: sync 2024-04-25T15:58:06.036 INFO:tasks.workunit.client.0.smithi087.stdout:1/390: mknod d3/d12/c7b 0 2024-04-25T15:58:06.037 INFO:tasks.workunit.client.0.smithi087.stdout:6/471: rmdir d7/d1a/d1d/d8a 39 2024-04-25T15:58:06.038 INFO:tasks.workunit.client.0.smithi087.stdout:6/472: write d7/d1a/d1d/d21/d27/d2c/f9b [151699,116120] 0 2024-04-25T15:58:06.040 INFO:tasks.workunit.client.0.smithi087.stdout:0/314: truncate d1/da/f64 2425822 0 2024-04-25T15:58:06.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/297: rename f0 to d6/f51 0 2024-04-25T15:58:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:2/347: symlink d3/d27/d29/d2d/d40/l63 0 2024-04-25T15:58:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:6/473: dread d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:06.044 INFO:tasks.workunit.client.0.smithi087.stdout:1/391: fdatasync d3/d12/d14/f17 0 2024-04-25T15:58:06.045 INFO:tasks.workunit.client.0.smithi087.stdout:8/363: write d4/d9/f15 [691805,34823] 0 2024-04-25T15:58:06.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/412: link d9/d2f/c3d d9/d2f/d3b/c87 0 2024-04-25T15:58:06.048 INFO:tasks.workunit.client.0.smithi087.stdout:2/348: rmdir d3/d2a/d1c 39 2024-04-25T15:58:06.050 INFO:tasks.workunit.client.0.smithi087.stdout:0/315: symlink d1/l6d 0 2024-04-25T15:58:06.050 INFO:tasks.workunit.client.0.smithi087.stdout:6/474: fdatasync d7/d1a/d1d/d21/d27/d2c/f57 0 2024-04-25T15:58:06.052 INFO:tasks.workunit.client.0.smithi087.stdout:8/364: dread d4/d8/f49 [0,4194304] 0 2024-04-25T15:58:06.056 INFO:tasks.workunit.client.0.smithi087.stdout:4/381: write d4/d10/d60/d5c/d3a/f3e [1328495,55599] 0 2024-04-25T15:58:06.057 INFO:tasks.workunit.client.0.smithi087.stdout:0/316: dread d1/d6/d1f/f40 [0,4194304] 0 2024-04-25T15:58:06.063 INFO:tasks.workunit.client.0.smithi087.stdout:1/392: creat d3/d12/d14/d29/f7c x:0 0 0 2024-04-25T15:58:06.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/382: stat d4/d10/d60/d56/d61/d3f/d58/d5e/f70 0 2024-04-25T15:58:06.063 INFO:tasks.workunit.client.0.smithi087.stdout:6/475: dwrite d7/d1a/d41/f55 [0,4194304] 0 2024-04-25T15:58:06.064 INFO:tasks.workunit.client.0.smithi087.stdout:4/383: write d4/d10/d60/f46 [4194338,66856] 0 2024-04-25T15:58:06.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/298: dwrite d6/d8/f17 [0,4194304] 0 2024-04-25T15:58:06.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/349: rename d3/d2a/d1c/f4b to d3/d27/d29/d2d/d40/f64 0 2024-04-25T15:58:06.066 INFO:tasks.workunit.client.0.smithi087.stdout:8/365: creat d4/d1d/d17/d37/d5e/f7a x:0 0 0 2024-04-25T15:58:06.066 INFO:tasks.workunit.client.0.smithi087.stdout:5/413: write d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a [1153840,69462] 0 2024-04-25T15:58:06.067 INFO:tasks.workunit.client.0.smithi087.stdout:9/299: chown d6/d8/d12/f2f 120450969 1 2024-04-25T15:58:06.069 INFO:tasks.workunit.client.0.smithi087.stdout:5/414: chown d9/d2c/d30 1 1 2024-04-25T15:58:06.069 INFO:tasks.workunit.client.0.smithi087.stdout:0/317: creat d1/da/d3e/d54/d34/f6e x:0 0 0 2024-04-25T15:58:06.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/350: write d3/d20/d4a/f44 [2364640,2720] 0 2024-04-25T15:58:06.070 INFO:tasks.workunit.client.0.smithi087.stdout:1/393: mkdir d3/d12/d4d/d7d 0 2024-04-25T15:58:06.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/384: rmdir d4/d10/d60/d56/d61/d3f 39 2024-04-25T15:58:06.072 INFO:tasks.workunit.client.0.smithi087.stdout:0/318: fdatasync d1/d6/f3b 0 2024-04-25T15:58:06.076 INFO:tasks.workunit.client.0.smithi087.stdout:0/319: fdatasync d1/d6/f8 0 2024-04-25T15:58:06.077 INFO:tasks.workunit.client.0.smithi087.stdout:4/385: mknod d4/d10/d60/d52/d66/c7d 0 2024-04-25T15:58:06.077 INFO:tasks.workunit.client.0.smithi087.stdout:6/476: dwrite d7/f8 [4194304,4194304] 0 2024-04-25T15:58:06.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/415: truncate d9/d2f/d40/d4d/d7b/f51 509940 0 2024-04-25T15:58:06.081 INFO:tasks.workunit.client.0.smithi087.stdout:8/366: dread d4/f28 [0,4194304] 0 2024-04-25T15:58:06.089 INFO:tasks.workunit.client.0.smithi087.stdout:1/394: dread d3/d12/f26 [0,4194304] 0 2024-04-25T15:58:06.090 INFO:tasks.workunit.client.0.smithi087.stdout:4/386: dread d4/d10/d60/d5c/f28 [0,4194304] 0 2024-04-25T15:58:06.094 INFO:tasks.workunit.client.0.smithi087.stdout:2/351: dwrite d3/d2a/d48/f54 [0,4194304] 0 2024-04-25T15:58:06.096 INFO:tasks.workunit.client.0.smithi087.stdout:1/395: creat d3/d12/d4d/f7e x:0 0 0 2024-04-25T15:58:06.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/367: read d4/d1d/d17/f2e [86277,84487] 0 2024-04-25T15:58:06.099 INFO:tasks.workunit.client.0.smithi087.stdout:4/387: read d4/d10/f3c [1857421,55037] 0 2024-04-25T15:58:06.100 INFO:tasks.workunit.client.0.smithi087.stdout:6/477: getdents d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d 0 2024-04-25T15:58:06.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/320: dwrite d1/d6/d21/d2a/f66 [0,4194304] 0 2024-04-25T15:58:06.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/416: dwrite d9/d2f/d3b/f86 [0,4194304] 0 2024-04-25T15:58:06.102 INFO:tasks.workunit.client.0.smithi087.stdout:4/388: dread - d4/f7c zero size 2024-04-25T15:58:06.104 INFO:tasks.workunit.client.0.smithi087.stdout:2/352: write d3/d20/d4a/f44 [3915998,67079] 0 2024-04-25T15:58:06.104 INFO:tasks.workunit.client.0.smithi087.stdout:4/389: readlink d4/l29 0 2024-04-25T15:58:06.104 INFO:tasks.workunit.client.0.smithi087.stdout:8/368: write d4/d9/f15 [3415821,28474] 0 2024-04-25T15:58:06.105 INFO:tasks.workunit.client.0.smithi087.stdout:9/300: dread d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:06.111 INFO:tasks.workunit.client.0.smithi087.stdout:9/301: write d6/d8/d12/f37 [1491961,77676] 0 2024-04-25T15:58:06.114 INFO:tasks.workunit.client.0.smithi087.stdout:0/321: rmdir d1/d6/d21 39 2024-04-25T15:58:06.117 INFO:tasks.workunit.client.0.smithi087.stdout:6/478: write d7/d1a/d1d/d8a/f91 [787738,96652] 0 2024-04-25T15:58:06.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/396: dwrite d3/d12/f26 [0,4194304] 0 2024-04-25T15:58:06.121 INFO:tasks.workunit.client.0.smithi087.stdout:2/353: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:06.123 INFO:tasks.workunit.client.0.smithi087.stdout:8/369: getdents d4/d1d 0 2024-04-25T15:58:06.125 INFO:tasks.workunit.client.0.smithi087.stdout:5/417: dwrite f2 [0,4194304] 0 2024-04-25T15:58:06.126 INFO:tasks.workunit.client.0.smithi087.stdout:7/253: sync 2024-04-25T15:58:06.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/397: unlink d3/d12/d14/d29/d5c/l5f 0 2024-04-25T15:58:06.131 INFO:tasks.workunit.client.0.smithi087.stdout:5/418: stat d9/l27 0 2024-04-25T15:58:06.140 INFO:tasks.workunit.client.0.smithi087.stdout:6/479: link d7/d1a/d41/f74 d7/d1a/d1d/d21/d27/d2c/d35/d45/fa2 0 2024-04-25T15:58:06.142 INFO:tasks.workunit.client.0.smithi087.stdout:9/302: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:06.143 INFO:tasks.workunit.client.0.smithi087.stdout:0/322: dwrite d1/d6/d21/f51 [0,4194304] 0 2024-04-25T15:58:06.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/398: symlink d3/d12/d4d/d7d/l7f 0 2024-04-25T15:58:06.144 INFO:tasks.workunit.client.0.smithi087.stdout:7/254: link d1/d4/d18/d36/c3f d1/d4/d18/d36/d37/c4f 0 2024-04-25T15:58:06.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/390: dread d4/d10/d60/d52/d66/f43 [0,4194304] 0 2024-04-25T15:58:06.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/480: truncate d7/d1a/d7b/f5a 4552122 0 2024-04-25T15:58:06.149 INFO:tasks.workunit.client.0.smithi087.stdout:1/399: write d3/f8 [2930382,97099] 0 2024-04-25T15:58:06.151 INFO:tasks.workunit.client.0.smithi087.stdout:8/370: dwrite d4/d1d/d14/f6b [0,4194304] 0 2024-04-25T15:58:06.154 INFO:tasks.workunit.client.0.smithi087.stdout:0/323: write d1/da/d3e/d54/f20 [602715,22881] 0 2024-04-25T15:58:06.155 INFO:tasks.workunit.client.0.smithi087.stdout:3/333: sync 2024-04-25T15:58:06.155 INFO:tasks.workunit.client.0.smithi087.stdout:9/303: mknod d6/d8/d14/d1d/c52 0 2024-04-25T15:58:06.156 INFO:tasks.workunit.client.0.smithi087.stdout:4/391: fsync d4/d10/d60/d5c/d3a/f67 0 2024-04-25T15:58:06.158 INFO:tasks.workunit.client.0.smithi087.stdout:2/354: truncate d3/d27/f42 3244436 0 2024-04-25T15:58:06.159 INFO:tasks.workunit.client.0.smithi087.stdout:0/324: write d1/f3d [793917,122152] 0 2024-04-25T15:58:06.160 INFO:tasks.workunit.client.0.smithi087.stdout:6/481: chown d7/d1a/d1d/d21/d27/d2c/f9b 1 1 2024-04-25T15:58:06.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/392: read - d4/f5b zero size 2024-04-25T15:58:06.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/419: dwrite d9/d2f/d40/d4d/d7b/f54 [0,4194304] 0 2024-04-25T15:58:06.162 INFO:tasks.workunit.client.0.smithi087.stdout:8/371: symlink d4/d8/dd/l7b 0 2024-04-25T15:58:06.163 INFO:tasks.workunit.client.0.smithi087.stdout:2/355: write d3/d27/f41 [5133980,7969] 0 2024-04-25T15:58:06.163 INFO:tasks.workunit.client.0.smithi087.stdout:3/334: symlink d4/d17/d24/l66 0 2024-04-25T15:58:06.167 INFO:tasks.workunit.client.0.smithi087.stdout:5/420: fdatasync d9/d2c/d30/d56/f78 0 2024-04-25T15:58:06.167 INFO:tasks.workunit.client.0.smithi087.stdout:2/356: dread - d3/d27/d29/d2d/f57 zero size 2024-04-25T15:58:06.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/335: dread - d4/db/d28/d3c/d62/f64 zero size 2024-04-25T15:58:06.168 INFO:tasks.workunit.client.0.smithi087.stdout:8/372: write d4/d1d/d17/d37/f41 [523073,46784] 0 2024-04-25T15:58:06.169 INFO:tasks.workunit.client.0.smithi087.stdout:1/400: link d3/d12/d4d/f51 d3/d12/d14/d29/d2f/d53/f80 0 2024-04-25T15:58:06.173 INFO:tasks.workunit.client.0.smithi087.stdout:2/357: write d3/d27/d29/d4f/f60 [290544,100392] 0 2024-04-25T15:58:06.174 INFO:tasks.workunit.client.0.smithi087.stdout:2/358: stat d3/d27/d29/d2d/d40/l43 0 2024-04-25T15:58:06.175 INFO:tasks.workunit.client.0.smithi087.stdout:9/304: rename d6/d8/f17 to d6/d8/d14/f53 0 2024-04-25T15:58:06.176 INFO:tasks.workunit.client.0.smithi087.stdout:9/305: chown d6/d8/d32/d4c 48 1 2024-04-25T15:58:06.176 INFO:tasks.workunit.client.0.smithi087.stdout:6/482: dwrite d7/d1a/d41/f55 [0,4194304] 0 2024-04-25T15:58:06.179 INFO:tasks.workunit.client.0.smithi087.stdout:8/373: unlink d4/d22/f55 0 2024-04-25T15:58:06.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/393: mkdir d4/d10/d60/d56/d61/d3f/d58/d5e/d7e 0 2024-04-25T15:58:06.179 INFO:tasks.workunit.client.0.smithi087.stdout:7/255: dread d1/d4/d18/d36/f3a [0,4194304] 0 2024-04-25T15:58:06.180 INFO:tasks.workunit.client.0.smithi087.stdout:1/401: mknod d3/d12/d14/d29/d2f/c81 0 2024-04-25T15:58:06.182 INFO:tasks.workunit.client.0.smithi087.stdout:1/402: read d3/d12/d14/d29/d2f/d53/f80 [594984,18643] 0 2024-04-25T15:58:06.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/325: creat d1/d6/d21/d2a/f6f x:0 0 0 2024-04-25T15:58:06.186 INFO:tasks.workunit.client.0.smithi087.stdout:2/359: creat d3/d2a/d48/f65 x:0 0 0 2024-04-25T15:58:06.191 INFO:tasks.workunit.client.0.smithi087.stdout:8/374: write d4/d8/fb [757570,21316] 0 2024-04-25T15:58:06.192 INFO:tasks.workunit.client.0.smithi087.stdout:4/394: unlink d4/d10/d60/d52/d66/d15/l7b 0 2024-04-25T15:58:06.194 INFO:tasks.workunit.client.0.smithi087.stdout:2/360: dwrite d3/d27/d29/f2e [0,4194304] 0 2024-04-25T15:58:06.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/395: read d4/d10/d60/d52/d66/f2c [1009554,60487] 0 2024-04-25T15:58:06.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/306: mknod d6/d8/d32/d4c/d4f/c54 0 2024-04-25T15:58:06.197 INFO:tasks.workunit.client.0.smithi087.stdout:5/421: dread d9/f29 [0,4194304] 0 2024-04-25T15:58:06.199 INFO:tasks.workunit.client.0.smithi087.stdout:5/422: write d9/d2c/d30/d56/f78 [445182,125244] 0 2024-04-25T15:58:06.199 INFO:tasks.workunit.client.0.smithi087.stdout:8/375: rename d4/d9 to d4/d1d/d7c 0 2024-04-25T15:58:06.201 INFO:tasks.workunit.client.0.smithi087.stdout:1/403: mknod d3/d12/c82 0 2024-04-25T15:58:06.206 INFO:tasks.workunit.client.0.smithi087.stdout:2/361: mknod d3/d20/d4a/d47/c66 0 2024-04-25T15:58:06.208 INFO:tasks.workunit.client.0.smithi087.stdout:4/396: write d4/f41 [5135949,46118] 0 2024-04-25T15:58:06.209 INFO:tasks.workunit.client.0.smithi087.stdout:4/397: chown d4/l3d 68531 1 2024-04-25T15:58:06.209 INFO:tasks.workunit.client.0.smithi087.stdout:6/483: creat d7/d1a/fa3 x:0 0 0 2024-04-25T15:58:06.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/484: read - d7/d1a/d1d/d21/d27/d2c/f68 zero size 2024-04-25T15:58:06.211 INFO:tasks.workunit.client.0.smithi087.stdout:1/404: rmdir d3/d12/d14/d33 39 2024-04-25T15:58:06.214 INFO:tasks.workunit.client.0.smithi087.stdout:6/485: symlink d7/d1a/d41/la4 0 2024-04-25T15:58:06.215 INFO:tasks.workunit.client.0.smithi087.stdout:1/405: creat d3/d2d/d6c/f83 x:0 0 0 2024-04-25T15:58:06.216 INFO:tasks.workunit.client.0.smithi087.stdout:7/256: dwrite d1/d1a/f24 [0,4194304] 0 2024-04-25T15:58:06.217 INFO:tasks.workunit.client.0.smithi087.stdout:9/307: link d6/f51 d6/d8/d14/d1d/f55 0 2024-04-25T15:58:06.217 INFO:tasks.workunit.client.0.smithi087.stdout:7/257: readlink d1/d9/lc 0 2024-04-25T15:58:06.217 INFO:tasks.workunit.client.0.smithi087.stdout:7/258: fdatasync d1/d1a/f20 0 2024-04-25T15:58:06.218 INFO:tasks.workunit.client.0.smithi087.stdout:7/259: readlink d1/l21 0 2024-04-25T15:58:06.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/486: rmdir d7/d1a/d1d/d8a 39 2024-04-25T15:58:06.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/260: chown d1/d4/d18 46 1 2024-04-25T15:58:06.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/487: dread - d7/d1a/d1d/d21/d27/d2c/f5d zero size 2024-04-25T15:58:06.221 INFO:tasks.workunit.client.0.smithi087.stdout:1/406: creat d3/d12/d14/d29/d2f/d53/f84 x:0 0 0 2024-04-25T15:58:06.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/261: creat d1/d1a/f50 x:0 0 0 2024-04-25T15:58:06.227 INFO:tasks.workunit.client.0.smithi087.stdout:7/262: dread - d1/d4/d18/f2a zero size 2024-04-25T15:58:06.227 INFO:tasks.workunit.client.0.smithi087.stdout:0/326: write d1/d6/d21/d2a/f19 [2254516,86545] 0 2024-04-25T15:58:06.228 INFO:tasks.workunit.client.0.smithi087.stdout:1/407: mknod d3/d12/d4d/c85 0 2024-04-25T15:58:06.229 INFO:tasks.workunit.client.0.smithi087.stdout:9/308: truncate d6/d8/d14/d1d/f2d 3245097 0 2024-04-25T15:58:06.230 INFO:tasks.workunit.client.0.smithi087.stdout:8/376: dread - d4/d1d/f5b zero size 2024-04-25T15:58:06.231 INFO:tasks.workunit.client.0.smithi087.stdout:1/408: chown d3/d12/d14/d29/d2f/d40/f71 242 1 2024-04-25T15:58:06.231 INFO:tasks.workunit.client.0.smithi087.stdout:9/309: readlink d6/d8/d32/l4a 0 2024-04-25T15:58:06.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/362: write d3/d20/f46 [899649,5485] 0 2024-04-25T15:58:06.232 INFO:tasks.workunit.client.0.smithi087.stdout:7/263: chown d1/d9/d26/l34 7535 1 2024-04-25T15:58:06.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/398: truncate d4/d10/d60/d56/f55 2794963 0 2024-04-25T15:58:06.233 INFO:tasks.workunit.client.0.smithi087.stdout:9/310: write d6/d8/d29/f3f [1238586,25794] 0 2024-04-25T15:58:06.234 INFO:tasks.workunit.client.0.smithi087.stdout:7/264: chown d1/d1a/f50 1 1 2024-04-25T15:58:06.236 INFO:tasks.workunit.client.0.smithi087.stdout:6/488: getdents d7/d1a/d1d/d21/d37 0 2024-04-25T15:58:06.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/409: dread d3/d12/d14/d29/d2f/d40/f54 [0,4194304] 0 2024-04-25T15:58:06.242 INFO:tasks.workunit.client.0.smithi087.stdout:9/311: write d6/d8/d14/d1d/f39 [1997452,127654] 0 2024-04-25T15:58:06.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/399: mknod d4/d10/d60/d5c/d3a/c7f 0 2024-04-25T15:58:06.243 INFO:tasks.workunit.client.0.smithi087.stdout:7/265: mknod d1/d9/d26/d45/c51 0 2024-04-25T15:58:06.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/266: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:06.248 INFO:tasks.workunit.client.0.smithi087.stdout:0/327: link d1/d6/d1f/c49 d1/d4f/c70 0 2024-04-25T15:58:06.253 INFO:tasks.workunit.client.0.smithi087.stdout:2/363: write d3/d27/f42 [2940988,111790] 0 2024-04-25T15:58:06.255 INFO:tasks.workunit.client.0.smithi087.stdout:1/410: mknod d3/d12/d14/d33/c86 0 2024-04-25T15:58:06.255 INFO:tasks.workunit.client.0.smithi087.stdout:1/411: chown d3/f4 235 1 2024-04-25T15:58:06.257 INFO:tasks.workunit.client.0.smithi087.stdout:0/328: symlink d1/da/d3e/l71 0 2024-04-25T15:58:06.257 INFO:tasks.workunit.client.0.smithi087.stdout:0/329: chown d1/d6 1397363 1 2024-04-25T15:58:06.257 INFO:tasks.workunit.client.0.smithi087.stdout:6/489: write d7/d1a/d2a/f3c [1379129,16704] 0 2024-04-25T15:58:06.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/312: creat d6/d8/d48/f56 x:0 0 0 2024-04-25T15:58:06.261 INFO:tasks.workunit.client.0.smithi087.stdout:8/377: unlink d4/d8/dd/c53 0 2024-04-25T15:58:06.264 INFO:tasks.workunit.client.0.smithi087.stdout:0/330: mknod d1/d6/d1f/c72 0 2024-04-25T15:58:06.265 INFO:tasks.workunit.client.0.smithi087.stdout:6/490: rmdir d7/d1a/d1d 39 2024-04-25T15:58:06.285 INFO:tasks.workunit.client.0.smithi087.stdout:9/313: mkdir d6/d8/d32/d57 0 2024-04-25T15:58:06.286 INFO:tasks.workunit.client.0.smithi087.stdout:1/412: creat d3/d12/d14/d29/d2f/d61/f87 x:0 0 0 2024-04-25T15:58:06.286 INFO:tasks.workunit.client.0.smithi087.stdout:7/267: truncate d1/d1a/f24 681818 0 2024-04-25T15:58:06.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/413: read - d3/d12/d14/d29/d2f/d61/f87 zero size 2024-04-25T15:58:06.288 INFO:tasks.workunit.client.0.smithi087.stdout:0/331: rename d1/da/d3e/l71 to d1/da/d3e/d54/l73 0 2024-04-25T15:58:06.288 INFO:tasks.workunit.client.0.smithi087.stdout:4/400: link d4/d10/d60/d52/d66/la d4/d10/d60/d56/d61/l80 0 2024-04-25T15:58:06.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/314: unlink d6/d8/d32/l46 0 2024-04-25T15:58:06.292 INFO:tasks.workunit.client.0.smithi087.stdout:7/268: rmdir d1/d4/d18 39 2024-04-25T15:58:06.294 INFO:tasks.workunit.client.0.smithi087.stdout:1/414: symlink d3/d12/d14/d29/d5c/l88 0 2024-04-25T15:58:06.294 INFO:tasks.workunit.client.0.smithi087.stdout:6/491: dwrite d7/d1a/d1d/d21/d27/d2c/f57 [0,4194304] 0 2024-04-25T15:58:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:6/492: write d7/d1a/d2a/f7e [1523725,63314] 0 2024-04-25T15:58:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:4/401: unlink d4/d10/d60/d56/f4c 0 2024-04-25T15:58:06.298 INFO:tasks.workunit.client.0.smithi087.stdout:9/315: mkdir d6/d8/d29/d3a/d58 0 2024-04-25T15:58:06.299 INFO:tasks.workunit.client.0.smithi087.stdout:0/332: symlink d1/d4f/l74 0 2024-04-25T15:58:06.300 INFO:tasks.workunit.client.0.smithi087.stdout:7/269: truncate d1/f8 136790 0 2024-04-25T15:58:06.301 INFO:tasks.workunit.client.0.smithi087.stdout:1/415: symlink d3/d12/d14/d29/d2f/l89 0 2024-04-25T15:58:06.306 INFO:tasks.workunit.client.0.smithi087.stdout:4/402: creat d4/d10/f81 x:0 0 0 2024-04-25T15:58:06.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/270: dread d1/d4/f40 [0,4194304] 0 2024-04-25T15:58:06.308 INFO:tasks.workunit.client.0.smithi087.stdout:4/403: truncate d4/d10/d60/d5c/d3a/f67 451362 0 2024-04-25T15:58:06.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/333: mknod d1/da/d3e/d54/c75 0 2024-04-25T15:58:06.310 INFO:tasks.workunit.client.0.smithi087.stdout:0/334: chown d1/f61 6499 1 2024-04-25T15:58:06.310 INFO:tasks.workunit.client.0.smithi087.stdout:0/335: write d1/d6/f36 [351269,8963] 0 2024-04-25T15:58:06.311 INFO:tasks.workunit.client.0.smithi087.stdout:1/416: readlink d3/d12/d14/d29/d67/l6e 0 2024-04-25T15:58:06.312 INFO:tasks.workunit.client.0.smithi087.stdout:8/378: link d4/d1d/d17/d37/l6e d4/d8/l7d 0 2024-04-25T15:58:06.314 INFO:tasks.workunit.client.0.smithi087.stdout:8/379: write d4/d8/dd/f11 [3035570,78257] 0 2024-04-25T15:58:06.317 INFO:tasks.workunit.client.0.smithi087.stdout:4/404: dwrite d4/d10/d60/d5c/d3a/f67 [0,4194304] 0 2024-04-25T15:58:06.318 INFO:tasks.workunit.client.0.smithi087.stdout:3/336: sync 2024-04-25T15:58:06.320 INFO:tasks.workunit.client.0.smithi087.stdout:0/336: creat d1/d27/f76 x:0 0 0 2024-04-25T15:58:06.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/337: write d1/f61 [1015302,3140] 0 2024-04-25T15:58:06.322 INFO:tasks.workunit.client.0.smithi087.stdout:8/380: chown d4/d22/d43 1305773267 1 2024-04-25T15:58:06.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/271: unlink d1/d9/c41 0 2024-04-25T15:58:06.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/337: truncate d4/d17/f1b 850611 0 2024-04-25T15:58:06.328 INFO:tasks.workunit.client.0.smithi087.stdout:3/338: write d4/db/d28/f3a [1424874,17910] 0 2024-04-25T15:58:06.328 INFO:tasks.workunit.client.0.smithi087.stdout:9/316: link d6/d8/d14/d1d/f2d d6/d8/d32/f59 0 2024-04-25T15:58:06.330 INFO:tasks.workunit.client.0.smithi087.stdout:7/272: write d1/d4/d18/f2a [244518,27525] 0 2024-04-25T15:58:06.331 INFO:tasks.workunit.client.0.smithi087.stdout:7/273: write d1/f23 [3896924,31502] 0 2024-04-25T15:58:06.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/338: mkdir d1/d6/d77 0 2024-04-25T15:58:06.336 INFO:tasks.workunit.client.0.smithi087.stdout:9/317: creat d6/d8/d12/f5a x:0 0 0 2024-04-25T15:58:06.338 INFO:tasks.workunit.client.0.smithi087.stdout:6/493: truncate d7/d1a/d1d/d21/d27/d2c/d35/f83 1439042 0 2024-04-25T15:58:06.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/339: unlink d1/d6/d21/f52 0 2024-04-25T15:58:06.342 INFO:tasks.workunit.client.0.smithi087.stdout:0/340: dread d1/f3d [0,4194304] 0 2024-04-25T15:58:06.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/318: mkdir d6/d8/d29/d3a/d5b 0 2024-04-25T15:58:06.344 INFO:tasks.workunit.client.0.smithi087.stdout:7/274: mknod d1/d4/d18/d36/c52 0 2024-04-25T15:58:06.344 INFO:tasks.workunit.client.0.smithi087.stdout:0/341: write d1/da/d3e/d54/d34/f6e [970649,73618] 0 2024-04-25T15:58:06.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/342: chown d1/d6/f56 32965558 1 2024-04-25T15:58:06.345 INFO:tasks.workunit.client.0.smithi087.stdout:6/494: unlink d7/d71/d59/l72 0 2024-04-25T15:58:06.346 INFO:tasks.workunit.client.0.smithi087.stdout:4/405: truncate d4/f41 2246663 0 2024-04-25T15:58:06.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/275: rename d1/f23 to d1/d9/d26/f53 0 2024-04-25T15:58:06.352 INFO:tasks.workunit.client.0.smithi087.stdout:6/495: mkdir d7/d71/d59/d90/da5 0 2024-04-25T15:58:06.353 INFO:tasks.workunit.client.0.smithi087.stdout:6/496: chown d7/d1a/d1d/d21/d27/d2c/l33 99841691 1 2024-04-25T15:58:06.355 INFO:tasks.workunit.client.0.smithi087.stdout:4/406: write d4/d10/d60/d52/d66/f43 [1025531,69597] 0 2024-04-25T15:58:06.356 INFO:tasks.workunit.client.0.smithi087.stdout:3/339: truncate d4/d17/f1b 624796 0 2024-04-25T15:58:06.356 INFO:tasks.workunit.client.0.smithi087.stdout:8/381: truncate d4/f28 5467691 0 2024-04-25T15:58:06.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/276: write d1/d4/d18/d36/f3a [2348880,8492] 0 2024-04-25T15:58:06.361 INFO:tasks.workunit.client.0.smithi087.stdout:0/343: dread d1/da/d3e/d54/f20 [0,4194304] 0 2024-04-25T15:58:06.362 INFO:tasks.workunit.client.0.smithi087.stdout:4/407: rename d4/l29 to d4/d10/d60/d56/l82 0 2024-04-25T15:58:06.362 INFO:tasks.workunit.client.0.smithi087.stdout:9/319: dread d6/f1c [0,4194304] 0 2024-04-25T15:58:06.364 INFO:tasks.workunit.client.0.smithi087.stdout:9/320: write d6/f3b [1688686,81066] 0 2024-04-25T15:58:06.366 INFO:tasks.workunit.client.0.smithi087.stdout:9/321: write d6/d8/d32/f4d [437290,72456] 0 2024-04-25T15:58:06.367 INFO:tasks.workunit.client.0.smithi087.stdout:7/277: symlink d1/d1a/l54 0 2024-04-25T15:58:06.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/344: creat d1/da/d3e/d54/d34/d55/f78 x:0 0 0 2024-04-25T15:58:06.372 INFO:tasks.workunit.client.0.smithi087.stdout:4/408: creat d4/d10/d60/d56/d61/d3f/d58/f83 x:0 0 0 2024-04-25T15:58:06.376 INFO:tasks.workunit.client.0.smithi087.stdout:6/497: creat d7/d1a/fa6 x:0 0 0 2024-04-25T15:58:06.377 INFO:tasks.workunit.client.0.smithi087.stdout:9/322: rename d6/d8/d14/d1d/c4b to d6/d8/d32/d4c/d4f/c5c 0 2024-04-25T15:58:06.379 INFO:tasks.workunit.client.0.smithi087.stdout:8/382: dread d4/d8/dd/f11 [0,4194304] 0 2024-04-25T15:58:06.381 INFO:tasks.workunit.client.0.smithi087.stdout:4/409: dread d4/f6 [0,4194304] 0 2024-04-25T15:58:06.381 INFO:tasks.workunit.client.0.smithi087.stdout:0/345: dwrite d1/d6/d21/f23 [0,4194304] 0 2024-04-25T15:58:06.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/410: chown d4/d10/d60/d56/d61 954619 1 2024-04-25T15:58:06.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/278: creat d1/d4/f55 x:0 0 0 2024-04-25T15:58:06.386 INFO:tasks.workunit.client.0.smithi087.stdout:5/423: sync 2024-04-25T15:58:06.387 INFO:tasks.workunit.client.0.smithi087.stdout:9/323: unlink d6/f3b 0 2024-04-25T15:58:06.389 INFO:tasks.workunit.client.0.smithi087.stdout:8/383: mknod d4/d1d/d14/c7e 0 2024-04-25T15:58:06.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/498: creat d7/d1a/d1d/d21/fa7 x:0 0 0 2024-04-25T15:58:06.391 INFO:tasks.workunit.client.0.smithi087.stdout:7/279: mknod d1/d4/d18/d36/d37/c56 0 2024-04-25T15:58:06.391 INFO:tasks.workunit.client.0.smithi087.stdout:6/499: write d7/d1a/d1d/d21/d37/f3f [447056,29584] 0 2024-04-25T15:58:06.392 INFO:tasks.workunit.client.0.smithi087.stdout:9/324: rmdir d6/d8/d12 39 2024-04-25T15:58:06.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/346: mkdir d1/d79 0 2024-04-25T15:58:06.393 INFO:tasks.workunit.client.0.smithi087.stdout:9/325: chown d6/d8/d32 96445 1 2024-04-25T15:58:06.393 INFO:tasks.workunit.client.0.smithi087.stdout:4/411: link d4/f5b d4/d10/d60/d56/f84 0 2024-04-25T15:58:06.393 INFO:tasks.workunit.client.0.smithi087.stdout:0/347: dread - d1/d6/d21/d2a/f6f zero size 2024-04-25T15:58:06.394 INFO:tasks.workunit.client.0.smithi087.stdout:8/384: mkdir d4/d22/d43/d7f 0 2024-04-25T15:58:06.394 INFO:tasks.workunit.client.0.smithi087.stdout:5/424: getdents d9/d2c/d30/d70/d82 0 2024-04-25T15:58:06.396 INFO:tasks.workunit.client.0.smithi087.stdout:0/348: rmdir d1/da/d3e 39 2024-04-25T15:58:06.396 INFO:tasks.workunit.client.0.smithi087.stdout:7/280: write d1/d4/d18/f1b [1744058,107714] 0 2024-04-25T15:58:06.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/425: write d9/f33 [470115,123268] 0 2024-04-25T15:58:06.397 INFO:tasks.workunit.client.0.smithi087.stdout:8/385: creat d4/d8/dd/d2f/f80 x:0 0 0 2024-04-25T15:58:06.398 INFO:tasks.workunit.client.0.smithi087.stdout:6/500: read d7/f8 [3812445,38946] 0 2024-04-25T15:58:06.399 INFO:tasks.workunit.client.0.smithi087.stdout:7/281: write d1/d1a/f50 [177304,43109] 0 2024-04-25T15:58:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:5/426: unlink d9/f33 0 2024-04-25T15:58:06.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/340: truncate d4/d17/f1b 507284 0 2024-04-25T15:58:06.404 INFO:tasks.workunit.client.0.smithi087.stdout:0/349: dread d1/d6/d21/d2a/f19 [0,4194304] 0 2024-04-25T15:58:06.405 INFO:tasks.workunit.client.0.smithi087.stdout:9/326: getdents d6 0 2024-04-25T15:58:06.406 INFO:tasks.workunit.client.0.smithi087.stdout:7/282: mknod d1/d9/d26/c57 0 2024-04-25T15:58:06.406 INFO:tasks.workunit.client.0.smithi087.stdout:3/341: chown d4/f12 3 1 2024-04-25T15:58:06.408 INFO:tasks.workunit.client.0.smithi087.stdout:5/427: creat d9/d2c/d49/d80/f88 x:0 0 0 2024-04-25T15:58:06.408 INFO:tasks.workunit.client.0.smithi087.stdout:6/501: dwrite d7/d71/f61 [0,4194304] 0 2024-04-25T15:58:06.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/386: creat d4/f81 x:0 0 0 2024-04-25T15:58:06.409 INFO:tasks.workunit.client.0.smithi087.stdout:9/327: readlink d6/d8/d12/l25 0 2024-04-25T15:58:06.410 INFO:tasks.workunit.client.0.smithi087.stdout:6/502: fsync d7/d1a/d1d/d21/d37/f3f 0 2024-04-25T15:58:06.411 INFO:tasks.workunit.client.0.smithi087.stdout:7/283: creat d1/d3c/f58 x:0 0 0 2024-04-25T15:58:06.413 INFO:tasks.workunit.client.0.smithi087.stdout:2/364: sync 2024-04-25T15:58:06.413 INFO:tasks.workunit.client.0.smithi087.stdout:1/417: sync 2024-04-25T15:58:06.413 INFO:tasks.workunit.client.0.smithi087.stdout:5/428: creat d9/d2f/d3b/f89 x:0 0 0 2024-04-25T15:58:06.414 INFO:tasks.workunit.client.0.smithi087.stdout:5/429: chown d9/d2c 11051001 1 2024-04-25T15:58:06.416 INFO:tasks.workunit.client.0.smithi087.stdout:2/365: write d3/d20/d4a/f44 [4599262,115470] 0 2024-04-25T15:58:06.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/503: creat d7/d1a/d7b/fa8 x:0 0 0 2024-04-25T15:58:06.418 INFO:tasks.workunit.client.0.smithi087.stdout:2/366: write d3/d27/d29/d4f/f5f [230767,74459] 0 2024-04-25T15:58:06.419 INFO:tasks.workunit.client.0.smithi087.stdout:3/342: mknod d4/db/d28/c67 0 2024-04-25T15:58:06.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/284: mknod d1/d4/d18/c59 0 2024-04-25T15:58:06.421 INFO:tasks.workunit.client.0.smithi087.stdout:8/387: dread d4/d8/dd/f11 [0,4194304] 0 2024-04-25T15:58:06.422 INFO:tasks.workunit.client.0.smithi087.stdout:3/343: dread d4/d14/f3d [0,4194304] 0 2024-04-25T15:58:06.422 INFO:tasks.workunit.client.0.smithi087.stdout:3/344: chown d4 157353230 1 2024-04-25T15:58:06.423 INFO:tasks.workunit.client.0.smithi087.stdout:9/328: fsync d6/d8/d14/d1d/f2d 0 2024-04-25T15:58:06.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/329: readlink d6/d8/d12/l26 0 2024-04-25T15:58:06.424 INFO:tasks.workunit.client.0.smithi087.stdout:4/412: truncate d4/d10/d60/d52/d66/d15/d13/f1b 3610632 0 2024-04-25T15:58:06.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/350: link d1/d6/d21/f23 d1/da/d3e/d54/d34/d55/f7a 0 2024-04-25T15:58:06.426 INFO:tasks.workunit.client.0.smithi087.stdout:0/351: fsync d1/da/d3e/d54/d34/f43 0 2024-04-25T15:58:06.427 INFO:tasks.workunit.client.0.smithi087.stdout:5/430: creat d9/d2f/d40/d4d/d7b/d5c/f8a x:0 0 0 2024-04-25T15:58:06.428 INFO:tasks.workunit.client.0.smithi087.stdout:0/352: write d1/f14 [243231,82981] 0 2024-04-25T15:58:06.429 INFO:tasks.workunit.client.0.smithi087.stdout:7/285: creat d1/d3c/f5a x:0 0 0 2024-04-25T15:58:06.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/353: write d1/da/d3e/d54/f38 [110377,55816] 0 2024-04-25T15:58:06.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/345: rename d4/d17/d24/d29/d58/d59 to d4/d14/d53/d68 0 2024-04-25T15:58:06.437 INFO:tasks.workunit.client.0.smithi087.stdout:8/388: dwrite d4/d1d/d7c/f15 [0,4194304] 0 2024-04-25T15:58:06.438 INFO:tasks.workunit.client.0.smithi087.stdout:6/504: creat d7/d71/d59/d90/da5/fa9 x:0 0 0 2024-04-25T15:58:06.439 INFO:tasks.workunit.client.0.smithi087.stdout:2/367: fsync d3/f7 0 2024-04-25T15:58:06.442 INFO:tasks.workunit.client.0.smithi087.stdout:2/368: chown d3/d20/c4d 8481 1 2024-04-25T15:58:06.443 INFO:tasks.workunit.client.0.smithi087.stdout:2/369: chown d3/d20/c4d 4907 1 2024-04-25T15:58:06.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/346: dwrite d4/db/f47 [0,4194304] 0 2024-04-25T15:58:06.449 INFO:tasks.workunit.client.0.smithi087.stdout:9/330: creat d6/d45/f5d x:0 0 0 2024-04-25T15:58:06.450 INFO:tasks.workunit.client.0.smithi087.stdout:9/331: write d6/d8/f2e [2003287,7231] 0 2024-04-25T15:58:06.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/418: truncate d3/d2d/f38 7771639 0 2024-04-25T15:58:06.452 INFO:tasks.workunit.client.0.smithi087.stdout:5/431: dread d9/f12 [0,4194304] 0 2024-04-25T15:58:06.453 INFO:tasks.workunit.client.0.smithi087.stdout:9/332: write d6/d8/d29/f2a [4130244,19674] 0 2024-04-25T15:58:06.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/505: creat d7/d1a/d1d/d21/d37/faa x:0 0 0 2024-04-25T15:58:06.455 INFO:tasks.workunit.client.0.smithi087.stdout:5/432: chown d9/d2f/d40/d4d/d7b/d74 344693 1 2024-04-25T15:58:06.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/354: dread d1/d6/fe [0,4194304] 0 2024-04-25T15:58:06.459 INFO:tasks.workunit.client.0.smithi087.stdout:5/433: write d9/d2f/d3b/f68 [489382,3598] 0 2024-04-25T15:58:06.459 INFO:tasks.workunit.client.0.smithi087.stdout:9/333: read d6/d8/d12/f43 [3850628,69871] 0 2024-04-25T15:58:06.462 INFO:tasks.workunit.client.0.smithi087.stdout:8/389: dwrite d4/d1d/f59 [0,4194304] 0 2024-04-25T15:58:06.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/506: dread d7/d1a/d1d/d21/d27/d2c/d35/d45/f6e [0,4194304] 0 2024-04-25T15:58:06.468 INFO:tasks.workunit.client.0.smithi087.stdout:4/413: write d4/d10/d60/d52/d66/d15/ff [526640,64679] 0 2024-04-25T15:58:06.470 INFO:tasks.workunit.client.0.smithi087.stdout:5/434: dwrite d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f50 [0,4194304] 0 2024-04-25T15:58:06.472 INFO:tasks.workunit.client.0.smithi087.stdout:0/355: creat d1/d4f/f7b x:0 0 0 2024-04-25T15:58:06.474 INFO:tasks.workunit.client.0.smithi087.stdout:0/356: read d1/da/d3e/d54/d34/d55/f7a [602342,30692] 0 2024-04-25T15:58:06.475 INFO:tasks.workunit.client.0.smithi087.stdout:6/507: dwrite d7/d1a/d1d/d21/d27/d2c/d35/f36 [0,4194304] 0 2024-04-25T15:58:06.475 INFO:tasks.workunit.client.0.smithi087.stdout:2/370: link d3/d27/d29/d4f/f59 d3/d27/d38/f67 0 2024-04-25T15:58:06.476 INFO:tasks.workunit.client.0.smithi087.stdout:0/357: write d1/d6/f4d [683128,100253] 0 2024-04-25T15:58:06.481 INFO:tasks.workunit.client.0.smithi087.stdout:6/508: dwrite d7/fc [0,4194304] 0 2024-04-25T15:58:06.483 INFO:tasks.workunit.client.0.smithi087.stdout:9/334: rename d6/d8/d12/f44 to d6/d8/d29/d3a/d58/f5e 0 2024-04-25T15:58:06.484 INFO:tasks.workunit.client.0.smithi087.stdout:3/347: chown d4/d17/f1b 1 1 2024-04-25T15:58:06.484 INFO:tasks.workunit.client.0.smithi087.stdout:0/358: dread d1/d6/f4d [0,4194304] 0 2024-04-25T15:58:06.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/335: write d6/f1c [1619259,63622] 0 2024-04-25T15:58:06.485 INFO:tasks.workunit.client.0.smithi087.stdout:8/390: readlink d4/l5c 0 2024-04-25T15:58:06.486 INFO:tasks.workunit.client.0.smithi087.stdout:3/348: write d4/db/d28/d3c/f4b [1334343,104367] 0 2024-04-25T15:58:06.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/359: write d1/d6/f8 [61325,52216] 0 2024-04-25T15:58:06.487 INFO:tasks.workunit.client.0.smithi087.stdout:8/391: fdatasync d4/d8/fb 0 2024-04-25T15:58:06.491 INFO:tasks.workunit.client.0.smithi087.stdout:0/360: dread d1/da/d3e/d54/f20 [0,4194304] 0 2024-04-25T15:58:06.492 INFO:tasks.workunit.client.0.smithi087.stdout:4/414: creat d4/d10/d60/d52/d66/f85 x:0 0 0 2024-04-25T15:58:06.493 INFO:tasks.workunit.client.0.smithi087.stdout:7/286: getdents d1/d3c 0 2024-04-25T15:58:06.493 INFO:tasks.workunit.client.0.smithi087.stdout:7/287: chown d1/d3c/l31 1569 1 2024-04-25T15:58:06.500 INFO:tasks.workunit.client.0.smithi087.stdout:3/349: unlink d4/d17/f20 0 2024-04-25T15:58:06.500 INFO:tasks.workunit.client.0.smithi087.stdout:8/392: chown d4/d22/d43/d7f 5136 1 2024-04-25T15:58:06.501 INFO:tasks.workunit.client.0.smithi087.stdout:0/361: mknod d1/d4f/c7c 0 2024-04-25T15:58:06.503 INFO:tasks.workunit.client.0.smithi087.stdout:7/288: creat d1/d9/d26/d45/f5b x:0 0 0 2024-04-25T15:58:06.504 INFO:tasks.workunit.client.0.smithi087.stdout:6/509: mknod d7/cab 0 2024-04-25T15:58:06.505 INFO:tasks.workunit.client.0.smithi087.stdout:2/371: rename d3/d20/d4a/d47/f52 to d3/d27/d29/d2d/d40/f68 0 2024-04-25T15:58:06.506 INFO:tasks.workunit.client.0.smithi087.stdout:6/510: write d7/d1a/d1d/d21/d27/f73 [1145828,110789] 0 2024-04-25T15:58:06.506 INFO:tasks.workunit.client.0.smithi087.stdout:2/372: fsync d3/d27/f31 0 2024-04-25T15:58:06.507 INFO:tasks.workunit.client.0.smithi087.stdout:3/350: symlink d4/db/d28/d5c/l69 0 2024-04-25T15:58:06.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/435: link d9/d2c/d38/l6c d9/d2c/d30/d56/l8b 0 2024-04-25T15:58:06.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/289: creat d1/d9/d26/d45/f5c x:0 0 0 2024-04-25T15:58:06.513 INFO:tasks.workunit.client.0.smithi087.stdout:3/351: write d4/db/f38 [3102624,127327] 0 2024-04-25T15:58:06.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/393: mkdir d4/d1d/d3f/d82 0 2024-04-25T15:58:06.519 INFO:tasks.workunit.client.0.smithi087.stdout:8/394: symlink d4/d1d/d17/d37/l83 0 2024-04-25T15:58:06.520 INFO:tasks.workunit.client.0.smithi087.stdout:5/436: creat d9/d2f/d40/d4d/d7b/d74/d83/f8c x:0 0 0 2024-04-25T15:58:06.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/336: write d6/f51 [3006170,129400] 0 2024-04-25T15:58:06.522 INFO:tasks.workunit.client.0.smithi087.stdout:7/290: dread d1/d9/d26/f53 [0,4194304] 0 2024-04-25T15:58:06.523 INFO:tasks.workunit.client.0.smithi087.stdout:3/352: dwrite d4/d14/d53/d68/f5d [0,4194304] 0 2024-04-25T15:58:06.524 INFO:tasks.workunit.client.0.smithi087.stdout:5/437: write d9/d2f/f3c [111251,85034] 0 2024-04-25T15:58:06.524 INFO:tasks.workunit.client.0.smithi087.stdout:6/511: getdents d7/d71 0 2024-04-25T15:58:06.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/291: write d1/d9/d26/d45/f5b [588150,70684] 0 2024-04-25T15:58:06.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/373: getdents d3/d27/d38 0 2024-04-25T15:58:06.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/337: symlink d6/d8/d32/d4c/d4f/l5f 0 2024-04-25T15:58:06.529 INFO:tasks.workunit.client.0.smithi087.stdout:5/438: readlink d9/d2c/d38/l6c 0 2024-04-25T15:58:06.530 INFO:tasks.workunit.client.0.smithi087.stdout:8/395: creat d4/f84 x:0 0 0 2024-04-25T15:58:06.532 INFO:tasks.workunit.client.0.smithi087.stdout:3/353: creat d4/db/d28/d3c/f6a x:0 0 0 2024-04-25T15:58:06.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/374: rmdir d3/d20 39 2024-04-25T15:58:06.533 INFO:tasks.workunit.client.0.smithi087.stdout:0/362: truncate d1/d6/d21/f51 1335323 0 2024-04-25T15:58:06.535 INFO:tasks.workunit.client.0.smithi087.stdout:4/415: dwrite d4/d10/d60/d52/d66/f2c [0,4194304] 0 2024-04-25T15:58:06.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/439: creat d9/d2f/d40/d4d/d7b/d5c/d63/f8d x:0 0 0 2024-04-25T15:58:06.539 INFO:tasks.workunit.client.0.smithi087.stdout:2/375: rmdir d3/d27/d38 39 2024-04-25T15:58:06.539 INFO:tasks.workunit.client.0.smithi087.stdout:8/396: fsync d4/d8/f64 0 2024-04-25T15:58:06.541 INFO:tasks.workunit.client.0.smithi087.stdout:4/416: creat d4/d10/d60/d5c/f86 x:0 0 0 2024-04-25T15:58:06.542 INFO:tasks.workunit.client.0.smithi087.stdout:6/512: getdents d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d 0 2024-04-25T15:58:06.542 INFO:tasks.workunit.client.0.smithi087.stdout:2/376: write d3/d27/f39 [4464726,104395] 0 2024-04-25T15:58:06.545 INFO:tasks.workunit.client.0.smithi087.stdout:9/338: getdents d6/d8 0 2024-04-25T15:58:06.546 INFO:tasks.workunit.client.0.smithi087.stdout:8/397: unlink d4/d8/f64 0 2024-04-25T15:58:06.549 INFO:tasks.workunit.client.0.smithi087.stdout:0/363: dwrite d1/f58 [0,4194304] 0 2024-04-25T15:58:06.549 INFO:tasks.workunit.client.0.smithi087.stdout:7/292: write d1/d1a/f24 [36691,117386] 0 2024-04-25T15:58:06.555 INFO:tasks.workunit.client.0.smithi087.stdout:8/398: mkdir d4/d8/dd/d85 0 2024-04-25T15:58:06.557 INFO:tasks.workunit.client.0.smithi087.stdout:3/354: dwrite d4/d17/f63 [0,4194304] 0 2024-04-25T15:58:06.557 INFO:tasks.workunit.client.0.smithi087.stdout:6/513: mknod d7/d1a/d1d/d21/d27/d2c/cac 0 2024-04-25T15:58:06.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/399: write d4/d8/dd/f2b [5293212,53391] 0 2024-04-25T15:58:06.559 INFO:tasks.workunit.client.0.smithi087.stdout:9/339: dwrite d6/d8/d29/f3f [0,4194304] 0 2024-04-25T15:58:06.562 INFO:tasks.workunit.client.0.smithi087.stdout:0/364: mkdir d1/d27/d7d 0 2024-04-25T15:58:06.565 INFO:tasks.workunit.client.0.smithi087.stdout:4/417: rename d4/d10/d60/d5c/d6d to d4/d87 0 2024-04-25T15:58:06.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/440: dread d9/d2c/d30/d70/d79/d7d/f73 [4194304,4194304] 0 2024-04-25T15:58:06.571 INFO:tasks.workunit.client.0.smithi087.stdout:7/293: mkdir d1/d4/d18/d36/d5d 0 2024-04-25T15:58:06.571 INFO:tasks.workunit.client.0.smithi087.stdout:6/514: symlink d7/d71/d59/d90/lad 0 2024-04-25T15:58:06.574 INFO:tasks.workunit.client.0.smithi087.stdout:4/418: dwrite d4/d10/d60/f64 [0,4194304] 0 2024-04-25T15:58:06.574 INFO:tasks.workunit.client.0.smithi087.stdout:6/515: write d7/d1a/d1d/d21/d27/f73 [394383,113330] 0 2024-04-25T15:58:06.576 INFO:tasks.workunit.client.0.smithi087.stdout:2/377: getdents d3/d27/d29/d2d 0 2024-04-25T15:58:06.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/365: dread d1/f61 [0,4194304] 0 2024-04-25T15:58:06.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/366: truncate d1/d27/f76 742052 0 2024-04-25T15:58:06.580 INFO:tasks.workunit.client.0.smithi087.stdout:9/340: rename d6/d8/d14 to d6/d8/d29/d3a/d5b/d60 0 2024-04-25T15:58:06.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/441: creat d9/d2c/d30/d70/f8e x:0 0 0 2024-04-25T15:58:06.580 INFO:tasks.workunit.client.0.smithi087.stdout:1/419: sync 2024-04-25T15:58:06.581 INFO:tasks.workunit.client.0.smithi087.stdout:8/400: mkdir d4/d8/dd/d85/d86 0 2024-04-25T15:58:06.581 INFO:tasks.workunit.client.0.smithi087.stdout:7/294: creat d1/d4/d18/d36/d37/f5e x:0 0 0 2024-04-25T15:58:06.582 INFO:tasks.workunit.client.0.smithi087.stdout:5/442: write d9/f16 [2390982,51077] 0 2024-04-25T15:58:06.583 INFO:tasks.workunit.client.0.smithi087.stdout:1/420: write d3/f4 [573603,39134] 0 2024-04-25T15:58:06.584 INFO:tasks.workunit.client.0.smithi087.stdout:5/443: readlink d9/d2c/d30/l31 0 2024-04-25T15:58:06.584 INFO:tasks.workunit.client.0.smithi087.stdout:7/295: write d1/d3c/f58 [335183,63082] 0 2024-04-25T15:58:06.584 INFO:tasks.workunit.client.0.smithi087.stdout:6/516: unlink d7/d1a/d1d/c7f 0 2024-04-25T15:58:06.587 INFO:tasks.workunit.client.0.smithi087.stdout:6/517: fdatasync d7/d1a/f3e 0 2024-04-25T15:58:06.587 INFO:tasks.workunit.client.0.smithi087.stdout:2/378: chown d3/d2a/l26 40887 1 2024-04-25T15:58:06.587 INFO:tasks.workunit.client.0.smithi087.stdout:5/444: write d9/d2f/d3b/f89 [935192,11221] 0 2024-04-25T15:58:06.589 INFO:tasks.workunit.client.0.smithi087.stdout:9/341: dread d6/f1c [4194304,4194304] 0 2024-04-25T15:58:06.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/421: mknod d3/d12/d14/d33/c8a 0 2024-04-25T15:58:06.593 INFO:tasks.workunit.client.0.smithi087.stdout:4/419: dwrite d4/f6 [8388608,4194304] 0 2024-04-25T15:58:06.595 INFO:tasks.workunit.client.0.smithi087.stdout:7/296: symlink d1/d9/d26/l5f 0 2024-04-25T15:58:06.596 INFO:tasks.workunit.client.0.smithi087.stdout:2/379: unlink d3/d2a/d48/l61 0 2024-04-25T15:58:06.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/367: link d1/d6/d21/d2a/f66 d1/d6/d77/f7e 0 2024-04-25T15:58:06.598 INFO:tasks.workunit.client.0.smithi087.stdout:9/342: dwrite d6/d45/f5d [0,4194304] 0 2024-04-25T15:58:06.599 INFO:tasks.workunit.client.0.smithi087.stdout:8/401: symlink d4/d1d/l87 0 2024-04-25T15:58:06.600 INFO:tasks.workunit.client.0.smithi087.stdout:3/355: getdents d4/d17/d24/d29 0 2024-04-25T15:58:06.600 INFO:tasks.workunit.client.0.smithi087.stdout:0/368: truncate d1/d27/f76 1351328 0 2024-04-25T15:58:06.603 INFO:tasks.workunit.client.0.smithi087.stdout:5/445: mkdir d9/d2f/d40/d4d/d7b/d8f 0 2024-04-25T15:58:06.603 INFO:tasks.workunit.client.0.smithi087.stdout:6/518: fsync d7/d1a/d1d/d21/d27/d2c/d35/f50 0 2024-04-25T15:58:06.603 INFO:tasks.workunit.client.0.smithi087.stdout:4/420: rmdir d4/d10/d60/d52/d66 39 2024-04-25T15:58:06.605 INFO:tasks.workunit.client.0.smithi087.stdout:2/380: stat d3/d20/f45 0 2024-04-25T15:58:06.605 INFO:tasks.workunit.client.0.smithi087.stdout:2/381: stat d3/d27/d29/d2d/l56 0 2024-04-25T15:58:06.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/297: rename d1/d4/d18/f1b to d1/d9/d26/f60 0 2024-04-25T15:58:06.608 INFO:tasks.workunit.client.0.smithi087.stdout:5/446: unlink f3 0 2024-04-25T15:58:06.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/519: mknod d7/d1a/d7b/cae 0 2024-04-25T15:58:06.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/356: rename d4/d14/c18 to d4/d14/d53/c6b 0 2024-04-25T15:58:06.615 INFO:tasks.workunit.client.0.smithi087.stdout:8/402: creat d4/d1d/d17/d37/d5e/f88 x:0 0 0 2024-04-25T15:58:06.620 INFO:tasks.workunit.client.0.smithi087.stdout:2/382: rename d3/d27/d29/d2d/c58 to d3/d20/c69 0 2024-04-25T15:58:06.621 INFO:tasks.workunit.client.0.smithi087.stdout:9/343: write d6/d8/d29/d3a/d5b/d60/f53 [4902023,20343] 0 2024-04-25T15:58:06.623 INFO:tasks.workunit.client.0.smithi087.stdout:5/447: symlink d9/d2c/l90 0 2024-04-25T15:58:06.625 INFO:tasks.workunit.client.0.smithi087.stdout:9/344: fsync d6/d8/d29/d3a/d5b/d60/d1d/f55 0 2024-04-25T15:58:06.625 INFO:tasks.workunit.client.0.smithi087.stdout:8/403: unlink d4/d8/dd/d2f/f75 0 2024-04-25T15:58:06.626 INFO:tasks.workunit.client.0.smithi087.stdout:1/422: link d3/d12/d14/c1d d3/d12/d14/d29/d2f/c8b 0 2024-04-25T15:58:06.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/421: dread d4/d10/d60/d52/d66/f32 [0,4194304] 0 2024-04-25T15:58:06.628 INFO:tasks.workunit.client.0.smithi087.stdout:2/383: dwrite d3/d27/f41 [0,4194304] 0 2024-04-25T15:58:06.629 INFO:tasks.workunit.client.0.smithi087.stdout:2/384: write d3/d20/f45 [2299576,127730] 0 2024-04-25T15:58:06.635 INFO:tasks.workunit.client.0.smithi087.stdout:8/404: symlink d4/d8/dd/l89 0 2024-04-25T15:58:06.637 INFO:tasks.workunit.client.0.smithi087.stdout:1/423: creat d3/d12/d4d/d7d/f8c x:0 0 0 2024-04-25T15:58:06.637 INFO:tasks.workunit.client.0.smithi087.stdout:7/298: dwrite d1/d4/f40 [0,4194304] 0 2024-04-25T15:58:06.639 INFO:tasks.workunit.client.0.smithi087.stdout:7/299: dread - d1/d9/d26/d45/f5c zero size 2024-04-25T15:58:06.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/448: rename d9/d2c to d9/d91 0 2024-04-25T15:58:06.642 INFO:tasks.workunit.client.0.smithi087.stdout:6/520: getdents d7/d1a/d1d/d21/d27/d2c/d35 0 2024-04-25T15:58:06.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/405: chown d4/d1d/d7c/f1a 505 1 2024-04-25T15:58:06.646 INFO:tasks.workunit.client.0.smithi087.stdout:4/422: link d4/f4e d4/d10/d60/d56/d61/d3f/d42/f88 0 2024-04-25T15:58:06.647 INFO:tasks.workunit.client.0.smithi087.stdout:5/449: symlink d9/d2f/d3b/l92 0 2024-04-25T15:58:06.648 INFO:tasks.workunit.client.0.smithi087.stdout:5/450: chown d9/d91/f2e 1275809172 1 2024-04-25T15:58:06.648 INFO:tasks.workunit.client.0.smithi087.stdout:2/385: fsync d3/d27/d29/d2d/d40/f64 0 2024-04-25T15:58:06.650 INFO:tasks.workunit.client.0.smithi087.stdout:9/345: creat d6/d8/f61 x:0 0 0 2024-04-25T15:58:06.651 INFO:tasks.workunit.client.0.smithi087.stdout:6/521: symlink d7/d1a/d1d/d21/d37/laf 0 2024-04-25T15:58:06.652 INFO:tasks.workunit.client.0.smithi087.stdout:6/522: fdatasync d7/f12 0 2024-04-25T15:58:06.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/406: write d4/d22/d43/d6d/f77 [3244703,124166] 0 2024-04-25T15:58:06.655 INFO:tasks.workunit.client.0.smithi087.stdout:4/423: dwrite d4/d10/d60/d5c/d3a/f67 [0,4194304] 0 2024-04-25T15:58:06.658 INFO:tasks.workunit.client.0.smithi087.stdout:8/407: mknod d4/d8/dd/d85/c8a 0 2024-04-25T15:58:06.661 INFO:tasks.workunit.client.0.smithi087.stdout:4/424: creat d4/d10/d60/d52/d66/d15/d13/f89 x:0 0 0 2024-04-25T15:58:06.661 INFO:tasks.workunit.client.0.smithi087.stdout:6/523: symlink d7/d1a/d1d/d21/d27/lb0 0 2024-04-25T15:58:06.663 INFO:tasks.workunit.client.0.smithi087.stdout:6/524: fsync d7/d1a/d1d/d21/d27/d2c/f68 0 2024-04-25T15:58:06.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/346: mknod d6/d8/d32/d57/c62 0 2024-04-25T15:58:06.664 INFO:tasks.workunit.client.0.smithi087.stdout:6/525: chown d7/d1a/d1d/d21/d27/d2c/d35/c54 123498479 1 2024-04-25T15:58:06.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/424: getdents d3/d12/d14/d29/d3b 0 2024-04-25T15:58:06.666 INFO:tasks.workunit.client.0.smithi087.stdout:2/386: getdents d3/d27/d29 0 2024-04-25T15:58:06.669 INFO:tasks.workunit.client.0.smithi087.stdout:6/526: symlink d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/lb1 0 2024-04-25T15:58:06.670 INFO:tasks.workunit.client.0.smithi087.stdout:2/387: mkdir d3/d27/d29/d4f/d5a/d6a 0 2024-04-25T15:58:06.672 INFO:tasks.workunit.client.0.smithi087.stdout:1/425: creat d3/d12/f8d x:0 0 0 2024-04-25T15:58:06.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/527: rename d7/d1a/d1d/d21/d27/d2c/f5d to d7/d1a/d1d/d21/d27/d2c/d35/d45/fb2 0 2024-04-25T15:58:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/528: write d7/d1a/d1d/d21/d27/d2c/f5c [4394359,126433] 0 2024-04-25T15:58:06.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/426: unlink d3/d12/d14/d33/c86 0 2024-04-25T15:58:06.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/427: fdatasync d3/d2d/d6c/f83 0 2024-04-25T15:58:06.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/388: dwrite d3/d2a/d48/f54 [0,4194304] 0 2024-04-25T15:58:06.680 INFO:tasks.workunit.client.0.smithi087.stdout:1/428: mkdir d3/d12/d14/d29/d8e 0 2024-04-25T15:58:06.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/389: link d3/d2a/c22 d3/d27/d29/d2d/d40/c6b 0 2024-04-25T15:58:06.684 INFO:tasks.workunit.client.0.smithi087.stdout:4/425: dread d4/d10/d60/d56/d61/d3f/d58/f5a [0,4194304] 0 2024-04-25T15:58:06.687 INFO:tasks.workunit.client.0.smithi087.stdout:4/426: write d4/d10/d60/d52/d66/d15/fc [4106445,49066] 0 2024-04-25T15:58:06.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/429: dwrite d3/d12/d14/d29/f76 [0,4194304] 0 2024-04-25T15:58:06.694 INFO:tasks.workunit.client.0.smithi087.stdout:1/430: unlink d3/d12/c58 0 2024-04-25T15:58:06.695 INFO:tasks.workunit.client.0.smithi087.stdout:1/431: rename d3 to d3/d2d/d6c/d8f 22 2024-04-25T15:58:06.696 INFO:tasks.workunit.client.0.smithi087.stdout:4/427: dwrite f0 [8388608,4194304] 0 2024-04-25T15:58:06.700 INFO:tasks.workunit.client.0.smithi087.stdout:4/428: mkdir d4/d10/d60/d56/d61/d3f/d8a 0 2024-04-25T15:58:06.700 INFO:tasks.workunit.client.0.smithi087.stdout:1/432: getdents d3/d12/d14/d29/d8e 0 2024-04-25T15:58:06.705 INFO:tasks.workunit.client.0.smithi087.stdout:1/433: rename d3/d12/f19 to d3/d12/d14/d29/d3b/f90 0 2024-04-25T15:58:06.708 INFO:tasks.workunit.client.0.smithi087.stdout:4/429: dwrite d4/d10/d60/d52/d66/f2c [0,4194304] 0 2024-04-25T15:58:06.710 INFO:tasks.workunit.client.0.smithi087.stdout:2/390: dread d3/d2a/f14 [0,4194304] 0 2024-04-25T15:58:06.711 INFO:tasks.workunit.client.0.smithi087.stdout:4/430: creat d4/d10/d60/d5c/d3a/f8b x:0 0 0 2024-04-25T15:58:06.712 INFO:tasks.workunit.client.0.smithi087.stdout:2/391: creat d3/d2a/d48/f6c x:0 0 0 2024-04-25T15:58:06.713 INFO:tasks.workunit.client.0.smithi087.stdout:2/392: chown d3/d27/d29/d4f 112217 1 2024-04-25T15:58:06.715 INFO:tasks.workunit.client.0.smithi087.stdout:4/431: mknod d4/d10/d60/d56/d61/c8c 0 2024-04-25T15:58:06.717 INFO:tasks.workunit.client.0.smithi087.stdout:4/432: dread - d4/d10/d60/d56/d61/d3f/d58/d5e/f70 zero size 2024-04-25T15:58:06.717 INFO:tasks.workunit.client.0.smithi087.stdout:2/393: link d3/d27/f41 d3/d27/f6d 0 2024-04-25T15:58:06.723 INFO:tasks.workunit.client.0.smithi087.stdout:4/433: dwrite d4/d10/d60/d5c/d3a/f8b [0,4194304] 0 2024-04-25T15:58:06.736 INFO:tasks.workunit.client.0.smithi087.stdout:8/408: read d4/d22/d43/d6d/f77 [3518242,38970] 0 2024-04-25T15:58:06.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/434: fsync d3/d12/d4d/d7d/f8c 0 2024-04-25T15:58:06.744 INFO:tasks.workunit.client.0.smithi087.stdout:5/451: write d9/fa [2234581,84628] 0 2024-04-25T15:58:06.747 INFO:tasks.workunit.client.0.smithi087.stdout:5/452: mknod d9/d2f/d40/d4d/d7b/d5c/d5f/d44/c93 0 2024-04-25T15:58:06.748 INFO:tasks.workunit.client.0.smithi087.stdout:5/453: stat d9/d2f/d40 0 2024-04-25T15:58:06.750 INFO:tasks.workunit.client.0.smithi087.stdout:9/347: dwrite d6/d8/d32/f59 [0,4194304] 0 2024-04-25T15:58:06.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/454: unlink d9/d91/l90 0 2024-04-25T15:58:06.752 INFO:tasks.workunit.client.0.smithi087.stdout:9/348: mkdir d6/d3e/d63 0 2024-04-25T15:58:06.754 INFO:tasks.workunit.client.0.smithi087.stdout:5/455: mkdir d9/d91/d30/d70/d79/d94 0 2024-04-25T15:58:06.755 INFO:tasks.workunit.client.0.smithi087.stdout:5/456: dread - d9/d2f/d40/d4d/f57 zero size 2024-04-25T15:58:06.755 INFO:tasks.workunit.client.0.smithi087.stdout:9/349: creat d6/d8/d32/f64 x:0 0 0 2024-04-25T15:58:06.759 INFO:tasks.workunit.client.0.smithi087.stdout:9/350: chown d6/d8/d29/l3c 1431 1 2024-04-25T15:58:06.761 INFO:tasks.workunit.client.0.smithi087.stdout:9/351: mknod d6/c65 0 2024-04-25T15:58:06.762 INFO:tasks.workunit.client.0.smithi087.stdout:5/457: dwrite d9/f2d [4194304,4194304] 0 2024-04-25T15:58:06.762 INFO:tasks.workunit.client.0.smithi087.stdout:0/369: sync 2024-04-25T15:58:06.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/394: truncate d3/d27/f3e 3552053 0 2024-04-25T15:58:06.764 INFO:tasks.workunit.client.0.smithi087.stdout:9/352: mkdir d6/d8/d32/d57/d66 0 2024-04-25T15:58:06.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/395: dread - d3/d2a/d48/f65 zero size 2024-04-25T15:58:06.766 INFO:tasks.workunit.client.0.smithi087.stdout:4/434: truncate d4/f16 3149520 0 2024-04-25T15:58:06.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/409: write d4/f65 [1470313,35163] 0 2024-04-25T15:58:06.767 INFO:tasks.workunit.client.0.smithi087.stdout:0/370: read d1/d6/d21/f51 [621279,78720] 0 2024-04-25T15:58:06.768 INFO:tasks.workunit.client.0.smithi087.stdout:2/396: creat d3/d27/d29/f6e x:0 0 0 2024-04-25T15:58:06.770 INFO:tasks.workunit.client.0.smithi087.stdout:5/458: dread d9/f1f [0,4194304] 0 2024-04-25T15:58:06.770 INFO:tasks.workunit.client.0.smithi087.stdout:2/397: read d3/f7 [274092,15682] 0 2024-04-25T15:58:06.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/410: symlink d4/d22/l8b 0 2024-04-25T15:58:06.853 INFO:tasks.workunit.client.0.smithi087.stdout:0/371: truncate d1/da/d3e/d54/d34/d55/f7a 4766939 0 2024-04-25T15:58:06.855 INFO:tasks.workunit.client.0.smithi087.stdout:2/398: dread - d3/d2a/d48/f65 zero size 2024-04-25T15:58:06.864 INFO:tasks.workunit.client.0.smithi087.stdout:0/372: symlink d1/da/d3e/d54/l7f 0 2024-04-25T15:58:06.866 INFO:tasks.workunit.client.0.smithi087.stdout:8/411: truncate d4/d1d/d17/d37/d5e/f88 570605 0 2024-04-25T15:58:06.866 INFO:tasks.workunit.client.0.smithi087.stdout:2/399: unlink d3/d20/c4d 0 2024-04-25T15:58:06.868 INFO:tasks.workunit.client.0.smithi087.stdout:3/357: sync 2024-04-25T15:58:06.870 INFO:tasks.workunit.client.0.smithi087.stdout:4/435: dwrite d4/d10/d60/d56/d61/d3f/d58/f83 [0,4194304] 0 2024-04-25T15:58:06.871 INFO:tasks.workunit.client.0.smithi087.stdout:9/353: dwrite d6/d8/d29/d3a/d5b/d60/d1d/f2d [0,4194304] 0 2024-04-25T15:58:06.873 INFO:tasks.workunit.client.0.smithi087.stdout:0/373: symlink d1/d4f/l80 0 2024-04-25T15:58:06.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/412: write d4/d1d/d17/f2d [429323,81111] 0 2024-04-25T15:58:06.876 INFO:tasks.workunit.client.0.smithi087.stdout:4/436: chown d4/d10/f3c 96368 1 2024-04-25T15:58:06.881 INFO:tasks.workunit.client.0.smithi087.stdout:2/400: symlink d3/d2a/d48/l6f 0 2024-04-25T15:58:06.884 INFO:tasks.workunit.client.0.smithi087.stdout:4/437: chown d4/d10/d60/d52/d66/f2c 58 1 2024-04-25T15:58:06.885 INFO:tasks.workunit.client.0.smithi087.stdout:2/401: chown d3/d20/d4a/l3d 0 1 2024-04-25T15:58:06.889 INFO:tasks.workunit.client.0.smithi087.stdout:3/358: creat d4/db/f6c x:0 0 0 2024-04-25T15:58:06.891 INFO:tasks.workunit.client.0.smithi087.stdout:8/413: dread d4/d1d/d17/f2e [0,4194304] 0 2024-04-25T15:58:06.891 INFO:tasks.workunit.client.0.smithi087.stdout:9/354: truncate d6/d8/d29/d3a/f47 662665 0 2024-04-25T15:58:06.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/438: mkdir d4/d10/d60/d5c/d8d 0 2024-04-25T15:58:06.898 INFO:tasks.workunit.client.0.smithi087.stdout:3/359: creat d4/d14/d23/f6d x:0 0 0 2024-04-25T15:58:06.898 INFO:tasks.workunit.client.0.smithi087.stdout:8/414: symlink d4/d1d/d17/d37/l8c 0 2024-04-25T15:58:06.899 INFO:tasks.workunit.client.0.smithi087.stdout:9/355: write d6/d8/f2e [4515105,103482] 0 2024-04-25T15:58:06.899 INFO:tasks.workunit.client.0.smithi087.stdout:4/439: chown d4/fb 3246 1 2024-04-25T15:58:06.903 INFO:tasks.workunit.client.0.smithi087.stdout:2/402: rename d3/d27/d29/d4f/f60 to d3/d27/d29/d4f/f70 0 2024-04-25T15:58:06.903 INFO:tasks.workunit.client.0.smithi087.stdout:8/415: readlink d4/d1d/d17/d37/d5e/l5f 0 2024-04-25T15:58:06.904 INFO:tasks.workunit.client.0.smithi087.stdout:9/356: write d6/d8/fc [4268392,112324] 0 2024-04-25T15:58:06.906 INFO:tasks.workunit.client.0.smithi087.stdout:8/416: read - d4/f81 zero size 2024-04-25T15:58:06.907 INFO:tasks.workunit.client.0.smithi087.stdout:4/440: creat d4/d10/d60/f8e x:0 0 0 2024-04-25T15:58:06.909 INFO:tasks.workunit.client.0.smithi087.stdout:2/403: truncate d3/d2a/d48/f6c 531119 0 2024-04-25T15:58:06.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/404: fdatasync d3/d2a/d48/f65 0 2024-04-25T15:58:06.915 INFO:tasks.workunit.client.0.smithi087.stdout:4/441: creat d4/d10/d60/d56/d61/d3f/d58/f8f x:0 0 0 2024-04-25T15:58:06.916 INFO:tasks.workunit.client.0.smithi087.stdout:2/405: mknod d3/d2a/d48/c71 0 2024-04-25T15:58:06.918 INFO:tasks.workunit.client.0.smithi087.stdout:2/406: fsync d3/d2a/d48/f65 0 2024-04-25T15:58:06.919 INFO:tasks.workunit.client.0.smithi087.stdout:3/360: dread d4/f3b [0,4194304] 0 2024-04-25T15:58:06.920 INFO:tasks.workunit.client.0.smithi087.stdout:4/442: fdatasync d4/f14 0 2024-04-25T15:58:06.924 INFO:tasks.workunit.client.0.smithi087.stdout:7/300: sync 2024-04-25T15:58:06.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/443: mkdir d4/d10/d60/d5c/d3a/d90 0 2024-04-25T15:58:06.926 INFO:tasks.workunit.client.0.smithi087.stdout:2/407: mknod d3/d27/d29/d2d/d40/c72 0 2024-04-25T15:58:06.927 INFO:tasks.workunit.client.0.smithi087.stdout:8/417: write d4/d1d/d17/d37/f3b [1985035,8181] 0 2024-04-25T15:58:06.930 INFO:tasks.workunit.client.0.smithi087.stdout:9/357: write d6/d8/d29/d3a/f47 [568552,109179] 0 2024-04-25T15:58:06.930 INFO:tasks.workunit.client.0.smithi087.stdout:4/444: creat d4/d10/d60/d56/d61/d3f/f91 x:0 0 0 2024-04-25T15:58:06.932 INFO:tasks.workunit.client.0.smithi087.stdout:7/301: rename d1/d9/d26/d45/f5b to d1/d9/d26/d45/f61 0 2024-04-25T15:58:06.935 INFO:tasks.workunit.client.0.smithi087.stdout:2/408: creat d3/d27/d29/f73 x:0 0 0 2024-04-25T15:58:06.937 INFO:tasks.workunit.client.0.smithi087.stdout:8/418: creat d4/d1d/d3f/f8d x:0 0 0 2024-04-25T15:58:06.937 INFO:tasks.workunit.client.0.smithi087.stdout:9/358: creat d6/d8/d48/f67 x:0 0 0 2024-04-25T15:58:06.940 INFO:tasks.workunit.client.0.smithi087.stdout:4/445: write d4/d10/d60/d52/d66/d15/fe [3579016,97818] 0 2024-04-25T15:58:06.944 INFO:tasks.workunit.client.0.smithi087.stdout:3/361: dwrite d4/db/f6c [0,4194304] 0 2024-04-25T15:58:06.945 INFO:tasks.workunit.client.0.smithi087.stdout:8/419: write d4/d8/dd/f11 [4849064,31972] 0 2024-04-25T15:58:06.946 INFO:tasks.workunit.client.0.smithi087.stdout:9/359: truncate d6/d8/d48/f67 361881 0 2024-04-25T15:58:06.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/446: creat d4/d10/d60/d52/f92 x:0 0 0 2024-04-25T15:58:06.954 INFO:tasks.workunit.client.0.smithi087.stdout:9/360: unlink d6/d8/d32/d4c/d4f/c5c 0 2024-04-25T15:58:06.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/447: stat d4/d10/d60/d5c/d3a/f73 0 2024-04-25T15:58:06.955 INFO:tasks.workunit.client.0.smithi087.stdout:7/302: dwrite d1/f19 [0,4194304] 0 2024-04-25T15:58:06.957 INFO:tasks.workunit.client.0.smithi087.stdout:3/362: link d4/d17/d24/f32 d4/db/d28/f6e 0 2024-04-25T15:58:06.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/363: readlink l0 0 2024-04-25T15:58:06.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/361: unlink d6/d8/d29/d3a/f47 0 2024-04-25T15:58:06.963 INFO:tasks.workunit.client.0.smithi087.stdout:8/420: dwrite d4/d1d/d14/f6b [0,4194304] 0 2024-04-25T15:58:06.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/364: write d4/db/d28/f2f [1790215,99644] 0 2024-04-25T15:58:06.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/303: rename d1/d4/d18/d36/f3a to d1/d1a/f62 0 2024-04-25T15:58:06.967 INFO:tasks.workunit.client.0.smithi087.stdout:7/304: dread - d1/d4/d18/d36/d37/f48 zero size 2024-04-25T15:58:06.969 INFO:tasks.workunit.client.0.smithi087.stdout:4/448: truncate d4/d10/d60/d52/d66/d15/d13/f30 496056 0 2024-04-25T15:58:06.970 INFO:tasks.workunit.client.0.smithi087.stdout:9/362: mknod d6/d8/d29/d3a/d5b/d60/d1d/c68 0 2024-04-25T15:58:06.971 INFO:tasks.workunit.client.0.smithi087.stdout:4/449: truncate d4/d10/f2b 717179 0 2024-04-25T15:58:06.977 INFO:tasks.workunit.client.0.smithi087.stdout:4/450: dread d4/d10/d60/f64 [0,4194304] 0 2024-04-25T15:58:06.978 INFO:tasks.workunit.client.0.smithi087.stdout:3/365: fsync d4/db/d28/f6e 0 2024-04-25T15:58:06.980 INFO:tasks.workunit.client.0.smithi087.stdout:9/363: dwrite d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:06.982 INFO:tasks.workunit.client.0.smithi087.stdout:4/451: symlink d4/d10/d60/l93 0 2024-04-25T15:58:06.986 INFO:tasks.workunit.client.0.smithi087.stdout:4/452: unlink d4/d10/f7a 0 2024-04-25T15:58:06.989 INFO:tasks.workunit.client.0.smithi087.stdout:8/421: truncate d4/d8/dd/f52 117690 0 2024-04-25T15:58:06.991 INFO:tasks.workunit.client.0.smithi087.stdout:4/453: creat d4/d10/d60/d52/d66/d15/d13/f94 x:0 0 0 2024-04-25T15:58:06.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/366: write d4/db/f5b [413195,92108] 0 2024-04-25T15:58:06.993 INFO:tasks.workunit.client.0.smithi087.stdout:9/364: write f2 [111053,103944] 0 2024-04-25T15:58:06.995 INFO:tasks.workunit.client.0.smithi087.stdout:3/367: mknod d4/db/d28/d5c/c6f 0 2024-04-25T15:58:06.997 INFO:tasks.workunit.client.0.smithi087.stdout:4/454: rename d4/d10/d60/d56/d61/f2a to d4/d10/d60/d5c/d3a/f95 0 2024-04-25T15:58:06.998 INFO:tasks.workunit.client.0.smithi087.stdout:9/365: creat d6/d8/d29/d3a/f69 x:0 0 0 2024-04-25T15:58:07.001 INFO:tasks.workunit.client.0.smithi087.stdout:9/366: symlink d6/d8/d29/d3a/d5b/d60/l6a 0 2024-04-25T15:58:07.002 INFO:tasks.workunit.client.0.smithi087.stdout:4/455: creat d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f96 x:0 0 0 2024-04-25T15:58:07.003 INFO:tasks.workunit.client.0.smithi087.stdout:9/367: creat d6/f6b x:0 0 0 2024-04-25T15:58:07.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/368: dwrite d4/db/d28/d3c/d62/f64 [0,4194304] 0 2024-04-25T15:58:07.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/369: chown d4/d14/d37 14560 1 2024-04-25T15:58:07.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/370: fdatasync d4/db/f4d 0 2024-04-25T15:58:07.008 INFO:tasks.workunit.client.0.smithi087.stdout:4/456: rename d4/d10/d60/d52/d66/d15/d13 to d4/d10/d60/d56/d61/d3f/d42/d97 0 2024-04-25T15:58:07.009 INFO:tasks.workunit.client.0.smithi087.stdout:3/371: mknod d4/d14/d37/d51/c70 0 2024-04-25T15:58:07.010 INFO:tasks.workunit.client.0.smithi087.stdout:4/457: readlink d4/d10/l48 0 2024-04-25T15:58:07.012 INFO:tasks.workunit.client.0.smithi087.stdout:4/458: write d4/d10/d60/d56/d61/f76 [1503857,63096] 0 2024-04-25T15:58:07.012 INFO:tasks.workunit.client.0.smithi087.stdout:3/372: write d4/db/d28/d3c/d62/f64 [1666821,92290] 0 2024-04-25T15:58:07.014 INFO:tasks.workunit.client.0.smithi087.stdout:9/368: dwrite d6/d8/d32/f41 [0,4194304] 0 2024-04-25T15:58:07.016 INFO:tasks.workunit.client.0.smithi087.stdout:4/459: truncate d4/d10/d60/d56/d61/d3f/d58/d5e/f70 359147 0 2024-04-25T15:58:07.017 INFO:tasks.workunit.client.0.smithi087.stdout:4/460: chown d4/d10/d60/d52/d66/f5d 277 1 2024-04-25T15:58:07.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/529: sync 2024-04-25T15:58:07.020 INFO:tasks.workunit.client.0.smithi087.stdout:1/435: sync 2024-04-25T15:58:07.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/459: sync 2024-04-25T15:58:07.021 INFO:tasks.workunit.client.0.smithi087.stdout:4/461: symlink d4/d10/d60/d52/d66/l98 0 2024-04-25T15:58:07.021 INFO:tasks.workunit.client.0.smithi087.stdout:6/530: chown d7/d1a/d1d/d21/l63 1 1 2024-04-25T15:58:07.022 INFO:tasks.workunit.client.0.smithi087.stdout:4/462: fdatasync d4/d10/d60/f46 0 2024-04-25T15:58:07.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/460: write d9/d2f/d3b/f86 [1446743,95809] 0 2024-04-25T15:58:07.023 INFO:tasks.workunit.client.0.smithi087.stdout:3/373: rename l2 to d4/db/d28/d3c/l71 0 2024-04-25T15:58:07.025 INFO:tasks.workunit.client.0.smithi087.stdout:4/463: stat d4/d10/d60/d56/d61/l80 0 2024-04-25T15:58:07.027 INFO:tasks.workunit.client.0.smithi087.stdout:1/436: getdents d3 0 2024-04-25T15:58:07.028 INFO:tasks.workunit.client.0.smithi087.stdout:3/374: rename d4/f19 to d4/d14/f72 0 2024-04-25T15:58:07.029 INFO:tasks.workunit.client.0.smithi087.stdout:4/464: mknod d4/d10/d60/d56/d61/d3f/d42/c99 0 2024-04-25T15:58:07.032 INFO:tasks.workunit.client.0.smithi087.stdout:5/461: getdents d9/d2f/d40/d4d/d7b 0 2024-04-25T15:58:07.034 INFO:tasks.workunit.client.0.smithi087.stdout:1/437: creat d3/d12/f91 x:0 0 0 2024-04-25T15:58:07.037 INFO:tasks.workunit.client.0.smithi087.stdout:9/369: truncate d6/d45/f5d 3259938 0 2024-04-25T15:58:07.040 INFO:tasks.workunit.client.0.smithi087.stdout:1/438: dread d3/d12/d14/d29/d2f/d53/f80 [0,4194304] 0 2024-04-25T15:58:07.040 INFO:tasks.workunit.client.0.smithi087.stdout:5/462: dwrite d9/d91/d30/d56/f78 [0,4194304] 0 2024-04-25T15:58:07.042 INFO:tasks.workunit.client.0.smithi087.stdout:4/465: write d4/f41 [1032712,41941] 0 2024-04-25T15:58:07.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/370: read d6/d8/d29/d3a/d5b/d60/f53 [673562,67018] 0 2024-04-25T15:58:07.043 INFO:tasks.workunit.client.0.smithi087.stdout:1/439: dread - d3/d12/d14/d29/d2f/d40/f71 zero size 2024-04-25T15:58:07.047 INFO:tasks.workunit.client.0.smithi087.stdout:1/440: creat d3/d12/d14/d29/d2f/d61/f92 x:0 0 0 2024-04-25T15:58:07.048 INFO:tasks.workunit.client.0.smithi087.stdout:5/463: truncate d9/d91/d30/d70/d79/d7d/f73 9169511 0 2024-04-25T15:58:07.050 INFO:tasks.workunit.client.0.smithi087.stdout:1/441: mkdir d3/d12/d14/d29/d2f/d53/d93 0 2024-04-25T15:58:07.051 INFO:tasks.workunit.client.0.smithi087.stdout:3/375: dwrite d4/db/d28/d3c/d62/f64 [0,4194304] 0 2024-04-25T15:58:07.053 INFO:tasks.workunit.client.0.smithi087.stdout:3/376: readlink d4/db/d28/d3c/d62/l2e 0 2024-04-25T15:58:07.053 INFO:tasks.workunit.client.0.smithi087.stdout:5/464: creat d9/d91/d30/d70/d79/f95 x:0 0 0 2024-04-25T15:58:07.056 INFO:tasks.workunit.client.0.smithi087.stdout:4/466: dwrite d4/d10/d60/d52/d66/f11 [0,4194304] 0 2024-04-25T15:58:07.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/465: symlink d9/d2f/d40/d4d/d7b/d5c/d5f/l96 0 2024-04-25T15:58:07.059 INFO:tasks.workunit.client.0.smithi087.stdout:4/467: rmdir d4/d10/d60/d52/d66/d15 39 2024-04-25T15:58:07.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/466: dread - d9/d91/d30/d70/f8e zero size 2024-04-25T15:58:07.060 INFO:tasks.workunit.client.0.smithi087.stdout:5/467: chown d9/f12 2018299 1 2024-04-25T15:58:07.062 INFO:tasks.workunit.client.0.smithi087.stdout:4/468: mknod d4/d10/d60/d5c/c9a 0 2024-04-25T15:58:07.064 INFO:tasks.workunit.client.0.smithi087.stdout:1/442: dwrite d3/f4 [4194304,4194304] 0 2024-04-25T15:58:07.064 INFO:tasks.workunit.client.0.smithi087.stdout:5/468: creat d9/d91/d38/f97 x:0 0 0 2024-04-25T15:58:07.066 INFO:tasks.workunit.client.0.smithi087.stdout:3/377: write d4/f3b [593225,27708] 0 2024-04-25T15:58:07.068 INFO:tasks.workunit.client.0.smithi087.stdout:4/469: write d4/d10/d60/d52/d66/d15/ff [1216469,70245] 0 2024-04-25T15:58:07.070 INFO:tasks.workunit.client.0.smithi087.stdout:5/469: dread d9/d91/d30/d56/f78 [0,4194304] 0 2024-04-25T15:58:07.071 INFO:tasks.workunit.client.0.smithi087.stdout:1/443: symlink d3/d12/d39/d64/l94 0 2024-04-25T15:58:07.072 INFO:tasks.workunit.client.0.smithi087.stdout:1/444: stat d3/d12/d14/d29/d8e 0 2024-04-25T15:58:07.075 INFO:tasks.workunit.client.0.smithi087.stdout:1/445: chown d3/d12/d14/d29/d2f/c8b 785 1 2024-04-25T15:58:07.076 INFO:tasks.workunit.client.0.smithi087.stdout:4/470: dwrite d4/d10/d60/d56/d61/f1f [4194304,4194304] 0 2024-04-25T15:58:07.076 INFO:tasks.workunit.client.0.smithi087.stdout:1/446: chown d3/d12/d14/d33/c44 1 1 2024-04-25T15:58:07.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/471: dread - d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f96 zero size 2024-04-25T15:58:07.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/472: chown d4/fb 573925186 1 2024-04-25T15:58:07.081 INFO:tasks.workunit.client.0.smithi087.stdout:4/473: truncate d4/d10/d60/d56/d61/d3f/d58/f83 4950256 0 2024-04-25T15:58:07.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/474: mknod d4/d10/d60/d5c/d8d/c9b 0 2024-04-25T15:58:07.088 INFO:tasks.workunit.client.0.smithi087.stdout:1/447: dread d3/d12/f1c [0,4194304] 0 2024-04-25T15:58:07.089 INFO:tasks.workunit.client.0.smithi087.stdout:3/378: dread d4/d17/f2a [0,4194304] 0 2024-04-25T15:58:07.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/475: creat d4/d10/d60/d5c/d8d/f9c x:0 0 0 2024-04-25T15:58:07.090 INFO:tasks.workunit.client.0.smithi087.stdout:1/448: read d3/f8 [4770471,107573] 0 2024-04-25T15:58:07.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/379: dread - d4/d17/f5e zero size 2024-04-25T15:58:07.092 INFO:tasks.workunit.client.0.smithi087.stdout:1/449: readlink d3/d12/d14/d29/d65/l66 0 2024-04-25T15:58:07.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/380: mknod d4/d14/d37/d51/c73 0 2024-04-25T15:58:07.095 INFO:tasks.workunit.client.0.smithi087.stdout:1/450: rename d3/d12/d14/d29/d2f/d53/d93 to d3/d12/d14/d33/d95 0 2024-04-25T15:58:07.096 INFO:tasks.workunit.client.0.smithi087.stdout:1/451: rmdir d3 39 2024-04-25T15:58:07.098 INFO:tasks.workunit.client.0.smithi087.stdout:1/452: chown d3/d12/d14/d29/d2f/d53 0 1 2024-04-25T15:58:07.101 INFO:tasks.workunit.client.0.smithi087.stdout:3/381: dwrite d4/db/d28/d3c/d62/f44 [0,4194304] 0 2024-04-25T15:58:07.102 INFO:tasks.workunit.client.0.smithi087.stdout:1/453: unlink d3/d12/l13 0 2024-04-25T15:58:07.104 INFO:tasks.workunit.client.0.smithi087.stdout:5/470: dread d9/d2f/d40/d4d/d7b/d5c/d63/f66 [0,4194304] 0 2024-04-25T15:58:07.107 INFO:tasks.workunit.client.0.smithi087.stdout:0/374: sync 2024-04-25T15:58:07.107 INFO:tasks.workunit.client.0.smithi087.stdout:5/471: write d9/d2f/d40/f72 [316524,16574] 0 2024-04-25T15:58:07.111 INFO:tasks.workunit.client.0.smithi087.stdout:4/476: dread d4/d10/d60/f4b [0,4194304] 0 2024-04-25T15:58:07.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/382: dwrite d4/d14/d23/f26 [0,4194304] 0 2024-04-25T15:58:07.112 INFO:tasks.workunit.client.0.smithi087.stdout:5/472: creat d9/d91/d30/d56/f98 x:0 0 0 2024-04-25T15:58:07.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/473: mkdir d9/d99 0 2024-04-25T15:58:07.115 INFO:tasks.workunit.client.0.smithi087.stdout:1/454: write d3/d12/d14/f7a [1041125,99298] 0 2024-04-25T15:58:07.116 INFO:tasks.workunit.client.0.smithi087.stdout:0/375: dread d1/da/d3e/d54/d34/d55/f7a [0,4194304] 0 2024-04-25T15:58:07.119 INFO:tasks.workunit.client.0.smithi087.stdout:0/376: dread d1/f61 [0,4194304] 0 2024-04-25T15:58:07.122 INFO:tasks.workunit.client.0.smithi087.stdout:0/377: fdatasync d1/d6/f47 0 2024-04-25T15:58:07.122 INFO:tasks.workunit.client.0.smithi087.stdout:4/477: dread d4/d10/d60/d52/d66/d15/fc [0,4194304] 0 2024-04-25T15:58:07.126 INFO:tasks.workunit.client.0.smithi087.stdout:0/378: getdents d1/d6/d77 0 2024-04-25T15:58:07.191 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:07.202 INFO:tasks.workunit.client.0.smithi087.stdout:4/478: getdents d4/d10/d60/d56/d61/d3f/d42 0 2024-04-25T15:58:07.203 INFO:tasks.workunit.client.0.smithi087.stdout:0/379: creat d1/d6/d21/d4c/d50/f81 x:0 0 0 2024-04-25T15:58:07.205 INFO:tasks.workunit.client.0.smithi087.stdout:0/380: write d1/da/d3e/d54/f2b [4579255,37341] 0 2024-04-25T15:58:07.208 INFO:tasks.workunit.client.0.smithi087.stdout:1/455: dread d3/ff [0,4194304] 0 2024-04-25T15:58:07.209 INFO:tasks.workunit.client.0.smithi087.stdout:0/381: mkdir d1/d6/d21/d4c/d82 0 2024-04-25T15:58:07.211 INFO:tasks.workunit.client.0.smithi087.stdout:4/479: link d4/d10/d60/d56/d61/d3f/d58/d5e/f70 d4/d10/d60/d5c/d3a/f9d 0 2024-04-25T15:58:07.214 INFO:tasks.workunit.client.0.smithi087.stdout:0/382: write d1/d6/f47 [880025,64650] 0 2024-04-25T15:58:07.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/383: write d1/d6/f47 [1931470,16259] 0 2024-04-25T15:58:07.216 INFO:tasks.workunit.client.0.smithi087.stdout:0/384: fsync d1/da/d3e/d54/d34/f6e 0 2024-04-25T15:58:07.217 INFO:tasks.workunit.client.0.smithi087.stdout:1/456: fsync d3/d12/f70 0 2024-04-25T15:58:07.222 INFO:tasks.workunit.client.0.smithi087.stdout:0/385: dread d1/d6/f4d [0,4194304] 0 2024-04-25T15:58:07.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/457: creat d3/d12/d14/d29/f96 x:0 0 0 2024-04-25T15:58:07.228 INFO:tasks.workunit.client.0.smithi087.stdout:1/458: fsync d3/f4 0 2024-04-25T15:58:07.229 INFO:tasks.workunit.client.0.smithi087.stdout:2/409: sync 2024-04-25T15:58:07.229 INFO:tasks.workunit.client.0.smithi087.stdout:7/305: sync 2024-04-25T15:58:07.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/386: dread d1/d6/f47 [0,4194304] 0 2024-04-25T15:58:07.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/480: dread d4/d10/d60/f2f [0,4194304] 0 2024-04-25T15:58:07.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/459: mkdir d3/d12/d14/d29/d65/d97 0 2024-04-25T15:58:07.236 INFO:tasks.workunit.client.0.smithi087.stdout:2/410: creat d3/d27/d38/f74 x:0 0 0 2024-04-25T15:58:07.237 INFO:tasks.workunit.client.0.smithi087.stdout:7/306: symlink d1/d4/d18/d36/l63 0 2024-04-25T15:58:07.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/481: rename d4/d10/d60/d5c/d3a/f4d to d4/d10/f9e 0 2024-04-25T15:58:07.243 INFO:tasks.workunit.client.0.smithi087.stdout:2/411: symlink d3/d2a/d48/l75 0 2024-04-25T15:58:07.244 INFO:tasks.workunit.client.0.smithi087.stdout:0/387: link d1/da/d3e/d54/c75 d1/d6/d77/c83 0 2024-04-25T15:58:07.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/482: mkdir d4/d10/d60/d5c/d8d/d9f 0 2024-04-25T15:58:07.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/483: dread - d4/d10/d60/d52/f57 zero size 2024-04-25T15:58:07.249 INFO:tasks.workunit.client.0.smithi087.stdout:2/412: mkdir d3/d27/d29/d76 0 2024-04-25T15:58:07.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/484: dread d4/d10/d60/d56/d61/d3f/d58/d5e/f70 [0,4194304] 0 2024-04-25T15:58:07.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/460: creat d3/d12/d14/d29/d3b/f98 x:0 0 0 2024-04-25T15:58:07.252 INFO:tasks.workunit.client.0.smithi087.stdout:2/413: chown d3/d27/f42 3 1 2024-04-25T15:58:07.253 INFO:tasks.workunit.client.0.smithi087.stdout:7/307: truncate d1/d1a/f62 755467 0 2024-04-25T15:58:07.253 INFO:tasks.workunit.client.0.smithi087.stdout:1/461: chown d3/d12/d39/d64/l94 44398 1 2024-04-25T15:58:07.257 INFO:tasks.workunit.client.0.smithi087.stdout:2/414: dread d3/d27/f31 [0,4194304] 0 2024-04-25T15:58:07.259 INFO:tasks.workunit.client.0.smithi087.stdout:0/388: dwrite d1/f61 [0,4194304] 0 2024-04-25T15:58:07.263 INFO:tasks.workunit.client.0.smithi087.stdout:1/462: getdents d3/d12/d14/d29/d2f 0 2024-04-25T15:58:07.267 INFO:tasks.workunit.client.0.smithi087.stdout:2/415: mkdir d3/d2a/d48/d77 0 2024-04-25T15:58:07.268 INFO:tasks.workunit.client.0.smithi087.stdout:7/308: dwrite d1/d9/d26/f60 [0,4194304] 0 2024-04-25T15:58:07.268 INFO:tasks.workunit.client.0.smithi087.stdout:4/485: dwrite d4/d10/f51 [4194304,4194304] 0 2024-04-25T15:58:07.276 INFO:tasks.workunit.client.0.smithi087.stdout:0/389: mkdir d1/d27/d7d/d84 0 2024-04-25T15:58:07.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/416: chown d3/d27/l36 10 1 2024-04-25T15:58:07.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/309: dread d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:07.281 INFO:tasks.workunit.client.0.smithi087.stdout:7/310: truncate d1/d3c/f5a 652568 0 2024-04-25T15:58:07.282 INFO:tasks.workunit.client.0.smithi087.stdout:1/463: mknod d3/d12/d14/d29/d8e/c99 0 2024-04-25T15:58:07.283 INFO:tasks.workunit.client.0.smithi087.stdout:2/417: write d3/d27/f31 [715214,68995] 0 2024-04-25T15:58:07.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/390: mkdir d1/da/d3e/d85 0 2024-04-25T15:58:07.284 INFO:tasks.workunit.client.0.smithi087.stdout:4/486: fsync d4/d10/f9e 0 2024-04-25T15:58:07.285 INFO:tasks.workunit.client.0.smithi087.stdout:4/487: stat d4/d10/d60/d56/d61/f1c 0 2024-04-25T15:58:07.286 INFO:tasks.workunit.client.0.smithi087.stdout:7/311: dread d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/464: chown d3/d2d/f38 198595107 1 2024-04-25T15:58:07.289 INFO:tasks.workunit.client.0.smithi087.stdout:1/465: chown d3/d12/d14/d29/d8e 330450627 1 2024-04-25T15:58:07.291 INFO:tasks.workunit.client.0.smithi087.stdout:0/391: symlink d1/d6/d21/d2a/l86 0 2024-04-25T15:58:07.295 INFO:tasks.workunit.client.0.smithi087.stdout:4/488: rename d4/d10/f2b to d4/d10/d60/d56/d61/d3f/d42/d97/fa0 0 2024-04-25T15:58:07.299 INFO:tasks.workunit.client.0.smithi087.stdout:0/392: write d1/d6/d21/d2a/f19 [1057861,112654] 0 2024-04-25T15:58:07.300 INFO:tasks.workunit.client.0.smithi087.stdout:7/312: dwrite d1/d1a/f50 [0,4194304] 0 2024-04-25T15:58:07.302 INFO:tasks.workunit.client.0.smithi087.stdout:2/418: write d3/d27/d29/d2d/d40/f68 [691283,19150] 0 2024-04-25T15:58:07.305 INFO:tasks.workunit.client.0.smithi087.stdout:4/489: truncate d4/d10/d60/d56/d61/d3f/d58/f8f 663308 0 2024-04-25T15:58:07.306 INFO:tasks.workunit.client.0.smithi087.stdout:7/313: rmdir d1/d9/d26/d45 39 2024-04-25T15:58:07.306 INFO:tasks.workunit.client.0.smithi087.stdout:1/466: dwrite d3/d12/d14/d29/d2f/f5d [0,4194304] 0 2024-04-25T15:58:07.308 INFO:tasks.workunit.client.0.smithi087.stdout:1/467: mknod d3/c9a 0 2024-04-25T15:58:07.311 INFO:tasks.workunit.client.0.smithi087.stdout:7/314: read - d1/d9/d26/d45/f4b zero size 2024-04-25T15:58:07.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/419: read d3/f1e [1770686,7474] 0 2024-04-25T15:58:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:4/490: dwrite d4/d10/d60/d56/d61/f77 [0,4194304] 0 2024-04-25T15:58:07.317 INFO:tasks.workunit.client.0.smithi087.stdout:7/315: fdatasync d1/d4/d18/d36/d37/f5e 0 2024-04-25T15:58:07.319 INFO:tasks.workunit.client.0.smithi087.stdout:7/316: write d1/d4/d18/f2a [130517,7363] 0 2024-04-25T15:58:07.321 INFO:tasks.workunit.client.0.smithi087.stdout:4/491: dread d4/d10/d60/d52/d66/f43 [8388608,4194304] 0 2024-04-25T15:58:07.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/468: getdents d3/d12/d14 0 2024-04-25T15:58:07.323 INFO:tasks.workunit.client.0.smithi087.stdout:0/393: mkdir d1/da/d87 0 2024-04-25T15:58:07.328 INFO:tasks.workunit.client.0.smithi087.stdout:4/492: unlink d4/l3d 0 2024-04-25T15:58:07.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/394: creat d1/da/d3e/d54/f88 x:0 0 0 2024-04-25T15:58:07.330 INFO:tasks.workunit.client.0.smithi087.stdout:7/317: dwrite d1/d9/d26/d45/f5c [0,4194304] 0 2024-04-25T15:58:07.330 INFO:tasks.workunit.client.0.smithi087.stdout:1/469: unlink d3/d12/d14/d33/l56 0 2024-04-25T15:58:07.330 INFO:tasks.workunit.client.0.smithi087.stdout:0/395: read d1/d6/f4d [470514,112446] 0 2024-04-25T15:58:07.331 INFO:tasks.workunit.client.0.smithi087.stdout:0/396: fsync d1/f26 0 2024-04-25T15:58:07.332 INFO:tasks.workunit.client.0.smithi087.stdout:0/397: stat d1/d6/fe 0 2024-04-25T15:58:07.333 INFO:tasks.workunit.client.0.smithi087.stdout:7/318: read d1/d4/f12 [241006,130479] 0 2024-04-25T15:58:07.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/319: write d1/d9/d26/d45/f4b [859433,28809] 0 2024-04-25T15:58:07.335 INFO:tasks.workunit.client.0.smithi087.stdout:0/398: unlink d1/l5f 0 2024-04-25T15:58:07.336 INFO:tasks.workunit.client.0.smithi087.stdout:4/493: creat d4/d10/d60/d56/d61/d3f/d8a/fa1 x:0 0 0 2024-04-25T15:58:07.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/320: write d1/d4/f44 [741087,107179] 0 2024-04-25T15:58:07.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/399: write d1/d6/d21/f23 [1366318,128788] 0 2024-04-25T15:58:07.340 INFO:tasks.workunit.client.0.smithi087.stdout:7/321: chown d1/d4/d18/d36/d37/c4f 161301044 1 2024-04-25T15:58:07.341 INFO:tasks.workunit.client.0.smithi087.stdout:4/494: creat d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/fa2 x:0 0 0 2024-04-25T15:58:07.341 INFO:tasks.workunit.client.0.smithi087.stdout:0/400: mknod d1/da/d87/c89 0 2024-04-25T15:58:07.342 INFO:tasks.workunit.client.0.smithi087.stdout:7/322: creat d1/d3c/f64 x:0 0 0 2024-04-25T15:58:07.342 INFO:tasks.workunit.client.0.smithi087.stdout:0/401: fdatasync d1/f3d 0 2024-04-25T15:58:07.344 INFO:tasks.workunit.client.0.smithi087.stdout:0/402: write d1/d6/f3b [1047811,96591] 0 2024-04-25T15:58:07.344 INFO:tasks.workunit.client.0.smithi087.stdout:4/495: symlink d4/d10/d60/d56/d61/d3f/d58/la3 0 2024-04-25T15:58:07.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/403: chown d1/d6/d21/d4c/d50/d6b 213655 1 2024-04-25T15:58:07.345 INFO:tasks.workunit.client.0.smithi087.stdout:7/323: chown d1/d9/l14 9 1 2024-04-25T15:58:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/496: unlink d4/d10/d60/f46 0 2024-04-25T15:58:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/422: sync 2024-04-25T15:58:07.353 INFO:tasks.workunit.client.0.smithi087.stdout:6/531: sync 2024-04-25T15:58:07.358 INFO:tasks.workunit.client.0.smithi087.stdout:4/497: truncate d4/fb 3306607 0 2024-04-25T15:58:07.361 INFO:tasks.workunit.client.0.smithi087.stdout:2/420: dread d3/d2a/f1b [0,4194304] 0 2024-04-25T15:58:07.361 INFO:tasks.workunit.client.0.smithi087.stdout:8/423: unlink d4/f28 0 2024-04-25T15:58:07.361 INFO:tasks.workunit.client.0.smithi087.stdout:2/421: readlink d3/d20/d4a/l3d 0 2024-04-25T15:58:07.361 INFO:tasks.workunit.client.0.smithi087.stdout:0/404: creat d1/d6/d21/d4c/d50/d6b/f8a x:0 0 0 2024-04-25T15:58:07.363 INFO:tasks.workunit.client.0.smithi087.stdout:8/424: truncate d4/d1d/d7c/f1a 4571311 0 2024-04-25T15:58:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.359+0000 7f6f8ec2f640 1 Processor -- start 2024-04-25T15:58:07.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.359+0000 7f6f8ec2f640 1 -- start start 2024-04-25T15:58:07.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/498: rename d4/d10/d60/d56/d61/f77 to d4/d10/d60/d56/d61/d3f/fa4 0 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8ec2f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f88074160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8ec2f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f880746a0 0x7f6f88157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8ec2f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8815ad00 con 0x7f6f880ca290 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8ec2f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8815afe0 con 0x7f6f880746a0 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8ec2f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8815b2c0 con 0x7f6f880c9e80 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f880746a0 0x7f6f88157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f880746a0 0x7f6f88157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58144/0 (socket says 172.21.15.87:58144) 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/1448588041 learned_addr learned my addr 172.21.15.87:0/1448588041 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8c9cb640 1 --2- 172.21.15.87:0/1448588041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f88074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/1448588041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 msgr2=0x7f6f88074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 --2- 172.21.15.87:0/1448588041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f88074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/1448588041 >> v1:172.21.15.155:6789/0 conn(0x7f6f880ca290 legacy=0x7f6f881576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/1448588041 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8815b5a0 con 0x7f6f880746a0 2024-04-25T15:58:07.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f877fe640 1 -- 172.21.15.87:0/1448588041 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363038903 0 0) 0x7f6f8815ad00 con 0x7f6f880ca290 2024-04-25T15:58:07.368 INFO:tasks.workunit.client.0.smithi087.stdout:6/532: creat d7/d1a/d1d/fb3 x:0 0 0 2024-04-25T15:58:07.368 INFO:tasks.workunit.client.0.smithi087.stdout:7/324: getdents d1/d9/d26 0 2024-04-25T15:58:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.363+0000 7f6f8d1cc640 1 --2- 172.21.15.87:0/1448588041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880746a0 0x7f6f88157df0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009e50 tx=0x7f6f8001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8831bcae51efeb8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f877fe640 1 -- 172.21.15.87:0/1448588041 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800a57c0 con 0x7f6f880746a0 2024-04-25T15:58:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f877fe640 1 -- 172.21.15.87:0/1448588041 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f800a5960 con 0x7f6f880746a0 2024-04-25T15:58:07.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f877fe640 1 -- 172.21.15.87:0/1448588041 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800a5d30 con 0x7f6f880746a0 2024-04-25T15:58:07.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/405: mknod d1/d6/d21/d4c/c8b 0 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/1448588041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880746a0 msgr2=0x7f6f88157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/1448588041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880746a0 0x7f6f88157df0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009e50 tx=0x7f6f8001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/1448588041 shutdown_connections 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/1448588041 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880746a0 0x7f6f88157df0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/1448588041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f88074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/1448588041 >> 172.21.15.87:0/1448588041 conn(0x7f6f880ac550 msgr2=0x7f6f880ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/1448588041 shutdown_connections 2024-04-25T15:58:07.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/1448588041 wait complete. 2024-04-25T15:58:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 Processor -- start 2024-04-25T15:58:07.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.367+0000 7f6f8ec2f640 1 -- start start 2024-04-25T15:58:07.373 INFO:tasks.workunit.client.0.smithi087.stdout:6/533: rmdir d7/d1a/d1d/d21 39 2024-04-25T15:58:07.373 INFO:tasks.workunit.client.0.smithi087.stdout:7/325: fdatasync d1/d4/f3d 0 2024-04-25T15:58:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f880746a0 0x7f6f881f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f880ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 0x7f6f88153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f88164710 con 0x7f6f880ae8a0 2024-04-25T15:58:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8806e4f0 con 0x7f6f880746a0 2024-04-25T15:58:07.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f88164890 con 0x7f6f880c9e80 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 0x7f6f88153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 0x7f6f88153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58154/0 (socket says 172.21.15.87:58154) 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/292097422 learned_addr learned my addr 172.21.15.87:0/292097422 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8c9cb640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f880746a0 0x7f6f881f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f87fff640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f880ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 msgr2=0x7f6f880ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f880ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f880746a0 msgr2=0x7f6f881f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f880746a0 0x7f6f881f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 -- 172.21.15.87:0/292097422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f880b0190 con 0x7f6f880ae8a0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8d1cc640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 0x7f6f88153da0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6f8001a510 tx=0x7f6f80019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800bc020 con 0x7f6f880ae8a0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f800b8670 con 0x7f6f880ae8a0 2024-04-25T15:58:07.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f881f40f0 con 0x7f6f880ae8a0 2024-04-25T15:58:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800b8a20 con 0x7f6f880ae8a0 2024-04-25T15:58:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f881f43d0 con 0x7f6f880ae8a0 2024-04-25T15:58:07.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f88069bb0 con 0x7f6f880ae8a0 2024-04-25T15:58:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.371+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6f800bf020 con 0x7f6f880ae8a0 2024-04-25T15:58:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.375+0000 7f6f857fa640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f6c06f400 0x7f6f6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.375+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f6f8012a640 con 0x7f6f880ae8a0 2024-04-25T15:58:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.375+0000 7f6f8c9cb640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f6c06f400 0x7f6f6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.375+0000 7f6f8c9cb640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f6c06f400 0x7f6f6c071910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f880c4ed0 tx=0x7f6f7c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:07.379 INFO:tasks.workunit.client.0.smithi087.stdout:0/406: rename d1/da/l46 to d1/d6/d21/d4c/d50/d6b/l8c 0 2024-04-25T15:58:07.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.379+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f800c6030 con 0x7f6f880ae8a0 2024-04-25T15:58:07.388 INFO:tasks.workunit.client.0.smithi087.stdout:7/326: rename d1/d1a/f24 to d1/d9/f65 0 2024-04-25T15:58:07.388 INFO:tasks.workunit.client.0.smithi087.stdout:2/422: write d3/d27/d29/d2d/d40/f64 [939525,31063] 0 2024-04-25T15:58:07.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/499: chown d4/d10/d60/d56/d61/d3f/d42/d97/f1b 435743695 1 2024-04-25T15:58:07.393 INFO:tasks.workunit.client.0.smithi087.stdout:4/500: dread - d4/f35 zero size 2024-04-25T15:58:07.395 INFO:tasks.workunit.client.0.smithi087.stdout:6/534: mkdir d7/d1a/d1d/d21/d27/d2c/db4 0 2024-04-25T15:58:07.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/425: dwrite d4/d8/dd/f52 [0,4194304] 0 2024-04-25T15:58:07.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/535: chown d7/d1a/d1d/d21/d27/d2c/l4b 44 1 2024-04-25T15:58:07.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/407: truncate d1/d6/d1f/f40 2227408 0 2024-04-25T15:58:07.398 INFO:tasks.workunit.client.0.smithi087.stdout:2/423: getdents d3/d2a/d48/d77 0 2024-04-25T15:58:07.399 INFO:tasks.workunit.client.0.smithi087.stdout:4/501: creat d4/d10/d60/d5c/fa5 x:0 0 0 2024-04-25T15:58:07.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/408: rmdir d1/d6/d21/d4c 39 2024-04-25T15:58:07.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/536: mknod d7/d1a/d1d/d21/d37/d96/cb5 0 2024-04-25T15:58:07.402 INFO:tasks.workunit.client.0.smithi087.stdout:6/537: dread - d7/d71/d59/d90/f95 zero size 2024-04-25T15:58:07.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/426: link d4/d8/dd/f52 d4/d8/f8e 0 2024-04-25T15:58:07.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/424: rename d3/d27/c30 to d3/d20/d4a/d47/c78 0 2024-04-25T15:58:07.409 INFO:tasks.workunit.client.0.smithi087.stdout:0/409: creat d1/d6/d21/d4c/d50/f8d x:0 0 0 2024-04-25T15:58:07.410 INFO:tasks.workunit.client.0.smithi087.stdout:0/410: write d1/d27/f76 [1707354,98807] 0 2024-04-25T15:58:07.411 INFO:tasks.workunit.client.0.smithi087.stdout:0/411: stat d1/d27/d7d 0 2024-04-25T15:58:07.412 INFO:tasks.workunit.client.0.smithi087.stdout:2/425: unlink d3/d27/d29/d2d/d40/f64 0 2024-04-25T15:58:07.414 INFO:tasks.workunit.client.0.smithi087.stdout:8/427: chown d4/d1d/d17/d37/f41 110649 1 2024-04-25T15:58:07.416 INFO:tasks.workunit.client.0.smithi087.stdout:0/412: dread d1/d6/d21/f23 [0,4194304] 0 2024-04-25T15:58:07.416 INFO:tasks.workunit.client.0.smithi087.stdout:0/413: readlink d1/da/d3e/d54/l7f 0 2024-04-25T15:58:07.418 INFO:tasks.workunit.client.0.smithi087.stdout:4/502: rename d4/d10/d60/d56/d61/f76 to d4/d10/d60/fa6 0 2024-04-25T15:58:07.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/538: rename d7/d1a/d1d/d21/d37/c43 to d7/d1a/d41/cb6 0 2024-04-25T15:58:07.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/426: dread d3/d2a/f14 [0,4194304] 0 2024-04-25T15:58:07.424 INFO:tasks.workunit.client.0.smithi087.stdout:6/539: fdatasync d7/d1a/d2a/f3c 0 2024-04-25T15:58:07.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/540: fsync d7/d71/f24 0 2024-04-25T15:58:07.427 INFO:tasks.workunit.client.0.smithi087.stdout:8/428: rename d4/d1d/f4c to d4/d8/dd/d85/d86/f8f 0 2024-04-25T15:58:07.432 INFO:tasks.workunit.client.0.smithi087.stdout:0/414: rename d1/f14 to d1/d6/d21/d4c/d82/f8e 0 2024-04-25T15:58:07.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/427: mkdir d3/d2a/d48/d77/d79 0 2024-04-25T15:58:07.435 INFO:tasks.workunit.client.0.smithi087.stdout:8/429: dwrite d4/f81 [0,4194304] 0 2024-04-25T15:58:07.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/541: symlink d7/d1a/lb7 0 2024-04-25T15:58:07.440 INFO:tasks.workunit.client.0.smithi087.stdout:0/415: dwrite d1/d6/f8 [0,4194304] 0 2024-04-25T15:58:07.440 INFO:tasks.workunit.client.0.smithi087.stdout:8/430: creat d4/d22/f90 x:0 0 0 2024-04-25T15:58:07.445 INFO:tasks.workunit.client.0.smithi087.stdout:2/428: creat d3/d27/d29/f7a x:0 0 0 2024-04-25T15:58:07.447 INFO:tasks.workunit.client.0.smithi087.stdout:8/431: write d4/d1d/d17/d37/d5e/f7a [737801,84478] 0 2024-04-25T15:58:07.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/429: creat d3/d27/d29/d2d/d40/f7b x:0 0 0 2024-04-25T15:58:07.450 INFO:tasks.workunit.client.0.smithi087.stdout:8/432: truncate d4/d1d/d17/f2e 808932 0 2024-04-25T15:58:07.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/416: dwrite d1/d6/f47 [0,4194304] 0 2024-04-25T15:58:07.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/430: rename d3/d27/f6d to d3/d27/d29/f7c 0 2024-04-25T15:58:07.460 INFO:tasks.workunit.client.0.smithi087.stdout:2/431: creat d3/d27/d29/d2d/f7d x:0 0 0 2024-04-25T15:58:07.467 INFO:tasks.workunit.client.0.smithi087.stdout:0/417: rename d1/d6/d21/d4c/c69 to d1/d6/c8f 0 2024-04-25T15:58:07.468 INFO:tasks.workunit.client.0.smithi087.stdout:0/418: read d1/d6/f47 [2782171,127445] 0 2024-04-25T15:58:07.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/433: dread d4/d1d/d17/d37/f3b [0,4194304] 0 2024-04-25T15:58:07.469 INFO:tasks.workunit.client.0.smithi087.stdout:0/419: truncate d1/f58 4336490 0 2024-04-25T15:58:07.470 INFO:tasks.workunit.client.0.smithi087.stdout:8/434: fsync d4/d1d/d17/d37/d5e/f88 0 2024-04-25T15:58:07.474 INFO:tasks.workunit.client.0.smithi087.stdout:8/435: creat d4/d1d/d17/f91 x:0 0 0 2024-04-25T15:58:07.481 INFO:tasks.workunit.client.0.smithi087.stdout:8/436: truncate d4/d8/f6a 2095729 0 2024-04-25T15:58:07.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/437: write d4/d22/d43/f61 [638021,19892] 0 2024-04-25T15:58:07.484 INFO:tasks.workunit.client.0.smithi087.stdout:0/420: dread d1/d6/d21/d4c/d82/f8e [0,4194304] 0 2024-04-25T15:58:07.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/438: rmdir d4/d8/dd 39 2024-04-25T15:58:07.486 INFO:tasks.workunit.client.0.smithi087.stdout:8/439: creat d4/d1d/d14/f92 x:0 0 0 2024-04-25T15:58:07.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/421: symlink d1/da/d3e/d54/d34/d55/l90 0 2024-04-25T15:58:07.489 INFO:tasks.workunit.client.0.smithi087.stdout:8/440: symlink d4/d8/dd/l93 0 2024-04-25T15:58:07.491 INFO:tasks.workunit.client.0.smithi087.stdout:0/422: creat d1/da/d3e/d54/f91 x:0 0 0 2024-04-25T15:58:07.492 INFO:tasks.workunit.client.0.smithi087.stdout:0/423: chown d1/d6/d1f/f40 41 1 2024-04-25T15:58:07.493 INFO:tasks.workunit.client.0.smithi087.stdout:8/441: dread d4/d8/dd/f52 [0,4194304] 0 2024-04-25T15:58:07.497 INFO:tasks.workunit.client.0.smithi087.stdout:0/424: getdents d1/d6 0 2024-04-25T15:58:07.499 INFO:tasks.workunit.client.0.smithi087.stdout:0/425: fsync d1/d6/f4d 0 2024-04-25T15:58:07.504 INFO:tasks.workunit.client.0.smithi087.stdout:0/426: link d1/da/d3e/d54/f2b d1/f92 0 2024-04-25T15:58:07.505 INFO:tasks.workunit.client.0.smithi087.stdout:9/371: sync 2024-04-25T15:58:07.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/383: sync 2024-04-25T15:58:07.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/384: stat d4/d14/d23 0 2024-04-25T15:58:07.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/372: dread - d6/d8/d29/d3a/f40 zero size 2024-04-25T15:58:07.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/442: truncate d4/d1d/d7c/f15 1161256 0 2024-04-25T15:58:07.508 INFO:tasks.workunit.client.0.smithi087.stdout:8/443: dread d4/d1d/d17/d37/f3b [4194304,4194304] 0 2024-04-25T15:58:07.511 INFO:tasks.workunit.client.0.smithi087.stdout:3/385: rename d4/d14/f72 to d4/d17/f74 0 2024-04-25T15:58:07.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/386: readlink d4/d17/l1d 0 2024-04-25T15:58:07.516 INFO:tasks.workunit.client.0.smithi087.stdout:9/373: dwrite d6/d8/d32/f35 [4194304,4194304] 0 2024-04-25T15:58:07.518 INFO:tasks.workunit.client.0.smithi087.stdout:8/444: getdents d4/d22/d43 0 2024-04-25T15:58:07.518 INFO:tasks.workunit.client.0.smithi087.stdout:3/387: rmdir d4/db/d28 39 2024-04-25T15:58:07.522 INFO:tasks.workunit.client.0.smithi087.stdout:0/427: dwrite d1/d6/d1f/f40 [0,4194304] 0 2024-04-25T15:58:07.524 INFO:tasks.workunit.client.0.smithi087.stdout:0/428: chown d1/da/d3e/d54/d34/d55 83655 1 2024-04-25T15:58:07.525 INFO:tasks.workunit.client.0.smithi087.stdout:3/388: creat d4/d14/d53/f75 x:0 0 0 2024-04-25T15:58:07.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/374: truncate d6/d8/d12/f2f 4677445 0 2024-04-25T15:58:07.530 INFO:tasks.workunit.client.0.smithi087.stdout:0/429: getdents d1/d6 0 2024-04-25T15:58:07.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/445: dwrite d4/f4a [0,4194304] 0 2024-04-25T15:58:07.533 INFO:tasks.workunit.client.0.smithi087.stdout:9/375: creat d6/d8/d29/d3a/d5b/d60/d1d/f6c x:0 0 0 2024-04-25T15:58:07.536 INFO:tasks.workunit.client.0.smithi087.stdout:8/446: mkdir d4/d22/d43/d7f/d94 0 2024-04-25T15:58:07.536 INFO:tasks.workunit.client.0.smithi087.stdout:8/447: chown d4/d1d/d3f/d82 115893056 1 2024-04-25T15:58:07.538 INFO:tasks.workunit.client.0.smithi087.stdout:9/376: link f2 d6/d8/d48/f6d 0 2024-04-25T15:58:07.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/430: dwrite d1/f58 [0,4194304] 0 2024-04-25T15:58:07.543 INFO:tasks.workunit.client.0.smithi087.stdout:9/377: write d6/d8/d29/d3a/d5b/d60/d1d/f36 [2307131,49782] 0 2024-04-25T15:58:07.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/448: creat d4/f95 x:0 0 0 2024-04-25T15:58:07.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/449: readlink d4/d1d/l87 0 2024-04-25T15:58:07.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/431: creat d1/d27/d7d/f93 x:0 0 0 2024-04-25T15:58:07.547 INFO:tasks.workunit.client.0.smithi087.stdout:9/378: truncate d6/d8/d48/f56 26598 0 2024-04-25T15:58:07.547 INFO:tasks.workunit.client.0.smithi087.stdout:0/432: chown d1/d6/d1f 51 1 2024-04-25T15:58:07.548 INFO:tasks.workunit.client.0.smithi087.stdout:8/450: write d4/d1d/d14/f92 [1039614,64208] 0 2024-04-25T15:58:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:9/379: creat d6/d8/d48/f6e x:0 0 0 2024-04-25T15:58:07.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/451: chown d4/d1d/l20 35 1 2024-04-25T15:58:07.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/433: truncate d1/d6/f4d 1547506 0 2024-04-25T15:58:07.551 INFO:tasks.workunit.client.0.smithi087.stdout:9/380: chown d6/d8/d29/d3a/f4e 0 1 2024-04-25T15:58:07.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/452: creat d4/d22/f96 x:0 0 0 2024-04-25T15:58:07.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/381: unlink d6/d8/d48/f67 0 2024-04-25T15:58:07.556 INFO:tasks.workunit.client.0.smithi087.stdout:0/434: link d1/d6/d1f/f40 d1/d6/d21/f94 0 2024-04-25T15:58:07.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/453: creat d4/d1d/f97 x:0 0 0 2024-04-25T15:58:07.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/435: mknod d1/da/d3e/c95 0 2024-04-25T15:58:07.562 INFO:tasks.workunit.client.0.smithi087.stdout:9/382: dwrite d6/d8/d29/d3a/f69 [0,4194304] 0 2024-04-25T15:58:07.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/436: creat d1/f96 x:0 0 0 2024-04-25T15:58:07.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/437: chown d1/d4f/l74 34 1 2024-04-25T15:58:07.564 INFO:tasks.workunit.client.0.smithi087.stdout:0/438: chown d1/d6/d1f/c72 24 1 2024-04-25T15:58:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:9/383: mknod d6/d45/c6f 0 2024-04-25T15:58:07.568 INFO:tasks.workunit.client.0.smithi087.stdout:8/454: truncate d4/d1d/d7c/f1a 3354507 0 2024-04-25T15:58:07.570 INFO:tasks.workunit.client.0.smithi087.stdout:9/384: symlink d6/d8/d29/l70 0 2024-04-25T15:58:07.574 INFO:tasks.workunit.client.0.smithi087.stdout:8/455: rename d4/d1d/d17/f51 to d4/d1d/d17/f98 0 2024-04-25T15:58:07.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/439: dwrite d1/d4f/f7b [0,4194304] 0 2024-04-25T15:58:07.575 INFO:tasks.workunit.client.0.smithi087.stdout:9/385: rename d6/f6b to d6/d8/d29/d3a/d58/f71 0 2024-04-25T15:58:07.576 INFO:tasks.workunit.client.0.smithi087.stdout:9/386: readlink d6/d8/d29/d3a/d5b/d60/l16 0 2024-04-25T15:58:07.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/440: mknod d1/c97 0 2024-04-25T15:58:07.579 INFO:tasks.workunit.client.0.smithi087.stdout:9/387: unlink d6/d8/d29/f2a 0 2024-04-25T15:58:07.580 INFO:tasks.workunit.client.0.smithi087.stdout:9/388: chown d6/d8/d29/d3a/d5b/d60/l15 15690550 1 2024-04-25T15:58:07.583 INFO:tasks.workunit.client.0.smithi087.stdout:9/389: mkdir d6/d8/d29/d3a/d58/d72 0 2024-04-25T15:58:07.587 INFO:tasks.workunit.client.0.smithi087.stdout:0/441: dwrite d1/d6/f3b [4194304,4194304] 0 2024-04-25T15:58:07.589 INFO:tasks.workunit.client.0.smithi087.stdout:0/442: read d1/f3c [507085,78073] 0 2024-04-25T15:58:07.592 INFO:tasks.workunit.client.0.smithi087.stdout:9/390: dread d6/d8/d29/d3a/f69 [0,4194304] 0 2024-04-25T15:58:07.592 INFO:tasks.workunit.client.0.smithi087.stdout:0/443: symlink d1/da/d3e/d54/d34/l98 0 2024-04-25T15:58:07.594 INFO:tasks.workunit.client.0.smithi087.stdout:9/391: fdatasync d6/d8/d29/d3a/d58/f71 0 2024-04-25T15:58:07.595 INFO:tasks.workunit.client.0.smithi087.stdout:9/392: chown l4 4995411 1 2024-04-25T15:58:07.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/393: creat d6/d8/d29/f73 x:0 0 0 2024-04-25T15:58:07.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/394: chown d6/d8/d48 22866814 1 2024-04-25T15:58:07.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/444: link d1/d27/c5e d1/d27/d7d/d84/c99 0 2024-04-25T15:58:07.599 INFO:tasks.workunit.client.0.smithi087.stdout:9/395: dread - d6/d8/d29/d3a/d5b/d60/d1d/f6c zero size 2024-04-25T15:58:07.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/396: fdatasync d6/d8/d12/f37 0 2024-04-25T15:58:07.602 INFO:tasks.workunit.client.0.smithi087.stdout:9/397: creat d6/d8/d29/d3a/f74 x:0 0 0 2024-04-25T15:58:07.602 INFO:tasks.workunit.client.0.smithi087.stdout:0/445: link d1/d6/d21/l2f d1/d6/d77/l9a 0 2024-04-25T15:58:07.605 INFO:tasks.workunit.client.0.smithi087.stdout:0/446: mkdir d1/da/d3e/d85/d9b 0 2024-04-25T15:58:07.606 INFO:tasks.workunit.client.0.smithi087.stdout:0/447: write d1/da/d3e/d54/d34/f6e [1818459,82279] 0 2024-04-25T15:58:07.607 INFO:tasks.workunit.client.0.smithi087.stdout:8/456: dread d4/d1d/d14/f2c [0,4194304] 0 2024-04-25T15:58:07.608 INFO:tasks.workunit.client.0.smithi087.stdout:8/457: stat d4/d1d/d17/d37/d5e 0 2024-04-25T15:58:07.608 INFO:tasks.workunit.client.0.smithi087.stdout:0/448: creat d1/da/d3e/f9c x:0 0 0 2024-04-25T15:58:07.610 INFO:tasks.workunit.client.0.smithi087.stdout:8/458: creat d4/d22/d43/d7f/f99 x:0 0 0 2024-04-25T15:58:07.611 INFO:tasks.workunit.client.0.smithi087.stdout:0/449: rmdir d1/da/d3e/d85 39 2024-04-25T15:58:07.611 INFO:tasks.workunit.client.0.smithi087.stdout:8/459: fsync d4/f65 0 2024-04-25T15:58:07.611 INFO:tasks.workunit.client.0.smithi087.stdout:0/450: stat d1/c97 0 2024-04-25T15:58:07.612 INFO:tasks.workunit.client.0.smithi087.stdout:0/451: write d1/d6/d21/d2a/f6f [304474,31780] 0 2024-04-25T15:58:07.612 INFO:tasks.workunit.client.0.smithi087.stdout:9/398: truncate d6/f1c 2270693 0 2024-04-25T15:58:07.613 INFO:tasks.workunit.client.0.smithi087.stdout:8/460: mknod d4/d8/c9a 0 2024-04-25T15:58:07.613 INFO:tasks.workunit.client.0.smithi087.stdout:9/399: dread - d6/d8/d29/d3a/f4e zero size 2024-04-25T15:58:07.614 INFO:tasks.workunit.client.0.smithi087.stdout:9/400: stat c5 0 2024-04-25T15:58:07.615 INFO:tasks.workunit.client.0.smithi087.stdout:0/452: symlink d1/da/d3e/d85/d9b/l9d 0 2024-04-25T15:58:07.616 INFO:tasks.workunit.client.0.smithi087.stdout:9/401: unlink d6/d8/d29/d3a/d5b/d60/d1d/c68 0 2024-04-25T15:58:07.618 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-04-25T15:58:07.618 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:58:07.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:58:07.619 INFO:tasks.workunit.client.0.smithi087.stdout:9/402: mkdir d6/d8/d32/d57/d66/d75 0 2024-04-25T15:58:07.620 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:58:07.620 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:07.621 INFO:tasks.workunit.client.0.smithi087.stdout:9/403: fdatasync d6/d8/d29/d3a/d58/f71 0 2024-04-25T15:58:07.624 INFO:tasks.workunit.client.0.smithi087.stdout:0/453: dwrite d1/d6/d21/f23 [4194304,4194304] 0 2024-04-25T15:58:07.628 INFO:tasks.workunit.client.0.smithi087.stdout:9/404: creat d6/d8/d29/d3a/d58/f76 x:0 0 0 2024-04-25T15:58:07.628 INFO:tasks.workunit.client.0.smithi087.stdout:0/454: fsync d1/d6/d21/d4c/d82/f8e 0 2024-04-25T15:58:07.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/405: chown f2 1017 1 2024-04-25T15:58:07.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/455: chown d1/f3c 541415 1 2024-04-25T15:58:07.630 INFO:tasks.workunit.client.0.smithi087.stdout:8/461: dread d4/d1d/d7c/f1a [0,4194304] 0 2024-04-25T15:58:07.633 INFO:tasks.workunit.client.0.smithi087.stdout:5/474: sync 2024-04-25T15:58:07.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/456: chown d1/da/d3e/d54/c67 559090 1 2024-04-25T15:58:07.636 INFO:tasks.workunit.client.0.smithi087.stdout:9/406: dread d6/d8/d32/f59 [0,4194304] 0 2024-04-25T15:58:07.638 INFO:tasks.workunit.client.0.smithi087.stdout:9/407: write d6/d8/d29/d3a/d5b/d60/d1d/f6c [1002001,119182] 0 2024-04-25T15:58:07.638 INFO:tasks.workunit.client.0.smithi087.stdout:5/475: creat d9/d2f/d3b/f9a x:0 0 0 2024-04-25T15:58:07.641 INFO:tasks.workunit.client.0.smithi087.stdout:9/408: mknod d6/d8/d29/d3a/d5b/c77 0 2024-04-25T15:58:07.644 INFO:tasks.workunit.client.0.smithi087.stdout:9/409: chown d6/d8/d29/d3a/d5b/d60/l15 1587346525 1 2024-04-25T15:58:07.646 INFO:tasks.workunit.client.0.smithi087.stdout:9/410: symlink d6/d45/l78 0 2024-04-25T15:58:07.647 INFO:tasks.workunit.client.0.smithi087.stdout:9/411: readlink d6/d8/d29/l3d 0 2024-04-25T15:58:07.647 INFO:tasks.workunit.client.0.smithi087.stdout:5/476: dread d9/f26 [0,4194304] 0 2024-04-25T15:58:07.647 INFO:tasks.workunit.client.0.smithi087.stdout:8/462: dread d4/d1d/d17/d37/f78 [4194304,4194304] 0 2024-04-25T15:58:07.650 INFO:tasks.workunit.client.0.smithi087.stdout:8/463: creat d4/d1d/d7c/f9b x:0 0 0 2024-04-25T15:58:07.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.647+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8815ad90 con 0x7f6f880ae8a0 2024-04-25T15:58:07.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.647+0000 7f6f857fa640 1 -- 172.21.15.87:0/292097422 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+4837 (secure 0 0 0) 0x7f6f80016620 con 0x7f6f880ae8a0 2024-04-25T15:58:07.652 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:07.652 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:04.272250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:58:07.652 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-04-25T15:58:07.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/412: rename d6/d8/d29/d3a/d58/f5e to d6/d3e/d63/f79 0 2024-04-25T15:58:07.657 INFO:tasks.workunit.client.0.smithi087.stdout:5/477: dread d9/d2f/d40/d4d/d7b/d5c/d5f/f53 [0,4194304] 0 2024-04-25T15:58:07.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f6c06f400 msgr2=0x7f6f6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f6c06f400 0x7f6f6c071910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f880c4ed0 tx=0x7f6f7c009190 comp rx=0 tx=0).stop 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 msgr2=0x7f6f88153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 0x7f6f88153da0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6f8001a510 tx=0x7f6f80019680 comp rx=0 tx=0).stop 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 shutdown_connections 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f6f6c06f400 0x7f6f6c071910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f880ae8a0 0x7f6f88153da0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f880c9e80 0x7f6f880ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 --2- 172.21.15.87:0/292097422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f880746a0 0x7f6f881f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 >> 172.21.15.87:0/292097422 conn(0x7f6f880ac550 msgr2=0x7f6f880c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 shutdown_connections 2024-04-25T15:58:07.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.655+0000 7f6f8ec2f640 1 -- 172.21.15.87:0/292097422 wait complete. 2024-04-25T15:58:07.660 INFO:tasks.workunit.client.0.smithi087.stdout:0/457: dread d1/d6/d1f/f37 [4194304,4194304] 0 2024-04-25T15:58:07.662 INFO:tasks.workunit.client.0.smithi087.stdout:0/458: chown d1/d6/c8f 2918593 1 2024-04-25T15:58:07.662 INFO:tasks.workunit.client.0.smithi087.stdout:9/413: dwrite d6/f51 [0,4194304] 0 2024-04-25T15:58:07.667 INFO:tasks.workunit.client.0.smithi087.stdout:9/414: rename d6/d8/d29/d3a/d5b/d60/d1d/f55 to d6/d45/f7a 0 2024-04-25T15:58:07.673 INFO:tasks.workunit.client.0.smithi087.stdout:7/327: sync 2024-04-25T15:58:07.673 INFO:tasks.workunit.client.0.smithi087.stdout:1/470: sync 2024-04-25T15:58:07.673 INFO:tasks.workunit.client.0.smithi087.stdout:6/542: sync 2024-04-25T15:58:07.673 INFO:tasks.workunit.client.0.smithi087.stdout:4/503: sync 2024-04-25T15:58:07.673 INFO:tasks.workunit.client.0.smithi087.stdout:3/389: sync 2024-04-25T15:58:07.673 INFO:tasks.workunit.client.0.smithi087.stdout:2/432: sync 2024-04-25T15:58:07.676 INFO:tasks.workunit.client.0.smithi087.stdout:8/464: dread d4/d1d/d17/f2d [4194304,4194304] 0 2024-04-25T15:58:07.680 INFO:tasks.workunit.client.0.smithi087.stdout:7/328: write d1/d4/f55 [537303,110716] 0 2024-04-25T15:58:07.680 INFO:tasks.workunit.client.0.smithi087.stdout:2/433: mkdir d3/d27/d38/d7e 0 2024-04-25T15:58:07.682 INFO:tasks.workunit.client.0.smithi087.stdout:1/471: stat d3/d12/d14/d29/d67/l6e 0 2024-04-25T15:58:07.682 INFO:tasks.workunit.client.0.smithi087.stdout:4/504: truncate d4/d10/d60/f6c 451544 0 2024-04-25T15:58:07.683 INFO:tasks.workunit.client.0.smithi087.stdout:3/390: creat d4/d17/d24/d3f/f76 x:0 0 0 2024-04-25T15:58:07.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/434: read d3/d27/f3e [2026645,100621] 0 2024-04-25T15:58:07.685 INFO:tasks.workunit.client.0.smithi087.stdout:1/472: write d3/d12/f43 [418511,59100] 0 2024-04-25T15:58:07.685 INFO:tasks.workunit.client.0.smithi087.stdout:5/478: dread d9/f16 [0,4194304] 0 2024-04-25T15:58:07.688 INFO:tasks.workunit.client.0.smithi087.stdout:6/543: chown d7/d1a/d1d/d21/d37/faa 0 1 2024-04-25T15:58:07.690 INFO:tasks.workunit.client.0.smithi087.stdout:5/479: stat d9/d2f/d40 0 2024-04-25T15:58:07.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/415: dwrite d6/f51 [0,4194304] 0 2024-04-25T15:58:07.694 INFO:tasks.workunit.client.0.smithi087.stdout:3/391: rename d4/d17/d24/f4e to d4/db/d28/d5c/f77 0 2024-04-25T15:58:07.695 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-25T15:58:07.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/416: fdatasync d6/d8/d48/f56 0 2024-04-25T15:58:07.695 INFO:tasks.workunit.client.0.smithi087.stdout:2/435: link d3/d2a/f1b d3/d20/f7f 0 2024-04-25T15:58:07.697 INFO:tasks.workunit.client.0.smithi087.stdout:6/544: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/fb8 x:0 0 0 2024-04-25T15:58:07.699 INFO:tasks.workunit.client.0.smithi087.stdout:3/392: mknod d4/d17/d24/c78 0 2024-04-25T15:58:07.699 INFO:tasks.workunit.client.0.smithi087.stdout:2/436: dread d3/d27/d29/d4f/f5f [0,4194304] 0 2024-04-25T15:58:07.700 INFO:tasks.workunit.client.0.smithi087.stdout:3/393: write d4/db/f47 [322512,40117] 0 2024-04-25T15:58:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:5/480: link d9/d2f/f76 d9/d91/d30/d55/f9b 0 2024-04-25T15:58:07.704 INFO:tasks.workunit.client.0.smithi087.stdout:1/473: link d3/d12/d14/d29/d2f/f5d d3/d2d/d6c/f9b 0 2024-04-25T15:58:07.708 INFO:tasks.workunit.client.0.smithi087.stdout:9/417: mkdir d6/d8/d29/d3a/d58/d7b 0 2024-04-25T15:58:07.709 INFO:tasks.workunit.client.0.smithi087.stdout:9/418: dread - d6/d8/f61 zero size 2024-04-25T15:58:07.709 INFO:tasks.workunit.client.0.smithi087.stdout:3/394: creat d4/d17/d24/d3f/f79 x:0 0 0 2024-04-25T15:58:07.717 INFO:tasks.workunit.client.0.smithi087.stdout:1/474: mkdir d3/d12/d14/d29/d67/d73/d9c 0 2024-04-25T15:58:07.717 INFO:tasks.workunit.client.0.smithi087.stdout:3/395: symlink d4/db/d28/d3c/l7a 0 2024-04-25T15:58:07.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/545: getdents d7/d1a/d1d/d21/d37 0 2024-04-25T15:58:07.720 INFO:tasks.workunit.client.0.smithi087.stdout:5/481: getdents d9/d91/d38 0 2024-04-25T15:58:07.721 INFO:tasks.workunit.client.0.smithi087.stdout:8/465: dwrite d4/d8/f6a [0,4194304] 0 2024-04-25T15:58:07.723 INFO:tasks.workunit.client.0.smithi087.stdout:3/396: mkdir d4/d17/d24/d29/d7b 0 2024-04-25T15:58:07.726 INFO:tasks.workunit.client.0.smithi087.stdout:7/329: dwrite d1/d1a/f62 [0,4194304] 0 2024-04-25T15:58:07.727 INFO:tasks.workunit.client.0.smithi087.stdout:2/437: truncate d3/d27/f42 2848714 0 2024-04-25T15:58:07.729 INFO:tasks.workunit.client.0.smithi087.stdout:5/482: mknod d9/d91/d30/c9c 0 2024-04-25T15:58:07.730 INFO:tasks.workunit.client.0.smithi087.stdout:7/330: truncate d1/d4/f44 1019493 0 2024-04-25T15:58:07.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/475: rename d3/d12/d14/d29/f76 to d3/d12/d14/d29/d8e/f9d 0 2024-04-25T15:58:07.735 INFO:tasks.workunit.client.0.smithi087.stdout:5/483: write d9/d2f/d3b/f89 [666798,110182] 0 2024-04-25T15:58:07.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/397: creat d4/d14/d23/f7c x:0 0 0 2024-04-25T15:58:07.742 INFO:tasks.workunit.client.0.smithi087.stdout:1/476: symlink d3/d12/d14/d29/d2f/d53/l9e 0 2024-04-25T15:58:07.747 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-04-25T15:58:07.749 INFO:tasks.workunit.client.0.smithi087.stdout:6/546: dwrite d7/d1a/d1d/f60 [0,4194304] 0 2024-04-25T15:58:07.753 INFO:tasks.workunit.client.0.smithi087.stdout:5/484: dwrite d9/fa [0,4194304] 0 2024-04-25T15:58:07.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/419: dread d6/d8/d29/f3f [0,4194304] 0 2024-04-25T15:58:07.754 INFO:tasks.workunit.client.0.smithi087.stdout:1/477: symlink d3/d12/d14/d29/d2f/d61/l9f 0 2024-04-25T15:58:07.755 INFO:tasks.workunit.client.0.smithi087.stdout:6/547: fsync d7/d1a/d1d/d21/d27/d2c/d35/f36 0 2024-04-25T15:58:07.755 INFO:tasks.workunit.client.0.smithi087.stdout:3/398: rmdir d4/d14/d53/d68/d60 0 2024-04-25T15:58:07.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/420: chown d6/d8/d29/d3a 1150 1 2024-04-25T15:58:07.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/438: dwrite d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:07.761 INFO:tasks.workunit.client.0.smithi087.stdout:3/399: mkdir d4/d14/d53/d7d 0 2024-04-25T15:58:07.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 Processor -- start 2024-04-25T15:58:07.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 -- start start 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b80ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10b80cb270 0x7f10b8157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b80c7570 con 0x7f10b80cae60 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f10b815b8b0 con 0x7f10b80cb270 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bfe57640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10b815b5d0 con 0x7f10b815ad90 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10be3f4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10b80cb270 0x7f10b8157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bdbf3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b80ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bd3f2640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f10b80cae60 0x7f10b8157380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:41704/0 (socket says 172.21.15.87:41704) 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bd3f2640 1 -- 172.21.15.87:0/3490512500 learned_addr learned my addr 172.21.15.87:0/3490512500 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bdbf3640 1 -- 172.21.15.87:0/3490512500 >> v2:172.21.15.155:3300/0 conn(0x7f10b80cb270 msgr2=0x7f10b8157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:07.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bdbf3640 1 --2- 172.21.15.87:0/3490512500 >> v2:172.21.15.155:3300/0 conn(0x7f10b80cb270 0x7f10b8157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bdbf3640 1 -- 172.21.15.87:0/3490512500 >> v1:172.21.15.155:6789/0 conn(0x7f10b80cae60 legacy=0x7f10b8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.795+0000 7f10bdbf3640 1 -- 172.21.15.87:0/3490512500 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b80c2290 con 0x7f10b815ad90 2024-04-25T15:58:07.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bdbf3640 1 --2- 172.21.15.87:0/3490512500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b80ca920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097c0 tx=0x7f10a801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2a2731343dc0928 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:07.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bcbf1640 1 -- 172.21.15.87:0/3490512500 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80b0070 con 0x7f10b815ad90 2024-04-25T15:58:07.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bcbf1640 1 -- 172.21.15.87:0/3490512500 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a80ab600 con 0x7f10b815ad90 2024-04-25T15:58:07.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bcbf1640 1 -- 172.21.15.87:0/3490512500 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80ab9d0 con 0x7f10b815ad90 2024-04-25T15:58:07.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 -- 172.21.15.87:0/3490512500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 msgr2=0x7f10b80ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 --2- 172.21.15.87:0/3490512500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b80ca920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097c0 tx=0x7f10a801c380 comp rx=0 tx=0).stop 2024-04-25T15:58:07.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 -- 172.21.15.87:0/3490512500 shutdown_connections 2024-04-25T15:58:07.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 --2- 172.21.15.87:0/3490512500 >> v2:172.21.15.155:3300/0 conn(0x7f10b80cb270 0x7f10b8157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 --2- 172.21.15.87:0/3490512500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b80ca920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 -- 172.21.15.87:0/3490512500 >> 172.21.15.87:0/3490512500 conn(0x7f10b80c9330 msgr2=0x7f10b80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:07.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 -- 172.21.15.87:0/3490512500 shutdown_connections 2024-04-25T15:58:07.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.799+0000 7f10bfe57640 1 -- 172.21.15.87:0/3490512500 wait complete. 2024-04-25T15:58:07.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 Processor -- start 2024-04-25T15:58:07.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- start start 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 0x7f10b8150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80cb270 0x7f10b8156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b81f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f10b815b1a0 con 0x7f10b80cae60 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80ca190 con 0x7f10b80cb270 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10b815b320 con 0x7f10b815ad90 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 0x7f10b8150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 0x7f10b8150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58176/0 (socket says 172.21.15.87:58176) 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 -- 172.21.15.87:0/2691588403 learned_addr learned my addr 172.21.15.87:0/2691588403 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bd3f2640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80cb270 0x7f10b8156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10be3f4640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b81f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 -- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 msgr2=0x7f10b81f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b81f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 -- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80cb270 msgr2=0x7f10b8156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80cb270 0x7f10b8156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 -- 172.21.15.87:0/2691588403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b8151d70 con 0x7f10b80cae60 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10be3f4640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b81f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bdbf3640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 0x7f10b8150900 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f10a8019fb0 tx=0x7f10a8019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80b0040 con 0x7f10b80cae60 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a80b9070 con 0x7f10b80cae60 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b80b0560 con 0x7f10b80cae60 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8006e20 con 0x7f10b80cae60 2024-04-25T15:58:07.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b81571b0 con 0x7f10b80cae60 2024-04-25T15:58:07.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b8069bb0 con 0x7f10b80cae60 2024-04-25T15:58:07.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.803+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f10a80b4650 con 0x7f10b80cae60 2024-04-25T15:58:07.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.807+0000 7f10ae7fc640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f109c06f430 0x7f109c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:07.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.807+0000 7f10bd3f2640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f109c06f430 0x7f109c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:07.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.807+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f10a8129520 con 0x7f10b80cae60 2024-04-25T15:58:07.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.807+0000 7f10bd3f2640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f109c06f430 0x7f109c071940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f10b806ade0 tx=0x7f10b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:07.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:07.811+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10a8016090 con 0x7f10b80cae60 2024-04-25T15:58:07.895 INFO:tasks.workunit.client.0.smithi087.stdout:6/548: mkdir d7/d1a/d1d/d21/d37/db9 0 2024-04-25T15:58:07.897 INFO:tasks.workunit.client.0.smithi087.stdout:1/478: creat d3/d12/d14/d29/d67/fa0 x:0 0 0 2024-04-25T15:58:07.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/439: read d3/d27/f42 [2431114,65407] 0 2024-04-25T15:58:07.902 INFO:tasks.workunit.client.0.smithi087.stdout:3/400: creat d4/d17/d24/d3f/f7e x:0 0 0 2024-04-25T15:58:07.906 INFO:tasks.workunit.client.0.smithi087.stdout:7/331: dread d1/d9/d26/f30 [0,4194304] 0 2024-04-25T15:58:07.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/421: dwrite d6/d8/d32/f4d [0,4194304] 0 2024-04-25T15:58:07.915 INFO:tasks.workunit.client.0.smithi087.stdout:9/422: read - d6/d8/f61 zero size 2024-04-25T15:58:07.917 INFO:tasks.workunit.client.0.smithi087.stdout:1/479: rename d3/d12/d14/f7a to d3/d12/d14/d29/d2f/d61/fa1 0 2024-04-25T15:58:07.919 INFO:tasks.workunit.client.0.smithi087.stdout:3/401: dread d4/d17/d24/d3f/f4a [0,4194304] 0 2024-04-25T15:58:07.920 INFO:tasks.workunit.client.0.smithi087.stdout:2/440: mknod d3/d27/d29/d4f/d5a/d6a/c80 0 2024-04-25T15:58:07.920 INFO:tasks.workunit.client.0.smithi087.stdout:1/480: rmdir d3/d12 39 2024-04-25T15:58:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:1/481: readlink d3/d2d/d6c/l78 0 2024-04-25T15:58:07.924 INFO:tasks.workunit.client.0.smithi087.stdout:2/441: write d3/d20/f46 [98511,77484] 0 2024-04-25T15:58:07.930 INFO:tasks.workunit.client.0.smithi087.stdout:0/459: sync 2024-04-25T15:58:07.932 INFO:tasks.workunit.client.0.smithi087.stdout:9/423: dread d6/d8/d32/f59 [0,4194304] 0 2024-04-25T15:58:07.933 INFO:tasks.workunit.client.0.smithi087.stdout:2/442: truncate d3/d27/d29/d2d/f57 537205 0 2024-04-25T15:58:07.936 INFO:tasks.workunit.client.0.smithi087.stdout:0/460: creat d1/d27/f9e x:0 0 0 2024-04-25T15:58:07.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/332: dwrite d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:07.938 INFO:tasks.workunit.client.0.smithi087.stdout:0/461: chown d1/f3d 690287742 1 2024-04-25T15:58:07.943 INFO:tasks.workunit.client.0.smithi087.stdout:3/402: link d4/db/c13 d4/d14/d53/d7d/c7f 0 2024-04-25T15:58:07.947 INFO:tasks.workunit.client.0.smithi087.stdout:9/424: dwrite d6/d8/fc [0,4194304] 0 2024-04-25T15:58:07.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/333: creat d1/d1a/f66 x:0 0 0 2024-04-25T15:58:07.952 INFO:tasks.workunit.client.0.smithi087.stdout:2/443: mkdir d3/d2a/d81 0 2024-04-25T15:58:07.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/425: mkdir d6/d8/d29/d3a/d7c 0 2024-04-25T15:58:07.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/403: dwrite d4/db/d28/d3c/f4b [4194304,4194304] 0 2024-04-25T15:58:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/426: chown d6/d8/d29/l38 64993670 1 2024-04-25T15:58:07.961 INFO:tasks.workunit.client.0.smithi087.stdout:3/404: chown d4/d17/d24 11 1 2024-04-25T15:58:07.963 INFO:tasks.workunit.client.0.smithi087.stdout:7/334: dread d1/d9/d26/d45/f5c [0,4194304] 0 2024-04-25T15:58:07.964 INFO:tasks.workunit.client.0.smithi087.stdout:3/405: write d4/d14/f55 [915454,64710] 0 2024-04-25T15:58:07.968 INFO:tasks.workunit.client.0.smithi087.stdout:1/482: link d3/d12/d14/d29/d2f/f5d d3/d12/d39/d64/fa2 0 2024-04-25T15:58:07.979 INFO:tasks.workunit.client.0.smithi087.stdout:3/406: dwrite d4/db/fe [0,4194304] 0 2024-04-25T15:58:07.979 INFO:tasks.workunit.client.0.smithi087.stdout:2/444: rename d3/d27/d29/d4f/c55 to d3/d27/d29/d4f/d5a/d6a/c82 0 2024-04-25T15:58:07.987 INFO:tasks.workunit.client.0.smithi087.stdout:2/445: mkdir d3/d2a/d48/d83 0 2024-04-25T15:58:07.990 INFO:tasks.workunit.client.0.smithi087.stdout:0/462: truncate d1/d6/f8 529440 0 2024-04-25T15:58:07.992 INFO:tasks.workunit.client.0.smithi087.stdout:7/335: dread d1/fd [0,4194304] 0 2024-04-25T15:58:07.993 INFO:tasks.workunit.client.0.smithi087.stdout:9/427: link d6/d8/d29/d3a/d58/f76 d6/d8/d29/d3a/d58/d72/f7d 0 2024-04-25T15:58:07.995 INFO:tasks.workunit.client.0.smithi087.stdout:9/428: write d6/d8/d32/f35 [8473718,115796] 0 2024-04-25T15:58:07.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/446: rmdir d3/d27/d38 39 2024-04-25T15:58:08.001 INFO:tasks.workunit.client.0.smithi087.stdout:3/407: symlink d4/d14/d23/l80 0 2024-04-25T15:58:08.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/408: write d4/db/d28/d3c/d62/f44 [3268955,72230] 0 2024-04-25T15:58:08.007 INFO:tasks.workunit.client.0.smithi087.stdout:9/429: creat d6/d8/d29/d3a/d5b/f7e x:0 0 0 2024-04-25T15:58:08.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/483: getdents d3/d12/d39/d64 0 2024-04-25T15:58:08.013 INFO:tasks.workunit.client.0.smithi087.stdout:3/409: mkdir d4/d17/d81 0 2024-04-25T15:58:08.015 INFO:tasks.workunit.client.0.smithi087.stdout:2/447: dwrite d3/d27/d29/f73 [0,4194304] 0 2024-04-25T15:58:08.018 INFO:tasks.workunit.client.0.smithi087.stdout:7/336: dwrite d1/d1a/f39 [0,4194304] 0 2024-04-25T15:58:08.022 INFO:tasks.workunit.client.0.smithi087.stdout:7/337: write d1/d4/f40 [4634127,20943] 0 2024-04-25T15:58:08.024 INFO:tasks.workunit.client.0.smithi087.stdout:7/338: write d1/d1a/f66 [70531,22600] 0 2024-04-25T15:58:08.026 INFO:tasks.workunit.client.0.smithi087.stdout:8/466: sync 2024-04-25T15:58:08.027 INFO:tasks.workunit.client.0.smithi087.stdout:4/505: sync 2024-04-25T15:58:08.027 INFO:tasks.workunit.client.0.smithi087.stdout:1/484: creat d3/d12/d14/d33/d95/fa3 x:0 0 0 2024-04-25T15:58:08.027 INFO:tasks.workunit.client.0.smithi087.stdout:3/410: fdatasync d4/f10 0 2024-04-25T15:58:08.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/448: creat d3/d27/d29/d4f/f84 x:0 0 0 2024-04-25T15:58:08.028 INFO:tasks.workunit.client.0.smithi087.stdout:1/485: chown d3/d2d 1698149 1 2024-04-25T15:58:08.029 INFO:tasks.workunit.client.0.smithi087.stdout:3/411: chown d4/d14/d37 41 1 2024-04-25T15:58:08.030 INFO:tasks.workunit.client.0.smithi087.stdout:2/449: chown d3/d2a/d48/c4e 2020395 1 2024-04-25T15:58:08.032 INFO:tasks.workunit.client.0.smithi087.stdout:9/430: write d6/d8/d48/f6d [848137,94291] 0 2024-04-25T15:58:08.033 INFO:tasks.workunit.client.0.smithi087.stdout:7/339: mknod d1/d4/c67 0 2024-04-25T15:58:08.035 INFO:tasks.workunit.client.0.smithi087.stdout:4/506: write d4/d10/d60/d56/d61/f1c [6745634,25682] 0 2024-04-25T15:58:08.036 INFO:tasks.workunit.client.0.smithi087.stdout:0/463: dwrite d1/d6/d21/f94 [0,4194304] 0 2024-04-25T15:58:08.036 INFO:tasks.workunit.client.0.smithi087.stdout:1/486: symlink d3/d12/d14/d33/d95/la4 0 2024-04-25T15:58:08.038 INFO:tasks.workunit.client.0.smithi087.stdout:1/487: stat d3/c4a 0 2024-04-25T15:58:08.041 INFO:tasks.workunit.client.0.smithi087.stdout:8/467: mkdir d4/d9c 0 2024-04-25T15:58:08.042 INFO:tasks.workunit.client.0.smithi087.stdout:3/412: dread d4/db/fe [0,4194304] 0 2024-04-25T15:58:08.043 INFO:tasks.workunit.client.0.smithi087.stdout:7/340: unlink d1/d4/f12 0 2024-04-25T15:58:08.043 INFO:tasks.workunit.client.0.smithi087.stdout:8/468: write d4/d1d/f97 [275203,84569] 0 2024-04-25T15:58:08.045 INFO:tasks.workunit.client.0.smithi087.stdout:7/341: chown d1/d4/d18/d36 3321 1 2024-04-25T15:58:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:1/488: stat d3/d12/d14/d29/d2f/d40/f71 0 2024-04-25T15:58:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:2/450: mkdir d3/d2a/d48/d77/d79/d85 0 2024-04-25T15:58:08.047 INFO:tasks.workunit.client.0.smithi087.stdout:0/464: dwrite d1/f58 [0,4194304] 0 2024-04-25T15:58:08.048 INFO:tasks.workunit.client.0.smithi087.stdout:9/431: mkdir d6/d8/d29/d3a/d5b/d60/d7f 0 2024-04-25T15:58:08.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/489: chown d3/d12/d14/d29/d65/d97 449166 1 2024-04-25T15:58:08.048 INFO:tasks.workunit.client.0.smithi087.stdout:8/469: rmdir d4/d22/d43/d6d 39 2024-04-25T15:58:08.050 INFO:tasks.workunit.client.0.smithi087.stdout:4/507: link d4/d10/d60/d5c/d3a/f67 d4/d10/fa7 0 2024-04-25T15:58:08.051 INFO:tasks.workunit.client.0.smithi087.stdout:4/508: stat d4/d10/d60/d52/d66/d15/fe 0 2024-04-25T15:58:08.052 INFO:tasks.workunit.client.0.smithi087.stdout:3/413: mkdir d4/db/d28/d82 0 2024-04-25T15:58:08.053 INFO:tasks.workunit.client.0.smithi087.stdout:9/432: creat d6/f80 x:0 0 0 2024-04-25T15:58:08.054 INFO:tasks.workunit.client.0.smithi087.stdout:0/465: mknod d1/d6/d77/c9f 0 2024-04-25T15:58:08.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.051+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b80c7760 con 0x7f10b80cae60 2024-04-25T15:58:08.056 INFO:tasks.workunit.client.0.smithi087.stdout:9/433: readlink d6/d8/d32/d4c/d4f/l5f 0 2024-04-25T15:58:08.057 INFO:tasks.workunit.client.0.smithi087.stdout:8/470: write d4/d8/dd/d85/d86/f8f [4225738,99795] 0 2024-04-25T15:58:08.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.051+0000 7f10ae7fc640 1 -- 172.21.15.87:0/2691588403 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+4837 (secure 0 0 0) 0x7f10a80f5f10 con 0x7f10b80cae60 2024-04-25T15:58:08.057 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:08.057 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:04.272250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:58:08.058 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-04-25T15:58:08.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/509: symlink d4/d10/d60/d56/la8 0 2024-04-25T15:58:08.058 INFO:tasks.workunit.client.0.smithi087.stdout:3/414: symlink d4/d17/d24/d3f/l83 0 2024-04-25T15:58:08.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f109c06f430 msgr2=0x7f109c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:08.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f109c06f430 0x7f109c071940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f10b806ade0 tx=0x7f10b4009040 comp rx=0 tx=0).stop 2024-04-25T15:58:08.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 msgr2=0x7f10b8150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 0x7f10b8150900 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f10a8019fb0 tx=0x7f10a8019120 comp rx=0 tx=0).stop 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 shutdown_connections 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f109c06f430 0x7f109c071940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b815ad90 0x7f10b81f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80cb270 0x7f10b8156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 --2- 172.21.15.87:0/2691588403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10b80cae60 0x7f10b8150900 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 >> 172.21.15.87:0/2691588403 conn(0x7f10b80c9330 msgr2=0x7f10b80cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 shutdown_connections 2024-04-25T15:58:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:08.055+0000 7f10bfe57640 1 -- 172.21.15.87:0/2691588403 wait complete. 2024-04-25T15:58:08.061 INFO:tasks.workunit.client.0.smithi087.stdout:2/451: creat d3/d27/d38/d7e/f86 x:0 0 0 2024-04-25T15:58:08.061 INFO:tasks.workunit.client.0.smithi087.stdout:1/490: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:08.062 INFO:tasks.workunit.client.0.smithi087.stdout:8/471: chown d4/d1d/d17/l24 2010681 1 2024-04-25T15:58:08.064 INFO:tasks.workunit.client.0.smithi087.stdout:7/342: dwrite d1/d9/f65 [0,4194304] 0 2024-04-25T15:58:08.064 INFO:tasks.workunit.client.0.smithi087.stdout:9/434: mkdir d6/d8/d29/d3a/d5b/d60/d81 0 2024-04-25T15:58:08.065 INFO:tasks.workunit.client.0.smithi087.stdout:1/491: dread - d3/d12/d14/d29/d2f/d61/f87 zero size 2024-04-25T15:58:08.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/452: readlink d3/d27/d29/l50 0 2024-04-25T15:58:08.066 INFO:tasks.workunit.client.0.smithi087.stdout:8/472: rmdir d4/d1d/d17/d37 39 2024-04-25T15:58:08.067 INFO:tasks.workunit.client.0.smithi087.stdout:2/453: chown d3/d27/f42 0 1 2024-04-25T15:58:08.068 INFO:tasks.workunit.client.0.smithi087.stdout:1/492: truncate d3/d12/d14/d29/d2f/d53/f84 985234 0 2024-04-25T15:58:08.068 INFO:tasks.workunit.client.0.smithi087.stdout:2/454: write d3/d2a/d48/f6c [659671,106519] 0 2024-04-25T15:58:08.072 INFO:tasks.workunit.client.0.smithi087.stdout:0/466: getdents d1/da/d3e/d85/d9b 0 2024-04-25T15:58:08.072 INFO:tasks.workunit.client.0.smithi087.stdout:3/415: creat d4/db/d28/d82/f84 x:0 0 0 2024-04-25T15:58:08.072 INFO:tasks.workunit.client.0.smithi087.stdout:9/435: creat d6/d8/d32/d4c/f82 x:0 0 0 2024-04-25T15:58:08.074 INFO:tasks.workunit.client.0.smithi087.stdout:7/343: read d1/d4/f44 [269164,36791] 0 2024-04-25T15:58:08.074 INFO:tasks.workunit.client.0.smithi087.stdout:9/436: stat d6/d8/d29/l3c 0 2024-04-25T15:58:08.075 INFO:tasks.workunit.client.0.smithi087.stdout:1/493: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:08.079 INFO:tasks.workunit.client.0.smithi087.stdout:3/416: rename d4/d14/c45 to d4/d17/d24/d29/d7b/c85 0 2024-04-25T15:58:08.082 INFO:tasks.workunit.client.0.smithi087.stdout:1/494: mkdir d3/d12/d4d/da5 0 2024-04-25T15:58:08.085 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-04-25T15:58:08.086 INFO:tasks.workunit.client.0.smithi087.stdout:3/417: creat d4/db/d28/d82/f86 x:0 0 0 2024-04-25T15:58:08.089 INFO:tasks.workunit.client.0.smithi087.stdout:1/495: symlink d3/d12/d14/d29/d2f/d61/la6 0 2024-04-25T15:58:08.090 INFO:tasks.workunit.client.0.smithi087.stdout:1/496: chown d3/d12/d14/f16 21277 1 2024-04-25T15:58:08.090 INFO:tasks.workunit.client.0.smithi087.stdout:2/455: getdents d3/d20/d4a/d47 0 2024-04-25T15:58:08.091 INFO:tasks.workunit.client.0.smithi087.stdout:2/456: chown d3/d2a/d48/f65 73 1 2024-04-25T15:58:08.093 INFO:tasks.workunit.client.0.smithi087.stdout:8/473: write d4/d1d/d17/d37/f3b [2453134,84983] 0 2024-04-25T15:58:08.093 INFO:tasks.workunit.client.0.smithi087.stdout:7/344: link d1/d9/d26/d45/f61 d1/d4/d18/d36/f68 0 2024-04-25T15:58:08.094 INFO:tasks.workunit.client.0.smithi087.stdout:2/457: write d3/d27/d29/f73 [3236259,96740] 0 2024-04-25T15:58:08.096 INFO:tasks.workunit.client.0.smithi087.stdout:2/458: chown d3/d27/d29/l50 1088756 1 2024-04-25T15:58:08.096 INFO:tasks.workunit.client.0.smithi087.stdout:2/459: chown d3/d2a/d1c 62964 1 2024-04-25T15:58:08.096 INFO:tasks.workunit.client.0.smithi087.stdout:1/497: mkdir d3/d12/d14/d29/d67/d73/da7 0 2024-04-25T15:58:08.101 INFO:tasks.workunit.client.0.smithi087.stdout:1/498: write d3/d12/d14/d29/d2f/f36 [2750083,97704] 0 2024-04-25T15:58:08.101 INFO:tasks.workunit.client.0.smithi087.stdout:7/345: creat d1/d4/f69 x:0 0 0 2024-04-25T15:58:08.103 INFO:tasks.workunit.client.0.smithi087.stdout:3/418: dwrite d4/f16 [0,4194304] 0 2024-04-25T15:58:08.105 INFO:tasks.workunit.client.0.smithi087.stdout:9/437: dwrite d6/d8/d29/d3a/d58/d72/f7d [0,4194304] 0 2024-04-25T15:58:08.107 INFO:tasks.workunit.client.0.smithi087.stdout:9/438: chown d6/d8/d29/d3a/d5b/d60/d1d/f36 46153247 1 2024-04-25T15:58:08.107 INFO:tasks.workunit.client.0.smithi087.stdout:8/474: rename d4/d8/dd/l69 to d4/d1d/d17/d37/d5e/l9d 0 2024-04-25T15:58:08.108 INFO:tasks.workunit.client.0.smithi087.stdout:9/439: dread - d6/d8/d29/f73 zero size 2024-04-25T15:58:08.108 INFO:tasks.workunit.client.0.smithi087.stdout:1/499: rmdir d3/d12 39 2024-04-25T15:58:08.111 INFO:tasks.workunit.client.0.smithi087.stdout:7/346: dwrite d1/d9/d26/f60 [4194304,4194304] 0 2024-04-25T15:58:08.112 INFO:tasks.workunit.client.0.smithi087.stdout:7/347: chown d1/d4/d18/d36/l63 7116459 1 2024-04-25T15:58:08.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/475: chown d4/d8/l7d 0 1 2024-04-25T15:58:08.113 INFO:tasks.workunit.client.0.smithi087.stdout:8/476: write d4/f84 [120536,56448] 0 2024-04-25T15:58:08.116 INFO:tasks.workunit.client.0.smithi087.stdout:9/440: readlink d6/d8/lb 0 2024-04-25T15:58:08.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/477: write d4/d1d/d17/d37/f41 [68314,1877] 0 2024-04-25T15:58:08.117 INFO:tasks.workunit.client.0.smithi087.stdout:2/460: link d3/d2a/l15 d3/d27/d29/d2d/d40/l87 0 2024-04-25T15:58:08.118 INFO:tasks.workunit.client.0.smithi087.stdout:7/348: fsync d1/d9/d26/f53 0 2024-04-25T15:58:08.119 INFO:tasks.workunit.client.0.smithi087.stdout:7/349: fsync d1/d9/d26/f38 0 2024-04-25T15:58:08.120 INFO:tasks.workunit.client.0.smithi087.stdout:2/461: mkdir d3/d27/d29/d4f/d5a/d6a/d88 0 2024-04-25T15:58:08.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/441: chown d6/d8/d29/d3a/d5b/d60/d1d/l24 4686748 1 2024-04-25T15:58:08.122 INFO:tasks.workunit.client.0.smithi087.stdout:7/350: write d1/d9/f65 [732042,37642] 0 2024-04-25T15:58:08.124 INFO:tasks.workunit.client.0.smithi087.stdout:9/442: write d6/d8/d29/d3a/d58/f71 [14738,27631] 0 2024-04-25T15:58:08.124 INFO:tasks.workunit.client.0.smithi087.stdout:9/443: readlink d6/l22 0 2024-04-25T15:58:08.124 INFO:tasks.workunit.client.0.smithi087.stdout:1/500: symlink d3/d12/d14/d29/d3b/la8 0 2024-04-25T15:58:08.126 INFO:tasks.workunit.client.0.smithi087.stdout:7/351: symlink d1/d4/d18/l6a 0 2024-04-25T15:58:08.127 INFO:tasks.workunit.client.0.smithi087.stdout:9/444: mknod d6/d8/d32/c83 0 2024-04-25T15:58:08.128 INFO:tasks.workunit.client.0.smithi087.stdout:1/501: rmdir d3/d12/d14/d29/d65 39 2024-04-25T15:58:08.130 INFO:tasks.workunit.client.0.smithi087.stdout:1/502: mknod d3/d2d/d6c/ca9 0 2024-04-25T15:58:08.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/445: symlink d6/d8/l84 0 2024-04-25T15:58:08.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/503: readlink d3/d2d/d6c/l77 0 2024-04-25T15:58:08.134 INFO:tasks.workunit.client.0.smithi087.stdout:7/352: dwrite d1/d9/f65 [4194304,4194304] 0 2024-04-25T15:58:08.135 INFO:tasks.workunit.client.0.smithi087.stdout:9/446: mkdir d6/d8/d29/d3a/d5b/d60/d81/d85 0 2024-04-25T15:58:08.136 INFO:tasks.workunit.client.0.smithi087.stdout:7/353: readlink d1/d9/d26/l34 0 2024-04-25T15:58:08.136 INFO:tasks.workunit.client.0.smithi087.stdout:8/478: write d4/d1d/d14/f31 [706131,107337] 0 2024-04-25T15:58:08.139 INFO:tasks.workunit.client.0.smithi087.stdout:9/447: chown d6/d8/d29/d3a/d5b/d60/d81 27 1 2024-04-25T15:58:08.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/504: dwrite d3/d12/d14/f4e [0,4194304] 0 2024-04-25T15:58:08.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/448: dread d6/d8/d29/f3f [0,4194304] 0 2024-04-25T15:58:08.146 INFO:tasks.workunit.client.0.smithi087.stdout:2/462: dread d3/d27/f39 [0,4194304] 0 2024-04-25T15:58:08.146 INFO:tasks.workunit.client.0.smithi087.stdout:1/505: rename d3/d12/d14/d29/d2f/d61/l9f to d3/d12/d4d/d7d/laa 0 2024-04-25T15:58:08.149 INFO:tasks.workunit.client.0.smithi087.stdout:1/506: creat d3/d12/d14/d29/d2f/d40/fab x:0 0 0 2024-04-25T15:58:08.151 INFO:tasks.workunit.client.0.smithi087.stdout:9/449: rename d6/d45/f5d to d6/d8/d29/d3a/d5b/d60/f86 0 2024-04-25T15:58:08.152 INFO:tasks.workunit.client.0.smithi087.stdout:1/507: write d3/d12/d14/d29/d8e/f9d [4163052,30124] 0 2024-04-25T15:58:08.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/450: chown d6/d8/fc 1661 1 2024-04-25T15:58:08.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/463: rename d3/d27/f41 to d3/d27/d29/d4f/d5a/d6a/f89 0 2024-04-25T15:58:08.154 INFO:tasks.workunit.client.0.smithi087.stdout:9/451: write d6/d8/d32/f59 [2526726,7922] 0 2024-04-25T15:58:08.155 INFO:tasks.workunit.client.0.smithi087.stdout:1/508: creat d3/d12/d14/d33/d95/fac x:0 0 0 2024-04-25T15:58:08.155 INFO:tasks.workunit.client.0.smithi087.stdout:9/452: dread - d6/d8/d12/f5a zero size 2024-04-25T15:58:08.156 INFO:tasks.workunit.client.0.smithi087.stdout:2/464: mknod d3/d27/d29/d2d/d40/c8a 0 2024-04-25T15:58:08.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/509: dread - d3/d12/d4d/f7e zero size 2024-04-25T15:58:08.157 INFO:tasks.workunit.client.0.smithi087.stdout:1/510: chown d3/d12/d14/d29/f96 498218550 1 2024-04-25T15:58:08.158 INFO:tasks.workunit.client.0.smithi087.stdout:9/453: creat d6/d8/d29/d3a/d58/d72/f87 x:0 0 0 2024-04-25T15:58:08.160 INFO:tasks.workunit.client.0.smithi087.stdout:1/511: mkdir d3/dad 0 2024-04-25T15:58:08.160 INFO:tasks.workunit.client.0.smithi087.stdout:9/454: rmdir d6/d8/d29/d3a 39 2024-04-25T15:58:08.161 INFO:tasks.workunit.client.0.smithi087.stdout:1/512: dread - d3/d12/d14/d29/d2f/d40/fab zero size 2024-04-25T15:58:08.161 INFO:tasks.workunit.client.0.smithi087.stdout:9/455: read - d6/d8/d32/d4c/f82 zero size 2024-04-25T15:58:08.162 INFO:tasks.workunit.client.0.smithi087.stdout:1/513: read - d3/d12/d4d/d7d/f8c zero size 2024-04-25T15:58:08.163 INFO:tasks.workunit.client.0.smithi087.stdout:9/456: symlink d6/d3e/l88 0 2024-04-25T15:58:08.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/457: unlink d6/f80 0 2024-04-25T15:58:08.167 INFO:tasks.workunit.client.0.smithi087.stdout:2/465: truncate d3/d2a/f14 309423 0 2024-04-25T15:58:08.169 INFO:tasks.workunit.client.0.smithi087.stdout:1/514: mknod d3/d12/d14/d29/d65/d97/cae 0 2024-04-25T15:58:08.170 INFO:tasks.workunit.client.0.smithi087.stdout:5/485: sync 2024-04-25T15:58:08.170 INFO:tasks.workunit.client.0.smithi087.stdout:6/549: sync 2024-04-25T15:58:08.171 INFO:tasks.workunit.client.0.smithi087.stdout:9/458: creat d6/d8/f89 x:0 0 0 2024-04-25T15:58:08.172 INFO:tasks.workunit.client.0.smithi087.stdout:1/515: chown d3/c2c 4028 1 2024-04-25T15:58:08.172 INFO:tasks.workunit.client.0.smithi087.stdout:2/466: mknod d3/d2a/d48/d77/d79/d85/c8b 0 2024-04-25T15:58:08.173 INFO:tasks.workunit.client.0.smithi087.stdout:1/516: chown d3/d12/d14/d29/f96 595126 1 2024-04-25T15:58:08.175 INFO:tasks.workunit.client.0.smithi087.stdout:5/486: mknod d9/d2f/d40/d4d/d7b/d5c/d5f/d44/c9d 0 2024-04-25T15:58:08.176 INFO:tasks.workunit.client.0.smithi087.stdout:2/467: readlink d3/d27/d29/l5d 0 2024-04-25T15:58:08.178 INFO:tasks.workunit.client.0.smithi087.stdout:6/550: dwrite d7/d1a/d1d/f84 [0,4194304] 0 2024-04-25T15:58:08.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/459: dread d6/d8/d29/d3a/d5b/d60/d1d/f6c [0,4194304] 0 2024-04-25T15:58:08.184 INFO:tasks.workunit.client.0.smithi087.stdout:6/551: mkdir d7/d1a/d1d/d21/dba 0 2024-04-25T15:58:08.185 INFO:tasks.workunit.client.0.smithi087.stdout:5/487: dwrite f2 [0,4194304] 0 2024-04-25T15:58:08.187 INFO:tasks.workunit.client.0.smithi087.stdout:1/517: rename d3/d12/d14/d29/d3b/f68 to d3/d12/d14/d29/d67/d73/d9c/faf 0 2024-04-25T15:58:08.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/518: write d3/d12/d14/d29/d3b/f98 [781925,125864] 0 2024-04-25T15:58:08.189 INFO:tasks.workunit.client.0.smithi087.stdout:9/460: mknod d6/d8/d32/d4c/c8a 0 2024-04-25T15:58:08.190 INFO:tasks.workunit.client.0.smithi087.stdout:9/461: write d6/d8/d29/d3a/f74 [330794,111674] 0 2024-04-25T15:58:08.195 INFO:tasks.workunit.client.0.smithi087.stdout:2/468: getdents d3/d2a/d48/d77/d79/d85 0 2024-04-25T15:58:08.195 INFO:tasks.workunit.client.0.smithi087.stdout:2/469: stat d3/f1e 0 2024-04-25T15:58:08.195 INFO:tasks.workunit.client.0.smithi087.stdout:2/470: dread - d3/d20/d4a/f4c zero size 2024-04-25T15:58:08.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/471: dread d3/d27/d29/d2d/d40/f68 [0,4194304] 0 2024-04-25T15:58:08.198 INFO:tasks.workunit.client.0.smithi087.stdout:5/488: symlink d9/d91/d30/d70/d82/l9e 0 2024-04-25T15:58:08.199 INFO:tasks.workunit.client.0.smithi087.stdout:2/472: readlink d3/d2a/d48/l6f 0 2024-04-25T15:58:08.201 INFO:tasks.workunit.client.0.smithi087.stdout:1/519: dread d3/d12/d14/d29/d2f/f5d [0,4194304] 0 2024-04-25T15:58:08.206 INFO:tasks.workunit.client.0.smithi087.stdout:9/462: creat d6/d8/d29/d3a/d5b/d60/f8b x:0 0 0 2024-04-25T15:58:08.206 INFO:tasks.workunit.client.0.smithi087.stdout:1/520: creat d3/d12/d14/d29/d2f/d53/fb0 x:0 0 0 2024-04-25T15:58:08.206 INFO:tasks.workunit.client.0.smithi087.stdout:1/521: fdatasync d3/d12/d4d/f60 0 2024-04-25T15:58:08.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/552: rename d7/l8b to d7/d1a/d1d/lbb 0 2024-04-25T15:58:08.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/522: rename d3/d12/d4d/d7d/l7f to d3/d12/d14/d29/d67/d73/d9c/lb1 0 2024-04-25T15:58:08.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/523: fdatasync d3/d12/d4d/f7e 0 2024-04-25T15:58:08.216 INFO:tasks.workunit.client.0.smithi087.stdout:5/489: dread f1 [0,4194304] 0 2024-04-25T15:58:08.217 INFO:tasks.workunit.client.0.smithi087.stdout:5/490: stat d9/l24 0 2024-04-25T15:58:08.219 INFO:tasks.workunit.client.0.smithi087.stdout:5/491: rename d9/c13 to d9/d2f/c9f 0 2024-04-25T15:58:08.219 INFO:tasks.workunit.client.0.smithi087.stdout:5/492: fsync d9/fa 0 2024-04-25T15:58:08.238 INFO:tasks.workunit.client.0.smithi087.stdout:5/493: dread d9/f2d [4194304,4194304] 0 2024-04-25T15:58:08.239 INFO:tasks.workunit.client.0.smithi087.stdout:5/494: chown d9/d91/l75 36224819 1 2024-04-25T15:58:08.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/495: dwrite d9/d2f/d40/d4d/d7b/d5c/f5e [0,4194304] 0 2024-04-25T15:58:08.249 INFO:tasks.workunit.client.0.smithi087.stdout:5/496: getdents d9/d91/d30/d70/d79 0 2024-04-25T15:58:08.250 INFO:tasks.workunit.client.0.smithi087.stdout:5/497: dread - d9/d91/d49/d80/f88 zero size 2024-04-25T15:58:08.264 INFO:tasks.workunit.client.0.smithi087.stdout:5/498: dwrite d9/d91/d30/d55/f9b [0,4194304] 0 2024-04-25T15:58:08.268 INFO:tasks.workunit.client.0.smithi087.stdout:5/499: creat d9/d91/d30/d55/fa0 x:0 0 0 2024-04-25T15:58:08.274 INFO:tasks.workunit.client.0.smithi087.stdout:5/500: creat d9/d91/d38/fa1 x:0 0 0 2024-04-25T15:58:08.278 INFO:tasks.workunit.client.0.smithi087.stdout:5/501: mknod d9/d2f/d40/d4d/d7b/d5c/d5f/ca2 0 2024-04-25T15:58:08.279 INFO:tasks.workunit.client.0.smithi087.stdout:8/479: dread d4/d1d/d17/d37/d5e/f7a [0,4194304] 0 2024-04-25T15:58:08.280 INFO:tasks.workunit.client.0.smithi087.stdout:5/502: write d9/d2f/d3b/f89 [1501791,66633] 0 2024-04-25T15:58:08.281 INFO:tasks.workunit.client.0.smithi087.stdout:5/503: readlink d9/d2f/d40/d4d/d7b/d5c/d5f/l4f 0 2024-04-25T15:58:08.282 INFO:tasks.workunit.client.0.smithi087.stdout:8/480: readlink d4/l50 0 2024-04-25T15:58:08.284 INFO:tasks.workunit.client.0.smithi087.stdout:8/481: read - d4/d22/f90 zero size 2024-04-25T15:58:08.285 INFO:tasks.workunit.client.0.smithi087.stdout:5/504: mknod d9/d2f/d40/d4d/d7b/d74/d83/ca3 0 2024-04-25T15:58:08.286 INFO:tasks.workunit.client.0.smithi087.stdout:8/482: readlink d4/d1d/d17/l1f 0 2024-04-25T15:58:08.286 INFO:tasks.workunit.client.0.smithi087.stdout:5/505: chown f2 5241 1 2024-04-25T15:58:08.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/483: chown d4/d22/l8b 420693 1 2024-04-25T15:58:08.289 INFO:tasks.workunit.client.0.smithi087.stdout:4/510: dread d4/d10/d60/d52/d66/f32 [0,4194304] 0 2024-04-25T15:58:08.289 INFO:tasks.workunit.client.0.smithi087.stdout:8/484: rename d4/d8 to d4/d8/dd/d2f/d6f/d9e 22 2024-04-25T15:58:08.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/553: dread d7/f18 [0,4194304] 0 2024-04-25T15:58:08.295 INFO:tasks.workunit.client.0.smithi087.stdout:4/511: rmdir d4/d10/d60/d56/d61 39 2024-04-25T15:58:08.299 INFO:tasks.workunit.client.0.smithi087.stdout:5/506: dwrite d9/d91/d30/d55/f9b [0,4194304] 0 2024-04-25T15:58:08.300 INFO:tasks.workunit.client.0.smithi087.stdout:4/512: dread - d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/fa2 zero size 2024-04-25T15:58:08.301 INFO:tasks.workunit.client.0.smithi087.stdout:6/554: mkdir d7/d1a/d1d/d21/d37/db9/dbc 0 2024-04-25T15:58:08.304 INFO:tasks.workunit.client.0.smithi087.stdout:4/513: creat d4/d10/d60/d56/d61/d3f/fa9 x:0 0 0 2024-04-25T15:58:08.305 INFO:tasks.workunit.client.0.smithi087.stdout:8/485: dwrite d4/d8/fb [0,4194304] 0 2024-04-25T15:58:08.308 INFO:tasks.workunit.client.0.smithi087.stdout:5/507: write d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a [225867,38069] 0 2024-04-25T15:58:08.313 INFO:tasks.workunit.client.0.smithi087.stdout:5/508: rmdir d9/d2f/d40/d4d/d7b/d74/d83 39 2024-04-25T15:58:08.313 INFO:tasks.workunit.client.0.smithi087.stdout:5/509: write d9/d2f/d40/d4d/f57 [710953,33792] 0 2024-04-25T15:58:08.314 INFO:tasks.workunit.client.0.smithi087.stdout:8/486: getdents d4/d8 0 2024-04-25T15:58:08.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/555: rename d7/d1a/d1d/d21/d37 to d7/d1a/d41/dbd 0 2024-04-25T15:58:08.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/556: stat d7/d1a/d1d/d21/l63 0 2024-04-25T15:58:08.320 INFO:tasks.workunit.client.0.smithi087.stdout:5/510: readlink d9/d2f/d40/d4d/d7b/d74/l85 0 2024-04-25T15:58:08.322 INFO:tasks.workunit.client.0.smithi087.stdout:4/514: rename d4/d10/d60/f4b to d4/d10/d60/d5c/d8d/faa 0 2024-04-25T15:58:08.323 INFO:tasks.workunit.client.0.smithi087.stdout:8/487: symlink d4/d22/d43/d6d/l9f 0 2024-04-25T15:58:08.325 INFO:tasks.workunit.client.0.smithi087.stdout:5/511: rename d9/d2f/d40/d4d/d7b/d5c/f5e to d9/d91/d30/d70/d82/fa4 0 2024-04-25T15:58:08.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/488: mkdir d4/d22/d43/d7f/d94/da0 0 2024-04-25T15:58:08.328 INFO:tasks.workunit.client.0.smithi087.stdout:6/557: dwrite d7/d1a/d41/dbd/f3f [0,4194304] 0 2024-04-25T15:58:08.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/489: chown d4/d1d/d17/l36 201127 1 2024-04-25T15:58:08.330 INFO:tasks.workunit.client.0.smithi087.stdout:5/512: dread d9/d2f/d3b/f68 [0,4194304] 0 2024-04-25T15:58:08.331 INFO:tasks.workunit.client.0.smithi087.stdout:6/558: creat d7/d71/d76/fbe x:0 0 0 2024-04-25T15:58:08.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/490: rmdir d4/d8 39 2024-04-25T15:58:08.334 INFO:tasks.workunit.client.0.smithi087.stdout:4/515: dwrite d4/d10/d60/f2f [0,4194304] 0 2024-04-25T15:58:08.335 INFO:tasks.workunit.client.0.smithi087.stdout:0/467: sync 2024-04-25T15:58:08.337 INFO:tasks.workunit.client.0.smithi087.stdout:8/491: creat d4/d8/dd/d85/fa1 x:0 0 0 2024-04-25T15:58:08.339 INFO:tasks.workunit.client.0.smithi087.stdout:6/559: rename d7/d1a/d1d/d21/d27/d2c/c70 to d7/d1a/d41/dbd/db9/dbc/cbf 0 2024-04-25T15:58:08.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/516: symlink d4/d10/d60/d52/lab 0 2024-04-25T15:58:08.343 INFO:tasks.workunit.client.0.smithi087.stdout:6/560: chown d7/d1a/d1d/d21/l63 1280723 1 2024-04-25T15:58:08.344 INFO:tasks.workunit.client.0.smithi087.stdout:5/513: dwrite d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a [0,4194304] 0 2024-04-25T15:58:08.346 INFO:tasks.workunit.client.0.smithi087.stdout:5/514: fsync f2 0 2024-04-25T15:58:08.346 INFO:tasks.workunit.client.0.smithi087.stdout:4/517: write d4/d10/d60/d56/d61/f1f [8874296,10619] 0 2024-04-25T15:58:08.348 INFO:tasks.workunit.client.0.smithi087.stdout:8/492: dwrite d4/d8/fb [0,4194304] 0 2024-04-25T15:58:08.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/561: creat d7/d71/d59/d90/da5/fc0 x:0 0 0 2024-04-25T15:58:08.352 INFO:tasks.workunit.client.0.smithi087.stdout:4/518: mknod d4/d10/d60/d56/d61/d3f/d58/d5e/cac 0 2024-04-25T15:58:08.353 INFO:tasks.workunit.client.0.smithi087.stdout:6/562: read d7/d1a/d1d/f28 [1239188,21533] 0 2024-04-25T15:58:08.354 INFO:tasks.workunit.client.0.smithi087.stdout:8/493: creat d4/d1d/d14/fa2 x:0 0 0 2024-04-25T15:58:08.355 INFO:tasks.workunit.client.0.smithi087.stdout:6/563: readlink d7/d1a/d2a/l7d 0 2024-04-25T15:58:08.355 INFO:tasks.workunit.client.0.smithi087.stdout:8/494: write d4/d22/d43/f61 [125853,88777] 0 2024-04-25T15:58:08.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/495: unlink d4/d8/l7d 0 2024-04-25T15:58:08.360 INFO:tasks.workunit.client.0.smithi087.stdout:5/515: dread d9/d2f/f3c [0,4194304] 0 2024-04-25T15:58:08.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/564: mknod d7/d1a/d1d/d21/dba/cc1 0 2024-04-25T15:58:08.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/565: fsync d7/f10 0 2024-04-25T15:58:08.363 INFO:tasks.workunit.client.0.smithi087.stdout:8/496: chown d4/d1d/d17/d37/l8c 1873795411 1 2024-04-25T15:58:08.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/566: mkdir d7/d1a/d41/dbd/db9/dc2 0 2024-04-25T15:58:08.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/516: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/f53 1885489 0 2024-04-25T15:58:08.366 INFO:tasks.workunit.client.0.smithi087.stdout:6/567: readlink d7/d1a/d1d/d21/d27/d2c/d35/d45/l94 0 2024-04-25T15:58:08.366 INFO:tasks.workunit.client.0.smithi087.stdout:0/468: dread d1/f26 [0,4194304] 0 2024-04-25T15:58:08.367 INFO:tasks.workunit.client.0.smithi087.stdout:8/497: dread - d4/d1d/f5b zero size 2024-04-25T15:58:08.367 INFO:tasks.workunit.client.0.smithi087.stdout:6/568: chown d7/f2f 51361 1 2024-04-25T15:58:08.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/469: chown d1/d27 3179099 1 2024-04-25T15:58:08.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/517: chown d9/d2f/d40/d4d/d7b 73779 1 2024-04-25T15:58:08.369 INFO:tasks.workunit.client.0.smithi087.stdout:6/569: chown d7/d1a/d1d/d21/c6f 0 1 2024-04-25T15:58:08.369 INFO:tasks.workunit.client.0.smithi087.stdout:6/570: chown d7/d71/l87 99 1 2024-04-25T15:58:08.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/470: symlink d1/d6/d21/d4c/d50/la0 0 2024-04-25T15:58:08.370 INFO:tasks.workunit.client.0.smithi087.stdout:6/571: readlink d7/d1a/lb7 0 2024-04-25T15:58:08.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/518: fsync d9/d91/d30/d70/d79/d7d/f73 0 2024-04-25T15:58:08.371 INFO:tasks.workunit.client.0.smithi087.stdout:5/519: chown d9/d91/f3a 113 1 2024-04-25T15:58:08.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/520: chown d9/d91/d49/c61 107154 1 2024-04-25T15:58:08.373 INFO:tasks.workunit.client.0.smithi087.stdout:6/572: mknod d7/d1a/d1d/d21/d27/cc3 0 2024-04-25T15:58:08.374 INFO:tasks.workunit.client.0.smithi087.stdout:6/573: fsync d7/d1a/d1d/d21/d27/d2c/d35/f36 0 2024-04-25T15:58:08.374 INFO:tasks.workunit.client.0.smithi087.stdout:0/471: rename d1/l6d to d1/la1 0 2024-04-25T15:58:08.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/472: chown d1/da/d3e/f9c 475479 1 2024-04-25T15:58:08.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/473: chown d1/d6/d21 0 1 2024-04-25T15:58:08.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/521: link d9/d2f/d3b/c69 d9/d91/ca5 0 2024-04-25T15:58:08.379 INFO:tasks.workunit.client.0.smithi087.stdout:6/574: dread d7/f2f [0,4194304] 0 2024-04-25T15:58:08.381 INFO:tasks.workunit.client.0.smithi087.stdout:6/575: readlink d7/d1a/d1d/d21/d27/d2c/l4b 0 2024-04-25T15:58:08.383 INFO:tasks.workunit.client.0.smithi087.stdout:6/576: chown d7/d1a/d7b/l86 15937585 1 2024-04-25T15:58:08.384 INFO:tasks.workunit.client.0.smithi087.stdout:0/474: dwrite d1/d6/d21/d4c/d50/f8d [0,4194304] 0 2024-04-25T15:58:08.389 INFO:tasks.workunit.client.0.smithi087.stdout:8/498: write d4/d8/dd/f2b [5739846,70015] 0 2024-04-25T15:58:08.390 INFO:tasks.workunit.client.0.smithi087.stdout:8/499: readlink d4/d1d/d17/l40 0 2024-04-25T15:58:08.390 INFO:tasks.workunit.client.0.smithi087.stdout:5/522: dwrite d9/d2f/d3b/f4c [0,4194304] 0 2024-04-25T15:58:08.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/577: creat d7/d1a/fc4 x:0 0 0 2024-04-25T15:58:08.391 INFO:tasks.workunit.client.0.smithi087.stdout:8/500: read - d4/f95 zero size 2024-04-25T15:58:08.392 INFO:tasks.workunit.client.0.smithi087.stdout:5/523: truncate d9/d2f/d40/d4d/d7b/d5c/f8a 756540 0 2024-04-25T15:58:08.395 INFO:tasks.workunit.client.0.smithi087.stdout:0/475: creat d1/da/fa2 x:0 0 0 2024-04-25T15:58:08.395 INFO:tasks.workunit.client.0.smithi087.stdout:6/578: rmdir d7/d1a/d1d/d8a 39 2024-04-25T15:58:08.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/524: symlink d9/la6 0 2024-04-25T15:58:08.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/476: chown d1/d6/d21/d4c/d82/f8e 0 1 2024-04-25T15:58:08.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/525: readlink d9/d91/d30/d70/d79/l7f 0 2024-04-25T15:58:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:8/501: dread d4/d8/dd/f11 [0,4194304] 0 2024-04-25T15:58:08.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/579: creat d7/d1a/d1d/d21/d27/d2c/fc5 x:0 0 0 2024-04-25T15:58:08.402 INFO:tasks.workunit.client.0.smithi087.stdout:5/526: mknod d9/d2f/d40/d4d/d7b/d74/d83/ca7 0 2024-04-25T15:58:08.403 INFO:tasks.workunit.client.0.smithi087.stdout:0/477: creat d1/da/d3e/fa3 x:0 0 0 2024-04-25T15:58:08.403 INFO:tasks.workunit.client.0.smithi087.stdout:5/527: stat d9/d2f/d40/d4d/d7b/d5c/d5f/f53 0 2024-04-25T15:58:08.404 INFO:tasks.workunit.client.0.smithi087.stdout:0/478: chown d1/da/d3e/d85 986688 1 2024-04-25T15:58:08.406 INFO:tasks.workunit.client.0.smithi087.stdout:0/479: truncate d1/f61 4516370 0 2024-04-25T15:58:08.406 INFO:tasks.workunit.client.0.smithi087.stdout:5/528: creat d9/d2f/d40/d4d/d58/fa8 x:0 0 0 2024-04-25T15:58:08.409 INFO:tasks.workunit.client.0.smithi087.stdout:8/502: dwrite d4/d22/f90 [0,4194304] 0 2024-04-25T15:58:08.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/529: link d9/d91/l75 d9/d2f/d3b/la9 0 2024-04-25T15:58:08.412 INFO:tasks.workunit.client.0.smithi087.stdout:8/503: mknod d4/d1d/d17/ca3 0 2024-04-25T15:58:08.413 INFO:tasks.workunit.client.0.smithi087.stdout:5/530: mknod d9/d91/d30/d56/caa 0 2024-04-25T15:58:08.414 INFO:tasks.workunit.client.0.smithi087.stdout:0/480: dwrite d1/d6/f36 [0,4194304] 0 2024-04-25T15:58:08.416 INFO:tasks.workunit.client.0.smithi087.stdout:5/531: stat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/c9d 0 2024-04-25T15:58:08.418 INFO:tasks.workunit.client.0.smithi087.stdout:8/504: dread d4/d8/dd/f11 [0,4194304] 0 2024-04-25T15:58:08.418 INFO:tasks.workunit.client.0.smithi087.stdout:0/481: symlink d1/d6/d21/d4c/d50/d6b/la4 0 2024-04-25T15:58:08.419 INFO:tasks.workunit.client.0.smithi087.stdout:0/482: fdatasync d1/da/d3e/d54/d34/f4b 0 2024-04-25T15:58:08.419 INFO:tasks.workunit.client.0.smithi087.stdout:5/532: mknod d9/d91/d30/cab 0 2024-04-25T15:58:08.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/483: mknod d1/d6/d21/d4c/d50/ca5 0 2024-04-25T15:58:08.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/484: fdatasync d1/da/d3e/f9c 0 2024-04-25T15:58:08.425 INFO:tasks.workunit.client.0.smithi087.stdout:5/533: dread f2 [0,4194304] 0 2024-04-25T15:58:08.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/534: rmdir d9/d2f 39 2024-04-25T15:58:08.430 INFO:tasks.workunit.client.0.smithi087.stdout:5/535: rename d9/d91/d30/d70/d79/l7f to d9/d91/d30/d70/d82/lac 0 2024-04-25T15:58:08.433 INFO:tasks.workunit.client.0.smithi087.stdout:0/485: dwrite d1/da/d3e/fa3 [0,4194304] 0 2024-04-25T15:58:08.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/486: rename d1/f26 to d1/da/d3e/d54/d34/fa6 0 2024-04-25T15:58:08.438 INFO:tasks.workunit.client.0.smithi087.stdout:5/536: getdents d9/d2f/d40/d4d/d7b/d5c/d5f 0 2024-04-25T15:58:08.440 INFO:tasks.workunit.client.0.smithi087.stdout:8/505: dread d4/f73 [0,4194304] 0 2024-04-25T15:58:08.440 INFO:tasks.workunit.client.0.smithi087.stdout:0/487: creat d1/da/d3e/d85/d9b/fa7 x:0 0 0 2024-04-25T15:58:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/488: dread - d1/da/d3e/d54/d34/d55/f78 zero size 2024-04-25T15:58:08.442 INFO:tasks.workunit.client.0.smithi087.stdout:8/506: mknod d4/d8/dd/ca4 0 2024-04-25T15:58:08.444 INFO:tasks.workunit.client.0.smithi087.stdout:0/489: creat d1/d6/d77/fa8 x:0 0 0 2024-04-25T15:58:08.445 INFO:tasks.workunit.client.0.smithi087.stdout:8/507: rmdir d4/d1d/d17/d37/d5e 39 2024-04-25T15:58:08.445 INFO:tasks.workunit.client.0.smithi087.stdout:8/508: read - d4/f95 zero size 2024-04-25T15:58:08.447 INFO:tasks.workunit.client.0.smithi087.stdout:5/537: dwrite d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f50 [0,4194304] 0 2024-04-25T15:58:08.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/490: creat d1/d6/d21/fa9 x:0 0 0 2024-04-25T15:58:08.450 INFO:tasks.workunit.client.0.smithi087.stdout:8/509: rename d4/d22/f90 to d4/d1d/d14/fa5 0 2024-04-25T15:58:08.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/510: write d4/d1d/d14/f31 [117353,129187] 0 2024-04-25T15:58:08.454 INFO:tasks.workunit.client.0.smithi087.stdout:8/511: write d4/d8/f60 [61129,9410] 0 2024-04-25T15:58:08.460 INFO:tasks.workunit.client.0.smithi087.stdout:0/491: dwrite d1/f32 [0,4194304] 0 2024-04-25T15:58:08.462 INFO:tasks.workunit.client.0.smithi087.stdout:5/538: dwrite d9/d2f/d3b/f68 [0,4194304] 0 2024-04-25T15:58:08.466 INFO:tasks.workunit.client.0.smithi087.stdout:5/539: dread d9/d2f/d40/d4d/d7b/f51 [0,4194304] 0 2024-04-25T15:58:08.467 INFO:tasks.workunit.client.0.smithi087.stdout:5/540: dread - d9/d2f/d40/d4d/d7b/d5c/f6e zero size 2024-04-25T15:58:08.468 INFO:tasks.workunit.client.0.smithi087.stdout:5/541: chown d9/d2f/d3b/f9a 152 1 2024-04-25T15:58:08.475 INFO:tasks.workunit.client.0.smithi087.stdout:8/512: dwrite d4/d1d/d17/f33 [0,4194304] 0 2024-04-25T15:58:08.480 INFO:tasks.workunit.client.0.smithi087.stdout:5/542: creat d9/d2f/fad x:0 0 0 2024-04-25T15:58:08.480 INFO:tasks.workunit.client.0.smithi087.stdout:5/543: chown d9/d91/d38/fa1 116550918 1 2024-04-25T15:58:08.486 INFO:tasks.workunit.client.0.smithi087.stdout:5/544: dwrite d9/d2f/d3b/f68 [0,4194304] 0 2024-04-25T15:58:08.487 INFO:tasks.workunit.client.0.smithi087.stdout:8/513: mkdir d4/d1d/d3f/da6 0 2024-04-25T15:58:08.488 INFO:tasks.workunit.client.0.smithi087.stdout:5/545: read - d9/d91/d30/d70/f71 zero size 2024-04-25T15:58:08.493 INFO:tasks.workunit.client.0.smithi087.stdout:0/492: dread d1/da/d3e/d54/d34/d55/f7a [4194304,4194304] 0 2024-04-25T15:58:08.493 INFO:tasks.workunit.client.0.smithi087.stdout:3/419: sync 2024-04-25T15:58:08.501 INFO:tasks.workunit.client.0.smithi087.stdout:5/546: write d9/d91/d30/d70/d79/d7d/f73 [3609290,12963] 0 2024-04-25T15:58:08.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/514: dwrite d4/d1d/d17/d37/d5e/f7a [0,4194304] 0 2024-04-25T15:58:08.508 INFO:tasks.workunit.client.0.smithi087.stdout:0/493: dwrite d1/d6/d21/d4c/d50/f8d [4194304,4194304] 0 2024-04-25T15:58:08.508 INFO:tasks.workunit.client.0.smithi087.stdout:3/420: dwrite d4/db/d28/d82/f86 [0,4194304] 0 2024-04-25T15:58:08.509 INFO:tasks.workunit.client.0.smithi087.stdout:0/494: chown d1/d6/d21 0 1 2024-04-25T15:58:08.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/547: mkdir d9/d91/d30/d70/d79/dae 0 2024-04-25T15:58:08.515 INFO:tasks.workunit.client.0.smithi087.stdout:0/495: read - d1/d27/d7d/f93 zero size 2024-04-25T15:58:08.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/421: creat d4/d17/d24/d29/f87 x:0 0 0 2024-04-25T15:58:08.515 INFO:tasks.workunit.client.0.smithi087.stdout:8/515: write d4/d1d/d14/fa5 [4436380,90541] 0 2024-04-25T15:58:08.516 INFO:tasks.workunit.client.0.smithi087.stdout:0/496: readlink d1/d6/l5c 0 2024-04-25T15:58:08.516 INFO:tasks.workunit.client.0.smithi087.stdout:8/516: chown d4/d1d/f5b 360900 1 2024-04-25T15:58:08.516 INFO:tasks.workunit.client.0.smithi087.stdout:0/497: write d1/da/f3a [1816427,112010] 0 2024-04-25T15:58:08.516 INFO:tasks.workunit.client.0.smithi087.stdout:5/548: unlink d9/d91/d49/d80/f88 0 2024-04-25T15:58:08.516 INFO:tasks.workunit.client.0.smithi087.stdout:3/422: creat d4/d14/d53/f88 x:0 0 0 2024-04-25T15:58:08.517 INFO:tasks.workunit.client.0.smithi087.stdout:0/498: write d1/da/d3e/d54/d34/f6e [2218776,94737] 0 2024-04-25T15:58:08.518 INFO:tasks.workunit.client.0.smithi087.stdout:3/423: fsync d4/d17/f74 0 2024-04-25T15:58:08.519 INFO:tasks.workunit.client.0.smithi087.stdout:5/549: rmdir d9/d2f 39 2024-04-25T15:58:08.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/424: fsync d4/db/d28/d3c/d62/f65 0 2024-04-25T15:58:08.520 INFO:tasks.workunit.client.0.smithi087.stdout:8/517: symlink d4/d1d/d17/la7 0 2024-04-25T15:58:08.522 INFO:tasks.workunit.client.0.smithi087.stdout:3/425: fsync d4/db/d28/d3c/d62/f34 0 2024-04-25T15:58:08.524 INFO:tasks.workunit.client.0.smithi087.stdout:3/426: readlink d4/d17/l39 0 2024-04-25T15:58:08.526 INFO:tasks.workunit.client.0.smithi087.stdout:8/518: mknod d4/d22/d43/d7f/d94/da0/ca8 0 2024-04-25T15:58:08.526 INFO:tasks.workunit.client.0.smithi087.stdout:3/427: chown d4/db/d28/d3c/f4b 33920638 1 2024-04-25T15:58:08.526 INFO:tasks.workunit.client.0.smithi087.stdout:0/499: dwrite d1/d6/d21/f94 [0,4194304] 0 2024-04-25T15:58:08.531 INFO:tasks.workunit.client.0.smithi087.stdout:5/550: link d9/f25 d9/d2f/d40/d4d/d58/faf 0 2024-04-25T15:58:08.532 INFO:tasks.workunit.client.0.smithi087.stdout:8/519: fsync d4/d8/dd/f11 0 2024-04-25T15:58:08.534 INFO:tasks.workunit.client.0.smithi087.stdout:0/500: dwrite d1/f58 [0,4194304] 0 2024-04-25T15:58:08.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/428: mkdir d4/db/d28/d3c/d62/d89 0 2024-04-25T15:58:08.537 INFO:tasks.workunit.client.0.smithi087.stdout:8/520: truncate d4/d8/f49 886491 0 2024-04-25T15:58:08.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/551: dread d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a [0,4194304] 0 2024-04-25T15:58:08.540 INFO:tasks.workunit.client.0.smithi087.stdout:5/552: chown d9/d2f/d40/d4d/d7b/d5c/d5f/d44 341 1 2024-04-25T15:58:08.542 INFO:tasks.workunit.client.0.smithi087.stdout:3/429: symlink d4/d14/d23/l8a 0 2024-04-25T15:58:08.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/521: mknod d4/d8/ca9 0 2024-04-25T15:58:08.543 INFO:tasks.workunit.client.0.smithi087.stdout:9/463: sync 2024-04-25T15:58:08.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/553: read d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a [3365896,20126] 0 2024-04-25T15:58:08.547 INFO:tasks.workunit.client.0.smithi087.stdout:5/554: mknod d9/d2f/d40/d4d/d7b/d5c/d5f/cb0 0 2024-04-25T15:58:08.554 INFO:tasks.workunit.client.0.smithi087.stdout:5/555: link d9/c17 d9/d91/d30/cb1 0 2024-04-25T15:58:08.555 INFO:tasks.workunit.client.0.smithi087.stdout:9/464: dwrite d6/d8/f89 [0,4194304] 0 2024-04-25T15:58:08.555 INFO:tasks.workunit.client.0.smithi087.stdout:0/501: dread d1/da/d3e/d54/d34/d55/f7a [0,4194304] 0 2024-04-25T15:58:08.556 INFO:tasks.workunit.client.0.smithi087.stdout:8/522: dwrite d4/d1d/d17/f2d [8388608,4194304] 0 2024-04-25T15:58:08.556 INFO:tasks.workunit.client.0.smithi087.stdout:9/465: chown d6/d8/lb 23321923 1 2024-04-25T15:58:08.560 INFO:tasks.workunit.client.0.smithi087.stdout:5/556: symlink d9/d91/d30/d70/lb2 0 2024-04-25T15:58:08.561 INFO:tasks.workunit.client.0.smithi087.stdout:5/557: chown d9/d91/d30/d70/lb2 42298 1 2024-04-25T15:58:08.561 INFO:tasks.workunit.client.0.smithi087.stdout:9/466: unlink d6/d8/d12/l26 0 2024-04-25T15:58:08.563 INFO:tasks.workunit.client.0.smithi087.stdout:8/523: mknod d4/d1d/d3f/caa 0 2024-04-25T15:58:08.567 INFO:tasks.workunit.client.0.smithi087.stdout:9/467: rename c5 to d6/d3e/c8c 0 2024-04-25T15:58:08.567 INFO:tasks.workunit.client.0.smithi087.stdout:0/502: dwrite d1/f92 [0,4194304] 0 2024-04-25T15:58:08.569 INFO:tasks.workunit.client.0.smithi087.stdout:8/524: symlink d4/d22/d43/d7f/d94/da0/lab 0 2024-04-25T15:58:08.570 INFO:tasks.workunit.client.0.smithi087.stdout:8/525: stat d4/d1d/d3f/d82 0 2024-04-25T15:58:08.571 INFO:tasks.workunit.client.0.smithi087.stdout:0/503: mkdir d1/d6/d77/daa 0 2024-04-25T15:58:08.574 INFO:tasks.workunit.client.0.smithi087.stdout:5/558: link d9/d2f/d40/d4d/d7b/d5c/c77 d9/d91/d30/d56/cb3 0 2024-04-25T15:58:08.575 INFO:tasks.workunit.client.0.smithi087.stdout:3/430: dread d4/db/f38 [0,4194304] 0 2024-04-25T15:58:08.576 INFO:tasks.workunit.client.0.smithi087.stdout:0/504: write d1/da/d3e/d54/d34/f43 [4036373,91112] 0 2024-04-25T15:58:08.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/505: chown d1/d6/d21/f24 85877987 1 2024-04-25T15:58:08.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/559: creat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fb4 x:0 0 0 2024-04-25T15:58:08.580 INFO:tasks.workunit.client.0.smithi087.stdout:0/506: mkdir d1/dab 0 2024-04-25T15:58:08.581 INFO:tasks.workunit.client.0.smithi087.stdout:5/560: fsync d9/d91/d30/d56/f98 0 2024-04-25T15:58:08.582 INFO:tasks.workunit.client.0.smithi087.stdout:0/507: write d1/d4f/f7b [228167,101454] 0 2024-04-25T15:58:08.582 INFO:tasks.workunit.client.0.smithi087.stdout:3/431: getdents d4/db/d28/d5c 0 2024-04-25T15:58:08.585 INFO:tasks.workunit.client.0.smithi087.stdout:3/432: chown d4/f12 99 1 2024-04-25T15:58:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:9/468: getdents d6/d3e 0 2024-04-25T15:58:08.587 INFO:tasks.workunit.client.0.smithi087.stdout:5/561: creat d9/d2f/d40/d4d/d7b/d8f/fb5 x:0 0 0 2024-04-25T15:58:08.589 INFO:tasks.workunit.client.0.smithi087.stdout:3/433: creat d4/d17/d24/d29/f8b x:0 0 0 2024-04-25T15:58:08.589 INFO:tasks.workunit.client.0.smithi087.stdout:8/526: dread d4/d1d/d14/f6b [0,4194304] 0 2024-04-25T15:58:08.593 INFO:tasks.workunit.client.0.smithi087.stdout:8/527: creat d4/d1d/d3f/fac x:0 0 0 2024-04-25T15:58:08.597 INFO:tasks.workunit.client.0.smithi087.stdout:0/508: truncate d1/d6/d21/d2a/f19 6305661 0 2024-04-25T15:58:08.598 INFO:tasks.workunit.client.0.smithi087.stdout:8/528: getdents d4/d22/d43/d7f 0 2024-04-25T15:58:08.599 INFO:tasks.workunit.client.0.smithi087.stdout:5/562: dwrite d9/d91/d30/d56/f78 [0,4194304] 0 2024-04-25T15:58:08.599 INFO:tasks.workunit.client.0.smithi087.stdout:0/509: write d1/da/d3e/d54/f38 [175876,118088] 0 2024-04-25T15:58:08.605 INFO:tasks.workunit.client.0.smithi087.stdout:8/529: rename d4/d1d/d17/d37/f41 to d4/d1d/d17/d37/fad 0 2024-04-25T15:58:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:7/354: sync 2024-04-25T15:58:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:1/524: sync 2024-04-25T15:58:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:6/580: sync 2024-04-25T15:58:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/473: sync 2024-04-25T15:58:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:9/469: dread d6/d8/d12/f2f [0,4194304] 0 2024-04-25T15:58:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:4/519: sync 2024-04-25T15:58:08.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/434: dread d4/db/f4d [0,4194304] 0 2024-04-25T15:58:08.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/355: fsync d1/d4/d18/f2a 0 2024-04-25T15:58:08.613 INFO:tasks.workunit.client.0.smithi087.stdout:9/470: dread - d6/d8/d48/f6e zero size 2024-04-25T15:58:08.614 INFO:tasks.workunit.client.0.smithi087.stdout:3/435: fsync d4/db/f4d 0 2024-04-25T15:58:08.616 INFO:tasks.workunit.client.0.smithi087.stdout:7/356: chown d1/d4/d18/l2e 52 1 2024-04-25T15:58:08.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/474: creat d3/d27/d29/f8c x:0 0 0 2024-04-25T15:58:08.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/436: mkdir d4/db/d28/d82/d8c 0 2024-04-25T15:58:08.621 INFO:tasks.workunit.client.0.smithi087.stdout:2/475: creat d3/d27/d29/d2d/f8d x:0 0 0 2024-04-25T15:58:08.624 INFO:tasks.workunit.client.0.smithi087.stdout:0/510: dread d1/d4f/f7b [0,4194304] 0 2024-04-25T15:58:08.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/437: creat d4/d17/d24/d3f/f8d x:0 0 0 2024-04-25T15:58:08.626 INFO:tasks.workunit.client.0.smithi087.stdout:4/520: write d4/fb [1755684,107658] 0 2024-04-25T15:58:08.626 INFO:tasks.workunit.client.0.smithi087.stdout:2/476: dread - d3/d27/d29/f7a zero size 2024-04-25T15:58:08.628 INFO:tasks.workunit.client.0.smithi087.stdout:1/525: dwrite d3/d12/d14/d29/d2f/d53/f80 [0,4194304] 0 2024-04-25T15:58:08.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/471: truncate d6/d8/d32/f59 347045 0 2024-04-25T15:58:08.631 INFO:tasks.workunit.client.0.smithi087.stdout:7/357: dwrite d1/d4/f69 [0,4194304] 0 2024-04-25T15:58:08.632 INFO:tasks.workunit.client.0.smithi087.stdout:2/477: stat d3/d27/d29/d2d/l56 0 2024-04-25T15:58:08.634 INFO:tasks.workunit.client.0.smithi087.stdout:9/472: symlink d6/d3e/l8d 0 2024-04-25T15:58:08.634 INFO:tasks.workunit.client.0.smithi087.stdout:3/438: creat d4/d17/f8e x:0 0 0 2024-04-25T15:58:08.637 INFO:tasks.workunit.client.0.smithi087.stdout:9/473: fsync d6/d8/f61 0 2024-04-25T15:58:08.637 INFO:tasks.workunit.client.0.smithi087.stdout:8/530: dwrite d4/d1d/d17/f2e [0,4194304] 0 2024-04-25T15:58:08.637 INFO:tasks.workunit.client.0.smithi087.stdout:4/521: creat d4/d10/d60/d52/d66/fad x:0 0 0 2024-04-25T15:58:08.640 INFO:tasks.workunit.client.0.smithi087.stdout:4/522: fdatasync d4/d10/d60/d52/f92 0 2024-04-25T15:58:08.642 INFO:tasks.workunit.client.0.smithi087.stdout:3/439: readlink d4/db/d28/d3c/l71 0 2024-04-25T15:58:08.648 INFO:tasks.workunit.client.0.smithi087.stdout:2/478: dwrite d3/d20/f45 [0,4194304] 0 2024-04-25T15:58:08.651 INFO:tasks.workunit.client.0.smithi087.stdout:1/526: rename d3/d12/d14/d33/d95/fa3 to d3/d12/fb2 0 2024-04-25T15:58:08.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/474: symlink d6/d8/d32/d57/d66/d75/l8e 0 2024-04-25T15:58:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:2/479: mkdir d3/d20/d4a/d8e 0 2024-04-25T15:58:08.654 INFO:tasks.workunit.client.0.smithi087.stdout:4/523: creat d4/d10/d60/d5c/d3a/d90/fae x:0 0 0 2024-04-25T15:58:08.657 INFO:tasks.workunit.client.0.smithi087.stdout:8/531: getdents d4/d22 0 2024-04-25T15:58:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:9/475: truncate d6/d8/d12/f2f 5057688 0 2024-04-25T15:58:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:8/532: stat d4/d1d/d14/fa5 0 2024-04-25T15:58:08.659 INFO:tasks.workunit.client.0.smithi087.stdout:4/524: creat d4/d10/d60/d5c/d8d/faf x:0 0 0 2024-04-25T15:58:08.661 INFO:tasks.workunit.client.0.smithi087.stdout:8/533: truncate d4/d1d/d17/f91 753896 0 2024-04-25T15:58:08.661 INFO:tasks.workunit.client.0.smithi087.stdout:9/476: creat d6/d8/d29/d3a/d5b/f8f x:0 0 0 2024-04-25T15:58:08.663 INFO:tasks.workunit.client.0.smithi087.stdout:8/534: dread - d4/d1d/f47 zero size 2024-04-25T15:58:08.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/358: truncate d1/d4/f40 4179453 0 2024-04-25T15:58:08.665 INFO:tasks.workunit.client.0.smithi087.stdout:9/477: symlink d6/d8/d29/d3a/d5b/l90 0 2024-04-25T15:58:08.667 INFO:tasks.workunit.client.0.smithi087.stdout:3/440: dread d4/d14/d53/d68/f5d [0,4194304] 0 2024-04-25T15:58:08.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/535: chown d4/d8/l6c 0 1 2024-04-25T15:58:08.667 INFO:tasks.workunit.client.0.smithi087.stdout:9/478: fsync d6/d8/d29/d3a/f40 0 2024-04-25T15:58:08.667 INFO:tasks.workunit.client.0.smithi087.stdout:7/359: mkdir d1/d3c/d6b 0 2024-04-25T15:58:08.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/480: dread d3/d27/d29/f2c [0,4194304] 0 2024-04-25T15:58:08.668 INFO:tasks.workunit.client.0.smithi087.stdout:7/360: truncate d1/d4/f55 1189252 0 2024-04-25T15:58:08.669 INFO:tasks.workunit.client.0.smithi087.stdout:9/479: creat d6/d3e/f91 x:0 0 0 2024-04-25T15:58:08.671 INFO:tasks.workunit.client.0.smithi087.stdout:0/511: write d1/d6/d21/d2a/f19 [7121795,78758] 0 2024-04-25T15:58:08.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/512: creat d1/d6/d21/d4c/d50/d6b/fac x:0 0 0 2024-04-25T15:58:08.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/481: dread d3/d2a/f14 [0,4194304] 0 2024-04-25T15:58:08.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/441: dwrite d4/d17/d24/d29/f87 [0,4194304] 0 2024-04-25T15:58:08.682 INFO:tasks.workunit.client.0.smithi087.stdout:7/361: truncate d1/f19 2544213 0 2024-04-25T15:58:08.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/527: dwrite d3/d12/d14/f27 [0,4194304] 0 2024-04-25T15:58:08.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/482: write d3/d27/d29/d2d/f8d [317185,55170] 0 2024-04-25T15:58:08.687 INFO:tasks.workunit.client.0.smithi087.stdout:7/362: dread - d1/d4/f47 zero size 2024-04-25T15:58:08.688 INFO:tasks.workunit.client.0.smithi087.stdout:8/536: dwrite d4/d1d/d14/f2c [0,4194304] 0 2024-04-25T15:58:08.688 INFO:tasks.workunit.client.0.smithi087.stdout:3/442: unlink d4/d17/l39 0 2024-04-25T15:58:08.691 INFO:tasks.workunit.client.0.smithi087.stdout:4/525: dread d4/d10/d60/d56/d61/d3f/d58/f83 [0,4194304] 0 2024-04-25T15:58:08.694 INFO:tasks.workunit.client.0.smithi087.stdout:8/537: mkdir d4/d1d/d7c/dae 0 2024-04-25T15:58:08.695 INFO:tasks.workunit.client.0.smithi087.stdout:2/483: unlink d3/d27/d38/d7e/f86 0 2024-04-25T15:58:08.696 INFO:tasks.workunit.client.0.smithi087.stdout:4/526: write d4/d10/d60/d5c/f37 [2326188,40506] 0 2024-04-25T15:58:08.698 INFO:tasks.workunit.client.0.smithi087.stdout:7/363: rename d1/d4/d18/d36/c4a to d1/d9/d26/c6c 0 2024-04-25T15:58:08.702 INFO:tasks.workunit.client.0.smithi087.stdout:0/513: truncate d1/da/d3e/d54/d34/f43 2435039 0 2024-04-25T15:58:08.703 INFO:tasks.workunit.client.0.smithi087.stdout:8/538: dwrite d4/f65 [0,4194304] 0 2024-04-25T15:58:08.704 INFO:tasks.workunit.client.0.smithi087.stdout:3/443: symlink d4/db/d28/d3c/d62/d89/l8f 0 2024-04-25T15:58:08.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/527: dwrite d4/d10/d60/d52/d66/f2c [4194304,4194304] 0 2024-04-25T15:58:08.709 INFO:tasks.workunit.client.0.smithi087.stdout:0/514: creat d1/da/d3e/d54/d34/d55/fad x:0 0 0 2024-04-25T15:58:08.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/484: link d3/d27/d29/d4f/d5a/d6a/f89 d3/d2a/f8f 0 2024-04-25T15:58:08.710 INFO:tasks.workunit.client.0.smithi087.stdout:4/528: creat d4/d10/d60/d5c/d3a/d90/fb0 x:0 0 0 2024-04-25T15:58:08.712 INFO:tasks.workunit.client.0.smithi087.stdout:8/539: dread d4/d1d/f97 [0,4194304] 0 2024-04-25T15:58:08.717 INFO:tasks.workunit.client.0.smithi087.stdout:4/529: rmdir d4/d10/d60/d56 39 2024-04-25T15:58:08.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/528: truncate d3/d12/d14/d29/d2f/f36 4097997 0 2024-04-25T15:58:08.722 INFO:tasks.workunit.client.0.smithi087.stdout:8/540: stat d4/d1d/f59 0 2024-04-25T15:58:08.723 INFO:tasks.workunit.client.0.smithi087.stdout:8/541: dread - d4/d1d/d3f/f8d zero size 2024-04-25T15:58:08.724 INFO:tasks.workunit.client.0.smithi087.stdout:2/485: rename d3/d27/d29/d2d/d40/c6b to d3/d2a/d48/d77/d79/c90 0 2024-04-25T15:58:08.725 INFO:tasks.workunit.client.0.smithi087.stdout:3/444: getdents d4/d17/d24/d3f 0 2024-04-25T15:58:08.728 INFO:tasks.workunit.client.0.smithi087.stdout:2/486: fdatasync d3/d27/d29/f2c 0 2024-04-25T15:58:08.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/487: write d3/d27/d29/d2d/d40/f7b [71777,7928] 0 2024-04-25T15:58:08.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/529: dwrite d3/d12/d14/d29/d2f/d61/f87 [0,4194304] 0 2024-04-25T15:58:08.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/488: write d3/d20/f45 [2009344,114911] 0 2024-04-25T15:58:08.733 INFO:tasks.workunit.client.0.smithi087.stdout:0/515: truncate d1/f32 1866294 0 2024-04-25T15:58:08.736 INFO:tasks.workunit.client.0.smithi087.stdout:7/364: creat d1/d9/d26/f6d x:0 0 0 2024-04-25T15:58:08.738 INFO:tasks.workunit.client.0.smithi087.stdout:7/365: fdatasync d1/d4/d18/d36/d37/f5e 0 2024-04-25T15:58:08.739 INFO:tasks.workunit.client.0.smithi087.stdout:1/530: dwrite d3/d12/f8d [0,4194304] 0 2024-04-25T15:58:08.742 INFO:tasks.workunit.client.0.smithi087.stdout:1/531: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:08.746 INFO:tasks.workunit.client.0.smithi087.stdout:4/530: rename d4/d10/d60/d5c/f86 to d4/d10/d60/fb1 0 2024-04-25T15:58:08.747 INFO:tasks.workunit.client.0.smithi087.stdout:2/489: fdatasync d3/f1e 0 2024-04-25T15:58:08.749 INFO:tasks.workunit.client.0.smithi087.stdout:0/516: write d1/d6/f47 [334720,63652] 0 2024-04-25T15:58:08.753 INFO:tasks.workunit.client.0.smithi087.stdout:8/542: write d4/d8/dd/d2f/f67 [299118,91343] 0 2024-04-25T15:58:08.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/445: dwrite d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:08.753 INFO:tasks.workunit.client.0.smithi087.stdout:1/532: rmdir d3/d12/d14 39 2024-04-25T15:58:08.757 INFO:tasks.workunit.client.0.smithi087.stdout:2/490: symlink d3/d2a/d48/d83/l91 0 2024-04-25T15:58:08.759 INFO:tasks.workunit.client.0.smithi087.stdout:4/531: unlink d4/d10/d60/d56/d61/d3f/d58/c63 0 2024-04-25T15:58:08.761 INFO:tasks.workunit.client.0.smithi087.stdout:7/366: link d1/d9/d26/f38 d1/d3c/f6e 0 2024-04-25T15:58:08.765 INFO:tasks.workunit.client.0.smithi087.stdout:0/517: link d1/d6/d21/d4c/c8b d1/d6/d21/cae 0 2024-04-25T15:58:08.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/533: dwrite d3/d12/d4d/d7d/f8c [0,4194304] 0 2024-04-25T15:58:08.766 INFO:tasks.workunit.client.0.smithi087.stdout:8/543: dwrite d4/d8/dd/d2f/f80 [0,4194304] 0 2024-04-25T15:58:08.767 INFO:tasks.workunit.client.0.smithi087.stdout:4/532: unlink d4/d10/d60/d52/d66/l98 0 2024-04-25T15:58:08.768 INFO:tasks.workunit.client.0.smithi087.stdout:8/544: stat d4/d1d/d17/d37/f78 0 2024-04-25T15:58:08.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/545: chown d4/d22/d43/d7f/d94/da0/ca8 1036425823 1 2024-04-25T15:58:08.770 INFO:tasks.workunit.client.0.smithi087.stdout:2/491: getdents d3/d27/d29/d76 0 2024-04-25T15:58:08.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/492: write d3/d27/d29/f6e [1034897,36657] 0 2024-04-25T15:58:08.775 INFO:tasks.workunit.client.0.smithi087.stdout:1/534: stat d3/d12/d14/d29/d3b/f5e 0 2024-04-25T15:58:08.779 INFO:tasks.workunit.client.0.smithi087.stdout:1/535: creat d3/d12/d14/d29/d67/d73/fb3 x:0 0 0 2024-04-25T15:58:08.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/518: dread d1/da/d3e/d54/f38 [0,4194304] 0 2024-04-25T15:58:08.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/533: dwrite d4/d10/d60/f64 [4194304,4194304] 0 2024-04-25T15:58:08.782 INFO:tasks.workunit.client.0.smithi087.stdout:3/446: truncate d4/d17/d24/f32 1566776 0 2024-04-25T15:58:08.782 INFO:tasks.workunit.client.0.smithi087.stdout:0/519: dread - d1/d6/d21/fa9 zero size 2024-04-25T15:58:08.784 INFO:tasks.workunit.client.0.smithi087.stdout:4/534: chown d4/d10/d60/d56/d61/d3f 152 1 2024-04-25T15:58:08.785 INFO:tasks.workunit.client.0.smithi087.stdout:0/520: mknod d1/caf 0 2024-04-25T15:58:08.789 INFO:tasks.workunit.client.0.smithi087.stdout:0/521: fdatasync d1/d4f/f7b 0 2024-04-25T15:58:08.792 INFO:tasks.workunit.client.0.smithi087.stdout:0/522: creat d1/d6/fb0 x:0 0 0 2024-04-25T15:58:08.793 INFO:tasks.workunit.client.0.smithi087.stdout:8/546: truncate d4/d1d/d17/f98 4352673 0 2024-04-25T15:58:08.794 INFO:tasks.workunit.client.0.smithi087.stdout:0/523: mkdir d1/d6/db1 0 2024-04-25T15:58:08.797 INFO:tasks.workunit.client.0.smithi087.stdout:0/524: mkdir d1/da/d3e/db2 0 2024-04-25T15:58:08.797 INFO:tasks.workunit.client.0.smithi087.stdout:3/447: truncate d4/db/fc 2927581 0 2024-04-25T15:58:08.798 INFO:tasks.workunit.client.0.smithi087.stdout:0/525: write d1/da/d3e/d54/f88 [906340,45771] 0 2024-04-25T15:58:08.798 INFO:tasks.workunit.client.0.smithi087.stdout:4/535: write d4/d10/d60/d5c/d3a/f95 [4315311,29407] 0 2024-04-25T15:58:08.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/547: getdents d4/d8/dd/d85/d86 0 2024-04-25T15:58:08.799 INFO:tasks.workunit.client.0.smithi087.stdout:4/536: chown d4/f6 71 1 2024-04-25T15:58:08.801 INFO:tasks.workunit.client.0.smithi087.stdout:0/526: write d1/d6/d21/d4c/d50/d6b/f8a [291261,119784] 0 2024-04-25T15:58:08.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/537: dread - d4/d10/d60/d56/d61/d3f/d42/d97/f89 zero size 2024-04-25T15:58:08.803 INFO:tasks.workunit.client.0.smithi087.stdout:8/548: rename d4/f81 to d4/d1d/d3f/d82/faf 0 2024-04-25T15:58:08.803 INFO:tasks.workunit.client.0.smithi087.stdout:0/527: write d1/da/d3e/d85/d9b/fa7 [775578,107059] 0 2024-04-25T15:58:08.804 INFO:tasks.workunit.client.0.smithi087.stdout:4/538: readlink d4/d10/d60/d5c/d3a/l6b 0 2024-04-25T15:58:08.805 INFO:tasks.workunit.client.0.smithi087.stdout:0/528: fsync d1/d6/d21/f23 0 2024-04-25T15:58:08.806 INFO:tasks.workunit.client.0.smithi087.stdout:4/539: write d4/d10/d60/d52/d66/f11 [1984972,22197] 0 2024-04-25T15:58:08.808 INFO:tasks.workunit.client.0.smithi087.stdout:0/529: write d1/da/d3e/d54/d34/d55/fad [172505,101055] 0 2024-04-25T15:58:08.811 INFO:tasks.workunit.client.0.smithi087.stdout:1/536: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:08.813 INFO:tasks.workunit.client.0.smithi087.stdout:8/549: rename d4/d1d/d17/f98 to d4/d1d/d3f/d82/fb0 0 2024-04-25T15:58:08.815 INFO:tasks.workunit.client.0.smithi087.stdout:0/530: dread d1/d6/d21/f23 [0,4194304] 0 2024-04-25T15:58:08.817 INFO:tasks.workunit.client.0.smithi087.stdout:8/550: rmdir d4/d1d/d3f 39 2024-04-25T15:58:08.820 INFO:tasks.workunit.client.0.smithi087.stdout:3/448: dread d4/d14/d37/d51/f52 [0,4194304] 0 2024-04-25T15:58:08.821 INFO:tasks.workunit.client.0.smithi087.stdout:8/551: mkdir d4/d9c/db1 0 2024-04-25T15:58:08.823 INFO:tasks.workunit.client.0.smithi087.stdout:1/537: truncate d3/d12/f26 2927916 0 2024-04-25T15:58:08.823 INFO:tasks.workunit.client.0.smithi087.stdout:0/531: dwrite d1/da/f3a [0,4194304] 0 2024-04-25T15:58:08.824 INFO:tasks.workunit.client.0.smithi087.stdout:8/552: fsync d4/d8/fb 0 2024-04-25T15:58:08.829 INFO:tasks.workunit.client.0.smithi087.stdout:0/532: symlink d1/da/d3e/d54/d34/lb3 0 2024-04-25T15:58:08.829 INFO:tasks.workunit.client.0.smithi087.stdout:4/540: dread d4/d10/d60/d5c/d3a/f67 [0,4194304] 0 2024-04-25T15:58:08.832 INFO:tasks.workunit.client.0.smithi087.stdout:8/553: dwrite d4/d8/dd/f11 [0,4194304] 0 2024-04-25T15:58:08.836 INFO:tasks.workunit.client.0.smithi087.stdout:1/538: link d3/d12/d14/d29/d3b/c6b d3/d12/d14/d29/cb4 0 2024-04-25T15:58:08.837 INFO:tasks.workunit.client.0.smithi087.stdout:0/533: getdents d1/da 0 2024-04-25T15:58:08.840 INFO:tasks.workunit.client.0.smithi087.stdout:8/554: creat d4/d1d/d3f/d82/fb2 x:0 0 0 2024-04-25T15:58:08.841 INFO:tasks.workunit.client.0.smithi087.stdout:4/541: dwrite d4/d10/d60/d56/d61/d3f/fa4 [0,4194304] 0 2024-04-25T15:58:08.843 INFO:tasks.workunit.client.0.smithi087.stdout:3/449: truncate d4/db/f6c 2432822 0 2024-04-25T15:58:08.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/555: mkdir d4/d22/d43/db3 0 2024-04-25T15:58:08.849 INFO:tasks.workunit.client.0.smithi087.stdout:3/450: symlink d4/db/d28/d3c/d62/d89/l90 0 2024-04-25T15:58:08.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/539: dwrite d3/d12/d14/d29/d3b/f90 [0,4194304] 0 2024-04-25T15:58:08.852 INFO:tasks.workunit.client.0.smithi087.stdout:0/534: rmdir d1/d79 0 2024-04-25T15:58:08.853 INFO:tasks.workunit.client.0.smithi087.stdout:0/535: fdatasync d1/d6/f36 0 2024-04-25T15:58:08.853 INFO:tasks.workunit.client.0.smithi087.stdout:1/540: rmdir d3/d12/d14/d29/d67/d73/d9c 39 2024-04-25T15:58:08.854 INFO:tasks.workunit.client.0.smithi087.stdout:4/542: write d4/f14 [797464,77518] 0 2024-04-25T15:58:08.855 INFO:tasks.workunit.client.0.smithi087.stdout:8/556: mkdir d4/d8/db4 0 2024-04-25T15:58:08.857 INFO:tasks.workunit.client.0.smithi087.stdout:0/536: creat d1/da/d3e/d85/fb4 x:0 0 0 2024-04-25T15:58:08.858 INFO:tasks.workunit.client.0.smithi087.stdout:1/541: creat d3/d12/fb5 x:0 0 0 2024-04-25T15:58:08.859 INFO:tasks.workunit.client.0.smithi087.stdout:8/557: creat d4/d1d/d3f/fb5 x:0 0 0 2024-04-25T15:58:08.861 INFO:tasks.workunit.client.0.smithi087.stdout:0/537: creat d1/da/d3e/db2/fb5 x:0 0 0 2024-04-25T15:58:08.862 INFO:tasks.workunit.client.0.smithi087.stdout:0/538: dread - d1/d27/d7d/f93 zero size 2024-04-25T15:58:08.863 INFO:tasks.workunit.client.0.smithi087.stdout:1/542: mknod d3/d12/d14/cb6 0 2024-04-25T15:58:08.863 INFO:tasks.workunit.client.0.smithi087.stdout:0/539: stat d1/d27/f76 0 2024-04-25T15:58:08.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/543: getdents d4/d10/d60/d56/d61/d3f/d8a 0 2024-04-25T15:58:08.867 INFO:tasks.workunit.client.0.smithi087.stdout:1/543: stat d3/d12/f26 0 2024-04-25T15:58:08.867 INFO:tasks.workunit.client.0.smithi087.stdout:8/558: dwrite d4/d1d/d7c/f1a [0,4194304] 0 2024-04-25T15:58:08.867 INFO:tasks.workunit.client.0.smithi087.stdout:0/540: mknod d1/cb6 0 2024-04-25T15:58:08.871 INFO:tasks.workunit.client.0.smithi087.stdout:8/559: symlink d4/d1d/d3f/lb6 0 2024-04-25T15:58:08.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/544: dwrite d4/d10/d60/f64 [4194304,4194304] 0 2024-04-25T15:58:08.875 INFO:tasks.workunit.client.0.smithi087.stdout:8/560: mkdir d4/d1d/d7c/dae/db7 0 2024-04-25T15:58:08.876 INFO:tasks.workunit.client.0.smithi087.stdout:8/561: chown d4/d1d/d17/f91 10729 1 2024-04-25T15:58:08.876 INFO:tasks.workunit.client.0.smithi087.stdout:4/545: creat d4/d10/d60/d5c/d3a/d90/fb2 x:0 0 0 2024-04-25T15:58:08.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/562: dread d4/d1d/d17/f2e [0,4194304] 0 2024-04-25T15:58:08.884 INFO:tasks.workunit.client.0.smithi087.stdout:8/563: read d4/d8/f60 [57025,96209] 0 2024-04-25T15:58:08.887 INFO:tasks.workunit.client.0.smithi087.stdout:1/544: link d3/d12/d14/d33/c46 d3/d12/d14/d29/d2f/d40/cb7 0 2024-04-25T15:58:08.889 INFO:tasks.workunit.client.0.smithi087.stdout:0/541: dwrite d1/d6/d21/f51 [0,4194304] 0 2024-04-25T15:58:08.889 INFO:tasks.workunit.client.0.smithi087.stdout:1/545: write d3/d12/f43 [4306731,120062] 0 2024-04-25T15:58:08.891 INFO:tasks.workunit.client.0.smithi087.stdout:0/542: write d1/da/d3e/f9c [193035,130993] 0 2024-04-25T15:58:08.891 INFO:tasks.workunit.client.0.smithi087.stdout:8/564: dread d4/d1d/d7c/f1a [0,4194304] 0 2024-04-25T15:58:08.892 INFO:tasks.workunit.client.0.smithi087.stdout:0/543: chown d1/d6/d77/f7e 166484 1 2024-04-25T15:58:08.894 INFO:tasks.workunit.client.0.smithi087.stdout:8/565: write d4/d22/f96 [809506,15651] 0 2024-04-25T15:58:08.894 INFO:tasks.workunit.client.0.smithi087.stdout:1/546: creat d3/d12/d14/d29/d65/d97/fb8 x:0 0 0 2024-04-25T15:58:08.895 INFO:tasks.workunit.client.0.smithi087.stdout:8/566: write d4/d1d/d3f/f8d [686973,26539] 0 2024-04-25T15:58:08.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/544: creat d1/d6/d1f/fb7 x:0 0 0 2024-04-25T15:58:08.901 INFO:tasks.workunit.client.0.smithi087.stdout:0/545: creat d1/d6/d21/d4c/d50/fb8 x:0 0 0 2024-04-25T15:58:08.902 INFO:tasks.workunit.client.0.smithi087.stdout:0/546: read d1/f32 [12695,44760] 0 2024-04-25T15:58:08.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/547: read d1/d6/f47 [3742437,103803] 0 2024-04-25T15:58:08.908 INFO:tasks.workunit.client.0.smithi087.stdout:0/548: mknod d1/da/d3e/db2/cb9 0 2024-04-25T15:58:08.908 INFO:tasks.workunit.client.0.smithi087.stdout:1/547: dread d3/d12/d14/f17 [0,4194304] 0 2024-04-25T15:58:08.909 INFO:tasks.workunit.client.0.smithi087.stdout:4/546: dwrite d4/d10/d60/d5c/d3a/f62 [0,4194304] 0 2024-04-25T15:58:08.911 INFO:tasks.workunit.client.0.smithi087.stdout:1/548: rmdir d3/d12/d14/d29/d3b 39 2024-04-25T15:58:08.911 INFO:tasks.workunit.client.0.smithi087.stdout:4/547: write d4/d10/d60/d5c/d3a/f95 [2270289,128873] 0 2024-04-25T15:58:08.914 INFO:tasks.workunit.client.0.smithi087.stdout:4/548: chown d4/d10/d60/d52/d66/f11 3966 1 2024-04-25T15:58:08.915 INFO:tasks.workunit.client.0.smithi087.stdout:8/567: dread d4/d8/f6a [0,4194304] 0 2024-04-25T15:58:08.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/549: write d3/d12/d4d/f7e [462420,47625] 0 2024-04-25T15:58:08.921 INFO:tasks.workunit.client.0.smithi087.stdout:1/550: creat d3/fb9 x:0 0 0 2024-04-25T15:58:08.923 INFO:tasks.workunit.client.0.smithi087.stdout:1/551: write d3/f1b [4107198,103415] 0 2024-04-25T15:58:08.924 INFO:tasks.workunit.client.0.smithi087.stdout:4/549: dwrite d4/d10/d60/f8e [0,4194304] 0 2024-04-25T15:58:08.925 INFO:tasks.workunit.client.0.smithi087.stdout:8/568: dwrite d4/d1d/d17/f91 [0,4194304] 0 2024-04-25T15:58:08.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/550: unlink d4/d10/d60/l93 0 2024-04-25T15:58:08.932 INFO:tasks.workunit.client.0.smithi087.stdout:8/569: symlink d4/d9c/lb8 0 2024-04-25T15:58:08.932 INFO:tasks.workunit.client.0.smithi087.stdout:4/551: chown d4/d10/f9e 1510532 1 2024-04-25T15:58:08.938 INFO:tasks.workunit.client.0.smithi087.stdout:8/570: link d4/d8/c9a d4/d1d/d7c/dae/db7/cb9 0 2024-04-25T15:58:08.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/552: link d4/d10/d60/d56/d61/l80 d4/d10/d60/d5c/d8d/lb3 0 2024-04-25T15:58:08.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/571: fdatasync d4/d8/dd/d2f/f67 0 2024-04-25T15:58:08.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/572: chown d4/d22 7 1 2024-04-25T15:58:08.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/553: creat d4/d10/d60/d56/d61/d3f/d8a/fb4 x:0 0 0 2024-04-25T15:58:08.942 INFO:tasks.workunit.client.0.smithi087.stdout:8/573: symlink d4/d22/d43/d7f/d94/da0/lba 0 2024-04-25T15:58:08.943 INFO:tasks.workunit.client.0.smithi087.stdout:4/554: getdents d4/d87 0 2024-04-25T15:58:08.945 INFO:tasks.workunit.client.0.smithi087.stdout:8/574: rename d4/d1d/d3f/caa to d4/d1d/d7c/dae/db7/cbb 0 2024-04-25T15:58:08.947 INFO:tasks.workunit.client.0.smithi087.stdout:4/555: creat d4/d10/d60/d56/fb5 x:0 0 0 2024-04-25T15:58:08.950 INFO:tasks.workunit.client.0.smithi087.stdout:4/556: creat d4/d10/d60/fb6 x:0 0 0 2024-04-25T15:58:08.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/575: dwrite d4/d8/dd/d85/fa1 [0,4194304] 0 2024-04-25T15:58:08.954 INFO:tasks.workunit.client.0.smithi087.stdout:4/557: truncate d4/d10/d60/d52/d66/f85 332218 0 2024-04-25T15:58:08.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/552: truncate d3/f35 255517 0 2024-04-25T15:58:08.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/549: dwrite d1/f3d [0,4194304] 0 2024-04-25T15:58:08.966 INFO:tasks.workunit.client.0.smithi087.stdout:0/550: unlink d1/d6/d21/d2a/l86 0 2024-04-25T15:58:08.967 INFO:tasks.workunit.client.0.smithi087.stdout:1/553: unlink d3/d12/d14/d33/c46 0 2024-04-25T15:58:08.967 INFO:tasks.workunit.client.0.smithi087.stdout:0/551: write d1/da/d3e/d54/f91 [136497,72507] 0 2024-04-25T15:58:08.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/552: chown d1/f3c 174 1 2024-04-25T15:58:08.969 INFO:tasks.workunit.client.0.smithi087.stdout:4/558: getdents d4/d10 0 2024-04-25T15:58:08.969 INFO:tasks.workunit.client.0.smithi087.stdout:1/554: fdatasync d3/d12/d14/d29/d8e/f9d 0 2024-04-25T15:58:08.970 INFO:tasks.workunit.client.0.smithi087.stdout:1/555: write d3/d12/f43 [2181646,64945] 0 2024-04-25T15:58:08.972 INFO:tasks.workunit.client.0.smithi087.stdout:1/556: write d3/d12/d14/d29/d67/fa0 [786746,96589] 0 2024-04-25T15:58:08.972 INFO:tasks.workunit.client.0.smithi087.stdout:8/576: truncate d4/d8/dd/d85/d86/f8f 2492442 0 2024-04-25T15:58:08.974 INFO:tasks.workunit.client.0.smithi087.stdout:4/559: mkdir d4/d10/d60/d56/d61/db7 0 2024-04-25T15:58:08.975 INFO:tasks.workunit.client.0.smithi087.stdout:1/557: mkdir d3/d12/d4d/dba 0 2024-04-25T15:58:08.975 INFO:tasks.workunit.client.0.smithi087.stdout:0/553: read d1/d6/f3b [4114352,55785] 0 2024-04-25T15:58:08.976 INFO:tasks.workunit.client.0.smithi087.stdout:4/560: dread d4/d10/d60/d52/d66/f85 [0,4194304] 0 2024-04-25T15:58:08.976 INFO:tasks.workunit.client.0.smithi087.stdout:8/577: mkdir d4/d8/dd/d85/dbc 0 2024-04-25T15:58:08.980 INFO:tasks.workunit.client.0.smithi087.stdout:0/554: truncate d1/d6/f36 3601858 0 2024-04-25T15:58:08.981 INFO:tasks.workunit.client.0.smithi087.stdout:0/555: truncate d1/da/d3e/d54/d34/fa6 4962574 0 2024-04-25T15:58:08.982 INFO:tasks.workunit.client.0.smithi087.stdout:4/561: rename d4/f41 to d4/d10/d60/d5c/d3a/d90/fb8 0 2024-04-25T15:58:08.982 INFO:tasks.workunit.client.0.smithi087.stdout:0/556: write d1/da/d3e/fa3 [4299711,22547] 0 2024-04-25T15:58:08.985 INFO:tasks.workunit.client.0.smithi087.stdout:1/558: link d3/d12/d14/f17 d3/d12/d14/d29/d8e/fbb 0 2024-04-25T15:58:08.986 INFO:tasks.workunit.client.0.smithi087.stdout:8/578: getdents d4/d1d/d3f/da6 0 2024-04-25T15:58:08.990 INFO:tasks.workunit.client.0.smithi087.stdout:0/557: mkdir d1/da/d3e/db2/dba 0 2024-04-25T15:58:08.993 INFO:tasks.workunit.client.0.smithi087.stdout:1/559: creat d3/d2d/d6c/fbc x:0 0 0 2024-04-25T15:58:08.993 INFO:tasks.workunit.client.0.smithi087.stdout:9/480: sync 2024-04-25T15:58:08.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/563: sync 2024-04-25T15:58:08.994 INFO:tasks.workunit.client.0.smithi087.stdout:6/581: sync 2024-04-25T15:58:08.996 INFO:tasks.workunit.client.0.smithi087.stdout:1/560: mknod d3/d12/d14/d29/d2f/d53/cbd 0 2024-04-25T15:58:08.997 INFO:tasks.workunit.client.0.smithi087.stdout:9/481: stat d6/d8/d29/d3a/d5b/d60/f53 0 2024-04-25T15:58:08.998 INFO:tasks.workunit.client.0.smithi087.stdout:4/562: dwrite d4/d10/d60/d56/d61/d3f/d58/f83 [0,4194304] 0 2024-04-25T15:58:09.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/482: read d6/d8/d48/f56 [1303,3066] 0 2024-04-25T15:58:09.003 INFO:tasks.workunit.client.0.smithi087.stdout:5/564: symlink d9/d91/d30/d70/d79/d94/lb6 0 2024-04-25T15:58:09.004 INFO:tasks.workunit.client.0.smithi087.stdout:4/563: mkdir d4/d10/d60/d5c/d3a/d90/db9 0 2024-04-25T15:58:09.010 INFO:tasks.workunit.client.0.smithi087.stdout:1/561: write d3/f8 [6140488,37384] 0 2024-04-25T15:58:09.011 INFO:tasks.workunit.client.0.smithi087.stdout:4/564: readlink d4/d10/d60/d5c/d3a/l6b 0 2024-04-25T15:58:09.013 INFO:tasks.workunit.client.0.smithi087.stdout:6/582: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/fb8 [0,4194304] 0 2024-04-25T15:58:09.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/579: dwrite d4/d8/f8e [0,4194304] 0 2024-04-25T15:58:09.019 INFO:tasks.workunit.client.0.smithi087.stdout:9/483: dwrite d6/d8/d48/f6e [0,4194304] 0 2024-04-25T15:58:09.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/583: write d7/d1a/d1d/d21/f6d [342750,89054] 0 2024-04-25T15:58:09.023 INFO:tasks.workunit.client.0.smithi087.stdout:4/565: creat d4/d10/d60/d52/fba x:0 0 0 2024-04-25T15:58:09.025 INFO:tasks.workunit.client.0.smithi087.stdout:5/565: dwrite d9/d91/d30/d70/d79/d7d/f73 [8388608,4194304] 0 2024-04-25T15:58:09.026 INFO:tasks.workunit.client.0.smithi087.stdout:8/580: rename d4/d1d/d7c/f1a to d4/d8/dd/fbd 0 2024-04-25T15:58:09.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/558: dread d1/d6/f36 [0,4194304] 0 2024-04-25T15:58:09.031 INFO:tasks.workunit.client.0.smithi087.stdout:9/484: rename d6/d8/d32/d4c/d4f to d6/d3e/d92 0 2024-04-25T15:58:09.034 INFO:tasks.workunit.client.0.smithi087.stdout:0/559: symlink d1/da/d3e/d85/lbb 0 2024-04-25T15:58:09.034 INFO:tasks.workunit.client.0.smithi087.stdout:1/562: dwrite d3/d2d/d6c/f9b [0,4194304] 0 2024-04-25T15:58:09.034 INFO:tasks.workunit.client.0.smithi087.stdout:5/566: dread d9/d2f/d40/d4d/d7b/f51 [0,4194304] 0 2024-04-25T15:58:09.036 INFO:tasks.workunit.client.0.smithi087.stdout:9/485: creat d6/d8/d32/d57/d66/f93 x:0 0 0 2024-04-25T15:58:09.037 INFO:tasks.workunit.client.0.smithi087.stdout:0/560: write d1/d6/d1f/f40 [3619308,49311] 0 2024-04-25T15:58:09.038 INFO:tasks.workunit.client.0.smithi087.stdout:4/566: rename d4/d10/d60/d5c/d8d/faa to d4/d10/d60/d5c/d3a/d90/fbb 0 2024-04-25T15:58:09.039 INFO:tasks.workunit.client.0.smithi087.stdout:8/581: getdents d4/d9c 0 2024-04-25T15:58:09.039 INFO:tasks.workunit.client.0.smithi087.stdout:4/567: chown d4/d10/d60/d56/d61/l19 2050269 1 2024-04-25T15:58:09.039 INFO:tasks.workunit.client.0.smithi087.stdout:1/563: mknod d3/d2d/cbe 0 2024-04-25T15:58:09.040 INFO:tasks.workunit.client.0.smithi087.stdout:5/567: symlink d9/d91/d49/lb7 0 2024-04-25T15:58:09.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/561: symlink d1/d6/d77/lbc 0 2024-04-25T15:58:09.043 INFO:tasks.workunit.client.0.smithi087.stdout:0/562: read d1/da/f3a [2698414,14790] 0 2024-04-25T15:58:09.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/582: dread d4/d1d/d17/f2e [0,4194304] 0 2024-04-25T15:58:09.046 INFO:tasks.workunit.client.0.smithi087.stdout:8/583: read d4/d1d/d17/f2d [256751,71019] 0 2024-04-25T15:58:09.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/564: dwrite d3/d12/d14/d29/d8e/f9d [0,4194304] 0 2024-04-25T15:58:09.049 INFO:tasks.workunit.client.0.smithi087.stdout:9/486: creat d6/d8/d29/f94 x:0 0 0 2024-04-25T15:58:09.049 INFO:tasks.workunit.client.0.smithi087.stdout:5/568: symlink d9/d91/lb8 0 2024-04-25T15:58:09.051 INFO:tasks.workunit.client.0.smithi087.stdout:9/487: write d6/d8/d29/d3a/d5b/f7e [776030,12438] 0 2024-04-25T15:58:09.052 INFO:tasks.workunit.client.0.smithi087.stdout:4/568: creat d4/d10/d60/d52/d66/fbc x:0 0 0 2024-04-25T15:58:09.053 INFO:tasks.workunit.client.0.smithi087.stdout:4/569: chown d4/d10/d60/d52/l69 14918184 1 2024-04-25T15:58:09.054 INFO:tasks.workunit.client.0.smithi087.stdout:0/563: link d1/d6/c8f d1/d6/d77/cbd 0 2024-04-25T15:58:09.055 INFO:tasks.workunit.client.0.smithi087.stdout:4/570: truncate d4/d10/d60/d56/d61/d3f/d42/d97/f89 771706 0 2024-04-25T15:58:09.057 INFO:tasks.workunit.client.0.smithi087.stdout:8/584: mknod d4/d22/d43/cbe 0 2024-04-25T15:58:09.061 INFO:tasks.workunit.client.0.smithi087.stdout:0/564: creat d1/d4f/fbe x:0 0 0 2024-04-25T15:58:09.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/569: creat d9/d2f/d40/d4d/d7b/d74/fb9 x:0 0 0 2024-04-25T15:58:09.067 INFO:tasks.workunit.client.0.smithi087.stdout:9/488: dwrite d6/d8/d29/d3a/d5b/d60/f53 [4194304,4194304] 0 2024-04-25T15:58:09.067 INFO:tasks.workunit.client.0.smithi087.stdout:1/565: rename d3/d12/d14/d29/cb4 to d3/d12/d14/d29/d2f/d40/cbf 0 2024-04-25T15:58:09.069 INFO:tasks.workunit.client.0.smithi087.stdout:9/489: truncate d6/d8/f61 757233 0 2024-04-25T15:58:09.069 INFO:tasks.workunit.client.0.smithi087.stdout:1/566: write d3/d12/d4d/f51 [1602830,64210] 0 2024-04-25T15:58:09.069 INFO:tasks.workunit.client.0.smithi087.stdout:5/570: creat d9/d91/d30/d70/d79/d7d/fba x:0 0 0 2024-04-25T15:58:09.073 INFO:tasks.workunit.client.0.smithi087.stdout:5/571: truncate d9/d2f/d40/d4d/d7b/d74/d83/f8c 207029 0 2024-04-25T15:58:09.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/567: mkdir d3/d12/d39/d64/dc0 0 2024-04-25T15:58:09.074 INFO:tasks.workunit.client.0.smithi087.stdout:4/571: write d4/d10/d60/d56/d61/d3f/d58/d5e/f70 [554635,23856] 0 2024-04-25T15:58:09.074 INFO:tasks.workunit.client.0.smithi087.stdout:5/572: readlink d9/d2f/l45 0 2024-04-25T15:58:09.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/584: dread d7/f12 [0,4194304] 0 2024-04-25T15:58:09.075 INFO:tasks.workunit.client.0.smithi087.stdout:0/565: dread d1/d6/f8 [0,4194304] 0 2024-04-25T15:58:09.077 INFO:tasks.workunit.client.0.smithi087.stdout:5/573: unlink d9/f1a 0 2024-04-25T15:58:09.078 INFO:tasks.workunit.client.0.smithi087.stdout:9/490: creat d6/d8/d29/d3a/d5b/d60/f95 x:0 0 0 2024-04-25T15:58:09.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/568: truncate d3/d12/d14/d29/d2f/d53/f84 1785053 0 2024-04-25T15:58:09.080 INFO:tasks.workunit.client.0.smithi087.stdout:0/566: creat d1/da/d3e/d85/d9b/fbf x:0 0 0 2024-04-25T15:58:09.080 INFO:tasks.workunit.client.0.smithi087.stdout:4/572: dread d4/d10/d60/d56/d61/d3f/d58/f8f [0,4194304] 0 2024-04-25T15:58:09.082 INFO:tasks.workunit.client.0.smithi087.stdout:5/574: rmdir d9/d2f 39 2024-04-25T15:58:09.083 INFO:tasks.workunit.client.0.smithi087.stdout:5/575: dread - d9/d91/d30/d70/d79/d7d/fba zero size 2024-04-25T15:58:09.084 INFO:tasks.workunit.client.0.smithi087.stdout:0/567: unlink d1/da/d3e/d54/l7f 0 2024-04-25T15:58:09.084 INFO:tasks.workunit.client.0.smithi087.stdout:4/573: rmdir d4/d10/d60/d5c/d3a/d90 39 2024-04-25T15:58:09.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/568: write d1/da/d3e/d85/d9b/fbf [133490,10140] 0 2024-04-25T15:58:09.085 INFO:tasks.workunit.client.0.smithi087.stdout:6/585: creat d7/d1a/d1d/d21/d27/d2c/db4/fc6 x:0 0 0 2024-04-25T15:58:09.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/574: chown d4/d10/d60/d5c/c4f 194517818 1 2024-04-25T15:58:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/491: creat d6/d8/f96 x:0 0 0 2024-04-25T15:58:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:1/569: link d3/d12/d14/d29/l34 d3/d12/d14/d29/d67/lc1 0 2024-04-25T15:58:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:5/576: write d9/f2d [5795893,43261] 0 2024-04-25T15:58:09.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/586: mkdir d7/d71/d59/dc7 0 2024-04-25T15:58:09.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/575: chown d4/d10/d60/d56/d61/d3f/d58 1178764 1 2024-04-25T15:58:09.089 INFO:tasks.workunit.client.0.smithi087.stdout:0/569: truncate d1/d6/d21/fa9 114561 0 2024-04-25T15:58:09.090 INFO:tasks.workunit.client.0.smithi087.stdout:5/577: read - d9/d91/d30/f81 zero size 2024-04-25T15:58:09.090 INFO:tasks.workunit.client.0.smithi087.stdout:9/492: mknod d6/d3e/d92/c97 0 2024-04-25T15:58:09.091 INFO:tasks.workunit.client.0.smithi087.stdout:1/570: creat d3/d12/d4d/da5/fc2 x:0 0 0 2024-04-25T15:58:09.091 INFO:tasks.workunit.client.0.smithi087.stdout:4/576: mknod d4/cbd 0 2024-04-25T15:58:09.092 INFO:tasks.workunit.client.0.smithi087.stdout:4/577: dread - d4/d10/d60/fb1 zero size 2024-04-25T15:58:09.093 INFO:tasks.workunit.client.0.smithi087.stdout:0/570: mkdir d1/d6/db1/dc0 0 2024-04-25T15:58:09.094 INFO:tasks.workunit.client.0.smithi087.stdout:4/578: read d4/d10/d60/d56/d61/d3f/d58/d5e/f6a [4119710,71605] 0 2024-04-25T15:58:09.095 INFO:tasks.workunit.client.0.smithi087.stdout:1/571: dread d3/f35 [0,4194304] 0 2024-04-25T15:58:09.168 INFO:tasks.workunit.client.0.smithi087.stdout:7/367: sync 2024-04-25T15:58:09.174 INFO:tasks.workunit.client.0.smithi087.stdout:6/587: link d7/d1a/d1d/d21/d27/d2c/db4/fc6 d7/d71/d76/fc8 0 2024-04-25T15:58:09.176 INFO:tasks.workunit.client.0.smithi087.stdout:4/579: fsync d4/d10/d60/d52/d66/f2c 0 2024-04-25T15:58:09.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/493: write d6/d8/d12/f2f [659661,125615] 0 2024-04-25T15:58:09.182 INFO:tasks.workunit.client.0.smithi087.stdout:6/588: creat d7/d1a/d1d/d21/d27/d2c/db4/fc9 x:0 0 0 2024-04-25T15:58:09.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/571: write d1/d6/d77/f7e [4226382,54509] 0 2024-04-25T15:58:09.185 INFO:tasks.workunit.client.0.smithi087.stdout:7/368: dread d1/d4/d18/d36/f68 [0,4194304] 0 2024-04-25T15:58:09.186 INFO:tasks.workunit.client.0.smithi087.stdout:4/580: write d4/d10/d60/d5c/f54 [642952,101349] 0 2024-04-25T15:58:09.187 INFO:tasks.workunit.client.0.smithi087.stdout:1/572: dread d3/d12/f1c [0,4194304] 0 2024-04-25T15:58:09.191 INFO:tasks.workunit.client.0.smithi087.stdout:7/369: write d1/d1a/f20 [2201204,116131] 0 2024-04-25T15:58:09.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/589: dwrite d7/d1a/d2a/f64 [0,4194304] 0 2024-04-25T15:58:09.201 INFO:tasks.workunit.client.0.smithi087.stdout:1/573: symlink d3/d12/d4d/dba/lc3 0 2024-04-25T15:58:09.203 INFO:tasks.workunit.client.0.smithi087.stdout:9/494: truncate d6/d8/d32/f4d 3578723 0 2024-04-25T15:58:09.206 INFO:tasks.workunit.client.0.smithi087.stdout:0/572: dwrite d1/d6/f3b [0,4194304] 0 2024-04-25T15:58:09.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/581: creat d4/d10/d60/d52/d66/fbe x:0 0 0 2024-04-25T15:58:09.221 INFO:tasks.workunit.client.0.smithi087.stdout:6/590: chown d7/d1a/d1d/d21/d27/d2c/db4/fc9 2 1 2024-04-25T15:58:09.223 INFO:tasks.workunit.client.0.smithi087.stdout:9/495: mknod d6/d8/d32/d4c/c98 0 2024-04-25T15:58:09.225 INFO:tasks.workunit.client.0.smithi087.stdout:9/496: dread - d6/d8/d12/f5a zero size 2024-04-25T15:58:09.226 INFO:tasks.workunit.client.0.smithi087.stdout:1/574: mkdir d3/d12/d14/d29/d2f/dc4 0 2024-04-25T15:58:09.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/575: stat d3/d12/d14/d29/d2f/dc4 0 2024-04-25T15:58:09.229 INFO:tasks.workunit.client.0.smithi087.stdout:1/576: fsync d3/d12/d39/d64/fa2 0 2024-04-25T15:58:09.230 INFO:tasks.workunit.client.0.smithi087.stdout:6/591: mkdir d7/d1a/d1d/d21/d27/d2c/d35/d45/dca 0 2024-04-25T15:58:09.232 INFO:tasks.workunit.client.0.smithi087.stdout:4/582: dread d4/d10/d60/d56/d61/d3f/d42/d97/f30 [0,4194304] 0 2024-04-25T15:58:09.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/583: stat d4/d10/d60/d52/d66/f43 0 2024-04-25T15:58:09.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/577: rmdir d3/d12/d14/d29/d67/d73 39 2024-04-25T15:58:09.235 INFO:tasks.workunit.client.0.smithi087.stdout:9/497: mkdir d6/d8/d29/d3a/d5b/d60/d81/d85/d99 0 2024-04-25T15:58:09.238 INFO:tasks.workunit.client.0.smithi087.stdout:6/592: creat d7/d71/d76/fcb x:0 0 0 2024-04-25T15:58:09.238 INFO:tasks.workunit.client.0.smithi087.stdout:9/498: write d6/d8/f89 [1963149,563] 0 2024-04-25T15:58:09.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/593: write d7/d71/d76/f8e [116646,64074] 0 2024-04-25T15:58:09.241 INFO:tasks.workunit.client.0.smithi087.stdout:9/499: dread - d6/d8/d32/d4c/f82 zero size 2024-04-25T15:58:09.244 INFO:tasks.workunit.client.0.smithi087.stdout:0/573: dread d1/d6/d1f/f37 [4194304,4194304] 0 2024-04-25T15:58:09.244 INFO:tasks.workunit.client.0.smithi087.stdout:6/594: write d7/d71/f31 [3567028,74066] 0 2024-04-25T15:58:09.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/584: rename d4/d10/d60/d52/d66/d15/f1a to d4/d10/d60/d56/d61/d3f/fbf 0 2024-04-25T15:58:09.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/574: write d1/da/d3e/f9c [860328,121250] 0 2024-04-25T15:58:09.248 INFO:tasks.workunit.client.0.smithi087.stdout:0/575: dread - d1/da/d3e/db2/fb5 zero size 2024-04-25T15:58:09.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/576: unlink d1/d27/f9e 0 2024-04-25T15:58:09.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/500: dwrite d6/d8/d29/d3a/f69 [0,4194304] 0 2024-04-25T15:58:09.262 INFO:tasks.workunit.client.0.smithi087.stdout:4/585: symlink d4/d10/d60/d56/d61/db7/lc0 0 2024-04-25T15:58:09.262 INFO:tasks.workunit.client.0.smithi087.stdout:9/501: truncate d6/d8/d12/f5a 965549 0 2024-04-25T15:58:09.264 INFO:tasks.workunit.client.0.smithi087.stdout:1/578: link d3/d2d/d6c/l78 d3/d12/d14/d29/d2f/d40/lc5 0 2024-04-25T15:58:09.269 INFO:tasks.workunit.client.0.smithi087.stdout:0/577: rename d1/d6/d77/c83 to d1/da/d3e/d54/cc1 0 2024-04-25T15:58:09.275 INFO:tasks.workunit.client.0.smithi087.stdout:4/586: dwrite d4/d10/d60/d56/d61/d3f/d42/d97/f89 [0,4194304] 0 2024-04-25T15:58:09.275 INFO:tasks.workunit.client.0.smithi087.stdout:1/579: unlink d3/d12/d14/d29/d67/d73/fb3 0 2024-04-25T15:58:09.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/580: read d3/f9 [7858530,102774] 0 2024-04-25T15:58:09.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/578: write d1/da/d3e/d54/f20 [4124215,68862] 0 2024-04-25T15:58:09.278 INFO:tasks.workunit.client.0.smithi087.stdout:0/579: chown d1/f58 3 1 2024-04-25T15:58:09.285 INFO:tasks.workunit.client.0.smithi087.stdout:9/502: rename d6/d8/d29/l70 to d6/d8/d29/d3a/d5b/d60/l9a 0 2024-04-25T15:58:09.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/595: truncate d7/d1a/d2a/f7e 940615 0 2024-04-25T15:58:09.287 INFO:tasks.workunit.client.0.smithi087.stdout:4/587: unlink d4/d10/d60/d52/d66/d15/c65 0 2024-04-25T15:58:09.287 INFO:tasks.workunit.client.0.smithi087.stdout:2/493: sync 2024-04-25T15:58:09.287 INFO:tasks.workunit.client.0.smithi087.stdout:3/451: sync 2024-04-25T15:58:09.288 INFO:tasks.workunit.client.0.smithi087.stdout:6/596: truncate d7/d1a/d41/dbd/faa 136139 0 2024-04-25T15:58:09.289 INFO:tasks.workunit.client.0.smithi087.stdout:1/581: creat d3/d12/d4d/d7d/fc6 x:0 0 0 2024-04-25T15:58:09.289 INFO:tasks.workunit.client.0.smithi087.stdout:2/494: chown d3/d2a/d1c/l2f 4765 1 2024-04-25T15:58:09.290 INFO:tasks.workunit.client.0.smithi087.stdout:0/580: creat d1/da/d3e/d54/d34/fc2 x:0 0 0 2024-04-25T15:58:09.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/597: chown d7/d1a/d1d/d21/d27/d2c/c62 5 1 2024-04-25T15:58:09.299 INFO:tasks.workunit.client.0.smithi087.stdout:2/495: creat d3/d2a/d1c/f92 x:0 0 0 2024-04-25T15:58:09.301 INFO:tasks.workunit.client.0.smithi087.stdout:9/503: mknod d6/d8/d29/d3a/d7c/c9b 0 2024-04-25T15:58:09.302 INFO:tasks.workunit.client.0.smithi087.stdout:3/452: symlink d4/db/d28/l91 0 2024-04-25T15:58:09.304 INFO:tasks.workunit.client.0.smithi087.stdout:2/496: stat d3/d2a/d1c 0 2024-04-25T15:58:09.307 INFO:tasks.workunit.client.0.smithi087.stdout:0/581: dwrite d1/d6/d21/d4c/d50/d6b/f8a [0,4194304] 0 2024-04-25T15:58:09.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/504: mknod d6/c9c 0 2024-04-25T15:58:09.310 INFO:tasks.workunit.client.0.smithi087.stdout:2/497: mkdir d3/d2a/d81/d93 0 2024-04-25T15:58:09.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/453: creat d4/d14/d53/d68/f92 x:0 0 0 2024-04-25T15:58:09.317 INFO:tasks.workunit.client.0.smithi087.stdout:3/454: stat d4/d17/d81 0 2024-04-25T15:58:09.321 INFO:tasks.workunit.client.0.smithi087.stdout:4/588: dwrite d4/d10/d60/fb1 [0,4194304] 0 2024-04-25T15:58:09.322 INFO:tasks.workunit.client.0.smithi087.stdout:6/598: dwrite d7/d1a/f3e [0,4194304] 0 2024-04-25T15:58:09.322 INFO:tasks.workunit.client.0.smithi087.stdout:1/582: dwrite d3/d12/d14/d29/d3b/f90 [0,4194304] 0 2024-04-25T15:58:09.325 INFO:tasks.workunit.client.0.smithi087.stdout:3/455: write d4/db/f4d [1975960,103579] 0 2024-04-25T15:58:09.325 INFO:tasks.workunit.client.0.smithi087.stdout:1/583: write d3/d12/f91 [142560,31798] 0 2024-04-25T15:58:09.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/456: unlink d4/db/d28/c67 0 2024-04-25T15:58:09.332 INFO:tasks.workunit.client.0.smithi087.stdout:0/582: dwrite d1/da/d3e/db2/fb5 [0,4194304] 0 2024-04-25T15:58:09.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/457: readlink d4/db/d28/d3c/l71 0 2024-04-25T15:58:09.337 INFO:tasks.workunit.client.0.smithi087.stdout:4/589: mknod d4/d10/d60/d52/d66/cc1 0 2024-04-25T15:58:09.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/583: mknod d1/d27/cc3 0 2024-04-25T15:58:09.341 INFO:tasks.workunit.client.0.smithi087.stdout:4/590: creat d4/d10/d60/d5c/d8d/fc2 x:0 0 0 2024-04-25T15:58:09.343 INFO:tasks.workunit.client.0.smithi087.stdout:4/591: rename d4/d10/d60/d56/d61/db7 to d4/d10/d60/d56/d61/db7/dc3 22 2024-04-25T15:58:09.344 INFO:tasks.workunit.client.0.smithi087.stdout:1/584: link d3/d12/d4d/c85 d3/d12/d14/d33/cc7 0 2024-04-25T15:58:09.346 INFO:tasks.workunit.client.0.smithi087.stdout:0/584: creat d1/da/d3e/db2/dba/fc4 x:0 0 0 2024-04-25T15:58:09.347 INFO:tasks.workunit.client.0.smithi087.stdout:4/592: write d4/d10/d60/d52/d66/f32 [1563815,46516] 0 2024-04-25T15:58:09.348 INFO:tasks.workunit.client.0.smithi087.stdout:4/593: fdatasync d4/d10/d60/d5c/d8d/fc2 0 2024-04-25T15:58:09.348 INFO:tasks.workunit.client.0.smithi087.stdout:4/594: stat d4/cbd 0 2024-04-25T15:58:09.349 INFO:tasks.workunit.client.0.smithi087.stdout:0/585: write d1/d6/f36 [1969821,16609] 0 2024-04-25T15:58:09.351 INFO:tasks.workunit.client.0.smithi087.stdout:3/458: dread d4/d17/f74 [0,4194304] 0 2024-04-25T15:58:09.352 INFO:tasks.workunit.client.0.smithi087.stdout:0/586: creat d1/da/d3e/d54/d34/fc5 x:0 0 0 2024-04-25T15:58:09.352 INFO:tasks.workunit.client.0.smithi087.stdout:3/459: fdatasync d4/d17/d24/d3f/f8d 0 2024-04-25T15:58:09.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/498: write d3/d27/d29/d4f/f5f [1343664,8943] 0 2024-04-25T15:58:09.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/585: dread d3/d12/d14/d29/d3b/f98 [0,4194304] 0 2024-04-25T15:58:09.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/585: sync 2024-04-25T15:58:09.426 INFO:tasks.workunit.client.0.smithi087.stdout:0/587: mkdir d1/d6/d77/dc6 0 2024-04-25T15:58:09.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/460: creat d4/db/d28/d82/f93 x:0 0 0 2024-04-25T15:58:09.427 INFO:tasks.workunit.client.0.smithi087.stdout:2/499: chown d3/d2a/d48/f6c 0 1 2024-04-25T15:58:09.430 INFO:tasks.workunit.client.0.smithi087.stdout:4/595: dwrite d4/f14 [0,4194304] 0 2024-04-25T15:58:09.430 INFO:tasks.workunit.client.0.smithi087.stdout:2/500: stat d3/fd 0 2024-04-25T15:58:09.432 INFO:tasks.workunit.client.0.smithi087.stdout:1/586: chown d3/d12/d14/d29/d2f/c8b 10333 1 2024-04-25T15:58:09.433 INFO:tasks.workunit.client.0.smithi087.stdout:4/596: dread - d4/d10/d60/f71 zero size 2024-04-25T15:58:09.434 INFO:tasks.workunit.client.0.smithi087.stdout:3/461: mkdir d4/db/d28/d3c/d62/d94 0 2024-04-25T15:58:09.438 INFO:tasks.workunit.client.0.smithi087.stdout:1/587: mknod d3/d12/d4d/cc8 0 2024-04-25T15:58:09.444 INFO:tasks.workunit.client.0.smithi087.stdout:8/586: mknod d4/d1d/d17/d37/d5e/cbf 0 2024-04-25T15:58:09.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/462: creat d4/d17/d24/d29/d58/f95 x:0 0 0 2024-04-25T15:58:09.446 INFO:tasks.workunit.client.0.smithi087.stdout:4/597: symlink d4/d10/d60/d56/d61/d3f/d58/lc4 0 2024-04-25T15:58:09.453 INFO:tasks.workunit.client.0.smithi087.stdout:0/588: dwrite d1/f3c [0,4194304] 0 2024-04-25T15:58:09.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/587: rmdir d4/d22/d43/d7f 39 2024-04-25T15:58:09.459 INFO:tasks.workunit.client.0.smithi087.stdout:3/463: fdatasync d4/db/d28/d5c/f77 0 2024-04-25T15:58:09.462 INFO:tasks.workunit.client.0.smithi087.stdout:1/588: link d3/ff d3/d12/d14/d29/d8e/fc9 0 2024-04-25T15:58:09.464 INFO:tasks.workunit.client.0.smithi087.stdout:4/598: symlink d4/d10/d60/d56/d61/d3f/d8a/lc5 0 2024-04-25T15:58:09.467 INFO:tasks.workunit.client.0.smithi087.stdout:0/589: symlink d1/da/d3e/db2/lc7 0 2024-04-25T15:58:09.467 INFO:tasks.workunit.client.0.smithi087.stdout:4/599: stat d4/d10/d60/d56/d61/d3f/d8a 0 2024-04-25T15:58:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:2/501: dwrite d3/d2a/f1f [0,4194304] 0 2024-04-25T15:58:09.495 INFO:tasks.workunit.client.0.smithi087.stdout:3/464: dread d4/db/d28/f2f [0,4194304] 0 2024-04-25T15:58:09.498 INFO:tasks.workunit.client.0.smithi087.stdout:3/465: read d4/d17/f63 [481686,119652] 0 2024-04-25T15:58:09.499 INFO:tasks.workunit.client.0.smithi087.stdout:5/578: sync 2024-04-25T15:58:09.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/370: sync 2024-04-25T15:58:09.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/588: truncate d4/d1d/f59 437367 0 2024-04-25T15:58:09.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/589: write d3/ff [2532277,130831] 0 2024-04-25T15:58:09.503 INFO:tasks.workunit.client.0.smithi087.stdout:4/600: write d4/f16 [298837,4795] 0 2024-04-25T15:58:09.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/466: unlink d4/ca 0 2024-04-25T15:58:09.508 INFO:tasks.workunit.client.0.smithi087.stdout:1/590: dread - d3/d12/fb2 zero size 2024-04-25T15:58:09.511 INFO:tasks.workunit.client.0.smithi087.stdout:5/579: truncate d9/d91/d30/d56/f98 281160 0 2024-04-25T15:58:09.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/467: fdatasync d4/d17/d24/d3f/f79 0 2024-04-25T15:58:09.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/589: getdents d4/d1d/d17/d72 0 2024-04-25T15:58:09.513 INFO:tasks.workunit.client.0.smithi087.stdout:2/502: dwrite d3/d20/f46 [0,4194304] 0 2024-04-25T15:58:09.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/371: write d1/d9/d26/f38 [2912036,95199] 0 2024-04-25T15:58:09.521 INFO:tasks.workunit.client.0.smithi087.stdout:2/503: chown d3/d27/d29/f2e 15031 1 2024-04-25T15:58:09.522 INFO:tasks.workunit.client.0.smithi087.stdout:5/580: unlink d9/d2f/d40/d4d/l84 0 2024-04-25T15:58:09.524 INFO:tasks.workunit.client.0.smithi087.stdout:7/372: creat d1/d1a/f6f x:0 0 0 2024-04-25T15:58:09.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/373: chown d1/d4/d18/d36/l63 1245 1 2024-04-25T15:58:09.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/374: chown d1/c42 74 1 2024-04-25T15:58:09.530 INFO:tasks.workunit.client.0.smithi087.stdout:5/581: mkdir d9/d2f/dbb 0 2024-04-25T15:58:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:5/582: write d9/d91/d30/d70/d79/d7d/f73 [2047836,4412] 0 2024-04-25T15:58:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:4/601: dread d4/f6 [4194304,4194304] 0 2024-04-25T15:58:09.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/591: truncate d3/d12/d14/f27 2585925 0 2024-04-25T15:58:09.543 INFO:tasks.workunit.client.0.smithi087.stdout:3/468: link d4/d14/c5f d4/db/d28/d5c/c96 0 2024-04-25T15:58:09.543 INFO:tasks.workunit.client.0.smithi087.stdout:7/375: write d1/f19 [362996,39460] 0 2024-04-25T15:58:09.544 INFO:tasks.workunit.client.0.smithi087.stdout:9/505: sync 2024-04-25T15:58:09.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/590: dwrite d4/d8/dd/d85/d86/f8f [0,4194304] 0 2024-04-25T15:58:09.546 INFO:tasks.workunit.client.0.smithi087.stdout:1/592: fsync d3/d12/d14/d29/d3b/f62 0 2024-04-25T15:58:09.546 INFO:tasks.workunit.client.0.smithi087.stdout:5/583: creat d9/d91/d30/d70/d79/dae/fbc x:0 0 0 2024-04-25T15:58:09.550 INFO:tasks.workunit.client.0.smithi087.stdout:1/593: chown d3/d2d/d6c/f9b 117512 1 2024-04-25T15:58:09.552 INFO:tasks.workunit.client.0.smithi087.stdout:4/602: creat d4/d10/d60/d52/d66/fc6 x:0 0 0 2024-04-25T15:58:09.552 INFO:tasks.workunit.client.0.smithi087.stdout:5/584: rmdir d9/d2f/d40 39 2024-04-25T15:58:09.552 INFO:tasks.workunit.client.0.smithi087.stdout:2/504: dwrite d3/d27/d29/f2c [0,4194304] 0 2024-04-25T15:58:09.555 INFO:tasks.workunit.client.0.smithi087.stdout:4/603: chown d4/d10/d60/d5c/d8d/faf 4948485 1 2024-04-25T15:58:09.556 INFO:tasks.workunit.client.0.smithi087.stdout:2/505: write d3/d27/d29/d2d/d40/f7b [710460,124123] 0 2024-04-25T15:58:09.558 INFO:tasks.workunit.client.0.smithi087.stdout:2/506: stat d3/d2a/f1b 0 2024-04-25T15:58:09.558 INFO:tasks.workunit.client.0.smithi087.stdout:1/594: mkdir d3/d12/d14/d29/d2f/d53/dca 0 2024-04-25T15:58:09.560 INFO:tasks.workunit.client.0.smithi087.stdout:8/591: dread d4/d1d/d3f/f8d [0,4194304] 0 2024-04-25T15:58:09.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/595: chown d3/d12/c82 10248 1 2024-04-25T15:58:09.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/469: dwrite d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:09.565 INFO:tasks.workunit.client.0.smithi087.stdout:7/376: link d1/d3c/f6e d1/f70 0 2024-04-25T15:58:09.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/604: mkdir d4/d10/d60/d56/d61/d3f/dc7 0 2024-04-25T15:58:09.569 INFO:tasks.workunit.client.0.smithi087.stdout:9/506: dwrite d6/d8/d29/d3a/d5b/d60/d1d/f6c [0,4194304] 0 2024-04-25T15:58:09.570 INFO:tasks.workunit.client.0.smithi087.stdout:2/507: mkdir d3/d27/d29/d4f/d5a/d6a/d88/d94 0 2024-04-25T15:58:09.575 INFO:tasks.workunit.client.0.smithi087.stdout:3/470: creat d4/d17/d24/d29/f97 x:0 0 0 2024-04-25T15:58:09.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/508: mkdir d3/d27/d29/d2d/d40/d95 0 2024-04-25T15:58:09.579 INFO:tasks.workunit.client.0.smithi087.stdout:4/605: dwrite d4/f16 [0,4194304] 0 2024-04-25T15:58:09.580 INFO:tasks.workunit.client.0.smithi087.stdout:2/509: dread - d3/d27/d29/d2d/f7d zero size 2024-04-25T15:58:09.581 INFO:tasks.workunit.client.0.smithi087.stdout:4/606: fsync d4/d10/d60/f6c 0 2024-04-25T15:58:09.581 INFO:tasks.workunit.client.0.smithi087.stdout:9/507: mknod d6/d8/d29/d3a/d58/d72/c9d 0 2024-04-25T15:58:09.582 INFO:tasks.workunit.client.0.smithi087.stdout:9/508: read - d6/d8/f96 zero size 2024-04-25T15:58:09.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/607: stat d4/d10/d60/d5c/d8d 0 2024-04-25T15:58:09.583 INFO:tasks.workunit.client.0.smithi087.stdout:5/585: getdents d9/d2f/d40/d4d/d58 0 2024-04-25T15:58:09.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/608: write d4/d10/d60/d56/d61/d3f/f91 [145359,1696] 0 2024-04-25T15:58:09.585 INFO:tasks.workunit.client.0.smithi087.stdout:1/596: rmdir d3/d12/d14/d29/d2f/dc4 0 2024-04-25T15:58:09.586 INFO:tasks.workunit.client.0.smithi087.stdout:7/377: write d1/d3c/f58 [783441,48477] 0 2024-04-25T15:58:09.587 INFO:tasks.workunit.client.0.smithi087.stdout:3/471: unlink d4/d17/d24/d3f/f8d 0 2024-04-25T15:58:09.587 INFO:tasks.workunit.client.0.smithi087.stdout:4/609: dread - d4/d10/d60/d56/d61/d3f/fa9 zero size 2024-04-25T15:58:09.589 INFO:tasks.workunit.client.0.smithi087.stdout:1/597: write d3/d12/d14/d29/d8e/fc9 [2832334,2936] 0 2024-04-25T15:58:09.590 INFO:tasks.workunit.client.0.smithi087.stdout:2/510: creat d3/d27/d29/d2d/f96 x:0 0 0 2024-04-25T15:58:09.591 INFO:tasks.workunit.client.0.smithi087.stdout:3/472: dread - d4/d17/d24/d29/f97 zero size 2024-04-25T15:58:09.591 INFO:tasks.workunit.client.0.smithi087.stdout:5/586: rmdir d9/d91/d38 39 2024-04-25T15:58:09.595 INFO:tasks.workunit.client.0.smithi087.stdout:9/509: getdents d6/d8 0 2024-04-25T15:58:09.596 INFO:tasks.workunit.client.0.smithi087.stdout:7/378: rename d1/d4/d18/f2a to d1/d4/d18/d36/f71 0 2024-04-25T15:58:09.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/598: write d3/d12/d14/d29/d65/d97/fb8 [790826,112248] 0 2024-04-25T15:58:09.596 INFO:tasks.workunit.client.0.smithi087.stdout:5/587: creat d9/d99/fbd x:0 0 0 2024-04-25T15:58:09.597 INFO:tasks.workunit.client.0.smithi087.stdout:8/592: dwrite d4/d8/dd/f2b [0,4194304] 0 2024-04-25T15:58:09.598 INFO:tasks.workunit.client.0.smithi087.stdout:2/511: truncate d3/d27/d29/f6e 1773522 0 2024-04-25T15:58:09.599 INFO:tasks.workunit.client.0.smithi087.stdout:3/473: creat d4/d14/d53/d7d/f98 x:0 0 0 2024-04-25T15:58:09.601 INFO:tasks.workunit.client.0.smithi087.stdout:1/599: write d3/d12/d39/d64/fa2 [4183373,46962] 0 2024-04-25T15:58:09.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/599: sync 2024-04-25T15:58:09.601 INFO:tasks.workunit.client.0.smithi087.stdout:0/590: sync 2024-04-25T15:58:09.602 INFO:tasks.workunit.client.0.smithi087.stdout:7/379: read d1/d9/f65 [7930629,71988] 0 2024-04-25T15:58:09.604 INFO:tasks.workunit.client.0.smithi087.stdout:8/593: write d4/d8/dd/d85/d86/f8f [4152066,68866] 0 2024-04-25T15:58:09.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/512: symlink d3/d2a/d81/d93/l97 0 2024-04-25T15:58:09.605 INFO:tasks.workunit.client.0.smithi087.stdout:3/474: chown d4/f3b 428 1 2024-04-25T15:58:09.606 INFO:tasks.workunit.client.0.smithi087.stdout:9/510: truncate d6/d8/d12/f43 753184 0 2024-04-25T15:58:09.608 INFO:tasks.workunit.client.0.smithi087.stdout:6/600: creat d7/d1a/d7b/fcc x:0 0 0 2024-04-25T15:58:09.611 INFO:tasks.workunit.client.0.smithi087.stdout:5/588: rename d9/d2f/d40/d4d/d7b/d8f/fb5 to d9/d2f/d40/d4d/fbe 0 2024-04-25T15:58:09.612 INFO:tasks.workunit.client.0.smithi087.stdout:2/513: mknod d3/d27/d29/d2d/c98 0 2024-04-25T15:58:09.613 INFO:tasks.workunit.client.0.smithi087.stdout:2/514: write d3/d27/d29/f2e [3992029,36938] 0 2024-04-25T15:58:09.614 INFO:tasks.workunit.client.0.smithi087.stdout:0/591: mkdir d1/d6/d77/daa/dc8 0 2024-04-25T15:58:09.618 INFO:tasks.workunit.client.0.smithi087.stdout:3/475: mkdir d4/d17/d24/d3f/d99 0 2024-04-25T15:58:09.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/600: truncate d3/f8 63615 0 2024-04-25T15:58:09.623 INFO:tasks.workunit.client.0.smithi087.stdout:7/380: dread d1/d3c/f6e [0,4194304] 0 2024-04-25T15:58:09.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/476: dread d4/db/d28/f3a [0,4194304] 0 2024-04-25T15:58:09.626 INFO:tasks.workunit.client.0.smithi087.stdout:2/515: symlink d3/d2a/d1c/l99 0 2024-04-25T15:58:09.627 INFO:tasks.workunit.client.0.smithi087.stdout:4/610: truncate d4/d10/d60/d56/d61/f17 1785775 0 2024-04-25T15:58:09.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/611: write d4/f14 [1853766,129697] 0 2024-04-25T15:58:09.633 INFO:tasks.workunit.client.0.smithi087.stdout:1/601: mknod d3/d12/d4d/dba/ccb 0 2024-04-25T15:58:09.634 INFO:tasks.workunit.client.0.smithi087.stdout:1/602: fdatasync d3/d12/d4d/f51 0 2024-04-25T15:58:09.637 INFO:tasks.workunit.client.0.smithi087.stdout:3/477: write d4/d17/d24/d3f/f4a [1538630,98524] 0 2024-04-25T15:58:09.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/594: link d4/d1d/d14/f2c d4/d22/d43/d7f/d94/fc0 0 2024-04-25T15:58:09.645 INFO:tasks.workunit.client.0.smithi087.stdout:8/595: dread d4/f84 [0,4194304] 0 2024-04-25T15:58:09.647 INFO:tasks.workunit.client.0.smithi087.stdout:9/511: write d6/f1c [778573,13083] 0 2024-04-25T15:58:09.648 INFO:tasks.workunit.client.0.smithi087.stdout:5/589: dwrite d9/d2f/d40/d4d/d7b/f51 [0,4194304] 0 2024-04-25T15:58:09.649 INFO:tasks.workunit.client.0.smithi087.stdout:9/512: readlink d6/d8/d29/d3a/d5b/d60/l16 0 2024-04-25T15:58:09.649 INFO:tasks.workunit.client.0.smithi087.stdout:5/590: dread - d9/d2f/d40/d4d/fbe zero size 2024-04-25T15:58:09.649 INFO:tasks.workunit.client.0.smithi087.stdout:7/381: rename d1/c1d to d1/d1a/c72 0 2024-04-25T15:58:09.651 INFO:tasks.workunit.client.0.smithi087.stdout:3/478: chown d4/d17/f1e 3491967 1 2024-04-25T15:58:09.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/591: write d9/d91/d30/d56/f98 [924734,75493] 0 2024-04-25T15:58:09.653 INFO:tasks.workunit.client.0.smithi087.stdout:2/516: link d3/d27/d29/d4f/f84 d3/d2a/d48/d77/d79/f9a 0 2024-04-25T15:58:09.655 INFO:tasks.workunit.client.0.smithi087.stdout:4/612: rename d4/d10/d60/d5c/l40 to d4/d10/d60/d5c/lc8 0 2024-04-25T15:58:09.655 INFO:tasks.workunit.client.0.smithi087.stdout:2/517: chown d3/c18 507679185 1 2024-04-25T15:58:09.656 INFO:tasks.workunit.client.0.smithi087.stdout:6/601: getdents d7/d1a/d41/d9c 0 2024-04-25T15:58:09.657 INFO:tasks.workunit.client.0.smithi087.stdout:2/518: chown d3/f7 168 1 2024-04-25T15:58:09.657 INFO:tasks.workunit.client.0.smithi087.stdout:8/596: unlink d4/d22/d43/d6d/l9f 0 2024-04-25T15:58:09.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/603: getdents d3/dad 0 2024-04-25T15:58:09.660 INFO:tasks.workunit.client.0.smithi087.stdout:4/613: chown d4/d10/d60/d56/d61/d3f/d42 131032 1 2024-04-25T15:58:09.661 INFO:tasks.workunit.client.0.smithi087.stdout:1/604: chown d3/d2d/d6c 4681360 1 2024-04-25T15:58:09.662 INFO:tasks.workunit.client.0.smithi087.stdout:9/513: dwrite d6/d8/d29/d3a/f4e [0,4194304] 0 2024-04-25T15:58:09.662 INFO:tasks.workunit.client.0.smithi087.stdout:2/519: chown d3/d27/d29/d2d/f96 314305 1 2024-04-25T15:58:09.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/382: creat d1/d4/d18/d36/d37/f73 x:0 0 0 2024-04-25T15:58:09.664 INFO:tasks.workunit.client.0.smithi087.stdout:3/479: dwrite d4/d14/f55 [0,4194304] 0 2024-04-25T15:58:09.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/480: write d4/d17/d24/d29/f8b [206907,116729] 0 2024-04-25T15:58:09.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/592: unlink d9/d91/d30/d56/f5d 0 2024-04-25T15:58:09.667 INFO:tasks.workunit.client.0.smithi087.stdout:9/514: read f2 [532062,77489] 0 2024-04-25T15:58:09.668 INFO:tasks.workunit.client.0.smithi087.stdout:5/593: write d9/d91/d30/d56/f98 [1693359,102319] 0 2024-04-25T15:58:09.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/605: unlink d3/d2d/c47 0 2024-04-25T15:58:09.680 INFO:tasks.workunit.client.0.smithi087.stdout:3/481: rmdir d4/d17/d24/d29/d58 39 2024-04-25T15:58:09.683 INFO:tasks.workunit.client.0.smithi087.stdout:5/594: symlink d9/d99/lbf 0 2024-04-25T15:58:09.688 INFO:tasks.workunit.client.0.smithi087.stdout:8/597: truncate d4/d8/dd/d2f/f67 2409661 0 2024-04-25T15:58:09.689 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:09.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/383: dwrite d1/d4/d18/d36/f68 [0,4194304] 0 2024-04-25T15:58:09.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:09.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/482: dwrite d4/d17/d24/d3f/f7e [0,4194304] 0 2024-04-25T15:58:09.695 INFO:tasks.workunit.client.0.smithi087.stdout:3/483: write d4/d17/d24/f56 [990822,57909] 0 2024-04-25T15:58:09.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/515: rename d6/c9c to d6/d8/d29/d3a/d5b/d60/d1d/c9e 0 2024-04-25T15:58:09.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:09.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/602: write d7/d1a/d1d/f28 [216967,12380] 0 2024-04-25T15:58:09.699 INFO:tasks.workunit.client.0.smithi087.stdout:3/484: write d4/d17/d24/d29/f8b [581502,18789] 0 2024-04-25T15:58:09.699 INFO:tasks.workunit.client.0.smithi087.stdout:7/384: unlink d1/d4/c35 0 2024-04-25T15:58:09.701 INFO:tasks.workunit.client.0.smithi087.stdout:1/606: mknod d3/d12/d14/d29/d2f/d40/ccc 0 2024-04-25T15:58:09.704 INFO:tasks.workunit.client.0.smithi087.stdout:8/598: dread d4/d1d/f59 [0,4194304] 0 2024-04-25T15:58:09.706 INFO:tasks.workunit.client.0.smithi087.stdout:8/599: truncate d4/d1d/f5b 248721 0 2024-04-25T15:58:09.706 INFO:tasks.workunit.client.0.smithi087.stdout:7/385: rmdir d1 39 2024-04-25T15:58:09.706 INFO:tasks.workunit.client.0.smithi087.stdout:8/600: stat d4/d8/l76 0 2024-04-25T15:58:09.715 INFO:tasks.workunit.client.0.smithi087.stdout:6/603: rename d7/d1a/d1d/lbb to d7/d1a/d1d/d21/d27/d2c/d35/lcd 0 2024-04-25T15:58:09.715 INFO:tasks.workunit.client.0.smithi087.stdout:7/386: chown d1/d3c/l31 79426144 1 2024-04-25T15:58:09.716 INFO:tasks.workunit.client.0.smithi087.stdout:8/601: creat d4/d1d/d3f/fc1 x:0 0 0 2024-04-25T15:58:09.717 INFO:tasks.workunit.client.0.smithi087.stdout:7/387: write d1/f19 [1231820,39810] 0 2024-04-25T15:58:09.721 INFO:tasks.workunit.client.0.smithi087.stdout:3/485: write d4/db/fe [1383336,67281] 0 2024-04-25T15:58:09.723 INFO:tasks.workunit.client.0.smithi087.stdout:9/516: rename d6/d8/d29/d3a/d5b/l90 to d6/d8/d29/d3a/d5b/d60/d7f/l9f 0 2024-04-25T15:58:09.723 INFO:tasks.workunit.client.0.smithi087.stdout:3/486: dread - d4/db/d28/d3c/d62/f65 zero size 2024-04-25T15:58:09.726 INFO:tasks.workunit.client.0.smithi087.stdout:3/487: stat d4/db/d28/d82/f93 0 2024-04-25T15:58:09.727 INFO:tasks.workunit.client.0.smithi087.stdout:4/614: dwrite d4/d10/d60/d5c/d3a/f62 [0,4194304] 0 2024-04-25T15:58:09.728 INFO:tasks.workunit.client.0.smithi087.stdout:1/607: truncate d3/d12/d4d/d7d/f8c 3624222 0 2024-04-25T15:58:09.732 INFO:tasks.workunit.client.0.smithi087.stdout:5/595: dread d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a [0,4194304] 0 2024-04-25T15:58:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:7/388: creat d1/f74 x:0 0 0 2024-04-25T15:58:09.733 INFO:tasks.workunit.client.0.smithi087.stdout:1/608: truncate d3/d12/d39/d64/fa2 4987901 0 2024-04-25T15:58:09.734 INFO:tasks.workunit.client.0.smithi087.stdout:3/488: symlink d4/d14/d53/l9a 0 2024-04-25T15:58:09.735 INFO:tasks.workunit.client.0.smithi087.stdout:4/615: stat d4/d10/d60/d56 0 2024-04-25T15:58:09.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/609: chown d3/d2d/d6c/f83 40032784 1 2024-04-25T15:58:09.737 INFO:tasks.workunit.client.0.smithi087.stdout:4/616: chown d4/d10/d60/d52/d66/f11 1304569 1 2024-04-25T15:58:09.739 INFO:tasks.workunit.client.0.smithi087.stdout:1/610: write d3/d12/d14/d29/d3b/f62 [346940,116164] 0 2024-04-25T15:58:09.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/604: dread d7/f10 [0,4194304] 0 2024-04-25T15:58:09.740 INFO:tasks.workunit.client.0.smithi087.stdout:5/596: fsync d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a 0 2024-04-25T15:58:09.741 INFO:tasks.workunit.client.0.smithi087.stdout:8/602: getdents d4/d22/d43/d6d 0 2024-04-25T15:58:09.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/597: chown d9/d2f/d40/d4d/fbe 0 1 2024-04-25T15:58:09.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/489: mkdir d4/d14/d9b 0 2024-04-25T15:58:09.744 INFO:tasks.workunit.client.0.smithi087.stdout:8/603: fsync d4/d22/d43/f61 0 2024-04-25T15:58:09.747 INFO:tasks.workunit.client.0.smithi087.stdout:8/604: write d4/d1d/d7c/f9b [322146,64090] 0 2024-04-25T15:58:09.749 INFO:tasks.workunit.client.0.smithi087.stdout:6/605: rename d7/d71/d76/fc8 to d7/d1a/d41/d9c/fce 0 2024-04-25T15:58:09.749 INFO:tasks.workunit.client.0.smithi087.stdout:9/517: dread d6/d8/d29/d3a/d5b/d60/d1d/f39 [0,4194304] 0 2024-04-25T15:58:09.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/598: symlink d9/d2f/d3b/lc0 0 2024-04-25T15:58:09.751 INFO:tasks.workunit.client.0.smithi087.stdout:3/490: mkdir d4/d17/d24/d3f/d9c 0 2024-04-25T15:58:09.751 INFO:tasks.workunit.client.0.smithi087.stdout:7/389: dwrite d1/d9/d26/d45/f5c [4194304,4194304] 0 2024-04-25T15:58:09.752 INFO:tasks.workunit.client.0.smithi087.stdout:9/518: creat d6/fa0 x:0 0 0 2024-04-25T15:58:09.753 INFO:tasks.workunit.client.0.smithi087.stdout:6/606: rmdir d7/d1a 39 2024-04-25T15:58:09.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/617: getdents d4 0 2024-04-25T15:58:09.758 INFO:tasks.workunit.client.0.smithi087.stdout:1/611: getdents d3/d12/d39 0 2024-04-25T15:58:09.759 INFO:tasks.workunit.client.0.smithi087.stdout:9/519: write d6/d8/d29/d3a/d5b/d60/f8b [80265,127186] 0 2024-04-25T15:58:09.764 INFO:tasks.workunit.client.0.smithi087.stdout:9/520: write d6/d8/d29/d3a/f69 [4343838,60067] 0 2024-04-25T15:58:09.764 INFO:tasks.workunit.client.0.smithi087.stdout:8/605: dwrite d4/d8/dd/fbd [0,4194304] 0 2024-04-25T15:58:09.766 INFO:tasks.workunit.client.0.smithi087.stdout:5/599: rename d9/d91/ca5 to d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/cc1 0 2024-04-25T15:58:09.767 INFO:tasks.workunit.client.0.smithi087.stdout:4/618: mknod d4/d10/d60/d52/cc9 0 2024-04-25T15:58:09.767 INFO:tasks.workunit.client.0.smithi087.stdout:6/607: creat d7/d1a/d1d/fcf x:0 0 0 2024-04-25T15:58:09.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/606: mknod d4/d22/d43/d7f/cc2 0 2024-04-25T15:58:09.770 INFO:tasks.workunit.client.0.smithi087.stdout:5/600: dread d9/d2f/f3c [0,4194304] 0 2024-04-25T15:58:09.771 INFO:tasks.workunit.client.0.smithi087.stdout:7/390: dread d1/d1a/f50 [0,4194304] 0 2024-04-25T15:58:09.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/592: sync 2024-04-25T15:58:09.773 INFO:tasks.workunit.client.0.smithi087.stdout:3/491: rename d4/d17/d24/d29/f8b to d4/db/d28/d3c/f9d 0 2024-04-25T15:58:09.773 INFO:tasks.workunit.client.0.smithi087.stdout:7/391: read - d1/d3c/f64 zero size 2024-04-25T15:58:09.773 INFO:tasks.workunit.client.0.smithi087.stdout:0/593: fdatasync d1/da/d3e/d54/d34/f4b 0 2024-04-25T15:58:09.773 INFO:tasks.workunit.client.0.smithi087.stdout:4/619: unlink d4/d10/d60/f8e 0 2024-04-25T15:58:09.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/608: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/cd0 0 2024-04-25T15:58:09.775 INFO:tasks.workunit.client.0.smithi087.stdout:7/392: write d1/d1a/f6f [692570,82629] 0 2024-04-25T15:58:09.776 INFO:tasks.workunit.client.0.smithi087.stdout:8/607: fsync d4/d22/d43/d7f/d94/fc0 0 2024-04-25T15:58:09.778 INFO:tasks.workunit.client.0.smithi087.stdout:7/393: write d1/f74 [633451,71567] 0 2024-04-25T15:58:09.778 INFO:tasks.workunit.client.0.smithi087.stdout:5/601: rename d9/f26 to d9/d2f/dbb/fc2 0 2024-04-25T15:58:09.779 INFO:tasks.workunit.client.0.smithi087.stdout:8/608: fsync d4/d8/dd/f52 0 2024-04-25T15:58:09.783 INFO:tasks.workunit.client.0.smithi087.stdout:9/521: getdents d6/d8/d29/d3a/d5b/d60/d81 0 2024-04-25T15:58:09.784 INFO:tasks.workunit.client.0.smithi087.stdout:3/492: write d4/d17/d24/d29/d58/f95 [157167,109833] 0 2024-04-25T15:58:09.784 INFO:tasks.workunit.client.0.smithi087.stdout:7/394: fsync d1/d4/d18/d36/d37/f73 0 2024-04-25T15:58:09.784 INFO:tasks.workunit.client.0.smithi087.stdout:0/594: link d1/f58 d1/d6/fc9 0 2024-04-25T15:58:09.786 INFO:tasks.workunit.client.0.smithi087.stdout:8/609: write d4/d1d/f5b [1280738,88938] 0 2024-04-25T15:58:09.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/522: symlink d6/d8/la1 0 2024-04-25T15:58:09.791 INFO:tasks.workunit.client.0.smithi087.stdout:0/595: stat d1/d6/d77/daa 0 2024-04-25T15:58:09.791 INFO:tasks.workunit.client.0.smithi087.stdout:1/612: dwrite d3/d12/d14/d29/d2f/d40/fab [0,4194304] 0 2024-04-25T15:58:09.795 INFO:tasks.workunit.client.0.smithi087.stdout:7/395: chown d1/d4/d18/d36/f68 1640888 1 2024-04-25T15:58:09.797 INFO:tasks.workunit.client.0.smithi087.stdout:2/520: sync 2024-04-25T15:58:09.798 INFO:tasks.workunit.client.0.smithi087.stdout:6/609: dwrite d7/d71/d76/fcb [0,4194304] 0 2024-04-25T15:58:09.802 INFO:tasks.workunit.client.0.smithi087.stdout:3/493: chown d4/d17/f8e 1078945 1 2024-04-25T15:58:09.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/396: fdatasync d1/f19 0 2024-04-25T15:58:09.802 INFO:tasks.workunit.client.0.smithi087.stdout:6/610: chown d7/d1a/d1d/d21/l63 1 1 2024-04-25T15:58:09.803 INFO:tasks.workunit.client.0.smithi087.stdout:4/620: dwrite d4/d10/d60/f64 [0,4194304] 0 2024-04-25T15:58:09.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/602: dwrite d9/d91/d30/d56/f98 [0,4194304] 0 2024-04-25T15:58:09.808 INFO:tasks.workunit.client.0.smithi087.stdout:2/521: mknod d3/d2a/d48/d83/c9b 0 2024-04-25T15:58:09.808 INFO:tasks.workunit.client.0.smithi087.stdout:4/621: chown d4/d10/d60/d56/d61/d3f/d42/d97/f1b 128557344 1 2024-04-25T15:58:09.808 INFO:tasks.workunit.client.0.smithi087.stdout:1/613: creat d3/d12/d14/d29/d65/fcd x:0 0 0 2024-04-25T15:58:09.809 INFO:tasks.workunit.client.0.smithi087.stdout:3/494: creat d4/db/d28/d3c/f9e x:0 0 0 2024-04-25T15:58:09.810 INFO:tasks.workunit.client.0.smithi087.stdout:7/397: stat d1/d9/d26/l34 0 2024-04-25T15:58:09.811 INFO:tasks.workunit.client.0.smithi087.stdout:0/596: mknod d1/d6/d77/dc6/cca 0 2024-04-25T15:58:09.812 INFO:tasks.workunit.client.0.smithi087.stdout:2/522: fsync d3/f7 0 2024-04-25T15:58:09.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/614: write d3/d12/d4d/f60 [604980,19744] 0 2024-04-25T15:58:09.813 INFO:tasks.workunit.client.0.smithi087.stdout:0/597: chown d1/d6/d21/f51 6345191 1 2024-04-25T15:58:09.816 INFO:tasks.workunit.client.0.smithi087.stdout:4/622: unlink d4/f14 0 2024-04-25T15:58:09.817 INFO:tasks.workunit.client.0.smithi087.stdout:8/610: link d4/d22/d43/d7f/cc2 d4/d1d/d3f/d82/cc3 0 2024-04-25T15:58:09.817 INFO:tasks.workunit.client.0.smithi087.stdout:7/398: symlink d1/d4/d18/l75 0 2024-04-25T15:58:09.817 INFO:tasks.workunit.client.0.smithi087.stdout:3/495: symlink d4/db/d28/d5c/l9f 0 2024-04-25T15:58:09.819 INFO:tasks.workunit.client.0.smithi087.stdout:1/615: creat d3/d12/d14/d29/d5c/fce x:0 0 0 2024-04-25T15:58:09.819 INFO:tasks.workunit.client.0.smithi087.stdout:8/611: stat d4/d8/dd/d85 0 2024-04-25T15:58:09.821 INFO:tasks.workunit.client.0.smithi087.stdout:6/611: rename d7/d1a/d1d/d21/d27/d2c/d35/d45/l94 to d7/d1a/d1d/ld1 0 2024-04-25T15:58:09.823 INFO:tasks.workunit.client.0.smithi087.stdout:9/523: dwrite d6/d8/d29/d3a/f69 [0,4194304] 0 2024-04-25T15:58:09.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/603: creat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/fc3 x:0 0 0 2024-04-25T15:58:09.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/612: dread - d7/d1a/fc4 zero size 2024-04-25T15:58:09.823 INFO:tasks.workunit.client.0.smithi087.stdout:1/616: truncate d3/d12/fb5 308448 0 2024-04-25T15:58:09.824 INFO:tasks.workunit.client.0.smithi087.stdout:8/612: read d4/d8/dd/d2f/f80 [1397416,39873] 0 2024-04-25T15:58:09.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/399: creat d1/d4/d18/d36/d37/f76 x:0 0 0 2024-04-25T15:58:09.829 INFO:tasks.workunit.client.0.smithi087.stdout:9/524: write d6/d8/d12/f5a [324729,27794] 0 2024-04-25T15:58:09.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/604: creat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fc4 x:0 0 0 2024-04-25T15:58:09.831 INFO:tasks.workunit.client.0.smithi087.stdout:9/525: stat d6/d8/d29/d3a/d7c 0 2024-04-25T15:58:09.832 INFO:tasks.workunit.client.0.smithi087.stdout:1/617: mknod d3/d12/d14/d29/d2f/d61/ccf 0 2024-04-25T15:58:09.832 INFO:tasks.workunit.client.0.smithi087.stdout:1/618: chown d3/fb9 687 1 2024-04-25T15:58:09.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/598: getdents d1/d6/d21 0 2024-04-25T15:58:09.837 INFO:tasks.workunit.client.0.smithi087.stdout:0/599: fsync d1/d6/d1f/fb7 0 2024-04-25T15:58:09.838 INFO:tasks.workunit.client.0.smithi087.stdout:5/605: unlink d9/f25 0 2024-04-25T15:58:09.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/523: truncate d3/d27/d29/d2d/f57 299612 0 2024-04-25T15:58:09.840 INFO:tasks.workunit.client.0.smithi087.stdout:8/613: creat d4/d8/dd/d2f/d6f/fc4 x:0 0 0 2024-04-25T15:58:09.841 INFO:tasks.workunit.client.0.smithi087.stdout:8/614: chown d4/d22/d43/d7f/f99 0 1 2024-04-25T15:58:09.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/526: creat d6/d8/d29/d3a/d7c/fa2 x:0 0 0 2024-04-25T15:58:09.844 INFO:tasks.workunit.client.0.smithi087.stdout:0/600: creat d1/d6/d21/d4c/fcb x:0 0 0 2024-04-25T15:58:09.845 INFO:tasks.workunit.client.0.smithi087.stdout:5/606: creat d9/d2f/d40/fc5 x:0 0 0 2024-04-25T15:58:09.846 INFO:tasks.workunit.client.0.smithi087.stdout:4/623: readlink d4/d10/d60/d56/d61/l80 0 2024-04-25T15:58:09.847 INFO:tasks.workunit.client.0.smithi087.stdout:2/524: creat d3/d27/d29/d2d/d40/f9c x:0 0 0 2024-04-25T15:58:09.847 INFO:tasks.workunit.client.0.smithi087.stdout:6/613: getdents d7/d71/d59/d90 0 2024-04-25T15:58:09.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/527: fsync d6/d8/d48/f6e 0 2024-04-25T15:58:09.849 INFO:tasks.workunit.client.0.smithi087.stdout:8/615: rename d4/d8/f8e to d4/d22/d43/d7f/d94/da0/fc5 0 2024-04-25T15:58:09.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/619: mkdir d3/d12/d14/d29/d67/d73/d9c/dd0 0 2024-04-25T15:58:09.850 INFO:tasks.workunit.client.0.smithi087.stdout:4/624: read - d4/d10/d60/d52/d66/f5d zero size 2024-04-25T15:58:09.853 INFO:tasks.workunit.client.0.smithi087.stdout:0/601: rename d1/d6/d1f/fb7 to d1/d6/d77/daa/fcc 0 2024-04-25T15:58:09.854 INFO:tasks.workunit.client.0.smithi087.stdout:7/400: dwrite d1/d4/f44 [0,4194304] 0 2024-04-25T15:58:09.859 INFO:tasks.workunit.client.0.smithi087.stdout:9/528: truncate d6/d8/d32/d4c/f82 409224 0 2024-04-25T15:58:09.859 INFO:tasks.workunit.client.0.smithi087.stdout:8/616: mkdir d4/d22/d43/d7f/dc6 0 2024-04-25T15:58:09.863 INFO:tasks.workunit.client.0.smithi087.stdout:1/620: dread d3/d12/d14/d29/d8e/f9d [0,4194304] 0 2024-04-25T15:58:09.864 INFO:tasks.workunit.client.0.smithi087.stdout:7/401: mknod d1/d9/c77 0 2024-04-25T15:58:09.865 INFO:tasks.workunit.client.0.smithi087.stdout:4/625: dwrite d4/d10/d60/d56/d61/f1c [0,4194304] 0 2024-04-25T15:58:09.866 INFO:tasks.workunit.client.0.smithi087.stdout:7/402: write d1/d3c/f64 [693229,45902] 0 2024-04-25T15:58:09.867 INFO:tasks.workunit.client.0.smithi087.stdout:9/529: stat d6/d8/f2e 0 2024-04-25T15:58:09.869 INFO:tasks.workunit.client.0.smithi087.stdout:9/530: stat d6/d8/d32/d4c/c98 0 2024-04-25T15:58:09.870 INFO:tasks.workunit.client.0.smithi087.stdout:4/626: truncate d4/d10/d60/d52/d66/f5d 738222 0 2024-04-25T15:58:09.870 INFO:tasks.workunit.client.0.smithi087.stdout:2/525: rename d3/d2a/c34 to d3/c9d 0 2024-04-25T15:58:09.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/607: dwrite d9/f2a [0,4194304] 0 2024-04-25T15:58:09.873 INFO:tasks.workunit.client.0.smithi087.stdout:1/621: symlink d3/d12/d14/d29/d5c/ld1 0 2024-04-25T15:58:09.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/526: truncate d3/d27/d29/d2d/f7d 153269 0 2024-04-25T15:58:09.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.883+0000 7ff147e08640 1 Processor -- start 2024-04-25T15:58:09.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.883+0000 7ff147e08640 1 -- start start 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff147e08640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff140152980 0x7ff1400c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff147e08640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff140155730 0x7ff14015fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff147e08640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140152d90 con 0x7ff140155320 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff147e08640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff1400aa290 con 0x7ff140155730 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff147e08640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff1401598b0 con 0x7ff140152980 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff140155730 0x7ff14015fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff140155730 0x7ff14015fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58180/0 (socket says 172.21.15.87:58180) 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 -- 172.21.15.87:0/1355804358 learned_addr learned my addr 172.21.15.87:0/1355804358 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff145ba4640 1 --2- 172.21.15.87:0/1355804358 >> v2:172.21.15.155:3300/0 conn(0x7ff140152980 0x7ff1400c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:09.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 -- 172.21.15.87:0/1355804358 >> v2:172.21.15.155:3300/0 conn(0x7ff140152980 msgr2=0x7ff1400c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:09.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 --2- 172.21.15.87:0/1355804358 >> v2:172.21.15.155:3300/0 conn(0x7ff140152980 0x7ff1400c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:09.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 -- 172.21.15.87:0/1355804358 >> v1:172.21.15.155:6789/0 conn(0x7ff140155320 legacy=0x7ff140074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:09.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 -- 172.21.15.87:0/1355804358 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400ca2f0 con 0x7ff140155730 2024-04-25T15:58:09.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff1463a5640 1 --2- 172.21.15.87:0/1355804358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155730 0x7ff14015fca0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff140073c10 tx=0x7ff13801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8b6cafeeed316f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:09.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff144ba2640 1 -- 172.21.15.87:0/1355804358 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1380a55e0 con 0x7ff140155730 2024-04-25T15:58:09.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff144ba2640 1 -- 172.21.15.87:0/1355804358 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1380a5780 con 0x7ff140155730 2024-04-25T15:58:09.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.887+0000 7ff144ba2640 1 -- 172.21.15.87:0/1355804358 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1380a5b50 con 0x7ff140155730 2024-04-25T15:58:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- 172.21.15.87:0/1355804358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155730 msgr2=0x7ff14015fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 --2- 172.21.15.87:0/1355804358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155730 0x7ff14015fca0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff140073c10 tx=0x7ff13801c920 comp rx=0 tx=0).stop 2024-04-25T15:58:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- 172.21.15.87:0/1355804358 shutdown_connections 2024-04-25T15:58:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 --2- 172.21.15.87:0/1355804358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155730 0x7ff14015fca0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 --2- 172.21.15.87:0/1355804358 >> v2:172.21.15.155:3300/0 conn(0x7ff140152980 0x7ff1400c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- 172.21.15.87:0/1355804358 >> 172.21.15.87:0/1355804358 conn(0x7ff1400ac550 msgr2=0x7ff1400ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:09.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- 172.21.15.87:0/1355804358 shutdown_connections 2024-04-25T15:58:09.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- 172.21.15.87:0/1355804358 wait complete. 2024-04-25T15:58:09.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 Processor -- start 2024-04-25T15:58:09.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- start start 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff140152980 0x7ff1400c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 0x7ff1400aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff140155730 0x7ff14006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff140158f70 con 0x7ff140155320 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff140158c90 con 0x7ff140155730 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff147e08640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff140074870 con 0x7ff140152980 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff1453a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 0x7ff1400aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:09.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff1453a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 0x7ff1400aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58190/0 (socket says 172.21.15.87:58190) 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff1453a3640 1 -- 172.21.15.87:0/4199119298 learned_addr learned my addr 172.21.15.87:0/4199119298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff145ba4640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff140152980 0x7ff1400c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.891+0000 7ff1463a5640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff140155730 0x7ff14006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1453a3640 1 -- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff140152980 msgr2=0x7ff1400c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1453a3640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff140152980 0x7ff1400c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1453a3640 1 -- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff140155730 msgr2=0x7ff14006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1453a3640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff140155730 0x7ff14006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1453a3640 1 -- 172.21.15.87:0/4199119298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14015e120 con 0x7ff140155320 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1453a3640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 0x7ff1400aa4c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b440 tx=0x7ff13000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130015020 con 0x7ff140155320 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff130011890 con 0x7ff140155320 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1401f1060 con 0x7ff140155320 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130011c80 con 0x7ff140155320 2024-04-25T15:58:09.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1400aaee0 con 0x7ff140155320 2024-04-25T15:58:09.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14014ab10 con 0x7ff140155320 2024-04-25T15:58:09.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff130018020 con 0x7ff140155320 2024-04-25T15:58:09.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1367fc640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff12406f400 0x7ff124071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:09.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff145ba4640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff12406f400 0x7ff124071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:09.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7ff13008f490 con 0x7ff140155320 2024-04-25T15:58:09.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.895+0000 7ff145ba4640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff12406f400 0x7ff124071910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0079c0 tx=0x7ff13c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:09.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:09.899+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff13001f030 con 0x7ff140155320 2024-04-25T15:58:10.012 INFO:tasks.workunit.client.0.smithi087.stdout:1/622: write d3/d12/d4d/d7d/fc6 [941367,121402] 0 2024-04-25T15:58:10.014 INFO:tasks.workunit.client.0.smithi087.stdout:6/614: link d7/d1a/d1d/d21/l63 d7/d1a/d1d/d21/d27/d2c/d35/ld2 0 2024-04-25T15:58:10.015 INFO:tasks.workunit.client.0.smithi087.stdout:2/527: truncate d3/d27/f3e 20256 0 2024-04-25T15:58:10.031 INFO:tasks.workunit.client.0.smithi087.stdout:7/403: dread d1/d4/f40 [0,4194304] 0 2024-04-25T15:58:10.041 INFO:tasks.workunit.client.0.smithi087.stdout:7/404: dwrite d1/d3c/f5a [0,4194304] 0 2024-04-25T15:58:10.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/617: dread d4/d22/d43/d7f/d94/fc0 [0,4194304] 0 2024-04-25T15:58:10.050 INFO:tasks.workunit.client.0.smithi087.stdout:3/496: sync 2024-04-25T15:58:10.072 INFO:tasks.workunit.client.0.smithi087.stdout:5/608: truncate d9/f21 1029164 0 2024-04-25T15:58:10.073 INFO:tasks.workunit.client.0.smithi087.stdout:0/602: getdents d1/d6/d21/d4c/d50/d6b 0 2024-04-25T15:58:10.074 INFO:tasks.workunit.client.0.smithi087.stdout:6/615: chown d7/cb 0 1 2024-04-25T15:58:10.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/623: dread - d3/d12/d14/d29/d2f/d40/f71 zero size 2024-04-25T15:58:10.079 INFO:tasks.workunit.client.0.smithi087.stdout:0/603: mkdir d1/da/d3e/d85/d9b/dcd 0 2024-04-25T15:58:10.080 INFO:tasks.workunit.client.0.smithi087.stdout:3/497: mkdir d4/db/d28/d82/d8c/da0 0 2024-04-25T15:58:10.084 INFO:tasks.workunit.client.0.smithi087.stdout:0/604: creat d1/d27/fce x:0 0 0 2024-04-25T15:58:10.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/605: chown d1/da/d3e/d54/d34/fc5 3 1 2024-04-25T15:58:10.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:10.087 INFO:tasks.workunit.client.0.smithi087.stdout:1/624: truncate d3/d12/d14/d29/d2f/d40/f54 16080 0 2024-04-25T15:58:10.091 INFO:tasks.workunit.client.0.smithi087.stdout:1/625: creat d3/d12/d14/d29/d2f/d53/fd2 x:0 0 0 2024-04-25T15:58:10.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/498: dread d4/d14/d37/d51/f52 [0,4194304] 0 2024-04-25T15:58:10.095 INFO:tasks.workunit.client.0.smithi087.stdout:0/606: link d1/l30 d1/d6/d21/d4c/d50/d6b/lcf 0 2024-04-25T15:58:10.099 INFO:tasks.workunit.client.0.smithi087.stdout:0/607: mknod d1/d27/d7d/cd0 0 2024-04-25T15:58:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:3/499: mkdir d4/db/d28/d82/d8c/da0/da1 0 2024-04-25T15:58:10.102 INFO:tasks.workunit.client.0.smithi087.stdout:0/608: creat d1/d6/d21/d4c/d82/fd1 x:0 0 0 2024-04-25T15:58:10.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/500: mkdir d4/d14/d53/d68/da2 0 2024-04-25T15:58:10.108 INFO:tasks.workunit.client.0.smithi087.stdout:0/609: dread d1/d6/d21/d4c/d50/d6b/f8a [0,4194304] 0 2024-04-25T15:58:10.112 INFO:tasks.workunit.client.0.smithi087.stdout:0/610: rename d1/da/c60 to d1/da/d87/cd2 0 2024-04-25T15:58:10.141 INFO:tasks.workunit.client.0.smithi087.stdout:0/611: dread d1/d6/d21/f51 [0,4194304] 0 2024-04-25T15:58:10.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.143+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff140069bb0 con 0x7ff140155320 2024-04-25T15:58:10.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.143+0000 7ff1367fc640 1 -- 172.21.15.87:0/4199119298 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5662 (secure 0 0 0) 0x7ff13000d040 con 0x7ff140155320 2024-04-25T15:58:10.147 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:10.147 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:08.546868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":64,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:58:10.147 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 38 2024-04-25T15:58:10.148 INFO:tasks.workunit.client.0.smithi087.stdout:0/612: getdents d1/d6/d77 0 2024-04-25T15:58:10.148 INFO:tasks.workunit.client.0.smithi087.stdout:6/616: write d7/f2f [1373033,17173] 0 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff12406f400 msgr2=0x7ff124071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff12406f400 0x7ff124071910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0079c0 tx=0x7ff13c008040 comp rx=0 tx=0).stop 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 msgr2=0x7ff1400aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 0x7ff1400aa4c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b440 tx=0x7ff13000b900 comp rx=0 tx=0).stop 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 shutdown_connections 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff12406f400 0x7ff124071910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff140155730 0x7ff14006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff140155320 0x7ff1400aa4c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 --2- 172.21.15.87:0/4199119298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff140152980 0x7ff1400c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 >> 172.21.15.87:0/4199119298 conn(0x7ff1400ac550 msgr2=0x7ff1401548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 shutdown_connections 2024-04-25T15:58:10.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.147+0000 7ff147e08640 1 -- 172.21.15.87:0/4199119298 wait complete. 2024-04-25T15:58:10.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/617: fdatasync d7/d1a/d1d/d21/d27/d2c/db4/fc6 0 2024-04-25T15:58:10.154 INFO:tasks.workunit.client.0.smithi087.stdout:6/618: symlink d7/d1a/d7b/ld3 0 2024-04-25T15:58:10.155 INFO:tasks.workunit.client.0.smithi087.stdout:6/619: stat d7/d1a/d1d/d21 0 2024-04-25T15:58:10.156 INFO:tasks.workunit.client.0.smithi087.stdout:6/620: rmdir d7/d1a/d41/d9c 39 2024-04-25T15:58:10.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/621: dread d7/d1a/f3e [0,4194304] 0 2024-04-25T15:58:10.166 INFO:tasks.workunit.client.0.smithi087.stdout:6/622: mkdir d7/dd4 0 2024-04-25T15:58:10.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/623: creat d7/d71/d76/fd5 x:0 0 0 2024-04-25T15:58:10.171 INFO:tasks.workunit.client.0.smithi087.stdout:6/624: truncate d7/f14 4489237 0 2024-04-25T15:58:10.172 INFO:tasks.workunit.client.0.smithi087.stdout:2/528: symlink d3/d27/d29/d2d/l9e 0 2024-04-25T15:58:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:5/609: creat d9/d2f/d40/d4d/fc6 x:0 0 0 2024-04-25T15:58:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:0/613: dwrite d1/da/d3e/db2/dba/fc4 [0,4194304] 0 2024-04-25T15:58:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:6/625: fsync d7/f8 0 2024-04-25T15:58:10.175 INFO:tasks.workunit.client.0.smithi087.stdout:2/529: symlink d3/d2a/d81/l9f 0 2024-04-25T15:58:10.176 INFO:tasks.workunit.client.0.smithi087.stdout:4/627: mkdir d4/d10/d60/d56/d61/dca 0 2024-04-25T15:58:10.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/614: chown d1/da/d3e/c65 76130937 1 2024-04-25T15:58:10.177 INFO:tasks.workunit.client.0.smithi087.stdout:6/626: mknod d7/d71/d59/d90/cd6 0 2024-04-25T15:58:10.178 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-25T15:58:10.179 INFO:tasks.workunit.client.0.smithi087.stdout:0/615: dread - d1/d6/d21/d4c/d50/fb8 zero size 2024-04-25T15:58:10.179 INFO:tasks.workunit.client.0.smithi087.stdout:0/616: fsync d1/d6/d21/f94 0 2024-04-25T15:58:10.183 INFO:tasks.workunit.client.0.smithi087.stdout:6/627: symlink d7/d1a/d41/dbd/ld7 0 2024-04-25T15:58:10.184 INFO:tasks.workunit.client.0.smithi087.stdout:6/628: readlink d7/d1a/d1d/d21/d27/lb0 0 2024-04-25T15:58:10.186 INFO:tasks.workunit.client.0.smithi087.stdout:5/610: getdents d9/d2f/d40/d4d/d7b/d5c/d5f 0 2024-04-25T15:58:10.190 INFO:tasks.workunit.client.0.smithi087.stdout:6/629: dwrite d7/d1a/d41/f55 [0,4194304] 0 2024-04-25T15:58:10.192 INFO:tasks.workunit.client.0.smithi087.stdout:4/628: mkdir d4/d10/d60/d5c/d3a/d90/db9/dcb 0 2024-04-25T15:58:10.193 INFO:tasks.workunit.client.0.smithi087.stdout:5/611: mkdir d9/d2f/d40/d4d/d7b/d5c/dc7 0 2024-04-25T15:58:10.195 INFO:tasks.workunit.client.0.smithi087.stdout:2/530: getdents d3/d27/d29 0 2024-04-25T15:58:10.196 INFO:tasks.workunit.client.0.smithi087.stdout:5/612: truncate d9/d2f/d40/d4d/d7b/f51 4730154 0 2024-04-25T15:58:10.196 INFO:tasks.workunit.client.0.smithi087.stdout:0/617: getdents d1/da 0 2024-04-25T15:58:10.197 INFO:tasks.workunit.client.0.smithi087.stdout:6/630: mknod d7/d71/d76/cd8 0 2024-04-25T15:58:10.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/531: truncate d3/d27/d29/d2d/f96 750173 0 2024-04-25T15:58:10.199 INFO:tasks.workunit.client.0.smithi087.stdout:4/629: creat d4/d10/d60/d56/d61/d3f/d8a/fcc x:0 0 0 2024-04-25T15:58:10.199 INFO:tasks.workunit.client.0.smithi087.stdout:2/532: write d3/d27/d38/f74 [146343,105537] 0 2024-04-25T15:58:10.201 INFO:tasks.workunit.client.0.smithi087.stdout:4/630: dread - d4/d10/d60/fb6 zero size 2024-04-25T15:58:10.201 INFO:tasks.workunit.client.0.smithi087.stdout:9/531: sync 2024-04-25T15:58:10.202 INFO:tasks.workunit.client.0.smithi087.stdout:6/631: symlink d7/d71/d59/d90/da5/ld9 0 2024-04-25T15:58:10.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/618: rename d1/d6/d77/daa/dc8 to d1/d6/db1/dc0/dd3 0 2024-04-25T15:58:10.205 INFO:tasks.workunit.client.0.smithi087.stdout:2/533: creat d3/d27/d29/d4f/fa0 x:0 0 0 2024-04-25T15:58:10.206 INFO:tasks.workunit.client.0.smithi087.stdout:9/532: stat d6/d8/d29/d3a/d5b/d60/f86 0 2024-04-25T15:58:10.206 INFO:tasks.workunit.client.0.smithi087.stdout:6/632: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/cda 0 2024-04-25T15:58:10.209 INFO:tasks.workunit.client.0.smithi087.stdout:0/619: unlink d1/da/d87/cd2 0 2024-04-25T15:58:10.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/533: write d6/d8/d29/d3a/f4e [1575055,11017] 0 2024-04-25T15:58:10.209 INFO:tasks.workunit.client.0.smithi087.stdout:6/633: symlink d7/d71/d59/ldb 0 2024-04-25T15:58:10.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/634: readlink d7/d1a/d1d/d21/d27/d2c/d35/d45/l6c 0 2024-04-25T15:58:10.212 INFO:tasks.workunit.client.0.smithi087.stdout:2/534: link d3/d2a/d48/f6c d3/d27/d38/fa1 0 2024-04-25T15:58:10.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/635: rename d7/d71/d59/l81 to d7/d1a/d1d/d21/d27/d2c/d35/ldc 0 2024-04-25T15:58:10.216 INFO:tasks.workunit.client.0.smithi087.stdout:2/535: mknod d3/d2a/d48/d77/d79/ca2 0 2024-04-25T15:58:10.217 INFO:tasks.workunit.client.0.smithi087.stdout:2/536: stat d3/d27/d38 0 2024-04-25T15:58:10.219 INFO:tasks.workunit.client.0.smithi087.stdout:2/537: stat d3/d27/d29/d4f/d5a/d6a/c80 0 2024-04-25T15:58:10.219 INFO:tasks.workunit.client.0.smithi087.stdout:0/620: dwrite d1/d6/fe [0,4194304] 0 2024-04-25T15:58:10.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/636: rename d7/d1a/d41/c99 to d7/d71/d59/cdd 0 2024-04-25T15:58:10.226 INFO:tasks.workunit.client.0.smithi087.stdout:4/631: write d4/f1e [791658,80778] 0 2024-04-25T15:58:10.230 INFO:tasks.workunit.client.0.smithi087.stdout:6/637: mkdir d7/d1a/d41/dbd/db9/dbc/dde 0 2024-04-25T15:58:10.233 INFO:tasks.workunit.client.0.smithi087.stdout:5/613: dwrite d9/f2b [0,4194304] 0 2024-04-25T15:58:10.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/638: creat d7/fdf x:0 0 0 2024-04-25T15:58:10.235 INFO:tasks.workunit.client.0.smithi087.stdout:5/614: fdatasync d9/f1f 0 2024-04-25T15:58:10.235 INFO:tasks.workunit.client.0.smithi087.stdout:9/534: dread d6/d8/f89 [0,4194304] 0 2024-04-25T15:58:10.236 INFO:tasks.workunit.client.0.smithi087.stdout:6/639: rmdir d7/d71 39 2024-04-25T15:58:10.238 INFO:tasks.workunit.client.0.smithi087.stdout:5/615: dread - d9/d2f/d40/d4d/d7b/d5c/d63/f8d zero size 2024-04-25T15:58:10.238 INFO:tasks.workunit.client.0.smithi087.stdout:6/640: readlink d7/d71/d59/ldb 0 2024-04-25T15:58:10.242 INFO:tasks.workunit.client.0.smithi087.stdout:9/535: dread d6/d8/d29/d3a/f74 [0,4194304] 0 2024-04-25T15:58:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:4/632: dread d4/d10/fa7 [0,4194304] 0 2024-04-25T15:58:10.246 INFO:tasks.workunit.client.0.smithi087.stdout:9/536: unlink d6/d3e/c49 0 2024-04-25T15:58:10.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/537: dread - d6/d8/d32/f64 zero size 2024-04-25T15:58:10.251 INFO:tasks.workunit.client.0.smithi087.stdout:9/538: fdatasync f2 0 2024-04-25T15:58:10.252 INFO:tasks.workunit.client.0.smithi087.stdout:0/621: dread d1/d6/d77/f7e [0,4194304] 0 2024-04-25T15:58:10.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/633: truncate d4/d10/d60/d5c/d3a/d90/fb0 411495 0 2024-04-25T15:58:10.252 INFO:tasks.workunit.client.0.smithi087.stdout:5/616: dwrite d9/d91/f2e [4194304,4194304] 0 2024-04-25T15:58:10.255 INFO:tasks.workunit.client.0.smithi087.stdout:0/622: symlink d1/da/ld4 0 2024-04-25T15:58:10.259 INFO:tasks.workunit.client.0.smithi087.stdout:4/634: symlink d4/d10/d60/d52/d66/d15/lcd 0 2024-04-25T15:58:10.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/617: creat d9/d2f/d40/d4d/d7b/d5c/d5f/fc8 x:0 0 0 2024-04-25T15:58:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.259+0000 7f752ff1c640 1 Processor -- start 2024-04-25T15:58:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.259+0000 7f752ff1c640 1 -- start start 2024-04-25T15:58:10.264 INFO:tasks.workunit.client.0.smithi087.stdout:4/635: unlink d4/d10/d60/d56/d61/f1c 0 2024-04-25T15:58:10.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/539: dwrite d6/d8/d29/d3a/d7c/fa2 [0,4194304] 0 2024-04-25T15:58:10.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752ff1c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75280c4250 0x7f752806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:10.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752ff1c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7528070490 0x7f752815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:10.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752ff1c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75280c5120 con 0x7f752815b170 2024-04-25T15:58:10.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752ff1c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f75280c3b20 con 0x7f7528070490 2024-04-25T15:58:10.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752ff1c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7528070e20 con 0x7f75280c4250 2024-04-25T15:58:10.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7528070490 0x7f752815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:10.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7528070490 0x7f752815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58200/0 (socket says 172.21.15.87:58200) 2024-04-25T15:58:10.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 -- 172.21.15.87:0/1442840200 learned_addr learned my addr 172.21.15.87:0/1442840200 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:10.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752dcb8640 1 --2- 172.21.15.87:0/1442840200 >> v2:172.21.15.155:3300/0 conn(0x7f75280c4250 0x7f752806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:10.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 -- 172.21.15.87:0/1442840200 >> v2:172.21.15.155:3300/0 conn(0x7f75280c4250 msgr2=0x7f752806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:10.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 --2- 172.21.15.87:0/1442840200 >> v2:172.21.15.155:3300/0 conn(0x7f75280c4250 0x7f752806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 -- 172.21.15.87:0/1442840200 >> v1:172.21.15.155:6789/0 conn(0x7f752815b170 legacy=0x7f75280c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.263+0000 7f752d4b7640 1 -- 172.21.15.87:0/1442840200 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75280c4b60 con 0x7f7528070490 2024-04-25T15:58:10.268 INFO:tasks.workunit.client.0.smithi087.stdout:0/623: mkdir d1/d6/d21/d2a/dd5 0 2024-04-25T15:58:10.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752d4b7640 1 --2- 172.21.15.87:0/1442840200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f752815ac30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f75280c9570 tx=0x7f751801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96774f768c2901a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:10.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ccb6640 1 -- 172.21.15.87:0/1442840200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180b0070 con 0x7f7528070490 2024-04-25T15:58:10.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ccb6640 1 -- 172.21.15.87:0/1442840200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75180ab600 con 0x7f7528070490 2024-04-25T15:58:10.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ccb6640 1 -- 172.21.15.87:0/1442840200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180ab9d0 con 0x7f7528070490 2024-04-25T15:58:10.270 INFO:tasks.workunit.client.0.smithi087.stdout:6/641: rename d7/d1a/d41/dbd/db9/dbc to d7/d1a/d1d/d21/d27/d2c/d35/d45/de0 0 2024-04-25T15:58:10.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 -- 172.21.15.87:0/1442840200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 msgr2=0x7f752815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 --2- 172.21.15.87:0/1442840200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f752815ac30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f75280c9570 tx=0x7f751801c460 comp rx=0 tx=0).stop 2024-04-25T15:58:10.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 -- 172.21.15.87:0/1442840200 shutdown_connections 2024-04-25T15:58:10.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 --2- 172.21.15.87:0/1442840200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f752815ac30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 --2- 172.21.15.87:0/1442840200 >> v2:172.21.15.155:3300/0 conn(0x7f75280c4250 0x7f752806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 -- 172.21.15.87:0/1442840200 >> 172.21.15.87:0/1442840200 conn(0x7f752806d780 msgr2=0x7f752806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:10.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 -- 172.21.15.87:0/1442840200 shutdown_connections 2024-04-25T15:58:10.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 -- 172.21.15.87:0/1442840200 wait complete. 2024-04-25T15:58:10.272 INFO:tasks.workunit.client.0.smithi087.stdout:9/540: creat d6/d8/d29/d3a/d58/fa3 x:0 0 0 2024-04-25T15:58:10.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 Processor -- start 2024-04-25T15:58:10.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.267+0000 7f752ff1c640 1 -- start start 2024-04-25T15:58:10.273 INFO:tasks.workunit.client.0.smithi087.stdout:9/541: truncate d6/d8/d29/d3a/d5b/f7e 1707430 0 2024-04-25T15:58:10.273 INFO:tasks.workunit.client.0.smithi087.stdout:9/542: chown d6/d3e/d63 13 1 2024-04-25T15:58:10.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f75280ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:10.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75280c4250 0x7f75281f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:10.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f752815b170 0x7f752814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:10.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7528155280 con 0x7f7528070490 2024-04-25T15:58:10.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7528155100 con 0x7f752815b170 2024-04-25T15:58:10.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7528164e80 con 0x7f75280c4250 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f75280ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f75280ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58212/0 (socket says 172.21.15.87:58212) 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 -- 172.21.15.87:0/3523790798 learned_addr learned my addr 172.21.15.87:0/3523790798 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752e4b9640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f752815b170 0x7f752814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752d4b7640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75280c4250 0x7f75281f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 -- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75280c4250 msgr2=0x7f75281f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75280c4250 0x7f75281f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 -- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f752815b170 msgr2=0x7f752814cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f752815b170 0x7f752814cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 -- 172.21.15.87:0/3523790798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752814d7b0 con 0x7f7528070490 2024-04-25T15:58:10.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752e4b9640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f752815b170 0x7f752814cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:58:10.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/624: unlink d1/d6/d1f/f40 0 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752dcb8640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f75280ae300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f752400e840 tx=0x7f752400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524017070 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752400ee90 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7528157570 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7528157b30 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752400cb60 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75100052a0 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f752401a070 con 0x7f7528070490 2024-04-25T15:58:10.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.271+0000 7f751e7fc640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f750c06f400 0x7f750c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:10.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.275+0000 7f752d4b7640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f750c06f400 0x7f750c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:10.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.275+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f752408f510 con 0x7f7528070490 2024-04-25T15:58:10.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.275+0000 7f752d4b7640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f750c06f400 0x7f750c071910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f75180ad000 tx=0x7f7518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:10.282 INFO:tasks.workunit.client.0.smithi087.stdout:5/618: link d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a d9/d2f/d40/fc9 0 2024-04-25T15:58:10.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.279+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f752405b940 con 0x7f7528070490 2024-04-25T15:58:10.284 INFO:tasks.workunit.client.0.smithi087.stdout:6/642: creat d7/d1a/d1d/d8a/fe1 x:0 0 0 2024-04-25T15:58:10.284 INFO:tasks.workunit.client.0.smithi087.stdout:6/643: dread - d7/d1a/d1d/d21/d27/d2c/f68 zero size 2024-04-25T15:58:10.289 INFO:tasks.workunit.client.0.smithi087.stdout:5/619: creat d9/d2f/d40/d4d/d58/fca x:0 0 0 2024-04-25T15:58:10.292 INFO:tasks.workunit.client.0.smithi087.stdout:4/636: truncate d4/d10/d60/d52/d66/f43 5682537 0 2024-04-25T15:58:10.294 INFO:tasks.workunit.client.0.smithi087.stdout:0/625: write d1/f32 [670726,102029] 0 2024-04-25T15:58:10.297 INFO:tasks.workunit.client.0.smithi087.stdout:4/637: write d4/d10/d60/d5c/f28 [647588,41116] 0 2024-04-25T15:58:10.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/638: chown d4/d10/d60/d5c/d3a/d90/db9 0 1 2024-04-25T15:58:10.305 INFO:tasks.workunit.client.0.smithi087.stdout:5/620: truncate d9/d91/d30/d55/f9b 975397 0 2024-04-25T15:58:10.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/644: dread d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:10.307 INFO:tasks.workunit.client.0.smithi087.stdout:0/626: link d1/da/fa2 d1/da/d3e/d54/d34/d55/fd6 0 2024-04-25T15:58:10.308 INFO:tasks.workunit.client.0.smithi087.stdout:4/639: creat d4/d10/d60/d56/fce x:0 0 0 2024-04-25T15:58:10.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/645: read d7/d1a/d1d/d21/d27/d2c/f5c [2578107,86306] 0 2024-04-25T15:58:10.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/646: fsync d7/d1a/d7b/fa8 0 2024-04-25T15:58:10.310 INFO:tasks.workunit.client.0.smithi087.stdout:5/621: creat d9/d2f/d40/fcb x:0 0 0 2024-04-25T15:58:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/627: symlink d1/da/d3e/db2/dba/ld7 0 2024-04-25T15:58:10.314 INFO:tasks.workunit.client.0.smithi087.stdout:6/647: stat d7/d1a/d41/d9c/c9f 0 2024-04-25T15:58:10.316 INFO:tasks.workunit.client.0.smithi087.stdout:4/640: rename d4/d10/d60/d5c/d8d/faf to d4/d10/d60/d56/d61/d3f/d42/fcf 0 2024-04-25T15:58:10.317 INFO:tasks.workunit.client.0.smithi087.stdout:4/641: fdatasync d4/d10/d60/d5c/d3a/f3e 0 2024-04-25T15:58:10.320 INFO:tasks.workunit.client.0.smithi087.stdout:0/628: write d1/d6/d21/d4c/fcb [605751,7041] 0 2024-04-25T15:58:10.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/648: link d7/d1a/d1d/d21/d27/f82 d7/d1a/d41/dbd/fe2 0 2024-04-25T15:58:10.322 INFO:tasks.workunit.client.0.smithi087.stdout:4/642: creat d4/d10/d60/d56/d61/d3f/dc7/fd0 x:0 0 0 2024-04-25T15:58:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:5/622: dwrite f1 [4194304,4194304] 0 2024-04-25T15:58:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/643: chown d4/d10/d60/d5c/d8d/lb3 1651 1 2024-04-25T15:58:10.326 INFO:tasks.workunit.client.0.smithi087.stdout:5/623: fsync d9/d91/d30/d70/d79/d7d/fba 0 2024-04-25T15:58:10.328 INFO:tasks.workunit.client.0.smithi087.stdout:6/649: creat d7/d1a/d1d/d21/d27/fe3 x:0 0 0 2024-04-25T15:58:10.329 INFO:tasks.workunit.client.0.smithi087.stdout:0/629: link d1/da/d3e/d54/d34/d55/fd6 d1/da/d3e/d54/fd8 0 2024-04-25T15:58:10.329 INFO:tasks.workunit.client.0.smithi087.stdout:4/644: creat d4/d10/d60/d5c/d3a/d90/db9/fd1 x:0 0 0 2024-04-25T15:58:10.332 INFO:tasks.workunit.client.0.smithi087.stdout:4/645: dread - d4/d10/d60/d5c/d3a/d90/fb2 zero size 2024-04-25T15:58:10.335 INFO:tasks.workunit.client.0.smithi087.stdout:4/646: symlink d4/d10/d60/d56/d61/d3f/d8a/ld2 0 2024-04-25T15:58:10.338 INFO:tasks.workunit.client.0.smithi087.stdout:6/650: rename d7/f8 to d7/d1a/d41/fe4 0 2024-04-25T15:58:10.338 INFO:tasks.workunit.client.0.smithi087.stdout:0/630: getdents d1/d6/d21/d2a/dd5 0 2024-04-25T15:58:10.339 INFO:tasks.workunit.client.0.smithi087.stdout:6/651: write d7/d1a/d41/dbd/f3f [4793117,39308] 0 2024-04-25T15:58:10.343 INFO:tasks.workunit.client.0.smithi087.stdout:4/647: getdents d4/d10/d60/d5c/d8d 0 2024-04-25T15:58:10.346 INFO:tasks.workunit.client.0.smithi087.stdout:4/648: chown d4/d10/d60/d56/l3b 166 1 2024-04-25T15:58:10.347 INFO:tasks.workunit.client.0.smithi087.stdout:5/624: write d9/d2f/f76 [1104425,8245] 0 2024-04-25T15:58:10.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/631: dwrite d1/da/d3e/d54/d34/d55/fad [0,4194304] 0 2024-04-25T15:58:10.352 INFO:tasks.workunit.client.0.smithi087.stdout:6/652: dwrite d7/fdf [0,4194304] 0 2024-04-25T15:58:10.355 INFO:tasks.workunit.client.0.smithi087.stdout:4/649: creat d4/d10/d60/d56/d61/fd3 x:0 0 0 2024-04-25T15:58:10.362 INFO:tasks.workunit.client.0.smithi087.stdout:0/632: truncate d1/d6/d21/d2a/f19 6808059 0 2024-04-25T15:58:10.363 INFO:tasks.workunit.client.0.smithi087.stdout:0/633: truncate d1/da/d3e/d85/d9b/fa7 1312317 0 2024-04-25T15:58:10.364 INFO:tasks.workunit.client.0.smithi087.stdout:5/625: getdents d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e 0 2024-04-25T15:58:10.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/653: getdents d7/d1a/d41/dbd/d96 0 2024-04-25T15:58:10.366 INFO:tasks.workunit.client.0.smithi087.stdout:6/654: write d7/d1a/d1d/d21/d27/d2c/d35/f97 [787910,108960] 0 2024-04-25T15:58:10.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/626: mknod d9/d91/d49/ccc 0 2024-04-25T15:58:10.368 INFO:tasks.workunit.client.0.smithi087.stdout:5/627: fsync d9/d99/fbd 0 2024-04-25T15:58:10.368 INFO:tasks.workunit.client.0.smithi087.stdout:6/655: symlink d7/d71/le5 0 2024-04-25T15:58:10.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/628: fsync d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fc4 0 2024-04-25T15:58:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/634: dwrite d1/f3c [0,4194304] 0 2024-04-25T15:58:10.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/629: write d9/d2f/d40/d4d/d7b/f54 [293172,6034] 0 2024-04-25T15:58:10.375 INFO:tasks.workunit.client.0.smithi087.stdout:5/630: chown d9/d2f/d40/d4d/d58/fca 82513 1 2024-04-25T15:58:10.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/631: mknod d9/d91/d30/d70/d82/ccd 0 2024-04-25T15:58:10.378 INFO:tasks.workunit.client.0.smithi087.stdout:6/656: read d7/fc [618257,91418] 0 2024-04-25T15:58:10.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/657: truncate d7/d71/d76/f8e 729707 0 2024-04-25T15:58:10.381 INFO:tasks.workunit.client.0.smithi087.stdout:6/658: chown d7/d1a/d1d/d21/d27/d2c/d35/f83 10231616 1 2024-04-25T15:58:10.383 INFO:tasks.workunit.client.0.smithi087.stdout:0/635: truncate d1/d6/d21/d2a/f66 2066384 0 2024-04-25T15:58:10.384 INFO:tasks.workunit.client.0.smithi087.stdout:5/632: link d9/d91/d30/d70/d79/f95 d9/d2f/d40/d4d/d58/fce 0 2024-04-25T15:58:10.386 INFO:tasks.workunit.client.0.smithi087.stdout:0/636: rename d1/d27/c5e to d1/d6/d77/daa/cd9 0 2024-04-25T15:58:10.387 INFO:tasks.workunit.client.0.smithi087.stdout:6/659: creat d7/d1a/fe6 x:0 0 0 2024-04-25T15:58:10.388 INFO:tasks.workunit.client.0.smithi087.stdout:0/637: mknod d1/cda 0 2024-04-25T15:58:10.389 INFO:tasks.workunit.client.0.smithi087.stdout:0/638: fdatasync d1/d6/d21/d4c/d50/f8d 0 2024-04-25T15:58:10.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/639: stat d1/da/d87 0 2024-04-25T15:58:10.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/633: dwrite d9/f29 [4194304,4194304] 0 2024-04-25T15:58:10.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/660: dwrite d7/d1a/d1d/d21/d27/d2c/f68 [0,4194304] 0 2024-04-25T15:58:10.414 INFO:tasks.workunit.client.0.smithi087.stdout:0/640: dread d1/da/f3a [0,4194304] 0 2024-04-25T15:58:10.414 INFO:tasks.workunit.client.0.smithi087.stdout:7/405: sync 2024-04-25T15:58:10.420 INFO:tasks.workunit.client.0.smithi087.stdout:6/661: read d7/d1a/d1d/d21/d27/f82 [5255887,28673] 0 2024-04-25T15:58:10.421 INFO:tasks.workunit.client.0.smithi087.stdout:7/406: creat d1/d4/d18/d36/f78 x:0 0 0 2024-04-25T15:58:10.424 INFO:tasks.workunit.client.0.smithi087.stdout:6/662: creat d7/fe7 x:0 0 0 2024-04-25T15:58:10.427 INFO:tasks.workunit.client.0.smithi087.stdout:7/407: rename d1/d4/d18/d36/d37/f76 to d1/d3c/d6b/f79 0 2024-04-25T15:58:10.428 INFO:tasks.workunit.client.0.smithi087.stdout:0/641: dread d1/da/d3e/d54/d34/fa6 [0,4194304] 0 2024-04-25T15:58:10.431 INFO:tasks.workunit.client.0.smithi087.stdout:7/408: symlink d1/d1a/l7a 0 2024-04-25T15:58:10.432 INFO:tasks.workunit.client.0.smithi087.stdout:7/409: chown d1/d4/d18/d36/l63 57177 1 2024-04-25T15:58:10.433 INFO:tasks.workunit.client.0.smithi087.stdout:0/642: creat d1/da/d3e/db2/dba/fdb x:0 0 0 2024-04-25T15:58:10.434 INFO:tasks.workunit.client.0.smithi087.stdout:7/410: mkdir d1/d1a/d7b 0 2024-04-25T15:58:10.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/643: mkdir d1/da/d3e/d54/ddc 0 2024-04-25T15:58:10.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/644: mknod d1/d6/cdd 0 2024-04-25T15:58:10.437 INFO:tasks.workunit.client.0.smithi087.stdout:7/411: read f0 [7742695,99783] 0 2024-04-25T15:58:10.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/645: dread - d1/f96 zero size 2024-04-25T15:58:10.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/646: fsync d1/da/d3e/d54/f88 0 2024-04-25T15:58:10.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/412: creat d1/d1a/d7b/f7c x:0 0 0 2024-04-25T15:58:10.441 INFO:tasks.workunit.client.0.smithi087.stdout:0/647: rmdir d1/da/d3e/db2/dba 39 2024-04-25T15:58:10.442 INFO:tasks.workunit.client.0.smithi087.stdout:7/413: fsync d1/d9/d26/f60 0 2024-04-25T15:58:10.443 INFO:tasks.workunit.client.0.smithi087.stdout:7/414: write d1/d1a/f66 [134244,23924] 0 2024-04-25T15:58:10.445 INFO:tasks.workunit.client.0.smithi087.stdout:7/415: mknod d1/d4/d18/d36/d37/c7d 0 2024-04-25T15:58:10.447 INFO:tasks.workunit.client.0.smithi087.stdout:7/416: mkdir d1/d4/d7e 0 2024-04-25T15:58:10.448 INFO:tasks.workunit.client.0.smithi087.stdout:7/417: symlink d1/d9/d26/d45/l7f 0 2024-04-25T15:58:10.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/648: dwrite d1/d6/f8 [0,4194304] 0 2024-04-25T15:58:10.461 INFO:tasks.workunit.client.0.smithi087.stdout:0/649: mkdir d1/d4f/dde 0 2024-04-25T15:58:10.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/618: sync 2024-04-25T15:58:10.462 INFO:tasks.workunit.client.0.smithi087.stdout:8/619: chown d4/d8/l6c 3064872 1 2024-04-25T15:58:10.463 INFO:tasks.workunit.client.0.smithi087.stdout:0/650: mkdir d1/d4f/dde/ddf 0 2024-04-25T15:58:10.464 INFO:tasks.workunit.client.0.smithi087.stdout:0/651: write d1/da/d3e/d54/f91 [696511,119663] 0 2024-04-25T15:58:10.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/620: symlink d4/d1d/lc7 0 2024-04-25T15:58:10.465 INFO:tasks.workunit.client.0.smithi087.stdout:8/621: fsync d4/d8/fb 0 2024-04-25T15:58:10.466 INFO:tasks.workunit.client.0.smithi087.stdout:0/652: write d1/da/d3e/db2/dba/fc4 [3892355,103116] 0 2024-04-25T15:58:10.468 INFO:tasks.workunit.client.0.smithi087.stdout:0/653: write d1/da/d3e/d54/d34/f6e [2014313,13276] 0 2024-04-25T15:58:10.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/622: mknod d4/d1d/d3f/d82/cc8 0 2024-04-25T15:58:10.500 INFO:tasks.workunit.client.0.smithi087.stdout:0/654: symlink d1/d27/d7d/d84/le0 0 2024-04-25T15:58:10.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/623: mkdir d4/d1d/d17/d37/dc9 0 2024-04-25T15:58:10.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/624: fsync d4/d8/dd/f11 0 2024-04-25T15:58:10.523 INFO:tasks.workunit.client.0.smithi087.stdout:0/655: write d1/d6/d21/f94 [142510,63248] 0 2024-04-25T15:58:10.525 INFO:tasks.workunit.client.0.smithi087.stdout:8/625: dwrite d4/d1d/d3f/fb5 [0,4194304] 0 2024-04-25T15:58:10.525 INFO:tasks.workunit.client.0.smithi087.stdout:0/656: readlink d1/da/d3e/d54/l73 0 2024-04-25T15:58:10.527 INFO:tasks.workunit.client.0.smithi087.stdout:8/626: write d4/d8/dd/fbd [24557,101133] 0 2024-04-25T15:58:10.529 INFO:tasks.workunit.client.0.smithi087.stdout:0/657: mkdir d1/d27/d7d/d84/de1 0 2024-04-25T15:58:10.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/627: rename d4/f95 to d4/d8/dd/d85/d86/fca 0 2024-04-25T15:58:10.532 INFO:tasks.workunit.client.0.smithi087.stdout:8/628: chown d4/d8/dd/d85/d86/f8f 1813203826 1 2024-04-25T15:58:10.532 INFO:tasks.workunit.client.0.smithi087.stdout:0/658: creat d1/d6/d77/dc6/fe2 x:0 0 0 2024-04-25T15:58:10.533 INFO:tasks.workunit.client.0.smithi087.stdout:8/629: chown d4/d8/ca9 6806 1 2024-04-25T15:58:10.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.531+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7510005860 con 0x7f7528070490 2024-04-25T15:58:10.537 INFO:tasks.workunit.client.0.smithi087.stdout:8/630: rename d4/d8/l6c to d4/d22/lcb 0 2024-04-25T15:58:10.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.531+0000 7f751e7fc640 1 -- 172.21.15.87:0/3523790798 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5668 (secure 0 0 0) 0x7f752405fc40 con 0x7f7528070490 2024-04-25T15:58:10.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:10.537 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:09.754387+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:clientreplay","state_seq":65,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:58:10.538 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 39 2024-04-25T15:58:10.538 INFO:tasks.workunit.client.0.smithi087.stdout:0/659: unlink d1/da/d3e/d54/d34/d55/f7a 0 2024-04-25T15:58:10.539 INFO:tasks.workunit.client.0.smithi087.stdout:0/660: write d1/f3c [3900865,13441] 0 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f750c06f400 msgr2=0x7f750c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f750c06f400 0x7f750c071910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f75180ad000 tx=0x7f7518008040 comp rx=0 tx=0).stop 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 msgr2=0x7f75280ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f75280ae300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f752400e840 tx=0x7f752400ec40 comp rx=0 tx=0).stop 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 shutdown_connections 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f750c06f400 0x7f750c071910 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f752815b170 0x7f752814cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75280c4250 0x7f75281f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 --2- 172.21.15.87:0/3523790798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528070490 0x7f75280ae300 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:10.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 >> 172.21.15.87:0/3523790798 conn(0x7f752806d780 msgr2=0x7f7528073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:10.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 shutdown_connections 2024-04-25T15:58:10.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:10.535+0000 7f752ff1c640 1 -- 172.21.15.87:0/3523790798 wait complete. 2024-04-25T15:58:10.542 INFO:tasks.workunit.client.0.smithi087.stdout:8/631: link d4/d8/dd/fbd d4/d1d/d3f/da6/fcc 0 2024-04-25T15:58:10.542 INFO:tasks.workunit.client.0.smithi087.stdout:8/632: chown d4/d1d/d7c/c46 170894747 1 2024-04-25T15:58:10.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/633: dwrite d4/d1d/d3f/f8d [0,4194304] 0 2024-04-25T15:58:10.554 INFO:tasks.workunit.client.0.smithi087.stdout:0/661: dread d1/d6/f36 [0,4194304] 0 2024-04-25T15:58:10.556 INFO:tasks.workunit.client.0.smithi087.stdout:0/662: fsync d1/da/d3e/d54/d34/f4b 0 2024-04-25T15:58:10.559 INFO:tasks.workunit.client.0.smithi087.stdout:0/663: chown d1/d6/f4d 58204 1 2024-04-25T15:58:10.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/634: creat d4/d9c/db1/fcd x:0 0 0 2024-04-25T15:58:10.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/664: mkdir d1/d4f/de3 0 2024-04-25T15:58:10.564 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-04-25T15:58:10.564 INFO:tasks.mds_thrash.fs.[a]:waiting for 55 secs before thrashing 2024-04-25T15:58:10.564 INFO:tasks.workunit.client.0.smithi087.stdout:8/635: creat d4/d1d/d17/d37/dc9/fce x:0 0 0 2024-04-25T15:58:10.566 INFO:tasks.workunit.client.0.smithi087.stdout:8/636: write d4/d1d/d17/d37/d5e/f88 [1492040,1338] 0 2024-04-25T15:58:10.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/665: getdents d1/d27 0 2024-04-25T15:58:10.568 INFO:tasks.workunit.client.0.smithi087.stdout:0/666: chown d1/d6/d77/f7e 14634553 1 2024-04-25T15:58:10.569 INFO:tasks.workunit.client.0.smithi087.stdout:8/637: getdents d4/d1d/d3f 0 2024-04-25T15:58:10.571 INFO:tasks.workunit.client.0.smithi087.stdout:8/638: mknod d4/d1d/d7c/dae/ccf 0 2024-04-25T15:58:10.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/667: dwrite d1/d6/d1f/f37 [8388608,4194304] 0 2024-04-25T15:58:10.581 INFO:tasks.workunit.client.0.smithi087.stdout:0/668: write d1/d4f/fbe [2449,29048] 0 2024-04-25T15:58:10.581 INFO:tasks.workunit.client.0.smithi087.stdout:8/639: dread d4/d1d/d14/f31 [0,4194304] 0 2024-04-25T15:58:10.582 INFO:tasks.workunit.client.0.smithi087.stdout:0/669: readlink d1/da/d3e/d54/l73 0 2024-04-25T15:58:10.591 INFO:tasks.workunit.client.0.smithi087.stdout:8/640: write d4/d1d/d7c/f23 [681128,63170] 0 2024-04-25T15:58:10.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/670: dwrite d1/d6/d21/fa9 [0,4194304] 0 2024-04-25T15:58:10.611 INFO:tasks.workunit.client.0.smithi087.stdout:0/671: dwrite d1/da/d3e/d54/d34/f43 [0,4194304] 0 2024-04-25T15:58:10.616 INFO:tasks.workunit.client.0.smithi087.stdout:8/641: dread d4/d8/dd/d85/d86/f8f [0,4194304] 0 2024-04-25T15:58:10.621 INFO:tasks.workunit.client.0.smithi087.stdout:8/642: truncate d4/d8/dd/d2f/f67 2199936 0 2024-04-25T15:58:10.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/672: dwrite d1/da/d3e/d54/f2b [0,4194304] 0 2024-04-25T15:58:10.623 INFO:tasks.workunit.client.0.smithi087.stdout:8/643: write d4/d1d/d3f/d82/fb2 [355972,29932] 0 2024-04-25T15:58:10.623 INFO:tasks.workunit.client.0.smithi087.stdout:0/673: write d1/d6/fe [1747433,122518] 0 2024-04-25T15:58:10.628 INFO:tasks.workunit.client.0.smithi087.stdout:8/644: mknod d4/d8/dd/d85/dbc/cd0 0 2024-04-25T15:58:10.629 INFO:tasks.workunit.client.0.smithi087.stdout:8/645: stat d4/d8 0 2024-04-25T15:58:10.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/674: mknod d1/da/d3e/ce4 0 2024-04-25T15:58:10.632 INFO:tasks.workunit.client.0.smithi087.stdout:0/675: read d1/da/d3e/d54/d34/f43 [4057092,109582] 0 2024-04-25T15:58:10.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/676: rmdir d1/da/d3e/d85 39 2024-04-25T15:58:10.638 INFO:tasks.workunit.client.0.smithi087.stdout:0/677: creat d1/d6/d77/daa/fe5 x:0 0 0 2024-04-25T15:58:10.639 INFO:tasks.workunit.client.0.smithi087.stdout:8/646: dwrite d4/d1d/f47 [0,4194304] 0 2024-04-25T15:58:10.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/647: chown d4/d1d/d3f/fac 503537220 1 2024-04-25T15:58:10.642 INFO:tasks.workunit.client.0.smithi087.stdout:0/678: mkdir d1/d4f/de6 0 2024-04-25T15:58:10.642 INFO:tasks.workunit.client.0.smithi087.stdout:8/648: fsync d4/d8/dd/d85/d86/f8f 0 2024-04-25T15:58:10.646 INFO:tasks.workunit.client.0.smithi087.stdout:0/679: write d1/d6/fe [2595854,85130] 0 2024-04-25T15:58:10.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/649: rename d4/d1d/c21 to d4/d1d/cd1 0 2024-04-25T15:58:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:8/650: write d4/d1d/f47 [2518021,5035] 0 2024-04-25T15:58:10.653 INFO:tasks.workunit.client.0.smithi087.stdout:0/680: creat d1/d6/d21/d2a/fe7 x:0 0 0 2024-04-25T15:58:10.656 INFO:tasks.workunit.client.0.smithi087.stdout:0/681: symlink d1/da/d3e/d54/le8 0 2024-04-25T15:58:10.661 INFO:tasks.workunit.client.0.smithi087.stdout:8/651: read d4/d8/dd/d2f/f67 [1652612,25999] 0 2024-04-25T15:58:10.662 INFO:tasks.workunit.client.0.smithi087.stdout:0/682: rmdir d1/d4f/dde/ddf 0 2024-04-25T15:58:10.663 INFO:tasks.workunit.client.0.smithi087.stdout:8/652: fsync d4/d1d/d17/d37/f78 0 2024-04-25T15:58:10.664 INFO:tasks.workunit.client.0.smithi087.stdout:8/653: rmdir d4/d1d/d3f/d82 39 2024-04-25T15:58:10.667 INFO:tasks.workunit.client.0.smithi087.stdout:8/654: mkdir d4/d8/dd/d85/dbc/dd2 0 2024-04-25T15:58:10.671 INFO:tasks.workunit.client.0.smithi087.stdout:8/655: symlink d4/ld3 0 2024-04-25T15:58:10.674 INFO:tasks.workunit.client.0.smithi087.stdout:8/656: rmdir d4/d1d/d3f/d82 39 2024-04-25T15:58:10.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/657: stat d4/d8/c12 0 2024-04-25T15:58:10.682 INFO:tasks.workunit.client.0.smithi087.stdout:0/683: dread d1/d6/fc9 [0,4194304] 0 2024-04-25T15:58:10.685 INFO:tasks.workunit.client.0.smithi087.stdout:0/684: mkdir d1/de9 0 2024-04-25T15:58:10.685 INFO:tasks.workunit.client.0.smithi087.stdout:8/658: dread d4/d22/d43/f61 [0,4194304] 0 2024-04-25T15:58:10.686 INFO:tasks.workunit.client.0.smithi087.stdout:0/685: fsync d1/f3d 0 2024-04-25T15:58:10.687 INFO:tasks.workunit.client.0.smithi087.stdout:8/659: symlink d4/d8/dd/d85/ld4 0 2024-04-25T15:58:10.688 INFO:tasks.workunit.client.0.smithi087.stdout:8/660: stat d4/d1d/f59 0 2024-04-25T15:58:10.690 INFO:tasks.workunit.client.0.smithi087.stdout:0/686: write d1/d6/d21/f51 [2964926,24223] 0 2024-04-25T15:58:10.692 INFO:tasks.workunit.client.0.smithi087.stdout:0/687: getdents d1/d27 0 2024-04-25T15:58:10.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/688: write d1/f58 [4423238,60317] 0 2024-04-25T15:58:10.695 INFO:tasks.workunit.client.0.smithi087.stdout:0/689: write d1/f58 [2042891,24976] 0 2024-04-25T15:58:10.697 INFO:tasks.workunit.client.0.smithi087.stdout:0/690: dread - d1/d6/d21/d4c/d50/d6b/fac zero size 2024-04-25T15:58:10.698 INFO:tasks.workunit.client.0.smithi087.stdout:0/691: dread - d1/d6/d21/d4c/d50/d6b/fac zero size 2024-04-25T15:58:10.700 INFO:tasks.workunit.client.0.smithi087.stdout:0/692: truncate d1/d6/d77/f7e 2138843 0 2024-04-25T15:58:10.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/693: write d1/da/d3e/d54/d34/f6e [1578755,110650] 0 2024-04-25T15:58:10.712 INFO:tasks.workunit.client.0.smithi087.stdout:0/694: truncate d1/da/d3e/d54/d34/d55/fad 1710808 0 2024-04-25T15:58:10.713 INFO:tasks.workunit.client.0.smithi087.stdout:0/695: stat d1/c59 0 2024-04-25T15:58:10.721 INFO:tasks.workunit.client.0.smithi087.stdout:0/696: dwrite d1/d6/d21/d4c/d50/f81 [0,4194304] 0 2024-04-25T15:58:10.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/697: stat d1/d6/d77/dc6/fe2 0 2024-04-25T15:58:10.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/698: fsync d1/d6/d77/f7e 0 2024-04-25T15:58:10.732 INFO:tasks.workunit.client.0.smithi087.stdout:0/699: dread d1/d6/d21/fa9 [0,4194304] 0 2024-04-25T15:58:10.737 INFO:tasks.workunit.client.0.smithi087.stdout:0/700: rename d1/d6/d77/c9f to d1/da/cea 0 2024-04-25T15:58:10.739 INFO:tasks.workunit.client.0.smithi087.stdout:0/701: creat d1/d6/d21/d4c/d50/feb x:0 0 0 2024-04-25T15:58:10.740 INFO:tasks.workunit.client.0.smithi087.stdout:0/702: truncate d1/d6/f36 4443439 0 2024-04-25T15:58:10.742 INFO:tasks.workunit.client.0.smithi087.stdout:0/703: creat d1/d6/d77/daa/fec x:0 0 0 2024-04-25T15:58:10.747 INFO:tasks.workunit.client.0.smithi087.stdout:0/704: link d1/da/d3e/l6a d1/d6/d21/d4c/d50/led 0 2024-04-25T15:58:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:0/705: dwrite d1/f61 [4194304,4194304] 0 2024-04-25T15:58:10.756 INFO:tasks.workunit.client.0.smithi087.stdout:0/706: readlink d1/da/d3e/d54/d34/lb3 0 2024-04-25T15:58:10.766 INFO:tasks.workunit.client.0.smithi087.stdout:0/707: dwrite d1/d6/d21/fa9 [0,4194304] 0 2024-04-25T15:58:10.768 INFO:tasks.workunit.client.0.smithi087.stdout:0/708: fdatasync d1/d6/f4d 0 2024-04-25T15:58:10.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/709: truncate d1/d6/d21/d4c/d50/feb 1029850 0 2024-04-25T15:58:10.775 INFO:tasks.workunit.client.0.smithi087.stdout:0/710: link d1/d6/d21/d2a/fe7 d1/da/d3e/db2/dba/fee 0 2024-04-25T15:58:10.776 INFO:tasks.workunit.client.0.smithi087.stdout:0/711: stat d1/da/d3e/db2/dba/ld7 0 2024-04-25T15:58:10.779 INFO:tasks.workunit.client.0.smithi087.stdout:0/712: creat d1/da/d3e/db2/fef x:0 0 0 2024-04-25T15:58:10.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/713: read d1/d6/d21/d2a/f6f [128529,77131] 0 2024-04-25T15:58:10.785 INFO:tasks.workunit.client.0.smithi087.stdout:0/714: creat d1/d6/d21/d2a/dd5/ff0 x:0 0 0 2024-04-25T15:58:10.788 INFO:tasks.workunit.client.0.smithi087.stdout:0/715: dread d1/d6/d21/d4c/d50/d6b/f8a [0,4194304] 0 2024-04-25T15:58:10.789 INFO:tasks.workunit.client.0.smithi087.stdout:0/716: dread - d1/d6/d21/d2a/fe7 zero size 2024-04-25T15:58:10.796 INFO:tasks.workunit.client.0.smithi087.stdout:0/717: dwrite d1/d6/d21/f94 [0,4194304] 0 2024-04-25T15:58:10.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/718: symlink d1/d4f/lf1 0 2024-04-25T15:58:10.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/719: read d1/da/d3e/d54/d34/f6e [2306559,124148] 0 2024-04-25T15:58:10.803 INFO:tasks.workunit.client.0.smithi087.stdout:0/720: dread - d1/da/fa2 zero size 2024-04-25T15:58:10.808 INFO:tasks.workunit.client.0.smithi087.stdout:0/721: dread d1/da/d3e/d54/f2b [0,4194304] 0 2024-04-25T15:58:10.812 INFO:tasks.workunit.client.0.smithi087.stdout:0/722: mkdir d1/da/d3e/d85/d9b/dcd/df2 0 2024-04-25T15:58:10.813 INFO:tasks.workunit.client.0.smithi087.stdout:0/723: chown d1/da/d3e/c65 6734163 1 2024-04-25T15:58:10.814 INFO:tasks.workunit.client.0.smithi087.stdout:0/724: mkdir d1/d6/d77/dc6/df3 0 2024-04-25T15:58:10.818 INFO:tasks.workunit.client.0.smithi087.stdout:0/725: rmdir d1/d4f/de6 0 2024-04-25T15:58:10.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/726: truncate d1/f32 273205 0 2024-04-25T15:58:10.828 INFO:tasks.workunit.client.0.smithi087.stdout:0/727: mkdir d1/dab/df4 0 2024-04-25T15:58:10.829 INFO:tasks.workunit.client.0.smithi087.stdout:0/728: truncate d1/d6/d77/daa/fcc 372335 0 2024-04-25T15:58:10.831 INFO:tasks.workunit.client.0.smithi087.stdout:0/729: rename d1/d6/d77/daa to d1/d4f/de3/df5 0 2024-04-25T15:58:10.839 INFO:tasks.workunit.client.0.smithi087.stdout:0/730: truncate d1/da/d3e/db2/dba/fc4 2465641 0 2024-04-25T15:58:10.842 INFO:tasks.workunit.client.0.smithi087.stdout:0/731: mknod d1/d6/d21/cf6 0 2024-04-25T15:58:10.844 INFO:tasks.workunit.client.0.smithi087.stdout:0/732: mknod d1/d6/d21/d2a/cf7 0 2024-04-25T15:58:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:1/626: sync 2024-04-25T15:58:10.898 INFO:tasks.workunit.client.0.smithi087.stdout:3/501: sync 2024-04-25T15:58:10.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/502: fdatasync d4/d14/d53/f75 0 2024-04-25T15:58:10.901 INFO:tasks.workunit.client.0.smithi087.stdout:1/627: mknod d3/dad/cd3 0 2024-04-25T15:58:10.906 INFO:tasks.workunit.client.0.smithi087.stdout:1/628: truncate d3/f8 547360 0 2024-04-25T15:58:10.910 INFO:tasks.workunit.client.0.smithi087.stdout:1/629: rmdir d3/d12/d14/d29/d67/d73/d9c 39 2024-04-25T15:58:10.915 INFO:tasks.workunit.client.0.smithi087.stdout:1/630: creat d3/d2d/d6c/fd4 x:0 0 0 2024-04-25T15:58:10.915 INFO:tasks.workunit.client.0.smithi087.stdout:3/503: truncate d4/d14/d23/f26 2439 0 2024-04-25T15:58:10.918 INFO:tasks.workunit.client.0.smithi087.stdout:3/504: rmdir d4/d14/d53/d7d 39 2024-04-25T15:58:10.919 INFO:tasks.workunit.client.0.smithi087.stdout:3/505: fsync d4/db/f5b 0 2024-04-25T15:58:10.922 INFO:tasks.workunit.client.0.smithi087.stdout:1/631: rmdir d3/d12/d14/d29/d67/d73/da7 0 2024-04-25T15:58:10.930 INFO:tasks.workunit.client.0.smithi087.stdout:3/506: truncate d4/d17/d24/d3f/f7e 2558303 0 2024-04-25T15:58:10.932 INFO:tasks.workunit.client.0.smithi087.stdout:3/507: mknod d4/d17/d24/ca3 0 2024-04-25T15:58:10.935 INFO:tasks.workunit.client.0.smithi087.stdout:3/508: creat d4/d17/d24/d3f/d99/fa4 x:0 0 0 2024-04-25T15:58:10.942 INFO:tasks.workunit.client.0.smithi087.stdout:3/509: dwrite d4/d17/d24/f32 [0,4194304] 0 2024-04-25T15:58:10.944 INFO:tasks.workunit.client.0.smithi087.stdout:1/632: dread d3/d12/d14/d29/d2f/f63 [0,4194304] 0 2024-04-25T15:58:10.947 INFO:tasks.workunit.client.0.smithi087.stdout:1/633: truncate d3/d12/d14/f16 1027997 0 2024-04-25T15:58:10.954 INFO:tasks.workunit.client.0.smithi087.stdout:1/634: mkdir d3/d12/d14/d29/d67/d73/d9c/dd0/dd5 0 2024-04-25T15:58:10.955 INFO:tasks.workunit.client.0.smithi087.stdout:3/510: write d4/d17/f1e [4165084,48359] 0 2024-04-25T15:58:10.955 INFO:tasks.workunit.client.0.smithi087.stdout:1/635: chown d3/d12/d14/d29/d5c 579401324 1 2024-04-25T15:58:10.958 INFO:tasks.workunit.client.0.smithi087.stdout:3/511: mkdir d4/db/d28/d5c/da5 0 2024-04-25T15:58:10.960 INFO:tasks.workunit.client.0.smithi087.stdout:1/636: rename d3/d12/d14/d29/d2f/d53/l4f to d3/d12/d14/d29/d67/d73/d9c/dd0/ld6 0 2024-04-25T15:58:10.963 INFO:tasks.workunit.client.0.smithi087.stdout:1/637: symlink d3/d2d/ld7 0 2024-04-25T15:58:10.967 INFO:tasks.workunit.client.0.smithi087.stdout:3/512: dread d4/f3b [0,4194304] 0 2024-04-25T15:58:10.970 INFO:tasks.workunit.client.0.smithi087.stdout:3/513: chown d4/d14/d37/f40 4685713 1 2024-04-25T15:58:10.972 INFO:tasks.workunit.client.0.smithi087.stdout:1/638: dwrite d3/d2d/d6c/fd4 [0,4194304] 0 2024-04-25T15:58:10.975 INFO:tasks.workunit.client.0.smithi087.stdout:3/514: rename d4/d14 to d4/d17/d81/da6 0 2024-04-25T15:58:10.977 INFO:tasks.workunit.client.0.smithi087.stdout:1/639: dread d3/d12/d14/d29/d2f/d53/f84 [0,4194304] 0 2024-04-25T15:58:10.982 INFO:tasks.workunit.client.0.smithi087.stdout:3/515: creat d4/d17/d24/d29/fa7 x:0 0 0 2024-04-25T15:58:10.984 INFO:tasks.workunit.client.0.smithi087.stdout:3/516: rmdir d4/db/d28/d3c/d62/d89 39 2024-04-25T15:58:10.989 INFO:tasks.workunit.client.0.smithi087.stdout:1/640: write d3/f35 [706344,26621] 0 2024-04-25T15:58:10.991 INFO:tasks.workunit.client.0.smithi087.stdout:3/517: write d4/d17/d81/da6/f3d [1013860,22086] 0 2024-04-25T15:58:10.991 INFO:tasks.workunit.client.0.smithi087.stdout:1/641: dread - d3/d12/d4d/da5/fc2 zero size 2024-04-25T15:58:10.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/518: fdatasync d4/d17/d81/da6/d53/f88 0 2024-04-25T15:58:10.995 INFO:tasks.workunit.client.0.smithi087.stdout:1/642: truncate d3/f8 1064521 0 2024-04-25T15:58:10.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/519: mkdir d4/d17/d24/d29/da8 0 2024-04-25T15:58:10.998 INFO:tasks.workunit.client.0.smithi087.stdout:1/643: rmdir d3/d12/d14/d29/d67 39 2024-04-25T15:58:10.999 INFO:tasks.workunit.client.0.smithi087.stdout:3/520: chown d4/d17/d24/d3f/d99/fa4 14 1 2024-04-25T15:58:11.002 INFO:tasks.workunit.client.0.smithi087.stdout:3/521: mkdir d4/db/d28/d82/d8c/da9 0 2024-04-25T15:58:11.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/522: write d4/db/f38 [855723,41316] 0 2024-04-25T15:58:11.009 INFO:tasks.workunit.client.0.smithi087.stdout:3/523: write d4/d17/d24/f46 [637849,121824] 0 2024-04-25T15:58:11.012 INFO:tasks.workunit.client.0.smithi087.stdout:1/644: dwrite d3/d12/d14/d29/d2f/d61/f87 [0,4194304] 0 2024-04-25T15:58:11.019 INFO:tasks.workunit.client.0.smithi087.stdout:1/645: getdents d3/d12/d14/d29/d65/d97 0 2024-04-25T15:58:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:1/646: link d3/d12/d4d/d7d/fc6 d3/d12/d4d/dba/fd8 0 2024-04-25T15:58:11.029 INFO:tasks.workunit.client.0.smithi087.stdout:3/524: dread d4/f2c [0,4194304] 0 2024-04-25T15:58:11.030 INFO:tasks.workunit.client.0.smithi087.stdout:1/647: getdents d3/d12/d14/d29/d3b 0 2024-04-25T15:58:11.035 INFO:tasks.workunit.client.0.smithi087.stdout:3/525: rename d4/d17/d81/da6/d23/f26 to d4/db/d28/d82/d8c/da0/da1/faa 0 2024-04-25T15:58:11.036 INFO:tasks.workunit.client.0.smithi087.stdout:1/648: creat d3/d12/d14/d29/d67/d73/fd9 x:0 0 0 2024-04-25T15:58:11.043 INFO:tasks.workunit.client.0.smithi087.stdout:3/526: truncate d4/d17/f63 900315 0 2024-04-25T15:58:11.044 INFO:tasks.workunit.client.0.smithi087.stdout:3/527: chown d4/d17/d81/da6/d37/d51/f52 909 1 2024-04-25T15:58:11.051 INFO:tasks.workunit.client.0.smithi087.stdout:1/649: dread d3/d12/d14/d29/d2f/d40/fab [0,4194304] 0 2024-04-25T15:58:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:3/528: dwrite d4/f12 [0,4194304] 0 2024-04-25T15:58:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:9/543: sync 2024-04-25T15:58:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:4/650: sync 2024-04-25T15:58:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:2/538: sync 2024-04-25T15:58:11.056 INFO:tasks.workunit.client.0.smithi087.stdout:2/539: fsync d3/d27/d29/f8c 0 2024-04-25T15:58:11.056 INFO:tasks.workunit.client.0.smithi087.stdout:1/650: creat d3/d12/d14/d33/d95/fda x:0 0 0 2024-04-25T15:58:11.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/651: write d4/d10/d60/d5c/d8d/f9c [636959,11770] 0 2024-04-25T15:58:11.058 INFO:tasks.workunit.client.0.smithi087.stdout:2/540: fsync d3/d27/d29/d4f/f5f 0 2024-04-25T15:58:11.059 INFO:tasks.workunit.client.0.smithi087.stdout:3/529: creat d4/d17/d24/d3f/d9c/fab x:0 0 0 2024-04-25T15:58:11.059 INFO:tasks.workunit.client.0.smithi087.stdout:1/651: dread - d3/d2d/d6c/fbc zero size 2024-04-25T15:58:11.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/652: fdatasync d4/d10/d60/d52/d66/f2c 0 2024-04-25T15:58:11.060 INFO:tasks.workunit.client.0.smithi087.stdout:3/530: chown d4/db/f5b 1756848 1 2024-04-25T15:58:11.060 INFO:tasks.workunit.client.0.smithi087.stdout:2/541: chown d3/d27/d29/d4f/fa0 21088000 1 2024-04-25T15:58:11.062 INFO:tasks.workunit.client.0.smithi087.stdout:2/542: chown d3/d27/d29/d4f 56334249 1 2024-04-25T15:58:11.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/531: read d4/db/d28/f2f [2720282,46256] 0 2024-04-25T15:58:11.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/532: write d4/d17/f74 [3692672,80348] 0 2024-04-25T15:58:11.064 INFO:tasks.workunit.client.0.smithi087.stdout:4/653: mkdir d4/d10/d60/d5c/d3a/dd4 0 2024-04-25T15:58:11.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/544: creat d6/d8/d29/d3a/d5b/d60/d81/d85/fa4 x:0 0 0 2024-04-25T15:58:11.066 INFO:tasks.workunit.client.0.smithi087.stdout:1/652: getdents d3/d12/d39 0 2024-04-25T15:58:11.067 INFO:tasks.workunit.client.0.smithi087.stdout:2/543: creat d3/d20/d4a/fa3 x:0 0 0 2024-04-25T15:58:11.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/544: readlink d3/d20/d4a/l3d 0 2024-04-25T15:58:11.070 INFO:tasks.workunit.client.0.smithi087.stdout:1/653: write d3/d12/d14/d29/d65/d97/fb8 [435092,29355] 0 2024-04-25T15:58:11.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/654: rename d4/d10/d60/d56/d61/d3f/d8a/lc5 to d4/d10/d60/d56/ld5 0 2024-04-25T15:58:11.078 INFO:tasks.workunit.client.0.smithi087.stdout:9/545: dwrite d6/d8/d32/d4c/f82 [0,4194304] 0 2024-04-25T15:58:11.079 INFO:tasks.workunit.client.0.smithi087.stdout:2/545: rename d3/d27/d29/d2d/d40/l62 to d3/d27/d38/la4 0 2024-04-25T15:58:11.081 INFO:tasks.workunit.client.0.smithi087.stdout:3/533: dwrite d4/d17/d81/da6/d53/d7d/f98 [0,4194304] 0 2024-04-25T15:58:11.081 INFO:tasks.workunit.client.0.smithi087.stdout:2/546: readlink d3/d20/d4a/l3d 0 2024-04-25T15:58:11.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/547: symlink d3/d2a/d48/d83/la5 0 2024-04-25T15:58:11.090 INFO:tasks.workunit.client.0.smithi087.stdout:3/534: rename d4/d17/d24/d3f to d4/d17/d24/d29/d58/dac 0 2024-04-25T15:58:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:1/654: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:4/655: link d4/d10/d60/d52/d66/f2c d4/d10/d60/d56/d61/d3f/fd6 0 2024-04-25T15:58:11.093 INFO:tasks.workunit.client.0.smithi087.stdout:9/546: dwrite d6/d8/d12/f5a [0,4194304] 0 2024-04-25T15:58:11.094 INFO:tasks.workunit.client.0.smithi087.stdout:9/547: chown d6/f51 776 1 2024-04-25T15:58:11.095 INFO:tasks.workunit.client.0.smithi087.stdout:3/535: rmdir d4/d17/d81 39 2024-04-25T15:58:11.095 INFO:tasks.workunit.client.0.smithi087.stdout:2/548: symlink d3/d27/d29/d4f/d5a/la6 0 2024-04-25T15:58:11.097 INFO:tasks.workunit.client.0.smithi087.stdout:4/656: symlink d4/d10/d60/d5c/d3a/d90/ld7 0 2024-04-25T15:58:11.097 INFO:tasks.workunit.client.0.smithi087.stdout:4/657: dread - d4/d10/d60/d5c/d8d/fc2 zero size 2024-04-25T15:58:11.100 INFO:tasks.workunit.client.0.smithi087.stdout:1/655: creat d3/d12/d39/d64/dc0/fdb x:0 0 0 2024-04-25T15:58:11.101 INFO:tasks.workunit.client.0.smithi087.stdout:3/536: symlink d4/d17/d81/da6/d37/d51/lad 0 2024-04-25T15:58:11.103 INFO:tasks.workunit.client.0.smithi087.stdout:9/548: creat d6/d8/d29/d3a/d5b/d60/fa5 x:0 0 0 2024-04-25T15:58:11.104 INFO:tasks.workunit.client.0.smithi087.stdout:1/656: unlink d3/d12/c82 0 2024-04-25T15:58:11.105 INFO:tasks.workunit.client.0.smithi087.stdout:2/549: link d3/d27/d38/fa1 d3/d27/d29/d4f/d5a/d6a/d88/fa7 0 2024-04-25T15:58:11.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/658: creat d4/d10/d60/d52/d66/d15/fd8 x:0 0 0 2024-04-25T15:58:11.107 INFO:tasks.workunit.client.0.smithi087.stdout:1/657: creat d3/d12/d4d/da5/fdc x:0 0 0 2024-04-25T15:58:11.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/658: stat d3/d12/d14/d29/c52 0 2024-04-25T15:58:11.109 INFO:tasks.workunit.client.0.smithi087.stdout:9/549: rename d6/d3e/c8c to d6/d8/d29/ca6 0 2024-04-25T15:58:11.111 INFO:tasks.workunit.client.0.smithi087.stdout:4/659: creat d4/d10/d60/d56/d61/fd9 x:0 0 0 2024-04-25T15:58:11.112 INFO:tasks.workunit.client.0.smithi087.stdout:2/550: rename d3/d27/d29/d4f/fa0 to d3/d27/d29/d2d/fa8 0 2024-04-25T15:58:11.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/537: dwrite d4/f16 [0,4194304] 0 2024-04-25T15:58:11.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/551: chown d3/d27/d29/d2d/d40/c72 11758356 1 2024-04-25T15:58:11.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/550: mkdir d6/d8/d32/d57/d66/da7 0 2024-04-25T15:58:11.116 INFO:tasks.workunit.client.0.smithi087.stdout:2/552: mknod d3/d27/d29/d4f/ca9 0 2024-04-25T15:58:11.117 INFO:tasks.workunit.client.0.smithi087.stdout:4/660: symlink d4/d10/d60/d56/d61/lda 0 2024-04-25T15:58:11.121 INFO:tasks.workunit.client.0.smithi087.stdout:9/551: dwrite d6/d8/d12/f2f [0,4194304] 0 2024-04-25T15:58:11.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/552: chown d6/d8/d29/f3f 8 1 2024-04-25T15:58:11.122 INFO:tasks.workunit.client.0.smithi087.stdout:2/553: dread d3/d27/d29/d2d/f57 [0,4194304] 0 2024-04-25T15:58:11.123 INFO:tasks.workunit.client.0.smithi087.stdout:9/553: chown d6/d8/d29/d3a/d5b/d60/d1d/f39 181334 1 2024-04-25T15:58:11.124 INFO:tasks.workunit.client.0.smithi087.stdout:2/554: dread d3/d27/d29/d2d/f7d [0,4194304] 0 2024-04-25T15:58:11.128 INFO:tasks.workunit.client.0.smithi087.stdout:3/538: getdents d4/d17/d24/d29/d58/dac 0 2024-04-25T15:58:11.131 INFO:tasks.workunit.client.0.smithi087.stdout:4/661: rename d4/d10/d60/d56/d61/fd9 to d4/fdb 0 2024-04-25T15:58:11.133 INFO:tasks.workunit.client.0.smithi087.stdout:3/539: write d4/d17/d81/da6/d37/d51/f52 [1085890,90891] 0 2024-04-25T15:58:11.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/554: getdents d6/d8/d29/d3a/d5b/d60/d81 0 2024-04-25T15:58:11.134 INFO:tasks.workunit.client.0.smithi087.stdout:4/662: rmdir d4/d10/d60/d56/d61/d3f/d42 39 2024-04-25T15:58:11.136 INFO:tasks.workunit.client.0.smithi087.stdout:3/540: truncate d4/db/d28/d82/f86 4515892 0 2024-04-25T15:58:11.136 INFO:tasks.workunit.client.0.smithi087.stdout:9/555: truncate d6/d8/d29/d3a/f40 487582 0 2024-04-25T15:58:11.137 INFO:tasks.workunit.client.0.smithi087.stdout:4/663: symlink d4/d10/d60/d52/d66/d15/ldc 0 2024-04-25T15:58:11.138 INFO:tasks.workunit.client.0.smithi087.stdout:9/556: read - d6/d8/d29/d3a/d5b/d60/fa5 zero size 2024-04-25T15:58:11.139 INFO:tasks.workunit.client.0.smithi087.stdout:9/557: chown d6/d8/f96 147 1 2024-04-25T15:58:11.141 INFO:tasks.workunit.client.0.smithi087.stdout:4/664: creat d4/d10/d60/d56/d61/d3f/d58/d5e/fdd x:0 0 0 2024-04-25T15:58:11.141 INFO:tasks.workunit.client.0.smithi087.stdout:9/558: dread - d6/d8/d29/d3a/d5b/d60/d81/d85/fa4 zero size 2024-04-25T15:58:11.144 INFO:tasks.workunit.client.0.smithi087.stdout:3/541: dwrite d4/db/d28/d82/f84 [0,4194304] 0 2024-04-25T15:58:11.154 INFO:tasks.workunit.client.0.smithi087.stdout:2/555: dwrite d3/d2a/d48/f6c [0,4194304] 0 2024-04-25T15:58:11.161 INFO:tasks.workunit.client.0.smithi087.stdout:3/542: dread d4/db/f5b [0,4194304] 0 2024-04-25T15:58:11.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/665: dread d4/f16 [0,4194304] 0 2024-04-25T15:58:11.164 INFO:tasks.workunit.client.0.smithi087.stdout:3/543: getdents d4 0 2024-04-25T15:58:11.165 INFO:tasks.workunit.client.0.smithi087.stdout:4/666: fsync d4/d10/d60/d5c/d3a/d90/fbb 0 2024-04-25T15:58:11.236 INFO:tasks.workunit.client.0.smithi087.stdout:6/663: sync 2024-04-25T15:58:11.236 INFO:tasks.workunit.client.0.smithi087.stdout:5/634: sync 2024-04-25T15:58:11.241 INFO:tasks.workunit.client.0.smithi087.stdout:3/544: symlink d4/db/d28/d82/d8c/da0/da1/lae 0 2024-04-25T15:58:11.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/664: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/de0/fe8 x:0 0 0 2024-04-25T15:58:11.254 INFO:tasks.workunit.client.0.smithi087.stdout:2/556: dwrite d3/d27/d29/d2d/f7d [0,4194304] 0 2024-04-25T15:58:11.256 INFO:tasks.workunit.client.0.smithi087.stdout:5/635: write d9/d2f/d40/d4d/d58/fa8 [116579,17998] 0 2024-04-25T15:58:11.257 INFO:tasks.workunit.client.0.smithi087.stdout:2/557: chown d3/d2a/d48/d83 0 1 2024-04-25T15:58:11.267 INFO:tasks.workunit.client.0.smithi087.stdout:6/665: link f6 d7/d1a/d41/dbd/d96/fe9 0 2024-04-25T15:58:11.278 INFO:tasks.workunit.client.0.smithi087.stdout:5/636: dwrite d9/d2f/d40/d4d/d7b/d74/d83/f8c [0,4194304] 0 2024-04-25T15:58:11.281 INFO:tasks.workunit.client.0.smithi087.stdout:5/637: chown d9/d91/d30/d70/d82/l9e 75826 1 2024-04-25T15:58:11.284 INFO:tasks.workunit.client.0.smithi087.stdout:3/545: truncate d4/d17/d81/da6/f55 4073220 0 2024-04-25T15:58:11.288 INFO:tasks.workunit.client.0.smithi087.stdout:3/546: write d4/db/d28/d3c/f6a [638801,15709] 0 2024-04-25T15:58:11.288 INFO:tasks.workunit.client.0.smithi087.stdout:5/638: creat d9/d2f/d40/d4d/d7b/d8f/fcf x:0 0 0 2024-04-25T15:58:11.288 INFO:tasks.workunit.client.0.smithi087.stdout:2/558: dread d3/d27/d29/f73 [0,4194304] 0 2024-04-25T15:58:11.289 INFO:tasks.workunit.client.0.smithi087.stdout:4/667: truncate d4/d10/d60/d56/d61/d3f/d58/f5a 4390774 0 2024-04-25T15:58:11.291 INFO:tasks.workunit.client.0.smithi087.stdout:6/666: dread d7/d1a/d1d/d21/d27/d2c/d35/f83 [0,4194304] 0 2024-04-25T15:58:11.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/667: truncate d7/d71/d76/fbe 390344 0 2024-04-25T15:58:11.295 INFO:tasks.workunit.client.0.smithi087.stdout:3/547: write d4/db/d28/d3c/f9d [917729,127634] 0 2024-04-25T15:58:11.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/639: creat d9/d91/d49/d80/fd0 x:0 0 0 2024-04-25T15:58:11.298 INFO:tasks.workunit.client.0.smithi087.stdout:3/548: read d4/db/f11 [1588022,113246] 0 2024-04-25T15:58:11.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/559: dwrite d3/d27/d29/f8c [0,4194304] 0 2024-04-25T15:58:11.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/640: dwrite d9/d91/d30/f81 [0,4194304] 0 2024-04-25T15:58:11.324 INFO:tasks.workunit.client.0.smithi087.stdout:5/641: rmdir d9/d91/d30/d70/d79/dae 39 2024-04-25T15:58:11.327 INFO:tasks.workunit.client.0.smithi087.stdout:5/642: chown d9/d2f/d40/d4d/d7b/d8f 3007605 1 2024-04-25T15:58:11.328 INFO:tasks.workunit.client.0.smithi087.stdout:3/549: dread d4/db/f38 [0,4194304] 0 2024-04-25T15:58:11.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/560: dwrite d3/d27/d29/d2d/d40/f7b [0,4194304] 0 2024-04-25T15:58:11.331 INFO:tasks.workunit.client.0.smithi087.stdout:6/668: dread d7/d1a/f39 [0,4194304] 0 2024-04-25T15:58:11.332 INFO:tasks.workunit.client.0.smithi087.stdout:2/561: mkdir d3/d20/daa 0 2024-04-25T15:58:11.338 INFO:tasks.workunit.client.0.smithi087.stdout:5/643: rename d9/d2f/d40/d4d/d58/fa8 to d9/d91/d38/fd1 0 2024-04-25T15:58:11.340 INFO:tasks.workunit.client.0.smithi087.stdout:3/550: symlink d4/db/d28/d82/d8c/da9/laf 0 2024-04-25T15:58:11.341 INFO:tasks.workunit.client.0.smithi087.stdout:3/551: write d4/db/f47 [504778,122319] 0 2024-04-25T15:58:11.348 INFO:tasks.workunit.client.0.smithi087.stdout:5/644: symlink d9/d91/d30/d70/d79/d7d/ld2 0 2024-04-25T15:58:11.350 INFO:tasks.workunit.client.0.smithi087.stdout:3/552: creat d4/d17/d81/fb0 x:0 0 0 2024-04-25T15:58:11.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/562: fdatasync d3/d27/d29/d4f/d5a/d6a/f89 0 2024-04-25T15:58:11.354 INFO:tasks.workunit.client.0.smithi087.stdout:2/563: stat d3/d27/d29/d4f/ca9 0 2024-04-25T15:58:11.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/669: rename d7/d1a/d41/dbd/d96/fe9 to d7/d1a/d1d/d21/d27/d2c/db4/fea 0 2024-04-25T15:58:11.360 INFO:tasks.workunit.client.0.smithi087.stdout:5/645: dwrite d9/d2f/d40/d4d/d7b/d5c/d63/f8d [0,4194304] 0 2024-04-25T15:58:11.362 INFO:tasks.workunit.client.0.smithi087.stdout:5/646: chown d9/d2f/c42 15376983 1 2024-04-25T15:58:11.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/553: dwrite d4/db/f4d [0,4194304] 0 2024-04-25T15:58:11.365 INFO:tasks.workunit.client.0.smithi087.stdout:2/564: dread d3/d27/d29/d2d/d40/f7b [0,4194304] 0 2024-04-25T15:58:11.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/647: write d9/d2f/f76 [1526816,71670] 0 2024-04-25T15:58:11.367 INFO:tasks.workunit.client.0.smithi087.stdout:2/565: chown d3/ce 881 1 2024-04-25T15:58:11.369 INFO:tasks.workunit.client.0.smithi087.stdout:5/648: stat d9/d2f/d40/d4d/d7b 0 2024-04-25T15:58:11.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/649: stat d9/d91/d30/d70/f8e 0 2024-04-25T15:58:11.374 INFO:tasks.workunit.client.0.smithi087.stdout:5/650: mknod d9/d91/d30/cd3 0 2024-04-25T15:58:11.377 INFO:tasks.workunit.client.0.smithi087.stdout:6/670: write f6 [293054,119603] 0 2024-04-25T15:58:11.380 INFO:tasks.workunit.client.0.smithi087.stdout:2/566: rename d3/d27/d29/d2d/d40/c72 to d3/cab 0 2024-04-25T15:58:11.381 INFO:tasks.workunit.client.0.smithi087.stdout:5/651: mkdir d9/d2f/d40/d4d/d7a/dd4 0 2024-04-25T15:58:11.381 INFO:tasks.workunit.client.0.smithi087.stdout:2/567: fsync d3/d27/d29/d2d/f96 0 2024-04-25T15:58:11.383 INFO:tasks.workunit.client.0.smithi087.stdout:3/554: truncate d4/d17/d81/da6/d37/d51/f52 528306 0 2024-04-25T15:58:11.385 INFO:tasks.workunit.client.0.smithi087.stdout:3/555: write d4/db/f5b [250547,118361] 0 2024-04-25T15:58:11.390 INFO:tasks.workunit.client.0.smithi087.stdout:3/556: getdents d4/d17/d81/da6/d53 0 2024-04-25T15:58:11.390 INFO:tasks.workunit.client.0.smithi087.stdout:5/652: dwrite d9/f1f [0,4194304] 0 2024-04-25T15:58:11.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/557: chown d4/d17/d81/da6/d53/d68 0 1 2024-04-25T15:58:11.393 INFO:tasks.workunit.client.0.smithi087.stdout:3/558: write d4/db/fc [2602232,78571] 0 2024-04-25T15:58:11.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/653: rename d9/c35 to d9/d91/d30/d70/d82/cd5 0 2024-04-25T15:58:11.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/654: dread - d9/d2f/d40/fc5 zero size 2024-04-25T15:58:11.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/655: fsync d9/d91/d38/f97 0 2024-04-25T15:58:11.399 INFO:tasks.workunit.client.0.smithi087.stdout:7/418: sync 2024-04-25T15:58:11.399 INFO:tasks.workunit.client.0.smithi087.stdout:8/661: sync 2024-04-25T15:58:11.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/733: sync 2024-04-25T15:58:11.400 INFO:tasks.workunit.client.0.smithi087.stdout:5/656: write d9/d91/d30/d70/f8e [898966,42784] 0 2024-04-25T15:58:11.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/734: dread - d1/d6/fb0 zero size 2024-04-25T15:58:11.402 INFO:tasks.workunit.client.0.smithi087.stdout:7/419: readlink d1/d9/d26/l5f 0 2024-04-25T15:58:11.406 INFO:tasks.workunit.client.0.smithi087.stdout:3/559: dwrite d4/db/d28/f6e [4194304,4194304] 0 2024-04-25T15:58:11.406 INFO:tasks.workunit.client.0.smithi087.stdout:2/568: dread d3/d27/d29/f7c [0,4194304] 0 2024-04-25T15:58:11.406 INFO:tasks.workunit.client.0.smithi087.stdout:0/735: stat d1/d6/d21/d4c/d50/l53 0 2024-04-25T15:58:11.406 INFO:tasks.workunit.client.0.smithi087.stdout:8/662: link d4/d22/d43/d7f/f99 d4/d9c/db1/fd5 0 2024-04-25T15:58:11.408 INFO:tasks.workunit.client.0.smithi087.stdout:5/657: write d9/d2f/d40/d4d/d7b/d5c/d63/f66 [2056225,8784] 0 2024-04-25T15:58:11.408 INFO:tasks.workunit.client.0.smithi087.stdout:0/736: readlink d1/la1 0 2024-04-25T15:58:11.409 INFO:tasks.workunit.client.0.smithi087.stdout:8/663: write d4/d8/dd/d85/d86/f8f [1741950,113072] 0 2024-04-25T15:58:11.410 INFO:tasks.workunit.client.0.smithi087.stdout:3/560: creat d4/db/d28/d82/d8c/fb1 x:0 0 0 2024-04-25T15:58:11.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/561: write d4/d17/f74 [4536380,89457] 0 2024-04-25T15:58:11.413 INFO:tasks.workunit.client.0.smithi087.stdout:7/420: link d1/d9/d26/d45/c4e d1/d9/d26/c80 0 2024-04-25T15:58:11.417 INFO:tasks.workunit.client.0.smithi087.stdout:3/562: stat d4/db/d28/d82/d8c/da0/da1 0 2024-04-25T15:58:11.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/421: creat d1/d4/d18/d36/f81 x:0 0 0 2024-04-25T15:58:11.420 INFO:tasks.workunit.client.0.smithi087.stdout:5/658: dwrite d9/d2f/d3b/f86 [0,4194304] 0 2024-04-25T15:58:11.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/737: dwrite d1/d6/d21/d4c/d82/f8e [0,4194304] 0 2024-04-25T15:58:11.430 INFO:tasks.workunit.client.0.smithi087.stdout:2/569: dread d3/d27/f39 [0,4194304] 0 2024-04-25T15:58:11.430 INFO:tasks.workunit.client.0.smithi087.stdout:3/563: dread d4/db/d28/d82/f84 [0,4194304] 0 2024-04-25T15:58:11.431 INFO:tasks.workunit.client.0.smithi087.stdout:7/422: creat d1/d4/d18/f82 x:0 0 0 2024-04-25T15:58:11.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/564: readlink d4/d17/d81/da6/d23/l80 0 2024-04-25T15:58:11.435 INFO:tasks.workunit.client.0.smithi087.stdout:5/659: rename d9/d91/l75 to d9/d2f/d3b/ld6 0 2024-04-25T15:58:11.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/738: dwrite d1/f3d [0,4194304] 0 2024-04-25T15:58:11.436 INFO:tasks.workunit.client.0.smithi087.stdout:3/565: chown d4/d17/d81/da6/d37/d51/c70 3564959 1 2024-04-25T15:58:11.436 INFO:tasks.workunit.client.0.smithi087.stdout:7/423: unlink d1/d4/d18/d36/d37/f48 0 2024-04-25T15:58:11.437 INFO:tasks.workunit.client.0.smithi087.stdout:2/570: truncate d3/d2a/f14 468765 0 2024-04-25T15:58:11.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/566: chown d4/d17/d24/d29/d7b 0 1 2024-04-25T15:58:11.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/571: symlink d3/d2a/d48/d83/lac 0 2024-04-25T15:58:11.449 INFO:tasks.workunit.client.0.smithi087.stdout:8/664: dread d4/d1d/d3f/da6/fcc [0,4194304] 0 2024-04-25T15:58:11.449 INFO:tasks.workunit.client.0.smithi087.stdout:3/567: dwrite d4/d17/d81/da6/f3d [0,4194304] 0 2024-04-25T15:58:11.451 INFO:tasks.workunit.client.0.smithi087.stdout:2/572: write d3/d27/d29/d2d/d40/f9c [152301,82389] 0 2024-04-25T15:58:11.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/573: dread - d3/d2a/d48/d77/d79/f9a zero size 2024-04-25T15:58:11.455 INFO:tasks.workunit.client.0.smithi087.stdout:2/574: stat d3/fd 0 2024-04-25T15:58:11.458 INFO:tasks.workunit.client.0.smithi087.stdout:8/665: rename d4/d1d/d14/f92 to d4/d22/d43/d7f/dc6/fd6 0 2024-04-25T15:58:11.459 INFO:tasks.workunit.client.0.smithi087.stdout:3/568: unlink d4/db/d28/d3c/f6a 0 2024-04-25T15:58:11.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/569: stat d4/d17/d24/d29/d58/dac/f4a 0 2024-04-25T15:58:11.462 INFO:tasks.workunit.client.0.smithi087.stdout:7/424: dwrite d1/f70 [4194304,4194304] 0 2024-04-25T15:58:11.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/575: rmdir d3/d20/d4a/d47 39 2024-04-25T15:58:11.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/666: mknod d4/d1d/d7c/dae/cd7 0 2024-04-25T15:58:11.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/570: mkdir d4/db/d28/d3c/d62/db2 0 2024-04-25T15:58:11.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/667: fsync d4/d22/d43/d6d/f77 0 2024-04-25T15:58:11.469 INFO:tasks.workunit.client.0.smithi087.stdout:2/576: dread d3/d27/f39 [0,4194304] 0 2024-04-25T15:58:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:8/668: write d4/d8/dd/d85/d86/f8f [4314996,27693] 0 2024-04-25T15:58:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:9/559: sync 2024-04-25T15:58:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:1/659: sync 2024-04-25T15:58:11.474 INFO:tasks.workunit.client.0.smithi087.stdout:1/660: truncate d3/d12/d4d/f60 795334 0 2024-04-25T15:58:11.474 INFO:tasks.workunit.client.0.smithi087.stdout:9/560: dread - d6/d8/d29/d3a/d5b/d60/d81/d85/fa4 zero size 2024-04-25T15:58:11.476 INFO:tasks.workunit.client.0.smithi087.stdout:0/739: dread d1/f3c [0,4194304] 0 2024-04-25T15:58:11.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/561: write d6/d8/d29/d3a/d58/f71 [89101,41079] 0 2024-04-25T15:58:11.478 INFO:tasks.workunit.client.0.smithi087.stdout:8/669: creat d4/d8/dd/d85/dbc/fd8 x:0 0 0 2024-04-25T15:58:11.478 INFO:tasks.workunit.client.0.smithi087.stdout:5/660: dread d9/d2f/d40/d4d/d7b/f51 [0,4194304] 0 2024-04-25T15:58:11.479 INFO:tasks.workunit.client.0.smithi087.stdout:7/425: link d1/d4/c49 d1/d4/d18/d36/c83 0 2024-04-25T15:58:11.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/577: creat d3/d27/d29/d4f/d5a/d6a/d88/d94/fad x:0 0 0 2024-04-25T15:58:11.480 INFO:tasks.workunit.client.0.smithi087.stdout:0/740: fsync d1/da/d3e/d54/d34/fc2 0 2024-04-25T15:58:11.480 INFO:tasks.workunit.client.0.smithi087.stdout:7/426: chown d1/d3c/d6b 4207 1 2024-04-25T15:58:11.483 INFO:tasks.workunit.client.0.smithi087.stdout:8/670: symlink d4/d1d/d7c/dae/ld9 0 2024-04-25T15:58:11.483 INFO:tasks.workunit.client.0.smithi087.stdout:5/661: fdatasync d9/d2f/d40/d4d/d7b/f51 0 2024-04-25T15:58:11.484 INFO:tasks.workunit.client.0.smithi087.stdout:9/562: unlink d6/d8/d29/d3a/d5b/d60/l16 0 2024-04-25T15:58:11.485 INFO:tasks.workunit.client.0.smithi087.stdout:7/427: creat d1/d3c/d6b/f84 x:0 0 0 2024-04-25T15:58:11.486 INFO:tasks.workunit.client.0.smithi087.stdout:2/578: symlink d3/d2a/d48/lae 0 2024-04-25T15:58:11.486 INFO:tasks.workunit.client.0.smithi087.stdout:8/671: rmdir d4/d9c/db1 39 2024-04-25T15:58:11.487 INFO:tasks.workunit.client.0.smithi087.stdout:5/662: truncate d9/d91/d38/f97 70561 0 2024-04-25T15:58:11.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/741: symlink d1/da/d3e/db2/lf8 0 2024-04-25T15:58:11.489 INFO:tasks.workunit.client.0.smithi087.stdout:9/563: mkdir d6/d8/d32/d57/d66/da7/da8 0 2024-04-25T15:58:11.489 INFO:tasks.workunit.client.0.smithi087.stdout:7/428: chown d1/d4/l15 10088 1 2024-04-25T15:58:11.490 INFO:tasks.workunit.client.0.smithi087.stdout:3/571: dread d4/db/d28/d82/f86 [0,4194304] 0 2024-04-25T15:58:11.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/672: creat d4/d1d/d17/d72/fda x:0 0 0 2024-04-25T15:58:11.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/663: chown d9/d91/d30/d56/f98 2550057 1 2024-04-25T15:58:11.492 INFO:tasks.workunit.client.0.smithi087.stdout:0/742: chown d1/da/d3e/d85/d9b/dcd/df2 0 1 2024-04-25T15:58:11.493 INFO:tasks.workunit.client.0.smithi087.stdout:7/429: creat d1/d1a/f85 x:0 0 0 2024-04-25T15:58:11.493 INFO:tasks.workunit.client.0.smithi087.stdout:9/564: read d6/f51 [1899618,26840] 0 2024-04-25T15:58:11.493 INFO:tasks.workunit.client.0.smithi087.stdout:2/579: dread d3/d2a/f14 [0,4194304] 0 2024-04-25T15:58:11.494 INFO:tasks.workunit.client.0.smithi087.stdout:8/673: readlink d4/d1d/d17/l36 0 2024-04-25T15:58:11.495 INFO:tasks.workunit.client.0.smithi087.stdout:1/661: dwrite d3/f7 [4194304,4194304] 0 2024-04-25T15:58:11.495 INFO:tasks.workunit.client.0.smithi087.stdout:5/664: mknod d9/d91/d49/cd7 0 2024-04-25T15:58:11.496 INFO:tasks.workunit.client.0.smithi087.stdout:7/430: write d1/d1a/f39 [2756761,106415] 0 2024-04-25T15:58:11.497 INFO:tasks.workunit.client.0.smithi087.stdout:9/565: chown d6/d8/d29/l3c 0 1 2024-04-25T15:58:11.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/572: creat d4/db/d28/d82/d8c/da9/fb3 x:0 0 0 2024-04-25T15:58:11.499 INFO:tasks.workunit.client.0.smithi087.stdout:2/580: mknod d3/d27/d29/d76/caf 0 2024-04-25T15:58:11.500 INFO:tasks.workunit.client.0.smithi087.stdout:0/743: truncate d1/da/d3e/d85/fb4 332308 0 2024-04-25T15:58:11.501 INFO:tasks.workunit.client.0.smithi087.stdout:1/662: write d3/d12/d14/d29/d2f/d53/fd2 [947353,85560] 0 2024-04-25T15:58:11.501 INFO:tasks.workunit.client.0.smithi087.stdout:5/665: chown d9/d91/d30/d70/d79/d7d/ld2 170996 1 2024-04-25T15:58:11.503 INFO:tasks.workunit.client.0.smithi087.stdout:0/744: read d1/da/d3e/fa3 [244882,45062] 0 2024-04-25T15:58:11.505 INFO:tasks.workunit.client.0.smithi087.stdout:5/666: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fc4 31323 0 2024-04-25T15:58:11.505 INFO:tasks.workunit.client.0.smithi087.stdout:5/667: chown d9/d2f/d40 114 1 2024-04-25T15:58:11.507 INFO:tasks.workunit.client.0.smithi087.stdout:7/431: creat d1/d1a/d7b/f86 x:0 0 0 2024-04-25T15:58:11.510 INFO:tasks.workunit.client.0.smithi087.stdout:9/566: mkdir d6/d8/d29/da9 0 2024-04-25T15:58:11.511 INFO:tasks.workunit.client.0.smithi087.stdout:9/567: write d6/d8/f96 [1042075,1993] 0 2024-04-25T15:58:11.512 INFO:tasks.workunit.client.0.smithi087.stdout:9/568: chown d6/d8/d32/d57/d66/da7/da8 1 1 2024-04-25T15:58:11.515 INFO:tasks.workunit.client.0.smithi087.stdout:2/581: rename d3/d20/d4a/l5b to d3/d20/d4a/d8e/lb0 0 2024-04-25T15:58:11.516 INFO:tasks.workunit.client.0.smithi087.stdout:1/663: dread d3/d12/d14/f17 [0,4194304] 0 2024-04-25T15:58:11.519 INFO:tasks.workunit.client.0.smithi087.stdout:3/573: truncate d4/db/d28/d82/d8c/da0/da1/faa 33287 0 2024-04-25T15:58:11.524 INFO:tasks.workunit.client.0.smithi087.stdout:2/582: dwrite d3/d2a/d48/f65 [0,4194304] 0 2024-04-25T15:58:11.524 INFO:tasks.workunit.client.0.smithi087.stdout:9/569: creat d6/d8/d32/d4c/faa x:0 0 0 2024-04-25T15:58:11.527 INFO:tasks.workunit.client.0.smithi087.stdout:5/668: dread d9/d2f/d40/d4d/d7b/d5c/d63/f66 [0,4194304] 0 2024-04-25T15:58:11.528 INFO:tasks.workunit.client.0.smithi087.stdout:5/669: readlink d9/d2f/d40/l4e 0 2024-04-25T15:58:11.528 INFO:tasks.workunit.client.0.smithi087.stdout:1/664: symlink d3/d12/d4d/dba/ldd 0 2024-04-25T15:58:11.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/674: getdents d4/d1d/d17/d72 0 2024-04-25T15:58:11.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/675: truncate d4/d1d/d17/d37/f3b 5895929 0 2024-04-25T15:58:11.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/583: fsync d3/d27/d29/d4f/f59 0 2024-04-25T15:58:11.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/665: creat d3/dad/fde x:0 0 0 2024-04-25T15:58:11.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/584: readlink d3/d2a/d48/l6f 0 2024-04-25T15:58:11.535 INFO:tasks.workunit.client.0.smithi087.stdout:5/670: creat d9/d2f/d40/d4d/d7b/d74/d83/fd8 x:0 0 0 2024-04-25T15:58:11.539 INFO:tasks.workunit.client.0.smithi087.stdout:0/745: getdents d1/d4f/de3/df5 0 2024-04-25T15:58:11.539 INFO:tasks.workunit.client.0.smithi087.stdout:0/746: chown d1/c59 118801 1 2024-04-25T15:58:11.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/747: fdatasync d1/da/d3e/f9c 0 2024-04-25T15:58:11.541 INFO:tasks.workunit.client.0.smithi087.stdout:5/671: dwrite d9/f29 [4194304,4194304] 0 2024-04-25T15:58:11.543 INFO:tasks.workunit.client.0.smithi087.stdout:1/666: rename d3/d12/f70 to d3/d2d/d6c/fdf 0 2024-04-25T15:58:11.544 INFO:tasks.workunit.client.0.smithi087.stdout:2/585: symlink d3/d2a/d81/d93/lb1 0 2024-04-25T15:58:11.544 INFO:tasks.workunit.client.0.smithi087.stdout:2/586: readlink d3/d2a/d81/d93/l97 0 2024-04-25T15:58:11.546 INFO:tasks.workunit.client.0.smithi087.stdout:3/574: link d4/db/d28/d3c/c49 d4/d17/d24/d29/d58/cb4 0 2024-04-25T15:58:11.551 INFO:tasks.workunit.client.0.smithi087.stdout:5/672: creat d9/d91/d38/fd9 x:0 0 0 2024-04-25T15:58:11.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/570: chown d6/d8/d32/d57/d66/da7 1949656 1 2024-04-25T15:58:11.555 INFO:tasks.workunit.client.0.smithi087.stdout:1/667: fdatasync d3/d12/d14/f16 0 2024-04-25T15:58:11.556 INFO:tasks.workunit.client.0.smithi087.stdout:3/575: mknod d4/db/d28/cb5 0 2024-04-25T15:58:11.557 INFO:tasks.workunit.client.0.smithi087.stdout:3/576: read d4/db/d28/d3c/d62/f34 [1012446,117459] 0 2024-04-25T15:58:11.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/676: rename d4/d9c/db1/fd5 to d4/d1d/d3f/fdb 0 2024-04-25T15:58:11.564 INFO:tasks.workunit.client.0.smithi087.stdout:1/668: write d3/d12/d14/f4e [1680385,44198] 0 2024-04-25T15:58:11.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/673: rename d9/d2f/d3b/l92 to d9/d2f/d40/d4d/d7b/d5c/d5f/lda 0 2024-04-25T15:58:11.570 INFO:tasks.workunit.client.0.smithi087.stdout:3/577: dread d4/d17/d24/d29/d58/dac/f7e [0,4194304] 0 2024-04-25T15:58:11.572 INFO:tasks.workunit.client.1.smithi155.stdout:8/957: rename d2/d15/d18/d49/df4/d6c/c98 to d2/d15/da1/c135 0 2024-04-25T15:58:11.572 INFO:tasks.workunit.client.0.smithi087.stdout:8/677: unlink d4/d1d/d7c/f9b 0 2024-04-25T15:58:11.572 INFO:tasks.workunit.client.0.smithi087.stdout:8/678: read - d4/d1d/d3f/fac zero size 2024-04-25T15:58:11.573 INFO:tasks.workunit.client.0.smithi087.stdout:8/679: chown d4/d8/dd/l93 269093 1 2024-04-25T15:58:11.576 INFO:tasks.workunit.client.0.smithi087.stdout:2/587: write d3/d2a/f1b [4156684,26152] 0 2024-04-25T15:58:11.577 INFO:tasks.workunit.client.1.smithi155.stdout:8/958: getdents d2/d15/d18/d49/dc9 0 2024-04-25T15:58:11.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/748: link d1/da/c2d d1/cf9 0 2024-04-25T15:58:11.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/749: write d1/da/d3e/db2/fb5 [2281973,15281] 0 2024-04-25T15:58:11.581 INFO:tasks.workunit.client.0.smithi087.stdout:5/674: rmdir d9/d2f/d40/d4d/d7b 39 2024-04-25T15:58:11.582 INFO:tasks.workunit.client.1.smithi155.stdout:9/983: dwrite dc/d11/d67/fbb [0,4194304] 0 2024-04-25T15:58:11.584 INFO:tasks.workunit.client.0.smithi087.stdout:3/578: unlink d4/d17/d24/l57 0 2024-04-25T15:58:11.588 INFO:tasks.workunit.client.0.smithi087.stdout:8/680: rename d4/d22/d43/d7f/d94 to d4/d22/d43/d7f/dc6/ddc 0 2024-04-25T15:58:11.589 INFO:tasks.workunit.client.0.smithi087.stdout:1/669: symlink d3/d12/d14/d29/le0 0 2024-04-25T15:58:11.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/571: write d6/d8/d32/f59 [279099,22775] 0 2024-04-25T15:58:11.591 INFO:tasks.workunit.client.0.smithi087.stdout:0/750: unlink d1/l62 0 2024-04-25T15:58:11.591 INFO:tasks.workunit.client.0.smithi087.stdout:5/675: dwrite d9/d91/d49/d80/fd0 [0,4194304] 0 2024-04-25T15:58:11.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/751: fsync d1/da/d3e/d54/f88 0 2024-04-25T15:58:11.595 INFO:tasks.workunit.client.0.smithi087.stdout:0/752: dread - d1/d6/d21/d2a/fe7 zero size 2024-04-25T15:58:11.597 INFO:tasks.workunit.client.0.smithi087.stdout:8/681: mkdir d4/d22/d43/ddd 0 2024-04-25T15:58:11.597 INFO:tasks.workunit.client.0.smithi087.stdout:1/670: dread d3/f4 [0,4194304] 0 2024-04-25T15:58:11.597 INFO:tasks.workunit.client.0.smithi087.stdout:3/579: link d4/d17/d81/da6/d53/c6b d4/d17/d24/d29/d58/dac/d99/cb6 0 2024-04-25T15:58:11.598 INFO:tasks.workunit.client.0.smithi087.stdout:1/671: write d3/d2d/d6c/fbc [243389,17031] 0 2024-04-25T15:58:11.599 INFO:tasks.workunit.client.0.smithi087.stdout:2/588: rename d3/d2a/d48/lae to d3/d2a/lb2 0 2024-04-25T15:58:11.604 INFO:tasks.workunit.client.0.smithi087.stdout:9/572: link d6/d8/d32/f35 d6/d8/d29/d3a/d7c/fab 0 2024-04-25T15:58:11.606 INFO:tasks.workunit.client.0.smithi087.stdout:0/753: creat d1/da/d3e/d85/d9b/dcd/df2/ffa x:0 0 0 2024-04-25T15:58:11.608 INFO:tasks.workunit.client.0.smithi087.stdout:2/589: truncate d3/d27/d29/d4f/d5a/d6a/f89 518871 0 2024-04-25T15:58:11.609 INFO:tasks.workunit.client.0.smithi087.stdout:2/590: dread - d3/d2a/d48/d77/d79/f9a zero size 2024-04-25T15:58:11.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/580: symlink d4/db/lb7 0 2024-04-25T15:58:11.610 INFO:tasks.workunit.client.0.smithi087.stdout:1/672: creat d3/d12/d14/fe1 x:0 0 0 2024-04-25T15:58:11.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/591: chown d3/d27/d29/d4f/d5a/d6a/d88/d94/fad 1598 1 2024-04-25T15:58:11.612 INFO:tasks.workunit.client.0.smithi087.stdout:9/573: rename d6/d3e/l8d to d6/d8/d29/d3a/d7c/lac 0 2024-04-25T15:58:11.615 INFO:tasks.workunit.client.0.smithi087.stdout:0/754: getdents d1/d6/d21 0 2024-04-25T15:58:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:1/673: dread - d3/d12/d14/d29/f7c zero size 2024-04-25T15:58:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/592: dread d3/d27/d29/d2d/f7d [0,4194304] 0 2024-04-25T15:58:11.617 INFO:tasks.workunit.client.0.smithi087.stdout:1/674: fsync d3/d12/d14/d29/d2f/d53/fd2 0 2024-04-25T15:58:11.618 INFO:tasks.workunit.client.0.smithi087.stdout:3/581: link d4/d17/f74 d4/db/fb8 0 2024-04-25T15:58:11.620 INFO:tasks.workunit.client.0.smithi087.stdout:4/668: sync 2024-04-25T15:58:11.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/755: mkdir d1/da/d3e/d85/d9b/dfb 0 2024-04-25T15:58:11.623 INFO:tasks.workunit.client.0.smithi087.stdout:1/675: symlink d3/d12/d14/d29/d65/d97/le2 0 2024-04-25T15:58:11.627 INFO:tasks.workunit.client.0.smithi087.stdout:9/574: creat d6/d8/d29/d3a/d5b/d60/d1d/fad x:0 0 0 2024-04-25T15:58:11.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/669: chown d4/f4e 828802 1 2024-04-25T15:58:11.631 INFO:tasks.workunit.client.0.smithi087.stdout:1/676: mkdir d3/d12/d39/de3 0 2024-04-25T15:58:11.633 INFO:tasks.workunit.client.0.smithi087.stdout:3/582: unlink d4/db/d28/d5c/c96 0 2024-04-25T15:58:11.635 INFO:tasks.workunit.client.0.smithi087.stdout:9/575: creat d6/d8/d29/d3a/d5b/d60/d81/fae x:0 0 0 2024-04-25T15:58:11.636 INFO:tasks.workunit.client.0.smithi087.stdout:9/576: write d6/d8/d29/d3a/d58/f71 [904873,119540] 0 2024-04-25T15:58:11.637 INFO:tasks.workunit.client.0.smithi087.stdout:9/577: write d6/d8/d12/f2f [2412377,24254] 0 2024-04-25T15:58:11.637 INFO:tasks.workunit.client.0.smithi087.stdout:0/756: unlink d1/da/d3e/d85/d9b/dcd/df2/ffa 0 2024-04-25T15:58:11.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/593: write d3/d27/d29/d4f/d5a/d6a/f89 [1168991,1756] 0 2024-04-25T15:58:11.641 INFO:tasks.workunit.client.0.smithi087.stdout:1/677: creat d3/d12/d4d/d7d/fe4 x:0 0 0 2024-04-25T15:58:11.645 INFO:tasks.workunit.client.0.smithi087.stdout:9/578: mknod d6/d8/d32/d4c/caf 0 2024-04-25T15:58:11.646 INFO:tasks.workunit.client.0.smithi087.stdout:2/594: dread d3/d27/d29/d2d/f7d [0,4194304] 0 2024-04-25T15:58:11.646 INFO:tasks.workunit.client.0.smithi087.stdout:4/670: mknod d4/d10/d60/d56/d61/dca/cde 0 2024-04-25T15:58:11.647 INFO:tasks.workunit.client.0.smithi087.stdout:1/678: dread d3/d2d/d6c/fd4 [0,4194304] 0 2024-04-25T15:58:11.649 INFO:tasks.workunit.client.0.smithi087.stdout:1/679: chown d3/d12/d14/d29/d2f/d61/f87 7242 1 2024-04-25T15:58:11.650 INFO:tasks.workunit.client.0.smithi087.stdout:9/579: write d6/d8/d29/d3a/f74 [679935,52474] 0 2024-04-25T15:58:11.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/757: creat d1/ffc x:0 0 0 2024-04-25T15:58:11.654 INFO:tasks.workunit.client.0.smithi087.stdout:9/580: fdatasync d6/d8/d29/d3a/f74 0 2024-04-25T15:58:11.657 INFO:tasks.workunit.client.0.smithi087.stdout:3/583: dwrite d4/db/f11 [0,4194304] 0 2024-04-25T15:58:11.657 INFO:tasks.workunit.client.0.smithi087.stdout:2/595: dwrite d3/d2a/d48/f54 [0,4194304] 0 2024-04-25T15:58:11.659 INFO:tasks.workunit.client.0.smithi087.stdout:4/671: rename d4/fb to d4/d10/d60/d52/d66/fdf 0 2024-04-25T15:58:11.661 INFO:tasks.workunit.client.0.smithi087.stdout:9/581: symlink d6/d8/d32/d57/lb0 0 2024-04-25T15:58:11.663 INFO:tasks.workunit.client.0.smithi087.stdout:2/596: creat d3/d27/d38/d7e/fb3 x:0 0 0 2024-04-25T15:58:11.665 INFO:tasks.workunit.client.0.smithi087.stdout:1/680: link d3/le d3/d12/d14/d29/d67/d73/d9c/le5 0 2024-04-25T15:58:11.666 INFO:tasks.workunit.client.0.smithi087.stdout:0/758: dwrite d1/da/d3e/d85/d9b/fbf [0,4194304] 0 2024-04-25T15:58:11.671 INFO:tasks.workunit.client.0.smithi087.stdout:1/681: mknod d3/d2d/ce6 0 2024-04-25T15:58:11.673 INFO:tasks.workunit.client.0.smithi087.stdout:0/759: rename d1/da/d3e/db2/fb5 to d1/da/d3e/d54/ffd 0 2024-04-25T15:58:11.673 INFO:tasks.workunit.client.0.smithi087.stdout:1/682: chown d3/d2d/d6c/ca9 0 1 2024-04-25T15:58:11.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/760: creat d1/da/d3e/d85/d9b/ffe x:0 0 0 2024-04-25T15:58:11.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/597: dread d3/d27/d29/d2d/d40/f68 [0,4194304] 0 2024-04-25T15:58:11.678 INFO:tasks.workunit.client.0.smithi087.stdout:3/584: dwrite d4/d17/d81/da6/d37/f40 [0,4194304] 0 2024-04-25T15:58:11.679 INFO:tasks.workunit.client.0.smithi087.stdout:3/585: fdatasync d4/d17/d24/f32 0 2024-04-25T15:58:11.680 INFO:tasks.workunit.client.1.smithi155.stdout:8/959: creat d2/d15/d18/d23/d3c/dc6/f136 x:0 0 0 2024-04-25T15:58:11.681 INFO:tasks.workunit.client.1.smithi155.stdout:9/984: mknod dc/d13/d60/d7a/c13d 0 2024-04-25T15:58:11.686 INFO:tasks.workunit.client.1.smithi155.stdout:9/985: creat dc/d13/d48/f13e x:0 0 0 2024-04-25T15:58:11.688 INFO:tasks.workunit.client.0.smithi087.stdout:4/672: dread d4/d10/d60/d56/d61/d3f/d58/f5a [0,4194304] 0 2024-04-25T15:58:11.688 INFO:tasks.workunit.client.0.smithi087.stdout:9/582: truncate d6/d8/d12/f2f 3700417 0 2024-04-25T15:58:11.688 INFO:tasks.workunit.client.0.smithi087.stdout:1/683: dwrite d3/d12/d14/d29/d2f/d53/fb0 [0,4194304] 0 2024-04-25T15:58:11.688 INFO:tasks.workunit.client.0.smithi087.stdout:0/761: getdents d1/d27 0 2024-04-25T15:58:11.691 INFO:tasks.workunit.client.0.smithi087.stdout:2/598: write d3/f1e [2904700,96547] 0 2024-04-25T15:58:11.692 INFO:tasks.workunit.client.1.smithi155.stdout:9/986: truncate dc/d17/d2a/f8b 8022774 0 2024-04-25T15:58:11.694 INFO:tasks.workunit.client.0.smithi087.stdout:9/583: creat d6/d8/d32/d4c/fb1 x:0 0 0 2024-04-25T15:58:11.694 INFO:tasks.workunit.client.0.smithi087.stdout:1/684: creat d3/d12/d14/d29/d65/fe7 x:0 0 0 2024-04-25T15:58:11.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/673: mknod d4/d10/d60/d56/d61/d3f/d8a/ce0 0 2024-04-25T15:58:11.696 INFO:tasks.workunit.client.0.smithi087.stdout:3/586: dwrite d4/d17/d24/d29/d58/dac/d9c/fab [0,4194304] 0 2024-04-25T15:58:11.697 INFO:tasks.workunit.client.1.smithi155.stdout:8/960: dread d2/d15/d18/d34/d48/f50 [0,4194304] 0 2024-04-25T15:58:11.698 INFO:tasks.workunit.client.0.smithi087.stdout:3/587: fdatasync d4/d17/d24/d29/d58/f95 0 2024-04-25T15:58:11.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/762: rename d1/d6/d21/d4c to d1/d6/db1/dc0/dd3/dff 0 2024-04-25T15:58:11.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/599: fsync d3/d2a/d48/d77/d79/f9a 0 2024-04-25T15:58:11.703 INFO:tasks.workunit.client.0.smithi087.stdout:1/685: mknod d3/d12/d14/d29/d2f/d53/ce8 0 2024-04-25T15:58:11.703 INFO:tasks.workunit.client.1.smithi155.stdout:9/987: dread dc/d17/d8e/f114 [0,4194304] 0 2024-04-25T15:58:11.706 INFO:tasks.workunit.client.0.smithi087.stdout:3/588: creat d4/d17/d81/da6/d53/fb9 x:0 0 0 2024-04-25T15:58:11.707 INFO:tasks.workunit.client.0.smithi087.stdout:0/763: mkdir d1/d6/d77/d100 0 2024-04-25T15:58:11.707 INFO:tasks.workunit.client.1.smithi155.stdout:9/988: dread - dc/d13/de5/f118 zero size 2024-04-25T15:58:11.708 INFO:tasks.workunit.client.0.smithi087.stdout:9/584: dwrite d6/d8/d29/d3a/d5b/d60/f95 [0,4194304] 0 2024-04-25T15:58:11.712 INFO:tasks.workunit.client.1.smithi155.stdout:9/989: chown dc/d13/d2e/f11e 4 1 2024-04-25T15:58:11.716 INFO:tasks.workunit.client.1.smithi155.stdout:8/961: mknod d2/d15/d18/d49/dc9/c137 0 2024-04-25T15:58:11.719 INFO:tasks.workunit.client.0.smithi087.stdout:3/589: rename d4/d17/l1d to d4/d17/d24/lba 0 2024-04-25T15:58:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:0/764: symlink d1/da/d3e/d85/d9b/l101 0 2024-04-25T15:58:11.721 INFO:tasks.workunit.client.1.smithi155.stdout:8/962: truncate d2/d15/d18/d23/d3c/fb5 4952159 0 2024-04-25T15:58:11.725 INFO:tasks.workunit.client.0.smithi087.stdout:1/686: unlink d3/d12/d14/d33/d95/fda 0 2024-04-25T15:58:11.726 INFO:tasks.workunit.client.0.smithi087.stdout:3/590: dwrite d4/d17/d81/da6/f3d [0,4194304] 0 2024-04-25T15:58:11.727 INFO:tasks.workunit.client.0.smithi087.stdout:3/591: fdatasync d4/db/fe 0 2024-04-25T15:58:11.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/765: mkdir d1/d4f/d102 0 2024-04-25T15:58:11.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/592: dread - d4/db/d28/d82/d8c/fb1 zero size 2024-04-25T15:58:11.728 INFO:tasks.workunit.client.0.smithi087.stdout:9/585: symlink d6/d8/d29/d3a/d5b/d60/d1d/lb2 0 2024-04-25T15:58:11.729 INFO:tasks.workunit.client.0.smithi087.stdout:2/600: getdents d3/d20/d4a/d47 0 2024-04-25T15:58:11.731 INFO:tasks.workunit.client.0.smithi087.stdout:4/674: link d4/d10/d60/d52/d66/f2c d4/d10/d60/d52/d66/d15/fe1 0 2024-04-25T15:58:11.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/601: write d3/d27/d38/f74 [590234,91619] 0 2024-04-25T15:58:11.732 INFO:tasks.workunit.client.1.smithi155.stdout:8/963: dwrite d2/d15/d18/d23/d3c/dc6/f136 [0,4194304] 0 2024-04-25T15:58:11.732 INFO:tasks.workunit.client.0.smithi087.stdout:3/593: truncate d4/d17/d24/d29/d58/dac/f76 799684 0 2024-04-25T15:58:11.734 INFO:tasks.workunit.client.0.smithi087.stdout:3/594: stat d4/db/d28/d3c/d62/d94 0 2024-04-25T15:58:11.735 INFO:tasks.workunit.client.0.smithi087.stdout:1/687: chown d3/d12/d14/f17 150617656 1 2024-04-25T15:58:11.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/586: rmdir d6/d8/d29/d3a/d5b 39 2024-04-25T15:58:11.738 INFO:tasks.workunit.client.1.smithi155.stdout:9/990: dread dc/d17/d2a/fdc [0,4194304] 0 2024-04-25T15:58:11.738 INFO:tasks.workunit.client.1.smithi155.stdout:8/964: getdents d2/d15/d35 0 2024-04-25T15:58:11.743 INFO:tasks.workunit.client.1.smithi155.stdout:8/965: truncate d2/d15/d18/d49/df4/f6b 794284 0 2024-04-25T15:58:11.743 INFO:tasks.workunit.client.0.smithi087.stdout:3/595: symlink d4/db/d28/d82/lbb 0 2024-04-25T15:58:11.744 INFO:tasks.workunit.client.0.smithi087.stdout:6/671: sync 2024-04-25T15:58:11.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/688: write d3/d12/d14/d29/d3b/f98 [594768,68036] 0 2024-04-25T15:58:11.746 INFO:tasks.workunit.client.0.smithi087.stdout:0/766: rename d1/d4f/de3/df5/cd9 to d1/d6/db1/dc0/c103 0 2024-04-25T15:58:11.747 INFO:tasks.workunit.client.1.smithi155.stdout:8/966: symlink d2/d15/d18/d23/d2d/l138 0 2024-04-25T15:58:11.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/675: mkdir d4/d10/d60/d56/d61/d3f/d42/d97/de2 0 2024-04-25T15:58:11.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/676: chown d4/d10/d60/d52/f92 48990 1 2024-04-25T15:58:11.748 INFO:tasks.workunit.client.0.smithi087.stdout:2/602: mkdir d3/d27/d29/d2d/d40/d95/db4 0 2024-04-25T15:58:11.749 INFO:tasks.workunit.client.0.smithi087.stdout:4/677: read - d4/d10/d60/d56/fce zero size 2024-04-25T15:58:11.750 INFO:tasks.workunit.client.0.smithi087.stdout:4/678: readlink d4/d10/d60/d52/d66/la 0 2024-04-25T15:58:11.751 INFO:tasks.workunit.client.0.smithi087.stdout:6/672: symlink d7/d1a/d1d/d8a/leb 0 2024-04-25T15:58:11.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/767: unlink d1/da/d3e/d54/d34/f43 0 2024-04-25T15:58:11.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/596: getdents d4/db/d28/d3c/d62/d94 0 2024-04-25T15:58:11.754 INFO:tasks.workunit.client.1.smithi155.stdout:9/991: dread dc/d11/f42 [0,4194304] 0 2024-04-25T15:58:11.755 INFO:tasks.workunit.client.0.smithi087.stdout:2/603: creat d3/d27/d38/d7e/fb5 x:0 0 0 2024-04-25T15:58:11.756 INFO:tasks.workunit.client.0.smithi087.stdout:2/604: write d3/d2a/d48/f65 [4243806,74804] 0 2024-04-25T15:58:11.759 INFO:tasks.workunit.client.1.smithi155.stdout:8/967: mkdir d2/d15/d18/d34/d48/d4e/d81/dcc/d139 0 2024-04-25T15:58:11.760 INFO:tasks.workunit.client.0.smithi087.stdout:6/673: rename d7/d1a/d1d/d21/d27/d2c/d35/d45/de0 to d7/d71/d59/dc7/dec 0 2024-04-25T15:58:11.761 INFO:tasks.workunit.client.1.smithi155.stdout:9/992: unlink dc/d17/d2a/l6e 0 2024-04-25T15:58:11.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/605: mkdir d3/d2a/d48/d77/db6 0 2024-04-25T15:58:11.767 INFO:tasks.workunit.client.1.smithi155.stdout:9/993: chown dc/d11/d30/d46/da0/fcf 545 1 2024-04-25T15:58:11.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/606: truncate d3/d27/d29/d4f/d5a/d6a/d88/d94/fad 161487 0 2024-04-25T15:58:11.767 INFO:tasks.workunit.client.0.smithi087.stdout:6/674: symlink d7/d1a/d41/dbd/led 0 2024-04-25T15:58:11.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/689: write d3/d2d/f38 [1652669,79646] 0 2024-04-25T15:58:11.769 INFO:tasks.workunit.client.0.smithi087.stdout:3/597: fdatasync d4/d17/f63 0 2024-04-25T15:58:11.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/690: stat d3/d12/d4d/d7d 0 2024-04-25T15:58:11.772 INFO:tasks.workunit.client.0.smithi087.stdout:4/679: getdents d4/d10/d60/d56/d61/db7 0 2024-04-25T15:58:11.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/587: dwrite d6/d8/d32/f4d [0,4194304] 0 2024-04-25T15:58:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/680: stat d4/d10/d60/d5c/f54 0 2024-04-25T15:58:11.775 INFO:tasks.workunit.client.0.smithi087.stdout:3/598: creat d4/db/d28/d3c/fbc x:0 0 0 2024-04-25T15:58:11.777 INFO:tasks.workunit.client.0.smithi087.stdout:2/607: rename d3/d27/d29/d2d/d40/d95/db4 to d3/d2a/d48/d77/db7 0 2024-04-25T15:58:11.779 INFO:tasks.workunit.client.0.smithi087.stdout:1/691: symlink d3/d12/d14/d29/d67/d73/d9c/dd0/le9 0 2024-04-25T15:58:11.781 INFO:tasks.workunit.client.1.smithi155.stdout:8/968: dread d2/d15/d18/d34/d48/f8b [4194304,4194304] 0 2024-04-25T15:58:11.781 INFO:tasks.workunit.client.1.smithi155.stdout:9/994: dwrite dc/d11/d5a/f78 [0,4194304] 0 2024-04-25T15:58:11.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/681: creat d4/d10/d60/d5c/d3a/d90/fe3 x:0 0 0 2024-04-25T15:58:11.784 INFO:tasks.workunit.client.0.smithi087.stdout:9/588: read d6/f2b [1463924,53399] 0 2024-04-25T15:58:11.784 INFO:tasks.workunit.client.0.smithi087.stdout:4/682: fdatasync d4/d10/f3c 0 2024-04-25T15:58:11.785 INFO:tasks.workunit.client.0.smithi087.stdout:6/675: getdents d7/d1a/d1d/d8a 0 2024-04-25T15:58:11.787 INFO:tasks.workunit.client.0.smithi087.stdout:2/608: rename d3/d2a/c22 to d3/d2a/d81/d93/cb8 0 2024-04-25T15:58:11.789 INFO:tasks.workunit.client.0.smithi087.stdout:6/676: symlink d7/d71/d59/d90/da5/lee 0 2024-04-25T15:58:11.789 INFO:tasks.workunit.client.1.smithi155.stdout:9/995: truncate dc/d11/f119 164483 0 2024-04-25T15:58:11.790 INFO:tasks.workunit.client.0.smithi087.stdout:3/599: getdents d4/db/d28/d82 0 2024-04-25T15:58:11.790 INFO:tasks.workunit.client.0.smithi087.stdout:4/683: dread d4/d10/d60/d56/d61/d3f/d42/d97/f30 [0,4194304] 0 2024-04-25T15:58:11.791 INFO:tasks.workunit.client.1.smithi155.stdout:8/969: creat d2/d15/d18/d34/d48/d4e/d11b/f13a x:0 0 0 2024-04-25T15:58:11.792 INFO:tasks.workunit.client.0.smithi087.stdout:1/692: link d3/d12/d14/f4e d3/d12/d14/d29/d2f/fea 0 2024-04-25T15:58:11.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/677: write d7/d1a/d1d/fb3 [379949,22785] 0 2024-04-25T15:58:11.794 INFO:tasks.workunit.client.0.smithi087.stdout:6/678: chown d7/d1a/d1d/d21/dba/cc1 15 1 2024-04-25T15:58:11.794 INFO:tasks.workunit.client.0.smithi087.stdout:4/684: fdatasync d4/d10/f9e 0 2024-04-25T15:58:11.795 INFO:tasks.workunit.client.0.smithi087.stdout:6/679: write d7/fe7 [216722,109244] 0 2024-04-25T15:58:11.796 INFO:tasks.workunit.client.0.smithi087.stdout:3/600: creat d4/db/d28/d82/d8c/da9/fbd x:0 0 0 2024-04-25T15:58:11.796 INFO:tasks.workunit.client.0.smithi087.stdout:2/609: write d3/d27/d29/d4f/f70 [118766,114655] 0 2024-04-25T15:58:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:1/693: creat d3/d12/d14/d33/feb x:0 0 0 2024-04-25T15:58:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:4/685: symlink d4/d10/d60/d5c/d8d/le4 0 2024-04-25T15:58:11.799 INFO:tasks.workunit.client.0.smithi087.stdout:2/610: truncate d3/d27/d29/f7c 2107904 0 2024-04-25T15:58:11.799 INFO:tasks.workunit.client.0.smithi087.stdout:3/601: symlink d4/db/d28/d82/d8c/da0/lbe 0 2024-04-25T15:58:11.800 INFO:tasks.workunit.client.0.smithi087.stdout:6/680: symlink d7/d71/d59/dc7/dec/dde/lef 0 2024-04-25T15:58:11.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/686: write d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/fa2 [242161,29281] 0 2024-04-25T15:58:11.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/694: creat d3/d12/d14/d29/d2f/d61/fec x:0 0 0 2024-04-25T15:58:11.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/695: chown d3/d12/d14/f4e 716738872 1 2024-04-25T15:58:11.803 INFO:tasks.workunit.client.0.smithi087.stdout:4/687: chown d4/d10/d60/d5c/d8d/fc2 2 1 2024-04-25T15:58:11.804 INFO:tasks.workunit.client.1.smithi155.stdout:8/970: link d2/d15/d18/d23/d3c/de0/ff0 d2/d15/da1/dde/d40/d5b/d10d/d119/f13b 0 2024-04-25T15:58:11.806 INFO:tasks.workunit.client.1.smithi155.stdout:8/971: symlink d2/d15/da1/dde/l13c 0 2024-04-25T15:58:11.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/688: mkdir d4/d10/d60/d5c/de5 0 2024-04-25T15:58:11.809 INFO:tasks.workunit.client.1.smithi155.stdout:8/972: symlink d2/d15/da1/dde/d40/d5b/l13d 0 2024-04-25T15:58:11.809 INFO:tasks.workunit.client.0.smithi087.stdout:1/696: rename d3/d12/d4d/c85 to d3/dad/ced 0 2024-04-25T15:58:11.811 INFO:tasks.workunit.client.1.smithi155.stdout:9/996: write dc/d13/d2e/f4a [3040843,8834] 0 2024-04-25T15:58:11.814 INFO:tasks.workunit.client.0.smithi087.stdout:4/689: getdents d4/d10/d60/d56/d61/d3f/d58/d5e/d7e 0 2024-04-25T15:58:11.815 INFO:tasks.workunit.client.1.smithi155.stdout:8/973: dread - d2/d15/d63/dc0/fd6 zero size 2024-04-25T15:58:11.815 INFO:tasks.workunit.client.0.smithi087.stdout:1/697: truncate d3/d12/d4d/d7d/f8c 4533054 0 2024-04-25T15:58:11.819 INFO:tasks.workunit.client.0.smithi087.stdout:9/589: truncate d6/d8/d32/f59 51495 0 2024-04-25T15:58:11.819 INFO:tasks.workunit.client.1.smithi155.stdout:8/974: getdents d2/d15/d18/d34/d48/d4e/d81/dcc/d139 0 2024-04-25T15:58:11.820 INFO:tasks.workunit.client.1.smithi155.stdout:9/997: write dc/d17/d2a/ff1 [2705291,78479] 0 2024-04-25T15:58:11.821 INFO:tasks.workunit.client.1.smithi155.stdout:8/975: fdatasync d2/d15/d18/d34/d48/f8b 0 2024-04-25T15:58:11.822 INFO:tasks.workunit.client.0.smithi087.stdout:6/681: dread d7/d71/f31 [0,4194304] 0 2024-04-25T15:58:11.824 INFO:tasks.workunit.client.0.smithi087.stdout:9/590: dread - d6/d8/d29/d3a/d5b/d60/d81/d85/fa4 zero size 2024-04-25T15:58:11.824 INFO:tasks.workunit.client.0.smithi087.stdout:2/611: write d3/d27/d29/d4f/f84 [895824,65936] 0 2024-04-25T15:58:11.825 INFO:tasks.workunit.client.0.smithi087.stdout:4/690: dwrite d4/d10/d60/d52/d66/fad [0,4194304] 0 2024-04-25T15:58:11.826 INFO:tasks.workunit.client.0.smithi087.stdout:3/602: truncate d4/d17/d81/da6/d37/f40 3444686 0 2024-04-25T15:58:11.826 INFO:tasks.workunit.client.1.smithi155.stdout:8/976: read d2/d15/d18/d23/d3c/fa9 [712173,5426] 0 2024-04-25T15:58:11.830 INFO:tasks.workunit.client.1.smithi155.stdout:8/977: creat d2/f13e x:0 0 0 2024-04-25T15:58:11.831 INFO:tasks.workunit.client.1.smithi155.stdout:9/998: write dc/d11/d67/fc8 [4374000,40226] 0 2024-04-25T15:58:11.832 INFO:tasks.workunit.client.0.smithi087.stdout:3/603: dread d4/db/d28/d82/d8c/da0/da1/faa [0,4194304] 0 2024-04-25T15:58:11.836 INFO:tasks.workunit.client.0.smithi087.stdout:1/698: dread d3/d12/d14/d29/d2f/f5d [0,4194304] 0 2024-04-25T15:58:11.837 INFO:tasks.workunit.client.0.smithi087.stdout:1/699: chown d3/d2d 1923440 1 2024-04-25T15:58:11.837 INFO:tasks.workunit.client.1.smithi155.stdout:8/978: read d2/d15/d18/d34/d48/d4e/d81/dcc/f12a [2701822,95156] 0 2024-04-25T15:58:11.838 INFO:tasks.workunit.client.0.smithi087.stdout:9/591: write d6/f2b [232147,29042] 0 2024-04-25T15:58:11.839 INFO:tasks.workunit.client.0.smithi087.stdout:6/682: getdents d7/d71/d59/d90/da5 0 2024-04-25T15:58:11.840 INFO:tasks.workunit.client.0.smithi087.stdout:6/683: stat d7/d1a/d41 0 2024-04-25T15:58:11.840 INFO:tasks.workunit.client.0.smithi087.stdout:1/700: mkdir d3/d12/d14/d33/dee 0 2024-04-25T15:58:11.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/592: creat d6/d8/d29/d3a/d5b/d60/d81/fb3 x:0 0 0 2024-04-25T15:58:11.842 INFO:tasks.workunit.client.1.smithi155.stdout:8/979: creat d2/d15/da1/dde/d40/d5b/d10d/d119/f13f x:0 0 0 2024-04-25T15:58:11.843 INFO:tasks.workunit.client.0.smithi087.stdout:6/684: mkdir d7/d1a/d41/dbd/df0 0 2024-04-25T15:58:11.845 INFO:tasks.workunit.client.0.smithi087.stdout:1/701: creat d3/d12/d39/d64/dc0/fef x:0 0 0 2024-04-25T15:58:11.846 INFO:tasks.workunit.client.0.smithi087.stdout:9/593: unlink d6/d8/d32/d4c/faa 0 2024-04-25T15:58:11.847 INFO:tasks.workunit.client.0.smithi087.stdout:3/604: link d4/l1f d4/d17/d81/da6/d9b/lbf 0 2024-04-25T15:58:11.847 INFO:tasks.workunit.client.1.smithi155.stdout:9/999: write dc/d17/d8e/dae/fb0 [817593,117767] 0 2024-04-25T15:58:11.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/702: dread d3/f8 [0,4194304] 0 2024-04-25T15:58:11.848 INFO:tasks.workunit.client.0.smithi087.stdout:2/612: truncate d3/d20/f7f 754437 0 2024-04-25T15:58:11.849 INFO:tasks.workunit.client.1.smithi155.stdout:8/980: getdents d2/d15/d18/d23/d3c/d76/d7e 0 2024-04-25T15:58:11.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/594: fsync d6/d8/d29/d3a/d5b/f8f 0 2024-04-25T15:58:11.854 INFO:tasks.workunit.client.0.smithi087.stdout:1/703: write d3/f1b [2956714,8416] 0 2024-04-25T15:58:11.855 INFO:tasks.workunit.client.0.smithi087.stdout:2/613: creat d3/d27/d29/d4f/d5a/d6a/fb9 x:0 0 0 2024-04-25T15:58:11.855 INFO:tasks.workunit.client.0.smithi087.stdout:6/685: dwrite d7/d1a/d1d/d8a/fe1 [0,4194304] 0 2024-04-25T15:58:11.856 INFO:tasks.workunit.client.0.smithi087.stdout:9/595: write d6/d8/d29/d3a/d5b/d60/d1d/f39 [2464714,77002] 0 2024-04-25T15:58:11.859 INFO:tasks.workunit.client.0.smithi087.stdout:9/596: chown d6/d8/d29/d3a/d58/d72/f87 1396 1 2024-04-25T15:58:11.861 INFO:tasks.workunit.client.0.smithi087.stdout:1/704: dwrite d3/d12/fb5 [0,4194304] 0 2024-04-25T15:58:11.863 INFO:tasks.workunit.client.0.smithi087.stdout:9/597: read d6/d8/d29/d3a/d58/d72/f7d [3676809,22952] 0 2024-04-25T15:58:11.864 INFO:tasks.workunit.client.1.smithi155.stdout:8/981: dwrite d2/d15/da1/dde/fea [0,4194304] 0 2024-04-25T15:58:11.865 INFO:tasks.workunit.client.0.smithi087.stdout:6/686: dread d7/d1a/d1d/d21/d27/f73 [0,4194304] 0 2024-04-25T15:58:11.875 INFO:tasks.workunit.client.0.smithi087.stdout:6/687: getdents d7/d1a/d41/dbd/db9/dc2 0 2024-04-25T15:58:11.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/598: dread f2 [0,4194304] 0 2024-04-25T15:58:11.877 INFO:tasks.workunit.client.0.smithi087.stdout:6/688: write d7/d71/d59/d90/f95 [691637,7293] 0 2024-04-25T15:58:11.879 INFO:tasks.workunit.client.0.smithi087.stdout:6/689: rmdir d7/d1a/d1d/d8a 39 2024-04-25T15:58:11.881 INFO:tasks.workunit.client.0.smithi087.stdout:7/432: sync 2024-04-25T15:58:11.881 INFO:tasks.workunit.client.0.smithi087.stdout:1/705: write d3/d12/d14/d29/d2f/d61/fa1 [1194350,50143] 0 2024-04-25T15:58:11.882 INFO:tasks.workunit.client.0.smithi087.stdout:6/690: truncate d7/d71/f31 927141 0 2024-04-25T15:58:11.883 INFO:tasks.workunit.client.0.smithi087.stdout:3/605: dwrite d4/d17/d81/da6/f55 [4194304,4194304] 0 2024-04-25T15:58:11.886 INFO:tasks.workunit.client.0.smithi087.stdout:6/691: mknod d7/d71/d59/dc7/dec/cf1 0 2024-04-25T15:58:11.887 INFO:tasks.workunit.client.1.smithi155.stdout:8/982: dwrite d2/d15/d18/d49/f9e [0,4194304] 0 2024-04-25T15:58:11.889 INFO:tasks.workunit.client.0.smithi087.stdout:6/692: dread - d7/d71/d59/dc7/dec/fe8 zero size 2024-04-25T15:58:11.891 INFO:tasks.workunit.client.0.smithi087.stdout:3/606: rename d4/db/d28 to d4/d17/d24/d29/d58/dac/dc0 0 2024-04-25T15:58:11.895 INFO:tasks.workunit.client.0.smithi087.stdout:1/706: link d3/d12/d14/d29/d65/d97/cae d3/d12/d39/d64/dc0/cf0 0 2024-04-25T15:58:11.897 INFO:tasks.workunit.client.0.smithi087.stdout:3/607: chown d4/d17/d81/da6/d53/d7d/c7f 10354 1 2024-04-25T15:58:11.899 INFO:tasks.workunit.client.0.smithi087.stdout:1/707: mkdir d3/d12/d14/d29/d2f/d53/dca/df1 0 2024-04-25T15:58:11.900 INFO:tasks.workunit.client.0.smithi087.stdout:1/708: stat d3/d12/d14/d29/d8e/f9d 0 2024-04-25T15:58:11.901 INFO:tasks.workunit.client.0.smithi087.stdout:9/599: dread d6/d8/d29/d3a/d7c/fab [0,4194304] 0 2024-04-25T15:58:11.902 INFO:tasks.workunit.client.0.smithi087.stdout:7/433: dread d1/fd [4194304,4194304] 0 2024-04-25T15:58:11.903 INFO:tasks.workunit.client.0.smithi087.stdout:1/709: dread d3/d12/d14/d29/d2f/f5d [4194304,4194304] 0 2024-04-25T15:58:11.904 INFO:tasks.workunit.client.0.smithi087.stdout:1/710: write d3/d12/d39/d64/dc0/fdb [115894,86303] 0 2024-04-25T15:58:11.908 INFO:tasks.workunit.client.1.smithi155.stdout:8/983: dread d2/fa [0,4194304] 0 2024-04-25T15:58:11.909 INFO:tasks.workunit.client.0.smithi087.stdout:3/608: link d4/d17/d81/da6/d37/d51/f52 d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/fc1 0 2024-04-25T15:58:11.912 INFO:tasks.workunit.client.1.smithi155.stdout:8/984: truncate d2/d15/d18/d49/dc9/f114 2378586 0 2024-04-25T15:58:11.912 INFO:tasks.workunit.client.0.smithi087.stdout:1/711: creat d3/d12/d14/d29/d67/d73/d9c/ff2 x:0 0 0 2024-04-25T15:58:11.914 INFO:tasks.workunit.client.0.smithi087.stdout:7/434: dwrite d1/d1a/f6f [0,4194304] 0 2024-04-25T15:58:11.914 INFO:tasks.workunit.client.0.smithi087.stdout:1/712: dread - d3/d12/d14/d33/d95/fac zero size 2024-04-25T15:58:11.917 INFO:tasks.workunit.client.0.smithi087.stdout:1/713: creat d3/d12/d4d/d7d/ff3 x:0 0 0 2024-04-25T15:58:11.917 INFO:tasks.workunit.client.0.smithi087.stdout:3/609: link d4/d17/d24/l66 d4/d17/d24/d29/d58/dac/dc0/d3c/d62/lc2 0 2024-04-25T15:58:11.923 INFO:tasks.workunit.client.0.smithi087.stdout:9/600: dwrite d6/d8/d12/f43 [0,4194304] 0 2024-04-25T15:58:11.923 INFO:tasks.workunit.client.0.smithi087.stdout:1/714: link d3/d12/d14/d29/d3b/f62 d3/d12/d14/d29/d65/ff4 0 2024-04-25T15:58:11.925 INFO:tasks.workunit.client.0.smithi087.stdout:1/715: fsync d3/d12/d39/d64/dc0/fdb 0 2024-04-25T15:58:11.925 INFO:tasks.workunit.client.0.smithi087.stdout:1/716: readlink d3/d12/d4d/dba/lc3 0 2024-04-25T15:58:11.927 INFO:tasks.workunit.client.1.smithi155.stdout:8/985: dwrite d2/d15/d18/d34/f9f [0,4194304] 0 2024-04-25T15:58:11.927 INFO:tasks.workunit.client.0.smithi087.stdout:9/601: read d6/d8/d29/d3a/d5b/d60/f86 [2014620,99579] 0 2024-04-25T15:58:11.930 INFO:tasks.workunit.client.0.smithi087.stdout:9/602: dread - d6/fa0 zero size 2024-04-25T15:58:11.936 INFO:tasks.workunit.client.1.smithi155.stdout:8/986: rename d2/d15/d18/d23/dfa to d2/d15/d18/d23/d3c/d76/d7e/ddb/d140 0 2024-04-25T15:58:11.939 INFO:tasks.workunit.client.0.smithi087.stdout:9/603: link d6/d8/d29/d3a/d5b/d60/d1d/c9e d6/d8/d29/d3a/d58/d7b/cb4 0 2024-04-25T15:58:11.940 INFO:tasks.workunit.client.0.smithi087.stdout:9/604: creat d6/d8/d48/fb5 x:0 0 0 2024-04-25T15:58:11.941 INFO:tasks.workunit.client.1.smithi155.stdout:8/987: link d2/d15/d18/l133 d2/d15/d18/d49/df4/d6c/d11c/l141 0 2024-04-25T15:58:11.944 INFO:tasks.workunit.client.1.smithi155.stdout:8/988: mkdir d2/d15/d18/d49/d142 0 2024-04-25T15:58:11.944 INFO:tasks.workunit.client.0.smithi087.stdout:9/605: dread d6/d8/f96 [0,4194304] 0 2024-04-25T15:58:11.944 INFO:tasks.workunit.client.0.smithi087.stdout:9/606: chown d6/d8/d29 47394625 1 2024-04-25T15:58:11.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/607: stat d6/d8/d29/d3a/d5b/d60/d81 0 2024-04-25T15:58:11.946 INFO:tasks.workunit.client.1.smithi155.stdout:8/989: symlink d2/d15/d18/d49/l143 0 2024-04-25T15:58:11.947 INFO:tasks.workunit.client.0.smithi087.stdout:9/608: write d6/d3e/d63/f79 [1358895,53945] 0 2024-04-25T15:58:11.947 INFO:tasks.workunit.client.1.smithi155.stdout:8/990: rmdir d2/d15/d18/d23/d3c/dc6 39 2024-04-25T15:58:11.950 INFO:tasks.workunit.client.0.smithi087.stdout:9/609: link d6/d3e/d92/l5f d6/d8/d29/d3a/d58/lb6 0 2024-04-25T15:58:11.951 INFO:tasks.workunit.client.1.smithi155.stdout:8/991: read d2/d15/da1/dde/d40/d5b/d10d/d119/f13b [425244,71533] 0 2024-04-25T15:58:11.951 INFO:tasks.workunit.client.0.smithi087.stdout:9/610: chown d6/d8/d29/d3a/d58/d72/f87 499 1 2024-04-25T15:58:11.952 INFO:tasks.workunit.client.1.smithi155.stdout:8/992: dread d2/d15/d18/d23/d3c/de0/ff0 [0,4194304] 0 2024-04-25T15:58:11.953 INFO:tasks.workunit.client.0.smithi087.stdout:1/717: dread d3/d12/d14/d29/d8e/fc9 [0,4194304] 0 2024-04-25T15:58:11.955 INFO:tasks.workunit.client.0.smithi087.stdout:1/718: fsync d3/d12/d14/d29/d67/d73/d9c/faf 0 2024-04-25T15:58:11.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/719: chown d3/d12/d4d/da5/fdc 363 1 2024-04-25T15:58:11.958 INFO:tasks.workunit.client.1.smithi155.stdout:8/993: truncate d2/d15/da1/dde/d40/d5b/df8/d122/f124 494947 0 2024-04-25T15:58:11.960 INFO:tasks.workunit.client.0.smithi087.stdout:9/611: dwrite d6/d8/d32/f35 [0,4194304] 0 2024-04-25T15:58:11.960 INFO:tasks.workunit.client.0.smithi087.stdout:1/720: mknod d3/d12/d14/d29/d2f/d53/dca/df1/cf5 0 2024-04-25T15:58:11.962 INFO:tasks.workunit.client.1.smithi155.stdout:8/994: mkdir d2/d15/d63/dd7/d144 0 2024-04-25T15:58:11.962 INFO:tasks.workunit.client.1.smithi155.stdout:8/995: stat d2/d15/da1/dde/d40/d5b/d10d 0 2024-04-25T15:58:11.963 INFO:tasks.workunit.client.0.smithi087.stdout:1/721: unlink d3/d12/d14/d29/c52 0 2024-04-25T15:58:11.965 INFO:tasks.workunit.client.1.smithi155.stdout:8/996: creat d2/d15/d18/d23/d3c/f145 x:0 0 0 2024-04-25T15:58:11.966 INFO:tasks.workunit.client.1.smithi155.stdout:8/997: stat d2/d15/d18/d49/df4/f42 0 2024-04-25T15:58:11.975 INFO:tasks.workunit.client.0.smithi087.stdout:1/722: truncate d3/d12/d14/d29/d2f/d61/f87 1792990 0 2024-04-25T15:58:11.978 INFO:tasks.workunit.client.1.smithi155.stdout:8/998: write d2/d15/d18/fb7 [3707093,2286] 0 2024-04-25T15:58:11.981 INFO:tasks.workunit.client.1.smithi155.stdout:8/999: truncate d2/d15/fcd 4694554 0 2024-04-25T15:58:11.983 INFO:tasks.workunit.client.0.smithi087.stdout:1/723: truncate d3/d12/f1c 1800123 0 2024-04-25T15:58:11.985 INFO:tasks.workunit.client.1.smithi155.stderr:+ rm -rf -- ./tmp.srjGEwqATC 2024-04-25T15:58:11.985 INFO:tasks.workunit.client.0.smithi087.stdout:1/724: creat d3/d12/d39/d64/dc0/ff6 x:0 0 0 2024-04-25T15:58:11.987 INFO:tasks.workunit.client.0.smithi087.stdout:1/725: mkdir d3/d12/d14/d29/d2f/df7 0 2024-04-25T15:58:11.992 INFO:tasks.workunit.client.0.smithi087.stdout:1/726: rename d3/d12/d14/d29/l34 to d3/lf8 0 2024-04-25T15:58:11.992 INFO:tasks.workunit.client.0.smithi087.stdout:1/727: stat d3/d12/d14/d33/d95/fac 0 2024-04-25T15:58:11.994 INFO:tasks.workunit.client.0.smithi087.stdout:1/728: mknod d3/d2d/d6c/cf9 0 2024-04-25T15:58:12.013 INFO:tasks.workunit.client.0.smithi087.stdout:5/676: sync 2024-04-25T15:58:12.014 INFO:tasks.workunit.client.0.smithi087.stdout:5/677: truncate d9/f1c 5203629 0 2024-04-25T15:58:12.016 INFO:tasks.workunit.client.0.smithi087.stdout:5/678: write d9/d91/d30/d70/d79/d7d/fba [580743,83770] 0 2024-04-25T15:58:12.016 INFO:tasks.workunit.client.0.smithi087.stdout:5/679: readlink d9/d91/d38/l6c 0 2024-04-25T15:58:12.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/680: getdents d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e 0 2024-04-25T15:58:12.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/681: dread - d9/d91/d30/d55/fa0 zero size 2024-04-25T15:58:12.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/682: creat d9/d91/d38/fdb x:0 0 0 2024-04-25T15:58:12.024 INFO:tasks.workunit.client.0.smithi087.stdout:5/683: creat d9/d2f/d40/d4d/d7a/fdc x:0 0 0 2024-04-25T15:58:12.028 INFO:tasks.workunit.client.0.smithi087.stdout:5/684: link d9/d91/d30/d70/d82/ccd d9/d91/d30/d70/d79/cdd 0 2024-04-25T15:58:12.028 INFO:tasks.workunit.client.0.smithi087.stdout:5/685: dread - d9/d2f/d40/fcb zero size 2024-04-25T15:58:12.032 INFO:tasks.workunit.client.0.smithi087.stdout:5/686: getdents d9/d2f/d40/d4d/d7b/d5c/d5f/d44 0 2024-04-25T15:58:12.033 INFO:tasks.workunit.client.0.smithi087.stdout:5/687: dread - d9/d2f/d40/d4d/d58/fce zero size 2024-04-25T15:58:12.033 INFO:tasks.workunit.client.0.smithi087.stdout:5/688: fdatasync d9/fa 0 2024-04-25T15:58:12.034 INFO:tasks.workunit.client.0.smithi087.stdout:5/689: mkdir d9/d2f/dbb/dde 0 2024-04-25T15:58:12.036 INFO:tasks.workunit.client.0.smithi087.stdout:5/690: rmdir d9/d2f/d40/d4d/d7b/d8f 39 2024-04-25T15:58:12.037 INFO:tasks.workunit.client.0.smithi087.stdout:5/691: fdatasync d9/d2f/d40/d4d/d7b/d74/fb9 0 2024-04-25T15:58:12.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/692: fsync d9/d2f/d3b/f89 0 2024-04-25T15:58:12.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/693: chown d9/d91/d30/f81 40 1 2024-04-25T15:58:12.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/694: dwrite d9/d91/d38/f97 [0,4194304] 0 2024-04-25T15:58:12.046 INFO:tasks.workunit.client.0.smithi087.stdout:5/695: readlink d9/d99/lbf 0 2024-04-25T15:58:12.050 INFO:tasks.workunit.client.0.smithi087.stdout:5/696: creat d9/d91/d30/d70/d79/fdf x:0 0 0 2024-04-25T15:58:12.054 INFO:tasks.workunit.client.0.smithi087.stdout:5/697: link d9/f12 d9/d91/fe0 0 2024-04-25T15:58:12.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/698: dwrite d9/d91/d30/d56/f98 [0,4194304] 0 2024-04-25T15:58:12.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/699: getdents d9/d2f/d40/d4d/d58 0 2024-04-25T15:58:12.067 INFO:tasks.workunit.client.0.smithi087.stdout:5/700: mkdir d9/d2f/d40/d4d/de1 0 2024-04-25T15:58:12.067 INFO:tasks.workunit.client.0.smithi087.stdout:5/701: stat d9/d91/d30/d55 0 2024-04-25T15:58:12.069 INFO:tasks.workunit.client.0.smithi087.stdout:5/702: mkdir d9/d91/d30/de2 0 2024-04-25T15:58:12.072 INFO:tasks.workunit.client.0.smithi087.stdout:5/703: read d9/d91/f65 [2830360,90686] 0 2024-04-25T15:58:12.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/704: dwrite d9/d2f/d3b/f89 [0,4194304] 0 2024-04-25T15:58:12.086 INFO:tasks.workunit.client.0.smithi087.stdout:5/705: dwrite d9/d2f/d40/d4d/d7b/d5c/f8a [0,4194304] 0 2024-04-25T15:58:12.092 INFO:tasks.workunit.client.0.smithi087.stdout:5/706: creat d9/d2f/d40/d4d/d7b/d8f/fe3 x:0 0 0 2024-04-25T15:58:12.092 INFO:tasks.workunit.client.0.smithi087.stdout:5/707: stat d9/d91/f2e 0 2024-04-25T15:58:12.093 INFO:tasks.workunit.client.0.smithi087.stdout:5/708: write d9/d91/d30/d70/d79/fdf [741316,50062] 0 2024-04-25T15:58:12.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/709: rmdir d9/d2f/d40/d4d/d7b/d74/d83 39 2024-04-25T15:58:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/710: chown d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a 66330033 1 2024-04-25T15:58:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/711: dread - d9/d91/d30/d70/f71 zero size 2024-04-25T15:58:12.098 INFO:tasks.workunit.client.0.smithi087.stdout:5/712: rmdir d9/d91/d49 39 2024-04-25T15:58:12.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/713: rename d9/d91/d49/d80 to d9/d91/d30/d70/d79/dae/de4 0 2024-04-25T15:58:12.108 INFO:tasks.workunit.client.0.smithi087.stdout:5/714: dwrite d9/d91/d30/d56/f98 [0,4194304] 0 2024-04-25T15:58:12.109 INFO:tasks.workunit.client.0.smithi087.stdout:5/715: write d9/d2f/d3b/f86 [2313604,17782] 0 2024-04-25T15:58:12.118 INFO:tasks.workunit.client.0.smithi087.stdout:5/716: write d9/d91/fe0 [3177739,66446] 0 2024-04-25T15:58:12.121 INFO:tasks.workunit.client.0.smithi087.stdout:5/717: mkdir d9/d91/d30/d70/d79/dae/de4/de5 0 2024-04-25T15:58:12.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/768: sync 2024-04-25T15:58:12.135 INFO:tasks.workunit.client.0.smithi087.stdout:4/691: sync 2024-04-25T15:58:12.135 INFO:tasks.workunit.client.0.smithi087.stdout:8/682: sync 2024-04-25T15:58:12.137 INFO:tasks.workunit.client.0.smithi087.stdout:4/692: symlink d4/d10/d60/d56/d61/le6 0 2024-04-25T15:58:12.141 INFO:tasks.workunit.client.0.smithi087.stdout:0/769: rmdir d1/da/d3e/d85/d9b/dfb 0 2024-04-25T15:58:12.142 INFO:tasks.workunit.client.0.smithi087.stdout:4/693: creat d4/d10/d60/d56/fe7 x:0 0 0 2024-04-25T15:58:12.145 INFO:tasks.workunit.client.0.smithi087.stdout:8/683: truncate d4/d1d/d14/f31 294362 0 2024-04-25T15:58:12.146 INFO:tasks.workunit.client.0.smithi087.stdout:4/694: creat d4/fe8 x:0 0 0 2024-04-25T15:58:12.148 INFO:tasks.workunit.client.0.smithi087.stdout:8/684: creat d4/d22/d43/db3/fde x:0 0 0 2024-04-25T15:58:12.148 INFO:tasks.workunit.client.0.smithi087.stdout:0/770: dwrite d1/f3d [0,4194304] 0 2024-04-25T15:58:12.151 INFO:tasks.workunit.client.0.smithi087.stdout:0/771: mkdir d1/d6/d104 0 2024-04-25T15:58:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:0/772: truncate d1/d6/f47 5227249 0 2024-04-25T15:58:12.153 INFO:tasks.workunit.client.0.smithi087.stdout:0/773: readlink d1/da/d3e/d54/d34/d55/l90 0 2024-04-25T15:58:12.162 INFO:tasks.workunit.client.0.smithi087.stdout:4/695: dwrite d4/f4e [0,4194304] 0 2024-04-25T15:58:12.170 INFO:tasks.workunit.client.0.smithi087.stdout:8/685: dread d4/d1d/d3f/d82/fb0 [0,4194304] 0 2024-04-25T15:58:12.170 INFO:tasks.workunit.client.0.smithi087.stdout:8/686: chown d4/ld3 15585536 1 2024-04-25T15:58:12.172 INFO:tasks.workunit.client.0.smithi087.stdout:4/696: dwrite d4/d10/d60/d52/fba [0,4194304] 0 2024-04-25T15:58:12.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/774: dread d1/d6/f3b [4194304,4194304] 0 2024-04-25T15:58:12.174 INFO:tasks.workunit.client.0.smithi087.stdout:8/687: mkdir d4/d22/d43/d7f/dc6/ddf 0 2024-04-25T15:58:12.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/697: truncate d4/d10/d60/d5c/fa5 375004 0 2024-04-25T15:58:12.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/775: write d1/da/d3e/d85/d9b/fa7 [621563,123616] 0 2024-04-25T15:58:12.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:12.180 INFO:tasks.workunit.client.0.smithi087.stdout:4/698: rename d4/d10/d60/d56/l3b to d4/d87/le9 0 2024-04-25T15:58:12.182 INFO:tasks.workunit.client.0.smithi087.stdout:4/699: chown d4/d10/d60/d56/d61/d3f/d42/d97/de2 12734 1 2024-04-25T15:58:12.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/776: dwrite d1/da/d3e/d54/d34/d55/f78 [0,4194304] 0 2024-04-25T15:58:12.194 INFO:tasks.workunit.client.0.smithi087.stdout:0/777: rename d1/d4f/dde to d1/d6/d21/d2a/dd5/d105 0 2024-04-25T15:58:12.195 INFO:tasks.workunit.client.0.smithi087.stdout:0/778: chown d1/de9 0 1 2024-04-25T15:58:12.197 INFO:tasks.workunit.client.0.smithi087.stdout:8/688: dread d4/f4a [0,4194304] 0 2024-04-25T15:58:12.197 INFO:tasks.workunit.client.0.smithi087.stdout:4/700: dwrite d4/f5b [0,4194304] 0 2024-04-25T15:58:12.202 INFO:tasks.workunit.client.0.smithi087.stdout:0/779: link d1/da/f3a d1/dab/df4/f106 0 2024-04-25T15:58:12.211 INFO:tasks.workunit.client.0.smithi087.stdout:0/780: dwrite d1/da/d3e/d54/f88 [0,4194304] 0 2024-04-25T15:58:12.212 INFO:tasks.workunit.client.0.smithi087.stdout:0/781: chown d1/d6/db1/dc0/dd3/dff/d50/feb 30161855 1 2024-04-25T15:58:12.214 INFO:tasks.workunit.client.0.smithi087.stdout:8/689: dread d4/d8/dd/d2f/f67 [0,4194304] 0 2024-04-25T15:58:12.218 INFO:tasks.workunit.client.0.smithi087.stdout:8/690: truncate d4/d1d/d14/f31 1210468 0 2024-04-25T15:58:12.219 INFO:tasks.workunit.client.0.smithi087.stdout:8/691: write d4/d8/dd/d2f/d6f/fc4 [598567,105168] 0 2024-04-25T15:58:12.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/701: dread d4/d10/d60/d52/d66/d15/fe [0,4194304] 0 2024-04-25T15:58:12.222 INFO:tasks.workunit.client.0.smithi087.stdout:1/729: sync 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/435: sync 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:9/612: sync 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:2/614: sync 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:6/693: sync 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:3/610: sync 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/692: unlink d4/d1d/c70 0 2024-04-25T15:58:12.223 INFO:tasks.workunit.client.0.smithi087.stdout:4/702: rmdir d4/d10/d60/d56/d61/d3f/d58/d5e 39 2024-04-25T15:58:12.226 INFO:tasks.workunit.client.0.smithi087.stdout:8/693: chown d4/d22/d43/l54 66151 1 2024-04-25T15:58:12.227 INFO:tasks.workunit.client.0.smithi087.stdout:6/694: creat d7/d1a/d2a/ff2 x:0 0 0 2024-04-25T15:58:12.227 INFO:tasks.workunit.client.0.smithi087.stdout:4/703: fsync d4/d10/d60/d5c/d3a/d90/db9/fd1 0 2024-04-25T15:58:12.227 INFO:tasks.workunit.client.0.smithi087.stdout:7/436: symlink d1/d4/d7e/l87 0 2024-04-25T15:58:12.228 INFO:tasks.workunit.client.0.smithi087.stdout:2/615: symlink d3/lba 0 2024-04-25T15:58:12.228 INFO:tasks.workunit.client.0.smithi087.stdout:1/730: dread d3/f35 [0,4194304] 0 2024-04-25T15:58:12.230 INFO:tasks.workunit.client.0.smithi087.stdout:6/695: dread - d7/d1a/d1d/d21/d27/fe3 zero size 2024-04-25T15:58:12.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/437: write d1/d4/f47 [80513,58371] 0 2024-04-25T15:58:12.230 INFO:tasks.workunit.client.0.smithi087.stdout:9/613: rename d6/d8/d29 to d6/d8/d12/db7 0 2024-04-25T15:58:12.231 INFO:tasks.workunit.client.0.smithi087.stdout:7/438: dread - d1/d4/d18/d36/f81 zero size 2024-04-25T15:58:12.232 INFO:tasks.workunit.client.0.smithi087.stdout:6/696: chown d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/lb1 153954 1 2024-04-25T15:58:12.232 INFO:tasks.workunit.client.0.smithi087.stdout:3/611: symlink d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da0/lc3 0 2024-04-25T15:58:12.233 INFO:tasks.workunit.client.0.smithi087.stdout:8/694: creat d4/d1d/d14/fe0 x:0 0 0 2024-04-25T15:58:12.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/704: creat d4/d10/d60/d56/d61/db7/fea x:0 0 0 2024-04-25T15:58:12.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/731: unlink d3/d2d/d6c/f83 0 2024-04-25T15:58:12.234 INFO:tasks.workunit.client.0.smithi087.stdout:2/616: creat d3/d2a/d1c/fbb x:0 0 0 2024-04-25T15:58:12.236 INFO:tasks.workunit.client.0.smithi087.stdout:4/705: rmdir d4/d87 39 2024-04-25T15:58:12.239 INFO:tasks.workunit.client.0.smithi087.stdout:7/439: link d1/d4/d18/d36/f68 d1/d3c/f88 0 2024-04-25T15:58:12.241 INFO:tasks.workunit.client.0.smithi087.stdout:3/612: rename d4/f12 to d4/d17/d24/d29/d58/dac/dc0/d82/d8c/fc4 0 2024-04-25T15:58:12.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/706: unlink d4/d10/d60/d56/d61/l80 0 2024-04-25T15:58:12.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/440: symlink d1/d3c/l89 0 2024-04-25T15:58:12.252 INFO:tasks.workunit.client.0.smithi087.stdout:8/695: dwrite d4/d1d/d3f/d82/faf [0,4194304] 0 2024-04-25T15:58:12.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/441: truncate d1/d3c/d6b/f79 263961 0 2024-04-25T15:58:12.253 INFO:tasks.workunit.client.0.smithi087.stdout:8/696: fdatasync d4/d1d/d17/d37/f3b 0 2024-04-25T15:58:12.254 INFO:tasks.workunit.client.0.smithi087.stdout:7/442: read d1/d4/d18/d36/f71 [153235,85722] 0 2024-04-25T15:58:12.260 INFO:tasks.workunit.client.0.smithi087.stdout:2/617: dwrite d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:12.261 INFO:tasks.workunit.client.0.smithi087.stdout:2/618: read - d3/d27/d29/d2d/fa8 zero size 2024-04-25T15:58:12.270 INFO:tasks.workunit.client.0.smithi087.stdout:4/707: mknod d4/d10/d60/d56/d61/db7/ceb 0 2024-04-25T15:58:12.271 INFO:tasks.workunit.client.0.smithi087.stdout:7/443: rmdir d1/d9/d26 39 2024-04-25T15:58:12.273 INFO:tasks.workunit.client.0.smithi087.stdout:2/619: mknod d3/d27/d38/cbc 0 2024-04-25T15:58:12.274 INFO:tasks.workunit.client.0.smithi087.stdout:6/697: getdents d7/d71/d59 0 2024-04-25T15:58:12.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/614: creat d6/d8/d12/db7/d3a/d5b/d60/d7f/fb8 x:0 0 0 2024-04-25T15:58:12.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/615: chown d6/d8/d12 425732 1 2024-04-25T15:58:12.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/698: truncate d7/d71/d59/dc7/dec/fe8 789852 0 2024-04-25T15:58:12.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/708: mkdir d4/d10/d60/d56/d61/d3f/d42/d97/de2/dec 0 2024-04-25T15:58:12.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/616: mkdir d6/d8/d32/d4c/db9 0 2024-04-25T15:58:12.285 INFO:tasks.workunit.client.0.smithi087.stdout:9/617: dread - d6/d8/d32/f64 zero size 2024-04-25T15:58:12.286 INFO:tasks.workunit.client.0.smithi087.stdout:2/620: dwrite d3/d27/d29/d4f/d5a/d6a/fb9 [0,4194304] 0 2024-04-25T15:58:12.287 INFO:tasks.workunit.client.0.smithi087.stdout:6/699: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/ff3 x:0 0 0 2024-04-25T15:58:12.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/700: unlink d7/d1a/d1d/d21/d27/d2c/d35/f36 0 2024-04-25T15:58:12.294 INFO:tasks.workunit.client.0.smithi087.stdout:9/618: symlink d6/d3e/d63/lba 0 2024-04-25T15:58:12.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/613: truncate d4/db/f6c 455238 0 2024-04-25T15:58:12.299 INFO:tasks.workunit.client.0.smithi087.stdout:6/701: dread - d7/d1a/d1d/d21/fa7 zero size 2024-04-25T15:58:12.299 INFO:tasks.workunit.client.0.smithi087.stdout:8/697: truncate d4/d22/f96 778085 0 2024-04-25T15:58:12.300 INFO:tasks.workunit.client.0.smithi087.stdout:6/702: chown d7/d71/d59/d90/da5/fc0 5877330 1 2024-04-25T15:58:12.300 INFO:tasks.workunit.client.0.smithi087.stdout:8/698: fdatasync d4/d1d/d3f/f8d 0 2024-04-25T15:58:12.300 INFO:tasks.workunit.client.0.smithi087.stdout:9/619: creat d6/d3e/fbb x:0 0 0 2024-04-25T15:58:12.301 INFO:tasks.workunit.client.0.smithi087.stdout:8/699: read - d4/d1d/d3f/fac zero size 2024-04-25T15:58:12.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/703: unlink d7/d71/l88 0 2024-04-25T15:58:12.306 INFO:tasks.workunit.client.0.smithi087.stdout:4/709: write d4/d10/f9e [387693,35385] 0 2024-04-25T15:58:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/620: creat d6/d8/d12/fbc x:0 0 0 2024-04-25T15:58:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/444: dwrite d1/d4/f40 [0,4194304] 0 2024-04-25T15:58:12.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/614: mknod d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/cc5 0 2024-04-25T15:58:12.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/615: chown d4/d17/d24/d29/d58/dac/d9c/fab 1 1 2024-04-25T15:58:12.315 INFO:tasks.workunit.client.0.smithi087.stdout:3/616: chown d4/d17/d24/d29/d7b 51365 1 2024-04-25T15:58:12.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/621: dread d6/d3e/d63/f79 [0,4194304] 0 2024-04-25T15:58:12.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/621: link d3/d20/d4a/d8e/lb0 d3/d2a/d48/d83/lbd 0 2024-04-25T15:58:12.318 INFO:tasks.workunit.client.0.smithi087.stdout:9/622: truncate d6/d8/d32/f4d 4312335 0 2024-04-25T15:58:12.320 INFO:tasks.workunit.client.0.smithi087.stdout:7/445: symlink d1/d3c/d6b/l8a 0 2024-04-25T15:58:12.323 INFO:tasks.workunit.client.0.smithi087.stdout:7/446: truncate d1/d4/d18/d36/f81 14056 0 2024-04-25T15:58:12.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/710: symlink d4/d10/d60/d56/d61/d3f/d58/led 0 2024-04-25T15:58:12.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/447: chown d1/d9/f65 9 1 2024-04-25T15:58:12.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/700: rename d4/d1d/d3f to d4/d1d/de1 0 2024-04-25T15:58:12.327 INFO:tasks.workunit.client.0.smithi087.stdout:9/623: mknod d6/d8/d32/d57/cbd 0 2024-04-25T15:58:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/448: read d1/d1a/f39 [3817761,37928] 0 2024-04-25T15:58:12.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/622: dwrite d3/d27/d29/d4f/f5f [0,4194304] 0 2024-04-25T15:58:12.330 INFO:tasks.workunit.client.0.smithi087.stdout:3/617: dread d4/f2c [0,4194304] 0 2024-04-25T15:58:12.333 INFO:tasks.workunit.client.0.smithi087.stdout:7/449: creat d1/d1a/d7b/f8b x:0 0 0 2024-04-25T15:58:12.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/623: fdatasync d3/d27/d29/d2d/f57 0 2024-04-25T15:58:12.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/624: mknod d3/d2a/d48/d77/d79/d85/cbe 0 2024-04-25T15:58:12.341 INFO:tasks.workunit.client.0.smithi087.stdout:2/625: readlink d3/lba 0 2024-04-25T15:58:12.343 INFO:tasks.workunit.client.0.smithi087.stdout:3/618: symlink d4/d17/d81/da6/d23/lc6 0 2024-04-25T15:58:12.343 INFO:tasks.workunit.client.0.smithi087.stdout:6/704: dwrite d7/d1a/d1d/d21/d27/d2c/f5c [0,4194304] 0 2024-04-25T15:58:12.344 INFO:tasks.workunit.client.0.smithi087.stdout:3/619: chown d4/db/c4c 522 1 2024-04-25T15:58:12.345 INFO:tasks.workunit.client.0.smithi087.stdout:4/711: link d4/f35 d4/d10/d60/d52/d66/d15/fee 0 2024-04-25T15:58:12.345 INFO:tasks.workunit.client.0.smithi087.stdout:3/620: chown d4/d17/d24/d29/d58 1887604 1 2024-04-25T15:58:12.347 INFO:tasks.workunit.client.0.smithi087.stdout:4/712: readlink d4/d10/d60/d52/d66/d15/l4a 0 2024-04-25T15:58:12.347 INFO:tasks.workunit.client.0.smithi087.stdout:8/701: rename d4/d22/f96 to d4/d8/dd/d85/dbc/fe2 0 2024-04-25T15:58:12.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/705: rmdir d7/d71/d59 39 2024-04-25T15:58:12.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/702: chown d4/d22/d43/cbe 9 1 2024-04-25T15:58:12.353 INFO:tasks.workunit.client.0.smithi087.stdout:9/624: rename d6/d8/d12/db7/d3a/d7c/fa2 to d6/d8/d12/db7/fbe 0 2024-04-25T15:58:12.354 INFO:tasks.workunit.client.0.smithi087.stdout:3/621: truncate d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/fb3 454757 0 2024-04-25T15:58:12.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/706: truncate d7/d1a/d1d/d21/d27/f73 1797768 0 2024-04-25T15:58:12.354 INFO:tasks.workunit.client.0.smithi087.stdout:4/713: creat d4/d10/d60/d5c/d3a/d90/db9/fef x:0 0 0 2024-04-25T15:58:12.357 INFO:tasks.workunit.client.0.smithi087.stdout:6/707: write d7/d1a/fc4 [915758,25826] 0 2024-04-25T15:58:12.358 INFO:tasks.workunit.client.0.smithi087.stdout:9/625: mkdir d6/d8/d32/d57/dbf 0 2024-04-25T15:58:12.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/622: creat d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fc7 x:0 0 0 2024-04-25T15:58:12.363 INFO:tasks.workunit.client.0.smithi087.stdout:4/714: dread d4/f7c [0,4194304] 0 2024-04-25T15:58:12.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.358+0000 7f0d0bdfd640 1 Processor -- start 2024-04-25T15:58:12.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0bdfd640 1 -- start start 2024-04-25T15:58:12.366 INFO:tasks.workunit.client.0.smithi087.stdout:7/450: dwrite d1/d1a/f6f [4194304,4194304] 0 2024-04-25T15:58:12.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/623: symlink d4/d17/d24/d29/d58/dac/lc8 0 2024-04-25T15:58:12.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0bdfd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d04158a00 0x7f0d040ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:12.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0bdfd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:12.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0bdfd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d04063660 con 0x7f0d04158e10 2024-04-25T15:58:12.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0bdfd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0d040c5470 con 0x7f0d04158a00 2024-04-25T15:58:12.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0bdfd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d040ab670 con 0x7f0d040adfb0 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d04158a00 0x7f0d040ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0d04158a00 0x7f0d040ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56508/0 (socket says 172.21.15.87:56508) 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 -- 172.21.15.87:0/3695266305 learned_addr learned my addr 172.21.15.87:0/3695266305 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0a39a640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 -- 172.21.15.87:0/3695266305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 msgr2=0x7f0d0415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 -- 172.21.15.87:0/3695266305 >> v1:172.21.15.87:6789/0 conn(0x7f0d04158e10 legacy=0x7f0d04152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d09b99640 1 -- 172.21.15.87:0/3695266305 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d040ab930 con 0x7f0d04158a00 2024-04-25T15:58:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.362+0000 7f0d0a39a640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:58:12.369 INFO:tasks.workunit.client.0.smithi087.stdout:2/626: dread d3/d2a/d48/f6c [0,4194304] 0 2024-04-25T15:58:12.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d09b99640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d040ada70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0d040c55f0 tx=0x7f0d0001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4919f2e268cb6e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:12.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d08b97640 1 -- 172.21.15.87:0/3695266305 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000aa430 con 0x7f0d04158a00 2024-04-25T15:58:12.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d08b97640 1 -- 172.21.15.87:0/3695266305 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d000af070 con 0x7f0d04158a00 2024-04-25T15:58:12.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d08b97640 1 -- 172.21.15.87:0/3695266305 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000aa7f0 con 0x7f0d04158a00 2024-04-25T15:58:12.372 INFO:tasks.workunit.client.0.smithi087.stdout:9/626: truncate d6/d8/d12/db7/d3a/d58/d72/f7d 4939115 0 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3695266305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 msgr2=0x7f0d040ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d040ada70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0d040c55f0 tx=0x7f0d0001c510 comp rx=0 tx=0).stop 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3695266305 shutdown_connections 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3695266305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d040ada70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3695266305 >> 172.21.15.87:0/3695266305 conn(0x7f0d0406d650 msgr2=0x7f0d040c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3695266305 shutdown_connections 2024-04-25T15:58:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.366+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3695266305 wait complete. 2024-04-25T15:58:12.374 INFO:tasks.workunit.client.0.smithi087.stdout:7/451: dread - d1/d9/d26/f6d zero size 2024-04-25T15:58:12.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 Processor -- start 2024-04-25T15:58:12.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 -- start start 2024-04-25T15:58:12.375 INFO:tasks.workunit.client.0.smithi087.stdout:4/715: mknod d4/d10/d60/d56/d61/d3f/d42/d97/cf0 0 2024-04-25T15:58:12.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/624: fdatasync d4/d17/f5e 0 2024-04-25T15:58:12.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0413da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:12.376 INFO:tasks.workunit.client.0.smithi087.stdout:4/716: readlink d4/d10/d60/d5c/d8d/le4 0 2024-04-25T15:58:12.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d041f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:12.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d04158e10 0x7f0d041f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d040af0f0 con 0x7f0d04158a00 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d040aef70 con 0x7f0d04158e10 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d040749b0 con 0x7f0d040adfb0 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d041f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d041f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56512/0 (socket says 172.21.15.87:56512) 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 -- 172.21.15.87:0/3691865760 learned_addr learned my addr 172.21.15.87:0/3691865760 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09b99640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0413da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0a39a640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d04158e10 0x7f0d041f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 -- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 msgr2=0x7f0d0413da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0413da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 -- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d04158e10 msgr2=0x7f0d041f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d04158e10 0x7f0d041f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 -- 172.21.15.87:0/3691865760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0414e5a0 con 0x7f0d04158a00 2024-04-25T15:58:12.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d09398640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d041f1960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4001b00 tx=0x7f0cf4014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:12.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4012470 con 0x7f0d04158a00 2024-04-25T15:58:12.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf4012630 con 0x7f0d04158a00 2024-04-25T15:58:12.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4014d70 con 0x7f0d04158a00 2024-04-25T15:58:12.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.370+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0413ea20 con 0x7f0d04158a00 2024-04-25T15:58:12.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0414dda0 con 0x7f0d04158a00 2024-04-25T15:58:12.379 INFO:tasks.workunit.client.0.smithi087.stdout:2/627: mknod d3/d2a/d48/d77/cbf 0 2024-04-25T15:58:12.379 INFO:tasks.workunit.client.0.smithi087.stdout:8/703: write d4/d8/dd/d85/dbc/fe2 [37741,7374] 0 2024-04-25T15:58:12.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d04069bb0 con 0x7f0d04158a00 2024-04-25T15:58:12.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0cf40050d0 con 0x7f0d04158a00 2024-04-25T15:58:12.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0cfa7fc640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ce806f400 0x7f0ce8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:12.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0d09b99640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ce806f400 0x7f0ce8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:12.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f0cf408f440 con 0x7f0d04158a00 2024-04-25T15:58:12.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.374+0000 7f0d09b99640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ce806f400 0x7f0ce8071910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d000ae000 tx=0x7f0d000a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:12.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/717: rmdir d4/d10/d60/d5c/d3a 39 2024-04-25T15:58:12.382 INFO:tasks.workunit.client.0.smithi087.stdout:9/627: write d6/d8/d12/db7/f3f [4122658,855] 0 2024-04-25T15:58:12.385 INFO:tasks.workunit.client.0.smithi087.stdout:6/708: dwrite d7/d1a/fa3 [0,4194304] 0 2024-04-25T15:58:12.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/628: rename d3/d2a/d48/c4e to d3/d27/d38/cc0 0 2024-04-25T15:58:12.388 INFO:tasks.workunit.client.0.smithi087.stdout:3/625: rmdir d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da0 39 2024-04-25T15:58:12.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/452: link d1/d9/d26/f6d d1/d4/f8c 0 2024-04-25T15:58:12.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.386+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0cf4018020 con 0x7f0d04158a00 2024-04-25T15:58:12.390 INFO:tasks.workunit.client.0.smithi087.stdout:3/626: fdatasync d4/d17/d24/d29/d58/dac/f79 0 2024-04-25T15:58:12.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/718: dread d4/d10/d60/d5c/d3a/d90/fb0 [0,4194304] 0 2024-04-25T15:58:12.393 INFO:tasks.workunit.client.0.smithi087.stdout:9/628: write d6/d45/f7a [5972076,101191] 0 2024-04-25T15:58:12.397 INFO:tasks.workunit.client.0.smithi087.stdout:3/627: mkdir d4/d17/d24/d29/d58/dac/dc9 0 2024-04-25T15:58:12.398 INFO:tasks.workunit.client.0.smithi087.stdout:7/453: creat d1/d4/d18/d36/d5d/f8d x:0 0 0 2024-04-25T15:58:12.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/629: dread d3/d27/d29/f7c [0,4194304] 0 2024-04-25T15:58:12.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/719: mkdir d4/d10/d60/d52/d66/d15/df1 0 2024-04-25T15:58:12.403 INFO:tasks.workunit.client.0.smithi087.stdout:7/454: write d1/d3c/f5a [4901583,89677] 0 2024-04-25T15:58:12.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/628: chown d4/d17/d24/d29/d58/dac/d9c 44 1 2024-04-25T15:58:12.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/709: dwrite d7/d71/d76/f8e [0,4194304] 0 2024-04-25T15:58:12.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/630: rmdir d3/d20/d4a/d8e 39 2024-04-25T15:58:12.405 INFO:tasks.workunit.client.0.smithi087.stdout:8/704: dwrite d4/d8/f60 [0,4194304] 0 2024-04-25T15:58:12.408 INFO:tasks.workunit.client.0.smithi087.stdout:9/629: creat d6/d8/d12/db7/d3a/d5b/d60/d1d/fc0 x:0 0 0 2024-04-25T15:58:12.409 INFO:tasks.workunit.client.0.smithi087.stdout:9/630: chown d6/fa0 39420 1 2024-04-25T15:58:12.410 INFO:tasks.workunit.client.0.smithi087.stdout:9/631: chown f2 2918387 1 2024-04-25T15:58:12.411 INFO:tasks.workunit.client.0.smithi087.stdout:8/705: creat d4/d1d/d7c/fe3 x:0 0 0 2024-04-25T15:58:12.414 INFO:tasks.workunit.client.0.smithi087.stdout:7/455: mkdir d1/d9/d8e 0 2024-04-25T15:58:12.416 INFO:tasks.workunit.client.0.smithi087.stdout:9/632: creat d6/d8/d32/d4c/fc1 x:0 0 0 2024-04-25T15:58:12.417 INFO:tasks.workunit.client.0.smithi087.stdout:6/710: symlink d7/d1a/d1d/lf4 0 2024-04-25T15:58:12.419 INFO:tasks.workunit.client.0.smithi087.stdout:4/720: link d4/d10/d60/d56/d61/d3f/d42/d97/f89 d4/d10/d60/d52/ff2 0 2024-04-25T15:58:12.419 INFO:tasks.workunit.client.0.smithi087.stdout:3/629: getdents d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94 0 2024-04-25T15:58:12.422 INFO:tasks.workunit.client.0.smithi087.stdout:9/633: rmdir d6/d8/d32/d57/d66 39 2024-04-25T15:58:12.423 INFO:tasks.workunit.client.0.smithi087.stdout:8/706: dwrite d4/d1d/de1/fc1 [0,4194304] 0 2024-04-25T15:58:12.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/631: getdents d3/d27/d29/d4f/d5a/d6a/d88 0 2024-04-25T15:58:12.425 INFO:tasks.workunit.client.0.smithi087.stdout:4/721: write d4/d10/d60/d56/f84 [3917847,53587] 0 2024-04-25T15:58:12.428 INFO:tasks.workunit.client.0.smithi087.stdout:8/707: fsync d4/d1d/d14/fa2 0 2024-04-25T15:58:12.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/630: dread d4/d17/d24/f56 [0,4194304] 0 2024-04-25T15:58:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:6/711: dwrite f6 [4194304,4194304] 0 2024-04-25T15:58:12.435 INFO:tasks.workunit.client.0.smithi087.stdout:3/631: chown d4/d17/d24/f46 1604950 1 2024-04-25T15:58:12.436 INFO:tasks.workunit.client.0.smithi087.stdout:8/708: chown d4/d1d/d17/d37/d5e/l5f 317319 1 2024-04-25T15:58:12.437 INFO:tasks.workunit.client.0.smithi087.stdout:4/722: fdatasync d4/d10/d60/d56/d61/d3f/d42/fcf 0 2024-04-25T15:58:12.442 INFO:tasks.workunit.client.0.smithi087.stdout:6/712: mkdir d7/d71/d59/df5 0 2024-04-25T15:58:12.442 INFO:tasks.workunit.client.0.smithi087.stdout:8/709: mknod d4/d1d/de1/d82/ce4 0 2024-04-25T15:58:12.445 INFO:tasks.workunit.client.0.smithi087.stdout:4/723: mknod d4/d10/d60/d5c/cf3 0 2024-04-25T15:58:12.449 INFO:tasks.workunit.client.0.smithi087.stdout:8/710: unlink d4/d8/dd/d85/fa1 0 2024-04-25T15:58:12.450 INFO:tasks.workunit.client.0.smithi087.stdout:2/632: dwrite d3/d27/d29/d2d/d40/f9c [0,4194304] 0 2024-04-25T15:58:12.452 INFO:tasks.workunit.client.0.smithi087.stdout:5/718: sync 2024-04-25T15:58:12.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/456: dread d1/d9/d26/d45/f61 [0,4194304] 0 2024-04-25T15:58:12.455 INFO:tasks.workunit.client.0.smithi087.stdout:9/634: dwrite d6/d3e/d63/f79 [0,4194304] 0 2024-04-25T15:58:12.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/711: write d4/d1d/de1/d82/fb2 [425721,27451] 0 2024-04-25T15:58:12.458 INFO:tasks.workunit.client.0.smithi087.stdout:5/719: chown d9/d2f/d40/d4d/d7b/d74 228468 1 2024-04-25T15:58:12.461 INFO:tasks.workunit.client.0.smithi087.stdout:6/713: dwrite d7/fc [0,4194304] 0 2024-04-25T15:58:12.463 INFO:tasks.workunit.client.0.smithi087.stdout:4/724: rmdir d4/d10/d60/d5c/d3a/d90/db9/dcb 0 2024-04-25T15:58:12.467 INFO:tasks.workunit.client.0.smithi087.stdout:9/635: rmdir d6/d8/d32/d57/d66 39 2024-04-25T15:58:12.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/712: symlink d4/d8/dd/d85/dbc/dd2/le5 0 2024-04-25T15:58:12.470 INFO:tasks.workunit.client.0.smithi087.stdout:3/632: dread d4/db/f38 [0,4194304] 0 2024-04-25T15:58:12.472 INFO:tasks.workunit.client.0.smithi087.stdout:9/636: mkdir d6/d3e/d63/dc2 0 2024-04-25T15:58:12.475 INFO:tasks.workunit.client.0.smithi087.stdout:7/457: dwrite d1/d4/f69 [0,4194304] 0 2024-04-25T15:58:12.476 INFO:tasks.workunit.client.0.smithi087.stdout:6/714: creat d7/d1a/d1d/d21/d27/ff6 x:0 0 0 2024-04-25T15:58:12.488 INFO:tasks.workunit.client.0.smithi087.stdout:5/720: truncate d9/f29 5189857 0 2024-04-25T15:58:12.489 INFO:tasks.workunit.client.0.smithi087.stdout:3/633: rmdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62 39 2024-04-25T15:58:12.489 INFO:tasks.workunit.client.0.smithi087.stdout:7/458: symlink d1/d1a/d7b/l8f 0 2024-04-25T15:58:12.491 INFO:tasks.workunit.client.0.smithi087.stdout:2/633: dread d3/d2a/d48/f54 [0,4194304] 0 2024-04-25T15:58:12.491 INFO:tasks.workunit.client.0.smithi087.stdout:9/637: dread d6/d3e/d63/f79 [0,4194304] 0 2024-04-25T15:58:12.491 INFO:tasks.workunit.client.0.smithi087.stdout:6/715: fsync d7/d1a/d1d/d8a/f91 0 2024-04-25T15:58:12.494 INFO:tasks.workunit.client.0.smithi087.stdout:8/713: dwrite d4/d1d/de1/fac [0,4194304] 0 2024-04-25T15:58:12.498 INFO:tasks.workunit.client.0.smithi087.stdout:3/634: dread - d4/d17/d81/da6/d53/f75 zero size 2024-04-25T15:58:12.498 INFO:tasks.workunit.client.0.smithi087.stdout:5/721: creat d9/d91/d30/d70/d79/dae/de4/fe6 x:0 0 0 2024-04-25T15:58:12.501 INFO:tasks.workunit.client.0.smithi087.stdout:9/638: truncate d6/d8/d12/db7/d3a/f74 1417041 0 2024-04-25T15:58:12.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/716: unlink d7/d71/d59/dc7/dec/cf1 0 2024-04-25T15:58:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:2/634: creat d3/d2a/d48/d77/d79/d85/fc1 x:0 0 0 2024-04-25T15:58:12.512 INFO:tasks.workunit.client.0.smithi087.stdout:5/722: mknod d9/d91/d30/d70/d79/d7d/ce7 0 2024-04-25T15:58:12.512 INFO:tasks.workunit.client.0.smithi087.stdout:4/725: dread d4/d10/d60/d56/f55 [0,4194304] 0 2024-04-25T15:58:12.514 INFO:tasks.workunit.client.0.smithi087.stdout:2/635: write d3/d27/d29/d4f/d5a/d6a/d88/d94/fad [1024765,106790] 0 2024-04-25T15:58:12.514 INFO:tasks.workunit.client.0.smithi087.stdout:9/639: creat d6/d3e/d63/dc2/fc3 x:0 0 0 2024-04-25T15:58:12.515 INFO:tasks.workunit.client.0.smithi087.stdout:8/714: rename d4/d1d/d7c/dae/db7/cbb to d4/ce6 0 2024-04-25T15:58:12.516 INFO:tasks.workunit.client.0.smithi087.stdout:8/715: write d4/d1d/d17/d72/fda [351935,123002] 0 2024-04-25T15:58:12.518 INFO:tasks.workunit.client.0.smithi087.stdout:4/726: symlink d4/d10/lf4 0 2024-04-25T15:58:12.520 INFO:tasks.workunit.client.0.smithi087.stdout:9/640: creat d6/d3e/fc4 x:0 0 0 2024-04-25T15:58:12.520 INFO:tasks.workunit.client.0.smithi087.stdout:6/717: getdents d7/d1a/d1d/d21/d27/d2c/d35/d45/dca 0 2024-04-25T15:58:12.521 INFO:tasks.workunit.client.0.smithi087.stdout:2/636: symlink d3/lc2 0 2024-04-25T15:58:12.521 INFO:tasks.workunit.client.0.smithi087.stdout:7/459: dread d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:12.522 INFO:tasks.workunit.client.0.smithi087.stdout:8/716: mknod d4/d22/d43/d7f/dc6/ce7 0 2024-04-25T15:58:12.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/718: dread - d7/d1a/d1d/fcf zero size 2024-04-25T15:58:12.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/641: write d6/d8/d12/db7/d3a/d58/f71 [381179,83113] 0 2024-04-25T15:58:12.524 INFO:tasks.workunit.client.0.smithi087.stdout:5/723: getdents d9/d91/d30/d70/d79 0 2024-04-25T15:58:12.526 INFO:tasks.workunit.client.0.smithi087.stdout:9/642: fsync d6/d8/d12/db7/f94 0 2024-04-25T15:58:12.527 INFO:tasks.workunit.client.0.smithi087.stdout:4/727: getdents d4/d10/d60 0 2024-04-25T15:58:12.528 INFO:tasks.workunit.client.0.smithi087.stdout:8/717: mknod d4/d8/dd/d2f/d6f/ce8 0 2024-04-25T15:58:12.529 INFO:tasks.workunit.client.0.smithi087.stdout:3/635: dread d4/d17/f1e [0,4194304] 0 2024-04-25T15:58:12.530 INFO:tasks.workunit.client.0.smithi087.stdout:2/637: rename d3/d27/d29/d2d/f8d to d3/d27/d29/d2d/d40/fc3 0 2024-04-25T15:58:12.530 INFO:tasks.workunit.client.0.smithi087.stdout:8/718: write d4/d1d/f5b [263710,103334] 0 2024-04-25T15:58:12.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/638: read - d3/d27/d29/d4f/f59 zero size 2024-04-25T15:58:12.534 INFO:tasks.workunit.client.0.smithi087.stdout:4/728: truncate d4/d10/d60/d56/d61/d3f/d58/d5e/fdd 491353 0 2024-04-25T15:58:12.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/636: mknod d4/d17/d81/da6/d37/cca 0 2024-04-25T15:58:12.535 INFO:tasks.workunit.client.0.smithi087.stdout:4/729: chown d4/d10/d60/d52/c53 2 1 2024-04-25T15:58:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/460: rename d1/d4/d18/d36/c83 to d1/d4/d18/d36/d5d/c90 0 2024-04-25T15:58:12.538 INFO:tasks.workunit.client.0.smithi087.stdout:3/637: truncate d4/d17/d24/d29/d58/dac/d99/fa4 165841 0 2024-04-25T15:58:12.538 INFO:tasks.workunit.client.0.smithi087.stdout:4/730: fsync d4/d10/d60/d52/ff2 0 2024-04-25T15:58:12.539 INFO:tasks.workunit.client.0.smithi087.stdout:4/731: dread - d4/d10/d60/fb6 zero size 2024-04-25T15:58:12.541 INFO:tasks.workunit.client.0.smithi087.stdout:9/643: rename d6/d8/d12/f43 to d6/d8/d32/fc5 0 2024-04-25T15:58:12.546 INFO:tasks.workunit.client.0.smithi087.stdout:7/461: mknod d1/d9/c91 0 2024-04-25T15:58:12.546 INFO:tasks.workunit.client.0.smithi087.stdout:3/638: dwrite d4/db/fc [0,4194304] 0 2024-04-25T15:58:12.547 INFO:tasks.workunit.client.0.smithi087.stdout:3/639: chown d4/d17/f8e 3681 1 2024-04-25T15:58:12.548 INFO:tasks.workunit.client.0.smithi087.stdout:5/724: rename d9/d2f/d40/d4d/d7b/d5c/d63 to d9/d2f/d40/d4d/d7b/d5c/d5f/de8 0 2024-04-25T15:58:12.554 INFO:tasks.workunit.client.0.smithi087.stdout:2/639: rename d3/d27/d29/d2d/d40/c8a to d3/d2a/d1c/cc4 0 2024-04-25T15:58:12.555 INFO:tasks.workunit.client.0.smithi087.stdout:3/640: write d4/d17/f74 [184860,91188] 0 2024-04-25T15:58:12.558 INFO:tasks.workunit.client.0.smithi087.stdout:8/719: dread d4/d1d/d17/d37/f3b [0,4194304] 0 2024-04-25T15:58:12.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/719: dwrite d7/d71/d59/f8c [0,4194304] 0 2024-04-25T15:58:12.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/720: chown d4/d1d/de1/fac 10 1 2024-04-25T15:58:12.562 INFO:tasks.workunit.client.0.smithi087.stdout:4/732: link d4/d10/d60/d52/c53 d4/d10/d60/d56/d61/d3f/d58/cf5 0 2024-04-25T15:58:12.562 INFO:tasks.workunit.client.0.smithi087.stdout:5/725: dwrite d9/d2f/d3b/f86 [0,4194304] 0 2024-04-25T15:58:12.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/641: unlink d4/d17/d24/ca3 0 2024-04-25T15:58:12.566 INFO:tasks.workunit.client.0.smithi087.stdout:7/462: creat d1/d9/f92 x:0 0 0 2024-04-25T15:58:12.567 INFO:tasks.workunit.client.0.smithi087.stdout:3/642: write d4/d17/d81/da6/f3d [4493110,69282] 0 2024-04-25T15:58:12.569 INFO:tasks.workunit.client.0.smithi087.stdout:3/643: dread - d4/d17/d81/da6/d23/f7c zero size 2024-04-25T15:58:12.570 INFO:tasks.workunit.client.0.smithi087.stdout:3/644: chown d4/d17/d81/da6/d37/d51/c70 47 1 2024-04-25T15:58:12.571 INFO:tasks.workunit.client.0.smithi087.stdout:6/720: mknod d7/d1a/d41/dbd/db9/cf7 0 2024-04-25T15:58:12.571 INFO:tasks.workunit.client.0.smithi087.stdout:8/721: symlink d4/d22/d43/d7f/dc6/le9 0 2024-04-25T15:58:12.572 INFO:tasks.workunit.client.0.smithi087.stdout:3/645: truncate d4/d17/d24/f46 1529081 0 2024-04-25T15:58:12.573 INFO:tasks.workunit.client.0.smithi087.stdout:5/726: creat d9/d91/d30/d70/d79/fe9 x:0 0 0 2024-04-25T15:58:12.573 INFO:tasks.workunit.client.0.smithi087.stdout:9/644: write d6/d8/d32/f59 [664301,98290] 0 2024-04-25T15:58:12.579 INFO:tasks.workunit.client.0.smithi087.stdout:3/646: write d4/f10 [1913195,121834] 0 2024-04-25T15:58:12.579 INFO:tasks.workunit.client.0.smithi087.stdout:5/727: fsync d9/d91/d38/fd1 0 2024-04-25T15:58:12.583 INFO:tasks.workunit.client.0.smithi087.stdout:5/728: fsync d9/d91/f2e 0 2024-04-25T15:58:12.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/640: dwrite d3/d27/d29/d2d/d40/f68 [0,4194304] 0 2024-04-25T15:58:12.587 INFO:tasks.workunit.client.0.smithi087.stdout:9/645: rename d6/d8/d32/d4c/fc1 to d6/d8/d32/d57/d66/da7/da8/fc6 0 2024-04-25T15:58:12.587 INFO:tasks.workunit.client.0.smithi087.stdout:4/733: truncate d4/d10/d60/d56/d61/d3f/d42/d97/fa0 64951 0 2024-04-25T15:58:12.591 INFO:tasks.workunit.client.0.smithi087.stdout:7/463: dread f0 [0,4194304] 0 2024-04-25T15:58:12.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/641: creat d3/d27/d29/d76/fc5 x:0 0 0 2024-04-25T15:58:12.592 INFO:tasks.workunit.client.0.smithi087.stdout:5/729: chown d9/d2f/c3d 5010239 1 2024-04-25T15:58:12.595 INFO:tasks.workunit.client.0.smithi087.stdout:3/647: stat d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89/l8f 0 2024-04-25T15:58:12.595 INFO:tasks.workunit.client.0.smithi087.stdout:9/646: unlink d6/d8/d32/d57/d66/d75/l8e 0 2024-04-25T15:58:12.597 INFO:tasks.workunit.client.0.smithi087.stdout:4/734: mkdir d4/d10/d60/d56/d61/df6 0 2024-04-25T15:58:12.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/721: dwrite d7/d1a/d41/f74 [0,4194304] 0 2024-04-25T15:58:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:8/722: dwrite d4/d1d/d7c/f15 [0,4194304] 0 2024-04-25T15:58:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/642: mknod d3/d27/d29/d4f/d5a/d6a/cc6 0 2024-04-25T15:58:12.605 INFO:tasks.workunit.client.0.smithi087.stdout:4/735: chown d4/d10/d60/d52/d66/fbe 29066397 1 2024-04-25T15:58:12.606 INFO:tasks.workunit.client.0.smithi087.stdout:0/782: sync 2024-04-25T15:58:12.607 INFO:tasks.workunit.client.0.smithi087.stdout:5/730: mkdir d9/d2f/d40/d4d/d7b/dea 0 2024-04-25T15:58:12.609 INFO:tasks.workunit.client.0.smithi087.stdout:8/723: truncate d4/f4a 5102013 0 2024-04-25T15:58:12.610 INFO:tasks.workunit.client.0.smithi087.stdout:4/736: write d4/d10/d60/d56/d61/d3f/d42/f88 [3861357,4259] 0 2024-04-25T15:58:12.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/647: rename d6/d8/d12/db7/d3a/d5b/d60/f53 to d6/d8/d32/fc7 0 2024-04-25T15:58:12.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/648: creat d4/d17/d81/da6/d53/d7d/fcb x:0 0 0 2024-04-25T15:58:12.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/464: getdents d1/d4 0 2024-04-25T15:58:12.613 INFO:tasks.workunit.client.0.smithi087.stdout:8/724: chown d4/d1d/f47 399739553 1 2024-04-25T15:58:12.614 INFO:tasks.workunit.client.0.smithi087.stdout:5/731: fdatasync d9/d91/f65 0 2024-04-25T15:58:12.617 INFO:tasks.workunit.client.0.smithi087.stdout:7/465: symlink d1/d4/d18/l93 0 2024-04-25T15:58:12.617 INFO:tasks.workunit.client.0.smithi087.stdout:9/648: dread - d6/d8/d12/db7/d3a/d5b/d60/d1d/fc0 zero size 2024-04-25T15:58:12.618 INFO:tasks.workunit.client.0.smithi087.stdout:3/649: write d4/d17/d24/d29/d58/dac/dc0/f6e [4984639,102294] 0 2024-04-25T15:58:12.618 INFO:tasks.workunit.client.0.smithi087.stdout:8/725: unlink d4/d22/c45 0 2024-04-25T15:58:12.620 INFO:tasks.workunit.client.0.smithi087.stdout:7/466: write d1/d4/d18/d36/d37/f73 [203958,130590] 0 2024-04-25T15:58:12.620 INFO:tasks.workunit.client.0.smithi087.stdout:2/643: rename d3/d27/d29/l5d to d3/d20/d4a/d8e/lc7 0 2024-04-25T15:58:12.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/649: fsync d6/d8/d12/db7/d3a/d58/f71 0 2024-04-25T15:58:12.623 INFO:tasks.workunit.client.0.smithi087.stdout:6/722: link d7/d71/d59/d90/da5/ld9 d7/d1a/d41/lf8 0 2024-04-25T15:58:12.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/650: dread d4/d17/d24/f56 [0,4194304] 0 2024-04-25T15:58:12.628 INFO:tasks.workunit.client.0.smithi087.stdout:9/650: rmdir d6/d8/d32 39 2024-04-25T15:58:12.628 INFO:tasks.workunit.client.0.smithi087.stdout:6/723: chown d7/d1a/d41/dbd/f3f 484 1 2024-04-25T15:58:12.629 INFO:tasks.workunit.client.0.smithi087.stdout:5/732: rmdir d9/d91/d30/d70/d79/d94 39 2024-04-25T15:58:12.633 INFO:tasks.workunit.client.0.smithi087.stdout:4/737: dwrite d4/d10/d60/d52/d66/d15/fe [0,4194304] 0 2024-04-25T15:58:12.636 INFO:tasks.workunit.client.0.smithi087.stdout:3/651: write d4/d17/d24/d29/d58/dac/dc0/d3c/f9e [183532,125029] 0 2024-04-25T15:58:12.639 INFO:tasks.workunit.client.0.smithi087.stdout:9/651: chown d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99 5 1 2024-04-25T15:58:12.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/726: dwrite d4/d1d/d17/d37/dc9/fce [0,4194304] 0 2024-04-25T15:58:12.648 INFO:tasks.workunit.client.0.smithi087.stdout:7/467: dwrite d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:12.651 INFO:tasks.workunit.client.0.smithi087.stdout:3/652: rmdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62 39 2024-04-25T15:58:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:2/644: dwrite d3/d27/d38/f67 [0,4194304] 0 2024-04-25T15:58:12.654 INFO:tasks.workunit.client.0.smithi087.stdout:8/727: fdatasync d4/d1d/d7c/fe3 0 2024-04-25T15:58:12.656 INFO:tasks.workunit.client.0.smithi087.stdout:9/652: write d6/d8/fc [3509313,83882] 0 2024-04-25T15:58:12.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/733: dwrite d9/d2f/fad [0,4194304] 0 2024-04-25T15:58:12.663 INFO:tasks.workunit.client.0.smithi087.stdout:8/728: write d4/d8/dd/d85/d86/f8f [3802611,124832] 0 2024-04-25T15:58:12.665 INFO:tasks.workunit.client.0.smithi087.stdout:6/724: dwrite d7/d1a/d1d/d21/d27/f73 [0,4194304] 0 2024-04-25T15:58:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:3/653: creat d4/d17/d24/d29/d58/dac/d99/fcc x:0 0 0 2024-04-25T15:58:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:7/468: dread d1/d1a/f66 [0,4194304] 0 2024-04-25T15:58:12.673 INFO:tasks.workunit.client.0.smithi087.stdout:7/469: symlink d1/d4/d18/d36/d37/l94 0 2024-04-25T15:58:12.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/729: rmdir d4/d8/dd/d2f/d6f 39 2024-04-25T15:58:12.676 INFO:tasks.workunit.client.0.smithi087.stdout:4/738: dwrite d4/d10/d60/d56/fb5 [0,4194304] 0 2024-04-25T15:58:12.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/654: read - d4/d17/d24/d29/d58/dac/d99/fcc zero size 2024-04-25T15:58:12.679 INFO:tasks.workunit.client.0.smithi087.stdout:5/734: link d9/d91/d30/d70/d82/cd5 d9/d2f/dbb/dde/ceb 0 2024-04-25T15:58:12.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/470: chown d1/d9/d26/d45/f4b 6105451 1 2024-04-25T15:58:12.682 INFO:tasks.workunit.client.0.smithi087.stdout:2/645: dread d3/d27/f3e [0,4194304] 0 2024-04-25T15:58:12.684 INFO:tasks.workunit.client.0.smithi087.stdout:8/730: write d4/d1d/de1/fac [2166528,73434] 0 2024-04-25T15:58:12.689 INFO:tasks.workunit.client.0.smithi087.stdout:5/735: read d9/d91/d30/d70/f8e [723322,119898] 0 2024-04-25T15:58:12.690 INFO:tasks.workunit.client.0.smithi087.stdout:3/655: write d4/d17/d81/da6/d53/d68/f92 [314378,48270] 0 2024-04-25T15:58:12.691 INFO:tasks.workunit.client.0.smithi087.stdout:6/725: dwrite d7/d1a/d7b/fa8 [0,4194304] 0 2024-04-25T15:58:12.691 INFO:tasks.workunit.client.0.smithi087.stdout:9/653: dwrite d6/d8/d12/db7/d3a/d5b/d60/d1d/fc0 [0,4194304] 0 2024-04-25T15:58:12.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/471: creat d1/d4/d18/d36/f95 x:0 0 0 2024-04-25T15:58:12.693 INFO:tasks.workunit.client.0.smithi087.stdout:2/646: chown d3/d27/d29/d2d/fa8 475 1 2024-04-25T15:58:12.693 INFO:tasks.workunit.client.0.smithi087.stdout:8/731: write d4/d1d/d14/fa5 [5504972,116068] 0 2024-04-25T15:58:12.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/736: write d9/d2f/f76 [717177,99298] 0 2024-04-25T15:58:12.696 INFO:tasks.workunit.client.0.smithi087.stdout:7/472: readlink d1/d4/d18/d36/l63 0 2024-04-25T15:58:12.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/739: dread d4/d10/d60/d56/fb5 [0,4194304] 0 2024-04-25T15:58:12.698 INFO:tasks.workunit.client.0.smithi087.stdout:2/647: write d3/d27/d29/d2d/f96 [1561921,710] 0 2024-04-25T15:58:12.701 INFO:tasks.workunit.client.0.smithi087.stdout:5/737: symlink d9/d91/d30/d56/lec 0 2024-04-25T15:58:12.703 INFO:tasks.workunit.client.0.smithi087.stdout:9/654: mknod d6/d8/d12/db7/d3a/d5b/cc8 0 2024-04-25T15:58:12.704 INFO:tasks.workunit.client.0.smithi087.stdout:8/732: mkdir d4/d1d/d17/d37/dea 0 2024-04-25T15:58:12.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.706+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d040704e0 con 0x7f0d04158a00 2024-04-25T15:58:12.713 INFO:tasks.workunit.client.0.smithi087.stdout:9/655: dwrite d6/d8/d12/db7/d3a/d58/f71 [0,4194304] 0 2024-04-25T15:58:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.710+0000 7f0cfa7fc640 1 -- 172.21.15.87:0/3691865760 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5669 (secure 0 0 0) 0x7f0cf400c070 con 0x7f0d04158a00 2024-04-25T15:58:12.714 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:58:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 40 2024-04-25T15:58:12.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ce806f400 msgr2=0x7f0ce8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ce806f400 0x7f0ce8071910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d000ae000 tx=0x7f0d000a7000 comp rx=0 tx=0).stop 2024-04-25T15:58:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 msgr2=0x7f0d041f1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d041f1960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4001b00 tx=0x7f0cf4014420 comp rx=0 tx=0).stop 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 shutdown_connections 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ce806f400 0x7f0ce8071910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d04158e10 0x7f0d041f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d04158a00 0x7f0d041f1960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 --2- 172.21.15.87:0/3691865760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d040adfb0 0x7f0d0413da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 >> 172.21.15.87:0/3691865760 conn(0x7f0d0406d650 msgr2=0x7f0d0414b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 shutdown_connections 2024-04-25T15:58:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:12.714+0000 7f0d0bdfd640 1 -- 172.21.15.87:0/3691865760 wait complete. 2024-04-25T15:58:12.720 INFO:tasks.workunit.client.0.smithi087.stdout:6/726: write d7/d71/f61 [1720583,35092] 0 2024-04-25T15:58:12.722 INFO:tasks.workunit.client.0.smithi087.stdout:7/473: dread d1/d9/d26/f60 [4194304,4194304] 0 2024-04-25T15:58:12.722 INFO:tasks.workunit.client.0.smithi087.stdout:9/656: link d6/d8/d12/db7/d3a/d5b/d60/d1d/fc0 d6/d8/d12/db7/d3a/d7c/fc9 0 2024-04-25T15:58:12.722 INFO:tasks.workunit.client.0.smithi087.stdout:8/733: dread d4/d8/dd/fbd [0,4194304] 0 2024-04-25T15:58:12.722 INFO:tasks.workunit.client.0.smithi087.stdout:2/648: truncate d3/d2a/d48/f65 4313041 0 2024-04-25T15:58:12.723 INFO:tasks.workunit.client.0.smithi087.stdout:6/727: chown d7/d1a/d1d/d21/d27/d2c/db4/fc6 21637147 1 2024-04-25T15:58:12.723 INFO:tasks.workunit.client.0.smithi087.stdout:9/657: fsync d6/d8/d12/db7/f73 0 2024-04-25T15:58:12.724 INFO:tasks.workunit.client.0.smithi087.stdout:9/658: chown d6/d8 5326063 1 2024-04-25T15:58:12.725 INFO:tasks.workunit.client.0.smithi087.stdout:2/649: fsync d3/d27/d38/d7e/fb5 0 2024-04-25T15:58:12.726 INFO:tasks.workunit.client.0.smithi087.stdout:6/728: rmdir d7/d1a/d7b 39 2024-04-25T15:58:12.726 INFO:tasks.workunit.client.0.smithi087.stdout:8/734: mknod d4/d1d/d7c/dae/db7/ceb 0 2024-04-25T15:58:12.730 INFO:tasks.workunit.client.0.smithi087.stdout:6/729: mkdir d7/d1a/d41/dbd/df0/df9 0 2024-04-25T15:58:12.731 INFO:tasks.workunit.client.0.smithi087.stdout:4/740: dwrite d4/d10/d60/d56/d61/d3f/d42/d97/f30 [0,4194304] 0 2024-04-25T15:58:12.733 INFO:tasks.workunit.client.0.smithi087.stdout:6/730: symlink d7/d1a/d41/dbd/d96/lfa 0 2024-04-25T15:58:12.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/731: chown d7/d1a/d1d/d8a/c9e 0 1 2024-04-25T15:58:12.738 INFO:tasks.workunit.client.0.smithi087.stdout:2/650: write d3/d20/f7f [1777246,85438] 0 2024-04-25T15:58:12.739 INFO:tasks.workunit.client.0.smithi087.stdout:4/741: creat d4/d10/d60/d56/ff7 x:0 0 0 2024-04-25T15:58:12.740 INFO:tasks.workunit.client.0.smithi087.stdout:8/735: dwrite d4/d1d/d17/d37/f3b [0,4194304] 0 2024-04-25T15:58:12.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/732: mkdir d7/d1a/d41/dbd/db9/dfb 0 2024-04-25T15:58:12.742 INFO:tasks.workunit.client.0.smithi087.stdout:2/651: write d3/d2a/d1c/f92 [989887,66212] 0 2024-04-25T15:58:12.743 INFO:tasks.workunit.client.0.smithi087.stdout:4/742: chown d4/d10/d60/d52/d66/f5d 3842 1 2024-04-25T15:58:12.744 INFO:tasks.workunit.client.0.smithi087.stdout:8/736: symlink d4/d8/dd/d85/dbc/dd2/lec 0 2024-04-25T15:58:12.745 INFO:tasks.workunit.client.0.smithi087.stdout:9/659: dread d6/d8/d12/f37 [0,4194304] 0 2024-04-25T15:58:12.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/733: symlink d7/d1a/d41/d9c/lfc 0 2024-04-25T15:58:12.746 INFO:tasks.workunit.client.0.smithi087.stdout:2/652: creat d3/d2a/d81/d93/fc8 x:0 0 0 2024-04-25T15:58:12.749 INFO:tasks.workunit.client.0.smithi087.stdout:4/743: creat d4/d10/d60/d52/d66/d15/df1/ff8 x:0 0 0 2024-04-25T15:58:12.752 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=5262 2024-04-25T15:58:12.752 INFO:tasks.mds_thrash.fs.[b]:waiting for 4 secs before reviving mds.c 2024-04-25T15:58:12.752 INFO:tasks.workunit.client.0.smithi087.stdout:4/744: truncate d4/d10/d60/d52/d66/d15/fd8 787890 0 2024-04-25T15:58:12.753 INFO:tasks.workunit.client.0.smithi087.stdout:8/737: creat d4/d8/db4/fed x:0 0 0 2024-04-25T15:58:12.753 INFO:tasks.workunit.client.0.smithi087.stdout:9/660: creat d6/d8/d48/fca x:0 0 0 2024-04-25T15:58:12.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/661: fdatasync d6/d8/d12/fbc 0 2024-04-25T15:58:12.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/745: chown d4/c50 30717 1 2024-04-25T15:58:12.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/738: mkdir d4/d1d/de1/dee 0 2024-04-25T15:58:12.758 INFO:tasks.workunit.client.0.smithi087.stdout:1/732: sync 2024-04-25T15:58:12.759 INFO:tasks.workunit.client.0.smithi087.stdout:2/653: dwrite d3/d2a/d48/d77/d79/f9a [0,4194304] 0 2024-04-25T15:58:12.759 INFO:tasks.workunit.client.0.smithi087.stdout:9/662: symlink d6/d3e/d63/lcb 0 2024-04-25T15:58:12.759 INFO:tasks.workunit.client.0.smithi087.stdout:8/739: write d4/d9c/db1/fcd [358311,2650] 0 2024-04-25T15:58:12.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/740: fdatasync d4/d8/fb 0 2024-04-25T15:58:12.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/654: chown d3/d2a/d48/d77/cbf 3057 1 2024-04-25T15:58:12.762 INFO:tasks.workunit.client.0.smithi087.stdout:4/746: truncate d4/d10/d60/d56/d61/d3f/d8a/fb4 400808 0 2024-04-25T15:58:12.762 INFO:tasks.workunit.client.0.smithi087.stdout:8/741: chown d4/d1d/d17/d72/fda 13 1 2024-04-25T15:58:12.764 INFO:tasks.workunit.client.0.smithi087.stdout:6/734: truncate d7/f2f 822298 0 2024-04-25T15:58:12.764 INFO:tasks.workunit.client.0.smithi087.stdout:6/735: readlink d7/d71/d59/d90/da5/lee 0 2024-04-25T15:58:12.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/655: dread d3/d27/d29/d4f/f70 [0,4194304] 0 2024-04-25T15:58:12.769 INFO:tasks.workunit.client.0.smithi087.stdout:4/747: rename d4/d10/d60/d52/d66/fc6 to d4/d10/d60/d52/d66/d15/df1/ff9 0 2024-04-25T15:58:12.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/663: write d6/d8/f96 [1604920,90089] 0 2024-04-25T15:58:12.772 INFO:tasks.workunit.client.0.smithi087.stdout:8/742: mkdir d4/d8/dd/d2f/d6f/def 0 2024-04-25T15:58:12.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/748: write d4/d10/f9e [1307374,75193] 0 2024-04-25T15:58:12.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/733: getdents d3/d12/d39/d64/dc0 0 2024-04-25T15:58:12.776 INFO:tasks.workunit.client.0.smithi087.stdout:8/743: rmdir d4/d9c/db1 39 2024-04-25T15:58:12.778 INFO:tasks.workunit.client.0.smithi087.stdout:9/664: rename d6/d8/d48/fca to d6/d8/d12/db7/d3a/fcc 0 2024-04-25T15:58:12.779 INFO:tasks.workunit.client.0.smithi087.stdout:8/744: symlink d4/d8/lf0 0 2024-04-25T15:58:12.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/734: link d3/d12/d14/d29/d2f/d61/la6 d3/d12/d14/d29/d2f/d61/lfa 0 2024-04-25T15:58:12.784 INFO:tasks.workunit.client.0.smithi087.stdout:6/736: read d7/f2f [126666,5404] 0 2024-04-25T15:58:12.786 INFO:tasks.workunit.client.0.smithi087.stdout:6/737: chown d7/d1a/d1d/d21/d27/d2c/d35/d45/fb2 6 1 2024-04-25T15:58:12.786 INFO:tasks.workunit.client.0.smithi087.stdout:9/665: mkdir d6/d8/d12/db7/d3a/d5b/d60/dcd 0 2024-04-25T15:58:12.787 INFO:tasks.workunit.client.0.smithi087.stdout:6/738: fdatasync d7/d1a/d1d/d21/d27/d2c/fc5 0 2024-04-25T15:58:12.789 INFO:tasks.workunit.client.0.smithi087.stdout:9/666: fdatasync d6/d8/d12/db7/fbe 0 2024-04-25T15:58:12.793 INFO:tasks.workunit.client.0.smithi087.stdout:6/739: mkdir d7/dfd 0 2024-04-25T15:58:12.793 INFO:tasks.workunit.client.0.smithi087.stdout:8/745: write d4/d1d/de1/fdb [802464,55156] 0 2024-04-25T15:58:12.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/740: chown d7/d1a/d7b/fa8 225725 1 2024-04-25T15:58:12.797 INFO:tasks.workunit.client.0.smithi087.stdout:9/667: dwrite d6/d8/d12/db7/d3a/f69 [0,4194304] 0 2024-04-25T15:58:12.798 INFO:tasks.workunit.client.0.smithi087.stdout:6/741: readlink d7/d1a/d41/la4 0 2024-04-25T15:58:12.800 INFO:tasks.workunit.client.0.smithi087.stdout:1/735: dwrite d3/f5a [0,4194304] 0 2024-04-25T15:58:12.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/668: mkdir d6/dce 0 2024-04-25T15:58:12.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/742: mknod d7/d1a/d41/dbd/db9/cfe 0 2024-04-25T15:58:12.809 INFO:tasks.workunit.client.0.smithi087.stdout:9/669: stat d6/fa0 0 2024-04-25T15:58:12.809 INFO:tasks.workunit.client.0.smithi087.stdout:8/746: dwrite d4/d1d/de1/da6/fcc [0,4194304] 0 2024-04-25T15:58:12.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/670: stat d6/d8/d12/db7/d3a/d5b/d60/c42 0 2024-04-25T15:58:12.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/736: truncate d3/d12/d4d/d7d/f8c 4698525 0 2024-04-25T15:58:12.814 INFO:tasks.workunit.client.0.smithi087.stdout:8/747: creat d4/d1d/d7c/dae/db7/ff1 x:0 0 0 2024-04-25T15:58:12.814 INFO:tasks.workunit.client.0.smithi087.stdout:1/737: fdatasync d3/d12/d14/d29/d65/fe7 0 2024-04-25T15:58:12.814 INFO:tasks.workunit.client.0.smithi087.stdout:9/671: chown d6/d8/d12/db7/d3a/d5b/d60/c1b 64612051 1 2024-04-25T15:58:12.815 INFO:tasks.workunit.client.0.smithi087.stdout:8/748: stat d4/d8/dd/d85/ld4 0 2024-04-25T15:58:12.815 INFO:tasks.workunit.client.0.smithi087.stdout:6/743: getdents d7/d1a/d41/dbd/d96 0 2024-04-25T15:58:12.816 INFO:tasks.workunit.client.0.smithi087.stdout:1/738: write d3/d12/d4d/d7d/fe4 [465785,7549] 0 2024-04-25T15:58:12.819 INFO:tasks.workunit.client.0.smithi087.stdout:9/672: rmdir d6 39 2024-04-25T15:58:12.821 INFO:tasks.workunit.client.0.smithi087.stdout:8/749: unlink d4/d22/d43/d7f/dc6/ddc/fc0 0 2024-04-25T15:58:12.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/744: dwrite d7/d1a/d41/f55 [0,4194304] 0 2024-04-25T15:58:12.827 INFO:tasks.workunit.client.0.smithi087.stdout:1/739: creat d3/d12/ffb x:0 0 0 2024-04-25T15:58:12.828 INFO:tasks.workunit.client.0.smithi087.stdout:9/673: creat d6/d8/d12/db7/d3a/d7c/fcf x:0 0 0 2024-04-25T15:58:12.830 INFO:tasks.workunit.client.0.smithi087.stdout:8/750: creat d4/ff2 x:0 0 0 2024-04-25T15:58:12.830 INFO:tasks.workunit.client.0.smithi087.stdout:6/745: symlink d7/d71/lff 0 2024-04-25T15:58:12.831 INFO:tasks.workunit.client.0.smithi087.stdout:6/746: chown d7/d1a/d1d/d21/d27/d2c/db4 5188449 1 2024-04-25T15:58:12.839 INFO:tasks.workunit.client.0.smithi087.stdout:8/751: dwrite d4/f73 [4194304,4194304] 0 2024-04-25T15:58:12.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/752: getdents d4/d8 0 2024-04-25T15:58:12.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/740: write d3/d12/d14/d29/f7c [933398,10269] 0 2024-04-25T15:58:12.849 INFO:tasks.workunit.client.0.smithi087.stdout:1/741: fdatasync d3/d12/d14/d33/d95/fac 0 2024-04-25T15:58:12.851 INFO:tasks.workunit.client.0.smithi087.stdout:8/753: link d4/l50 d4/d1d/d14/lf3 0 2024-04-25T15:58:12.852 INFO:tasks.workunit.client.0.smithi087.stdout:1/742: unlink d3/d12/d14/d29/d2f/d61/fec 0 2024-04-25T15:58:12.855 INFO:tasks.workunit.client.0.smithi087.stdout:9/674: dwrite d6/d8/d12/db7/d3a/d5b/d60/d1d/fc0 [0,4194304] 0 2024-04-25T15:58:12.857 INFO:tasks.workunit.client.0.smithi087.stdout:6/747: dwrite d7/d1a/d7b/f77 [0,4194304] 0 2024-04-25T15:58:12.859 INFO:tasks.workunit.client.0.smithi087.stdout:8/754: dread d4/d1d/d14/f31 [0,4194304] 0 2024-04-25T15:58:12.863 INFO:tasks.workunit.client.0.smithi087.stdout:8/755: truncate d4/d1d/d17/f91 4219651 0 2024-04-25T15:58:12.865 INFO:tasks.workunit.client.0.smithi087.stdout:1/743: dwrite d3/d12/d14/d33/feb [0,4194304] 0 2024-04-25T15:58:12.867 INFO:tasks.workunit.client.0.smithi087.stdout:6/748: link f6 d7/d71/d59/d90/da5/f100 0 2024-04-25T15:58:12.871 INFO:tasks.workunit.client.0.smithi087.stdout:1/744: rmdir d3/d12/d14/d29/d2f/d53/dca 39 2024-04-25T15:58:12.873 INFO:tasks.workunit.client.0.smithi087.stdout:6/749: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/f101 x:0 0 0 2024-04-25T15:58:12.875 INFO:tasks.workunit.client.0.smithi087.stdout:9/675: link d6/d8/d12/db7/d3a/d5b/d60/f95 d6/d8/d12/db7/d3a/d58/d72/fd0 0 2024-04-25T15:58:12.875 INFO:tasks.workunit.client.0.smithi087.stdout:6/750: write d7/f10 [6119100,24122] 0 2024-04-25T15:58:12.876 INFO:tasks.workunit.client.0.smithi087.stdout:1/745: creat d3/d12/d14/d33/ffc x:0 0 0 2024-04-25T15:58:12.879 INFO:tasks.workunit.client.0.smithi087.stdout:6/751: mknod d7/d1a/d7b/c102 0 2024-04-25T15:58:12.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/756: dwrite d4/d1d/d17/d37/fad [0,4194304] 0 2024-04-25T15:58:12.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/676: rename d6/d8/d12/db7/d3a/d7c/c9b to d6/d8/d12/db7/d3a/d58/d72/cd1 0 2024-04-25T15:58:12.885 INFO:tasks.workunit.client.0.smithi087.stdout:8/757: creat d4/d1d/d14/ff4 x:0 0 0 2024-04-25T15:58:12.886 INFO:tasks.workunit.client.0.smithi087.stdout:8/758: fdatasync d4/d1d/d14/fe0 0 2024-04-25T15:58:12.887 INFO:tasks.workunit.client.0.smithi087.stdout:8/759: fdatasync d4/d1d/de1/da6/fcc 0 2024-04-25T15:58:12.887 INFO:tasks.workunit.client.0.smithi087.stdout:9/677: fdatasync d6/d8/d48/f6d 0 2024-04-25T15:58:12.892 INFO:tasks.workunit.client.0.smithi087.stdout:1/746: dread d3/d12/d14/d29/d67/fa0 [0,4194304] 0 2024-04-25T15:58:12.893 INFO:tasks.workunit.client.0.smithi087.stdout:8/760: rename d4/d8/dd/f11 to d4/d1d/de1/d82/ff5 0 2024-04-25T15:58:12.894 INFO:tasks.workunit.client.0.smithi087.stdout:6/752: getdents d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d 0 2024-04-25T15:58:12.897 INFO:tasks.workunit.client.0.smithi087.stdout:9/678: dwrite d6/d8/d48/fb5 [0,4194304] 0 2024-04-25T15:58:12.898 INFO:tasks.workunit.client.0.smithi087.stdout:8/761: truncate d4/d8/dd/d85/dbc/fe2 1213351 0 2024-04-25T15:58:12.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/753: getdents d7/d1a/d41/d9c 0 2024-04-25T15:58:12.900 INFO:tasks.workunit.client.0.smithi087.stdout:6/754: stat d7/d1a/f9d 0 2024-04-25T15:58:12.903 INFO:tasks.workunit.client.0.smithi087.stdout:6/755: write d7/d71/d59/dc7/dec/fe8 [229621,60428] 0 2024-04-25T15:58:12.904 INFO:tasks.workunit.client.0.smithi087.stdout:6/756: readlink d7/d71/l87 0 2024-04-25T15:58:12.905 INFO:tasks.workunit.client.0.smithi087.stdout:8/762: dread d4/d1d/de1/fc1 [0,4194304] 0 2024-04-25T15:58:12.908 INFO:tasks.workunit.client.0.smithi087.stdout:9/679: dwrite d6/d3e/f91 [0,4194304] 0 2024-04-25T15:58:12.908 INFO:tasks.workunit.client.0.smithi087.stdout:6/757: unlink d7/fe7 0 2024-04-25T15:58:12.910 INFO:tasks.workunit.client.0.smithi087.stdout:1/747: write d3/d12/f26 [3026418,29279] 0 2024-04-25T15:58:12.912 INFO:tasks.workunit.client.0.smithi087.stdout:1/748: write d3/d12/d14/d29/d67/d73/d9c/ff2 [410135,31730] 0 2024-04-25T15:58:12.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/680: mkdir d6/d8/d12/db7/d3a/d58/d72/dd2 0 2024-04-25T15:58:12.914 INFO:tasks.workunit.client.0.smithi087.stdout:8/763: dwrite d4/d1d/de1/f8d [0,4194304] 0 2024-04-25T15:58:12.916 INFO:tasks.workunit.client.0.smithi087.stdout:1/749: creat d3/d12/d14/d29/d8e/ffd x:0 0 0 2024-04-25T15:58:12.921 INFO:tasks.workunit.client.0.smithi087.stdout:1/750: mkdir d3/dfe 0 2024-04-25T15:58:12.923 INFO:tasks.workunit.client.0.smithi087.stdout:9/681: rename d6/d8/d12/db7/ca6 to d6/d8/d48/cd3 0 2024-04-25T15:58:12.923 INFO:tasks.workunit.client.0.smithi087.stdout:6/758: dwrite f6 [4194304,4194304] 0 2024-04-25T15:58:12.925 INFO:tasks.workunit.client.0.smithi087.stdout:6/759: chown d7/d1a/d1d/d21/fa7 0 1 2024-04-25T15:58:12.926 INFO:tasks.workunit.client.0.smithi087.stdout:1/751: mkdir d3/d12/d14/d29/d2f/d53/dca/df1/dff 0 2024-04-25T15:58:12.927 INFO:tasks.workunit.client.0.smithi087.stdout:8/764: dwrite d4/d1d/d17/f2e [0,4194304] 0 2024-04-25T15:58:12.932 INFO:tasks.workunit.client.0.smithi087.stdout:8/765: rename d4/d1d/d17/d72/fda to d4/d1d/d7c/dae/db7/ff6 0 2024-04-25T15:58:12.934 INFO:tasks.workunit.client.0.smithi087.stdout:6/760: rmdir d7/d71/d59/df5 0 2024-04-25T15:58:12.936 INFO:tasks.workunit.client.0.smithi087.stdout:8/766: mkdir d4/d22/d43/d7f/dc6/df7 0 2024-04-25T15:58:12.936 INFO:tasks.workunit.client.0.smithi087.stdout:8/767: fsync d4/d1d/d7c/f23 0 2024-04-25T15:58:12.937 INFO:tasks.workunit.client.0.smithi087.stdout:1/752: creat d3/f100 x:0 0 0 2024-04-25T15:58:12.938 INFO:tasks.workunit.client.0.smithi087.stdout:6/761: unlink d7/d1a/d1d/d21/d27/d2c/cac 0 2024-04-25T15:58:12.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/768: mkdir d4/d1d/d7c/dae/df8 0 2024-04-25T15:58:12.941 INFO:tasks.workunit.client.0.smithi087.stdout:1/753: creat d3/d12/d14/d29/d67/d73/d9c/f101 x:0 0 0 2024-04-25T15:58:12.942 INFO:tasks.workunit.client.0.smithi087.stdout:6/762: fsync d7/d1a/d1d/d21/d27/d2c/db4/fc6 0 2024-04-25T15:58:12.943 INFO:tasks.workunit.client.0.smithi087.stdout:1/754: write d3/d12/d14/d29/d2f/d53/fb0 [2434980,40530] 0 2024-04-25T15:58:12.944 INFO:tasks.workunit.client.0.smithi087.stdout:6/763: chown d7/d1a/d1d/l67 14956151 1 2024-04-25T15:58:12.947 INFO:tasks.workunit.client.0.smithi087.stdout:8/769: rename d4/d1d/de1/fac to d4/d1d/d17/ff9 0 2024-04-25T15:58:12.948 INFO:tasks.workunit.client.0.smithi087.stdout:8/770: dread - d4/d1d/d7c/fe3 zero size 2024-04-25T15:58:12.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/771: readlink d4/d1d/d17/l36 0 2024-04-25T15:58:12.951 INFO:tasks.workunit.client.0.smithi087.stdout:6/764: dwrite d7/d71/d76/fcb [0,4194304] 0 2024-04-25T15:58:12.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/755: link d3/d12/d4d/d7d/fc6 d3/d12/d4d/da5/f102 0 2024-04-25T15:58:12.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/783: sync 2024-04-25T15:58:12.959 INFO:tasks.workunit.client.0.smithi087.stdout:8/772: dwrite d4/d1d/de1/fc1 [0,4194304] 0 2024-04-25T15:58:12.960 INFO:tasks.workunit.client.0.smithi087.stdout:8/773: fsync d4/d1d/d14/fa5 0 2024-04-25T15:58:12.963 INFO:tasks.workunit.client.0.smithi087.stdout:1/756: creat d3/d12/d14/d33/d95/f103 x:0 0 0 2024-04-25T15:58:12.963 INFO:tasks.workunit.client.0.smithi087.stdout:6/765: creat d7/d1a/d41/f103 x:0 0 0 2024-04-25T15:58:12.967 INFO:tasks.workunit.client.0.smithi087.stdout:8/774: write d4/d1d/d14/f6b [1551389,46377] 0 2024-04-25T15:58:12.969 INFO:tasks.workunit.client.0.smithi087.stdout:1/757: mkdir d3/d12/d14/d29/d2f/d53/dca/d104 0 2024-04-25T15:58:12.969 INFO:tasks.workunit.client.0.smithi087.stdout:8/775: write d4/d8/dd/d2f/d6f/fc4 [1621823,108267] 0 2024-04-25T15:58:12.970 INFO:tasks.workunit.client.0.smithi087.stdout:8/776: write d4/d8/dd/fbd [950981,43843] 0 2024-04-25T15:58:12.971 INFO:tasks.workunit.client.0.smithi087.stdout:6/766: creat d7/d1a/d1d/d21/d27/d2c/d35/f104 x:0 0 0 2024-04-25T15:58:12.973 INFO:tasks.workunit.client.0.smithi087.stdout:0/784: truncate d1/d6/d21/f23 7839741 0 2024-04-25T15:58:12.976 INFO:tasks.workunit.client.0.smithi087.stdout:1/758: dwrite d3/d12/d14/d29/d67/d73/d9c/faf [0,4194304] 0 2024-04-25T15:58:12.978 INFO:tasks.workunit.client.0.smithi087.stdout:6/767: mknod d7/d1a/d41/dbd/df0/c105 0 2024-04-25T15:58:12.980 INFO:tasks.workunit.client.0.smithi087.stdout:8/777: unlink d4/d1d/d17/c4b 0 2024-04-25T15:58:12.981 INFO:tasks.workunit.client.0.smithi087.stdout:1/759: creat d3/d12/d14/d29/d3b/f105 x:0 0 0 2024-04-25T15:58:12.981 INFO:tasks.workunit.client.0.smithi087.stdout:1/760: chown d3/dfe 489 1 2024-04-25T15:58:12.981 INFO:tasks.workunit.client.0.smithi087.stdout:0/785: mknod d1/de9/c107 0 2024-04-25T15:58:12.983 INFO:tasks.workunit.client.0.smithi087.stdout:8/778: creat d4/d8/ffa x:0 0 0 2024-04-25T15:58:12.985 INFO:tasks.workunit.client.0.smithi087.stdout:8/779: write d4/d1d/d14/fa5 [846233,116250] 0 2024-04-25T15:58:12.985 INFO:tasks.workunit.client.0.smithi087.stdout:1/761: dread d3/d12/d14/d29/d65/ff4 [0,4194304] 0 2024-04-25T15:58:12.986 INFO:tasks.workunit.client.0.smithi087.stdout:8/780: write d4/d22/d43/d7f/f99 [1015290,5016] 0 2024-04-25T15:58:12.990 INFO:tasks.workunit.client.0.smithi087.stdout:6/768: link d7/f18 d7/d1a/d1d/d21/d27/d2c/f106 0 2024-04-25T15:58:13.009 INFO:tasks.workunit.client.0.smithi087.stdout:0/786: truncate d1/d6/db1/dc0/dd3/dff/d82/f8e 3522320 0 2024-04-25T15:58:13.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/787: creat d1/de9/f108 x:0 0 0 2024-04-25T15:58:13.016 INFO:tasks.workunit.client.0.smithi087.stdout:1/762: dwrite d3/d2d/d6c/fd4 [0,4194304] 0 2024-04-25T15:58:13.016 INFO:tasks.workunit.client.0.smithi087.stdout:6/769: dwrite d7/d1a/d41/d9c/fce [0,4194304] 0 2024-04-25T15:58:13.017 INFO:tasks.workunit.client.0.smithi087.stdout:6/770: write d7/f12 [2407012,16726] 0 2024-04-25T15:58:13.038 INFO:tasks.workunit.client.0.smithi087.stdout:6/771: dwrite d7/d1a/d1d/d21/d27/d2c/d35/f83 [0,4194304] 0 2024-04-25T15:58:13.040 INFO:tasks.workunit.client.0.smithi087.stdout:0/788: dwrite d1/da/d3e/d54/d34/d55/fad [0,4194304] 0 2024-04-25T15:58:13.042 INFO:tasks.workunit.client.0.smithi087.stdout:0/789: rmdir d1/d6 39 2024-04-25T15:58:13.045 INFO:tasks.workunit.client.0.smithi087.stdout:6/772: rename d7/d1a/d41/dbd/db9/dc2 to d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107 0 2024-04-25T15:58:13.050 INFO:tasks.workunit.client.0.smithi087.stdout:8/781: dread d4/d8/dd/d2f/f80 [0,4194304] 0 2024-04-25T15:58:13.053 INFO:tasks.workunit.client.0.smithi087.stdout:8/782: write d4/d8/f49 [1410811,81375] 0 2024-04-25T15:58:13.054 INFO:tasks.workunit.client.0.smithi087.stdout:6/773: creat d7/d1a/d41/dbd/df0/df9/f108 x:0 0 0 2024-04-25T15:58:13.060 INFO:tasks.workunit.client.0.smithi087.stdout:6/774: dwrite d7/fc [4194304,4194304] 0 2024-04-25T15:58:13.061 INFO:tasks.workunit.client.0.smithi087.stdout:0/790: truncate d1/da/d3e/d54/f88 3553388 0 2024-04-25T15:58:13.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/791: write d1/d4f/f7b [3433588,123821] 0 2024-04-25T15:58:13.063 INFO:tasks.workunit.client.0.smithi087.stdout:6/775: getdents d7/d1a/d41/dbd/d96 0 2024-04-25T15:58:13.064 INFO:tasks.workunit.client.0.smithi087.stdout:0/792: fsync d1/d27/f76 0 2024-04-25T15:58:13.068 INFO:tasks.workunit.client.0.smithi087.stdout:0/793: mkdir d1/da/d3e/db2/dba/d109 0 2024-04-25T15:58:13.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/776: mkdir d7/d1a/d1d/d21/d109 0 2024-04-25T15:58:13.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/777: readlink d7/d1a/d1d/lf4 0 2024-04-25T15:58:13.071 INFO:tasks.workunit.client.0.smithi087.stdout:6/778: write d7/d1a/d1d/d21/d27/d2c/d35/f97 [776813,13068] 0 2024-04-25T15:58:13.072 INFO:tasks.workunit.client.0.smithi087.stdout:0/794: truncate d1/d6/d21/d2a/fe7 558186 0 2024-04-25T15:58:13.073 INFO:tasks.workunit.client.0.smithi087.stdout:6/779: read d7/d1a/d1d/d21/d27/d2c/f5c [1619358,11720] 0 2024-04-25T15:58:13.078 INFO:tasks.workunit.client.0.smithi087.stdout:6/780: getdents d7/d1a/d1d/d21/d27/d2c/db4 0 2024-04-25T15:58:13.084 INFO:tasks.workunit.client.0.smithi087.stdout:0/795: rename d1/da/d3e/db2 to d1/da/d3e/d85/d9b/d10a 0 2024-04-25T15:58:13.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/796: dread - d1/d4f/de3/df5/fec zero size 2024-04-25T15:58:13.087 INFO:tasks.workunit.client.0.smithi087.stdout:0/797: read d1/f3d [1408391,34459] 0 2024-04-25T15:58:13.090 INFO:tasks.workunit.client.0.smithi087.stdout:6/781: rename d7/d71/d76/f8e to d7/d1a/d1d/d21/f10a 0 2024-04-25T15:58:13.091 INFO:tasks.workunit.client.0.smithi087.stdout:0/798: fdatasync d1/d6/d21/d2a/f6f 0 2024-04-25T15:58:13.091 INFO:tasks.workunit.client.0.smithi087.stdout:6/782: chown d7/d1a/d1d/d21 508560433 1 2024-04-25T15:58:13.093 INFO:tasks.workunit.client.0.smithi087.stdout:0/799: read d1/da/d3e/d54/d34/fa6 [3994958,128934] 0 2024-04-25T15:58:13.095 INFO:tasks.workunit.client.0.smithi087.stdout:0/800: unlink d1/cda 0 2024-04-25T15:58:13.095 INFO:tasks.workunit.client.0.smithi087.stdout:0/801: readlink d1/da/d3e/d85/d9b/d10a/lc7 0 2024-04-25T15:58:13.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/802: chown d1/da/d3e/d85/d9b/d10a 60 1 2024-04-25T15:58:13.097 INFO:tasks.workunit.client.0.smithi087.stdout:6/783: dwrite d7/d71/f61 [0,4194304] 0 2024-04-25T15:58:13.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/803: dread - d1/d6/d77/fa8 zero size 2024-04-25T15:58:13.099 INFO:tasks.workunit.client.0.smithi087.stdout:6/784: write d7/d1a/d41/dbd/faa [184470,77280] 0 2024-04-25T15:58:13.100 INFO:tasks.workunit.client.0.smithi087.stdout:6/785: readlink d7/d1a/d41/dbd/laf 0 2024-04-25T15:58:13.103 INFO:tasks.workunit.client.0.smithi087.stdout:0/804: dread d1/da/d3e/d54/f91 [0,4194304] 0 2024-04-25T15:58:13.104 INFO:tasks.workunit.client.0.smithi087.stdout:6/786: symlink d7/d1a/d1d/d21/d27/d2c/d35/l10b 0 2024-04-25T15:58:13.106 INFO:tasks.workunit.client.0.smithi087.stdout:6/787: mkdir d7/d1a/d7b/d10c 0 2024-04-25T15:58:13.108 INFO:tasks.workunit.client.0.smithi087.stdout:0/805: link d1/d6/d21/d2a/c3f d1/d6/d104/c10b 0 2024-04-25T15:58:13.109 INFO:tasks.workunit.client.0.smithi087.stdout:0/806: chown d1/da/d3e/d54/d34/d55/f78 3 1 2024-04-25T15:58:13.110 INFO:tasks.workunit.client.0.smithi087.stdout:0/807: chown d1/d6/db1/dc0/dd3/dff/d82 8176 1 2024-04-25T15:58:13.121 INFO:tasks.workunit.client.0.smithi087.stdout:3/656: sync 2024-04-25T15:58:13.124 INFO:tasks.workunit.client.0.smithi087.stdout:6/788: dread d7/d1a/d1d/f60 [0,4194304] 0 2024-04-25T15:58:13.125 INFO:tasks.workunit.client.0.smithi087.stdout:3/657: unlink d4/d17/d81/da6/d23/lc6 0 2024-04-25T15:58:13.126 INFO:tasks.workunit.client.0.smithi087.stdout:0/808: dwrite d1/dab/df4/f106 [0,4194304] 0 2024-04-25T15:58:13.128 INFO:tasks.workunit.client.0.smithi087.stdout:6/789: creat d7/d1a/d41/dbd/df0/df9/f10d x:0 0 0 2024-04-25T15:58:13.129 INFO:tasks.workunit.client.0.smithi087.stdout:6/790: write d7/d1a/d1d/d21/d27/ff6 [865717,120569] 0 2024-04-25T15:58:13.130 INFO:tasks.workunit.client.0.smithi087.stdout:3/658: truncate d4/d17/d24/d29/d58/dac/dc0/d5c/f77 172128 0 2024-04-25T15:58:13.132 INFO:tasks.workunit.client.0.smithi087.stdout:0/809: symlink d1/dab/df4/l10c 0 2024-04-25T15:58:13.133 INFO:tasks.workunit.client.0.smithi087.stdout:0/810: write d1/d6/db1/dc0/dd3/dff/d50/fb8 [370454,34300] 0 2024-04-25T15:58:13.135 INFO:tasks.workunit.client.0.smithi087.stdout:3/659: creat d4/d17/d24/d29/d58/fcd x:0 0 0 2024-04-25T15:58:13.137 INFO:tasks.workunit.client.0.smithi087.stdout:6/791: rmdir d7/d1a/d1d/d21/d109 0 2024-04-25T15:58:13.138 INFO:tasks.workunit.client.0.smithi087.stdout:3/660: rename d4/d17/d24/d29/d58/dac/dc0/d3c/fbc to d4/d17/d81/da6/d37/d51/fce 0 2024-04-25T15:58:13.141 INFO:tasks.workunit.client.0.smithi087.stdout:3/661: chown d4/d17/d24/d29/d58/dac/dc0/l91 2 1 2024-04-25T15:58:13.141 INFO:tasks.workunit.client.0.smithi087.stdout:0/811: dwrite d1/da/d3e/d85/d9b/fbf [0,4194304] 0 2024-04-25T15:58:13.142 INFO:tasks.workunit.client.0.smithi087.stdout:6/792: unlink d7/d1a/d1d/ld1 0 2024-04-25T15:58:13.142 INFO:tasks.workunit.client.0.smithi087.stdout:3/662: readlink d4/d17/d24/d29/d58/dac/dc0/d5c/l9f 0 2024-04-25T15:58:13.148 INFO:tasks.workunit.client.0.smithi087.stdout:3/663: unlink d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/laf 0 2024-04-25T15:58:13.149 INFO:tasks.workunit.client.0.smithi087.stdout:3/664: write d4/db/fc [285072,108098] 0 2024-04-25T15:58:13.152 INFO:tasks.workunit.client.0.smithi087.stdout:0/812: dwrite d1/da/d3e/d54/f38 [0,4194304] 0 2024-04-25T15:58:13.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/665: dread d4/d17/d81/da6/d53/d68/f5d [0,4194304] 0 2024-04-25T15:58:13.160 INFO:tasks.workunit.client.0.smithi087.stdout:0/813: getdents d1/d27/d7d/d84 0 2024-04-25T15:58:13.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/793: write d7/d1a/d41/dbd/fe2 [7683737,97474] 0 2024-04-25T15:58:13.162 INFO:tasks.workunit.client.0.smithi087.stdout:6/794: chown d7/d1a/d7b/ld3 32 1 2024-04-25T15:58:13.164 INFO:tasks.workunit.client.0.smithi087.stdout:3/666: write d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f34 [519217,21712] 0 2024-04-25T15:58:13.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/795: link d7/d1a/d1d/d21/d27/d2c/db4/fea d7/d1a/d41/dbd/db9/f10e 0 2024-04-25T15:58:13.170 INFO:tasks.workunit.client.0.smithi087.stdout:3/667: creat d4/d17/d81/da6/d37/d51/fcf x:0 0 0 2024-04-25T15:58:13.171 INFO:tasks.workunit.client.0.smithi087.stdout:0/814: truncate d1/f58 1765660 0 2024-04-25T15:58:13.173 INFO:tasks.workunit.client.0.smithi087.stdout:3/668: symlink d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/ld0 0 2024-04-25T15:58:13.175 INFO:tasks.workunit.client.0.smithi087.stdout:6/796: creat d7/d1a/d1d/d21/d27/d2c/f10f x:0 0 0 2024-04-25T15:58:13.176 INFO:tasks.workunit.client.0.smithi087.stdout:3/669: creat d4/d17/d24/d29/d58/dac/d99/fd1 x:0 0 0 2024-04-25T15:58:13.182 INFO:tasks.workunit.client.0.smithi087.stdout:3/670: getdents d4/d17/d24/d29/d58/dac/d9c 0 2024-04-25T15:58:13.183 INFO:tasks.workunit.client.0.smithi087.stdout:3/671: write d4/d17/d24/d29/d58/dac/d9c/fab [1975844,14766] 0 2024-04-25T15:58:13.189 INFO:tasks.workunit.client.0.smithi087.stdout:3/672: mknod d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da0/cd2 0 2024-04-25T15:58:13.189 INFO:tasks.workunit.client.0.smithi087.stdout:3/673: fsync d4/d17/d81/da6/d53/d68/f92 0 2024-04-25T15:58:13.193 INFO:tasks.workunit.client.0.smithi087.stdout:3/674: write d4/d17/d24/d29/d58/dac/dc0/d82/f86 [3897885,124922] 0 2024-04-25T15:58:13.195 INFO:tasks.workunit.client.0.smithi087.stdout:6/797: dwrite d7/d1a/d2a/f7e [0,4194304] 0 2024-04-25T15:58:13.196 INFO:tasks.workunit.client.0.smithi087.stdout:6/798: chown d7/d1a/d1d/d21/d27/d2c/f9b 498289552 1 2024-04-25T15:58:13.205 INFO:tasks.workunit.client.0.smithi087.stdout:3/675: write d4/d17/f1b [349658,15810] 0 2024-04-25T15:58:13.205 INFO:tasks.workunit.client.0.smithi087.stdout:6/799: dwrite d7/d1a/d41/dbd/df0/df9/f10d [0,4194304] 0 2024-04-25T15:58:13.206 INFO:tasks.workunit.client.0.smithi087.stdout:3/676: write d4/db/f47 [4958033,28443] 0 2024-04-25T15:58:13.209 INFO:tasks.workunit.client.0.smithi087.stdout:3/677: truncate d4/d17/d81/da6/d23/f7c 592533 0 2024-04-25T15:58:13.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/678: chown d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/fbd 4 1 2024-04-25T15:58:13.214 INFO:tasks.workunit.client.0.smithi087.stdout:6/800: dwrite d7/d1a/d1d/d21/f5f [0,4194304] 0 2024-04-25T15:58:13.215 INFO:tasks.workunit.client.0.smithi087.stdout:3/679: mkdir d4/d17/d24/d29/d58/dac/dc9/dd3 0 2024-04-25T15:58:13.216 INFO:tasks.workunit.client.0.smithi087.stdout:6/801: symlink d7/d1a/d41/dbd/db9/l110 0 2024-04-25T15:58:13.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/802: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/c111 0 2024-04-25T15:58:13.224 INFO:tasks.workunit.client.0.smithi087.stdout:3/680: write d4/d17/f63 [881319,115992] 0 2024-04-25T15:58:13.226 INFO:tasks.workunit.client.0.smithi087.stdout:6/803: dwrite d7/d1a/d2a/f7e [0,4194304] 0 2024-04-25T15:58:13.227 INFO:tasks.workunit.client.0.smithi087.stdout:3/681: symlink d4/d17/d81/da6/d53/d7d/ld4 0 2024-04-25T15:58:13.228 INFO:tasks.workunit.client.0.smithi087.stdout:6/804: fdatasync d7/d1a/f51 0 2024-04-25T15:58:13.232 INFO:tasks.workunit.client.0.smithi087.stdout:6/805: symlink d7/d1a/d7b/l112 0 2024-04-25T15:58:13.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/682: dwrite d4/d17/f1e [0,4194304] 0 2024-04-25T15:58:13.244 INFO:tasks.workunit.client.0.smithi087.stdout:3/683: rename d4/d17/d81/da6/d53/d7d/f98 to d4/d17/d24/d29/fd5 0 2024-04-25T15:58:13.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/806: truncate d7/d1a/d2a/f7e 3823119 0 2024-04-25T15:58:13.258 INFO:tasks.workunit.client.0.smithi087.stdout:3/684: dwrite d4/d17/d24/d29/d58/dac/d9c/fab [0,4194304] 0 2024-04-25T15:58:13.259 INFO:tasks.workunit.client.0.smithi087.stdout:6/807: dwrite d7/d1a/d1d/d21/d27/ff6 [0,4194304] 0 2024-04-25T15:58:13.265 INFO:tasks.workunit.client.0.smithi087.stdout:3/685: dwrite d4/db/f47 [0,4194304] 0 2024-04-25T15:58:13.265 INFO:tasks.workunit.client.0.smithi087.stdout:3/686: dread - d4/d17/d24/d29/d58/dac/d99/fcc zero size 2024-04-25T15:58:13.267 INFO:tasks.workunit.client.0.smithi087.stdout:6/808: getdents d7/d1a/d1d 0 2024-04-25T15:58:13.268 INFO:tasks.workunit.client.0.smithi087.stdout:6/809: write d7/d71/d59/d90/da5/fc0 [320893,120348] 0 2024-04-25T15:58:13.271 INFO:tasks.workunit.client.0.smithi087.stdout:6/810: creat d7/d71/d59/f113 x:0 0 0 2024-04-25T15:58:13.278 INFO:tasks.workunit.client.0.smithi087.stdout:6/811: dwrite d7/d71/d59/f113 [0,4194304] 0 2024-04-25T15:58:13.280 INFO:tasks.workunit.client.0.smithi087.stdout:6/812: fsync d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/fb8 0 2024-04-25T15:58:13.281 INFO:tasks.workunit.client.0.smithi087.stdout:6/813: stat d7/d1a/d41/dbd/f3f 0 2024-04-25T15:58:13.284 INFO:tasks.workunit.client.0.smithi087.stdout:6/814: write d7/d1a/d1d/d21/d27/d2c/d35/d45/fb2 [1046476,102773] 0 2024-04-25T15:58:13.284 INFO:tasks.workunit.client.0.smithi087.stdout:6/815: fdatasync d7/fc 0 2024-04-25T15:58:13.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/816: mknod d7/d71/d76/c114 0 2024-04-25T15:58:13.287 INFO:tasks.workunit.client.0.smithi087.stdout:5/738: sync 2024-04-25T15:58:13.288 INFO:tasks.workunit.client.0.smithi087.stdout:6/817: rmdir d7/d1a/d7b 39 2024-04-25T15:58:13.289 INFO:tasks.workunit.client.0.smithi087.stdout:6/818: chown d7/d1a/d1d/d21/d27/d2c/d35/f104 79451096 1 2024-04-25T15:58:13.290 INFO:tasks.workunit.client.0.smithi087.stdout:6/819: chown d7/d1a/fe6 20307345 1 2024-04-25T15:58:13.291 INFO:tasks.workunit.client.0.smithi087.stdout:5/739: getdents d9 0 2024-04-25T15:58:13.295 INFO:tasks.workunit.client.0.smithi087.stdout:6/820: getdents d7/d1a/d1d/d21/d27/d2c/d35/d45/dca 0 2024-04-25T15:58:13.297 INFO:tasks.workunit.client.0.smithi087.stdout:6/821: symlink d7/d71/d59/dc7/dec/l115 0 2024-04-25T15:58:13.300 INFO:tasks.workunit.client.0.smithi087.stdout:5/740: dwrite d9/d2f/d40/d4d/d7b/d5c/d5f/d44/fc3 [0,4194304] 0 2024-04-25T15:58:13.303 INFO:tasks.workunit.client.0.smithi087.stdout:5/741: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fc4 985384 0 2024-04-25T15:58:13.307 INFO:tasks.workunit.client.0.smithi087.stdout:5/742: truncate d9/d2f/d40/d4d/d58/fce 407042 0 2024-04-25T15:58:13.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/822: write d7/f40 [4107360,12619] 0 2024-04-25T15:58:13.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/743: read d9/d2f/dbb/fc2 [1039672,90725] 0 2024-04-25T15:58:13.312 INFO:tasks.workunit.client.0.smithi087.stdout:6/823: write d7/d1a/fc4 [525729,75706] 0 2024-04-25T15:58:13.315 INFO:tasks.workunit.client.0.smithi087.stdout:5/744: rename d9/d2f/d40/d4d/d7a to d9/d91/d38/ded 0 2024-04-25T15:58:13.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/824: rename d7/d1a/d41/dbd/l75 to d7/d1a/d41/d9c/l116 0 2024-04-25T15:58:13.333 INFO:tasks.workunit.client.0.smithi087.stdout:6/825: dread d7/d1a/d1d/d8a/fe1 [0,4194304] 0 2024-04-25T15:58:13.335 INFO:tasks.workunit.client.0.smithi087.stdout:6/826: mknod d7/c117 0 2024-04-25T15:58:13.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/827: chown d7/d1a/d1d/d8a/leb 1864468110 1 2024-04-25T15:58:13.342 INFO:tasks.workunit.client.0.smithi087.stdout:6/828: dwrite d7/d1a/d7b/f77 [0,4194304] 0 2024-04-25T15:58:13.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/829: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/fb8 [0,4194304] 0 2024-04-25T15:58:13.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/830: dread d7/d1a/d7b/fa8 [0,4194304] 0 2024-04-25T15:58:13.356 INFO:tasks.workunit.client.0.smithi087.stdout:6/831: mknod d7/d1a/d7b/c118 0 2024-04-25T15:58:13.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/832: creat d7/d1a/d1d/d21/d27/d2c/f119 x:0 0 0 2024-04-25T15:58:13.362 INFO:tasks.workunit.client.0.smithi087.stdout:6/833: symlink d7/d1a/d41/dbd/df0/df9/l11a 0 2024-04-25T15:58:13.369 INFO:tasks.workunit.client.0.smithi087.stdout:6/834: dwrite d7/d71/d59/d90/da5/fc0 [0,4194304] 0 2024-04-25T15:58:13.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/835: dread d7/fdf [0,4194304] 0 2024-04-25T15:58:13.392 INFO:tasks.workunit.client.0.smithi087.stdout:6/836: write d7/d71/d59/d90/f95 [1153321,97456] 0 2024-04-25T15:58:13.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/837: rmdir d7/d1a/d1d/d21/d27 39 2024-04-25T15:58:13.396 INFO:tasks.workunit.client.0.smithi087.stdout:6/838: mknod d7/d1a/d1d/d21/d27/d2c/d35/c11b 0 2024-04-25T15:58:13.398 INFO:tasks.workunit.client.0.smithi087.stdout:6/839: symlink d7/d71/l11c 0 2024-04-25T15:58:13.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/840: write d7/fc [8730469,121806] 0 2024-04-25T15:58:13.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/841: creat d7/d1a/d41/dbd/d96/f11d x:0 0 0 2024-04-25T15:58:13.403 INFO:tasks.workunit.client.0.smithi087.stdout:6/842: mknod d7/d1a/d2a/c11e 0 2024-04-25T15:58:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:7/474: sync 2024-04-25T15:58:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/749: sync 2024-04-25T15:58:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:2/656: sync 2024-04-25T15:58:13.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/657: chown d3/d27/d29/d4f/d5a/d6a/cc6 1839276 1 2024-04-25T15:58:13.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/843: rename d7/d1a/d41/f44 to d7/d1a/d41/dbd/df0/f11f 0 2024-04-25T15:58:13.409 INFO:tasks.workunit.client.0.smithi087.stdout:2/658: rename d3/d20/f45 to d3/d27/d29/d4f/d5a/d6a/d88/fc9 0 2024-04-25T15:58:13.410 INFO:tasks.workunit.client.0.smithi087.stdout:4/750: mknod d4/d10/d60/d5c/d3a/cfa 0 2024-04-25T15:58:13.412 INFO:tasks.workunit.client.0.smithi087.stdout:4/751: write d4/d10/d60/d56/d61/db7/fea [770590,88113] 0 2024-04-25T15:58:13.412 INFO:tasks.workunit.client.0.smithi087.stdout:6/844: mkdir d7/d1a/d41/dbd/df0/d120 0 2024-04-25T15:58:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:2/659: fsync d3/d2a/f8f 0 2024-04-25T15:58:13.416 INFO:tasks.workunit.client.0.smithi087.stdout:2/660: read d3/d27/d38/f74 [121389,62628] 0 2024-04-25T15:58:13.418 INFO:tasks.workunit.client.0.smithi087.stdout:7/475: dread d1/d9/d26/f53 [0,4194304] 0 2024-04-25T15:58:13.419 INFO:tasks.workunit.client.0.smithi087.stdout:7/476: readlink d1/d4/d18/l2b 0 2024-04-25T15:58:13.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/477: truncate d1/d3c/d6b/f84 901755 0 2024-04-25T15:58:13.421 INFO:tasks.workunit.client.0.smithi087.stdout:6/845: rename d7/d71/d59/d90/da5/ld9 to d7/d71/d59/dc7/l121 0 2024-04-25T15:58:13.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/846: mknod d7/d1a/d41/dbd/db9/c122 0 2024-04-25T15:58:13.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/478: dwrite d1/d4/d18/d36/d37/f73 [0,4194304] 0 2024-04-25T15:58:13.429 INFO:tasks.workunit.client.0.smithi087.stdout:2/661: rename d3/d27/d29/d2d/d40/l53 to d3/d2a/d48/d77/db7/lca 0 2024-04-25T15:58:13.430 INFO:tasks.workunit.client.0.smithi087.stdout:4/752: write d4/d10/d60/d56/d61/d3f/d8a/fa1 [219754,121308] 0 2024-04-25T15:58:13.431 INFO:tasks.workunit.client.0.smithi087.stdout:2/662: chown d3/d2a/l26 33117457 1 2024-04-25T15:58:13.432 INFO:tasks.workunit.client.0.smithi087.stdout:7/479: rename d1/d1a/d7b/f86 to d1/d4/d7e/f96 0 2024-04-25T15:58:13.432 INFO:tasks.workunit.client.0.smithi087.stdout:4/753: chown d4/d10/d60/d5c/d3a/d90 721 1 2024-04-25T15:58:13.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/663: truncate d3/f1e 3466672 0 2024-04-25T15:58:13.435 INFO:tasks.workunit.client.0.smithi087.stdout:2/664: chown d3/d27/d29/d2d 27988524 1 2024-04-25T15:58:13.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/754: write d4/d10/d60/d52/d66/fbe [78839,128808] 0 2024-04-25T15:58:13.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/847: dwrite d7/f40 [0,4194304] 0 2024-04-25T15:58:13.437 INFO:tasks.workunit.client.0.smithi087.stdout:4/755: chown d4/d10/d60/d52/cc9 8859 1 2024-04-25T15:58:13.438 INFO:tasks.workunit.client.0.smithi087.stdout:2/665: write d3/d27/d29/f2c [4745318,17138] 0 2024-04-25T15:58:13.439 INFO:tasks.workunit.client.0.smithi087.stdout:6/848: mknod d7/d1a/d1d/d21/d27/d2c/d35/c123 0 2024-04-25T15:58:13.441 INFO:tasks.workunit.client.0.smithi087.stdout:6/849: chown d7/d1a/d1d/d21/d27/f73 115 1 2024-04-25T15:58:13.442 INFO:tasks.workunit.client.0.smithi087.stdout:4/756: mknod d4/d10/d60/d5c/d3a/cfb 0 2024-04-25T15:58:13.443 INFO:tasks.workunit.client.0.smithi087.stdout:7/480: write d1/d1a/f62 [1720932,104804] 0 2024-04-25T15:58:13.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/666: creat d3/d27/fcb x:0 0 0 2024-04-25T15:58:13.449 INFO:tasks.workunit.client.0.smithi087.stdout:7/481: link d1/d9/d26/f38 d1/d1a/f97 0 2024-04-25T15:58:13.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/850: dwrite d7/d1a/d7b/fa8 [0,4194304] 0 2024-04-25T15:58:13.454 INFO:tasks.workunit.client.0.smithi087.stdout:4/757: write d4/d10/d60/d5c/d3a/d90/fbb [3416692,38368] 0 2024-04-25T15:58:13.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/667: truncate d3/f1e 3276225 0 2024-04-25T15:58:13.458 INFO:tasks.workunit.client.0.smithi087.stdout:4/758: rmdir d4 39 2024-04-25T15:58:13.458 INFO:tasks.workunit.client.0.smithi087.stdout:7/482: dwrite d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:13.466 INFO:tasks.workunit.client.0.smithi087.stdout:4/759: rename d4/d10/d60/d52/d66/f11 to d4/d10/d60/d56/d61/d3f/d8a/ffc 0 2024-04-25T15:58:13.470 INFO:tasks.workunit.client.0.smithi087.stdout:4/760: creat d4/d10/d60/d56/d61/d3f/d42/d97/de2/dec/ffd x:0 0 0 2024-04-25T15:58:13.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/761: truncate d4/d10/d60/d5c/d3a/f3e 1653377 0 2024-04-25T15:58:13.476 INFO:tasks.workunit.client.0.smithi087.stdout:4/762: write d4/d10/d60/d56/d61/d3f/fa9 [440067,46494] 0 2024-04-25T15:58:13.477 INFO:tasks.workunit.client.0.smithi087.stdout:4/763: write d4/d10/d60/d56/d61/d3f/d8a/fcc [447840,45461] 0 2024-04-25T15:58:13.478 INFO:tasks.workunit.client.0.smithi087.stdout:4/764: stat d4/d10/d60/d5c/d8d/fc2 0 2024-04-25T15:58:13.481 INFO:tasks.workunit.client.0.smithi087.stdout:4/765: chown d4/d87/le9 28348 1 2024-04-25T15:58:13.482 INFO:tasks.workunit.client.0.smithi087.stdout:6/851: dread d7/d1a/d1d/d21/d27/f73 [0,4194304] 0 2024-04-25T15:58:13.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/852: fdatasync d7/d1a/d1d/d21/f6d 0 2024-04-25T15:58:13.484 INFO:tasks.workunit.client.0.smithi087.stdout:4/766: creat d4/d10/d60/d5c/d8d/d9f/ffe x:0 0 0 2024-04-25T15:58:13.488 INFO:tasks.workunit.client.0.smithi087.stdout:4/767: rmdir d4/d10/d60/d56/d61/dca 39 2024-04-25T15:58:13.490 INFO:tasks.workunit.client.0.smithi087.stdout:2/668: dwrite d3/d2a/d48/f65 [4194304,4194304] 0 2024-04-25T15:58:13.493 INFO:tasks.workunit.client.0.smithi087.stdout:4/768: unlink d4/d10/d60/d56/d61/d3f/d58/la3 0 2024-04-25T15:58:13.497 INFO:tasks.workunit.client.0.smithi087.stdout:2/669: dwrite d3/d2a/d48/d77/d79/f9a [0,4194304] 0 2024-04-25T15:58:13.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/483: dread d1/d4/f44 [0,4194304] 0 2024-04-25T15:58:13.500 INFO:tasks.workunit.client.0.smithi087.stdout:4/769: creat d4/d10/d60/d56/d61/d3f/d58/d5e/fff x:0 0 0 2024-04-25T15:58:13.502 INFO:tasks.workunit.client.0.smithi087.stdout:9/682: sync 2024-04-25T15:58:13.504 INFO:tasks.workunit.client.0.smithi087.stdout:4/770: chown d4/d10/d60/d56/d61/d3f/d42/d97/de2/dec/ffd 99 1 2024-04-25T15:58:13.504 INFO:tasks.workunit.client.0.smithi087.stdout:6/853: dwrite d7/d1a/d1d/d21/d27/d2c/f106 [0,4194304] 0 2024-04-25T15:58:13.505 INFO:tasks.workunit.client.0.smithi087.stdout:4/771: readlink d4/d10/d60/d56/d61/le6 0 2024-04-25T15:58:13.510 INFO:tasks.workunit.client.0.smithi087.stdout:4/772: mkdir d4/d10/d60/d56/d61/d3f/d42/d100 0 2024-04-25T15:58:13.511 INFO:tasks.workunit.client.0.smithi087.stdout:9/683: fsync d6/d8/f89 0 2024-04-25T15:58:13.515 INFO:tasks.workunit.client.0.smithi087.stdout:2/670: dread d3/d2a/d48/f65 [0,4194304] 0 2024-04-25T15:58:13.517 INFO:tasks.workunit.client.0.smithi087.stdout:6/854: rename d7/d1a/fe6 to d7/d1a/d1d/d21/d27/d2c/f124 0 2024-04-25T15:58:13.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/684: dread - d6/d8/d32/d4c/fb1 zero size 2024-04-25T15:58:13.519 INFO:tasks.workunit.client.0.smithi087.stdout:2/671: mkdir d3/d27/d29/d4f/d5a/d6a/d88/d94/dcc 0 2024-04-25T15:58:13.520 INFO:tasks.workunit.client.0.smithi087.stdout:6/855: symlink d7/d1a/d41/dbd/df0/l125 0 2024-04-25T15:58:13.520 INFO:tasks.workunit.client.0.smithi087.stdout:2/672: chown d3/d2a/d48/d83/l91 394415242 1 2024-04-25T15:58:13.522 INFO:tasks.workunit.client.0.smithi087.stdout:4/773: getdents d4/d10/d60/d56/d61/d3f 0 2024-04-25T15:58:13.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/856: mknod d7/d71/d59/dc7/dec/c126 0 2024-04-25T15:58:13.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/857: stat d7/d1a/d7b/f5a 0 2024-04-25T15:58:13.524 INFO:tasks.workunit.client.0.smithi087.stdout:4/774: dread - d4/d10/d60/fb6 zero size 2024-04-25T15:58:13.525 INFO:tasks.workunit.client.0.smithi087.stdout:2/673: fdatasync d3/d27/d29/d2d/d40/fc3 0 2024-04-25T15:58:13.526 INFO:tasks.workunit.client.0.smithi087.stdout:4/775: chown d4/d10/d60/d56/d61/db7/ceb 3 1 2024-04-25T15:58:13.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/685: dwrite d6/d8/d48/f56 [0,4194304] 0 2024-04-25T15:58:13.533 INFO:tasks.workunit.client.0.smithi087.stdout:6/858: truncate d7/d1a/d1d/d21/d27/d2c/f5c 3040889 0 2024-04-25T15:58:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/686: creat d6/d8/d12/db7/d3a/d58/d72/dd2/fd4 x:0 0 0 2024-04-25T15:58:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:2/674: dread d3/d27/d29/d4f/d5a/d6a/f89 [0,4194304] 0 2024-04-25T15:58:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:4/776: write d4/d10/d60/d52/f57 [319474,21102] 0 2024-04-25T15:58:13.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/859: fsync d7/d71/d59/d90/da5/fa9 0 2024-04-25T15:58:13.536 INFO:tasks.workunit.client.0.smithi087.stdout:4/777: stat d4/d10/d60 0 2024-04-25T15:58:13.537 INFO:tasks.workunit.client.0.smithi087.stdout:9/687: write d6/d8/f89 [5047953,8233] 0 2024-04-25T15:58:13.539 INFO:tasks.workunit.client.0.smithi087.stdout:2/675: creat d3/d20/d4a/fcd x:0 0 0 2024-04-25T15:58:13.540 INFO:tasks.workunit.client.0.smithi087.stdout:4/778: mknod d4/d10/d60/d5c/d8d/c101 0 2024-04-25T15:58:13.545 INFO:tasks.workunit.client.0.smithi087.stdout:9/688: rename d6/f2b to d6/d8/d32/fd5 0 2024-04-25T15:58:13.547 INFO:tasks.workunit.client.0.smithi087.stdout:2/676: mkdir d3/dce 0 2024-04-25T15:58:13.547 INFO:tasks.workunit.client.0.smithi087.stdout:9/689: stat d6/d8/d32/d4c/caf 0 2024-04-25T15:58:13.549 INFO:tasks.workunit.client.0.smithi087.stdout:4/779: dwrite d4/d10/d60/d52/d66/d15/fe [0,4194304] 0 2024-04-25T15:58:13.550 INFO:tasks.workunit.client.0.smithi087.stdout:2/677: mknod d3/d2a/d81/ccf 0 2024-04-25T15:58:13.551 INFO:tasks.workunit.client.0.smithi087.stdout:9/690: write d6/d8/d12/db7/d3a/d5b/d60/d81/fb3 [393041,123927] 0 2024-04-25T15:58:13.553 INFO:tasks.workunit.client.0.smithi087.stdout:4/780: read - d4/d10/d60/d56/d61/d3f/d42/fcf zero size 2024-04-25T15:58:13.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/860: dread d7/d1a/d1d/d21/f10a [0,4194304] 0 2024-04-25T15:58:13.558 INFO:tasks.workunit.client.0.smithi087.stdout:2/678: dread d3/d27/d29/d4f/f84 [0,4194304] 0 2024-04-25T15:58:13.560 INFO:tasks.workunit.client.0.smithi087.stdout:4/781: getdents d4/d10/d60/d5c/d3a/d90 0 2024-04-25T15:58:13.561 INFO:tasks.workunit.client.0.smithi087.stdout:4/782: chown d4/d10/d60/d5c/c9a 1174 1 2024-04-25T15:58:13.561 INFO:tasks.workunit.client.0.smithi087.stdout:6/861: rmdir d7/d1a/d41 39 2024-04-25T15:58:13.562 INFO:tasks.workunit.client.0.smithi087.stdout:2/679: fdatasync d3/d27/d38/f74 0 2024-04-25T15:58:13.564 INFO:tasks.workunit.client.0.smithi087.stdout:2/680: read d3/d2a/f1f [3238632,69859] 0 2024-04-25T15:58:13.567 INFO:tasks.workunit.client.0.smithi087.stdout:6/862: truncate d7/d1a/d1d/f84 707523 0 2024-04-25T15:58:13.569 INFO:tasks.workunit.client.0.smithi087.stdout:4/783: dwrite d4/d10/d60/d5c/fa5 [0,4194304] 0 2024-04-25T15:58:13.572 INFO:tasks.workunit.client.0.smithi087.stdout:9/691: dwrite d6/d8/d12/db7/d3a/d5b/d60/f86 [0,4194304] 0 2024-04-25T15:58:13.575 INFO:tasks.workunit.client.0.smithi087.stdout:2/681: rename d3/d27/d29/f2e to d3/dce/fd0 0 2024-04-25T15:58:13.576 INFO:tasks.workunit.client.0.smithi087.stdout:9/692: symlink d6/d8/d12/ld6 0 2024-04-25T15:58:13.577 INFO:tasks.workunit.client.0.smithi087.stdout:2/682: write d3/d2a/f1b [1128990,46867] 0 2024-04-25T15:58:13.581 INFO:tasks.workunit.client.0.smithi087.stdout:9/693: rename d6/d3e/f91 to d6/dce/fd7 0 2024-04-25T15:58:13.581 INFO:tasks.workunit.client.0.smithi087.stdout:4/784: dwrite d4/d10/d60/f6c [0,4194304] 0 2024-04-25T15:58:13.588 INFO:tasks.workunit.client.0.smithi087.stdout:9/694: creat d6/d8/d32/d4c/db9/fd8 x:0 0 0 2024-04-25T15:58:13.588 INFO:tasks.workunit.client.0.smithi087.stdout:4/785: getdents d4/d10/d60/d5c/d3a/dd4 0 2024-04-25T15:58:13.589 INFO:tasks.workunit.client.0.smithi087.stdout:4/786: write d4/d10/d60/d56/d61/f1f [3240966,118708] 0 2024-04-25T15:58:13.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/695: dread - d6/d8/d12/db7/d3a/d5b/d60/d7f/fb8 zero size 2024-04-25T15:58:13.594 INFO:tasks.workunit.client.0.smithi087.stdout:4/787: rename d4/d10/d60/d52/d66/la to d4/d10/l102 0 2024-04-25T15:58:13.594 INFO:tasks.workunit.client.0.smithi087.stdout:9/696: symlink d6/d3e/d92/ld9 0 2024-04-25T15:58:13.597 INFO:tasks.workunit.client.0.smithi087.stdout:4/788: unlink d4/d10/fa7 0 2024-04-25T15:58:13.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/863: dread f5 [0,4194304] 0 2024-04-25T15:58:13.602 INFO:tasks.workunit.client.0.smithi087.stdout:9/697: link d6/d8/d12/db7/d3a/d58/d72/c9d d6/d8/d12/db7/d3a/d58/cda 0 2024-04-25T15:58:13.602 INFO:tasks.workunit.client.0.smithi087.stdout:4/789: read d4/d10/d60/d52/d66/f85 [34494,81485] 0 2024-04-25T15:58:13.603 INFO:tasks.workunit.client.0.smithi087.stdout:6/864: chown d7/d1a/d41/dbd/led 9515798 1 2024-04-25T15:58:13.606 INFO:tasks.workunit.client.0.smithi087.stdout:2/683: dwrite d3/d27/f42 [0,4194304] 0 2024-04-25T15:58:13.608 INFO:tasks.workunit.client.0.smithi087.stdout:6/865: mkdir d7/d1a/d1d/d21/d27/d2c/d35/d127 0 2024-04-25T15:58:13.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/866: stat d7/d1a/d1d/d21/d27/d2c/d35/d45/fb2 0 2024-04-25T15:58:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:8/783: sync 2024-04-25T15:58:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/763: sync 2024-04-25T15:58:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/815: sync 2024-04-25T15:58:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:5/745: sync 2024-04-25T15:58:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:3/687: sync 2024-04-25T15:58:13.622 INFO:tasks.workunit.client.0.smithi087.stdout:9/698: truncate d6/d8/f89 3828565 0 2024-04-25T15:58:13.624 INFO:tasks.workunit.client.0.smithi087.stdout:0/816: mknod d1/d6/d77/c10d 0 2024-04-25T15:58:13.625 INFO:tasks.workunit.client.0.smithi087.stdout:5/746: readlink d9/d91/d30/d70/d82/lac 0 2024-04-25T15:58:13.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/688: mknod d4/d17/cd6 0 2024-04-25T15:58:13.626 INFO:tasks.workunit.client.0.smithi087.stdout:2/684: dwrite d3/d2a/d1c/fbb [0,4194304] 0 2024-04-25T15:58:13.626 INFO:tasks.workunit.client.0.smithi087.stdout:5/747: fdatasync d9/f2d 0 2024-04-25T15:58:13.628 INFO:tasks.workunit.client.0.smithi087.stdout:6/867: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/f128 x:0 0 0 2024-04-25T15:58:13.629 INFO:tasks.workunit.client.0.smithi087.stdout:1/764: readlink d3/d12/d14/d29/d2f/d61/la6 0 2024-04-25T15:58:13.633 INFO:tasks.workunit.client.0.smithi087.stdout:8/784: dread d4/d8/dd/d2f/f67 [0,4194304] 0 2024-04-25T15:58:13.636 INFO:tasks.workunit.client.0.smithi087.stdout:1/765: rmdir d3/d12/d14/d29/d2f/d53/dca 39 2024-04-25T15:58:13.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/748: creat d9/d2f/dbb/dde/fee x:0 0 0 2024-04-25T15:58:13.640 INFO:tasks.workunit.client.0.smithi087.stdout:0/817: dread d1/f58 [0,4194304] 0 2024-04-25T15:58:13.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/785: chown d4/d8/dd/l93 1540 1 2024-04-25T15:58:13.640 INFO:tasks.workunit.client.0.smithi087.stdout:6/868: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/fa2 [4194304,4194304] 0 2024-04-25T15:58:13.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/786: chown d4/d1d/d17/f2e 47870607 1 2024-04-25T15:58:13.648 INFO:tasks.workunit.client.0.smithi087.stdout:6/869: mkdir d7/d71/d129 0 2024-04-25T15:58:13.651 INFO:tasks.workunit.client.0.smithi087.stdout:0/818: dread d1/d6/f4d [0,4194304] 0 2024-04-25T15:58:13.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/787: write d4/d22/d43/d7f/dc6/ddc/da0/fc5 [2141408,15159] 0 2024-04-25T15:58:13.653 INFO:tasks.workunit.client.0.smithi087.stdout:5/749: write d9/d2f/d3b/f4c [3312647,17653] 0 2024-04-25T15:58:13.654 INFO:tasks.workunit.client.0.smithi087.stdout:6/870: read d7/f10 [316439,81814] 0 2024-04-25T15:58:13.655 INFO:tasks.workunit.client.0.smithi087.stdout:1/766: dwrite d3/d12/d4d/f57 [0,4194304] 0 2024-04-25T15:58:13.655 INFO:tasks.workunit.client.0.smithi087.stdout:2/685: dread d3/d27/d29/d4f/f5f [0,4194304] 0 2024-04-25T15:58:13.657 INFO:tasks.workunit.client.0.smithi087.stdout:8/788: write d4/d1d/d7c/fe3 [462992,94556] 0 2024-04-25T15:58:13.658 INFO:tasks.workunit.client.0.smithi087.stdout:2/686: chown d3/d27/d29/d4f/d5a/d6a 0 1 2024-04-25T15:58:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/689: dwrite d4/d17/d24/d29/d58/dac/dc0/d3c/f4b [0,4194304] 0 2024-04-25T15:58:13.662 INFO:tasks.workunit.client.0.smithi087.stdout:0/819: mknod d1/da/d3e/d85/d9b/dcd/df2/c10e 0 2024-04-25T15:58:13.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/767: creat d3/d2d/d6c/f106 x:0 0 0 2024-04-25T15:58:13.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/687: rmdir d3/d2a/d48/d77/d79/d85 39 2024-04-25T15:58:13.665 INFO:tasks.workunit.client.0.smithi087.stdout:5/750: dread d9/d2f/d40/f72 [0,4194304] 0 2024-04-25T15:58:13.666 INFO:tasks.workunit.client.0.smithi087.stdout:1/768: chown d3/d12/d39/d64/fa2 6442 1 2024-04-25T15:58:13.666 INFO:tasks.workunit.client.0.smithi087.stdout:8/789: rename d4/d1d/de1/fdb to d4/d1d/de1/d82/ffb 0 2024-04-25T15:58:13.667 INFO:tasks.workunit.client.0.smithi087.stdout:6/871: dread d7/d1a/d1d/f84 [0,4194304] 0 2024-04-25T15:58:13.667 INFO:tasks.workunit.client.0.smithi087.stdout:3/690: readlink d4/d17/d81/da6/d53/l9a 0 2024-04-25T15:58:13.669 INFO:tasks.workunit.client.0.smithi087.stdout:1/769: chown d3/d12/d14/d29/d67/d73/fd9 697 1 2024-04-25T15:58:13.669 INFO:tasks.workunit.client.0.smithi087.stdout:2/688: symlink d3/d20/d4a/d8e/ld1 0 2024-04-25T15:58:13.671 INFO:tasks.workunit.client.0.smithi087.stdout:5/751: creat d9/d2f/d3b/fef x:0 0 0 2024-04-25T15:58:13.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/691: mknod d4/d17/d81/da6/d37/d51/cd7 0 2024-04-25T15:58:13.673 INFO:tasks.workunit.client.0.smithi087.stdout:6/872: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/c12a 0 2024-04-25T15:58:13.674 INFO:tasks.workunit.client.0.smithi087.stdout:8/790: creat d4/d8/dd/d85/dbc/ffc x:0 0 0 2024-04-25T15:58:13.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/873: write d7/d1a/d1d/d21/d27/d2c/f119 [491011,57188] 0 2024-04-25T15:58:13.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/820: dwrite d1/d6/d21/fa9 [0,4194304] 0 2024-04-25T15:58:13.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/689: rename d3/d2a/d48/f6c to d3/d27/d29/d4f/d5a/d6a/d88/fd2 0 2024-04-25T15:58:13.679 INFO:tasks.workunit.client.0.smithi087.stdout:1/770: link d3/d2d/cbe d3/d12/d14/d29/d5c/c107 0 2024-04-25T15:58:13.679 INFO:tasks.workunit.client.0.smithi087.stdout:8/791: symlink d4/d22/d43/d7f/dc6/ddc/da0/lfd 0 2024-04-25T15:58:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:5/752: chown d9/d2f/d40/d4d/d7b/d74/d83/ca3 27760728 1 2024-04-25T15:58:13.682 INFO:tasks.workunit.client.0.smithi087.stdout:6/874: unlink d7/d1a/d1d/f84 0 2024-04-25T15:58:13.683 INFO:tasks.workunit.client.0.smithi087.stdout:8/792: stat d4/d22/d43/l54 0 2024-04-25T15:58:13.685 INFO:tasks.workunit.client.0.smithi087.stdout:0/821: mkdir d1/d4f/de3/df5/d10f 0 2024-04-25T15:58:13.686 INFO:tasks.workunit.client.0.smithi087.stdout:3/692: dwrite d4/d17/d24/d29/f97 [0,4194304] 0 2024-04-25T15:58:13.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/771: mkdir d3/d12/d39/d64/dc0/d108 0 2024-04-25T15:58:13.690 INFO:tasks.workunit.client.0.smithi087.stdout:0/822: creat d1/da/d3e/d85/d9b/dcd/df2/f110 x:0 0 0 2024-04-25T15:58:13.691 INFO:tasks.workunit.client.0.smithi087.stdout:3/693: rmdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89 39 2024-04-25T15:58:13.692 INFO:tasks.workunit.client.0.smithi087.stdout:6/875: dwrite d7/f12 [4194304,4194304] 0 2024-04-25T15:58:13.692 INFO:tasks.workunit.client.0.smithi087.stdout:0/823: write d1/de9/f108 [180774,74825] 0 2024-04-25T15:58:13.693 INFO:tasks.workunit.client.0.smithi087.stdout:8/793: symlink d4/d22/d43/lfe 0 2024-04-25T15:58:13.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/753: creat d9/d91/d30/d70/d79/dae/ff0 x:0 0 0 2024-04-25T15:58:13.695 INFO:tasks.workunit.client.0.smithi087.stdout:1/772: symlink d3/d12/d39/d64/l109 0 2024-04-25T15:58:13.697 INFO:tasks.workunit.client.0.smithi087.stdout:0/824: dread - d1/d6/d21/d2a/dd5/ff0 zero size 2024-04-25T15:58:13.697 INFO:tasks.workunit.client.0.smithi087.stdout:2/690: getdents d3/d2a/d48/d83 0 2024-04-25T15:58:13.698 INFO:tasks.workunit.client.0.smithi087.stdout:8/794: mkdir d4/d1d/d14/dff 0 2024-04-25T15:58:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:6/876: symlink d7/d1a/d41/d9c/l12b 0 2024-04-25T15:58:13.699 INFO:tasks.workunit.client.0.smithi087.stdout:2/691: fsync d3/d27/d38/d7e/fb5 0 2024-04-25T15:58:13.700 INFO:tasks.workunit.client.0.smithi087.stdout:0/825: write d1/d6/db1/dc0/dd3/dff/d50/f8d [3795004,74726] 0 2024-04-25T15:58:13.700 INFO:tasks.workunit.client.0.smithi087.stdout:2/692: dread - d3/d20/d4a/fa3 zero size 2024-04-25T15:58:13.701 INFO:tasks.workunit.client.0.smithi087.stdout:5/754: unlink d9/d2f/d40/d4d/d7b/d5c/d5f/fc8 0 2024-04-25T15:58:13.702 INFO:tasks.workunit.client.0.smithi087.stdout:6/877: dread - d7/d1a/d41/dbd/df0/df9/f108 zero size 2024-04-25T15:58:13.702 INFO:tasks.workunit.client.0.smithi087.stdout:3/694: dread d4/d17/d24/d29/d58/dac/dc0/d5c/f77 [0,4194304] 0 2024-04-25T15:58:13.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/693: chown d3/d2a/d48/d77/db7 27 1 2024-04-25T15:58:13.703 INFO:tasks.workunit.client.0.smithi087.stdout:8/795: fdatasync d4/d1d/f59 0 2024-04-25T15:58:13.707 INFO:tasks.workunit.client.0.smithi087.stdout:5/755: rmdir d9/d2f 39 2024-04-25T15:58:13.708 INFO:tasks.workunit.client.0.smithi087.stdout:2/694: read d3/d27/d29/d2d/d40/f68 [3707468,57244] 0 2024-04-25T15:58:13.711 INFO:tasks.workunit.client.0.smithi087.stdout:6/878: creat d7/d1a/d1d/d21/d27/d2c/d35/f12c x:0 0 0 2024-04-25T15:58:13.716 INFO:tasks.workunit.client.0.smithi087.stdout:8/796: unlink d4/d1d/d7c/dae/db7/ff1 0 2024-04-25T15:58:13.716 INFO:tasks.workunit.client.0.smithi087.stdout:6/879: dread d7/d1a/fc4 [0,4194304] 0 2024-04-25T15:58:13.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/880: fsync d7/d71/d59/d90/da5/fc0 0 2024-04-25T15:58:13.719 INFO:tasks.workunit.client.0.smithi087.stdout:3/695: unlink d4/f16 0 2024-04-25T15:58:13.725 INFO:tasks.workunit.client.0.smithi087.stdout:0/826: dread d1/da/d3e/d54/d34/d55/fad [0,4194304] 0 2024-04-25T15:58:13.726 INFO:tasks.workunit.client.0.smithi087.stdout:5/756: chown d9/d91/d30/d70/d79/dae/de4/fe6 9057235 1 2024-04-25T15:58:13.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/881: rename d7/d1a/d41/dbd/c47 to d7/d71/d59/d90/da5/c12d 0 2024-04-25T15:58:13.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/695: mknod d3/d27/d29/d76/cd3 0 2024-04-25T15:58:13.731 INFO:tasks.workunit.client.0.smithi087.stdout:3/696: fdatasync d4/d17/d24/d29/d58/dac/dc0/d5c/f77 0 2024-04-25T15:58:13.733 INFO:tasks.workunit.client.0.smithi087.stdout:6/882: dread d7/fdf [0,4194304] 0 2024-04-25T15:58:13.734 INFO:tasks.workunit.client.0.smithi087.stdout:8/797: creat d4/d1d/de1/dee/f100 x:0 0 0 2024-04-25T15:58:13.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/883: truncate d7/d1a/d1d/d21/d27/d2c/d35/f12c 833504 0 2024-04-25T15:58:13.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/827: mkdir d1/d4f/de3/d111 0 2024-04-25T15:58:13.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/697: readlink d4/l8 0 2024-04-25T15:58:13.739 INFO:tasks.workunit.client.0.smithi087.stdout:3/698: truncate d4/d17/f1b 1264207 0 2024-04-25T15:58:13.741 INFO:tasks.workunit.client.0.smithi087.stdout:2/696: rename d3/d27/d29/d2d/c98 to d3/d27/d29/d4f/d5a/d6a/d88/d94/cd4 0 2024-04-25T15:58:13.741 INFO:tasks.workunit.client.0.smithi087.stdout:8/798: stat d4/d1d/d17/d37/l83 0 2024-04-25T15:58:13.743 INFO:tasks.workunit.client.0.smithi087.stdout:8/799: truncate d4/d1d/d17/d37/d5e/f88 2298987 0 2024-04-25T15:58:13.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/757: mkdir d9/d2f/d40/d4d/d58/df1 0 2024-04-25T15:58:13.745 INFO:tasks.workunit.client.0.smithi087.stdout:0/828: rename d1/d27 to d1/d6/d112 0 2024-04-25T15:58:13.746 INFO:tasks.workunit.client.0.smithi087.stdout:0/829: chown d1/d6/db1/dc0/dd3/dff/d50/d6b 50 1 2024-04-25T15:58:13.747 INFO:tasks.workunit.client.0.smithi087.stdout:2/697: dread - d3/d27/d29/f7a zero size 2024-04-25T15:58:13.748 INFO:tasks.workunit.client.0.smithi087.stdout:6/884: link d7/d71/d76/fcb d7/d71/d59/d90/da5/f12e 0 2024-04-25T15:58:13.750 INFO:tasks.workunit.client.0.smithi087.stdout:3/699: creat d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/fd8 x:0 0 0 2024-04-25T15:58:13.751 INFO:tasks.workunit.client.0.smithi087.stdout:3/700: write d4/db/f5b [831492,87073] 0 2024-04-25T15:58:13.751 INFO:tasks.workunit.client.0.smithi087.stdout:0/830: creat d1/d6/d112/d7d/f113 x:0 0 0 2024-04-25T15:58:13.753 INFO:tasks.workunit.client.0.smithi087.stdout:8/800: mkdir d4/d1d/d17/d101 0 2024-04-25T15:58:13.754 INFO:tasks.workunit.client.0.smithi087.stdout:7/484: sync 2024-04-25T15:58:13.754 INFO:tasks.workunit.client.0.smithi087.stdout:5/758: creat d9/d91/d30/de2/ff2 x:0 0 0 2024-04-25T15:58:13.755 INFO:tasks.workunit.client.0.smithi087.stdout:2/698: mknod d3/d2a/d48/d77/db6/cd5 0 2024-04-25T15:58:13.756 INFO:tasks.workunit.client.0.smithi087.stdout:0/831: unlink d1/da/d3e/d54/d34/fc5 0 2024-04-25T15:58:13.756 INFO:tasks.workunit.client.0.smithi087.stdout:3/701: mknod d4/d17/d24/d29/d58/dac/dc0/d5c/da5/cd9 0 2024-04-25T15:58:13.759 INFO:tasks.workunit.client.0.smithi087.stdout:7/485: mkdir d1/d4/d18/d98 0 2024-04-25T15:58:13.762 INFO:tasks.workunit.client.0.smithi087.stdout:5/759: mknod d9/d2f/dbb/cf3 0 2024-04-25T15:58:13.763 INFO:tasks.workunit.client.0.smithi087.stdout:5/760: chown d9/d2f/d40/d4d/d7b/d74/l85 261258444 1 2024-04-25T15:58:13.763 INFO:tasks.workunit.client.0.smithi087.stdout:2/699: creat d3/d2a/d1c/fd6 x:0 0 0 2024-04-25T15:58:13.770 INFO:tasks.workunit.client.0.smithi087.stdout:2/700: chown d3/d27/d29/d2d/d40/l87 165 1 2024-04-25T15:58:13.772 INFO:tasks.workunit.client.0.smithi087.stdout:0/832: mkdir d1/d6/d112/d7d/d84/de1/d114 0 2024-04-25T15:58:13.774 INFO:tasks.workunit.client.0.smithi087.stdout:0/833: write d1/d6/d112/d7d/f93 [1035860,50656] 0 2024-04-25T15:58:13.775 INFO:tasks.workunit.client.0.smithi087.stdout:7/486: truncate d1/f19 2113752 0 2024-04-25T15:58:13.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/885: dwrite d7/d1a/fa6 [0,4194304] 0 2024-04-25T15:58:13.776 INFO:tasks.workunit.client.0.smithi087.stdout:7/487: chown d1/d1a/f62 408 1 2024-04-25T15:58:13.778 INFO:tasks.workunit.client.0.smithi087.stdout:7/488: read d1/d4/f40 [492562,68070] 0 2024-04-25T15:58:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:7/489: fdatasync d1/d9/d26/d45/f5c 0 2024-04-25T15:58:13.780 INFO:tasks.workunit.client.0.smithi087.stdout:3/702: creat d4/db/fda x:0 0 0 2024-04-25T15:58:13.781 INFO:tasks.workunit.client.0.smithi087.stdout:7/490: truncate d1/d4/d18/d36/f78 777864 0 2024-04-25T15:58:13.782 INFO:tasks.workunit.client.0.smithi087.stdout:5/761: rename d9/d2f/d40/d4d/d7b/d5c/d5f/ca2 to d9/d2f/d40/d4d/cf4 0 2024-04-25T15:58:13.784 INFO:tasks.workunit.client.0.smithi087.stdout:5/762: dread - d9/d91/d38/ded/fdc zero size 2024-04-25T15:58:13.786 INFO:tasks.workunit.client.0.smithi087.stdout:8/801: dwrite d4/d8/dd/d2f/f67 [0,4194304] 0 2024-04-25T15:58:13.788 INFO:tasks.workunit.client.0.smithi087.stdout:6/886: symlink d7/dd4/l12f 0 2024-04-25T15:58:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:2/701: link d3/d27/d29/d2d/d40/l43 d3/dce/ld7 0 2024-04-25T15:58:13.791 INFO:tasks.workunit.client.0.smithi087.stdout:2/702: read d3/d2a/d48/d77/d79/f9a [2660299,73368] 0 2024-04-25T15:58:13.792 INFO:tasks.workunit.client.0.smithi087.stdout:2/703: read - d3/d2a/d81/d93/fc8 zero size 2024-04-25T15:58:13.797 INFO:tasks.workunit.client.0.smithi087.stdout:3/703: symlink d4/d17/d81/da6/d53/d68/da2/ldb 0 2024-04-25T15:58:13.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/887: mkdir d7/d71/d59/d130 0 2024-04-25T15:58:13.797 INFO:tasks.workunit.client.0.smithi087.stdout:5/763: link d9/d91/d38/f97 d9/d91/d30/d70/d79/dae/de4/ff5 0 2024-04-25T15:58:13.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/491: getdents d1/d4/d18/d36 0 2024-04-25T15:58:13.803 INFO:tasks.workunit.client.0.smithi087.stdout:3/704: dread d4/d17/d24/d29/d58/dac/f4a [0,4194304] 0 2024-04-25T15:58:13.804 INFO:tasks.workunit.client.0.smithi087.stdout:5/764: rename d9/d2f/d40/d4d/d7b/d5c/l64 to d9/d91/d30/d55/lf6 0 2024-04-25T15:58:13.805 INFO:tasks.workunit.client.0.smithi087.stdout:8/802: link d4/c5d d4/d22/d43/d7f/dc6/ddc/c102 0 2024-04-25T15:58:13.806 INFO:tasks.workunit.client.0.smithi087.stdout:8/803: fsync d4/d1d/de1/da6/fcc 0 2024-04-25T15:58:13.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/704: dwrite d3/d27/d29/d2d/f7d [0,4194304] 0 2024-04-25T15:58:13.808 INFO:tasks.workunit.client.0.smithi087.stdout:7/492: rename d1/d4/cb to d1/d4/d18/c99 0 2024-04-25T15:58:13.813 INFO:tasks.workunit.client.0.smithi087.stdout:8/804: dread d4/d1d/f59 [0,4194304] 0 2024-04-25T15:58:13.813 INFO:tasks.workunit.client.0.smithi087.stdout:3/705: unlink d4/d17/d81/da6/d53/d7d/ld4 0 2024-04-25T15:58:13.813 INFO:tasks.workunit.client.0.smithi087.stdout:7/493: rename d1/d9/c33 to d1/d1a/d7b/c9a 0 2024-04-25T15:58:13.816 INFO:tasks.workunit.client.0.smithi087.stdout:8/805: chown d4/d8/db4 14800724 1 2024-04-25T15:58:13.817 INFO:tasks.workunit.client.0.smithi087.stdout:8/806: stat d4/d1d/de1/d82/ffb 0 2024-04-25T15:58:13.818 INFO:tasks.workunit.client.0.smithi087.stdout:8/807: dread - d4/d8/dd/d85/d86/fca zero size 2024-04-25T15:58:13.819 INFO:tasks.workunit.client.0.smithi087.stdout:2/705: link d3/d27/l36 d3/d2a/d48/d83/ld8 0 2024-04-25T15:58:13.820 INFO:tasks.workunit.client.0.smithi087.stdout:6/888: dwrite d7/d1a/d41/dbd/db9/f10e [4194304,4194304] 0 2024-04-25T15:58:13.822 INFO:tasks.workunit.client.0.smithi087.stdout:8/808: creat d4/d8/dd/d85/dbc/dd2/f103 x:0 0 0 2024-04-25T15:58:13.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/706: creat d3/d20/d4a/d47/fd9 x:0 0 0 2024-04-25T15:58:13.824 INFO:tasks.workunit.client.0.smithi087.stdout:8/809: dread - d4/d8/dd/d85/dbc/dd2/f103 zero size 2024-04-25T15:58:13.825 INFO:tasks.workunit.client.0.smithi087.stdout:6/889: mkdir d7/d1a/d1d/d21/d27/d2c/d35/d45/d131 0 2024-04-25T15:58:13.826 INFO:tasks.workunit.client.0.smithi087.stdout:3/706: rename d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89/l90 to d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/ldc 0 2024-04-25T15:58:13.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/890: read - d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/f128 zero size 2024-04-25T15:58:13.829 INFO:tasks.workunit.client.0.smithi087.stdout:2/707: rename d3/d2a/d48/d83/l91 to d3/d2a/d48/lda 0 2024-04-25T15:58:13.829 INFO:tasks.workunit.client.0.smithi087.stdout:3/707: rmdir d4/d17/d24/d29/d58/dac/dc0 39 2024-04-25T15:58:13.830 INFO:tasks.workunit.client.0.smithi087.stdout:6/891: chown d7/d1a/d1d/d21/d27/d2c/d35/c54 133556 1 2024-04-25T15:58:13.832 INFO:tasks.workunit.client.0.smithi087.stdout:2/708: dread - d3/d27/d29/d76/fc5 zero size 2024-04-25T15:58:13.834 INFO:tasks.workunit.client.0.smithi087.stdout:8/810: dwrite d4/d22/d43/d7f/dc6/ddc/da0/fc5 [4194304,4194304] 0 2024-04-25T15:58:13.913 INFO:tasks.workunit.client.0.smithi087.stdout:4/790: sync 2024-04-25T15:58:13.927 INFO:tasks.workunit.client.0.smithi087.stdout:3/708: mknod d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/cdd 0 2024-04-25T15:58:13.928 INFO:tasks.workunit.client.0.smithi087.stdout:6/892: mknod d7/d1a/d1d/d21/c132 0 2024-04-25T15:58:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:4/791: rmdir d4/d10/d60/d5c/d8d/d9f 39 2024-04-25T15:58:13.936 INFO:tasks.workunit.client.0.smithi087.stdout:7/494: link d1/d4/d18/l75 d1/d3c/l9b 0 2024-04-25T15:58:13.939 INFO:tasks.workunit.client.0.smithi087.stdout:6/893: mkdir d7/d1a/d1d/d21/d27/d2c/d35/d127/d133 0 2024-04-25T15:58:13.940 INFO:tasks.workunit.client.0.smithi087.stdout:8/811: dwrite d4/d1d/d17/d37/fad [0,4194304] 0 2024-04-25T15:58:13.943 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-04-25T15:58:13.938+0000 7f627a0fe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:58:13.947 INFO:tasks.workunit.client.0.smithi087.stdout:4/792: fsync d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f96 0 2024-04-25T15:58:13.952 INFO:tasks.workunit.client.0.smithi087.stdout:2/709: dread d3/d20/f46 [0,4194304] 0 2024-04-25T15:58:13.956 INFO:tasks.workunit.client.0.smithi087.stdout:3/709: dwrite d4/d17/d24/d29/d58/dac/d9c/fab [0,4194304] 0 2024-04-25T15:58:13.958 INFO:tasks.workunit.client.0.smithi087.stdout:6/894: dread f6 [4194304,4194304] 0 2024-04-25T15:58:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:2/710: rename d3/f1e to d3/d27/d29/d2d/d40/d95/fdb 0 2024-04-25T15:58:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:6/895: mkdir d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/d134 0 2024-04-25T15:58:13.969 INFO:tasks.workunit.client.0.smithi087.stdout:8/812: dread d4/d1d/de1/f8d [0,4194304] 0 2024-04-25T15:58:13.970 INFO:tasks.workunit.client.0.smithi087.stdout:2/711: creat d3/fdc x:0 0 0 2024-04-25T15:58:13.971 INFO:tasks.workunit.client.0.smithi087.stdout:6/896: symlink d7/d71/d59/d90/da5/l135 0 2024-04-25T15:58:13.972 INFO:tasks.workunit.client.0.smithi087.stdout:4/793: dwrite d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f96 [0,4194304] 0 2024-04-25T15:58:13.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/794: stat f0 0 2024-04-25T15:58:13.974 INFO:tasks.workunit.client.0.smithi087.stdout:8/813: chown d4/d8/dd/ca4 204630 1 2024-04-25T15:58:13.974 INFO:tasks.workunit.client.0.smithi087.stdout:6/897: dread - d7/d71/d76/fd5 zero size 2024-04-25T15:58:13.977 INFO:tasks.workunit.client.0.smithi087.stdout:4/795: mkdir d4/d10/d60/d52/d66/d15/d103 0 2024-04-25T15:58:13.981 INFO:tasks.workunit.client.0.smithi087.stdout:2/712: write d3/d27/d29/d2d/f57 [561693,34207] 0 2024-04-25T15:58:13.982 INFO:tasks.workunit.client.0.smithi087.stdout:2/713: chown d3/d2a/l15 15444087 1 2024-04-25T15:58:13.984 INFO:tasks.workunit.client.0.smithi087.stdout:2/714: write d3/fdc [642041,112850] 0 2024-04-25T15:58:13.985 INFO:tasks.workunit.client.0.smithi087.stdout:6/898: dread d7/d1a/d1d/d21/d27/d2c/d35/f97 [0,4194304] 0 2024-04-25T15:58:13.990 INFO:tasks.workunit.client.0.smithi087.stdout:6/899: unlink d7/d1a/d41/l65 0 2024-04-25T15:58:13.992 INFO:tasks.workunit.client.0.smithi087.stdout:4/796: dwrite d4/d10/d60/fa6 [0,4194304] 0 2024-04-25T15:58:14.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/900: write d7/d71/f24 [1095460,11433] 0 2024-04-25T15:58:14.006 INFO:tasks.workunit.client.0.smithi087.stdout:2/715: dwrite d3/d27/f31 [0,4194304] 0 2024-04-25T15:58:14.008 INFO:tasks.workunit.client.0.smithi087.stdout:4/797: write d4/d10/d60/d5c/d3a/f3e [2611143,100098] 0 2024-04-25T15:58:14.009 INFO:tasks.workunit.client.0.smithi087.stdout:8/814: dread d4/d8/dd/f52 [0,4194304] 0 2024-04-25T15:58:14.012 INFO:tasks.workunit.client.0.smithi087.stdout:2/716: symlink d3/d2a/d48/d77/d79/d85/ldd 0 2024-04-25T15:58:14.014 INFO:tasks.workunit.client.0.smithi087.stdout:4/798: creat d4/d10/d60/d56/d61/d3f/d42/d97/f104 x:0 0 0 2024-04-25T15:58:14.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/717: chown d3/d2a/d48/d77/d79 66222375 1 2024-04-25T15:58:14.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/815: creat d4/d8/dd/d2f/d6f/f104 x:0 0 0 2024-04-25T15:58:14.017 INFO:tasks.workunit.client.0.smithi087.stdout:2/718: stat d3/d2a/d48/d77/d79/d85 0 2024-04-25T15:58:14.018 INFO:tasks.workunit.client.0.smithi087.stdout:6/901: dwrite d7/d71/d59/d90/da5/f100 [4194304,4194304] 0 2024-04-25T15:58:14.019 INFO:tasks.workunit.client.0.smithi087.stdout:4/799: mknod d4/d10/d60/d56/d61/df6/c105 0 2024-04-25T15:58:14.022 INFO:tasks.workunit.client.0.smithi087.stdout:2/719: mkdir d3/d27/d29/d4f/d5a/d6a/d88/d94/dcc/dde 0 2024-04-25T15:58:14.023 INFO:tasks.workunit.client.0.smithi087.stdout:8/816: link d4/d22/d43/d7f/dc6/ddc/da0/lab d4/d22/d43/d7f/dc6/ddc/l105 0 2024-04-25T15:58:14.024 INFO:tasks.workunit.client.0.smithi087.stdout:8/817: fsync d4/d8/f49 0 2024-04-25T15:58:14.025 INFO:tasks.workunit.client.0.smithi087.stdout:4/800: creat d4/d10/d60/d56/d61/d3f/d42/d100/f106 x:0 0 0 2024-04-25T15:58:14.027 INFO:tasks.workunit.client.0.smithi087.stdout:4/801: stat d4/d10/d60/d56/d61/d3f/d42/c47 0 2024-04-25T15:58:14.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/720: dread d3/d27/d29/d2d/d40/fc3 [0,4194304] 0 2024-04-25T15:58:14.028 INFO:tasks.workunit.client.0.smithi087.stdout:8/818: write d4/d22/d43/d7f/f99 [1598393,100495] 0 2024-04-25T15:58:14.029 INFO:tasks.workunit.client.0.smithi087.stdout:4/802: chown d4/d10/d60/d56/d61/d3f/d58/f8f 2 1 2024-04-25T15:58:14.032 INFO:tasks.workunit.client.0.smithi087.stdout:8/819: mkdir d4/d1d/d17/d37/d106 0 2024-04-25T15:58:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:4/803: truncate d4/d10/d60/d52/d66/d15/f1d 2983392 0 2024-04-25T15:58:14.034 INFO:tasks.workunit.client.0.smithi087.stdout:6/902: dread d7/f10 [0,4194304] 0 2024-04-25T15:58:14.035 INFO:tasks.workunit.client.0.smithi087.stdout:8/820: symlink d4/d1d/d17/d101/l107 0 2024-04-25T15:58:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:4/804: mkdir d4/d10/d60/d52/d107 0 2024-04-25T15:58:14.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/721: dwrite d3/fdc [0,4194304] 0 2024-04-25T15:58:14.039 INFO:tasks.workunit.client.0.smithi087.stdout:8/821: rmdir d4/d22/d43/d7f/dc6 39 2024-04-25T15:58:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:2/722: creat d3/d27/d38/fdf x:0 0 0 2024-04-25T15:58:14.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/822: creat d4/d22/d43/d7f/dc6/ddc/f108 x:0 0 0 2024-04-25T15:58:14.044 INFO:tasks.workunit.client.0.smithi087.stdout:2/723: mknod d3/d2a/d48/d77/db6/ce0 0 2024-04-25T15:58:14.045 INFO:tasks.workunit.client.0.smithi087.stdout:8/823: rmdir d4/d22/d43 39 2024-04-25T15:58:14.050 INFO:tasks.workunit.client.0.smithi087.stdout:9/699: sync 2024-04-25T15:58:14.050 INFO:tasks.workunit.client.0.smithi087.stdout:1/773: sync 2024-04-25T15:58:14.052 INFO:tasks.workunit.client.0.smithi087.stdout:9/700: symlink d6/d8/d12/ldb 0 2024-04-25T15:58:14.055 INFO:tasks.workunit.client.0.smithi087.stdout:6/903: dread d7/d1a/d1d/d21/d27/d2c/f57 [0,4194304] 0 2024-04-25T15:58:14.055 INFO:tasks.workunit.client.0.smithi087.stdout:9/701: truncate d6/d8/d12/db7/f3f 4526348 0 2024-04-25T15:58:14.059 INFO:tasks.workunit.client.0.smithi087.stdout:2/724: write d3/d20/d4a/f4c [815995,19271] 0 2024-04-25T15:58:14.059 INFO:tasks.workunit.client.0.smithi087.stdout:6/904: write d7/d1a/d1d/f28 [1578284,80594] 0 2024-04-25T15:58:14.062 INFO:tasks.workunit.client.0.smithi087.stdout:8/824: truncate d4/d22/d43/d7f/dc6/ddc/da0/fc5 4843004 0 2024-04-25T15:58:14.062 INFO:tasks.workunit.client.0.smithi087.stdout:2/725: stat d3/d27/d29/f2c 0 2024-04-25T15:58:14.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/805: dread d4/d10/d60/d52/ff2 [0,4194304] 0 2024-04-25T15:58:14.063 INFO:tasks.workunit.client.0.smithi087.stdout:1/774: dwrite d3/d12/d14/d29/d65/fcd [0,4194304] 0 2024-04-25T15:58:14.064 INFO:tasks.workunit.client.0.smithi087.stdout:6/905: chown d7/d1a/d1d/d21/d27/d2c/db4 263439000 1 2024-04-25T15:58:14.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/726: read d3/d27/d29/d2d/d40/fc3 [349441,102987] 0 2024-04-25T15:58:14.065 INFO:tasks.workunit.client.0.smithi087.stdout:1/775: chown d3/d2d/ld7 6395 1 2024-04-25T15:58:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/727: write d3/d2a/f14 [2514406,47651] 0 2024-04-25T15:58:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/906: rename d7/d1a/d41/la4 to d7/d1a/d1d/d21/dba/l136 0 2024-04-25T15:58:14.070 INFO:tasks.workunit.client.0.smithi087.stdout:2/728: chown d3/d2a/l15 44504954 1 2024-04-25T15:58:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/806: mknod d4/c108 0 2024-04-25T15:58:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:6/907: fdatasync d7/d1a/d41/f55 0 2024-04-25T15:58:14.073 INFO:tasks.workunit.client.0.smithi087.stdout:6/908: fdatasync d7/d1a/d1d/d21/d27/d2c/f106 0 2024-04-25T15:58:14.073 INFO:tasks.workunit.client.0.smithi087.stdout:8/825: dread d4/d22/d43/f61 [0,4194304] 0 2024-04-25T15:58:14.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/776: dread d3/d12/d4d/f57 [0,4194304] 0 2024-04-25T15:58:14.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/807: symlink d4/d10/d60/d52/d66/d15/df1/l109 0 2024-04-25T15:58:14.079 INFO:tasks.workunit.client.0.smithi087.stdout:6/909: rmdir d7/d1a/d1d/d21/dba 39 2024-04-25T15:58:14.080 INFO:tasks.workunit.client.0.smithi087.stdout:2/729: dwrite d3/d20/d4a/fa3 [0,4194304] 0 2024-04-25T15:58:14.081 INFO:tasks.workunit.client.0.smithi087.stdout:4/808: chown d4/d10/d60/d5c/d3a/d90/fb0 1 1 2024-04-25T15:58:14.081 INFO:tasks.workunit.client.0.smithi087.stdout:9/702: dread d6/d8/d12/db7/d3a/d5b/d60/d1d/f39 [0,4194304] 0 2024-04-25T15:58:14.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/809: write d4/d10/d60/fa6 [5184249,86618] 0 2024-04-25T15:58:14.082 INFO:tasks.workunit.client.0.smithi087.stdout:8/826: truncate d4/d1d/d14/f31 113919 0 2024-04-25T15:58:14.086 INFO:tasks.workunit.client.0.smithi087.stdout:9/703: symlink d6/d8/d32/d4c/ldc 0 2024-04-25T15:58:14.089 INFO:tasks.workunit.client.0.smithi087.stdout:9/704: truncate d6/d8/d12/db7/d3a/d58/d72/dd2/fd4 720035 0 2024-04-25T15:58:14.089 INFO:tasks.workunit.client.0.smithi087.stdout:1/777: creat d3/d12/d14/d29/d67/f10a x:0 0 0 2024-04-25T15:58:14.090 INFO:tasks.workunit.client.0.smithi087.stdout:1/778: dread - d3/dad/fde zero size 2024-04-25T15:58:14.091 INFO:tasks.workunit.client.0.smithi087.stdout:4/810: mkdir d4/d10/d60/d56/d61/d10a 0 2024-04-25T15:58:14.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/705: rmdir d6/d8/d32/d57 39 2024-04-25T15:58:14.093 INFO:tasks.workunit.client.0.smithi087.stdout:1/779: rmdir d3/d12/d14 39 2024-04-25T15:58:14.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/827: rename d4/d1d/d7c/f15 to d4/d9c/f109 0 2024-04-25T15:58:14.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/828: stat d4/d22/d43/f61 0 2024-04-25T15:58:14.097 INFO:tasks.workunit.client.0.smithi087.stdout:4/811: read - d4/d10/d60/d56/d61/d3f/d42/d97/f94 zero size 2024-04-25T15:58:14.101 INFO:tasks.workunit.client.0.smithi087.stdout:8/829: symlink d4/d1d/d14/l10a 0 2024-04-25T15:58:14.102 INFO:tasks.workunit.client.0.smithi087.stdout:4/812: symlink d4/d10/d60/l10b 0 2024-04-25T15:58:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/910: dwrite d7/d1a/d1d/d8a/f91 [0,4194304] 0 2024-04-25T15:58:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:9/706: creat d6/d8/d32/d57/d66/da7/da8/fdd x:0 0 0 2024-04-25T15:58:14.104 INFO:tasks.workunit.client.0.smithi087.stdout:6/911: chown f6 78 1 2024-04-25T15:58:14.107 INFO:tasks.workunit.client.0.smithi087.stdout:1/780: mknod d3/d12/d14/d29/d2f/df7/c10b 0 2024-04-25T15:58:14.111 INFO:tasks.workunit.client.0.smithi087.stdout:4/813: mkdir d4/d10c 0 2024-04-25T15:58:14.112 INFO:tasks.workunit.client.0.smithi087.stdout:6/912: mkdir d7/d1a/d41/dbd/df0/d120/d137 0 2024-04-25T15:58:14.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/830: creat d4/d8/dd/d2f/f10b x:0 0 0 2024-04-25T15:58:14.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/831: read d4/d8/fb [1166979,67801] 0 2024-04-25T15:58:14.118 INFO:tasks.workunit.client.0.smithi087.stdout:1/781: creat d3/d12/d14/d29/d2f/d53/dca/d104/f10c x:0 0 0 2024-04-25T15:58:14.120 INFO:tasks.workunit.client.0.smithi087.stdout:8/832: write d4/d1d/de1/d82/ffb [932537,89623] 0 2024-04-25T15:58:14.124 INFO:tasks.workunit.client.0.smithi087.stdout:6/913: dread d7/d1a/d1d/d21/d27/d2c/d35/f53 [0,4194304] 0 2024-04-25T15:58:14.124 INFO:tasks.workunit.client.0.smithi087.stdout:4/814: link d4/d10/d60/d5c/d3a/d90/db9/fef d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f10d 0 2024-04-25T15:58:14.126 INFO:tasks.workunit.client.0.smithi087.stdout:9/707: truncate d6/d8/d12/db7/d3a/d5b/d60/f86 253238 0 2024-04-25T15:58:14.126 INFO:tasks.workunit.client.0.smithi087.stdout:4/815: stat d4/d10/d60/d5c/d3a 0 2024-04-25T15:58:14.127 INFO:tasks.workunit.client.0.smithi087.stdout:1/782: dwrite d3/fb9 [0,4194304] 0 2024-04-25T15:58:14.130 INFO:tasks.workunit.client.0.smithi087.stdout:9/708: mkdir d6/d3e/d63/dc2/dde 0 2024-04-25T15:58:14.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/783: mknod d3/d12/d14/d29/d65/c10d 0 2024-04-25T15:58:14.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/709: dread - d6/d8/d12/db7/d3a/fcc zero size 2024-04-25T15:58:14.133 INFO:tasks.workunit.client.0.smithi087.stdout:6/914: link d7/f18 d7/d1a/f138 0 2024-04-25T15:58:14.136 INFO:tasks.workunit.client.0.smithi087.stdout:1/784: fsync d3/d12/d14/d29/d2f/d53/f84 0 2024-04-25T15:58:14.140 INFO:tasks.workunit.client.0.smithi087.stdout:6/915: mknod d7/d1a/c139 0 2024-04-25T15:58:14.141 INFO:tasks.workunit.client.0.smithi087.stdout:1/785: rename d3/d12/d4d/dba/lc3 to d3/d12/d14/d29/d2f/d53/dca/l10e 0 2024-04-25T15:58:14.142 INFO:tasks.workunit.client.0.smithi087.stdout:8/833: truncate d4/d8/f60 3312131 0 2024-04-25T15:58:14.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/916: symlink d7/dd4/l13a 0 2024-04-25T15:58:14.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/765: sync 2024-04-25T15:58:14.190 INFO:tasks.workunit.client.0.smithi087.stdout:0/834: sync 2024-04-25T15:58:14.203 INFO:tasks.workunit.client.0.smithi087.stdout:8/834: mkdir d4/d22/d43/d7f/dc6/df7/d10c 0 2024-04-25T15:58:14.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/835: chown d1/da/d3e/c5a 38751 1 2024-04-25T15:58:14.207 INFO:tasks.workunit.client.0.smithi087.stdout:1/786: rmdir d3/d12/d14/d29/d67/d73/d9c/dd0/dd5 0 2024-04-25T15:58:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:5/766: creat d9/d99/ff7 x:0 0 0 2024-04-25T15:58:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:6/917: link d7/d1a/d41/dbd/df0/df9/f10d d7/dfd/f13b 0 2024-04-25T15:58:14.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/835: rmdir d4/d8/dd/d85 39 2024-04-25T15:58:14.210 INFO:tasks.workunit.client.0.smithi087.stdout:0/836: rmdir d1/d6 39 2024-04-25T15:58:14.212 INFO:tasks.workunit.client.0.smithi087.stdout:9/710: dread d6/d8/d12/db7/d3a/d58/f76 [0,4194304] 0 2024-04-25T15:58:14.213 INFO:tasks.workunit.client.0.smithi087.stdout:1/787: write d3/d12/d14/d29/d67/d73/fd9 [313384,51251] 0 2024-04-25T15:58:14.213 INFO:tasks.workunit.client.0.smithi087.stdout:5/767: creat d9/d2f/d40/d4d/d7b/dea/ff8 x:0 0 0 2024-04-25T15:58:14.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/837: write d1/d4f/de3/df5/fec [952596,25626] 0 2024-04-25T15:58:14.217 INFO:tasks.workunit.client.0.smithi087.stdout:8/836: getdents d4/d1d/d17/d72 0 2024-04-25T15:58:14.219 INFO:tasks.workunit.client.0.smithi087.stdout:9/711: dread - d6/d8/d32/d57/d66/da7/da8/fc6 zero size 2024-04-25T15:58:14.219 INFO:tasks.workunit.client.0.smithi087.stdout:1/788: mknod d3/dad/c10f 0 2024-04-25T15:58:14.221 INFO:tasks.workunit.client.0.smithi087.stdout:6/918: truncate d7/d71/d59/d90/da5/f12e 2483196 0 2024-04-25T15:58:14.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/837: mknod d4/d1d/d7c/dae/db7/c10d 0 2024-04-25T15:58:14.225 INFO:tasks.workunit.client.0.smithi087.stdout:1/789: creat d3/d12/d39/d64/dc0/f110 x:0 0 0 2024-04-25T15:58:14.227 INFO:tasks.workunit.client.0.smithi087.stdout:8/838: write d4/d1d/de1/fc1 [627819,11770] 0 2024-04-25T15:58:14.227 INFO:tasks.workunit.client.0.smithi087.stdout:6/919: unlink d7/d1a/d1d/lf4 0 2024-04-25T15:58:14.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/839: chown d4/d22/d43/lfe 14 1 2024-04-25T15:58:14.233 INFO:tasks.workunit.client.0.smithi087.stdout:6/920: write d7/d71/d59/dc7/dec/fe8 [1461237,68082] 0 2024-04-25T15:58:14.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/790: unlink d3/d12/d14/d29/d2f/d61/la6 0 2024-04-25T15:58:14.235 INFO:tasks.workunit.client.0.smithi087.stdout:5/768: link d9/d91/d30/d70/d82/ccd d9/d91/d30/d70/d79/dae/de4/de5/cf9 0 2024-04-25T15:58:14.236 INFO:tasks.workunit.client.0.smithi087.stdout:9/712: dwrite d6/d8/d32/d4c/fb1 [0,4194304] 0 2024-04-25T15:58:14.238 INFO:tasks.workunit.client.0.smithi087.stdout:6/921: dread - d7/d1a/d41/dbd/df0/df9/f108 zero size 2024-04-25T15:58:14.243 INFO:tasks.workunit.client.0.smithi087.stdout:9/713: mknod d6/d3e/d63/dc2/cdf 0 2024-04-25T15:58:14.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/769: creat d9/d2f/d40/d4d/de1/ffa x:0 0 0 2024-04-25T15:58:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:1/791: creat d3/d12/d14/f111 x:0 0 0 2024-04-25T15:58:14.248 INFO:tasks.workunit.client.0.smithi087.stdout:0/838: write d1/da/d3e/d85/d9b/d10a/dba/fee [607635,14574] 0 2024-04-25T15:58:14.249 INFO:tasks.workunit.client.0.smithi087.stdout:1/792: read - d3/d12/d39/d64/dc0/ff6 zero size 2024-04-25T15:58:14.251 INFO:tasks.workunit.client.0.smithi087.stdout:9/714: rename d6/d8/d12/db7/d3a/d7c/lac to d6/d8/d32/d57/d66/da7/le0 0 2024-04-25T15:58:14.253 INFO:tasks.workunit.client.0.smithi087.stdout:0/839: write d1/d6/d77/dc6/fe2 [639934,32766] 0 2024-04-25T15:58:14.254 INFO:tasks.workunit.client.0.smithi087.stdout:1/793: symlink d3/d12/d4d/da5/l112 0 2024-04-25T15:58:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:5/770: creat d9/d2f/d40/d4d/d58/df1/ffb x:0 0 0 2024-04-25T15:58:14.263 INFO:tasks.workunit.client.0.smithi087.stdout:6/922: dread d7/d71/d59/d90/da5/fc0 [0,4194304] 0 2024-04-25T15:58:14.272 INFO:tasks.workunit.client.0.smithi087.stdout:6/923: dwrite d7/d1a/d41/dbd/faa [0,4194304] 0 2024-04-25T15:58:14.272 INFO:tasks.workunit.client.0.smithi087.stdout:9/715: mknod d6/d8/d32/ce1 0 2024-04-25T15:58:14.274 INFO:tasks.workunit.client.0.smithi087.stdout:1/794: dwrite d3/d12/d14/d29/d65/d97/fb8 [0,4194304] 0 2024-04-25T15:58:14.275 INFO:tasks.workunit.client.0.smithi087.stdout:0/840: creat d1/da/d3e/d54/f115 x:0 0 0 2024-04-25T15:58:14.281 INFO:tasks.workunit.client.0.smithi087.stdout:5/771: dread d9/d91/d30/d70/d79/fdf [0,4194304] 0 2024-04-25T15:58:14.282 INFO:tasks.workunit.client.0.smithi087.stdout:6/924: mkdir d7/d1a/d1d/d21/d27/d2c/d13c 0 2024-04-25T15:58:14.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/495: sync 2024-04-25T15:58:14.291 INFO:tasks.workunit.client.0.smithi087.stdout:1/795: rename d3/d12/d14/d29/d3b/la8 to d3/d12/d4d/da5/l113 0 2024-04-25T15:58:14.292 INFO:tasks.workunit.client.0.smithi087.stdout:9/716: creat d6/d8/d12/db7/d3a/d5b/d60/fe2 x:0 0 0 2024-04-25T15:58:14.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/925: creat d7/d71/d59/d90/f13d x:0 0 0 2024-04-25T15:58:14.295 INFO:tasks.workunit.client.0.smithi087.stdout:9/717: write d6/d8/d12/db7/f3f [1180609,19332] 0 2024-04-25T15:58:14.302 INFO:tasks.workunit.client.0.smithi087.stdout:1/796: dwrite d3/f1b [0,4194304] 0 2024-04-25T15:58:14.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/496: dwrite d1/d3c/d6b/f79 [0,4194304] 0 2024-04-25T15:58:14.313 INFO:tasks.workunit.client.0.smithi087.stdout:0/841: write d1/da/f64 [2638508,113104] 0 2024-04-25T15:58:14.313 INFO:tasks.workunit.client.0.smithi087.stdout:5/772: write d9/d2f/d40/f72 [1350231,106305] 0 2024-04-25T15:58:14.318 INFO:tasks.workunit.client.0.smithi087.stdout:1/797: truncate d3/d12/d14/d29/d8e/fbb 796184 0 2024-04-25T15:58:14.319 INFO:tasks.workunit.client.0.smithi087.stdout:0/842: read d1/f92 [3264484,103031] 0 2024-04-25T15:58:14.322 INFO:tasks.workunit.client.0.smithi087.stdout:1/798: fdatasync d3/d12/f26 0 2024-04-25T15:58:14.323 INFO:tasks.workunit.client.0.smithi087.stdout:5/773: symlink d9/d2f/d40/d4d/lfc 0 2024-04-25T15:58:14.324 INFO:tasks.workunit.client.0.smithi087.stdout:6/926: write d7/d1a/fc4 [1485602,56357] 0 2024-04-25T15:58:14.326 INFO:tasks.workunit.client.0.smithi087.stdout:1/799: fsync d3/dad/fde 0 2024-04-25T15:58:14.335 INFO:tasks.workunit.client.0.smithi087.stdout:0/843: dread d1/d6/d21/d2a/f6f [0,4194304] 0 2024-04-25T15:58:14.336 INFO:tasks.workunit.client.0.smithi087.stdout:1/800: fsync d3/d12/d14/f2b 0 2024-04-25T15:58:14.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/927: dwrite d7/d1a/d41/dbd/db9/f10e [0,4194304] 0 2024-04-25T15:58:14.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/801: mknod d3/d12/d4d/da5/c114 0 2024-04-25T15:58:14.342 INFO:tasks.workunit.client.0.smithi087.stdout:0/844: mkdir d1/d6/d21/d2a/dd5/d116 0 2024-04-25T15:58:14.343 INFO:tasks.workunit.client.0.smithi087.stdout:7/497: dread d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:14.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/845: truncate d1/da/d3e/d54/f115 303393 0 2024-04-25T15:58:14.346 INFO:tasks.workunit.client.0.smithi087.stdout:0/846: truncate d1/da/d3e/d85/d9b/dcd/df2/f110 135002 0 2024-04-25T15:58:14.348 INFO:tasks.workunit.client.0.smithi087.stdout:7/498: write d1/d9/d26/d45/f61 [2386270,2974] 0 2024-04-25T15:58:14.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/847: mkdir d1/d6/d112/d7d/d117 0 2024-04-25T15:58:14.351 INFO:tasks.workunit.client.0.smithi087.stdout:1/802: rename d3/d12/d14/l3d to d3/d12/d14/d33/l115 0 2024-04-25T15:58:14.352 INFO:tasks.workunit.client.0.smithi087.stdout:7/499: symlink d1/d9/l9c 0 2024-04-25T15:58:14.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/803: fsync d3/d12/d14/d29/d8e/f9d 0 2024-04-25T15:58:14.356 INFO:tasks.workunit.client.0.smithi087.stdout:7/500: write d1/d4/d7e/f96 [669816,4750] 0 2024-04-25T15:58:14.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/501: unlink d1/d4/d18/d36/d37/c7d 0 2024-04-25T15:58:14.361 INFO:tasks.workunit.client.0.smithi087.stdout:7/502: unlink d1/d9/le 0 2024-04-25T15:58:14.364 INFO:tasks.workunit.client.0.smithi087.stdout:7/503: unlink d1/d4/d18/d36/c3f 0 2024-04-25T15:58:14.366 INFO:tasks.workunit.client.0.smithi087.stdout:7/504: truncate d1/d4/f3d 5221304 0 2024-04-25T15:58:14.370 INFO:tasks.workunit.client.0.smithi087.stdout:1/804: dread d3/d12/d14/f2b [0,4194304] 0 2024-04-25T15:58:14.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/805: write d3/d12/d14/d29/d2f/d40/f54 [1045952,6885] 0 2024-04-25T15:58:14.381 INFO:tasks.workunit.client.0.smithi087.stdout:1/806: creat d3/d12/d14/d29/d67/d73/d9c/dd0/f116 x:0 0 0 2024-04-25T15:58:14.383 INFO:tasks.workunit.client.0.smithi087.stdout:1/807: mkdir d3/d12/d4d/dba/d117 0 2024-04-25T15:58:14.383 INFO:tasks.workunit.client.0.smithi087.stdout:1/808: chown d3/d2d 0 1 2024-04-25T15:58:14.384 INFO:tasks.workunit.client.0.smithi087.stdout:1/809: chown d3/d12/d14/d29/d2f/d53/dca/d104/f10c 3 1 2024-04-25T15:58:14.386 INFO:tasks.workunit.client.0.smithi087.stdout:1/810: fsync d3/d12/d14/d29/d3b/f98 0 2024-04-25T15:58:14.403 INFO:tasks.workunit.client.0.smithi087.stdout:2/730: sync 2024-04-25T15:58:14.403 INFO:tasks.workunit.client.0.smithi087.stdout:3/710: sync 2024-04-25T15:58:14.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/731: creat d3/d2a/d81/fe1 x:0 0 0 2024-04-25T15:58:14.407 INFO:tasks.workunit.client.0.smithi087.stdout:2/732: mkdir d3/d2a/d81/de2 0 2024-04-25T15:58:14.409 INFO:tasks.workunit.client.0.smithi087.stdout:2/733: write d3/d2a/d48/d77/d79/f9a [2655469,108397] 0 2024-04-25T15:58:14.411 INFO:tasks.workunit.client.0.smithi087.stdout:2/734: mkdir d3/d27/d29/d4f/de3 0 2024-04-25T15:58:14.412 INFO:tasks.workunit.client.0.smithi087.stdout:2/735: chown d3/d27/d29/d4f/d5a/d6a/d88 52385941 1 2024-04-25T15:58:14.413 INFO:tasks.workunit.client.0.smithi087.stdout:2/736: chown d3/d27/d29/d2d/d40/d95 5 1 2024-04-25T15:58:14.415 INFO:tasks.workunit.client.0.smithi087.stdout:2/737: mkdir d3/d2a/d81/de4 0 2024-04-25T15:58:14.417 INFO:tasks.workunit.client.0.smithi087.stdout:3/711: dwrite d4/d17/d81/da6/d37/f40 [0,4194304] 0 2024-04-25T15:58:14.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/738: mkdir d3/d27/d29/d4f/d5a/d6a/d88/d94/dcc/de5 0 2024-04-25T15:58:14.421 INFO:tasks.workunit.client.0.smithi087.stdout:3/712: truncate d4/d17/d24/d29/d58/dac/dc0/f3a 403135 0 2024-04-25T15:58:14.424 INFO:tasks.workunit.client.0.smithi087.stdout:3/713: symlink d4/d17/d24/d29/d58/dac/dc0/lde 0 2024-04-25T15:58:14.430 INFO:tasks.workunit.client.0.smithi087.stdout:2/739: truncate d3/d27/d29/f2c 3470343 0 2024-04-25T15:58:14.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/740: creat d3/d27/d29/d4f/d5a/d6a/d88/fe6 x:0 0 0 2024-04-25T15:58:14.434 INFO:tasks.workunit.client.0.smithi087.stdout:2/741: fsync d3/d27/f42 0 2024-04-25T15:58:14.436 INFO:tasks.workunit.client.0.smithi087.stdout:3/714: dwrite d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f44 [0,4194304] 0 2024-04-25T15:58:14.437 INFO:tasks.workunit.client.0.smithi087.stdout:2/742: read d3/d27/d29/d4f/d5a/d6a/d88/fc9 [2008591,73617] 0 2024-04-25T15:58:14.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/715: write d4/d17/d24/f46 [469195,5240] 0 2024-04-25T15:58:14.439 INFO:tasks.workunit.client.0.smithi087.stdout:3/716: chown d4/d17/d81 85247 1 2024-04-25T15:58:14.441 INFO:tasks.workunit.client.0.smithi087.stdout:3/717: dread - d4/d17/d81/da6/d53/d7d/fcb zero size 2024-04-25T15:58:14.443 INFO:tasks.workunit.client.0.smithi087.stdout:3/718: read d4/d17/d24/d29/d58/dac/d99/fa4 [120526,10678] 0 2024-04-25T15:58:14.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/719: fdatasync d4/d17/d24/d29/d58/dac/f79 0 2024-04-25T15:58:14.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/720: write d4/d17/f1b [631741,22268] 0 2024-04-25T15:58:14.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/721: creat d4/d17/d81/da6/d53/fdf x:0 0 0 2024-04-25T15:58:14.453 INFO:tasks.workunit.client.0.smithi087.stdout:2/743: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:14.456 INFO:tasks.workunit.client.0.smithi087.stdout:2/744: truncate d3/d2a/d48/d77/d79/d85/fc1 491002 0 2024-04-25T15:58:14.461 INFO:tasks.workunit.client.0.smithi087.stdout:2/745: rename d3/d27/d29/d4f/d5a/d6a/d88/d94/dcc to d3/d27/d29/d4f/d5a/d6a/d88/de7 0 2024-04-25T15:58:14.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/746: truncate d3/d2a/d81/d93/fc8 991463 0 2024-04-25T15:58:14.482 INFO:tasks.workunit.client.0.smithi087.stdout:9/718: sync 2024-04-25T15:58:14.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/840: sync 2024-04-25T15:58:14.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/816: sync 2024-04-25T15:58:14.484 INFO:tasks.workunit.client.0.smithi087.stdout:9/719: fdatasync d6/d8/d32/fc7 0 2024-04-25T15:58:14.485 INFO:tasks.workunit.client.0.smithi087.stdout:8/841: mknod d4/d1d/c10e 0 2024-04-25T15:58:14.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/720: read - d6/d3e/d63/dc2/fc3 zero size 2024-04-25T15:58:14.486 INFO:tasks.workunit.client.0.smithi087.stdout:4/817: write d4/d10/d60/d56/d61/d3f/d42/d97/f1b [3882840,70462] 0 2024-04-25T15:58:14.488 INFO:tasks.workunit.client.0.smithi087.stdout:8/842: readlink d4/d8/dd/d85/dbc/dd2/le5 0 2024-04-25T15:58:14.489 INFO:tasks.workunit.client.0.smithi087.stdout:4/818: truncate d4/d10/d60/fb6 320778 0 2024-04-25T15:58:14.489 INFO:tasks.workunit.client.0.smithi087.stdout:9/721: fsync d6/d8/d12/db7/d3a/d5b/d60/d1d/f36 0 2024-04-25T15:58:14.497 INFO:tasks.workunit.client.0.smithi087.stdout:9/722: link d6/d8/d12/db7/d3a/d58/d72/f7d d6/d3e/d92/fe3 0 2024-04-25T15:58:14.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/723: write d6/d8/d12/db7/d3a/d5b/d60/fa5 [465980,56745] 0 2024-04-25T15:58:14.503 INFO:tasks.workunit.client.0.smithi087.stdout:4/819: dwrite d4/d10/d60/d56/d61/d3f/fd6 [4194304,4194304] 0 2024-04-25T15:58:14.505 INFO:tasks.workunit.client.0.smithi087.stdout:8/843: dread d4/d1d/de1/da6/fcc [0,4194304] 0 2024-04-25T15:58:14.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/820: dread d4/d10/d60/d5c/d3a/f67 [0,4194304] 0 2024-04-25T15:58:14.520 INFO:tasks.workunit.client.0.smithi087.stdout:4/821: read - d4/d10/d60/d56/fe7 zero size 2024-04-25T15:58:14.521 INFO:tasks.workunit.client.0.smithi087.stdout:4/822: rmdir d4/d87 39 2024-04-25T15:58:14.522 INFO:tasks.workunit.client.0.smithi087.stdout:4/823: rmdir d4/d10/d60/d56/d61/d3f/d42/d97/de2 39 2024-04-25T15:58:14.525 INFO:tasks.workunit.client.0.smithi087.stdout:4/824: unlink d4/d10/d60/d5c/f37 0 2024-04-25T15:58:14.526 INFO:tasks.workunit.client.0.smithi087.stdout:4/825: readlink d4/d10/d60/d5c/d8d/le4 0 2024-04-25T15:58:14.528 INFO:tasks.workunit.client.0.smithi087.stdout:8/844: dread d4/d1d/d14/fa5 [0,4194304] 0 2024-04-25T15:58:14.532 INFO:tasks.workunit.client.0.smithi087.stdout:9/724: dread d6/d8/d12/db7/d3a/d5b/d60/d1d/f6c [0,4194304] 0 2024-04-25T15:58:14.533 INFO:tasks.workunit.client.0.smithi087.stdout:4/826: dread d4/d10/d60/d5c/f2d [0,4194304] 0 2024-04-25T15:58:14.534 INFO:tasks.workunit.client.0.smithi087.stdout:9/725: truncate d6/d8/d12/db7/d3a/d7c/fcf 712191 0 2024-04-25T15:58:14.538 INFO:tasks.workunit.client.0.smithi087.stdout:9/726: link d6/d8/d12/db7/f73 d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/fe4 0 2024-04-25T15:58:14.540 INFO:tasks.workunit.client.0.smithi087.stdout:9/727: mknod d6/d8/d32/d4c/db9/ce5 0 2024-04-25T15:58:14.542 INFO:tasks.workunit.client.0.smithi087.stdout:9/728: creat d6/d8/d12/db7/d3a/d5b/d60/dcd/fe6 x:0 0 0 2024-04-25T15:58:14.543 INFO:tasks.workunit.client.0.smithi087.stdout:9/729: write d6/d8/d32/d57/d66/da7/da8/fdd [474664,102258] 0 2024-04-25T15:58:14.547 INFO:tasks.workunit.client.0.smithi087.stdout:9/730: rename d6/d8/d12/db7/d3a/f74 to d6/d8/d12/db7/d3a/d5b/d60/d1d/fe7 0 2024-04-25T15:58:14.551 INFO:tasks.workunit.client.0.smithi087.stdout:9/731: unlink d6/d8/d12/db7/d3a/d58/f76 0 2024-04-25T15:58:14.556 INFO:tasks.workunit.client.0.smithi087.stdout:9/732: dread f2 [0,4194304] 0 2024-04-25T15:58:14.564 INFO:tasks.workunit.client.0.smithi087.stdout:9/733: dwrite d6/d8/d32/d57/d66/da7/da8/fc6 [0,4194304] 0 2024-04-25T15:58:14.608 INFO:tasks.workunit.client.0.smithi087.stdout:5/774: sync 2024-04-25T15:58:14.608 INFO:tasks.workunit.client.0.smithi087.stdout:6/928: sync 2024-04-25T15:58:14.610 INFO:tasks.workunit.client.0.smithi087.stdout:5/775: dread d9/d91/d30/d70/d79/fdf [0,4194304] 0 2024-04-25T15:58:14.613 INFO:tasks.workunit.client.0.smithi087.stdout:5/776: fsync d9/d91/d30/d70/d79/fdf 0 2024-04-25T15:58:14.616 INFO:tasks.workunit.client.0.smithi087.stdout:5/777: creat d9/d91/d30/d55/ffd x:0 0 0 2024-04-25T15:58:14.617 INFO:tasks.workunit.client.0.smithi087.stdout:6/929: dwrite d7/d71/d59/dc7/dec/fe8 [0,4194304] 0 2024-04-25T15:58:14.622 INFO:tasks.workunit.client.0.smithi087.stdout:5/778: rename d9/d2f/dbb/dde/fee to d9/d99/ffe 0 2024-04-25T15:58:14.674 INFO:tasks.workunit.client.0.smithi087.stdout:1/811: sync 2024-04-25T15:58:14.674 INFO:tasks.workunit.client.0.smithi087.stdout:0/848: sync 2024-04-25T15:58:14.674 INFO:tasks.workunit.client.0.smithi087.stdout:7/505: sync 2024-04-25T15:58:14.679 INFO:tasks.workunit.client.0.smithi087.stdout:7/506: creat d1/d9/f9d x:0 0 0 2024-04-25T15:58:14.684 INFO:tasks.workunit.client.0.smithi087.stdout:7/507: rename d1/d1a/l7a to d1/d9/d8e/l9e 0 2024-04-25T15:58:14.699 INFO:tasks.workunit.client.0.smithi087.stdout:7/508: rename d1/d4/d18/d36/d37 to d1/d9f 0 2024-04-25T15:58:14.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/849: dwrite d1/d4f/de3/df5/fcc [0,4194304] 0 2024-04-25T15:58:14.703 INFO:tasks.workunit.client.0.smithi087.stdout:1/812: dwrite d3/d12/d4d/d7d/fc6 [0,4194304] 0 2024-04-25T15:58:14.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/509: symlink d1/d9/d26/d45/la0 0 2024-04-25T15:58:14.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/850: rmdir d1/d6/db1/dc0/dd3/dff/d50 39 2024-04-25T15:58:14.714 INFO:tasks.workunit.client.0.smithi087.stdout:7/510: mkdir d1/d3c/d6b/da1 0 2024-04-25T15:58:14.715 INFO:tasks.workunit.client.0.smithi087.stdout:1/813: creat d3/d12/d14/d29/d2f/d40/f118 x:0 0 0 2024-04-25T15:58:14.717 INFO:tasks.workunit.client.0.smithi087.stdout:0/851: write d1/da/d3e/d54/f20 [3277273,102654] 0 2024-04-25T15:58:14.718 INFO:tasks.workunit.client.0.smithi087.stdout:7/511: readlink d1/d9/lc 0 2024-04-25T15:58:14.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/852: chown d1/d6/d112/d7d/d84 38 1 2024-04-25T15:58:14.725 INFO:tasks.workunit.client.0.smithi087.stdout:0/853: write d1/dab/df4/f106 [4616227,16716] 0 2024-04-25T15:58:14.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/854: readlink d1/da/d3e/d85/lbb 0 2024-04-25T15:58:14.730 INFO:tasks.workunit.client.0.smithi087.stdout:1/814: link d3/d12/d14/d29/d67/lc1 d3/d12/d4d/dba/d117/l119 0 2024-04-25T15:58:14.730 INFO:tasks.workunit.client.0.smithi087.stdout:7/512: link d1/d1a/l54 d1/d4/d18/d36/la2 0 2024-04-25T15:58:14.733 INFO:tasks.workunit.client.0.smithi087.stdout:0/855: creat d1/f118 x:0 0 0 2024-04-25T15:58:14.736 INFO:tasks.workunit.client.0.smithi087.stdout:7/513: getdents d1/d4 0 2024-04-25T15:58:14.736 INFO:tasks.workunit.client.0.smithi087.stdout:0/856: fsync d1/da/d3e/d54/d34/fc2 0 2024-04-25T15:58:14.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/815: creat d3/d12/d14/f11a x:0 0 0 2024-04-25T15:58:14.738 INFO:tasks.workunit.client.0.smithi087.stdout:1/816: chown d3/d12/f43 4 1 2024-04-25T15:58:14.739 INFO:tasks.workunit.client.0.smithi087.stdout:7/514: mkdir d1/d3c/da3 0 2024-04-25T15:58:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:8/845: sync 2024-04-25T15:58:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/747: sync 2024-04-25T15:58:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/722: sync 2024-04-25T15:58:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:1/817: readlink d3/d12/d39/d64/l94 0 2024-04-25T15:58:14.743 INFO:tasks.workunit.client.0.smithi087.stdout:0/857: rename d1/d6/d112/f76 to d1/d6/d77/f119 0 2024-04-25T15:58:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/723: fdatasync d4/f2c 0 2024-04-25T15:58:14.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/818: fsync d3/d12/d14/d29/d67/d73/d9c/faf 0 2024-04-25T15:58:14.745 INFO:tasks.workunit.client.0.smithi087.stdout:7/515: mkdir d1/d1a/d7b/da4 0 2024-04-25T15:58:14.745 INFO:tasks.workunit.client.0.smithi087.stdout:0/858: dread - d1/d6/d77/fa8 zero size 2024-04-25T15:58:14.746 INFO:tasks.workunit.client.0.smithi087.stdout:2/748: mknod d3/d27/d29/d2d/ce8 0 2024-04-25T15:58:14.747 INFO:tasks.workunit.client.0.smithi087.stdout:7/516: chown d1/d4/d18/f82 317 1 2024-04-25T15:58:14.749 INFO:tasks.workunit.client.0.smithi087.stdout:7/517: readlink d1/d9/l25 0 2024-04-25T15:58:14.749 INFO:tasks.workunit.client.0.smithi087.stdout:8/846: link d4/d8/dd/d85/dbc/fd8 d4/d22/d43/d7f/dc6/df7/d10c/f10f 0 2024-04-25T15:58:14.751 INFO:tasks.workunit.client.0.smithi087.stdout:7/518: chown d1/d9/d26/l34 31344519 1 2024-04-25T15:58:14.751 INFO:tasks.workunit.client.0.smithi087.stdout:8/847: chown d4/d22/d43/d7f/dc6/ce7 2 1 2024-04-25T15:58:14.752 INFO:tasks.workunit.client.0.smithi087.stdout:1/819: rename d3/d12/d14/d29/d2f/df7 to d3/d2d/d11b 0 2024-04-25T15:58:14.753 INFO:tasks.workunit.client.0.smithi087.stdout:2/749: dread d3/d27/d29/d2d/f57 [0,4194304] 0 2024-04-25T15:58:14.753 INFO:tasks.workunit.client.0.smithi087.stdout:7/519: readlink d1/d4/d18/l2b 0 2024-04-25T15:58:14.754 INFO:tasks.workunit.client.0.smithi087.stdout:2/750: stat d3/d2a/d81/d93/fc8 0 2024-04-25T15:58:14.755 INFO:tasks.workunit.client.0.smithi087.stdout:0/859: link d1/da/d3e/d54/d34/d55/l63 d1/d6/d77/l11a 0 2024-04-25T15:58:14.757 INFO:tasks.workunit.client.0.smithi087.stdout:1/820: rename d3/ff to d3/d12/d39/d64/dc0/d108/f11c 0 2024-04-25T15:58:14.759 INFO:tasks.workunit.client.0.smithi087.stdout:0/860: creat d1/d4f/de3/d111/f11b x:0 0 0 2024-04-25T15:58:14.759 INFO:tasks.workunit.client.0.smithi087.stdout:1/821: read - d3/d12/d4d/da5/fdc zero size 2024-04-25T15:58:14.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/751: mkdir d3/d27/d29/de9 0 2024-04-25T15:58:14.765 INFO:tasks.workunit.client.0.smithi087.stdout:3/724: dread d4/d17/d81/da6/f3d [0,4194304] 0 2024-04-25T15:58:14.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/752: creat d3/d20/d4a/d47/fea x:0 0 0 2024-04-25T15:58:14.765 INFO:tasks.workunit.client.0.smithi087.stdout:4/827: sync 2024-04-25T15:58:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:6/930: sync 2024-04-25T15:58:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:9/734: sync 2024-04-25T15:58:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:5/779: sync 2024-04-25T15:58:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:1/822: fsync d3/d12/d14/d29/d2f/f63 0 2024-04-25T15:58:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:8/848: dwrite d4/d22/d43/d7f/dc6/fd6 [0,4194304] 0 2024-04-25T15:58:14.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/849: readlink d4/d8/l76 0 2024-04-25T15:58:14.769 INFO:tasks.workunit.client.0.smithi087.stdout:0/861: dread d1/da/d3e/f9c [0,4194304] 0 2024-04-25T15:58:14.776 INFO:tasks.workunit.client.0.smithi087.stdout:3/725: dwrite d4/db/f47 [0,4194304] 0 2024-04-25T15:58:14.781 INFO:tasks.workunit.client.0.smithi087.stdout:6/931: creat d7/d1a/d41/dbd/db9/f13e x:0 0 0 2024-04-25T15:58:14.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/828: dread d4/d10/d60/d52/f57 [0,4194304] 0 2024-04-25T15:58:14.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/829: chown d4/d10/d60/d52/d66/d15 1 1 2024-04-25T15:58:14.783 INFO:tasks.workunit.client.0.smithi087.stdout:8/850: rmdir d4/d1d/de1 39 2024-04-25T15:58:14.783 INFO:tasks.workunit.client.0.smithi087.stdout:0/862: rmdir d1/d6/db1/dc0/dd3/dff 39 2024-04-25T15:58:14.783 INFO:tasks.workunit.client.0.smithi087.stdout:4/830: dread - d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f10d zero size 2024-04-25T15:58:14.784 INFO:tasks.workunit.client.0.smithi087.stdout:5/780: truncate d9/f21 1690938 0 2024-04-25T15:58:14.785 INFO:tasks.workunit.client.0.smithi087.stdout:5/781: write d9/d91/d38/fdb [7609,111113] 0 2024-04-25T15:58:14.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/735: fsync d6/d8/d12/db7/d3a/d58/d72/dd2/fd4 0 2024-04-25T15:58:14.796 INFO:tasks.workunit.client.0.smithi087.stdout:4/831: dread - d4/d10/d60/d5c/d3a/f73 zero size 2024-04-25T15:58:14.798 INFO:tasks.workunit.client.0.smithi087.stdout:5/782: creat d9/d2f/d40/d4d/de1/fff x:0 0 0 2024-04-25T15:58:14.798 INFO:tasks.workunit.client.0.smithi087.stdout:6/932: mkdir d7/d1a/d1d/d21/d27/d2c/d13c/d13f 0 2024-04-25T15:58:14.799 INFO:tasks.workunit.client.0.smithi087.stdout:3/726: dwrite d4/d17/d24/d29/d58/dac/f4a [0,4194304] 0 2024-04-25T15:58:14.799 INFO:tasks.workunit.client.0.smithi087.stdout:9/736: creat d6/d8/d32/d4c/db9/fe8 x:0 0 0 2024-04-25T15:58:14.801 INFO:tasks.workunit.client.0.smithi087.stdout:9/737: fsync d6/d8/d32/d57/d66/da7/da8/fdd 0 2024-04-25T15:58:14.802 INFO:tasks.workunit.client.0.smithi087.stdout:2/753: getdents d3/d2a/d81 0 2024-04-25T15:58:14.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/738: read - d6/d8/d12/db7/d3a/d5b/f8f zero size 2024-04-25T15:58:14.804 INFO:tasks.workunit.client.0.smithi087.stdout:4/832: creat d4/d10/d60/d56/d61/d3f/d42/f10e x:0 0 0 2024-04-25T15:58:14.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/823: write d3/d12/f1c [1851208,74301] 0 2024-04-25T15:58:14.806 INFO:tasks.workunit.client.0.smithi087.stdout:3/727: rmdir d4/d17/d24/d29/d58/dac 39 2024-04-25T15:58:14.808 INFO:tasks.workunit.client.0.smithi087.stdout:3/728: chown d4/db/f5b 122765646 1 2024-04-25T15:58:14.808 INFO:tasks.workunit.client.0.smithi087.stdout:8/851: write d4/d1d/f97 [801374,85984] 0 2024-04-25T15:58:14.810 INFO:tasks.workunit.client.0.smithi087.stdout:2/754: creat d3/d27/d29/d4f/feb x:0 0 0 2024-04-25T15:58:14.814 INFO:tasks.workunit.client.0.smithi087.stdout:0/863: getdents d1/d6/db1/dc0 0 2024-04-25T15:58:14.815 INFO:tasks.workunit.client.0.smithi087.stdout:6/933: creat d7/d1a/d1d/d21/d27/d2c/d35/d127/d133/f140 x:0 0 0 2024-04-25T15:58:14.817 INFO:tasks.workunit.client.0.smithi087.stdout:2/755: creat d3/d27/d29/d2d/fec x:0 0 0 2024-04-25T15:58:14.818 INFO:tasks.workunit.client.0.smithi087.stdout:4/833: mknod d4/d10/d60/d5c/d8d/c10f 0 2024-04-25T15:58:14.820 INFO:tasks.workunit.client.0.smithi087.stdout:4/834: write d4/d10/d60/d56/d61/f17 [5071763,39956] 0 2024-04-25T15:58:14.821 INFO:tasks.workunit.client.0.smithi087.stdout:0/864: chown d1/d6/d21/f51 126 1 2024-04-25T15:58:14.821 INFO:tasks.workunit.client.0.smithi087.stdout:6/934: mknod d7/d71/d59/d90/da5/c141 0 2024-04-25T15:58:14.822 INFO:tasks.workunit.client.0.smithi087.stdout:3/729: symlink d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/le0 0 2024-04-25T15:58:14.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/756: creat d3/d20/d4a/d47/fed x:0 0 0 2024-04-25T15:58:14.823 INFO:tasks.workunit.client.0.smithi087.stdout:7/520: sync 2024-04-25T15:58:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:9/739: creat d6/d8/d12/db7/d3a/d5b/d60/d1d/fe9 x:0 0 0 2024-04-25T15:58:14.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/865: mknod d1/d4f/de3/d111/c11c 0 2024-04-25T15:58:14.827 INFO:tasks.workunit.client.0.smithi087.stdout:2/757: chown d3/d2a/d48/c71 4 1 2024-04-25T15:58:14.828 INFO:tasks.workunit.client.0.smithi087.stdout:5/783: dwrite d9/f21 [0,4194304] 0 2024-04-25T15:58:14.828 INFO:tasks.workunit.client.0.smithi087.stdout:8/852: creat d4/d8/dd/d2f/f110 x:0 0 0 2024-04-25T15:58:14.830 INFO:tasks.workunit.client.0.smithi087.stdout:7/521: mkdir d1/d4/da5 0 2024-04-25T15:58:14.831 INFO:tasks.workunit.client.0.smithi087.stdout:9/740: chown d6/d8/d32/d57/cbd 1573 1 2024-04-25T15:58:14.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/758: dwrite d3/d2a/d1c/f92 [0,4194304] 0 2024-04-25T15:58:14.840 INFO:tasks.workunit.client.0.smithi087.stdout:1/824: truncate d3/d12/d14/d29/d2f/d61/fa1 2859711 0 2024-04-25T15:58:14.842 INFO:tasks.workunit.client.0.smithi087.stdout:6/935: symlink d7/d1a/d41/dbd/db9/dfb/l142 0 2024-04-25T15:58:14.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/835: creat d4/d10/d60/d56/d61/d3f/d42/d97/f110 x:0 0 0 2024-04-25T15:58:14.846 INFO:tasks.workunit.client.0.smithi087.stdout:7/522: rename d1/fd to d1/d4/da5/fa6 0 2024-04-25T15:58:14.846 INFO:tasks.workunit.client.0.smithi087.stdout:9/741: dwrite d6/d8/d12/db7/d3a/d5b/d60/dcd/fe6 [0,4194304] 0 2024-04-25T15:58:14.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/825: mknod d3/d12/d14/d29/d2f/c11d 0 2024-04-25T15:58:14.849 INFO:tasks.workunit.client.0.smithi087.stdout:6/936: write d7/fdf [3175830,29659] 0 2024-04-25T15:58:14.850 INFO:tasks.workunit.client.0.smithi087.stdout:2/759: rename d3/d27/d29/d4f/f70 to d3/d2a/d48/fee 0 2024-04-25T15:58:14.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/937: chown d7/d1a/d2a/f3c 12629930 1 2024-04-25T15:58:14.852 INFO:tasks.workunit.client.0.smithi087.stdout:5/784: write d9/d91/d38/f97 [4734836,63828] 0 2024-04-25T15:58:14.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/853: dread d4/d1d/de1/d82/fb0 [0,4194304] 0 2024-04-25T15:58:14.855 INFO:tasks.workunit.client.0.smithi087.stdout:7/523: mknod d1/d9/d8e/ca7 0 2024-04-25T15:58:14.855 INFO:tasks.workunit.client.0.smithi087.stdout:5/785: readlink d9/d91/d30/d56/l8b 0 2024-04-25T15:58:14.856 INFO:tasks.workunit.client.0.smithi087.stdout:8/854: chown d4/d1d/de1 31 1 2024-04-25T15:58:14.856 INFO:tasks.workunit.client.0.smithi087.stdout:9/742: mkdir d6/dea 0 2024-04-25T15:58:14.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/730: truncate d4/d17/d24/d29/d58/dac/f4a 2139372 0 2024-04-25T15:58:14.859 INFO:tasks.workunit.client.0.smithi087.stdout:5/786: dread - d9/d2f/d40/d4d/d7b/d74/fb9 zero size 2024-04-25T15:58:14.860 INFO:tasks.workunit.client.0.smithi087.stdout:2/760: mknod d3/d2a/d48/d77/cef 0 2024-04-25T15:58:14.860 INFO:tasks.workunit.client.0.smithi087.stdout:9/743: dread - d6/d8/d12/db7/d3a/d5b/f8f zero size 2024-04-25T15:58:14.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/836: dwrite d4/d10/d60/d52/d66/f5d [0,4194304] 0 2024-04-25T15:58:14.863 INFO:tasks.workunit.client.0.smithi087.stdout:2/761: stat d3/d2a/d48/d77/cbf 0 2024-04-25T15:58:14.865 INFO:tasks.workunit.client.0.smithi087.stdout:3/731: readlink d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9/ld0 0 2024-04-25T15:58:14.866 INFO:tasks.workunit.client.0.smithi087.stdout:6/938: getdents d7/dfd 0 2024-04-25T15:58:14.868 INFO:tasks.workunit.client.0.smithi087.stdout:6/939: fdatasync d7/d1a/d2a/ff2 0 2024-04-25T15:58:14.869 INFO:tasks.workunit.client.0.smithi087.stdout:8/855: link d4/d8/dd/d2f/d6f/fc4 d4/d1d/d17/d101/f111 0 2024-04-25T15:58:14.873 INFO:tasks.workunit.client.0.smithi087.stdout:9/744: dwrite d6/d8/d12/db7/d3a/d7c/fab [0,4194304] 0 2024-04-25T15:58:14.874 INFO:tasks.workunit.client.0.smithi087.stdout:1/826: getdents d3/d12/d14/d29/d67/d73/d9c/dd0 0 2024-04-25T15:58:14.882 INFO:tasks.workunit.client.0.smithi087.stdout:3/732: creat d4/d17/d81/da6/d53/d68/fe1 x:0 0 0 2024-04-25T15:58:14.883 INFO:tasks.workunit.client.0.smithi087.stdout:6/940: mknod d7/d1a/d1d/c143 0 2024-04-25T15:58:14.885 INFO:tasks.workunit.client.0.smithi087.stdout:0/866: dread d1/d6/db1/dc0/dd3/dff/d50/d6b/f8a [0,4194304] 0 2024-04-25T15:58:14.885 INFO:tasks.workunit.client.0.smithi087.stdout:8/856: dwrite d4/d8/fb [4194304,4194304] 0 2024-04-25T15:58:14.885 INFO:tasks.workunit.client.0.smithi087.stdout:9/745: chown d6/d8/d12/db7/d3a/d5b/d60/d1d/fc0 17620673 1 2024-04-25T15:58:14.890 INFO:tasks.workunit.client.0.smithi087.stdout:7/524: rename d1/d4/d18/d36/f78 to d1/d4/d18/d36/fa8 0 2024-04-25T15:58:14.891 INFO:tasks.workunit.client.0.smithi087.stdout:2/762: dread d3/d27/f39 [0,4194304] 0 2024-04-25T15:58:14.891 INFO:tasks.workunit.client.0.smithi087.stdout:0/867: creat d1/dab/df4/f11d x:0 0 0 2024-04-25T15:58:14.891 INFO:tasks.workunit.client.0.smithi087.stdout:1/827: dread d3/f1b [0,4194304] 0 2024-04-25T15:58:14.892 INFO:tasks.workunit.client.0.smithi087.stdout:1/828: dread - d3/f100 zero size 2024-04-25T15:58:14.894 INFO:tasks.workunit.client.0.smithi087.stdout:6/941: symlink d7/d1a/d41/dbd/d96/l144 0 2024-04-25T15:58:14.899 INFO:tasks.workunit.client.0.smithi087.stdout:7/525: truncate d1/d4/d18/d36/d5d/f8d 427838 0 2024-04-25T15:58:14.900 INFO:tasks.workunit.client.0.smithi087.stdout:0/868: creat d1/dab/f11e x:0 0 0 2024-04-25T15:58:14.902 INFO:tasks.workunit.client.0.smithi087.stdout:5/787: truncate d9/f1f 391542 0 2024-04-25T15:58:14.903 INFO:tasks.workunit.client.0.smithi087.stdout:4/837: dwrite d4/d10/d60/d56/d61/d3f/d58/d5e/f70 [0,4194304] 0 2024-04-25T15:58:14.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/869: write d1/d6/db1/dc0/dd3/dff/fcb [980809,14844] 0 2024-04-25T15:58:14.905 INFO:tasks.workunit.client.0.smithi087.stdout:8/857: mkdir d4/d22/d43/d7f/dc6/df7/d10c/d112 0 2024-04-25T15:58:14.910 INFO:tasks.workunit.client.0.smithi087.stdout:7/526: dread d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:14.911 INFO:tasks.workunit.client.0.smithi087.stdout:6/942: mknod d7/d1a/d1d/d21/c145 0 2024-04-25T15:58:14.911 INFO:tasks.workunit.client.0.smithi087.stdout:7/527: write d1/d3c/d6b/f79 [5131320,81310] 0 2024-04-25T15:58:14.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/788: fsync d9/d91/d30/d70/d79/d7d/f73 0 2024-04-25T15:58:14.914 INFO:tasks.workunit.client.0.smithi087.stdout:8/858: creat d4/d1d/d7c/f113 x:0 0 0 2024-04-25T15:58:14.916 INFO:tasks.workunit.client.0.smithi087.stdout:4/838: rmdir d4/d10/d60/d56/d61/d3f/d58/d5e/d7e 39 2024-04-25T15:58:14.919 INFO:tasks.workunit.client.0.smithi087.stdout:2/763: dwrite d3/d2a/f8f [0,4194304] 0 2024-04-25T15:58:14.920 INFO:tasks.workunit.client.0.smithi087.stdout:7/528: symlink d1/d3c/d6b/la9 0 2024-04-25T15:58:14.923 INFO:tasks.workunit.client.0.smithi087.stdout:5/789: creat d9/d91/d30/d70/d79/dae/de4/f100 x:0 0 0 2024-04-25T15:58:14.924 INFO:tasks.workunit.client.0.smithi087.stdout:3/733: link d4/d17/d24/d29/d58/dac/dc0/d3c/c49 d4/d17/d81/da6/ce2 0 2024-04-25T15:58:14.926 INFO:tasks.workunit.client.0.smithi087.stdout:7/529: fdatasync d1/d4/f69 0 2024-04-25T15:58:14.927 INFO:tasks.workunit.client.0.smithi087.stdout:1/829: dread d3/d12/d14/f4e [0,4194304] 0 2024-04-25T15:58:14.927 INFO:tasks.workunit.client.0.smithi087.stdout:8/859: unlink d4/d8/f6a 0 2024-04-25T15:58:14.928 INFO:tasks.workunit.client.0.smithi087.stdout:1/830: chown d3/d12/d14/d29/d2f/d61/fa1 2683 1 2024-04-25T15:58:14.929 INFO:tasks.workunit.client.0.smithi087.stdout:5/790: mkdir d9/d91/d30/d56/d101 0 2024-04-25T15:58:14.929 INFO:tasks.workunit.client.0.smithi087.stdout:8/860: chown d4/d22/d43/d7f/dc6/df7/d10c/f10f 7337 1 2024-04-25T15:58:14.931 INFO:tasks.workunit.client.0.smithi087.stdout:8/861: fsync d4/d1d/d17/d37/f78 0 2024-04-25T15:58:14.931 INFO:tasks.workunit.client.0.smithi087.stdout:0/870: dread d1/f92 [0,4194304] 0 2024-04-25T15:58:14.932 INFO:tasks.workunit.client.0.smithi087.stdout:0/871: stat d1/f92 0 2024-04-25T15:58:14.932 INFO:tasks.workunit.client.0.smithi087.stdout:3/734: rmdir d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da9 39 2024-04-25T15:58:14.933 INFO:tasks.workunit.client.0.smithi087.stdout:0/872: chown d1/d6/d77/d100 1640962 1 2024-04-25T15:58:14.935 INFO:tasks.workunit.client.0.smithi087.stdout:6/943: write d7/d1a/d1d/d21/d27/d2c/f57 [2896117,49009] 0 2024-04-25T15:58:14.938 INFO:tasks.workunit.client.0.smithi087.stdout:1/831: dwrite d3/f100 [0,4194304] 0 2024-04-25T15:58:14.939 INFO:tasks.workunit.client.0.smithi087.stdout:1/832: write d3/d2d/d6c/fd4 [2077111,29753] 0 2024-04-25T15:58:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:7/530: fsync d1/d9f/f5e 0 2024-04-25T15:58:14.941 INFO:tasks.workunit.client.0.smithi087.stdout:3/735: fsync d4/d17/d24/d29/fd5 0 2024-04-25T15:58:14.942 INFO:tasks.workunit.client.0.smithi087.stdout:5/791: mknod d9/d2f/d40/d4d/d7b/c102 0 2024-04-25T15:58:14.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/873: mkdir d1/d4f/de3/df5/d11f 0 2024-04-25T15:58:14.944 INFO:tasks.workunit.client.0.smithi087.stdout:7/531: fdatasync d1/d3c/f5a 0 2024-04-25T15:58:14.949 INFO:tasks.workunit.client.0.smithi087.stdout:5/792: fsync d9/d91/d30/d55/ffd 0 2024-04-25T15:58:14.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/736: mkdir d4/d17/d81/da6/d53/de3 0 2024-04-25T15:58:14.952 INFO:tasks.workunit.client.0.smithi087.stdout:4/839: dwrite d4/d10/d60/d56/d61/d3f/d42/d97/fa0 [0,4194304] 0 2024-04-25T15:58:14.953 INFO:tasks.workunit.client.0.smithi087.stdout:1/833: dread d3/d12/d4d/da5/f102 [0,4194304] 0 2024-04-25T15:58:14.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/862: write d4/d8/dd/d2f/f80 [3889088,88424] 0 2024-04-25T15:58:14.955 INFO:tasks.workunit.client.0.smithi087.stdout:6/944: dwrite d7/d1a/d1d/d21/d27/d2c/db4/fc6 [0,4194304] 0 2024-04-25T15:58:14.960 INFO:tasks.workunit.client.0.smithi087.stdout:3/737: chown d4/d17/d81/da6/c5f 1269 1 2024-04-25T15:58:14.960 INFO:tasks.workunit.client.0.smithi087.stdout:6/945: readlink d7/d1a/d1d/d21/d27/l32 0 2024-04-25T15:58:14.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/793: creat d9/f103 x:0 0 0 2024-04-25T15:58:14.961 INFO:tasks.workunit.client.0.smithi087.stdout:0/874: dwrite d1/d6/f8 [0,4194304] 0 2024-04-25T15:58:14.964 INFO:tasks.workunit.client.0.smithi087.stdout:0/875: stat d1/d6/db1/dc0/dd3/dff/d50/f81 0 2024-04-25T15:58:14.964 INFO:tasks.workunit.client.0.smithi087.stdout:1/834: dread d3/d12/d14/d29/d2f/d61/fa1 [0,4194304] 0 2024-04-25T15:58:14.969 INFO:tasks.workunit.client.0.smithi087.stdout:5/794: mknod d9/d91/d30/d70/d79/d94/c104 0 2024-04-25T15:58:14.972 INFO:tasks.workunit.client.0.smithi087.stdout:4/840: rename d4/d10/d60/d5c/d8d/fc2 to d4/d10/d60/d56/d61/d3f/d42/d97/f111 0 2024-04-25T15:58:14.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/738: dwrite d4/d17/d24/f56 [0,4194304] 0 2024-04-25T15:58:14.978 INFO:tasks.workunit.client.0.smithi087.stdout:6/946: rename d7/d1a/d1d/d21/d27/d2c/f124 to d7/d71/d59/d130/f146 0 2024-04-25T15:58:14.978 INFO:tasks.workunit.client.0.smithi087.stdout:3/739: readlink d4/d17/d81/da6/d23/l8a 0 2024-04-25T15:58:14.979 INFO:tasks.workunit.client.0.smithi087.stdout:0/876: dwrite d1/d6/f47 [0,4194304] 0 2024-04-25T15:58:14.982 INFO:tasks.workunit.client.0.smithi087.stdout:0/877: truncate d1/d6/db1/dc0/dd3/dff/fcb 1128412 0 2024-04-25T15:58:14.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/532: dread d1/d3c/f5a [0,4194304] 0 2024-04-25T15:58:14.986 INFO:tasks.workunit.client.0.smithi087.stdout:0/878: write d1/d6/d112/d7d/f93 [1351157,37310] 0 2024-04-25T15:58:14.987 INFO:tasks.workunit.client.0.smithi087.stdout:6/947: unlink d7/f18 0 2024-04-25T15:58:14.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/533: truncate f0 13315038 0 2024-04-25T15:58:14.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/534: mkdir d1/d3c/daa 0 2024-04-25T15:58:14.992 INFO:tasks.workunit.client.0.smithi087.stdout:0/879: read d1/dab/df4/f106 [290578,57499] 0 2024-04-25T15:58:14.994 INFO:tasks.workunit.client.0.smithi087.stdout:7/535: rmdir d1/d3c/d6b 39 2024-04-25T15:58:14.995 INFO:tasks.workunit.client.0.smithi087.stdout:0/880: readlink d1/da/d3e/d54/d34/d55/l90 0 2024-04-25T15:58:14.996 INFO:tasks.workunit.client.0.smithi087.stdout:5/795: dread d9/d2f/d40/d4d/d7b/d5c/d5f/d44/fc3 [0,4194304] 0 2024-04-25T15:58:14.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/536: chown d1/d9/d26/f6d 2036377 1 2024-04-25T15:58:14.998 INFO:tasks.workunit.client.0.smithi087.stdout:6/948: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/f128 [0,4194304] 0 2024-04-25T15:58:15.001 INFO:tasks.workunit.client.0.smithi087.stdout:1/835: dwrite d3/d12/d14/f17 [0,4194304] 0 2024-04-25T15:58:15.008 INFO:tasks.workunit.client.0.smithi087.stdout:0/881: dwrite d1/d6/d77/fa8 [0,4194304] 0 2024-04-25T15:58:15.014 INFO:tasks.workunit.client.0.smithi087.stdout:9/746: sync 2024-04-25T15:58:15.038 INFO:tasks.workunit.client.0.smithi087.stdout:1/836: symlink d3/d12/d14/d33/d95/l11e 0 2024-04-25T15:58:15.047 INFO:tasks.workunit.client.0.smithi087.stdout:5/796: creat d9/d91/f105 x:0 0 0 2024-04-25T15:58:15.053 INFO:tasks.workunit.client.0.smithi087.stdout:0/882: mkdir d1/d4f/de3/df5/d10f/d120 0 2024-04-25T15:58:15.055 INFO:tasks.workunit.client.0.smithi087.stdout:5/797: dwrite d9/d2f/d40/d4d/de1/fff [0,4194304] 0 2024-04-25T15:58:15.056 INFO:tasks.workunit.client.0.smithi087.stdout:5/798: chown d9/d91/d38/f5b 2002 1 2024-04-25T15:58:15.056 INFO:tasks.workunit.client.0.smithi087.stdout:6/949: creat d7/d1a/f147 x:0 0 0 2024-04-25T15:58:15.059 INFO:tasks.workunit.client.0.smithi087.stdout:6/950: write d7/d1a/d1d/d21/d27/d2c/db4/fc6 [4013498,78455] 0 2024-04-25T15:58:15.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/747: link d6/d8/d12/db7/d3a/d58/d7b/cb4 d6/d8/d12/db7/da9/ceb 0 2024-04-25T15:58:15.068 INFO:tasks.workunit.client.0.smithi087.stdout:9/748: creat d6/d8/d12/db7/d3a/d5b/d60/d7f/fec x:0 0 0 2024-04-25T15:58:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:5/799: getdents d9/d2f/d40/d4d/d7b/d5c/d5f/de8 0 2024-04-25T15:58:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:5/800: dread - d9/d2f/d3b/fef zero size 2024-04-25T15:58:15.102 INFO:tasks.workunit.client.0.smithi087.stdout:1/837: rename d3/d2d/ld7 to d3/d12/d14/d29/d2f/d40/l11f 0 2024-04-25T15:58:15.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/801: creat d9/d91/d30/d70/d79/f106 x:0 0 0 2024-04-25T15:58:15.108 INFO:tasks.workunit.client.0.smithi087.stdout:1/838: rename d3/d12/d14/d29/d2f/d53/dca/d104/f10c to d3/d12/d14/f120 0 2024-04-25T15:58:15.112 INFO:tasks.workunit.client.0.smithi087.stdout:5/802: rename d9/d2f/d40/d4d/d7b/dea to d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/d107 0 2024-04-25T15:58:15.120 INFO:tasks.workunit.client.0.smithi087.stdout:9/749: truncate d6/d8/d12/db7/d3a/d7c/fab 186978 0 2024-04-25T15:58:15.130 INFO:tasks.workunit.client.0.smithi087.stdout:1/839: getdents d3/d12/d14 0 2024-04-25T15:58:15.131 INFO:tasks.workunit.client.0.smithi087.stdout:0/883: rename d1/cb6 to d1/c121 0 2024-04-25T15:58:15.132 INFO:tasks.workunit.client.0.smithi087.stdout:1/840: write d3/d12/d14/d29/d2f/f5d [4338447,13112] 0 2024-04-25T15:58:15.132 INFO:tasks.workunit.client.0.smithi087.stdout:0/884: rmdir d1/d6/d77/dc6 39 2024-04-25T15:58:15.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/885: chown d1/dab 13 1 2024-04-25T15:58:15.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/886: chown d1/d6/db1/dc0 6344913 1 2024-04-25T15:58:15.138 INFO:tasks.workunit.client.0.smithi087.stdout:9/750: write d6/d8/d32/d57/d66/f93 [839801,11964] 0 2024-04-25T15:58:15.139 INFO:tasks.workunit.client.0.smithi087.stdout:2/764: sync 2024-04-25T15:58:15.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/887: read d1/da/d3e/d85/d9b/fbf [3004705,5139] 0 2024-04-25T15:58:15.140 INFO:tasks.workunit.client.0.smithi087.stdout:9/751: mknod d6/d8/d32/d4c/db9/ced 0 2024-04-25T15:58:15.141 INFO:tasks.workunit.client.0.smithi087.stdout:0/888: creat d1/d4f/de3/f122 x:0 0 0 2024-04-25T15:58:15.144 INFO:tasks.workunit.client.0.smithi087.stdout:2/765: stat d3/d27/d29/d2d/d40/l43 0 2024-04-25T15:58:15.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/889: write d1/da/d3e/d85/d9b/d10a/dba/fdb [690016,123420] 0 2024-04-25T15:58:15.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/752: mknod d6/d8/d12/db7/d3a/d58/d72/cee 0 2024-04-25T15:58:15.150 INFO:tasks.workunit.client.0.smithi087.stdout:2/766: write d3/d27/d29/d2d/d40/f7b [800485,86111] 0 2024-04-25T15:58:15.151 INFO:tasks.workunit.client.0.smithi087.stdout:0/890: write d1/da/d3e/d54/d34/fa6 [2737300,91039] 0 2024-04-25T15:58:15.151 INFO:tasks.workunit.client.0.smithi087.stdout:9/753: creat d6/d8/d12/db7/d3a/d7c/fef x:0 0 0 2024-04-25T15:58:15.152 INFO:tasks.workunit.client.0.smithi087.stdout:1/841: dread d3/fb9 [0,4194304] 0 2024-04-25T15:58:15.153 INFO:tasks.workunit.client.0.smithi087.stdout:0/891: read d1/da/d3e/d54/f91 [159857,122246] 0 2024-04-25T15:58:15.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/842: creat d3/d12/d14/d29/d67/f121 x:0 0 0 2024-04-25T15:58:15.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/767: dwrite d3/d27/f42 [4194304,4194304] 0 2024-04-25T15:58:15.158 INFO:tasks.workunit.client.0.smithi087.stdout:9/754: write d6/d8/d32/f41 [3546481,12616] 0 2024-04-25T15:58:15.161 INFO:tasks.workunit.client.0.smithi087.stdout:2/768: readlink d3/d2a/d48/d83/ld8 0 2024-04-25T15:58:15.162 INFO:tasks.workunit.client.0.smithi087.stdout:2/769: fsync d3/d2a/d81/d93/fc8 0 2024-04-25T15:58:15.162 INFO:tasks.workunit.client.0.smithi087.stdout:1/843: mkdir d3/d12/d14/d29/d2f/d53/d122 0 2024-04-25T15:58:15.163 INFO:tasks.workunit.client.0.smithi087.stdout:0/892: dwrite d1/da/d3e/d54/ffd [0,4194304] 0 2024-04-25T15:58:15.163 INFO:tasks.workunit.client.0.smithi087.stdout:2/770: chown d3/d27/d38/fdf 388 1 2024-04-25T15:58:15.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/755: symlink d6/d8/d12/db7/d3a/d7c/lf0 0 2024-04-25T15:58:15.173 INFO:tasks.workunit.client.0.smithi087.stdout:9/756: creat d6/d8/d12/db7/d3a/d58/d72/ff1 x:0 0 0 2024-04-25T15:58:15.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/893: dwrite d1/d4f/de3/df5/fec [0,4194304] 0 2024-04-25T15:58:15.175 INFO:tasks.workunit.client.0.smithi087.stdout:9/757: fdatasync d6/d8/d12/db7/d3a/d5b/d60/fe2 0 2024-04-25T15:58:15.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/894: creat d1/d6/db1/f123 x:0 0 0 2024-04-25T15:58:15.177 INFO:tasks.workunit.client.0.smithi087.stdout:2/771: dwrite d3/d2a/d48/f54 [4194304,4194304] 0 2024-04-25T15:58:15.177 INFO:tasks.workunit.client.0.smithi087.stdout:9/758: mkdir d6/d8/d32/d4c/df2 0 2024-04-25T15:58:15.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/895: write d1/d6/d77/f119 [845439,10831] 0 2024-04-25T15:58:15.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/772: mknod d3/d27/d29/de9/cf0 0 2024-04-25T15:58:15.184 INFO:tasks.workunit.client.0.smithi087.stdout:2/773: rmdir d3/d27 39 2024-04-25T15:58:15.189 INFO:tasks.workunit.client.0.smithi087.stdout:9/759: getdents d6/d45 0 2024-04-25T15:58:15.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/774: creat d3/d27/d29/d76/ff1 x:0 0 0 2024-04-25T15:58:15.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/760: rename d6/d8/d12/c33 to d6/d8/d32/cf3 0 2024-04-25T15:58:15.198 INFO:tasks.workunit.client.0.smithi087.stdout:0/896: truncate d1/d6/db1/dc0/dd3/dff/d50/fb8 23183 0 2024-04-25T15:58:15.198 INFO:tasks.workunit.client.0.smithi087.stdout:9/761: write d6/d8/d12/db7/d3a/d5b/d60/dcd/fe6 [2073999,111291] 0 2024-04-25T15:58:15.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/775: dwrite d3/fdc [0,4194304] 0 2024-04-25T15:58:15.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/776: stat d3/d2a/d1c/l2f 0 2024-04-25T15:58:15.205 INFO:tasks.workunit.client.0.smithi087.stdout:0/897: rename d1/d4f/de3/df5/d10f/d120 to d1/da/d3e/d85/d9b/d124 0 2024-04-25T15:58:15.206 INFO:tasks.workunit.client.0.smithi087.stdout:2/777: creat d3/d27/d29/de9/ff2 x:0 0 0 2024-04-25T15:58:15.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/898: chown d1/da/d3e/d54/d34/d55/fd6 17485 1 2024-04-25T15:58:15.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/762: dwrite d6/d45/f7a [0,4194304] 0 2024-04-25T15:58:15.211 INFO:tasks.workunit.client.0.smithi087.stdout:0/899: rmdir d1/d4f/de3/df5/d11f 0 2024-04-25T15:58:15.215 INFO:tasks.workunit.client.0.smithi087.stdout:2/778: dread d3/d20/d4a/f4c [0,4194304] 0 2024-04-25T15:58:15.221 INFO:tasks.workunit.client.0.smithi087.stdout:2/779: dwrite d3/d27/d29/d4f/feb [0,4194304] 0 2024-04-25T15:58:15.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/900: write d1/da/d3e/d85/d9b/d10a/dba/fc4 [97326,32200] 0 2024-04-25T15:58:15.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/780: truncate d3/d20/d4a/f4c 407720 0 2024-04-25T15:58:15.232 INFO:tasks.workunit.client.0.smithi087.stdout:0/901: chown d1/d6/c8f 481991 1 2024-04-25T15:58:15.232 INFO:tasks.workunit.client.0.smithi087.stdout:0/902: readlink d1/l4 0 2024-04-25T15:58:15.233 INFO:tasks.workunit.client.0.smithi087.stdout:0/903: write d1/d4f/de3/df5/fcc [1400974,85743] 0 2024-04-25T15:58:15.239 INFO:tasks.workunit.client.0.smithi087.stdout:0/904: dwrite d1/d6/f47 [0,4194304] 0 2024-04-25T15:58:15.242 INFO:tasks.workunit.client.0.smithi087.stdout:0/905: readlink d1/da/d3e/l6a 0 2024-04-25T15:58:15.243 INFO:tasks.workunit.client.0.smithi087.stdout:0/906: write d1/da/d3e/f9c [360732,9458] 0 2024-04-25T15:58:15.246 INFO:tasks.workunit.client.0.smithi087.stdout:3/740: sync 2024-04-25T15:58:15.246 INFO:tasks.workunit.client.0.smithi087.stdout:7/537: sync 2024-04-25T15:58:15.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/841: sync 2024-04-25T15:58:15.246 INFO:tasks.workunit.client.0.smithi087.stdout:8/863: sync 2024-04-25T15:58:15.246 INFO:tasks.workunit.client.0.smithi087.stdout:0/907: mkdir d1/d6/db1/dc0/dd3/dff/d125 0 2024-04-25T15:58:15.247 INFO:tasks.workunit.client.0.smithi087.stdout:4/842: chown d4/d10/d60/d56/d61/d3f/d8a 975548 1 2024-04-25T15:58:15.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/864: chown d4/d22/d43/d7f/dc6/ddc/da0/fc5 1 1 2024-04-25T15:58:15.249 INFO:tasks.workunit.client.0.smithi087.stdout:3/741: truncate d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fc7 185777 0 2024-04-25T15:58:15.250 INFO:tasks.workunit.client.0.smithi087.stdout:8/865: truncate d4/d1d/de1/d82/ffb 1795519 0 2024-04-25T15:58:15.255 INFO:tasks.workunit.client.0.smithi087.stdout:3/742: rename d4/d17/d24/d29/d58/dac/dc9 to d4/d17/d81/da6/d53/d68/de4 0 2024-04-25T15:58:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:8/866: dwrite d4/d8/dd/d2f/f110 [0,4194304] 0 2024-04-25T15:58:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/743: mkdir d4/d17/d24/d29/d58/dac/dc0/d82/d8c/da0/de5 0 2024-04-25T15:58:15.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/538: truncate d1/d9f/f73 461204 0 2024-04-25T15:58:15.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/867: mkdir d4/d8/dd/d85/dbc/dd2/d114 0 2024-04-25T15:58:15.326 INFO:tasks.workunit.client.0.smithi087.stdout:4/843: truncate d4/d10/d60/d5c/d3a/f3e 2105352 0 2024-04-25T15:58:15.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/539: mknod d1/d4/d7e/cab 0 2024-04-25T15:58:15.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/868: mkdir d4/d22/d43/d7f/d115 0 2024-04-25T15:58:15.331 INFO:tasks.workunit.client.0.smithi087.stdout:7/540: rmdir d1/d9/d26 39 2024-04-25T15:58:15.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/803: sync 2024-04-25T15:58:15.370 INFO:tasks.workunit.client.0.smithi087.stdout:6/951: sync 2024-04-25T15:58:15.372 INFO:tasks.workunit.client.0.smithi087.stdout:8/869: creat d4/d22/d43/d7f/dc6/df7/d10c/f116 x:0 0 0 2024-04-25T15:58:15.373 INFO:tasks.workunit.client.0.smithi087.stdout:7/541: dread d1/d4/d18/d36/fa8 [0,4194304] 0 2024-04-25T15:58:15.377 INFO:tasks.workunit.client.0.smithi087.stdout:4/844: truncate d4/d10/d60/d5c/d3a/d90/fbb 1485953 0 2024-04-25T15:58:15.380 INFO:tasks.workunit.client.0.smithi087.stdout:7/542: mkdir d1/d3c/da3/dac 0 2024-04-25T15:58:15.383 INFO:tasks.workunit.client.0.smithi087.stdout:8/870: rename d4/d8/c58 to d4/d22/d43/d7f/dc6/ddf/c117 0 2024-04-25T15:58:15.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/543: truncate d1/d1a/f50 1904080 0 2024-04-25T15:58:15.388 INFO:tasks.workunit.client.0.smithi087.stdout:8/871: creat d4/d1d/de1/dee/f118 x:0 0 0 2024-04-25T15:58:15.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/544: mknod d1/d4/d7e/cad 0 2024-04-25T15:58:15.390 INFO:tasks.workunit.client.0.smithi087.stdout:8/872: chown d4/d22/c30 2282778 1 2024-04-25T15:58:15.391 INFO:tasks.workunit.client.0.smithi087.stdout:5/804: truncate d9/d2f/d3b/f89 1087404 0 2024-04-25T15:58:15.392 INFO:tasks.workunit.client.0.smithi087.stdout:8/873: fdatasync d4/d1d/d17/d37/f3b 0 2024-04-25T15:58:15.393 INFO:tasks.workunit.client.0.smithi087.stdout:7/545: readlink d1/d4/l15 0 2024-04-25T15:58:15.397 INFO:tasks.workunit.client.0.smithi087.stdout:7/546: write d1/d3c/f58 [1164291,102266] 0 2024-04-25T15:58:15.399 INFO:tasks.workunit.client.0.smithi087.stdout:8/874: getdents d4/d22/d43/d7f/dc6/df7/d10c/d112 0 2024-04-25T15:58:15.402 INFO:tasks.workunit.client.0.smithi087.stdout:6/952: dread d7/d1a/d1d/d21/d27/d2c/d35/f83 [0,4194304] 0 2024-04-25T15:58:15.404 INFO:tasks.workunit.client.0.smithi087.stdout:7/547: rename d1/d1a/c72 to d1/d1a/d7b/cae 0 2024-04-25T15:58:15.409 INFO:tasks.workunit.client.0.smithi087.stdout:7/548: mkdir d1/d4/d18/d36/d5d/daf 0 2024-04-25T15:58:15.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/805: dwrite d9/d99/ffe [0,4194304] 0 2024-04-25T15:58:15.417 INFO:tasks.workunit.client.0.smithi087.stdout:5/806: mkdir d9/d91/d30/d70/d79/d7d/d108 0 2024-04-25T15:58:15.421 INFO:tasks.workunit.client.0.smithi087.stdout:8/875: write d4/d8/f60 [4208499,25081] 0 2024-04-25T15:58:15.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/549: creat d1/d4/d18/d36/d5d/daf/fb0 x:0 0 0 2024-04-25T15:58:15.422 INFO:tasks.workunit.client.0.smithi087.stdout:6/953: link d7/d1a/d41/dbd/ld7 d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/l148 0 2024-04-25T15:58:15.424 INFO:tasks.workunit.client.0.smithi087.stdout:5/807: write d9/d91/d30/d70/f8e [1767380,36816] 0 2024-04-25T15:58:15.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/808: write d9/d99/ff7 [923656,42304] 0 2024-04-25T15:58:15.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/550: mkdir d1/d3c/d6b/da1/db1 0 2024-04-25T15:58:15.430 INFO:tasks.workunit.client.0.smithi087.stdout:5/809: creat d9/d91/d38/ded/dd4/f109 x:0 0 0 2024-04-25T15:58:15.434 INFO:tasks.workunit.client.0.smithi087.stdout:5/810: unlink d9/d91/d30/f81 0 2024-04-25T15:58:15.436 INFO:tasks.workunit.client.0.smithi087.stdout:8/876: dwrite d4/d1d/d17/d37/fad [4194304,4194304] 0 2024-04-25T15:58:15.438 INFO:tasks.workunit.client.0.smithi087.stdout:5/811: symlink d9/d91/l10a 0 2024-04-25T15:58:15.440 INFO:tasks.workunit.client.0.smithi087.stdout:8/877: dread d4/f84 [0,4194304] 0 2024-04-25T15:58:15.445 INFO:tasks.workunit.client.0.smithi087.stdout:5/812: creat d9/d2f/d3b/f10b x:0 0 0 2024-04-25T15:58:15.446 INFO:tasks.workunit.client.0.smithi087.stdout:8/878: rmdir d4/d8/dd/d85/d86 39 2024-04-25T15:58:15.447 INFO:tasks.workunit.client.0.smithi087.stdout:6/954: dread d7/d1a/d1d/d21/d27/d2c/d35/f50 [0,4194304] 0 2024-04-25T15:58:15.450 INFO:tasks.workunit.client.0.smithi087.stdout:8/879: mknod d4/d22/d43/d7f/dc6/df7/d10c/d112/c119 0 2024-04-25T15:58:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/880: truncate d4/d1d/d14/fa2 859985 0 2024-04-25T15:58:15.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/551: dread d1/d1a/f62 [0,4194304] 0 2024-04-25T15:58:15.454 INFO:tasks.workunit.client.0.smithi087.stdout:6/955: dread d7/d1a/d1d/d21/d27/d2c/d35/f97 [0,4194304] 0 2024-04-25T15:58:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:7/552: stat d1/d1a 0 2024-04-25T15:58:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:7/553: chown d1 21273806 1 2024-04-25T15:58:15.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/956: fdatasync d7/d1a/d41/dbd/fe2 0 2024-04-25T15:58:15.456 INFO:tasks.workunit.client.0.smithi087.stdout:8/881: link d4/d8/c9a d4/c11a 0 2024-04-25T15:58:15.457 INFO:tasks.workunit.client.0.smithi087.stdout:1/844: sync 2024-04-25T15:58:15.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/763: sync 2024-04-25T15:58:15.457 INFO:tasks.workunit.client.0.smithi087.stdout:6/957: write d7/d1a/d1d/d21/f5f [3138496,129330] 0 2024-04-25T15:58:15.458 INFO:tasks.workunit.client.0.smithi087.stdout:7/554: fdatasync d1/f8 0 2024-04-25T15:58:15.459 INFO:tasks.workunit.client.0.smithi087.stdout:8/882: mkdir d4/d8/dd/d2f/d6f/d11b 0 2024-04-25T15:58:15.460 INFO:tasks.workunit.client.0.smithi087.stdout:6/958: truncate d7/d1a/d41/dbd/db9/f13e 12423 0 2024-04-25T15:58:15.463 INFO:tasks.workunit.client.0.smithi087.stdout:6/959: symlink d7/dd4/l149 0 2024-04-25T15:58:15.464 INFO:tasks.workunit.client.0.smithi087.stdout:9/764: mknod d6/d8/d12/db7/da9/cf4 0 2024-04-25T15:58:15.467 INFO:tasks.workunit.client.0.smithi087.stdout:7/555: creat d1/d3c/fb2 x:0 0 0 2024-04-25T15:58:15.467 INFO:tasks.workunit.client.0.smithi087.stdout:9/765: mkdir d6/d8/d12/df5 0 2024-04-25T15:58:15.470 INFO:tasks.workunit.client.0.smithi087.stdout:6/960: rename d7/d1a/d1d/d21/d27/d2c/d13c to d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/d14a 0 2024-04-25T15:58:15.471 INFO:tasks.workunit.client.0.smithi087.stdout:7/556: truncate d1/d1a/f39 847114 0 2024-04-25T15:58:15.473 INFO:tasks.workunit.client.0.smithi087.stdout:8/883: dread d4/d1d/d14/fa5 [0,4194304] 0 2024-04-25T15:58:15.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/961: symlink d7/d71/l14b 0 2024-04-25T15:58:15.475 INFO:tasks.workunit.client.0.smithi087.stdout:7/557: mknod d1/d4/d18/cb3 0 2024-04-25T15:58:15.476 INFO:tasks.workunit.client.0.smithi087.stdout:7/558: fsync d1/d3c/f5a 0 2024-04-25T15:58:15.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/766: dwrite d6/d3e/fbb [0,4194304] 0 2024-04-25T15:58:15.479 INFO:tasks.workunit.client.0.smithi087.stdout:6/962: write d7/d1a/d1d/d21/d27/d2c/f106 [664017,36288] 0 2024-04-25T15:58:15.479 INFO:tasks.workunit.client.0.smithi087.stdout:7/559: write d1/d1a/f85 [684072,117904] 0 2024-04-25T15:58:15.482 INFO:tasks.workunit.client.0.smithi087.stdout:7/560: chown d1/d4/d18/f82 7389720 1 2024-04-25T15:58:15.483 INFO:tasks.workunit.client.0.smithi087.stdout:7/561: fdatasync d1/d3c/d6b/f79 0 2024-04-25T15:58:15.484 INFO:tasks.workunit.client.0.smithi087.stdout:1/845: dwrite d3/d12/d14/f2b [0,4194304] 0 2024-04-25T15:58:15.486 INFO:tasks.workunit.client.0.smithi087.stdout:8/884: rename d4/d22/d43/d7f/dc6/ddc/da0/lfd to d4/d1d/d17/d37/dc9/l11c 0 2024-04-25T15:58:15.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/963: symlink d7/d1a/d2a/l14c 0 2024-04-25T15:58:15.490 INFO:tasks.workunit.client.0.smithi087.stdout:9/767: dwrite d6/d8/d12/db7/d3a/d5b/d60/d7f/fec [0,4194304] 0 2024-04-25T15:58:15.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/768: write d6/d8/d12/db7/d3a/d5b/d60/d81/fb3 [1114580,11233] 0 2024-04-25T15:58:15.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/846: rmdir d3/d12/d14/d29/d8e 39 2024-04-25T15:58:15.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/964: symlink d7/d1a/d41/dbd/df0/l14d 0 2024-04-25T15:58:15.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/885: rename d4/l7 to d4/d1d/d14/dff/l11d 0 2024-04-25T15:58:15.504 INFO:tasks.workunit.client.0.smithi087.stdout:7/562: dread d1/d4/f44 [0,4194304] 0 2024-04-25T15:58:15.504 INFO:tasks.workunit.client.0.smithi087.stdout:8/886: chown d4/d1d/f47 5015 1 2024-04-25T15:58:15.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/965: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/d14a/f14e x:0 0 0 2024-04-25T15:58:15.506 INFO:tasks.workunit.client.0.smithi087.stdout:1/847: mknod d3/d12/d14/d29/c123 0 2024-04-25T15:58:15.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/887: write d4/d1d/d17/f33 [3074970,119453] 0 2024-04-25T15:58:15.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/769: rmdir d6/d8/d32/d4c/df2 0 2024-04-25T15:58:15.507 INFO:tasks.workunit.client.0.smithi087.stdout:1/848: fdatasync d3/d12/d39/d64/dc0/f110 0 2024-04-25T15:58:15.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/888: rmdir d4/d8/dd/d85/dbc 39 2024-04-25T15:58:15.510 INFO:tasks.workunit.client.0.smithi087.stdout:7/563: creat d1/d4/d18/d36/fb4 x:0 0 0 2024-04-25T15:58:15.512 INFO:tasks.workunit.client.0.smithi087.stdout:1/849: creat d3/d12/f124 x:0 0 0 2024-04-25T15:58:15.513 INFO:tasks.workunit.client.0.smithi087.stdout:7/564: mknod d1/d3c/d6b/da1/cb5 0 2024-04-25T15:58:15.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/889: symlink d4/d8/dd/d85/d86/l11e 0 2024-04-25T15:58:15.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/565: unlink d1/d9/lc 0 2024-04-25T15:58:15.517 INFO:tasks.workunit.client.0.smithi087.stdout:9/770: dwrite d6/d8/d12/db7/d3a/d58/fa3 [0,4194304] 0 2024-04-25T15:58:15.520 INFO:tasks.workunit.client.0.smithi087.stdout:7/566: write d1/d3c/f58 [1107985,51348] 0 2024-04-25T15:58:15.521 INFO:tasks.workunit.client.0.smithi087.stdout:7/567: chown d1/d4/l15 476438 1 2024-04-25T15:58:15.523 INFO:tasks.workunit.client.0.smithi087.stdout:1/850: dwrite d3/d12/d4d/d7d/ff3 [0,4194304] 0 2024-04-25T15:58:15.526 INFO:tasks.workunit.client.0.smithi087.stdout:8/890: dread d4/d8/dd/f52 [4194304,4194304] 0 2024-04-25T15:58:15.528 INFO:tasks.workunit.client.0.smithi087.stdout:6/966: write d7/d1a/f9d [852356,126406] 0 2024-04-25T15:58:15.531 INFO:tasks.workunit.client.0.smithi087.stdout:7/568: write d1/d1a/f62 [3703305,93901] 0 2024-04-25T15:58:15.531 INFO:tasks.workunit.client.0.smithi087.stdout:7/569: dread - d1/d9/f9d zero size 2024-04-25T15:58:15.532 INFO:tasks.workunit.client.0.smithi087.stdout:7/570: fsync d1/d4/f69 0 2024-04-25T15:58:15.532 INFO:tasks.workunit.client.0.smithi087.stdout:7/571: stat d1/d4/d18/l6a 0 2024-04-25T15:58:15.535 INFO:tasks.workunit.client.0.smithi087.stdout:1/851: creat d3/d12/d14/d29/d67/d73/d9c/f125 x:0 0 0 2024-04-25T15:58:15.536 INFO:tasks.workunit.client.0.smithi087.stdout:9/771: creat d6/d8/d32/d57/dbf/ff6 x:0 0 0 2024-04-25T15:58:15.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/572: creat d1/d4/d18/d36/d5d/fb6 x:0 0 0 2024-04-25T15:58:15.538 INFO:tasks.workunit.client.0.smithi087.stdout:6/967: rmdir d7/d1a/d41/dbd/df0/d120/d137 0 2024-04-25T15:58:15.538 INFO:tasks.workunit.client.0.smithi087.stdout:8/891: truncate d4/d8/dd/d85/dbc/dd2/f103 982242 0 2024-04-25T15:58:15.540 INFO:tasks.workunit.client.0.smithi087.stdout:6/968: write d7/d1a/f138 [4893412,125553] 0 2024-04-25T15:58:15.541 INFO:tasks.workunit.client.0.smithi087.stdout:1/852: link d3/f5a d3/d12/d14/d33/dee/f126 0 2024-04-25T15:58:15.544 INFO:tasks.workunit.client.0.smithi087.stdout:8/892: rename d4/d22/d43/db3 to d4/d22/d43/d7f/dc6/df7/d10c/d11f 0 2024-04-25T15:58:15.548 INFO:tasks.workunit.client.0.smithi087.stdout:7/573: getdents d1/d4/d18/d36/d5d/daf 0 2024-04-25T15:58:15.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/853: creat d3/d12/d14/d33/dee/f127 x:0 0 0 2024-04-25T15:58:15.549 INFO:tasks.workunit.client.0.smithi087.stdout:0/908: sync 2024-04-25T15:58:15.550 INFO:tasks.workunit.client.0.smithi087.stdout:3/744: sync 2024-04-25T15:58:15.550 INFO:tasks.workunit.client.0.smithi087.stdout:2/781: sync 2024-04-25T15:58:15.550 INFO:tasks.workunit.client.0.smithi087.stdout:9/772: link d6/d8/d12/db7/d3a/d58/d72/cd1 d6/d8/d12/db7/d3a/d5b/d60/dcd/cf7 0 2024-04-25T15:58:15.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/893: creat d4/d8/dd/d85/dbc/dd2/d114/f120 x:0 0 0 2024-04-25T15:58:15.556 INFO:tasks.workunit.client.0.smithi087.stdout:6/969: getdents d7/d1a/d41/dbd/df0/d120 0 2024-04-25T15:58:15.556 INFO:tasks.workunit.client.0.smithi087.stdout:1/854: dwrite d3/f7 [0,4194304] 0 2024-04-25T15:58:15.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/855: truncate d3/d12/d39/d64/dc0/ff6 687523 0 2024-04-25T15:58:15.560 INFO:tasks.workunit.client.0.smithi087.stdout:3/745: fsync d4/d17/d24/d29/d58/dac/dc0/d5c/f77 0 2024-04-25T15:58:15.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/746: chown d4/d17/d24/d29/d58/dac/d9c/fab 7352 1 2024-04-25T15:58:15.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/909: creat d1/d6/d104/f126 x:0 0 0 2024-04-25T15:58:15.565 INFO:tasks.workunit.client.0.smithi087.stdout:2/782: mknod d3/d2a/d81/de2/cf3 0 2024-04-25T15:58:15.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/773: symlink d6/d8/d12/df5/lf8 0 2024-04-25T15:58:15.567 INFO:tasks.workunit.client.0.smithi087.stdout:1/856: truncate d3/d12/d14/d29/d65/ff4 852337 0 2024-04-25T15:58:15.568 INFO:tasks.workunit.client.0.smithi087.stdout:7/574: dwrite d1/d4/d18/d36/f71 [0,4194304] 0 2024-04-25T15:58:15.568 INFO:tasks.workunit.client.0.smithi087.stdout:3/747: truncate d4/d17/d24/d29/fa7 884335 0 2024-04-25T15:58:15.570 INFO:tasks.workunit.client.0.smithi087.stdout:9/774: chown d6/d8/d12/db7/d3a/d5b/cc8 0 1 2024-04-25T15:58:15.571 INFO:tasks.workunit.client.0.smithi087.stdout:0/910: mkdir d1/d6/db1/d127 0 2024-04-25T15:58:15.571 INFO:tasks.workunit.client.0.smithi087.stdout:3/748: write d4/db/fb8 [538937,81221] 0 2024-04-25T15:58:15.572 INFO:tasks.workunit.client.0.smithi087.stdout:7/575: write d1/d4/d18/d36/f71 [3667652,51115] 0 2024-04-25T15:58:15.572 INFO:tasks.workunit.client.0.smithi087.stdout:8/894: creat d4/d22/d43/f121 x:0 0 0 2024-04-25T15:58:15.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/857: rmdir d3/d2d/d11b 39 2024-04-25T15:58:15.574 INFO:tasks.workunit.client.0.smithi087.stdout:2/783: symlink d3/d27/d29/d2d/d40/d95/lf4 0 2024-04-25T15:58:15.575 INFO:tasks.workunit.client.0.smithi087.stdout:6/970: dread d7/d1a/d1d/d21/f10a [0,4194304] 0 2024-04-25T15:58:15.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/813: sync 2024-04-25T15:58:15.576 INFO:tasks.workunit.client.0.smithi087.stdout:4/845: sync 2024-04-25T15:58:15.581 INFO:tasks.workunit.client.0.smithi087.stdout:3/749: dwrite d4/d17/d24/d29/d58/dac/dc0/f6e [0,4194304] 0 2024-04-25T15:58:15.587 INFO:tasks.workunit.client.0.smithi087.stdout:0/911: mknod d1/da/d3e/d54/ddc/c128 0 2024-04-25T15:58:15.592 INFO:tasks.workunit.client.0.smithi087.stdout:7/576: mknod d1/d3c/d6b/da1/db1/cb7 0 2024-04-25T15:58:15.594 INFO:tasks.workunit.client.0.smithi087.stdout:2/784: rename d3/d27/d38/la4 to d3/d27/d29/d4f/de3/lf5 0 2024-04-25T15:58:15.596 INFO:tasks.workunit.client.0.smithi087.stdout:6/971: creat d7/d1a/d7b/d10c/f14f x:0 0 0 2024-04-25T15:58:15.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/775: write d6/d8/d12/db7/d3a/d7c/fab [248984,29122] 0 2024-04-25T15:58:15.598 INFO:tasks.workunit.client.0.smithi087.stdout:4/846: mkdir d4/d10/d60/d52/d66/d15/d103/d112 0 2024-04-25T15:58:15.598 INFO:tasks.workunit.client.0.smithi087.stdout:9/776: dread - d6/d3e/fc4 zero size 2024-04-25T15:58:15.600 INFO:tasks.workunit.client.0.smithi087.stdout:4/847: chown d4/d10/d60/d56/d61/d3f/d42/d97/fa0 711367837 1 2024-04-25T15:58:15.601 INFO:tasks.workunit.client.0.smithi087.stdout:1/858: creat d3/d12/d14/d29/d2f/d61/f128 x:0 0 0 2024-04-25T15:58:15.602 INFO:tasks.workunit.client.0.smithi087.stdout:2/785: creat d3/d27/d29/d4f/d5a/d6a/d88/de7/ff6 x:0 0 0 2024-04-25T15:58:15.605 INFO:tasks.workunit.client.0.smithi087.stdout:6/972: rename d7/d71/d59/f113 to d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/d14a/f150 0 2024-04-25T15:58:15.605 INFO:tasks.workunit.client.0.smithi087.stdout:5/814: link d9/d2f/d40/d4d/fc6 d9/d2f/dbb/dde/f10c 0 2024-04-25T15:58:15.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/973: fdatasync d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/f128 0 2024-04-25T15:58:15.608 INFO:tasks.workunit.client.0.smithi087.stdout:8/895: link d4/d22/d43/d7f/cc2 d4/d8/dd/d85/dbc/c122 0 2024-04-25T15:58:15.608 INFO:tasks.workunit.client.0.smithi087.stdout:7/577: read d1/d9/d26/f30 [2121136,70931] 0 2024-04-25T15:58:15.609 INFO:tasks.workunit.client.0.smithi087.stdout:7/578: chown d1/d9/c77 759579 1 2024-04-25T15:58:15.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/777: write d6/d8/d32/fc5 [5168259,113495] 0 2024-04-25T15:58:15.610 INFO:tasks.workunit.client.0.smithi087.stdout:3/750: truncate d4/d17/d24/f56 81284 0 2024-04-25T15:58:15.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/751: readlink d4/l8 0 2024-04-25T15:58:15.612 INFO:tasks.workunit.client.0.smithi087.stdout:1/859: symlink d3/d12/d14/d29/d2f/d53/dca/df1/l129 0 2024-04-25T15:58:15.613 INFO:tasks.workunit.client.0.smithi087.stdout:0/912: link d1/dab/df4/f11d d1/d6/d21/f129 0 2024-04-25T15:58:15.614 INFO:tasks.workunit.client.0.smithi087.stdout:2/786: mknod d3/d27/d29/d76/cf7 0 2024-04-25T15:58:15.616 INFO:tasks.workunit.client.0.smithi087.stdout:0/913: stat d1/d6/d77/lbc 0 2024-04-25T15:58:15.617 INFO:tasks.workunit.client.0.smithi087.stdout:6/974: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/ff3 [0,4194304] 0 2024-04-25T15:58:15.619 INFO:tasks.workunit.client.0.smithi087.stdout:6/975: fsync d7/d1a/d1d/d21/d27/d2c/f57 0 2024-04-25T15:58:15.620 INFO:tasks.workunit.client.0.smithi087.stdout:5/815: link d9/d2f/d3b/f86 d9/d91/d30/d56/d101/f10d 0 2024-04-25T15:58:15.623 INFO:tasks.workunit.client.0.smithi087.stdout:3/752: creat d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89/fe6 x:0 0 0 2024-04-25T15:58:15.626 INFO:tasks.workunit.client.0.smithi087.stdout:8/896: mkdir d4/d9c/d123 0 2024-04-25T15:58:15.627 INFO:tasks.workunit.client.0.smithi087.stdout:2/787: fsync d3/d20/d4a/f44 0 2024-04-25T15:58:15.629 INFO:tasks.workunit.client.0.smithi087.stdout:4/848: rename d4/d10/d60/d56/d61/d3f/d8a/fcc to d4/d10/d60/d56/d61/d3f/d42/d97/f113 0 2024-04-25T15:58:15.630 INFO:tasks.workunit.client.0.smithi087.stdout:7/579: dread d1/d4/f69 [0,4194304] 0 2024-04-25T15:58:15.631 INFO:tasks.workunit.client.0.smithi087.stdout:0/914: symlink d1/da/d3e/d85/d9b/dcd/df2/l12a 0 2024-04-25T15:58:15.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/788: creat d3/d2a/d81/ff8 x:0 0 0 2024-04-25T15:58:15.638 INFO:tasks.workunit.client.0.smithi087.stdout:1/860: write d3/d12/d14/d29/d2f/d53/f84 [734978,84430] 0 2024-04-25T15:58:15.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/789: stat d3/c17 0 2024-04-25T15:58:15.639 INFO:tasks.workunit.client.0.smithi087.stdout:1/861: truncate d3/d12/f26 4906775 0 2024-04-25T15:58:15.643 INFO:tasks.workunit.client.0.smithi087.stdout:7/580: dread d1/d4/da5/fa6 [4194304,4194304] 0 2024-04-25T15:58:15.643 INFO:tasks.workunit.client.0.smithi087.stdout:8/897: symlink d4/d9c/l124 0 2024-04-25T15:58:15.644 INFO:tasks.workunit.client.0.smithi087.stdout:7/581: chown d1/d9/d26/f53 470662 1 2024-04-25T15:58:15.644 INFO:tasks.workunit.client.0.smithi087.stdout:3/753: dread d4/db/f4d [0,4194304] 0 2024-04-25T15:58:15.645 INFO:tasks.workunit.client.0.smithi087.stdout:2/790: creat d3/d27/d29/d4f/d5a/d6a/ff9 x:0 0 0 2024-04-25T15:58:15.645 INFO:tasks.workunit.client.0.smithi087.stdout:7/582: truncate d1/d1a/d7b/f8b 13709 0 2024-04-25T15:58:15.646 INFO:tasks.workunit.client.0.smithi087.stdout:1/862: mkdir d3/d12/d14/d29/d2f/d53/dca/d104/d12a 0 2024-04-25T15:58:15.647 INFO:tasks.workunit.client.0.smithi087.stdout:7/583: write d1/d9/f9d [262108,107722] 0 2024-04-25T15:58:15.647 INFO:tasks.workunit.client.0.smithi087.stdout:3/754: truncate d4/d17/d81/da6/d53/fb9 36778 0 2024-04-25T15:58:15.651 INFO:tasks.workunit.client.0.smithi087.stdout:8/898: creat d4/d1d/d7c/dae/df8/f125 x:0 0 0 2024-04-25T15:58:15.651 INFO:tasks.workunit.client.0.smithi087.stdout:4/849: write d4/d10/d60/d56/d61/d3f/d58/f83 [4881360,96168] 0 2024-04-25T15:58:15.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/915: write d1/da/d3e/fa3 [513481,44163] 0 2024-04-25T15:58:15.653 INFO:tasks.workunit.client.0.smithi087.stdout:8/899: readlink d4/d1d/d14/l10a 0 2024-04-25T15:58:15.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/584: rename d1/d9/d26/f60 to d1/d3c/da3/fb8 0 2024-04-25T15:58:15.654 INFO:tasks.workunit.client.0.smithi087.stdout:3/755: symlink d4/d17/d24/d29/d58/dac/dc0/d5c/da5/le7 0 2024-04-25T15:58:15.655 INFO:tasks.workunit.client.0.smithi087.stdout:1/863: creat d3/f12b x:0 0 0 2024-04-25T15:58:15.657 INFO:tasks.workunit.client.0.smithi087.stdout:2/791: dwrite d3/d27/d29/d4f/d5a/d6a/d88/d94/fad [0,4194304] 0 2024-04-25T15:58:15.657 INFO:tasks.workunit.client.0.smithi087.stdout:0/916: write d1/f92 [3108898,115373] 0 2024-04-25T15:58:15.657 INFO:tasks.workunit.client.0.smithi087.stdout:4/850: creat d4/d10/d60/d52/d66/d15/d103/f114 x:0 0 0 2024-04-25T15:58:15.661 INFO:tasks.workunit.client.0.smithi087.stdout:2/792: mkdir d3/d2a/d48/d77/db6/dfa 0 2024-04-25T15:58:15.662 INFO:tasks.workunit.client.0.smithi087.stdout:3/756: truncate d4/d17/d24/d29/d58/dac/dc0/d3c/f9d 1104583 0 2024-04-25T15:58:15.664 INFO:tasks.workunit.client.0.smithi087.stdout:0/917: creat d1/da/d3e/d85/d9b/f12b x:0 0 0 2024-04-25T15:58:15.664 INFO:tasks.workunit.client.0.smithi087.stdout:2/793: chown d3/d27/d29/d4f/d5a/d6a/f89 862403032 1 2024-04-25T15:58:15.665 INFO:tasks.workunit.client.0.smithi087.stdout:3/757: write d4/d17/d24/d29/d58/dac/f76 [641370,33604] 0 2024-04-25T15:58:15.666 INFO:tasks.workunit.client.0.smithi087.stdout:7/585: dwrite d1/d3c/d6b/f84 [0,4194304] 0 2024-04-25T15:58:15.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/794: chown d3/d2a/d48/f54 3426007 1 2024-04-25T15:58:15.670 INFO:tasks.workunit.client.0.smithi087.stdout:4/851: getdents d4/d10/d60/d56/d61/db7 0 2024-04-25T15:58:15.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/852: write d4/d10/d60/d5c/d3a/f9d [1432279,39447] 0 2024-04-25T15:58:15.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/853: readlink d4/d10/d60/d56/d61/d3f/l44 0 2024-04-25T15:58:15.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/918: dwrite d1/d6/db1/dc0/dd3/dff/d50/f81 [4194304,4194304] 0 2024-04-25T15:58:15.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/919: stat d1/d6/db1/dc0/dd3/dff/d50/d6b/fac 0 2024-04-25T15:58:15.681 INFO:tasks.workunit.client.0.smithi087.stdout:3/758: dwrite d4/d17/d81/da6/d53/f88 [0,4194304] 0 2024-04-25T15:58:15.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/586: dread d1/d9/d26/d45/f4b [0,4194304] 0 2024-04-25T15:58:15.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/795: getdents d3 0 2024-04-25T15:58:15.685 INFO:tasks.workunit.client.0.smithi087.stdout:4/854: creat d4/d10/d60/d5c/f115 x:0 0 0 2024-04-25T15:58:15.686 INFO:tasks.workunit.client.0.smithi087.stdout:2/796: dread - d3/d27/d38/fdf zero size 2024-04-25T15:58:15.690 INFO:tasks.workunit.client.0.smithi087.stdout:3/759: creat d4/d17/d81/da6/d9b/fe8 x:0 0 0 2024-04-25T15:58:15.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/864: dwrite d3/d12/d14/d29/d2f/d61/f87 [0,4194304] 0 2024-04-25T15:58:15.692 INFO:tasks.workunit.client.0.smithi087.stdout:4/855: mknod d4/d10/d60/d56/d61/d3f/c116 0 2024-04-25T15:58:15.693 INFO:tasks.workunit.client.0.smithi087.stdout:4/856: readlink d4/d10/d60/d56/d61/d3f/d42/l72 0 2024-04-25T15:58:15.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/920: link d1/da/ld4 d1/da/d3e/d54/l12c 0 2024-04-25T15:58:15.694 INFO:tasks.workunit.client.0.smithi087.stdout:4/857: stat d4/d10/d60/d56/d61/d3f/d42/c47 0 2024-04-25T15:58:15.696 INFO:tasks.workunit.client.0.smithi087.stdout:7/587: link d1/d9/f92 d1/d9f/fb9 0 2024-04-25T15:58:15.696 INFO:tasks.workunit.client.0.smithi087.stdout:4/858: stat d4/d10/d60/d52/d66/f32 0 2024-04-25T15:58:15.697 INFO:tasks.workunit.client.0.smithi087.stdout:3/760: rmdir d4/d17/d81/da6/d53/d68 39 2024-04-25T15:58:15.697 INFO:tasks.workunit.client.0.smithi087.stdout:4/859: write d4/d10/d60/d56/d61/db7/fea [393272,33670] 0 2024-04-25T15:58:15.701 INFO:tasks.workunit.client.0.smithi087.stdout:3/761: symlink d4/d17/d81/le9 0 2024-04-25T15:58:15.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/797: creat d3/d27/ffb x:0 0 0 2024-04-25T15:58:15.703 INFO:tasks.workunit.client.0.smithi087.stdout:3/762: read d4/d17/f74 [2791025,37486] 0 2024-04-25T15:58:15.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/860: rename d4/d10/d60/d56/d61/d3f/fd6 to d4/d10/d60/d52/d66/d15/df1/f117 0 2024-04-25T15:58:15.705 INFO:tasks.workunit.client.0.smithi087.stdout:0/921: dwrite d1/d6/db1/dc0/dd3/dff/d50/d6b/f8a [0,4194304] 0 2024-04-25T15:58:15.709 INFO:tasks.workunit.client.0.smithi087.stdout:7/588: creat d1/d4/fba x:0 0 0 2024-04-25T15:58:15.712 INFO:tasks.workunit.client.0.smithi087.stdout:2/798: symlink d3/d2a/d1c/lfc 0 2024-04-25T15:58:15.715 INFO:tasks.workunit.client.0.smithi087.stdout:4/861: rmdir d4/d10/d60/d56/d61/d3f/d8a 39 2024-04-25T15:58:15.717 INFO:tasks.workunit.client.0.smithi087.stdout:7/589: creat d1/d3c/d6b/da1/db1/fbb x:0 0 0 2024-04-25T15:58:15.718 INFO:tasks.workunit.client.0.smithi087.stdout:1/865: truncate d3/f8 1588421 0 2024-04-25T15:58:15.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/866: symlink d3/d12/d39/d64/l12c 0 2024-04-25T15:58:15.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/867: fdatasync d3/d12/d14/d29/d2f/d40/f54 0 2024-04-25T15:58:15.722 INFO:tasks.workunit.client.0.smithi087.stdout:3/763: getdents d4/d17/d24/d29/d58 0 2024-04-25T15:58:15.723 INFO:tasks.workunit.client.0.smithi087.stdout:1/868: chown d3/f100 7 1 2024-04-25T15:58:15.724 INFO:tasks.workunit.client.0.smithi087.stdout:4/862: rename d4/d10/d60/d5c/f28 to d4/d10/d60/d56/d61/d3f/d58/d5e/f118 0 2024-04-25T15:58:15.725 INFO:tasks.workunit.client.0.smithi087.stdout:7/590: dread d1/f74 [0,4194304] 0 2024-04-25T15:58:15.726 INFO:tasks.workunit.client.0.smithi087.stdout:1/869: truncate d3/d12/d14/d33/d95/f103 155053 0 2024-04-25T15:58:15.729 INFO:tasks.workunit.client.0.smithi087.stdout:3/764: rename d4/d17/d24/d29/d58/dac/dc0/d82/f84 to d4/d17/d81/da6/d37/d51/fea 0 2024-04-25T15:58:15.730 INFO:tasks.workunit.client.0.smithi087.stdout:0/922: dread d1/da/d3e/d54/d34/fa6 [0,4194304] 0 2024-04-25T15:58:15.731 INFO:tasks.workunit.client.0.smithi087.stdout:4/863: getdents d4/d10/d60/d56/d61/dca 0 2024-04-25T15:58:15.732 INFO:tasks.workunit.client.0.smithi087.stdout:1/870: rename d3/d12/d14/d29/d67/d73/d9c to d3/d12/d14/d29/d12d 0 2024-04-25T15:58:15.733 INFO:tasks.workunit.client.0.smithi087.stdout:0/923: mkdir d1/d6/d21/d2a/dd5/d12d 0 2024-04-25T15:58:15.734 INFO:tasks.workunit.client.0.smithi087.stdout:1/871: read d3/d12/d4d/d7d/fe4 [82889,101135] 0 2024-04-25T15:58:15.734 INFO:tasks.workunit.client.0.smithi087.stdout:3/765: mkdir d4/d17/d24/d29/d58/dac/dc0/d82/d8c/deb 0 2024-04-25T15:58:15.735 INFO:tasks.workunit.client.0.smithi087.stdout:2/799: dread d3/d27/d29/d2d/d40/f7b [0,4194304] 0 2024-04-25T15:58:15.738 INFO:tasks.workunit.client.0.smithi087.stdout:1/872: chown d3/d12/d4d/dba/d117/l119 1 1 2024-04-25T15:58:15.738 INFO:tasks.workunit.client.0.smithi087.stdout:2/800: chown d3/d20/d4a/d8e/lb0 1377 1 2024-04-25T15:58:15.739 INFO:tasks.workunit.client.0.smithi087.stdout:2/801: write d3/d27/d38/d7e/fb3 [145628,121664] 0 2024-04-25T15:58:15.740 INFO:tasks.workunit.client.0.smithi087.stdout:0/924: link d1/da/d3e/d85/d9b/dcd/df2/f110 d1/d6/d77/dc6/df3/f12e 0 2024-04-25T15:58:15.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/864: dwrite d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/fa2 [0,4194304] 0 2024-04-25T15:58:15.743 INFO:tasks.workunit.client.0.smithi087.stdout:0/925: rmdir d1/d6/d112/d7d/d84 39 2024-04-25T15:58:15.746 INFO:tasks.workunit.client.0.smithi087.stdout:0/926: symlink d1/d4f/de3/l12f 0 2024-04-25T15:58:15.746 INFO:tasks.workunit.client.0.smithi087.stdout:4/865: mknod d4/d10/d60/d56/d61/c119 0 2024-04-25T15:58:15.748 INFO:tasks.workunit.client.0.smithi087.stdout:4/866: truncate d4/d10/d60/d56/d61/fd3 650823 0 2024-04-25T15:58:15.749 INFO:tasks.workunit.client.0.smithi087.stdout:0/927: rename d1/da/d3e/d85/d9b/l101 to d1/da/d3e/d85/l130 0 2024-04-25T15:58:15.751 INFO:tasks.workunit.client.0.smithi087.stdout:4/867: mkdir d4/d10/d60/d11a 0 2024-04-25T15:58:15.754 INFO:tasks.workunit.client.0.smithi087.stdout:0/928: mknod d1/d6/d112/d7d/d84/de1/d114/c131 0 2024-04-25T15:58:15.761 INFO:tasks.workunit.client.0.smithi087.stdout:9/778: sync 2024-04-25T15:58:15.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/802: dread d3/d2a/f14 [0,4194304] 0 2024-04-25T15:58:15.762 INFO:tasks.workunit.client.0.smithi087.stdout:4/868: dread d4/d10/d60/d56/d61/d3f/d58/f5a [0,4194304] 0 2024-04-25T15:58:15.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/803: symlink d3/d2a/d48/d77/lfd 0 2024-04-25T15:58:15.765 INFO:tasks.workunit.client.0.smithi087.stdout:9/779: creat d6/d8/d12/db7/d3a/d5b/d60/d1d/ff9 x:0 0 0 2024-04-25T15:58:15.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/780: mkdir d6/d8/d12/db7/d3a/dfa 0 2024-04-25T15:58:15.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/781: read d6/d8/f2e [6621,114816] 0 2024-04-25T15:58:15.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/782: dread d6/d8/d12/db7/d3a/d58/d72/dd2/fd4 [0,4194304] 0 2024-04-25T15:58:15.774 INFO:tasks.workunit.client.0.smithi087.stdout:9/783: rename d6/d8 to d6/d8/d12/db7/d3a/dfa/dfb 22 2024-04-25T15:58:15.774 INFO:tasks.workunit.client.0.smithi087.stdout:9/784: readlink d6/d3e/d63/lcb 0 2024-04-25T15:58:15.776 INFO:tasks.workunit.client.0.smithi087.stdout:9/785: rmdir d6/d8/d12/db7/d3a/d5b/d60/d7f 39 2024-04-25T15:58:15.782 INFO:tasks.workunit.client.0.smithi087.stdout:9/786: dwrite d6/d8/d48/f56 [0,4194304] 0 2024-04-25T15:58:15.786 INFO:tasks.workunit.client.0.smithi087.stdout:4/869: write d4/d10/d60/d52/ff2 [4134206,72335] 0 2024-04-25T15:58:15.787 INFO:tasks.workunit.client.0.smithi087.stdout:2/804: write d3/d27/d29/f6e [2133080,24012] 0 2024-04-25T15:58:15.840 INFO:tasks.workunit.client.0.smithi087.stdout:9/787: getdents d6/d8/d12/db7/d3a/d58 0 2024-04-25T15:58:15.845 INFO:tasks.workunit.client.0.smithi087.stdout:9/788: chown d6/d8/d32/d4c/db9/fe8 1662 1 2024-04-25T15:58:15.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/789: symlink d6/d8/d12/df5/lfc 0 2024-04-25T15:58:15.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/870: dwrite d4/d10/d60/d56/ff7 [0,4194304] 0 2024-04-25T15:58:15.869 INFO:tasks.workunit.client.0.smithi087.stdout:2/805: dread d3/d27/d29/f8c [0,4194304] 0 2024-04-25T15:58:15.873 INFO:tasks.workunit.client.0.smithi087.stdout:4/871: rename d4/d10/d60/d52/d66/cc1 to d4/d10/d60/d56/d61/d3f/d42/c11b 0 2024-04-25T15:58:15.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/806: chown d3/d27/d38 1502460 1 2024-04-25T15:58:15.875 INFO:tasks.workunit.client.0.smithi087.stdout:9/790: dwrite d6/d8/d12/db7/d3a/f4e [0,4194304] 0 2024-04-25T15:58:15.876 INFO:tasks.workunit.client.0.smithi087.stdout:2/807: symlink d3/dce/lfe 0 2024-04-25T15:58:15.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/791: chown d6/d8/d12/db7/d3a/d5b/d60/l6a 79 1 2024-04-25T15:58:15.881 INFO:tasks.workunit.client.0.smithi087.stdout:2/808: fsync d3/d27/f39 0 2024-04-25T15:58:15.884 INFO:tasks.workunit.client.0.smithi087.stdout:4/872: write d4/d10/d60/d5c/f54 [1205734,11119] 0 2024-04-25T15:58:15.887 INFO:tasks.workunit.client.0.smithi087.stdout:9/792: creat d6/d8/d12/db7/d3a/d5b/d60/d81/ffd x:0 0 0 2024-04-25T15:58:15.889 INFO:tasks.workunit.client.0.smithi087.stdout:5/816: sync 2024-04-25T15:58:15.889 INFO:tasks.workunit.client.0.smithi087.stdout:6/976: sync 2024-04-25T15:58:15.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/873: rename d4/d10/d60/d56/d61/d3f/d42/d97/f110 to d4/d10/f11c 0 2024-04-25T15:58:15.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/793: write d6/d8/d12/db7/d3a/d5b/d60/d1d/fad [931054,128940] 0 2024-04-25T15:58:15.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/977: chown d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107 6825905 1 2024-04-25T15:58:15.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/874: mkdir d4/d10/d11d 0 2024-04-25T15:58:15.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/978: chown f6 315 1 2024-04-25T15:58:15.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/809: dwrite d3/d2a/f8f [0,4194304] 0 2024-04-25T15:58:15.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/794: dread - d6/d8/d12/db7/d3a/d5b/d60/d7f/fb8 zero size 2024-04-25T15:58:15.909 INFO:tasks.workunit.client.0.smithi087.stdout:9/795: creat d6/d8/d12/db7/d3a/d5b/d60/dcd/ffe x:0 0 0 2024-04-25T15:58:15.916 INFO:tasks.workunit.client.0.smithi087.stdout:2/810: dread d3/d27/d29/f7c [0,4194304] 0 2024-04-25T15:58:15.922 INFO:tasks.workunit.client.0.smithi087.stdout:6/979: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/f48 [4194304,4194304] 0 2024-04-25T15:58:15.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/796: truncate d6/d8/d32/f4d 508870 0 2024-04-25T15:58:15.924 INFO:tasks.workunit.client.0.smithi087.stdout:5/817: dread d9/d91/d30/d56/f78 [0,4194304] 0 2024-04-25T15:58:15.926 INFO:tasks.workunit.client.0.smithi087.stdout:6/980: write d7/d1a/d1d/d21/f5f [1149279,80671] 0 2024-04-25T15:58:15.934 INFO:tasks.workunit.client.0.smithi087.stdout:2/811: dwrite d3/d27/d38/f74 [0,4194304] 0 2024-04-25T15:58:15.941 INFO:tasks.workunit.client.0.smithi087.stdout:2/812: dread d3/d27/d29/d2d/d40/fc3 [0,4194304] 0 2024-04-25T15:58:15.941 INFO:tasks.workunit.client.0.smithi087.stdout:5/818: write d9/d2f/d40/d4d/d7b/d5c/f6e [576907,95611] 0 2024-04-25T15:58:15.943 INFO:tasks.workunit.client.0.smithi087.stdout:5/819: write d9/d99/ff7 [1826657,40427] 0 2024-04-25T15:58:15.947 INFO:tasks.workunit.client.0.smithi087.stdout:5/820: creat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/d107/f10e x:0 0 0 2024-04-25T15:58:15.951 INFO:tasks.workunit.client.0.smithi087.stdout:9/797: dread d6/d8/d12/db7/d3a/d5b/d60/f95 [0,4194304] 0 2024-04-25T15:58:15.953 INFO:tasks.workunit.client.0.smithi087.stdout:9/798: chown d6/d8/d12/fbc 1245 1 2024-04-25T15:58:15.954 INFO:tasks.workunit.client.0.smithi087.stdout:2/813: dwrite d3/d27/d29/d2d/f7d [0,4194304] 0 2024-04-25T15:58:15.955 INFO:tasks.workunit.client.0.smithi087.stdout:2/814: readlink d3/lc2 0 2024-04-25T15:58:15.956 INFO:tasks.workunit.client.0.smithi087.stdout:9/799: mkdir d6/d8/d12/db7/d3a/d5b/d60/d7f/dff 0 2024-04-25T15:58:15.958 INFO:tasks.workunit.client.0.smithi087.stdout:2/815: write d3/d27/d29/d4f/d5a/d6a/f89 [1737571,121188] 0 2024-04-25T15:58:15.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/800: readlink d6/d8/d12/db7/d3a/d5b/d60/l15 0 2024-04-25T15:58:15.961 INFO:tasks.workunit.client.0.smithi087.stdout:6/981: dread d7/d1a/d41/fe4 [0,4194304] 0 2024-04-25T15:58:15.961 INFO:tasks.workunit.client.0.smithi087.stdout:5/821: truncate d9/d2f/d40/d4d/de1/fff 109761 0 2024-04-25T15:58:15.964 INFO:tasks.workunit.client.0.smithi087.stdout:9/801: rename d6/d8/d32/l4a to d6/d3e/d63/dc2/l100 0 2024-04-25T15:58:15.970 INFO:tasks.workunit.client.0.smithi087.stdout:2/816: dread d3/d20/f46 [0,4194304] 0 2024-04-25T15:58:15.971 INFO:tasks.workunit.client.0.smithi087.stdout:6/982: getdents d7/d1a/d41/dbd/df0/df9 0 2024-04-25T15:58:15.971 INFO:tasks.workunit.client.0.smithi087.stdout:5/822: dwrite f1 [0,4194304] 0 2024-04-25T15:58:15.974 INFO:tasks.workunit.client.0.smithi087.stdout:9/802: mkdir d6/d8/d12/db7/d101 0 2024-04-25T15:58:15.978 INFO:tasks.workunit.client.0.smithi087.stdout:2/817: creat d3/d2a/d48/d77/db6/dfa/fff x:0 0 0 2024-04-25T15:58:15.980 INFO:tasks.workunit.client.0.smithi087.stdout:5/823: mknod d9/d2f/d40/d4d/d58/c10f 0 2024-04-25T15:58:15.981 INFO:tasks.workunit.client.0.smithi087.stdout:9/803: mkdir d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d102 0 2024-04-25T15:58:15.982 INFO:tasks.workunit.client.0.smithi087.stdout:2/818: creat d3/d20/d4a/d47/f100 x:0 0 0 2024-04-25T15:58:15.983 INFO:tasks.workunit.client.0.smithi087.stdout:5/824: creat d9/d2f/d40/d4d/d7b/d8f/f110 x:0 0 0 2024-04-25T15:58:15.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/983: dread d7/d71/f61 [0,4194304] 0 2024-04-25T15:58:15.993 INFO:tasks.workunit.client.0.smithi087.stdout:6/984: mkdir d7/d1a/d1d/d8a/d151 0 2024-04-25T15:58:15.994 INFO:tasks.workunit.client.0.smithi087.stdout:2/819: dwrite d3/d27/d29/d2d/fa8 [0,4194304] 0 2024-04-25T15:58:15.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/825: dwrite d9/d91/d38/ded/dd4/f109 [0,4194304] 0 2024-04-25T15:58:15.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/820: read d3/d27/d29/d4f/feb [1217524,118817] 0 2024-04-25T15:58:16.000 INFO:tasks.workunit.client.0.smithi087.stdout:2/821: chown d3/d27/d29/d4f/l5e 5149596 1 2024-04-25T15:58:16.001 INFO:tasks.workunit.client.0.smithi087.stdout:2/822: fdatasync d3/d27/d29/f7c 0 2024-04-25T15:58:16.002 INFO:tasks.workunit.client.0.smithi087.stdout:8/900: sync 2024-04-25T15:58:16.002 INFO:tasks.workunit.client.0.smithi087.stdout:3/766: sync 2024-04-25T15:58:16.002 INFO:tasks.workunit.client.0.smithi087.stdout:7/591: sync 2024-04-25T15:58:16.007 INFO:tasks.workunit.client.0.smithi087.stdout:6/985: truncate d7/d1a/d1d/d21/d27/f82 3617094 0 2024-04-25T15:58:16.008 INFO:tasks.workunit.client.0.smithi087.stdout:6/986: dread - d7/d71/d59/d130/f146 zero size 2024-04-25T15:58:16.009 INFO:tasks.workunit.client.0.smithi087.stdout:2/823: creat d3/f101 x:0 0 0 2024-04-25T15:58:16.010 INFO:tasks.workunit.client.0.smithi087.stdout:6/987: chown d7/d1a/d1d/d21/d27/d2c/db4/fc9 6780 1 2024-04-25T15:58:16.014 INFO:tasks.workunit.client.0.smithi087.stdout:7/592: mkdir d1/d4/dbc 0 2024-04-25T15:58:16.017 INFO:tasks.workunit.client.0.smithi087.stdout:6/988: fsync d7/d1a/d1d/d21/d27/d2c/d35/d127/d133/f140 0 2024-04-25T15:58:16.019 INFO:tasks.workunit.client.0.smithi087.stdout:7/593: symlink d1/d3c/da3/lbd 0 2024-04-25T15:58:16.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/594: chown d1/d9/d26/d45/f4b 5840 1 2024-04-25T15:58:16.022 INFO:tasks.workunit.client.0.smithi087.stdout:6/989: creat d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/f152 x:0 0 0 2024-04-25T15:58:16.023 INFO:tasks.workunit.client.0.smithi087.stdout:3/767: dread d4/db/fe [0,4194304] 0 2024-04-25T15:58:16.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/990: fdatasync d7/d1a/d1d/d21/f6d 0 2024-04-25T15:58:16.024 INFO:tasks.workunit.client.0.smithi087.stdout:8/901: getdents d4/d22/d43/d7f/dc6/df7 0 2024-04-25T15:58:16.025 INFO:tasks.workunit.client.0.smithi087.stdout:3/768: write d4/d17/d24/f32 [2340951,19504] 0 2024-04-25T15:58:16.025 INFO:tasks.workunit.client.0.smithi087.stdout:8/902: chown d4/d22 113665 1 2024-04-25T15:58:16.026 INFO:tasks.workunit.client.0.smithi087.stdout:6/991: chown d7/d1a/d41/f74 7000575 1 2024-04-25T15:58:16.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/992: chown d7/d1a/f39 302 1 2024-04-25T15:58:16.028 INFO:tasks.workunit.client.0.smithi087.stdout:5/826: dread d9/d2f/d3b/f68 [0,4194304] 0 2024-04-25T15:58:16.028 INFO:tasks.workunit.client.0.smithi087.stdout:7/595: creat d1/d4/fbe x:0 0 0 2024-04-25T15:58:16.029 INFO:tasks.workunit.client.0.smithi087.stdout:3/769: truncate d4/d17/d81/da6/d53/fdf 76162 0 2024-04-25T15:58:16.029 INFO:tasks.workunit.client.0.smithi087.stdout:6/993: chown d7/d1a/d41/dbd 16873192 1 2024-04-25T15:58:16.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/994: write d7/d1a/d41/dbd/d96/f11d [392306,18357] 0 2024-04-25T15:58:16.031 INFO:tasks.workunit.client.0.smithi087.stdout:2/824: link d3/d27/d29/d2d/f7d d3/d20/f102 0 2024-04-25T15:58:16.032 INFO:tasks.workunit.client.0.smithi087.stdout:8/903: creat d4/d22/d43/f126 x:0 0 0 2024-04-25T15:58:16.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/770: fdatasync d4/d17/d81/da6/d53/d68/fe1 0 2024-04-25T15:58:16.034 INFO:tasks.workunit.client.0.smithi087.stdout:5/827: creat d9/d2f/d40/d4d/d7b/d5c/d5f/de8/f111 x:0 0 0 2024-04-25T15:58:16.035 INFO:tasks.workunit.client.0.smithi087.stdout:7/596: symlink d1/d3c/lbf 0 2024-04-25T15:58:16.036 INFO:tasks.workunit.client.0.smithi087.stdout:7/597: stat d1/d1a/f20 0 2024-04-25T15:58:16.039 INFO:tasks.workunit.client.0.smithi087.stdout:5/828: dread d9/d91/d30/d70/d79/f95 [0,4194304] 0 2024-04-25T15:58:16.039 INFO:tasks.workunit.client.0.smithi087.stdout:6/995: mknod d7/d1a/d1d/d21/c153 0 2024-04-25T15:58:16.041 INFO:tasks.workunit.client.0.smithi087.stdout:7/598: creat d1/d1a/d7b/fc0 x:0 0 0 2024-04-25T15:58:16.045 INFO:tasks.workunit.client.0.smithi087.stdout:2/825: link d3/d27/d38/f67 d3/f103 0 2024-04-25T15:58:16.046 INFO:tasks.workunit.client.0.smithi087.stdout:6/996: mknod d7/d1a/d1d/d21/d27/d2c/d35/d45/d8d/c154 0 2024-04-25T15:58:16.048 INFO:tasks.workunit.client.0.smithi087.stdout:3/771: rmdir d4/d17/d24/d29/d58/dac/dc0/d82/d8c/deb 0 2024-04-25T15:58:16.052 INFO:tasks.workunit.client.0.smithi087.stdout:5/829: creat d9/d2f/d40/d4d/d7b/f112 x:0 0 0 2024-04-25T15:58:16.053 INFO:tasks.workunit.client.0.smithi087.stdout:2/826: mknod d3/d27/d29/d4f/d5a/d6a/d88/de7/dde/c104 0 2024-04-25T15:58:16.055 INFO:tasks.workunit.client.0.smithi087.stdout:6/997: creat d7/d71/f155 x:0 0 0 2024-04-25T15:58:16.056 INFO:tasks.workunit.client.0.smithi087.stdout:7/599: getdents d1/d3c/d6b/da1/db1 0 2024-04-25T15:58:16.056 INFO:tasks.workunit.client.0.smithi087.stdout:8/904: dwrite d4/f65 [0,4194304] 0 2024-04-25T15:58:16.057 INFO:tasks.workunit.client.0.smithi087.stdout:5/830: creat d9/d2f/f113 x:0 0 0 2024-04-25T15:58:16.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/831: read - d9/d2f/d40/fcb zero size 2024-04-25T15:58:16.061 INFO:tasks.workunit.client.0.smithi087.stdout:3/772: rename d4/d17/d24/d29/d58/dac/dc0/d82/d8c to d4/d17/d81/da6/d53/d68/de4/dd3/dec 0 2024-04-25T15:58:16.063 INFO:tasks.workunit.client.0.smithi087.stdout:5/832: mkdir d9/d2f/d3b/d114 0 2024-04-25T15:58:16.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/773: read d4/d17/f63 [110626,2273] 0 2024-04-25T15:58:16.069 INFO:tasks.workunit.client.0.smithi087.stdout:5/833: symlink d9/d91/d30/d70/d79/l115 0 2024-04-25T15:58:16.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/998: dwrite d7/d1a/d1d/d21/d27/d2c/d35/d45/dca/d107/f152 [0,4194304] 0 2024-04-25T15:58:16.072 INFO:tasks.workunit.client.0.smithi087.stdout:3/774: creat d4/d17/d24/d29/fed x:0 0 0 2024-04-25T15:58:16.073 INFO:tasks.workunit.client.0.smithi087.stdout:2/827: truncate d3/d27/d29/d4f/d5a/d6a/d88/fc9 2372327 0 2024-04-25T15:58:16.074 INFO:tasks.workunit.client.0.smithi087.stdout:7/600: dwrite d1/d3c/f64 [0,4194304] 0 2024-04-25T15:58:16.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/999: fsync d7/d1a/f51 0 2024-04-25T15:58:16.076 INFO:tasks.workunit.client.0.smithi087.stdout:2/828: read d3/d27/d38/f74 [654838,79926] 0 2024-04-25T15:58:16.078 INFO:tasks.workunit.client.0.smithi087.stdout:2/829: write d3/d27/d29/d2d/d40/f9c [881601,20999] 0 2024-04-25T15:58:16.079 INFO:tasks.workunit.client.0.smithi087.stdout:3/775: creat d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fee x:0 0 0 2024-04-25T15:58:16.080 INFO:tasks.workunit.client.0.smithi087.stdout:2/830: fsync d3/d27/f39 0 2024-04-25T15:58:16.086 INFO:tasks.workunit.client.0.smithi087.stdout:7/601: dwrite d1/d4/d18/d36/d5d/f8d [0,4194304] 0 2024-04-25T15:58:16.087 INFO:tasks.workunit.client.0.smithi087.stdout:3/776: mkdir d4/d17/d24/d29/d58/dac/d99/def 0 2024-04-25T15:58:16.089 INFO:tasks.workunit.client.0.smithi087.stdout:2/831: fsync d3/dce/fd0 0 2024-04-25T15:58:16.090 INFO:tasks.workunit.client.0.smithi087.stdout:5/834: dwrite d9/d2f/d40/d4d/f57 [0,4194304] 0 2024-04-25T15:58:16.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/777: fsync d4/db/f4d 0 2024-04-25T15:58:16.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/835: chown d9/d2f/d40/d4d/d7b/d5c/d5f 40 1 2024-04-25T15:58:16.098 INFO:tasks.workunit.client.0.smithi087.stdout:2/832: read d3/d27/d29/d2d/d40/f68 [1691295,3622] 0 2024-04-25T15:58:16.100 INFO:tasks.workunit.client.0.smithi087.stdout:7/602: dwrite d1/d4/d18/d36/fb4 [0,4194304] 0 2024-04-25T15:58:16.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/836: mkdir d9/d91/d30/d56/d101/d116 0 2024-04-25T15:58:16.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/778: rename d4/d17/d81/da6/d53/l9a to d4/d17/d81/da6/d53/d68/de4/dd3/dec/lf0 0 2024-04-25T15:58:16.110 INFO:tasks.workunit.client.0.smithi087.stdout:2/833: mknod d3/d27/c105 0 2024-04-25T15:58:16.110 INFO:tasks.workunit.client.0.smithi087.stdout:2/834: read d3/d27/d38/fa1 [3431562,71098] 0 2024-04-25T15:58:16.110 INFO:tasks.workunit.client.0.smithi087.stdout:2/835: chown d3/f101 100220 1 2024-04-25T15:58:16.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/779: creat d4/d17/d81/da6/d53/d68/ff1 x:0 0 0 2024-04-25T15:58:16.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/836: mkdir d3/d27/d38/d106 0 2024-04-25T15:58:16.114 INFO:tasks.workunit.client.0.smithi087.stdout:2/837: fdatasync d3/d27/d38/fdf 0 2024-04-25T15:58:16.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/837: rmdir d9/d2f/d3b/d114 0 2024-04-25T15:58:16.116 INFO:tasks.workunit.client.0.smithi087.stdout:7/603: creat d1/d3c/fc1 x:0 0 0 2024-04-25T15:58:16.120 INFO:tasks.workunit.client.0.smithi087.stdout:2/838: unlink d3/d2a/d48/d77/cef 0 2024-04-25T15:58:16.121 INFO:tasks.workunit.client.0.smithi087.stdout:5/838: mknod d9/d91/c117 0 2024-04-25T15:58:16.124 INFO:tasks.workunit.client.0.smithi087.stdout:7/604: link d1/d9f/fb9 d1/d9/d26/d45/fc2 0 2024-04-25T15:58:16.129 INFO:tasks.workunit.client.0.smithi087.stdout:5/839: dwrite d9/d91/d30/d70/d79/fe9 [0,4194304] 0 2024-04-25T15:58:16.130 INFO:tasks.workunit.client.0.smithi087.stdout:3/780: write d4/d17/d24/d29/d58/dac/dc0/d82/f93 [481285,90894] 0 2024-04-25T15:58:16.136 INFO:tasks.workunit.client.0.smithi087.stdout:2/839: dwrite d3/d27/d29/f73 [4194304,4194304] 0 2024-04-25T15:58:16.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/929: sync 2024-04-25T15:58:16.139 INFO:tasks.workunit.client.0.smithi087.stdout:1/873: sync 2024-04-25T15:58:16.144 INFO:tasks.workunit.client.0.smithi087.stdout:7/605: dwrite d1/d9/d26/d45/f4b [0,4194304] 0 2024-04-25T15:58:16.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/930: chown d1/d6/d77/l9a 23 1 2024-04-25T15:58:16.147 INFO:tasks.workunit.client.0.smithi087.stdout:5/840: dwrite d9/d99/fbd [0,4194304] 0 2024-04-25T15:58:16.147 INFO:tasks.workunit.client.0.smithi087.stdout:3/781: link d4/c2d d4/d17/d24/d29/d58/dac/d99/cf2 0 2024-04-25T15:58:16.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/606: symlink d1/d3c/da3/lc3 0 2024-04-25T15:58:16.151 INFO:tasks.workunit.client.0.smithi087.stdout:2/840: getdents d3/d27/d29/d2d/d40 0 2024-04-25T15:58:16.153 INFO:tasks.workunit.client.0.smithi087.stdout:1/874: getdents d3/d12/d39 0 2024-04-25T15:58:16.155 INFO:tasks.workunit.client.0.smithi087.stdout:5/841: creat d9/d91/d30/d70/d79/dae/de4/f118 x:0 0 0 2024-04-25T15:58:16.156 INFO:tasks.workunit.client.0.smithi087.stdout:2/841: stat d3/d20/d4a/fcd 0 2024-04-25T15:58:16.157 INFO:tasks.workunit.client.0.smithi087.stdout:7/607: write d1/d4/d18/d36/fa8 [363266,57968] 0 2024-04-25T15:58:16.157 INFO:tasks.workunit.client.0.smithi087.stdout:3/782: creat d4/d17/d81/da6/d53/d68/de4/dd3/ff3 x:0 0 0 2024-04-25T15:58:16.158 INFO:tasks.workunit.client.0.smithi087.stdout:5/842: dread - d9/d91/d38/ded/fdc zero size 2024-04-25T15:58:16.160 INFO:tasks.workunit.client.0.smithi087.stdout:2/842: creat d3/d2a/d48/d77/f107 x:0 0 0 2024-04-25T15:58:16.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/608: mknod d1/d4/cc4 0 2024-04-25T15:58:16.162 INFO:tasks.workunit.client.0.smithi087.stdout:7/609: write d1/d4/fba [576114,43941] 0 2024-04-25T15:58:16.163 INFO:tasks.workunit.client.0.smithi087.stdout:5/843: symlink d9/d2f/d40/d4d/d7b/d5c/l119 0 2024-04-25T15:58:16.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/844: fdatasync d9/d2f/d40/fcb 0 2024-04-25T15:58:16.164 INFO:tasks.workunit.client.0.smithi087.stdout:2/843: creat d3/d27/d29/d4f/d5a/d6a/d88/d94/f108 x:0 0 0 2024-04-25T15:58:16.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/844: symlink d3/d2a/d1c/l109 0 2024-04-25T15:58:16.168 INFO:tasks.workunit.client.0.smithi087.stdout:2/845: creat d3/d2a/d1c/f10a x:0 0 0 2024-04-25T15:58:16.169 INFO:tasks.workunit.client.0.smithi087.stdout:2/846: symlink d3/d2a/d1c/l10b 0 2024-04-25T15:58:16.172 INFO:tasks.workunit.client.0.smithi087.stdout:2/847: mkdir d3/d27/d38/d10c 0 2024-04-25T15:58:16.172 INFO:tasks.workunit.client.0.smithi087.stdout:5/845: dread d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f50 [0,4194304] 0 2024-04-25T15:58:16.179 INFO:tasks.workunit.client.0.smithi087.stdout:7/610: write d1/f8 [556538,34982] 0 2024-04-25T15:58:16.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/848: dread d3/d20/f46 [0,4194304] 0 2024-04-25T15:58:16.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/931: dwrite d1/d6/d21/f129 [0,4194304] 0 2024-04-25T15:58:16.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/846: rename d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/d107/f10e to d9/d2f/d40/d4d/d7b/d74/f11a 0 2024-04-25T15:58:16.184 INFO:tasks.workunit.client.0.smithi087.stdout:2/849: readlink d3/d2a/d81/d93/l97 0 2024-04-25T15:58:16.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/804: sync 2024-04-25T15:58:16.188 INFO:tasks.workunit.client.0.smithi087.stdout:4/875: sync 2024-04-25T15:58:16.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/875: dwrite d3/d12/d4d/f51 [0,4194304] 0 2024-04-25T15:58:16.188 INFO:tasks.workunit.client.0.smithi087.stdout:3/783: dwrite d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f64 [0,4194304] 0 2024-04-25T15:58:16.190 INFO:tasks.workunit.client.0.smithi087.stdout:5/847: chown d9/d91/d30/d70/d79/dae/fbc 1519 1 2024-04-25T15:58:16.190 INFO:tasks.workunit.client.0.smithi087.stdout:2/850: truncate d3/f101 823922 0 2024-04-25T15:58:16.193 INFO:tasks.workunit.client.0.smithi087.stdout:0/932: creat d1/d6/d112/d7d/f132 x:0 0 0 2024-04-25T15:58:16.194 INFO:tasks.workunit.client.0.smithi087.stdout:9/805: symlink d6/d3e/d63/dc2/l103 0 2024-04-25T15:58:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:5/848: mkdir d9/d2f/d11b 0 2024-04-25T15:58:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/933: write d1/d6/d112/d7d/f113 [294406,37759] 0 2024-04-25T15:58:16.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/851: fsync d3/d27/d29/d4f/d5a/d6a/d88/d94/fad 0 2024-04-25T15:58:16.202 INFO:tasks.workunit.client.0.smithi087.stdout:4/876: truncate d4/d10/d60/d5c/d3a/d90/fb2 940388 0 2024-04-25T15:58:16.203 INFO:tasks.workunit.client.0.smithi087.stdout:9/806: write d6/d8/d12/db7/f3f [508336,53636] 0 2024-04-25T15:58:16.206 INFO:tasks.workunit.client.0.smithi087.stdout:3/784: getdents d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/de5 0 2024-04-25T15:58:16.209 INFO:tasks.workunit.client.0.smithi087.stdout:0/934: creat d1/d6/d77/dc6/df3/f133 x:0 0 0 2024-04-25T15:58:16.209 INFO:tasks.workunit.client.0.smithi087.stdout:7/611: dwrite d1/d9/f65 [8388608,4194304] 0 2024-04-25T15:58:16.209 INFO:tasks.workunit.client.0.smithi087.stdout:5/849: creat d9/d91/f11c x:0 0 0 2024-04-25T15:58:16.215 INFO:tasks.workunit.client.0.smithi087.stdout:4/877: creat d4/d10/d60/d56/d61/d3f/d42/d100/f11e x:0 0 0 2024-04-25T15:58:16.221 INFO:tasks.workunit.client.0.smithi087.stdout:5/850: mkdir d9/d2f/d40/d4d/d7b/d5c/d11d 0 2024-04-25T15:58:16.221 INFO:tasks.workunit.client.0.smithi087.stdout:2/852: dwrite d3/d2a/d48/d77/d79/d85/fc1 [0,4194304] 0 2024-04-25T15:58:16.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/935: dread d1/de9/f108 [0,4194304] 0 2024-04-25T15:58:16.227 INFO:tasks.workunit.client.0.smithi087.stdout:9/807: dwrite d6/d8/d12/db7/d3a/d58/f71 [0,4194304] 0 2024-04-25T15:58:16.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/876: dread d3/d12/d14/d29/d2f/f63 [0,4194304] 0 2024-04-25T15:58:16.232 INFO:tasks.workunit.client.0.smithi087.stdout:2/853: creat d3/d2a/d1c/f10d x:0 0 0 2024-04-25T15:58:16.234 INFO:tasks.workunit.client.0.smithi087.stdout:7/612: dwrite d1/d1a/f85 [0,4194304] 0 2024-04-25T15:58:16.235 INFO:tasks.workunit.client.0.smithi087.stdout:8/905: sync 2024-04-25T15:58:16.237 INFO:tasks.workunit.client.0.smithi087.stdout:4/878: creat d4/d10/d60/d11a/f11f x:0 0 0 2024-04-25T15:58:16.241 INFO:tasks.workunit.client.0.smithi087.stdout:5/851: mknod d9/d2f/d40/d4d/d7b/d5c/dc7/c11e 0 2024-04-25T15:58:16.241 INFO:tasks.workunit.client.0.smithi087.stdout:3/785: dwrite d4/d17/f74 [0,4194304] 0 2024-04-25T15:58:16.243 INFO:tasks.workunit.client.0.smithi087.stdout:7/613: fdatasync d1/f19 0 2024-04-25T15:58:16.244 INFO:tasks.workunit.client.0.smithi087.stdout:5/852: readlink d9/d91/d30/d56/l8b 0 2024-04-25T15:58:16.245 INFO:tasks.workunit.client.0.smithi087.stdout:7/614: chown d1/d4/d7e/cad 269815 1 2024-04-25T15:58:16.245 INFO:tasks.workunit.client.0.smithi087.stdout:5/853: chown d9/d91/fe0 1522 1 2024-04-25T15:58:16.246 INFO:tasks.workunit.client.0.smithi087.stdout:1/877: creat d3/d12/d14/d29/d8e/f12e x:0 0 0 2024-04-25T15:58:16.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/936: dwrite d1/d6/f36 [0,4194304] 0 2024-04-25T15:58:16.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/786: write d4/d17/d81/da6/d53/d68/de4/dd3/ff3 [457186,44295] 0 2024-04-25T15:58:16.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/615: write d1/d3c/f64 [4624995,6126] 0 2024-04-25T15:58:16.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/937: fdatasync d1/f96 0 2024-04-25T15:58:16.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/808: mkdir d6/d8/d12/db7/d3a/d5b/d60/dcd/d104 0 2024-04-25T15:58:16.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/879: mknod d4/d87/c120 0 2024-04-25T15:58:16.250 INFO:tasks.workunit.client.0.smithi087.stdout:7/616: stat d1/d4/d18/d98 0 2024-04-25T15:58:16.253 INFO:tasks.workunit.client.0.smithi087.stdout:5/854: chown d9/d91/d30/cb1 170981236 1 2024-04-25T15:58:16.256 INFO:tasks.workunit.client.0.smithi087.stdout:5/855: readlink d9/d2f/d40/d4d/d7b/d5c/d5f/l4f 0 2024-04-25T15:58:16.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/809: read d6/d8/d12/db7/d3a/d5b/d60/d1d/f39 [2392555,69191] 0 2024-04-25T15:58:16.257 INFO:tasks.workunit.client.0.smithi087.stdout:8/906: rename d4/d22/d43/d7f/dc6/ddc/da0 to d4/d1d/d17/d37/d127 0 2024-04-25T15:58:16.259 INFO:tasks.workunit.client.0.smithi087.stdout:1/878: creat d3/d12/d14/d29/d2f/d53/dca/df1/dff/f12f x:0 0 0 2024-04-25T15:58:16.260 INFO:tasks.workunit.client.0.smithi087.stdout:2/854: getdents d3/d27/d29/d2d/d40/d95 0 2024-04-25T15:58:16.260 INFO:tasks.workunit.client.0.smithi087.stdout:5/856: dread - d9/d2f/d40/fc5 zero size 2024-04-25T15:58:16.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/879: fdatasync d3/d12/d14/d29/d65/d97/fb8 0 2024-04-25T15:58:16.270 INFO:tasks.workunit.client.0.smithi087.stdout:9/810: creat d6/dea/f105 x:0 0 0 2024-04-25T15:58:16.271 INFO:tasks.workunit.client.0.smithi087.stdout:2/855: mkdir d3/d27/d29/d2d/d10e 0 2024-04-25T15:58:16.272 INFO:tasks.workunit.client.0.smithi087.stdout:8/907: mknod d4/d22/c128 0 2024-04-25T15:58:16.273 INFO:tasks.workunit.client.0.smithi087.stdout:3/787: dwrite d4/d17/d81/da6/d53/f88 [0,4194304] 0 2024-04-25T15:58:16.275 INFO:tasks.workunit.client.0.smithi087.stdout:4/880: dwrite d4/d10/d60/d56/d61/d3f/d58/f83 [4194304,4194304] 0 2024-04-25T15:58:16.276 INFO:tasks.workunit.client.0.smithi087.stdout:2/856: fdatasync d3/d2a/d81/ff8 0 2024-04-25T15:58:16.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/938: dread d1/da/d3e/d54/d34/d55/fad [0,4194304] 0 2024-04-25T15:58:16.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/811: dread d6/d8/d12/db7/d3a/d58/f71 [0,4194304] 0 2024-04-25T15:58:16.293 INFO:tasks.workunit.client.0.smithi087.stdout:5/857: mkdir d9/d2f/d40/d4d/d7b/d8f/d11f 0 2024-04-25T15:58:16.294 INFO:tasks.workunit.client.0.smithi087.stdout:7/617: dread d1/d9/d26/f38 [0,4194304] 0 2024-04-25T15:58:16.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/858: fsync d9/d91/f11c 0 2024-04-25T15:58:16.295 INFO:tasks.workunit.client.0.smithi087.stdout:7/618: chown d1/d3c/l89 1526 1 2024-04-25T15:58:16.295 INFO:tasks.workunit.client.0.smithi087.stdout:3/788: mknod d4/d17/d81/da6/d53/d7d/cf4 0 2024-04-25T15:58:16.297 INFO:tasks.workunit.client.0.smithi087.stdout:2/857: creat d3/d27/d29/d2d/d40/d95/f10f x:0 0 0 2024-04-25T15:58:16.300 INFO:tasks.workunit.client.0.smithi087.stdout:9/812: mknod d6/d3e/d63/dc2/c106 0 2024-04-25T15:58:16.303 INFO:tasks.workunit.client.0.smithi087.stdout:5/859: rename d9/d2f/d40/d4d/c7c to d9/d2f/d40/d4d/d7b/d5c/d11d/c120 0 2024-04-25T15:58:16.304 INFO:tasks.workunit.client.0.smithi087.stdout:5/860: fdatasync d9/d91/d30/d70/d79/dae/de4/fe6 0 2024-04-25T15:58:16.305 INFO:tasks.workunit.client.0.smithi087.stdout:2/858: creat d3/d2a/d48/d83/f110 x:0 0 0 2024-04-25T15:58:16.306 INFO:tasks.workunit.client.0.smithi087.stdout:4/881: mkdir d4/d10/d60/d5c/d3a/dd4/d121 0 2024-04-25T15:58:16.308 INFO:tasks.workunit.client.0.smithi087.stdout:3/789: truncate d4/d17/d24/d29/d58/dac/dc0/d5c/f77 1135923 0 2024-04-25T15:58:16.309 INFO:tasks.workunit.client.0.smithi087.stdout:8/908: dread d4/d1d/de1/da6/fcc [0,4194304] 0 2024-04-25T15:58:16.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/813: creat d6/d8/d32/d4c/f107 x:0 0 0 2024-04-25T15:58:16.313 INFO:tasks.workunit.client.0.smithi087.stdout:2/859: mkdir d3/d27/d29/d4f/d5a/d6a/d88/de7/d111 0 2024-04-25T15:58:16.315 INFO:tasks.workunit.client.0.smithi087.stdout:1/880: getdents d3/d12/d14/d33/dee 0 2024-04-25T15:58:16.316 INFO:tasks.workunit.client.0.smithi087.stdout:4/882: dwrite d4/d10/d60/d52/fba [0,4194304] 0 2024-04-25T15:58:16.317 INFO:tasks.workunit.client.0.smithi087.stdout:1/881: chown d3/d12/d39/d64/l94 523615 1 2024-04-25T15:58:16.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/909: unlink d4/f84 0 2024-04-25T15:58:16.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/910: readlink d4/l5c 0 2024-04-25T15:58:16.322 INFO:tasks.workunit.client.0.smithi087.stdout:3/790: mknod d4/d17/d24/d29/da8/cf5 0 2024-04-25T15:58:16.322 INFO:tasks.workunit.client.0.smithi087.stdout:8/911: read d4/d1d/d7c/f23 [1668405,103753] 0 2024-04-25T15:58:16.324 INFO:tasks.workunit.client.0.smithi087.stdout:4/883: write d4/d10/d60/d56/fb5 [4104739,66297] 0 2024-04-25T15:58:16.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/619: link d1/f19 d1/d3c/fc5 0 2024-04-25T15:58:16.325 INFO:tasks.workunit.client.0.smithi087.stdout:5/861: link d9/d91/d30/d56/d101/f10d d9/d2f/d11b/f121 0 2024-04-25T15:58:16.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/912: fsync d4/d1d/de1/d82/fb2 0 2024-04-25T15:58:16.327 INFO:tasks.workunit.client.0.smithi087.stdout:2/860: dwrite d3/d27/d29/d4f/d5a/d6a/ff9 [0,4194304] 0 2024-04-25T15:58:16.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/913: fsync d4/d22/d43/d7f/f99 0 2024-04-25T15:58:16.336 INFO:tasks.workunit.client.0.smithi087.stdout:7/620: readlink d1/d9/d8e/l9e 0 2024-04-25T15:58:16.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/861: unlink d3/d20/f46 0 2024-04-25T15:58:16.342 INFO:tasks.workunit.client.0.smithi087.stdout:2/862: chown d3/d27/d29/d4f/d5a/d6a/ff9 5125 1 2024-04-25T15:58:16.344 INFO:tasks.workunit.client.0.smithi087.stdout:2/863: dread - d3/d2a/d1c/f10d zero size 2024-04-25T15:58:16.346 INFO:tasks.workunit.client.0.smithi087.stdout:2/864: chown d3/d27/d29/d4f/d5a/d6a/cc6 2451 1 2024-04-25T15:58:16.348 INFO:tasks.workunit.client.0.smithi087.stdout:5/862: mknod d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/d107/c122 0 2024-04-25T15:58:16.350 INFO:tasks.workunit.client.0.smithi087.stdout:2/865: write d3/d2a/f8f [1448391,87583] 0 2024-04-25T15:58:16.353 INFO:tasks.workunit.client.0.smithi087.stdout:9/814: link d6/d8/d12/db7/d3a/d5b/d60/d1d/l24 d6/d8/d12/db7/d3a/d58/d72/l108 0 2024-04-25T15:58:16.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/815: fdatasync d6/d8/d12/f37 0 2024-04-25T15:58:16.361 INFO:tasks.workunit.client.0.smithi087.stdout:9/816: chown d6/d8/d12/db7/f3f 54293706 1 2024-04-25T15:58:16.361 INFO:tasks.workunit.client.0.smithi087.stdout:1/882: getdents d3 0 2024-04-25T15:58:16.362 INFO:tasks.workunit.client.0.smithi087.stdout:5/863: symlink d9/d91/d30/d70/l123 0 2024-04-25T15:58:16.363 INFO:tasks.workunit.client.0.smithi087.stdout:2/866: mkdir d3/d20/d4a/d47/d112 0 2024-04-25T15:58:16.366 INFO:tasks.workunit.client.0.smithi087.stdout:0/939: dwrite d1/d6/f4d [0,4194304] 0 2024-04-25T15:58:16.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/914: symlink d4/d9c/d123/l129 0 2024-04-25T15:58:16.366 INFO:tasks.workunit.client.0.smithi087.stdout:3/791: creat d4/d17/d24/d29/d58/dac/dc0/ff6 x:0 0 0 2024-04-25T15:58:16.367 INFO:tasks.workunit.client.0.smithi087.stdout:1/883: chown d3/d12/d14/f27 16621 1 2024-04-25T15:58:16.368 INFO:tasks.workunit.client.0.smithi087.stdout:7/621: fdatasync d1/d4/f10 0 2024-04-25T15:58:16.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/792: fsync d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fc7 0 2024-04-25T15:58:16.378 INFO:tasks.workunit.client.0.smithi087.stdout:2/867: dread d3/f101 [0,4194304] 0 2024-04-25T15:58:16.382 INFO:tasks.workunit.client.0.smithi087.stdout:7/622: chown d1/d1a/f50 88750 1 2024-04-25T15:58:16.383 INFO:tasks.workunit.client.0.smithi087.stdout:9/817: dwrite d6/dea/f105 [0,4194304] 0 2024-04-25T15:58:16.386 INFO:tasks.workunit.client.0.smithi087.stdout:9/818: dread - d6/d3e/fc4 zero size 2024-04-25T15:58:16.388 INFO:tasks.workunit.client.0.smithi087.stdout:1/884: symlink d3/d12/d14/d29/d67/l130 0 2024-04-25T15:58:16.390 INFO:tasks.workunit.client.0.smithi087.stdout:9/819: dread - d6/d8/d12/db7/d3a/d5b/d60/d1d/ff9 zero size 2024-04-25T15:58:16.390 INFO:tasks.workunit.client.0.smithi087.stdout:0/940: creat d1/d6/d21/d2a/dd5/d12d/f134 x:0 0 0 2024-04-25T15:58:16.391 INFO:tasks.workunit.client.0.smithi087.stdout:2/868: rmdir d3/d20/d4a/d8e 39 2024-04-25T15:58:16.392 INFO:tasks.workunit.client.0.smithi087.stdout:7/623: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:16.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/915: creat d4/d9c/f12a x:0 0 0 2024-04-25T15:58:16.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/864: fsync d9/d2f/d40/d4d/d58/fca 0 2024-04-25T15:58:16.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/820: mknod d6/dea/c109 0 2024-04-25T15:58:16.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/941: creat d1/d6/d21/d2a/dd5/f135 x:0 0 0 2024-04-25T15:58:16.402 INFO:tasks.workunit.client.0.smithi087.stdout:7/624: dwrite d1/d3c/f58 [4194304,4194304] 0 2024-04-25T15:58:16.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/916: dwrite d4/d8/dd/d85/dbc/dd2/f103 [0,4194304] 0 2024-04-25T15:58:16.409 INFO:tasks.workunit.client.0.smithi087.stdout:2/869: rename d3/d27/d29/d2d/d40/d95/f10f to d3/d27/d29/d4f/d5a/d6a/d88/d94/f113 0 2024-04-25T15:58:16.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/865: mknod d9/d2f/d40/d4d/d58/df1/c124 0 2024-04-25T15:58:16.412 INFO:tasks.workunit.client.0.smithi087.stdout:1/885: truncate d3/d12/d14/d29/d2f/d40/f54 841810 0 2024-04-25T15:58:16.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/793: getdents d4/d17/d81/da6/d53/d68/de4 0 2024-04-25T15:58:16.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/917: symlink d4/d1d/de1/l12b 0 2024-04-25T15:58:16.416 INFO:tasks.workunit.client.0.smithi087.stdout:0/942: dwrite d1/d6/f8 [4194304,4194304] 0 2024-04-25T15:58:16.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/625: dwrite d1/d9/d26/d45/f61 [4194304,4194304] 0 2024-04-25T15:58:16.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/943: symlink d1/da/d3e/d85/d9b/d124/l136 0 2024-04-25T15:58:16.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/944: stat d1/da/d3e/d54/d34/fc2 0 2024-04-25T15:58:16.426 INFO:tasks.workunit.client.0.smithi087.stdout:2/870: creat d3/d27/d29/d4f/d5a/d6a/d88/de7/de5/f114 x:0 0 0 2024-04-25T15:58:16.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/866: creat d9/d91/f125 x:0 0 0 2024-04-25T15:58:16.427 INFO:tasks.workunit.client.0.smithi087.stdout:7/626: stat d1/f19 0 2024-04-25T15:58:16.428 INFO:tasks.workunit.client.0.smithi087.stdout:8/918: symlink d4/d22/d43/ddd/l12c 0 2024-04-25T15:58:16.430 INFO:tasks.workunit.client.0.smithi087.stdout:2/871: write d3/d27/d38/fdf [537483,7408] 0 2024-04-25T15:58:16.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/945: rmdir d1/da/d3e/d85/d9b/dcd 39 2024-04-25T15:58:16.434 INFO:tasks.workunit.client.0.smithi087.stdout:0/946: chown d1/da/d3e/c95 220668 1 2024-04-25T15:58:16.434 INFO:tasks.workunit.client.0.smithi087.stdout:5/867: fdatasync d9/d91/d38/fd9 0 2024-04-25T15:58:16.434 INFO:tasks.workunit.client.0.smithi087.stdout:8/919: mkdir d4/d1d/d17/d37/d127/d12d 0 2024-04-25T15:58:16.434 INFO:tasks.workunit.client.0.smithi087.stdout:3/794: dwrite d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fc7 [0,4194304] 0 2024-04-25T15:58:16.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/886: link d3/d12/d14/d29/d2f/d61/lfa d3/d12/d39/l131 0 2024-04-25T15:58:16.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/947: readlink d1/da/d3e/d85/lbb 0 2024-04-25T15:58:16.436 INFO:tasks.workunit.client.0.smithi087.stdout:8/920: write d4/f65 [2950563,119489] 0 2024-04-25T15:58:16.436 INFO:tasks.workunit.client.0.smithi087.stdout:5/868: dread - d9/d2f/d40/d4d/de1/ffa zero size 2024-04-25T15:58:16.440 INFO:tasks.workunit.client.0.smithi087.stdout:1/887: creat d3/f132 x:0 0 0 2024-04-25T15:58:16.441 INFO:tasks.workunit.client.0.smithi087.stdout:0/948: mknod d1/de9/c137 0 2024-04-25T15:58:16.443 INFO:tasks.workunit.client.0.smithi087.stdout:2/872: rename d3/d20/d4a/d8e to d3/d20/d4a/d47/d112/d115 0 2024-04-25T15:58:16.447 INFO:tasks.workunit.client.0.smithi087.stdout:0/949: fdatasync d1/d6/d77/f7e 0 2024-04-25T15:58:16.448 INFO:tasks.workunit.client.0.smithi087.stdout:7/627: dwrite d1/d4/da5/fa6 [8388608,4194304] 0 2024-04-25T15:58:16.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/628: readlink d1/d3c/lbf 0 2024-04-25T15:58:16.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/795: dwrite d4/d17/d24/d29/d58/f95 [0,4194304] 0 2024-04-25T15:58:16.455 INFO:tasks.workunit.client.0.smithi087.stdout:8/921: dwrite d4/d8/dd/d2f/d6f/f104 [0,4194304] 0 2024-04-25T15:58:16.457 INFO:tasks.workunit.client.0.smithi087.stdout:5/869: dwrite d9/f12 [0,4194304] 0 2024-04-25T15:58:16.458 INFO:tasks.workunit.client.0.smithi087.stdout:8/922: readlink d4/d22/l8b 0 2024-04-25T15:58:16.459 INFO:tasks.workunit.client.0.smithi087.stdout:0/950: symlink d1/d4f/de3/df5/d10f/l138 0 2024-04-25T15:58:16.462 INFO:tasks.workunit.client.0.smithi087.stdout:3/796: write d4/d17/d81/da6/d23/f7c [183290,84838] 0 2024-04-25T15:58:16.463 INFO:tasks.workunit.client.0.smithi087.stdout:8/923: rmdir d4/d8/dd/d85/d86 39 2024-04-25T15:58:16.466 INFO:tasks.workunit.client.0.smithi087.stdout:2/873: getdents d3/d27/d29/d4f 0 2024-04-25T15:58:16.468 INFO:tasks.workunit.client.0.smithi087.stdout:3/797: unlink d4/d17/d24/d29/da8/cf5 0 2024-04-25T15:58:16.470 INFO:tasks.workunit.client.0.smithi087.stdout:7/629: dwrite d1/d4/d18/d36/fa8 [0,4194304] 0 2024-04-25T15:58:16.473 INFO:tasks.workunit.client.0.smithi087.stdout:8/924: symlink d4/d8/dd/d85/l12e 0 2024-04-25T15:58:16.475 INFO:tasks.workunit.client.0.smithi087.stdout:0/951: dwrite d1/d6/d112/d7d/f132 [0,4194304] 0 2024-04-25T15:58:16.476 INFO:tasks.workunit.client.0.smithi087.stdout:3/798: unlink d4/d17/f1e 0 2024-04-25T15:58:16.477 INFO:tasks.workunit.client.0.smithi087.stdout:3/799: dread - d4/d17/d81/da6/d37/d51/fce zero size 2024-04-25T15:58:16.479 INFO:tasks.workunit.client.0.smithi087.stdout:3/800: write d4/d17/d24/d29/d58/fcd [841438,97899] 0 2024-04-25T15:58:16.479 INFO:tasks.workunit.client.0.smithi087.stdout:2/874: link d3/d20/f7f d3/f116 0 2024-04-25T15:58:16.480 INFO:tasks.workunit.client.0.smithi087.stdout:7/630: creat d1/d3c/d6b/fc6 x:0 0 0 2024-04-25T15:58:16.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/875: readlink d3/d2a/d48/d83/lac 0 2024-04-25T15:58:16.481 INFO:tasks.workunit.client.0.smithi087.stdout:8/925: creat d4/d8/dd/d85/dbc/f12f x:0 0 0 2024-04-25T15:58:16.481 INFO:tasks.workunit.client.0.smithi087.stdout:3/801: dread - d4/d17/d24/d29/d58/dac/f79 zero size 2024-04-25T15:58:16.481 INFO:tasks.workunit.client.0.smithi087.stdout:2/876: chown d3/d27/d29/d4f/l5e 1 1 2024-04-25T15:58:16.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/926: rename d4/d1d to d4/d1d/de1/dee/d130 22 2024-04-25T15:58:16.484 INFO:tasks.workunit.client.0.smithi087.stdout:0/952: creat d1/da/d3e/d54/f139 x:0 0 0 2024-04-25T15:58:16.484 INFO:tasks.workunit.client.0.smithi087.stdout:7/631: mknod d1/d9/d8e/cc7 0 2024-04-25T15:58:16.488 INFO:tasks.workunit.client.0.smithi087.stdout:7/632: symlink d1/d4/d7e/lc8 0 2024-04-25T15:58:16.488 INFO:tasks.workunit.client.0.smithi087.stdout:8/927: dread d4/d22/d43/f61 [0,4194304] 0 2024-04-25T15:58:16.489 INFO:tasks.workunit.client.0.smithi087.stdout:8/928: fdatasync d4/d1d/de1/dee/f100 0 2024-04-25T15:58:16.490 INFO:tasks.workunit.client.0.smithi087.stdout:8/929: readlink d4/d1d/d14/l10a 0 2024-04-25T15:58:16.492 INFO:tasks.workunit.client.0.smithi087.stdout:0/953: mkdir d1/da/d3e/d85/d9b/d13a 0 2024-04-25T15:58:16.493 INFO:tasks.workunit.client.0.smithi087.stdout:7/633: creat d1/d3c/d6b/da1/db1/fc9 x:0 0 0 2024-04-25T15:58:16.494 INFO:tasks.workunit.client.0.smithi087.stdout:2/877: link d3/d27/d29/d2d/d40/l43 d3/d27/d29/d4f/de3/l117 0 2024-04-25T15:58:16.495 INFO:tasks.workunit.client.0.smithi087.stdout:4/884: sync 2024-04-25T15:58:16.496 INFO:tasks.workunit.client.0.smithi087.stdout:3/802: link d4/d17/d24/d29/d58/dac/f76 d4/d17/d24/d29/d58/dac/dc0/ff7 0 2024-04-25T15:58:16.497 INFO:tasks.workunit.client.0.smithi087.stdout:8/930: fsync d4/d8/dd/d2f/d6f/fc4 0 2024-04-25T15:58:16.499 INFO:tasks.workunit.client.0.smithi087.stdout:5/870: dwrite d9/d2f/d40/d4d/de1/fff [0,4194304] 0 2024-04-25T15:58:16.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/878: mknod d3/d2a/d48/d77/db7/c118 0 2024-04-25T15:58:16.503 INFO:tasks.workunit.client.0.smithi087.stdout:5/871: dread - d9/d2f/dbb/dde/f10c zero size 2024-04-25T15:58:16.503 INFO:tasks.workunit.client.0.smithi087.stdout:0/954: getdents d1/d6/d77/d100 0 2024-04-25T15:58:16.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/888: dread d3/d12/d14/d29/d2f/f3f [0,4194304] 0 2024-04-25T15:58:16.561 INFO:tasks.workunit.client.0.smithi087.stdout:0/955: fdatasync d1/da/d3e/d85/d9b/d10a/dba/fdb 0 2024-04-25T15:58:16.561 INFO:tasks.workunit.client.0.smithi087.stdout:1/889: dread - d3/d12/d14/d29/d12d/f125 zero size 2024-04-25T15:58:16.613 INFO:tasks.workunit.client.0.smithi087.stdout:9/821: sync 2024-04-25T15:58:16.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/879: truncate d3/d27/d29/d4f/f5f 3982739 0 2024-04-25T15:58:16.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/956: mknod d1/d6/d21/d2a/dd5/d105/c13b 0 2024-04-25T15:58:16.624 INFO:tasks.workunit.client.0.smithi087.stdout:5/872: getdents d9/d91/d30/d70/d79/d94 0 2024-04-25T15:58:16.628 INFO:tasks.workunit.client.0.smithi087.stdout:2/880: symlink d3/d20/d4a/d47/d112/l119 0 2024-04-25T15:58:16.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/957: write d1/dab/f11e [570520,65045] 0 2024-04-25T15:58:16.634 INFO:tasks.workunit.client.0.smithi087.stdout:7/634: dwrite d1/d3c/fc5 [0,4194304] 0 2024-04-25T15:58:16.636 INFO:tasks.workunit.client.0.smithi087.stdout:9/822: rename d6/d8/d12/db7/d3a/d5b/d60/fa5 to d6/d45/f10a 0 2024-04-25T15:58:16.636 INFO:tasks.workunit.client.0.smithi087.stdout:2/881: stat d3/d2a/f8f 0 2024-04-25T15:58:16.638 INFO:tasks.workunit.client.0.smithi087.stdout:5/873: dread - d9/d91/d30/de2/ff2 zero size 2024-04-25T15:58:16.641 INFO:tasks.workunit.client.0.smithi087.stdout:7/635: readlink d1/d9/d26/d45/l7f 0 2024-04-25T15:58:16.647 INFO:tasks.workunit.client.0.smithi087.stdout:8/931: dread d4/d1d/de1/fb5 [0,4194304] 0 2024-04-25T15:58:16.647 INFO:tasks.workunit.client.0.smithi087.stdout:5/874: stat d9/d91/d30/d70/d82/l9e 0 2024-04-25T15:58:16.647 INFO:tasks.workunit.client.0.smithi087.stdout:5/875: dread - d9/d2f/d40/fcb zero size 2024-04-25T15:58:16.648 INFO:tasks.workunit.client.0.smithi087.stdout:7/636: mknod d1/d4/d18/d36/d5d/cca 0 2024-04-25T15:58:16.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/932: fsync d4/d1d/de1/da6/fcc 0 2024-04-25T15:58:16.661 INFO:tasks.workunit.client.0.smithi087.stdout:1/890: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:16.669 INFO:tasks.workunit.client.0.smithi087.stdout:7/637: truncate d1/d1a/d7b/f7c 988460 0 2024-04-25T15:58:16.679 INFO:tasks.workunit.client.0.smithi087.stdout:4/885: sync 2024-04-25T15:58:16.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/638: chown d1/d4/d18/l6a 29286 1 2024-04-25T15:58:16.683 INFO:tasks.workunit.client.0.smithi087.stdout:9/823: dwrite d6/d8/d12/fbc [0,4194304] 0 2024-04-25T15:58:16.687 INFO:tasks.workunit.client.0.smithi087.stdout:0/958: dwrite d1/d6/f56 [0,4194304] 0 2024-04-25T15:58:16.690 INFO:tasks.workunit.client.0.smithi087.stdout:9/824: stat d6/dce 0 2024-04-25T15:58:16.690 INFO:tasks.workunit.client.0.smithi087.stdout:8/933: truncate d4/d22/d43/d7f/dc6/fd6 1167965 0 2024-04-25T15:58:16.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/876: dwrite d9/d91/d38/f97 [4194304,4194304] 0 2024-04-25T15:58:16.695 INFO:tasks.workunit.client.0.smithi087.stdout:7/639: rename d1/d9/d8e to d1/d9/d8e/dcb 22 2024-04-25T15:58:16.695 INFO:tasks.workunit.client.0.smithi087.stdout:2/882: dwrite d3/d20/d4a/f4c [0,4194304] 0 2024-04-25T15:58:16.698 INFO:tasks.workunit.client.0.smithi087.stdout:8/934: mknod d4/d22/c131 0 2024-04-25T15:58:16.704 INFO:tasks.workunit.client.0.smithi087.stdout:9/825: mkdir d6/d8/d32/d4c/db9/d10b 0 2024-04-25T15:58:16.707 INFO:tasks.workunit.client.0.smithi087.stdout:2/883: rename d3/d27/d29/d2d/ce8 to d3/d2a/d81/d93/c11a 0 2024-04-25T15:58:16.708 INFO:tasks.workunit.client.0.smithi087.stdout:5/877: mknod d9/c126 0 2024-04-25T15:58:16.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/959: mknod d1/d6/db1/dc0/dd3/dff/d50/c13c 0 2024-04-25T15:58:16.711 INFO:tasks.workunit.client.0.smithi087.stdout:9/826: readlink d6/d8/d12/db7/d3a/d58/d72/l108 0 2024-04-25T15:58:16.712 INFO:tasks.workunit.client.0.smithi087.stdout:5/878: fdatasync d9/d91/f11c 0 2024-04-25T15:58:16.713 INFO:tasks.workunit.client.0.smithi087.stdout:8/935: mkdir d4/d22/d132 0 2024-04-25T15:58:16.714 INFO:tasks.workunit.client.0.smithi087.stdout:4/886: dwrite d4/d10/f81 [0,4194304] 0 2024-04-25T15:58:16.714 INFO:tasks.workunit.client.0.smithi087.stdout:1/891: dread d3/d12/d14/f2b [0,4194304] 0 2024-04-25T15:58:16.714 INFO:tasks.workunit.client.0.smithi087.stdout:0/960: truncate d1/ffc 965224 0 2024-04-25T15:58:16.715 INFO:tasks.workunit.client.0.smithi087.stdout:7/640: rmdir d1/d1a/d7b/da4 0 2024-04-25T15:58:16.716 INFO:tasks.workunit.client.0.smithi087.stdout:2/884: creat d3/d20/d4a/d47/f11b x:0 0 0 2024-04-25T15:58:16.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/936: readlink d4/d22/d43/ddd/l12c 0 2024-04-25T15:58:16.722 INFO:tasks.workunit.client.0.smithi087.stdout:4/887: chown d4/d10/d60/d5c/c45 231257 1 2024-04-25T15:58:16.722 INFO:tasks.workunit.client.0.smithi087.stdout:2/885: write d3/d27/d29/d2d/f96 [2007088,90308] 0 2024-04-25T15:58:16.723 INFO:tasks.workunit.client.0.smithi087.stdout:1/892: mkdir d3/d12/d14/d29/d2f/d53/dca/d133 0 2024-04-25T15:58:16.723 INFO:tasks.workunit.client.0.smithi087.stdout:8/937: truncate d4/d1d/d14/fa5 6024321 0 2024-04-25T15:58:16.724 INFO:tasks.workunit.client.0.smithi087.stdout:2/886: stat d3/d2a/d48/d77/db6/dfa/fff 0 2024-04-25T15:58:16.726 INFO:tasks.workunit.client.0.smithi087.stdout:5/879: creat d9/d2f/d40/d4d/d7b/d8f/d11f/f127 x:0 0 0 2024-04-25T15:58:16.727 INFO:tasks.workunit.client.0.smithi087.stdout:9/827: dwrite d6/d8/d48/fb5 [0,4194304] 0 2024-04-25T15:58:16.728 INFO:tasks.workunit.client.0.smithi087.stdout:0/961: rename d1/d6/db1/dc0/dd3/dff/d82 to d1/d6/db1/dc0/d13d 0 2024-04-25T15:58:16.729 INFO:tasks.workunit.client.0.smithi087.stdout:5/880: write d9/d91/d30/d56/f98 [4856422,92240] 0 2024-04-25T15:58:16.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/893: creat d3/d12/d14/f134 x:0 0 0 2024-04-25T15:58:16.736 INFO:tasks.workunit.client.0.smithi087.stdout:8/938: creat d4/d9c/d123/f133 x:0 0 0 2024-04-25T15:58:16.736 INFO:tasks.workunit.client.0.smithi087.stdout:2/887: creat d3/d27/d29/d4f/d5a/d6a/d88/de7/dde/f11c x:0 0 0 2024-04-25T15:58:16.736 INFO:tasks.workunit.client.0.smithi087.stdout:8/939: read - d4/d1d/de1/dee/f100 zero size 2024-04-25T15:58:16.736 INFO:tasks.workunit.client.0.smithi087.stdout:3/803: sync 2024-04-25T15:58:16.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/828: creat d6/d8/d12/db7/d3a/d5b/d60/d7f/f10c x:0 0 0 2024-04-25T15:58:16.740 INFO:tasks.workunit.client.0.smithi087.stdout:4/888: getdents d4/d10/d60/d56 0 2024-04-25T15:58:16.743 INFO:tasks.workunit.client.0.smithi087.stdout:9/829: chown d6/d3e/d63/f79 6 1 2024-04-25T15:58:16.743 INFO:tasks.workunit.client.0.smithi087.stdout:2/888: truncate d3/d20/d4a/d47/f100 913667 0 2024-04-25T15:58:16.744 INFO:tasks.workunit.client.0.smithi087.stdout:8/940: write d4/d1d/d17/d37/dc9/fce [3962210,96049] 0 2024-04-25T15:58:16.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/804: symlink d4/d17/d24/d29/d58/dac/dc0/d5c/lf8 0 2024-04-25T15:58:16.746 INFO:tasks.workunit.client.0.smithi087.stdout:7/641: dread d1/d1a/f6f [0,4194304] 0 2024-04-25T15:58:16.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/894: creat d3/d12/d14/d29/d3b/f135 x:0 0 0 2024-04-25T15:58:16.747 INFO:tasks.workunit.client.0.smithi087.stdout:0/962: dwrite d1/da/d3e/d54/f2b [0,4194304] 0 2024-04-25T15:58:16.751 INFO:tasks.workunit.client.0.smithi087.stdout:5/881: dwrite d9/d91/d38/ded/dd4/f109 [0,4194304] 0 2024-04-25T15:58:16.753 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-04-25T15:58:16.753 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:58:16.753 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T15:58:16.755 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:58:16.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:16.768 INFO:tasks.workunit.client.0.smithi087.stdout:2/889: unlink d3/d20/c69 0 2024-04-25T15:58:16.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/895: readlink d3/d12/d14/d29/d2f/d40/lc5 0 2024-04-25T15:58:16.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/642: creat d1/d3c/daa/fcc x:0 0 0 2024-04-25T15:58:16.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/830: write d6/d8/f89 [1945954,122946] 0 2024-04-25T15:58:16.772 INFO:tasks.workunit.client.0.smithi087.stdout:4/889: truncate d4/d10/d60/d5c/fa5 81803 0 2024-04-25T15:58:16.774 INFO:tasks.workunit.client.0.smithi087.stdout:9/831: chown d6/f1c 54424552 1 2024-04-25T15:58:16.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/882: link d9/d91/f65 d9/d2f/d40/f128 0 2024-04-25T15:58:16.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/963: getdents d1/d4f/de3 0 2024-04-25T15:58:16.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/890: mkdir d4/d10/d60/d5c/d3a/dd4/d121/d122 0 2024-04-25T15:58:16.783 INFO:tasks.workunit.client.0.smithi087.stdout:9/832: creat d6/d8/d12/db7/d3a/d58/d7b/f10d x:0 0 0 2024-04-25T15:58:16.784 INFO:tasks.workunit.client.0.smithi087.stdout:1/896: dread d3/d12/d39/d64/fa2 [0,4194304] 0 2024-04-25T15:58:16.785 INFO:tasks.workunit.client.0.smithi087.stdout:4/891: creat d4/d10/f123 x:0 0 0 2024-04-25T15:58:16.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/643: getdents d1/d3c/daa 0 2024-04-25T15:58:16.788 INFO:tasks.workunit.client.0.smithi087.stdout:9/833: chown d6/d3e/d92/ld9 8029929 1 2024-04-25T15:58:16.788 INFO:tasks.workunit.client.0.smithi087.stdout:5/883: rename d9/d91/f105 to d9/d2f/d40/d4d/d7b/d5c/d5f/de8/f129 0 2024-04-25T15:58:16.790 INFO:tasks.workunit.client.0.smithi087.stdout:2/890: dwrite d3/d27/d29/d4f/d5a/d6a/d88/fa7 [0,4194304] 0 2024-04-25T15:58:16.791 INFO:tasks.workunit.client.0.smithi087.stdout:1/897: rmdir d3/d12/d14 39 2024-04-25T15:58:16.794 INFO:tasks.workunit.client.0.smithi087.stdout:4/892: rmdir d4/d10/d60/d5c/d3a/d90 39 2024-04-25T15:58:16.797 INFO:tasks.workunit.client.0.smithi087.stdout:4/893: write d4/d10/d60/d52/d66/fdf [1494523,16360] 0 2024-04-25T15:58:16.802 INFO:tasks.workunit.client.0.smithi087.stdout:5/884: dwrite d9/d2f/d40/d4d/de1/fff [0,4194304] 0 2024-04-25T15:58:16.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/964: truncate d1/d6/d112/d7d/f113 39873 0 2024-04-25T15:58:16.802 INFO:tasks.workunit.client.0.smithi087.stdout:9/834: read d6/d8/d12/db7/d3a/d5b/d60/f8b [27763,8096] 0 2024-04-25T15:58:16.804 INFO:tasks.workunit.client.0.smithi087.stdout:2/891: mkdir d3/d20/d11d 0 2024-04-25T15:58:16.805 INFO:tasks.workunit.client.0.smithi087.stdout:4/894: mknod d4/d10/d60/d56/d61/d3f/dc7/c124 0 2024-04-25T15:58:16.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/898: mknod d3/d12/d39/de3/c136 0 2024-04-25T15:58:16.807 INFO:tasks.workunit.client.0.smithi087.stdout:7/644: link d1/d4/d18/c59 d1/d3c/daa/ccd 0 2024-04-25T15:58:16.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/895: fdatasync d4/fdb 0 2024-04-25T15:58:16.811 INFO:tasks.workunit.client.0.smithi087.stdout:0/965: creat d1/da/d3e/d85/d9b/d13a/f13e x:0 0 0 2024-04-25T15:58:16.812 INFO:tasks.workunit.client.0.smithi087.stdout:2/892: mknod d3/d27/d29/d4f/d5a/d6a/d88/d94/c11e 0 2024-04-25T15:58:16.812 INFO:tasks.workunit.client.0.smithi087.stdout:4/896: read d4/d10/d60/d56/d61/d3f/d58/d5e/fdd [484346,5139] 0 2024-04-25T15:58:16.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/835: dread d6/d8/d32/f59 [0,4194304] 0 2024-04-25T15:58:16.814 INFO:tasks.workunit.client.0.smithi087.stdout:1/899: rename d3/d12/d4d/da5/f102 to d3/d12/d4d/f137 0 2024-04-25T15:58:16.817 INFO:tasks.workunit.client.0.smithi087.stdout:7/645: symlink d1/d9/d26/lce 0 2024-04-25T15:58:16.820 INFO:tasks.workunit.client.0.smithi087.stdout:2/893: creat d3/d27/d29/d4f/de3/f11f x:0 0 0 2024-04-25T15:58:16.823 INFO:tasks.workunit.client.0.smithi087.stdout:0/966: dwrite d1/d6/d21/d2a/dd5/ff0 [0,4194304] 0 2024-04-25T15:58:16.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/894: chown d3/d27/d29/d4f/f59 1 1 2024-04-25T15:58:16.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/646: chown d1/d9f/f43 120065067 1 2024-04-25T15:58:16.826 INFO:tasks.workunit.client.0.smithi087.stdout:5/885: truncate d9/d2f/d40/d4d/f57 2877759 0 2024-04-25T15:58:16.829 INFO:tasks.workunit.client.0.smithi087.stdout:2/895: fsync d3/d27/d29/d4f/d5a/d6a/ff9 0 2024-04-25T15:58:16.832 INFO:tasks.workunit.client.0.smithi087.stdout:9/836: mkdir d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d102/d10e 0 2024-04-25T15:58:16.832 INFO:tasks.workunit.client.0.smithi087.stdout:0/967: mkdir d1/d6/d21/d2a/dd5/d12d/d13f 0 2024-04-25T15:58:16.833 INFO:tasks.workunit.client.0.smithi087.stdout:5/886: mknod d9/d99/c12a 0 2024-04-25T15:58:16.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/837: chown d6/fa0 63298611 1 2024-04-25T15:58:16.835 INFO:tasks.workunit.client.0.smithi087.stdout:2/896: mknod d3/d27/d29/d2d/d40/c120 0 2024-04-25T15:58:16.836 INFO:tasks.workunit.client.0.smithi087.stdout:7/647: write d1/d9/d26/f30 [1309172,71095] 0 2024-04-25T15:58:16.839 INFO:tasks.workunit.client.0.smithi087.stdout:5/887: write d9/d91/d38/fd1 [855988,65772] 0 2024-04-25T15:58:16.844 INFO:tasks.workunit.client.0.smithi087.stdout:1/900: dwrite d3/d12/d14/d29/d65/fe7 [0,4194304] 0 2024-04-25T15:58:16.848 INFO:tasks.workunit.client.0.smithi087.stdout:4/897: dread d4/d10/d60/d56/d61/d3f/d8a/ffc [0,4194304] 0 2024-04-25T15:58:16.848 INFO:tasks.workunit.client.0.smithi087.stdout:9/838: write d6/d8/d12/db7/d3a/d5b/d60/d81/ffd [824543,29900] 0 2024-04-25T15:58:16.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/901: chown d3/d12/fb5 46817 1 2024-04-25T15:58:16.851 INFO:tasks.workunit.client.0.smithi087.stdout:1/902: rmdir d3/d12/d39 39 2024-04-25T15:58:16.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/968: dwrite d1/da/f64 [4194304,4194304] 0 2024-04-25T15:58:16.852 INFO:tasks.workunit.client.0.smithi087.stdout:7/648: rename d1/d9/d26 to d1/d4/dcf 0 2024-04-25T15:58:16.855 INFO:tasks.workunit.client.0.smithi087.stdout:2/897: truncate d3/d2a/d1c/fbb 1212458 0 2024-04-25T15:58:16.858 INFO:tasks.workunit.client.0.smithi087.stdout:9/839: chown d6/d8/d12/db7/d3a/d5b/d60/d1d/c9e 19 1 2024-04-25T15:58:16.861 INFO:tasks.workunit.client.0.smithi087.stdout:2/898: unlink d3/d2a/d81/ccf 0 2024-04-25T15:58:16.861 INFO:tasks.workunit.client.0.smithi087.stdout:5/888: dwrite d9/d2f/d40/d4d/d7b/f112 [0,4194304] 0 2024-04-25T15:58:16.861 INFO:tasks.workunit.client.0.smithi087.stdout:1/903: chown d3/d2d/cbe 78 1 2024-04-25T15:58:16.863 INFO:tasks.workunit.client.0.smithi087.stdout:2/899: chown d3/d27/d29/d2d/d40/d95/fdb 147043797 1 2024-04-25T15:58:16.864 INFO:tasks.workunit.client.0.smithi087.stdout:2/900: dread - d3/d2a/d1c/f10a zero size 2024-04-25T15:58:16.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/898: creat d4/d10/d60/d56/d61/d3f/d58/d5e/f125 x:0 0 0 2024-04-25T15:58:16.866 INFO:tasks.workunit.client.0.smithi087.stdout:9/840: creat d6/d8/d12/db7/d3a/d5b/d60/d81/f10f x:0 0 0 2024-04-25T15:58:16.866 INFO:tasks.workunit.client.0.smithi087.stdout:5/889: chown d9/d2f/d40/d4d/d7b/d74/d83/ca3 49383 1 2024-04-25T15:58:16.867 INFO:tasks.workunit.client.0.smithi087.stdout:0/969: rename d1/d6/d21/d2a/dd5/ff0 to d1/da/d3e/d85/d9b/d10a/f140 0 2024-04-25T15:58:16.868 INFO:tasks.workunit.client.0.smithi087.stdout:2/901: mkdir d3/d27/d29/d2d/d40/d121 0 2024-04-25T15:58:16.869 INFO:tasks.workunit.client.0.smithi087.stdout:4/899: creat d4/d10/d60/d56/d61/db7/f126 x:0 0 0 2024-04-25T15:58:16.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/890: mknod d9/d2f/d40/c12b 0 2024-04-25T15:58:16.872 INFO:tasks.workunit.client.0.smithi087.stdout:0/970: chown d1/da/d3e/d85/d9b/d10a/dba/ld7 60552 1 2024-04-25T15:58:16.873 INFO:tasks.workunit.client.0.smithi087.stdout:1/904: dwrite d3/d12/d14/d29/d67/f10a [0,4194304] 0 2024-04-25T15:58:16.876 INFO:tasks.workunit.client.0.smithi087.stdout:4/900: symlink d4/d10/d60/d11a/l127 0 2024-04-25T15:58:16.877 INFO:tasks.workunit.client.0.smithi087.stdout:0/971: chown d1/da/d3e/d85/d9b/d10a/dba/fee 1814243476 1 2024-04-25T15:58:16.878 INFO:tasks.workunit.client.0.smithi087.stdout:7/649: truncate d1/d4/dcf/f38 4830567 0 2024-04-25T15:58:16.879 INFO:tasks.workunit.client.0.smithi087.stdout:1/905: write d3/d12/d14/d29/d12d/faf [2944795,88982] 0 2024-04-25T15:58:16.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/891: chown d9/d2f/d40/d4d/d7b/d8f/d11f 18089 1 2024-04-25T15:58:16.882 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-04-25T15:58:16.882 INFO:tasks.workunit.client.0.smithi087.stdout:5/892: chown d9/d91/d38 1957 1 2024-04-25T15:58:16.882 INFO:tasks.workunit.client.0.smithi087.stdout:9/841: dread d6/d8/d12/fbc [0,4194304] 0 2024-04-25T15:58:16.885 INFO:tasks.workunit.client.0.smithi087.stdout:2/902: dwrite d3/d2a/d48/d77/db6/dfa/fff [0,4194304] 0 2024-04-25T15:58:16.888 INFO:tasks.workunit.client.0.smithi087.stdout:1/906: chown d3/le 3122627 1 2024-04-25T15:58:16.888 INFO:tasks.workunit.client.0.smithi087.stdout:0/972: symlink d1/d6/d21/d2a/dd5/l141 0 2024-04-25T15:58:16.890 INFO:tasks.workunit.client.0.smithi087.stdout:7/650: chown d1/d1a/f97 117187952 1 2024-04-25T15:58:16.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/903: dread d3/d27/d29/d4f/d5a/d6a/ff9 [0,4194304] 0 2024-04-25T15:58:16.895 INFO:tasks.workunit.client.0.smithi087.stdout:8/941: sync 2024-04-25T15:58:16.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/901: creat d4/d10/d60/d5c/d3a/f128 x:0 0 0 2024-04-25T15:58:16.900 INFO:tasks.workunit.client.0.smithi087.stdout:0/973: dwrite d1/d6/f36 [0,4194304] 0 2024-04-25T15:58:16.900 INFO:tasks.workunit.client.0.smithi087.stdout:9/842: creat d6/d8/d32/d57/f110 x:0 0 0 2024-04-25T15:58:16.901 INFO:tasks.workunit.client.0.smithi087.stdout:7/651: truncate d1/d4/d18/d36/f95 344804 0 2024-04-25T15:58:16.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/904: unlink d3/d27/d29/d4f/d5a/d6a/d88/de7/ff6 0 2024-04-25T15:58:16.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/905: chown d3 12134469 1 2024-04-25T15:58:16.902 INFO:tasks.workunit.client.0.smithi087.stdout:5/893: link d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/d107/c122 d9/d91/d30/d56/c12c 0 2024-04-25T15:58:16.903 INFO:tasks.workunit.client.0.smithi087.stdout:8/942: mknod d4/d1d/d17/d37/d127/c134 0 2024-04-25T15:58:16.904 INFO:tasks.workunit.client.0.smithi087.stdout:4/902: rmdir d4/d10/d60 39 2024-04-25T15:58:16.905 INFO:tasks.workunit.client.0.smithi087.stdout:2/906: write d3/d27/d29/d4f/d5a/d6a/d88/d94/fad [3918261,75118] 0 2024-04-25T15:58:16.905 INFO:tasks.workunit.client.0.smithi087.stdout:1/907: creat d3/d12/d14/d29/d2f/d40/f138 x:0 0 0 2024-04-25T15:58:16.907 INFO:tasks.workunit.client.0.smithi087.stdout:9/843: mkdir d6/d3e/d63/d111 0 2024-04-25T15:58:16.907 INFO:tasks.workunit.client.0.smithi087.stdout:8/943: write d4/d1d/d17/d37/dc9/fce [558141,88391] 0 2024-04-25T15:58:16.910 INFO:tasks.workunit.client.0.smithi087.stdout:7/652: dread d1/d4/da5/fa6 [8388608,4194304] 0 2024-04-25T15:58:16.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/903: readlink d4/d10/d60/d5c/d3a/l6b 0 2024-04-25T15:58:16.910 INFO:tasks.workunit.client.0.smithi087.stdout:9/844: stat d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d102 0 2024-04-25T15:58:16.913 INFO:tasks.workunit.client.0.smithi087.stdout:2/907: unlink d3/d20/d4a/l3d 0 2024-04-25T15:58:16.914 INFO:tasks.workunit.client.0.smithi087.stdout:2/908: read - d3/d27/d29/d2d/fec zero size 2024-04-25T15:58:16.915 INFO:tasks.workunit.client.0.smithi087.stdout:8/944: unlink d4/d8/dd/d85/dbc/dd2/f103 0 2024-04-25T15:58:16.919 INFO:tasks.workunit.client.0.smithi087.stdout:5/894: truncate d9/d91/d30/d70/d79/fdf 107775 0 2024-04-25T15:58:16.921 INFO:tasks.workunit.client.0.smithi087.stdout:1/908: chown d3/d12/d14/d29/d3b/f62 103 1 2024-04-25T15:58:16.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/845: creat d6/dea/f112 x:0 0 0 2024-04-25T15:58:16.922 INFO:tasks.workunit.client.0.smithi087.stdout:1/909: chown d3/d12/d14/d29/d2f/d53/dca/df1/cf5 6910 1 2024-04-25T15:58:16.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/846: chown d6/d3e/d63/d111 20601 1 2024-04-25T15:58:16.926 INFO:tasks.workunit.client.0.smithi087.stdout:4/904: unlink d4/d10/d60/d56/d61/d3f/d58/d5e/fff 0 2024-04-25T15:58:16.928 INFO:tasks.workunit.client.0.smithi087.stdout:0/974: getdents d1/dab 0 2024-04-25T15:58:16.929 INFO:tasks.workunit.client.0.smithi087.stdout:8/945: chown d4/c11a 10687020 1 2024-04-25T15:58:16.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/653: mkdir d1/dd0 0 2024-04-25T15:58:16.931 INFO:tasks.workunit.client.0.smithi087.stdout:0/975: fdatasync d1/d6/d77/dc6/df3/f133 0 2024-04-25T15:58:16.931 INFO:tasks.workunit.client.0.smithi087.stdout:9/847: dwrite d6/d8/d12/db7/d3a/d5b/d60/d7f/fec [0,4194304] 0 2024-04-25T15:58:16.931 INFO:tasks.workunit.client.0.smithi087.stdout:5/895: rename d9/d91/d30/cb1 to d9/d91/d38/ded/dd4/c12d 0 2024-04-25T15:58:16.933 INFO:tasks.workunit.client.0.smithi087.stdout:0/976: chown d1/da/d3e/d85/d9b/d10a/fef 2 1 2024-04-25T15:58:16.933 INFO:tasks.workunit.client.0.smithi087.stdout:9/848: write d6/d8/d32/d4c/f107 [778686,19550] 0 2024-04-25T15:58:16.937 INFO:tasks.workunit.client.0.smithi087.stdout:2/909: dread d3/d27/d29/d2d/fa8 [0,4194304] 0 2024-04-25T15:58:16.938 INFO:tasks.workunit.client.0.smithi087.stdout:5/896: dread d9/d91/d30/d70/d79/d7d/fba [0,4194304] 0 2024-04-25T15:58:16.938 INFO:tasks.workunit.client.0.smithi087.stdout:8/946: readlink d4/d8/lf0 0 2024-04-25T15:58:16.939 INFO:tasks.workunit.client.0.smithi087.stdout:8/947: chown d4/c11a 654 1 2024-04-25T15:58:16.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/977: mkdir d1/da/d3e/d54/d34/d142 0 2024-04-25T15:58:16.946 INFO:tasks.workunit.client.0.smithi087.stdout:1/910: write d3/d12/f91 [1086986,52598] 0 2024-04-25T15:58:16.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/948: mknod d4/d1d/d17/d37/dc9/c135 0 2024-04-25T15:58:16.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/654: symlink d1/ld1 0 2024-04-25T15:58:16.950 INFO:tasks.workunit.client.0.smithi087.stdout:9/849: symlink d6/d3e/d63/dc2/dde/l113 0 2024-04-25T15:58:16.952 INFO:tasks.workunit.client.0.smithi087.stdout:4/905: creat d4/d10/d60/d56/d61/d3f/d58/d5e/f129 x:0 0 0 2024-04-25T15:58:16.952 INFO:tasks.workunit.client.0.smithi087.stdout:1/911: creat d3/d12/d4d/dba/f139 x:0 0 0 2024-04-25T15:58:16.953 INFO:tasks.workunit.client.0.smithi087.stdout:4/906: fsync d4/d10/d60/d56/fce 0 2024-04-25T15:58:16.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 Processor -- start 2024-04-25T15:58:16.953 INFO:tasks.workunit.client.0.smithi087.stdout:8/949: mknod d4/d1d/de1/d82/c136 0 2024-04-25T15:58:16.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 -- start start 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df015ef90 0x7f8df00c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8df00c9770 0x7f8df00c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8df00c5b20 con 0x7f8df015f950 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8df00c5e00 con 0x7f8df00c9770 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df75f5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8df00c60e0 con 0x7f8df015ef90 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df4b90640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8df015f950 0x7f8df015c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:45276/0 (socket says 172.21.15.87:45276) 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df5b92640 1 --2- 172.21.15.87:0/1103283486 >> v2:172.21.15.87:3300/0 conn(0x7f8df00c9770 0x7f8df00c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df4b90640 1 -- 172.21.15.87:0/1103283486 learned_addr learned my addr 172.21.15.87:0/1103283486 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df5391640 1 --2- 172.21.15.87:0/1103283486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df015ef90 0x7f8df00c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8de7fff640 1 -- 172.21.15.87:0/1103283486 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669292992 0 0) 0x7f8df00c5b20 con 0x7f8df015f950 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8de7fff640 1 -- 172.21.15.87:0/1103283486 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ddc003530 con 0x7f8df015f950 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df5b92640 1 -- 172.21.15.87:0/1103283486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df015ef90 msgr2=0x7f8df00c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df5b92640 1 --2- 172.21.15.87:0/1103283486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df015ef90 0x7f8df00c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:16.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df5b92640 1 -- 172.21.15.87:0/1103283486 >> v1:172.21.15.87:6789/0 conn(0x7f8df015f950 legacy=0x7f8df015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:16.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.950+0000 7f8df5b92640 1 -- 172.21.15.87:0/1103283486 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df015bc80 con 0x7f8df00c9770 2024-04-25T15:58:16.958 INFO:tasks.workunit.client.0.smithi087.stdout:8/950: rmdir d4 39 2024-04-25T15:58:16.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df5b92640 1 --2- 172.21.15.87:0/1103283486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df00c9770 0x7f8df00c9b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009d90 tx=0x7f8de801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce42b416c172f610 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:16.959 INFO:tasks.workunit.client.0.smithi087.stdout:0/978: creat d1/da/d3e/d85/d9b/d10a/f143 x:0 0 0 2024-04-25T15:58:16.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8de7fff640 1 -- 172.21.15.87:0/1103283486 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80b2070 con 0x7f8df00c9770 2024-04-25T15:58:16.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8de7fff640 1 -- 172.21.15.87:0/1103283486 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de80a5820 con 0x7f8df00c9770 2024-04-25T15:58:16.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8de7fff640 1 -- 172.21.15.87:0/1103283486 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80a5bd0 con 0x7f8df00c9770 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 -- 172.21.15.87:0/1103283486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df00c9770 msgr2=0x7f8df00c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 --2- 172.21.15.87:0/1103283486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df00c9770 0x7f8df00c9b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009d90 tx=0x7f8de801c850 comp rx=0 tx=0).stop 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 -- 172.21.15.87:0/1103283486 shutdown_connections 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 --2- 172.21.15.87:0/1103283486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df00c9770 0x7f8df00c9b80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 --2- 172.21.15.87:0/1103283486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df015ef90 0x7f8df00c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 -- 172.21.15.87:0/1103283486 >> 172.21.15.87:0/1103283486 conn(0x7f8df00ac550 msgr2=0x7f8df00ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:16.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 -- 172.21.15.87:0/1103283486 shutdown_connections 2024-04-25T15:58:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.954+0000 7f8df75f5640 1 -- 172.21.15.87:0/1103283486 wait complete. 2024-04-25T15:58:16.961 INFO:tasks.workunit.client.0.smithi087.stdout:1/912: chown d3/d12/d14/d29/d3b/c72 155053 1 2024-04-25T15:58:16.961 INFO:tasks.workunit.client.0.smithi087.stdout:4/907: unlink d4/d10/d60/d56/fe7 0 2024-04-25T15:58:16.961 INFO:tasks.workunit.client.0.smithi087.stdout:3/805: sync 2024-04-25T15:58:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 Processor -- start 2024-04-25T15:58:16.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 -- start start 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df00c9770 0x7f8df00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8df015ef90 0x7f8df0150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 0x7f8df0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8df015ff70 con 0x7f8df015f950 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0159760 con 0x7f8df015ef90 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df75f5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8df0168b50 con 0x7f8df00c9770 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5b92640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 0x7f8df0150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5b92640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 0x7f8df0150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56536/0 (socket says 172.21.15.87:56536) 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5b92640 1 -- 172.21.15.87:0/318984103 learned_addr learned my addr 172.21.15.87:0/318984103 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df00c9770 0x7f8df00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df4b90640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8df015ef90 0x7f8df0150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:16.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 -- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8df015ef90 msgr2=0x7f8df0150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8df015ef90 0x7f8df0150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 -- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 msgr2=0x7f8df0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 0x7f8df0150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 -- 172.21.15.87:0/318984103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df00c0f00 con 0x7f8df00c9770 2024-04-25T15:58:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5b92640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 0x7f8df0150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:58:16.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df4b90640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8df015ef90 0x7f8df0150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:58:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.958+0000 7f8df5391640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df00c9770 0x7f8df00c0460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00e870 tx=0x7f8dec00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec017070 con 0x7f8df00c9770 2024-04-25T15:58:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dec00ee60 con 0x7f8df00c9770 2024-04-25T15:58:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df00c11e0 con 0x7f8df00c9770 2024-04-25T15:58:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00cb60 con 0x7f8df00c9770 2024-04-25T15:58:16.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df00bfc60 con 0x7f8df00c9770 2024-04-25T15:58:16.968 INFO:tasks.workunit.client.0.smithi087.stdout:9/850: dwrite d6/d8/d12/db7/d3a/d5b/d60/d1d/f6c [0,4194304] 0 2024-04-25T15:58:16.968 INFO:tasks.workunit.client.0.smithi087.stdout:0/979: symlink d1/d6/db1/dc0/dd3/l144 0 2024-04-25T15:58:16.968 INFO:tasks.workunit.client.0.smithi087.stdout:8/951: chown d4/d22/d43/d7f/dc6/df7/d10c 138752 1 2024-04-25T15:58:16.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df0069bb0 con 0x7f8df00c9770 2024-04-25T15:58:16.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8dec01a070 con 0x7f8df00c9770 2024-04-25T15:58:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.962+0000 7f8de5ffb640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8dd406f430 0x7f8dd4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.966+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f8dec08f830 con 0x7f8df00c9770 2024-04-25T15:58:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.966+0000 7f8df4b90640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8dd406f430 0x7f8dd4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:16.970 INFO:tasks.workunit.client.0.smithi087.stdout:1/913: mknod d3/d12/d14/d29/d67/c13a 0 2024-04-25T15:58:16.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.966+0000 7f8df4b90640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8dd406f430 0x7f8dd4071940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8de0001210 tx=0x7f8de0000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:16.972 INFO:tasks.workunit.client.0.smithi087.stdout:2/910: dwrite d3/f116 [0,4194304] 0 2024-04-25T15:58:16.975 INFO:tasks.workunit.client.0.smithi087.stdout:3/806: unlink d4/d17/d24/d29/d58/dac/dc0/d5c/l69 0 2024-04-25T15:58:16.975 INFO:tasks.workunit.client.0.smithi087.stdout:7/655: dwrite d1/d3c/f6e [4194304,4194304] 0 2024-04-25T15:58:16.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:16.970+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8dec05bd40 con 0x7f8df00c9770 2024-04-25T15:58:16.977 INFO:tasks.workunit.client.0.smithi087.stdout:7/656: write d1/d4/d7e/f96 [916579,87516] 0 2024-04-25T15:58:16.979 INFO:tasks.workunit.client.0.smithi087.stdout:5/897: dread d9/f1c [0,4194304] 0 2024-04-25T15:58:16.980 INFO:tasks.workunit.client.0.smithi087.stdout:9/851: creat d6/d8/d12/f114 x:0 0 0 2024-04-25T15:58:16.981 INFO:tasks.workunit.client.0.smithi087.stdout:1/914: readlink d3/d12/d14/d29/d3b/l50 0 2024-04-25T15:58:16.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/657: chown d1/d4/f8c 25496387 1 2024-04-25T15:58:16.988 INFO:tasks.workunit.client.0.smithi087.stdout:8/952: creat d4/d8/dd/d85/d86/f137 x:0 0 0 2024-04-25T15:58:16.990 INFO:tasks.workunit.client.0.smithi087.stdout:4/908: mkdir d4/d10/d60/d56/d61/d12a 0 2024-04-25T15:58:16.990 INFO:tasks.workunit.client.0.smithi087.stdout:1/915: fdatasync d3/d12/d14/f11a 0 2024-04-25T15:58:16.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/898: dread d9/d91/d30/d70/d79/d7d/fba [0,4194304] 0 2024-04-25T15:58:16.997 INFO:tasks.workunit.client.0.smithi087.stdout:9/852: dwrite d6/d8/d12/db7/d3a/d5b/d60/fe2 [0,4194304] 0 2024-04-25T15:58:16.998 INFO:tasks.workunit.client.0.smithi087.stdout:4/909: read - d4/d10/d60/d56/d61/d3f/d58/d5e/f129 zero size 2024-04-25T15:58:17.002 INFO:tasks.workunit.client.0.smithi087.stdout:2/911: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:17.004 INFO:tasks.workunit.client.0.smithi087.stdout:7/658: write d1/d4/dcf/d45/fc2 [988901,61360] 0 2024-04-25T15:58:17.004 INFO:tasks.workunit.client.0.smithi087.stdout:1/916: truncate d3/d12/d14/d29/d2f/d40/f138 122226 0 2024-04-25T15:58:17.006 INFO:tasks.workunit.client.0.smithi087.stdout:9/853: fsync d6/d8/d32/d57/d66/da7/da8/fc6 0 2024-04-25T15:58:17.007 INFO:tasks.workunit.client.0.smithi087.stdout:2/912: fsync d3/d27/d29/f8c 0 2024-04-25T15:58:17.007 INFO:tasks.workunit.client.0.smithi087.stdout:4/910: rmdir d4/d10/d60/d5c/d3a/dd4/d121 39 2024-04-25T15:58:17.008 INFO:tasks.workunit.client.0.smithi087.stdout:7/659: fdatasync d1/d4/dcf/f30 0 2024-04-25T15:58:17.010 INFO:tasks.workunit.client.0.smithi087.stdout:2/913: chown d3/d2a 14 1 2024-04-25T15:58:17.012 INFO:tasks.workunit.client.0.smithi087.stdout:3/807: dwrite d4/d17/d24/d29/d58/dac/dc0/f2f [0,4194304] 0 2024-04-25T15:58:17.013 INFO:tasks.workunit.client.0.smithi087.stdout:8/953: truncate d4/d1d/d17/d37/fad 4443111 0 2024-04-25T15:58:17.018 INFO:tasks.workunit.client.0.smithi087.stdout:9/854: creat d6/d8/d12/db7/f115 x:0 0 0 2024-04-25T15:58:17.018 INFO:tasks.workunit.client.0.smithi087.stdout:8/954: dread - d4/d8/dd/d2f/f10b zero size 2024-04-25T15:58:17.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/899: dwrite d9/d2f/d40/d4d/d7b/d5c/d5f/de8/f129 [0,4194304] 0 2024-04-25T15:58:17.021 INFO:tasks.workunit.client.0.smithi087.stdout:2/914: creat d3/d2a/d48/d77/db6/dfa/f122 x:0 0 0 2024-04-25T15:58:17.021 INFO:tasks.workunit.client.0.smithi087.stdout:8/955: readlink d4/d1d/de1/lb6 0 2024-04-25T15:58:17.024 INFO:tasks.workunit.client.0.smithi087.stdout:2/915: chown d3/d2a/c5c 211835 1 2024-04-25T15:58:17.024 INFO:tasks.workunit.client.0.smithi087.stdout:1/917: dread d3/d12/d39/d64/fa2 [0,4194304] 0 2024-04-25T15:58:17.026 INFO:tasks.workunit.client.0.smithi087.stdout:7/660: link d1/d4/dcf/l34 d1/d3c/d6b/ld2 0 2024-04-25T15:58:17.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/808: dread d4/d17/d24/f56 [0,4194304] 0 2024-04-25T15:58:17.027 INFO:tasks.workunit.client.0.smithi087.stdout:8/956: mkdir d4/d22/d43/d138 0 2024-04-25T15:58:17.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/916: chown d3/d2a/d81/d93/l97 986 1 2024-04-25T15:58:17.032 INFO:tasks.workunit.client.0.smithi087.stdout:8/957: dread - d4/d9c/f12a zero size 2024-04-25T15:58:17.034 INFO:tasks.workunit.client.0.smithi087.stdout:7/661: mknod d1/d1a/cd3 0 2024-04-25T15:58:17.034 INFO:tasks.workunit.client.0.smithi087.stdout:1/918: read d3/d12/d14/d29/d2f/d40/f138 [33336,12606] 0 2024-04-25T15:58:17.037 INFO:tasks.workunit.client.0.smithi087.stdout:9/855: dwrite d6/d8/d12/db7/d3a/d5b/d60/dcd/ffe [0,4194304] 0 2024-04-25T15:58:17.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/900: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fb4 130834 0 2024-04-25T15:58:17.039 INFO:tasks.workunit.client.0.smithi087.stdout:5/901: stat d9/f21 0 2024-04-25T15:58:17.041 INFO:tasks.workunit.client.0.smithi087.stdout:2/917: write d3/f101 [7061,55763] 0 2024-04-25T15:58:17.043 INFO:tasks.workunit.client.0.smithi087.stdout:4/911: dwrite d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/fa2 [4194304,4194304] 0 2024-04-25T15:58:17.045 INFO:tasks.workunit.client.0.smithi087.stdout:8/958: rename d4/d22/d43/d7f/dc6 to d4/d22/d43/d138/d139 0 2024-04-25T15:58:17.050 INFO:tasks.workunit.client.0.smithi087.stdout:3/809: creat d4/d17/d24/d29/d58/dac/dc0/d3c/d62/db2/ff9 x:0 0 0 2024-04-25T15:58:17.051 INFO:tasks.workunit.client.0.smithi087.stdout:7/662: write f0 [7178515,51033] 0 2024-04-25T15:58:17.054 INFO:tasks.workunit.client.0.smithi087.stdout:9/856: rmdir d6/d3e/d63/d111 0 2024-04-25T15:58:17.056 INFO:tasks.workunit.client.0.smithi087.stdout:1/919: dwrite d3/d12/d4d/da5/fdc [0,4194304] 0 2024-04-25T15:58:17.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/912: creat d4/d10/d60/d5c/d3a/d90/f12b x:0 0 0 2024-04-25T15:58:17.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/918: dwrite d3/d27/d29/f7a [0,4194304] 0 2024-04-25T15:58:17.066 INFO:tasks.workunit.client.0.smithi087.stdout:1/920: stat d3/d12/d14/d29/d3b/f98 0 2024-04-25T15:58:17.069 INFO:tasks.workunit.client.0.smithi087.stdout:8/959: rename d4/d9c/d123/l129 to d4/d9c/l13a 0 2024-04-25T15:58:17.070 INFO:tasks.workunit.client.0.smithi087.stdout:7/663: creat d1/fd4 x:0 0 0 2024-04-25T15:58:17.070 INFO:tasks.workunit.client.0.smithi087.stdout:3/810: symlink d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/de5/lfa 0 2024-04-25T15:58:17.072 INFO:tasks.workunit.client.0.smithi087.stdout:2/919: mknod d3/d20/d4a/d47/d112/c123 0 2024-04-25T15:58:17.074 INFO:tasks.workunit.client.0.smithi087.stdout:9/857: dwrite d6/fa0 [0,4194304] 0 2024-04-25T15:58:17.075 INFO:tasks.workunit.client.0.smithi087.stdout:7/664: chown d1/f8 11413738 1 2024-04-25T15:58:17.075 INFO:tasks.workunit.client.0.smithi087.stdout:5/902: dwrite d9/d2f/d40/d4d/fc6 [0,4194304] 0 2024-04-25T15:58:17.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/921: mknod d3/d12/d14/d29/d2f/d53/dca/df1/dff/c13b 0 2024-04-25T15:58:17.078 INFO:tasks.workunit.client.0.smithi087.stdout:2/920: mkdir d3/d2a/d48/d77/d79/d85/d124 0 2024-04-25T15:58:17.081 INFO:tasks.workunit.client.0.smithi087.stdout:7/665: write d1/d4/d18/f82 [969495,19031] 0 2024-04-25T15:58:17.082 INFO:tasks.workunit.client.0.smithi087.stdout:9/858: write d6/d8/d12/db7/d3a/d5b/f8f [833465,43248] 0 2024-04-25T15:58:17.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/960: getdents d4/d1d/d17/d101 0 2024-04-25T15:58:17.084 INFO:tasks.workunit.client.0.smithi087.stdout:4/913: dwrite d4/d10/d60/d56/d61/d3f/d42/d97/f89 [0,4194304] 0 2024-04-25T15:58:17.084 INFO:tasks.workunit.client.0.smithi087.stdout:5/903: write d9/d2f/d40/d4d/d7b/f112 [3301675,45929] 0 2024-04-25T15:58:17.088 INFO:tasks.workunit.client.0.smithi087.stdout:7/666: mkdir d1/d4/d18/dd5 0 2024-04-25T15:58:17.090 INFO:tasks.workunit.client.0.smithi087.stdout:3/811: dwrite d4/db/fda [0,4194304] 0 2024-04-25T15:58:17.097 INFO:tasks.workunit.client.0.smithi087.stdout:8/961: dwrite d4/d8/dd/d85/d86/f8f [0,4194304] 0 2024-04-25T15:58:17.097 INFO:tasks.workunit.client.0.smithi087.stdout:4/914: link d4/d10/d60/d52/d66/fbe d4/d87/f12c 0 2024-04-25T15:58:17.099 INFO:tasks.workunit.client.0.smithi087.stdout:8/962: chown d4/d9c/d123/f133 344969266 1 2024-04-25T15:58:17.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/904: mkdir d9/d2f/d40/d4d/d7b/d5c/d5f/d12e 0 2024-04-25T15:58:17.100 INFO:tasks.workunit.client.0.smithi087.stdout:7/667: dread d1/d1a/f66 [0,4194304] 0 2024-04-25T15:58:17.103 INFO:tasks.workunit.client.0.smithi087.stdout:3/812: dread d4/d17/d24/f46 [0,4194304] 0 2024-04-25T15:58:17.103 INFO:tasks.workunit.client.0.smithi087.stdout:7/668: write d1/d4/d18/d36/fb4 [889435,76051] 0 2024-04-25T15:58:17.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/963: mkdir d4/d8/d13b 0 2024-04-25T15:58:17.104 INFO:tasks.workunit.client.0.smithi087.stdout:5/905: creat d9/d91/d30/de2/f12f x:0 0 0 2024-04-25T15:58:17.105 INFO:tasks.workunit.client.0.smithi087.stdout:4/915: creat d4/d10/d60/f12d x:0 0 0 2024-04-25T15:58:17.106 INFO:tasks.workunit.client.0.smithi087.stdout:1/922: dread d3/f8 [0,4194304] 0 2024-04-25T15:58:17.106 INFO:tasks.workunit.client.0.smithi087.stdout:3/813: chown d4/d17/d81/da6/d23/f7c 2200 1 2024-04-25T15:58:17.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/814: write d4/f2c [3002697,85061] 0 2024-04-25T15:58:17.108 INFO:tasks.workunit.client.0.smithi087.stdout:7/669: truncate d1/d3c/daa/fcc 737854 0 2024-04-25T15:58:17.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/916: creat d4/d87/f12e x:0 0 0 2024-04-25T15:58:17.110 INFO:tasks.workunit.client.0.smithi087.stdout:5/906: dread d9/d91/d38/fdb [0,4194304] 0 2024-04-25T15:58:17.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/815: read d4/d17/f74 [899178,10885] 0 2024-04-25T15:58:17.114 INFO:tasks.workunit.client.0.smithi087.stdout:4/917: creat d4/d10/d60/d52/d107/f12f x:0 0 0 2024-04-25T15:58:17.115 INFO:tasks.workunit.client.0.smithi087.stdout:5/907: rmdir d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e 39 2024-04-25T15:58:17.115 INFO:tasks.workunit.client.0.smithi087.stdout:3/816: truncate d4/d17/d81/da6/d9b/fe8 680849 0 2024-04-25T15:58:17.116 INFO:tasks.workunit.client.0.smithi087.stdout:5/908: fsync d9/f103 0 2024-04-25T15:58:17.118 INFO:tasks.workunit.client.0.smithi087.stdout:4/918: fdatasync d4/d10/f3c 0 2024-04-25T15:58:17.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/923: dwrite d3/f100 [0,4194304] 0 2024-04-25T15:58:17.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/964: dread d4/d1d/d14/f2c [0,4194304] 0 2024-04-25T15:58:17.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/919: dread - d4/d10/d60/d56/d61/d3f/d42/d100/f11e zero size 2024-04-25T15:58:17.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/909: creat d9/d99/f130 x:0 0 0 2024-04-25T15:58:17.123 INFO:tasks.workunit.client.0.smithi087.stdout:0/980: sync 2024-04-25T15:58:17.123 INFO:tasks.workunit.client.0.smithi087.stdout:8/965: chown d4/d1d/f97 137861 1 2024-04-25T15:58:17.127 INFO:tasks.workunit.client.0.smithi087.stdout:8/966: chown d4/d9c/f109 214545520 1 2024-04-25T15:58:17.127 INFO:tasks.workunit.client.0.smithi087.stdout:0/981: readlink d1/da/d3e/d54/d34/d55/l90 0 2024-04-25T15:58:17.129 INFO:tasks.workunit.client.0.smithi087.stdout:5/910: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/de8/f8d 4955888 0 2024-04-25T15:58:17.130 INFO:tasks.workunit.client.0.smithi087.stdout:3/817: dread d4/d17/d24/d29/d58/dac/f4a [0,4194304] 0 2024-04-25T15:58:17.135 INFO:tasks.workunit.client.0.smithi087.stdout:3/818: dread - d4/d17/d81/da6/d53/f75 zero size 2024-04-25T15:58:17.137 INFO:tasks.workunit.client.0.smithi087.stdout:9/859: write d6/d8/d48/f6d [60732,37630] 0 2024-04-25T15:58:17.138 INFO:tasks.workunit.client.0.smithi087.stdout:2/921: truncate d3/fd 2569184 0 2024-04-25T15:58:17.138 INFO:tasks.workunit.client.0.smithi087.stdout:4/920: dwrite d4/d10/d60/d56/d61/d3f/d58/d5e/f125 [0,4194304] 0 2024-04-25T15:58:17.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/967: dwrite d4/d22/d43/f121 [0,4194304] 0 2024-04-25T15:58:17.142 INFO:tasks.workunit.client.0.smithi087.stdout:2/922: chown d3/d27/d29/d76/cd3 236164 1 2024-04-25T15:58:17.143 INFO:tasks.workunit.client.0.smithi087.stdout:3/819: dread - d4/d17/d81/da6/d53/d68/de4/dd3/dec/fb1 zero size 2024-04-25T15:58:17.143 INFO:tasks.workunit.client.0.smithi087.stdout:5/911: rename d9/d91/d49/cd7 to d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/d107/c131 0 2024-04-25T15:58:17.147 INFO:tasks.workunit.client.0.smithi087.stdout:2/923: write d3/d27/d29/d4f/d5a/d6a/ff9 [4338941,55231] 0 2024-04-25T15:58:17.147 INFO:tasks.workunit.client.0.smithi087.stdout:9/860: rmdir d6/d8/d12/db7/d3a/d5b/d60/d81/d85 39 2024-04-25T15:58:17.149 INFO:tasks.workunit.client.0.smithi087.stdout:7/670: write d1/f8 [1441578,14468] 0 2024-04-25T15:58:17.150 INFO:tasks.workunit.client.0.smithi087.stdout:5/912: write d9/d91/d38/fdb [146653,117879] 0 2024-04-25T15:58:17.153 INFO:tasks.workunit.client.0.smithi087.stdout:1/924: dread d3/d12/d14/d29/d8e/f9d [0,4194304] 0 2024-04-25T15:58:17.154 INFO:tasks.workunit.client.0.smithi087.stdout:2/924: creat d3/d2a/d48/d77/db7/f125 x:0 0 0 2024-04-25T15:58:17.156 INFO:tasks.workunit.client.0.smithi087.stdout:8/968: dread d4/d1d/de1/d82/fb0 [0,4194304] 0 2024-04-25T15:58:17.157 INFO:tasks.workunit.client.0.smithi087.stdout:3/820: mkdir d4/d17/d81/da6/dfb 0 2024-04-25T15:58:17.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/925: stat d3/d27/d29/d2d/fec 0 2024-04-25T15:58:17.158 INFO:tasks.workunit.client.0.smithi087.stdout:0/982: write d1/da/d3e/d54/fd8 [452077,125375] 0 2024-04-25T15:58:17.158 INFO:tasks.workunit.client.0.smithi087.stdout:9/861: mkdir d6/d8/d12/db7/d3a/d5b/d60/dcd/d104/d116 0 2024-04-25T15:58:17.160 INFO:tasks.workunit.client.0.smithi087.stdout:1/925: dread d3/f8 [0,4194304] 0 2024-04-25T15:58:17.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/913: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f4a 2517490 0 2024-04-25T15:58:17.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/921: write d4/d10/d60/d5c/d3a/d90/fb0 [623097,120382] 0 2024-04-25T15:58:17.164 INFO:tasks.workunit.client.0.smithi087.stdout:2/926: dread - d3/d27/d29/d4f/d5a/d6a/d88/de7/dde/f11c zero size 2024-04-25T15:58:17.165 INFO:tasks.workunit.client.0.smithi087.stdout:7/671: dread d1/d3c/f88 [0,4194304] 0 2024-04-25T15:58:17.165 INFO:tasks.workunit.client.0.smithi087.stdout:8/969: truncate d4/d8/dd/d85/d86/f137 987683 0 2024-04-25T15:58:17.166 INFO:tasks.workunit.client.0.smithi087.stdout:9/862: mknod d6/d8/d48/c117 0 2024-04-25T15:58:17.168 INFO:tasks.workunit.client.0.smithi087.stdout:5/914: readlink d9/d2f/d40/d4d/d7b/d5c/d5f/l96 0 2024-04-25T15:58:17.169 INFO:tasks.workunit.client.0.smithi087.stdout:1/926: readlink d3/d12/d39/l131 0 2024-04-25T15:58:17.171 INFO:tasks.workunit.client.0.smithi087.stdout:2/927: stat d3/d2a/d48/d77/db7/c118 0 2024-04-25T15:58:17.172 INFO:tasks.workunit.client.0.smithi087.stdout:0/983: unlink d1/da/d3e/d85/d9b/ffe 0 2024-04-25T15:58:17.172 INFO:tasks.workunit.client.0.smithi087.stdout:9/863: read d6/d8/d12/db7/d3a/d7c/fcf [8972,44232] 0 2024-04-25T15:58:17.173 INFO:tasks.workunit.client.0.smithi087.stdout:7/672: truncate d1/d1a/f66 292831 0 2024-04-25T15:58:17.173 INFO:tasks.workunit.client.0.smithi087.stdout:1/927: chown d3/d12/d14/d29/d2f/d53/dca 31 1 2024-04-25T15:58:17.176 INFO:tasks.workunit.client.0.smithi087.stdout:5/915: dread - d9/d2f/d40/d4d/d58/faf zero size 2024-04-25T15:58:17.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/970: creat d4/d8/dd/d2f/d6f/f13c x:0 0 0 2024-04-25T15:58:17.177 INFO:tasks.workunit.client.0.smithi087.stdout:4/922: dread d4/d10/f81 [0,4194304] 0 2024-04-25T15:58:17.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/928: write d3/d12/d14/d29/d12d/dd0/f116 [231715,76935] 0 2024-04-25T15:58:17.178 INFO:tasks.workunit.client.0.smithi087.stdout:9/864: creat d6/d3e/d63/dc2/f118 x:0 0 0 2024-04-25T15:58:17.179 INFO:tasks.workunit.client.0.smithi087.stdout:2/928: creat d3/d2a/d81/d93/f126 x:0 0 0 2024-04-25T15:58:17.181 INFO:tasks.workunit.client.0.smithi087.stdout:1/929: fdatasync d3/d12/d4d/f51 0 2024-04-25T15:58:17.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/984: symlink d1/d6/db1/dc0/d13d/l145 0 2024-04-25T15:58:17.182 INFO:tasks.workunit.client.0.smithi087.stdout:2/929: dread - d3/d2a/d48/d77/db7/f125 zero size 2024-04-25T15:58:17.182 INFO:tasks.workunit.client.0.smithi087.stdout:3/821: dread d4/d17/d81/da6/f55 [4194304,4194304] 0 2024-04-25T15:58:17.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/985: write d1/d4f/de3/df5/fcc [4529925,119274] 0 2024-04-25T15:58:17.186 INFO:tasks.workunit.client.0.smithi087.stdout:3/822: fdatasync d4/d17/d81/da6/d37/d51/fcf 0 2024-04-25T15:58:17.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/865: read d6/f51 [4730641,52488] 0 2024-04-25T15:58:17.189 INFO:tasks.workunit.client.0.smithi087.stdout:1/930: write d3/d2d/d6c/f9b [4778116,98335] 0 2024-04-25T15:58:17.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/971: fsync d4/d1d/d14/f31 0 2024-04-25T15:58:17.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/930: truncate d3/d27/d29/d4f/feb 1318618 0 2024-04-25T15:58:17.193 INFO:tasks.workunit.client.0.smithi087.stdout:4/923: dwrite d4/d10/d60/d5c/d3a/f128 [0,4194304] 0 2024-04-25T15:58:17.194 INFO:tasks.workunit.client.0.smithi087.stdout:5/916: write d9/d2f/d3b/f9a [138410,12433] 0 2024-04-25T15:58:17.195 INFO:tasks.workunit.client.0.smithi087.stdout:7/673: getdents d1/d4/da5 0 2024-04-25T15:58:17.197 INFO:tasks.workunit.client.0.smithi087.stdout:2/931: chown d3/d27/d29/de9/ff2 5211 1 2024-04-25T15:58:17.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/931: creat d3/d12/d14/d29/d8e/f13c x:0 0 0 2024-04-25T15:58:17.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/917: chown d9/d91/d30/d70/d82/lac 387341 1 2024-04-25T15:58:17.200 INFO:tasks.workunit.client.0.smithi087.stdout:0/986: dwrite d1/da/d3e/d54/d34/d55/fd6 [0,4194304] 0 2024-04-25T15:58:17.200 INFO:tasks.workunit.client.0.smithi087.stdout:9/866: mknod d6/d8/d32/d57/d66/da7/da8/c119 0 2024-04-25T15:58:17.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/823: mkdir d4/d17/d81/da6/d23/dfc 0 2024-04-25T15:58:17.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/932: truncate d3/d20/d4a/fcd 42011 0 2024-04-25T15:58:17.206 INFO:tasks.workunit.client.0.smithi087.stdout:1/932: creat d3/d12/d14/d29/d12d/f13d x:0 0 0 2024-04-25T15:58:17.208 INFO:tasks.workunit.client.0.smithi087.stdout:8/972: creat d4/d1d/f13d x:0 0 0 2024-04-25T15:58:17.208 INFO:tasks.workunit.client.0.smithi087.stdout:3/824: rmdir d4/d17/d81 39 2024-04-25T15:58:17.211 INFO:tasks.workunit.client.0.smithi087.stdout:5/918: mknod d9/d2f/d40/d4d/d7b/d74/c132 0 2024-04-25T15:58:17.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/933: dread - d3/d12/fb2 zero size 2024-04-25T15:58:17.214 INFO:tasks.workunit.client.0.smithi087.stdout:2/933: mkdir d3/d20/d11d/d127 0 2024-04-25T15:58:17.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/674: dwrite d1/d4/fba [0,4194304] 0 2024-04-25T15:58:17.217 INFO:tasks.workunit.client.0.smithi087.stdout:9/867: dwrite d6/d3e/d63/dc2/f118 [0,4194304] 0 2024-04-25T15:58:17.217 INFO:tasks.workunit.client.0.smithi087.stdout:4/924: link d4/d10/d60/d52/d66/d15/ff d4/d10/d60/d52/d107/f130 0 2024-04-25T15:58:17.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/825: write d4/d17/d81/da6/d53/d68/fe1 [112950,760] 0 2024-04-25T15:58:17.218 INFO:tasks.workunit.client.0.smithi087.stdout:1/934: chown d3/d12/d14/d29/d2f/l6d 104288 1 2024-04-25T15:58:17.218 INFO:tasks.workunit.client.0.smithi087.stdout:7/675: dread - d1/d3c/d6b/da1/db1/fc9 zero size 2024-04-25T15:58:17.220 INFO:tasks.workunit.client.0.smithi087.stdout:8/973: mknod d4/d22/d43/d138/d139/df7/d10c/c13e 0 2024-04-25T15:58:17.221 INFO:tasks.workunit.client.0.smithi087.stdout:9/868: fdatasync d6/d8/d12/db7/d3a/d58/d7b/f10d 0 2024-04-25T15:58:17.221 INFO:tasks.workunit.client.0.smithi087.stdout:1/935: write d3/d12/fb5 [1455648,27057] 0 2024-04-25T15:58:17.223 INFO:tasks.workunit.client.0.smithi087.stdout:5/919: mknod d9/d91/d30/d70/c133 0 2024-04-25T15:58:17.223 INFO:tasks.workunit.client.0.smithi087.stdout:9/869: fdatasync d6/dea/f105 0 2024-04-25T15:58:17.225 INFO:tasks.workunit.client.0.smithi087.stdout:0/987: write d1/d6/fe [66723,57316] 0 2024-04-25T15:58:17.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/676: readlink d1/d4/dcf/l34 0 2024-04-25T15:58:17.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/925: read - d4/d10/d60/d56/d61/d3f/dc7/fd0 zero size 2024-04-25T15:58:17.229 INFO:tasks.workunit.client.0.smithi087.stdout:7/677: dread - d1/d3c/fc1 zero size 2024-04-25T15:58:17.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/826: symlink d4/d17/d81/da6/dfb/lfd 0 2024-04-25T15:58:17.231 INFO:tasks.workunit.client.0.smithi087.stdout:1/936: mkdir d3/d12/d14/d33/d95/d13e 0 2024-04-25T15:58:17.232 INFO:tasks.workunit.client.0.smithi087.stdout:0/988: mkdir d1/d6/d21/d2a/dd5/d105/d146 0 2024-04-25T15:58:17.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/937: chown d3/d12/ffb 22755 1 2024-04-25T15:58:17.238 INFO:tasks.workunit.client.0.smithi087.stdout:8/974: dwrite d4/d22/d43/d138/d139/ddc/f108 [0,4194304] 0 2024-04-25T15:58:17.238 INFO:tasks.workunit.client.0.smithi087.stdout:5/920: dwrite d9/d99/ffe [0,4194304] 0 2024-04-25T15:58:17.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/975: dread - d4/d22/d43/d138/d139/df7/d10c/d11f/fde zero size 2024-04-25T15:58:17.241 INFO:tasks.workunit.client.0.smithi087.stdout:1/938: mknod d3/d12/d39/c13f 0 2024-04-25T15:58:17.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/989: read - d1/d6/d112/fce zero size 2024-04-25T15:58:17.245 INFO:tasks.workunit.client.0.smithi087.stdout:3/827: mknod d4/d17/d24/d29/d58/dac/cfe 0 2024-04-25T15:58:17.246 INFO:tasks.workunit.client.0.smithi087.stdout:8/976: rmdir d4/d8/dd/d2f/d6f 39 2024-04-25T15:58:17.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/990: fsync d1/d6/d112/d7d/f93 0 2024-04-25T15:58:17.249 INFO:tasks.workunit.client.0.smithi087.stdout:5/921: mkdir d9/d134 0 2024-04-25T15:58:17.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/870: dread d6/d8/d32/fd5 [0,4194304] 0 2024-04-25T15:58:17.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/939: fsync d3/d12/d14/f27 0 2024-04-25T15:58:17.256 INFO:tasks.workunit.client.0.smithi087.stdout:0/991: chown d1/da/d3e/d54/f20 194433881 1 2024-04-25T15:58:17.258 INFO:tasks.workunit.client.0.smithi087.stdout:5/922: mkdir d9/d2f/d40/d4d/d7b/d8f/d11f/d135 0 2024-04-25T15:58:17.262 INFO:tasks.workunit.client.0.smithi087.stdout:2/934: dwrite d3/fd [0,4194304] 0 2024-04-25T15:58:17.264 INFO:tasks.workunit.client.0.smithi087.stdout:8/977: write d4/d1d/d17/d37/d5e/f7a [3360401,37480] 0 2024-04-25T15:58:17.264 INFO:tasks.workunit.client.0.smithi087.stdout:4/926: dwrite d4/d10/d60/d52/d66/fbc [0,4194304] 0 2024-04-25T15:58:17.265 INFO:tasks.workunit.client.0.smithi087.stdout:7/678: dwrite d1/d1a/f50 [0,4194304] 0 2024-04-25T15:58:17.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/940: creat d3/d12/d14/d29/d2f/d61/f140 x:0 0 0 2024-04-25T15:58:17.277 INFO:tasks.workunit.client.0.smithi087.stdout:3/828: dread d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fc1 [0,4194304] 0 2024-04-25T15:58:17.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/935: creat d3/d27/d29/d2d/d40/f128 x:0 0 0 2024-04-25T15:58:17.279 INFO:tasks.workunit.client.0.smithi087.stdout:9/871: rename d6/d8/d12/db7/d3a/d7c/fc9 to d6/d8/d32/d57/f11a 0 2024-04-25T15:58:17.280 INFO:tasks.workunit.client.0.smithi087.stdout:7/679: dread d1/d3c/f88 [4194304,4194304] 0 2024-04-25T15:58:17.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/941: truncate d3/d12/d14/d29/d2f/f63 4981188 0 2024-04-25T15:58:17.282 INFO:tasks.workunit.client.0.smithi087.stdout:9/872: write d6/d8/d12/db7/d3a/d5b/d60/d1d/f6c [874112,59549] 0 2024-04-25T15:58:17.288 INFO:tasks.workunit.client.0.smithi087.stdout:1/942: dwrite d3/d12/d14/d29/d8e/f13c [0,4194304] 0 2024-04-25T15:58:17.300 INFO:tasks.workunit.client.0.smithi087.stdout:5/923: creat d9/d2f/d40/d4d/d7b/f136 x:0 0 0 2024-04-25T15:58:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.294+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8df00abfb0 con 0x7f8df00c9770 2024-04-25T15:58:17.301 INFO:tasks.workunit.client.0.smithi087.stdout:5/924: dread - d9/d91/d30/d70/d79/dae/de4/fe6 zero size 2024-04-25T15:58:17.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8de5ffb640 1 -- 172.21.15.87:0/318984103 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5669 (secure 0 0 0) 0x7f8dec060040 con 0x7f8df00c9770 2024-04-25T15:58:17.302 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:17.302 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:58:17.302 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 40 2024-04-25T15:58:17.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/680: symlink d1/d1a/ld6 0 2024-04-25T15:58:17.304 INFO:tasks.workunit.client.0.smithi087.stdout:9/873: readlink d6/l28 0 2024-04-25T15:58:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8dd406f430 msgr2=0x7f8dd4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8dd406f430 0x7f8dd4071940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8de0001210 tx=0x7f8de0000bd0 comp rx=0 tx=0).stop 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df00c9770 msgr2=0x7f8df00c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df00c9770 0x7f8df00c0460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00e870 tx=0x7f8dec00ed30 comp rx=0 tx=0).stop 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 shutdown_connections 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8dd406f430 0x7f8dd4071940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df015f950 0x7f8df0150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8df015ef90 0x7f8df0150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 --2- 172.21.15.87:0/318984103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8df00c9770 0x7f8df00c0460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 >> 172.21.15.87:0/318984103 conn(0x7f8df00ac550 msgr2=0x7f8df00aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 shutdown_connections 2024-04-25T15:58:17.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:17.298+0000 7f8df75f5640 1 -- 172.21.15.87:0/318984103 wait complete. 2024-04-25T15:58:17.306 INFO:tasks.workunit.client.0.smithi087.stdout:9/874: dread - d6/d8/d12/f114 zero size 2024-04-25T15:58:17.307 INFO:tasks.workunit.client.0.smithi087.stdout:3/829: symlink d4/d17/d24/d29/d58/dac/dc0/d3c/lff 0 2024-04-25T15:58:17.308 INFO:tasks.workunit.client.0.smithi087.stdout:5/925: creat d9/d2f/d40/d4d/de1/f137 x:0 0 0 2024-04-25T15:58:17.308 INFO:tasks.workunit.client.0.smithi087.stdout:3/830: chown d4/d17/d81/da6/d53/fb9 3903939 1 2024-04-25T15:58:17.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/943: mknod d3/d12/d14/d29/d2f/d61/c141 0 2024-04-25T15:58:17.322 INFO:tasks.workunit.client.0.smithi087.stdout:4/927: link d4/l75 d4/d10/d60/d56/d61/l131 0 2024-04-25T15:58:17.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/928: write d4/d10/d60/fb6 [103537,27897] 0 2024-04-25T15:58:17.325 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T15:58:17.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/978: rename d4/d22/d43/d138/d139/ddc/c102 to d4/d22/c13f 0 2024-04-25T15:58:17.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/979: read d4/d1d/d17/ff9 [748482,93996] 0 2024-04-25T15:58:17.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/944: creat d3/d12/d14/d33/d95/d13e/f142 x:0 0 0 2024-04-25T15:58:17.343 INFO:tasks.workunit.client.0.smithi087.stdout:9/875: rename d6/d3e/fc4 to d6/dea/f11b 0 2024-04-25T15:58:17.346 INFO:tasks.workunit.client.0.smithi087.stdout:3/831: link d4/d17/d24/d29/d58/dac/dc0/d3c/f9d d4/d17/f100 0 2024-04-25T15:58:17.352 INFO:tasks.workunit.client.0.smithi087.stdout:5/926: getdents d9/d99 0 2024-04-25T15:58:17.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/945: creat d3/d12/d14/d29/d5c/f143 x:0 0 0 2024-04-25T15:58:17.364 INFO:tasks.workunit.client.0.smithi087.stdout:3/832: unlink d4/db/fc 0 2024-04-25T15:58:17.376 INFO:tasks.workunit.client.0.smithi087.stdout:2/936: truncate d3/d2a/d48/d77/d79/d85/fc1 1031317 0 2024-04-25T15:58:17.377 INFO:tasks.workunit.client.0.smithi087.stdout:7/681: truncate d1/d4/d18/d36/f68 2705446 0 2024-04-25T15:58:17.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/927: link d9/d2f/d40/d4d/d7b/d74/d83/fd8 d9/d2f/d40/d4d/de1/f138 0 2024-04-25T15:58:17.379 INFO:tasks.workunit.client.0.smithi087.stdout:2/937: readlink d3/d2a/d81/d93/lb1 0 2024-04-25T15:58:17.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/929: write d4/d10/d60/d52/d66/f32 [877414,39537] 0 2024-04-25T15:58:17.381 INFO:tasks.workunit.client.0.smithi087.stdout:3/833: dwrite d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89/fe6 [0,4194304] 0 2024-04-25T15:58:17.381 INFO:tasks.workunit.client.0.smithi087.stdout:7/682: dread - d1/d3c/d6b/da1/db1/fc9 zero size 2024-04-25T15:58:17.381 INFO:tasks.workunit.client.0.smithi087.stdout:9/876: dread d6/d8/d32/d4c/f82 [0,4194304] 0 2024-04-25T15:58:17.382 INFO:tasks.workunit.client.0.smithi087.stdout:1/946: truncate d3/f5a 1502527 0 2024-04-25T15:58:17.383 INFO:tasks.workunit.client.0.smithi087.stdout:7/683: readlink d1/d4/d18/l2e 0 2024-04-25T15:58:17.383 INFO:tasks.workunit.client.0.smithi087.stdout:2/938: mkdir d3/d2a/d48/d129 0 2024-04-25T15:58:17.387 INFO:tasks.workunit.client.0.smithi087.stdout:4/930: dread d4/d10/d60/d5c/f2d [0,4194304] 0 2024-04-25T15:58:17.387 INFO:tasks.workunit.client.0.smithi087.stdout:1/947: fsync d3/d12/d14/d29/d5c/f143 0 2024-04-25T15:58:17.387 INFO:tasks.workunit.client.0.smithi087.stdout:8/980: write d4/d1d/d14/f2c [2172734,71227] 0 2024-04-25T15:58:17.387 INFO:tasks.workunit.client.0.smithi087.stdout:7/684: chown d1/d3c/da3/lbd 31283280 1 2024-04-25T15:58:17.388 INFO:tasks.workunit.client.0.smithi087.stdout:9/877: unlink d6/d8/d12/db7/d3a/d58/f71 0 2024-04-25T15:58:17.391 INFO:tasks.workunit.client.0.smithi087.stdout:9/878: dread - d6/d8/d32/d57/f110 zero size 2024-04-25T15:58:17.391 INFO:tasks.workunit.client.0.smithi087.stdout:2/939: creat d3/d2a/d48/d77/db6/f12a x:0 0 0 2024-04-25T15:58:17.393 INFO:tasks.workunit.client.0.smithi087.stdout:3/834: dwrite d4/d17/d24/d29/f97 [0,4194304] 0 2024-04-25T15:58:17.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/981: unlink d4/d1d/d17/f2d 0 2024-04-25T15:58:17.396 INFO:tasks.workunit.client.0.smithi087.stdout:1/948: write d3/d12/d4d/f57 [506877,50693] 0 2024-04-25T15:58:17.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/940: chown d3/d2a/d48/fee 224 1 2024-04-25T15:58:17.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/835: rmdir d4/d17/d81/da6/d53 39 2024-04-25T15:58:17.403 INFO:tasks.workunit.client.0.smithi087.stdout:1/949: dread - d3/d12/d39/d64/dc0/fef zero size 2024-04-25T15:58:17.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/982: dwrite d4/d1d/d14/fa2 [0,4194304] 0 2024-04-25T15:58:17.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/836: dread - d4/d17/d81/fb0 zero size 2024-04-25T15:58:17.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/941: creat d3/d2a/d48/d77/d79/d85/f12b x:0 0 0 2024-04-25T15:58:17.408 INFO:tasks.workunit.client.0.smithi087.stdout:1/950: fsync d3/d12/d14/d29/d12d/faf 0 2024-04-25T15:58:17.410 INFO:tasks.workunit.client.0.smithi087.stdout:2/942: fdatasync d3/d27/d29/d4f/f59 0 2024-04-25T15:58:17.411 INFO:tasks.workunit.client.0.smithi087.stdout:4/931: write d4/d10/d60/d52/d66/f68 [4072362,68178] 0 2024-04-25T15:58:17.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/837: rename d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89/l8f to d4/d17/d24/d29/d7b/l101 0 2024-04-25T15:58:17.417 INFO:tasks.workunit.client.0.smithi087.stdout:8/983: dwrite d4/d1d/d14/fa2 [0,4194304] 0 2024-04-25T15:58:17.418 INFO:tasks.workunit.client.0.smithi087.stdout:4/932: creat d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/f132 x:0 0 0 2024-04-25T15:58:17.419 INFO:tasks.workunit.client.0.smithi087.stdout:3/838: rmdir d4/d17/d24/d29/d58/dac/dc0/d5c 39 2024-04-25T15:58:17.421 INFO:tasks.workunit.client.0.smithi087.stdout:2/943: link d3/d2a/d1c/f10a d3/d2a/d48/d77/d79/d85/d124/f12c 0 2024-04-25T15:58:17.421 INFO:tasks.workunit.client.0.smithi087.stdout:1/951: dwrite d3/d12/d14/d29/d65/fe7 [0,4194304] 0 2024-04-25T15:58:17.428 INFO:tasks.workunit.client.0.smithi087.stdout:1/952: rename d3/d12/d14/d29/d2f/d40/lc5 to d3/d12/d4d/dba/l144 0 2024-04-25T15:58:17.431 INFO:tasks.workunit.client.0.smithi087.stdout:4/933: write d4/d10/d60/d56/d61/d3f/d42/d97/f94 [851462,66724] 0 2024-04-25T15:58:17.432 INFO:tasks.workunit.client.0.smithi087.stdout:1/953: symlink d3/d12/d14/d29/l145 0 2024-04-25T15:58:17.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/839: dwrite d4/db/fe [0,4194304] 0 2024-04-25T15:58:17.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/944: truncate d3/d2a/d48/f65 271417 0 2024-04-25T15:58:17.435 INFO:tasks.workunit.client.0.smithi087.stdout:1/954: write d3/d12/d4d/f137 [1420562,128647] 0 2024-04-25T15:58:17.436 INFO:tasks.workunit.client.0.smithi087.stdout:1/955: read - d3/d2d/d6c/f106 zero size 2024-04-25T15:58:17.438 INFO:tasks.workunit.client.0.smithi087.stdout:1/956: write d3/d12/d14/d33/feb [282847,98438] 0 2024-04-25T15:58:17.438 INFO:tasks.workunit.client.0.smithi087.stdout:2/945: truncate d3/d27/d29/d2d/d40/d95/fdb 3344777 0 2024-04-25T15:58:17.440 INFO:tasks.workunit.client.0.smithi087.stdout:2/946: fsync d3/d27/d29/d2d/fec 0 2024-04-25T15:58:17.440 INFO:tasks.workunit.client.0.smithi087.stdout:3/840: creat d4/d17/d24/d29/d58/dac/d99/def/f102 x:0 0 0 2024-04-25T15:58:17.442 INFO:tasks.workunit.client.0.smithi087.stdout:2/947: chown d3/d27/d29 32 1 2024-04-25T15:58:17.444 INFO:tasks.workunit.client.0.smithi087.stdout:4/934: dwrite d4/d10/d60/d56/d61/d3f/d8a/ffc [0,4194304] 0 2024-04-25T15:58:17.448 INFO:tasks.workunit.client.0.smithi087.stdout:3/841: creat d4/d17/d24/d29/d58/dac/d9c/f103 x:0 0 0 2024-04-25T15:58:17.451 INFO:tasks.workunit.client.0.smithi087.stdout:4/935: unlink d4/f4e 0 2024-04-25T15:58:17.452 INFO:tasks.workunit.client.0.smithi087.stdout:0/992: sync 2024-04-25T15:58:17.452 INFO:tasks.workunit.client.0.smithi087.stdout:4/936: write d4/d87/f12e [991014,66714] 0 2024-04-25T15:58:17.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/948: write d3/d27/d29/d4f/f59 [5235139,88597] 0 2024-04-25T15:58:17.459 INFO:tasks.workunit.client.0.smithi087.stdout:1/957: dwrite d3/d12/d39/d64/dc0/d108/f11c [0,4194304] 0 2024-04-25T15:58:17.461 INFO:tasks.workunit.client.0.smithi087.stdout:2/949: mknod d3/d27/d29/d2d/c12d 0 2024-04-25T15:58:17.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/937: creat d4/d10/d11d/f133 x:0 0 0 2024-04-25T15:58:17.464 INFO:tasks.workunit.client.0.smithi087.stdout:3/842: getdents d4/d17/d81/da6/d9b 0 2024-04-25T15:58:17.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/938: fdatasync d4/d10/d60/d5c/d3a/d90/db9/fd1 0 2024-04-25T15:58:17.466 INFO:tasks.workunit.client.0.smithi087.stdout:0/993: write d1/da/d3e/d85/fb4 [842663,92884] 0 2024-04-25T15:58:17.467 INFO:tasks.workunit.client.0.smithi087.stdout:1/958: creat d3/dad/f146 x:0 0 0 2024-04-25T15:58:17.477 INFO:tasks.workunit.client.0.smithi087.stdout:4/939: symlink d4/d10/d60/l134 0 2024-04-25T15:58:17.478 INFO:tasks.workunit.client.0.smithi087.stdout:0/994: symlink d1/da/d3e/d85/d9b/dcd/df2/l147 0 2024-04-25T15:58:17.478 INFO:tasks.workunit.client.0.smithi087.stdout:0/995: readlink d1/l4 0 2024-04-25T15:58:17.481 INFO:tasks.workunit.client.0.smithi087.stdout:3/843: link d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f44 d4/d17/d81/da6/d53/d68/f104 0 2024-04-25T15:58:17.482 INFO:tasks.workunit.client.0.smithi087.stdout:0/996: rmdir d1/d6 39 2024-04-25T15:58:17.484 INFO:tasks.workunit.client.0.smithi087.stdout:2/950: truncate d3/d2a/d48/d77/db6/dfa/fff 144055 0 2024-04-25T15:58:17.487 INFO:tasks.workunit.client.0.smithi087.stdout:2/951: rename d3/d27/d29/d2d/fec to d3/d2a/d48/d129/f12e 0 2024-04-25T15:58:17.488 INFO:tasks.workunit.client.0.smithi087.stdout:3/844: unlink d4/d17/d24/d29/d58/dac/dc0/d3c/c49 0 2024-04-25T15:58:17.489 INFO:tasks.workunit.client.0.smithi087.stdout:4/940: getdents d4/d10/d60/d11a 0 2024-04-25T15:58:17.490 INFO:tasks.workunit.client.0.smithi087.stdout:1/959: dwrite d3/d12/d14/d29/d2f/d40/f54 [0,4194304] 0 2024-04-25T15:58:17.490 INFO:tasks.workunit.client.0.smithi087.stdout:3/845: fdatasync d4/d17/d24/d29/d58/dac/dc0/d3c/f9e 0 2024-04-25T15:58:17.492 INFO:tasks.workunit.client.0.smithi087.stdout:1/960: read - d3/d12/d39/d64/dc0/fef zero size 2024-04-25T15:58:17.493 INFO:tasks.workunit.client.0.smithi087.stdout:2/952: creat d3/d27/d38/d7e/f12f x:0 0 0 2024-04-25T15:58:17.493 INFO:tasks.workunit.client.0.smithi087.stdout:0/997: creat d1/da/f148 x:0 0 0 2024-04-25T15:58:17.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/846: fsync d4/d17/d24/d29/d58/dac/f4a 0 2024-04-25T15:58:17.499 INFO:tasks.workunit.client.0.smithi087.stdout:3/847: write d4/d17/d24/d29/f97 [3681358,21712] 0 2024-04-25T15:58:17.500 INFO:tasks.workunit.client.0.smithi087.stdout:4/941: read d4/d10/d60/d56/d61/d3f/d58/d5e/d7e/fa2 [236429,25291] 0 2024-04-25T15:58:17.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/953: dwrite d3/d20/d4a/d47/fea [0,4194304] 0 2024-04-25T15:58:17.501 INFO:tasks.workunit.client.0.smithi087.stdout:3/848: fsync d4/d17/d81/da6/d53/d68/ff1 0 2024-04-25T15:58:17.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/961: rename d3/d12/d14/d29/d2f/d53/d122 to d3/d12/d14/d29/d12d/dd0/d147 0 2024-04-25T15:58:17.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/962: readlink d3/d12/d14/d29/d2f/d53/l9e 0 2024-04-25T15:58:17.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/849: chown d4/d17/d24/d29/d58/dac/d99/def/f102 1 1 2024-04-25T15:58:17.509 INFO:tasks.workunit.client.0.smithi087.stdout:0/998: symlink d1/d6/d77/dc6/l149 0 2024-04-25T15:58:17.510 INFO:tasks.workunit.client.0.smithi087.stdout:2/954: creat d3/d2a/d48/d129/f130 x:0 0 0 2024-04-25T15:58:17.514 INFO:tasks.workunit.client.0.smithi087.stdout:1/963: symlink d3/d12/d39/d64/dc0/d108/l148 0 2024-04-25T15:58:17.516 INFO:tasks.workunit.client.0.smithi087.stdout:1/964: read d3/d12/d14/d29/f7c [137329,80400] 0 2024-04-25T15:58:17.516 INFO:tasks.workunit.client.0.smithi087.stdout:1/965: fdatasync d3/d12/f1c 0 2024-04-25T15:58:17.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/955: write d3/d2a/d48/d77/d79/d85/d124/f12c [408650,42568] 0 2024-04-25T15:58:17.526 INFO:tasks.workunit.client.0.smithi087.stdout:3/850: fdatasync d4/d17/d24/d29/d58/dac/dc0/f6e 0 2024-04-25T15:58:17.526 INFO:tasks.workunit.client.0.smithi087.stdout:4/942: rmdir d4/d10/d60/d5c/d3a/dd4/d121/d122 0 2024-04-25T15:58:17.527 INFO:tasks.workunit.client.0.smithi087.stdout:3/851: stat d4/d17/d24/d29/d58/dac/dc0/d3c/l7a 0 2024-04-25T15:58:17.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/956: creat d3/d20/f131 x:0 0 0 2024-04-25T15:58:17.531 INFO:tasks.workunit.client.0.smithi087.stdout:0/999: link d1/d6/db1/dc0/dd3/dff/d50/l53 d1/d6/db1/dc0/dd3/l14a 0 2024-04-25T15:58:17.531 INFO:tasks.workunit.client.0.smithi087.stdout:4/943: dread - d4/d10/d60/d5c/d8d/d9f/ffe zero size 2024-04-25T15:58:17.536 INFO:tasks.workunit.client.0.smithi087.stdout:3/852: getdents d4/d17/d24/d29/d58/dac/dc0/d82 0 2024-04-25T15:58:17.537 INFO:tasks.workunit.client.0.smithi087.stdout:4/944: chown d4/d10/d60/d56/d61/d3f/d42/l59 1049761 1 2024-04-25T15:58:17.538 INFO:tasks.workunit.client.0.smithi087.stdout:1/966: truncate d3/f100 805086 0 2024-04-25T15:58:17.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/967: dread - d3/d12/d14/d33/d95/fac zero size 2024-04-25T15:58:17.541 INFO:tasks.workunit.client.0.smithi087.stdout:3/853: getdents d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0 0 2024-04-25T15:58:17.544 INFO:tasks.workunit.client.0.smithi087.stdout:3/854: symlink d4/d17/d24/d29/d58/dac/d9c/l105 0 2024-04-25T15:58:17.546 INFO:tasks.workunit.client.0.smithi087.stdout:3/855: write d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fb3 [1154240,4795] 0 2024-04-25T15:58:17.547 INFO:tasks.workunit.client.0.smithi087.stdout:4/945: link d4/d10/d60/d56/d61/d3f/d42/d97/f30 d4/d10/d60/d56/d61/d3f/d8a/f135 0 2024-04-25T15:58:17.548 INFO:tasks.workunit.client.0.smithi087.stdout:3/856: readlink d4/d17/d24/l66 0 2024-04-25T15:58:17.549 INFO:tasks.workunit.client.0.smithi087.stdout:4/946: mknod d4/d10/d60/d52/c136 0 2024-04-25T15:58:17.550 INFO:tasks.workunit.client.0.smithi087.stdout:2/957: dread d3/dce/fd0 [0,4194304] 0 2024-04-25T15:58:17.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/857: rmdir d4/d17/d81/da6/d53/d68/de4/dd3 39 2024-04-25T15:58:17.551 INFO:tasks.workunit.client.0.smithi087.stdout:2/958: write d3/d20/f131 [794854,98512] 0 2024-04-25T15:58:17.551 INFO:tasks.workunit.client.0.smithi087.stdout:4/947: mkdir d4/d10/d60/d11a/d137 0 2024-04-25T15:58:17.553 INFO:tasks.workunit.client.0.smithi087.stdout:2/959: write d3/d2a/d48/d129/f130 [939237,35671] 0 2024-04-25T15:58:17.554 INFO:tasks.workunit.client.0.smithi087.stdout:3/858: getdents d4/db 0 2024-04-25T15:58:17.555 INFO:tasks.workunit.client.0.smithi087.stdout:4/948: chown d4/d10/d60/d56/d61/d3f/d58/cf5 7000610 1 2024-04-25T15:58:17.556 INFO:tasks.workunit.client.0.smithi087.stdout:3/859: readlink d4/d17/d24/lba 0 2024-04-25T15:58:17.557 INFO:tasks.workunit.client.0.smithi087.stdout:2/960: mknod d3/d27/d29/d2d/d40/d95/c132 0 2024-04-25T15:58:17.558 INFO:tasks.workunit.client.0.smithi087.stdout:2/961: write d3/d20/d4a/d47/fd9 [290162,10895] 0 2024-04-25T15:58:17.559 INFO:tasks.workunit.client.0.smithi087.stdout:4/949: creat d4/d10/d60/f138 x:0 0 0 2024-04-25T15:58:17.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/968: dread d3/d12/d14/d29/d12d/faf [0,4194304] 0 2024-04-25T15:58:17.560 INFO:tasks.workunit.client.0.smithi087.stdout:2/962: truncate d3/d27/fcb 738233 0 2024-04-25T15:58:17.561 INFO:tasks.workunit.client.0.smithi087.stdout:3/860: rename d4/d17/d81/da6/c48 to d4/d17/d24/d29/d58/dac/dc0/d3c/c106 0 2024-04-25T15:58:17.562 INFO:tasks.workunit.client.0.smithi087.stdout:1/969: mknod d3/dad/c149 0 2024-04-25T15:58:17.564 INFO:tasks.workunit.client.0.smithi087.stdout:2/963: fsync d3/d27/d29/d4f/f5f 0 2024-04-25T15:58:17.565 INFO:tasks.workunit.client.0.smithi087.stdout:2/964: write d3/d2a/d81/d93/f126 [585773,113939] 0 2024-04-25T15:58:17.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/970: readlink d3/d12/d14/d29/d2f/d53/dca/l10e 0 2024-04-25T15:58:17.566 INFO:tasks.workunit.client.0.smithi087.stdout:2/965: dread - d3/d2a/d48/d129/f12e zero size 2024-04-25T15:58:17.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/950: link d4/d10/d60/fa6 d4/d10/d60/d56/d61/d3f/d58/d5e/f139 0 2024-04-25T15:58:17.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/951: readlink d4/d87/le9 0 2024-04-25T15:58:17.569 INFO:tasks.workunit.client.0.smithi087.stdout:3/861: getdents d4/d17 0 2024-04-25T15:58:17.570 INFO:tasks.workunit.client.0.smithi087.stdout:2/966: chown d3/d27/d29/d4f/feb 138628988 1 2024-04-25T15:58:17.571 INFO:tasks.workunit.client.0.smithi087.stdout:3/862: chown d4/d17/d81/da6/d53/d7d/c7f 36 1 2024-04-25T15:58:17.576 INFO:tasks.workunit.client.0.smithi087.stdout:4/952: dwrite d4/fdb [0,4194304] 0 2024-04-25T15:58:17.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/967: mknod d3/d27/d29/d2d/d40/d121/c133 0 2024-04-25T15:58:17.582 INFO:tasks.workunit.client.0.smithi087.stdout:3/863: mkdir d4/d17/d24/d29/d107 0 2024-04-25T15:58:17.583 INFO:tasks.workunit.client.0.smithi087.stdout:3/864: chown d4/d17/d81/da6/d53 13 1 2024-04-25T15:58:17.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/968: chown d3/fdc 333 1 2024-04-25T15:58:17.585 INFO:tasks.workunit.client.0.smithi087.stdout:2/969: write d3/d27/d29/d4f/f84 [2202382,80392] 0 2024-04-25T15:58:17.586 INFO:tasks.workunit.client.0.smithi087.stdout:2/970: chown d3/d2a/d1c/f10a 1173 1 2024-04-25T15:58:17.587 INFO:tasks.workunit.client.0.smithi087.stdout:1/971: dread d3/d12/d4d/f57 [0,4194304] 0 2024-04-25T15:58:17.587 INFO:tasks.workunit.client.0.smithi087.stdout:3/865: mkdir d4/d17/d81/da6/d53/d68/de4/dd3/d108 0 2024-04-25T15:58:17.588 INFO:tasks.workunit.client.0.smithi087.stdout:3/866: write d4/d17/d81/da6/d53/d68/f92 [1256894,96555] 0 2024-04-25T15:58:17.589 INFO:tasks.workunit.client.0.smithi087.stdout:4/953: write d4/d10/d60/d52/f57 [902596,90160] 0 2024-04-25T15:58:17.591 INFO:tasks.workunit.client.0.smithi087.stdout:1/972: unlink d3/d12/d14/d29/d3b/f98 0 2024-04-25T15:58:17.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/973: fdatasync d3/d12/d4d/da5/fc2 0 2024-04-25T15:58:17.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/974: dread - d3/d12/d14/d29/d5c/f143 zero size 2024-04-25T15:58:17.595 INFO:tasks.workunit.client.0.smithi087.stdout:1/975: read - d3/d12/d14/d33/dee/f127 zero size 2024-04-25T15:58:17.597 INFO:tasks.workunit.client.0.smithi087.stdout:2/971: dread d3/f7 [0,4194304] 0 2024-04-25T15:58:17.597 INFO:tasks.workunit.client.0.smithi087.stdout:1/976: write d3/d12/d14/d29/d2f/d40/f118 [112125,57403] 0 2024-04-25T15:58:17.597 INFO:tasks.workunit.client.0.smithi087.stdout:4/954: rename d4/d10/d60/d56/d61/fd3 to d4/d10/d60/d56/d61/d3f/d42/d97/f13a 0 2024-04-25T15:58:17.601 INFO:tasks.workunit.client.0.smithi087.stdout:2/972: rmdir d3/d27/d29/d4f 39 2024-04-25T15:58:17.602 INFO:tasks.workunit.client.0.smithi087.stdout:4/955: creat d4/d10/d60/d5c/d3a/dd4/d121/f13b x:0 0 0 2024-04-25T15:58:17.608 INFO:tasks.workunit.client.0.smithi087.stdout:4/956: mkdir d4/d10/d60/d56/d61/d3f/d58/d13c 0 2024-04-25T15:58:17.608 INFO:tasks.workunit.client.0.smithi087.stdout:2/973: creat d3/d27/d29/d4f/d5a/d6a/d88/de7/d111/f134 x:0 0 0 2024-04-25T15:58:17.610 INFO:tasks.workunit.client.0.smithi087.stdout:3/867: dwrite d4/db/f6c [0,4194304] 0 2024-04-25T15:58:17.610 INFO:tasks.workunit.client.0.smithi087.stdout:1/977: write d3/d12/d14/f17 [1003946,54465] 0 2024-04-25T15:58:17.612 INFO:tasks.workunit.client.0.smithi087.stdout:1/978: fdatasync d3/d12/d14/d33/ffc 0 2024-04-25T15:58:17.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/868: write d4/d17/d81/da6/d53/fb9 [799797,79498] 0 2024-04-25T15:58:17.612 INFO:tasks.workunit.client.0.smithi087.stdout:2/974: creat d3/d27/d29/de9/f135 x:0 0 0 2024-04-25T15:58:17.613 INFO:tasks.workunit.client.0.smithi087.stdout:4/957: mknod d4/d10/d60/d5c/d3a/dd4/c13d 0 2024-04-25T15:58:17.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/975: mknod d3/d2a/d48/d83/c136 0 2024-04-25T15:58:17.618 INFO:tasks.workunit.client.0.smithi087.stdout:1/979: dread d3/d12/d14/f16 [0,4194304] 0 2024-04-25T15:58:17.620 INFO:tasks.workunit.client.0.smithi087.stdout:3/869: creat d4/d17/d81/da6/d23/f109 x:0 0 0 2024-04-25T15:58:17.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/958: write d4/d10/d60/d5c/d3a/d90/fae [805818,114934] 0 2024-04-25T15:58:17.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/976: dread d3/d2a/f8f [0,4194304] 0 2024-04-25T15:58:17.638 INFO:tasks.workunit.client.0.smithi087.stdout:1/980: dwrite d3/d12/d39/d64/dc0/fef [0,4194304] 0 2024-04-25T15:58:17.638 INFO:tasks.workunit.client.0.smithi087.stdout:3/870: dwrite d4/d17/d24/f56 [0,4194304] 0 2024-04-25T15:58:17.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/977: stat d3/d2a/d1c/cc4 0 2024-04-25T15:58:17.643 INFO:tasks.workunit.client.0.smithi087.stdout:5/928: sync 2024-04-25T15:58:17.644 INFO:tasks.workunit.client.0.smithi087.stdout:2/978: unlink d3/d27/d29/d2d/d40/f9c 0 2024-04-25T15:58:17.646 INFO:tasks.workunit.client.0.smithi087.stdout:1/981: rename d3/d12/d14/d29/d2f/d53/fb0 to d3/d12/d14/d29/d2f/d53/dca/d133/f14a 0 2024-04-25T15:58:17.648 INFO:tasks.workunit.client.0.smithi087.stdout:4/959: dread d4/d10/d60/f6c [0,4194304] 0 2024-04-25T15:58:17.650 INFO:tasks.workunit.client.0.smithi087.stdout:5/929: rename d9/d2f/c3d to d9/d2f/d40/d4d/d7b/d5c/d5f/c139 0 2024-04-25T15:58:17.654 INFO:tasks.workunit.client.0.smithi087.stdout:5/930: creat d9/d91/d30/f13a x:0 0 0 2024-04-25T15:58:17.655 INFO:tasks.workunit.client.0.smithi087.stdout:1/982: symlink d3/d12/d14/d29/d67/d73/l14b 0 2024-04-25T15:58:17.656 INFO:tasks.workunit.client.0.smithi087.stdout:4/960: creat d4/d10/d60/d5c/f13e x:0 0 0 2024-04-25T15:58:17.658 INFO:tasks.workunit.client.0.smithi087.stdout:4/961: fdatasync d4/d10/d60/d56/d61/d3f/fbf 0 2024-04-25T15:58:17.660 INFO:tasks.workunit.client.0.smithi087.stdout:5/931: rename d9/d91/d30/d70/d79/dae/de4/de5 to d9/d2f/d40/d4d/d7b/d5c/d5f/de8/d13b 0 2024-04-25T15:58:17.662 INFO:tasks.workunit.client.0.smithi087.stdout:1/983: truncate d3/d12/d14/d29/d2f/d61/f92 906121 0 2024-04-25T15:58:17.663 INFO:tasks.workunit.client.0.smithi087.stdout:1/984: dread - d3/d12/ffb zero size 2024-04-25T15:58:17.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/962: symlink d4/d10/d60/d5c/d3a/d90/l13f 0 2024-04-25T15:58:17.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/932: unlink d9/d2f/d40/c12b 0 2024-04-25T15:58:17.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/933: fsync d9/d2f/d3b/fef 0 2024-04-25T15:58:17.668 INFO:tasks.workunit.client.0.smithi087.stdout:3/871: truncate d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f64 2258898 0 2024-04-25T15:58:17.669 INFO:tasks.workunit.client.0.smithi087.stdout:2/979: truncate d3/f103 2168558 0 2024-04-25T15:58:17.671 INFO:tasks.workunit.client.0.smithi087.stdout:1/985: creat d3/dfe/f14c x:0 0 0 2024-04-25T15:58:17.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/872: creat d4/d17/d24/d29/d58/dac/dc0/d82/f10a x:0 0 0 2024-04-25T15:58:17.674 INFO:tasks.workunit.client.0.smithi087.stdout:3/873: creat d4/d17/d81/da6/dfb/f10b x:0 0 0 2024-04-25T15:58:17.676 INFO:tasks.workunit.client.0.smithi087.stdout:3/874: truncate d4/d17/d24/d29/fa7 1220864 0 2024-04-25T15:58:17.680 INFO:tasks.workunit.client.0.smithi087.stdout:2/980: link d3/d27/d29/d4f/d5a/d6a/c80 d3/d2a/d48/d77/d79/c137 0 2024-04-25T15:58:17.683 INFO:tasks.workunit.client.0.smithi087.stdout:2/981: unlink d3/d20/d4a/d47/c78 0 2024-04-25T15:58:17.685 INFO:tasks.workunit.client.0.smithi087.stdout:2/982: truncate d3/d2a/d48/d129/f12e 624701 0 2024-04-25T15:58:17.686 INFO:tasks.workunit.client.0.smithi087.stdout:4/963: dwrite d4/d10/d60/d56/d61/d3f/d42/f88 [0,4194304] 0 2024-04-25T15:58:17.686 INFO:tasks.workunit.client.0.smithi087.stdout:3/875: write d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fbd [101161,61827] 0 2024-04-25T15:58:17.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/876: mknod d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/c10c 0 2024-04-25T15:58:17.695 INFO:tasks.workunit.client.0.smithi087.stdout:2/983: getdents d3/d2a/d48/d129 0 2024-04-25T15:58:17.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/984: write d3/d2a/d48/f54 [2991649,26878] 0 2024-04-25T15:58:17.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/964: dread d4/d10/d60/d56/d61/d3f/d42/d97/f1b [0,4194304] 0 2024-04-25T15:58:17.700 INFO:tasks.workunit.client.0.smithi087.stdout:4/965: dread - d4/d10/d60/f71 zero size 2024-04-25T15:58:17.701 INFO:tasks.workunit.client.0.smithi087.stdout:4/966: chown d4/d10/d60/d5c/d3a/d90/ld7 1976087 1 2024-04-25T15:58:17.702 INFO:tasks.workunit.client.0.smithi087.stdout:4/967: chown d4/d10/d60/d56/d61/db7/lc0 3370 1 2024-04-25T15:58:17.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/968: getdents d4/d10/d60/d56/d61/d3f/dc7 0 2024-04-25T15:58:17.705 INFO:tasks.workunit.client.0.smithi087.stdout:4/969: truncate d4/f35 132116 0 2024-04-25T15:58:17.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/970: read d4/d10/d60/d56/d61/d3f/d8a/fb4 [45091,104179] 0 2024-04-25T15:58:17.710 INFO:tasks.workunit.client.0.smithi087.stdout:4/971: mkdir d4/d10/d60/d5c/d8d/d9f/d140 0 2024-04-25T15:58:17.711 INFO:tasks.workunit.client.0.smithi087.stdout:2/985: link d3/d27/d38/f67 d3/d27/d29/f138 0 2024-04-25T15:58:17.712 INFO:tasks.workunit.client.0.smithi087.stdout:3/877: dwrite d4/d17/d81/da6/d53/d68/f104 [0,4194304] 0 2024-04-25T15:58:17.713 INFO:tasks.workunit.client.0.smithi087.stdout:2/986: truncate d3/d27/ffb 1034731 0 2024-04-25T15:58:17.714 INFO:tasks.workunit.client.0.smithi087.stdout:2/987: write d3/fd [928663,119620] 0 2024-04-25T15:58:17.719 INFO:tasks.workunit.client.0.smithi087.stdout:2/988: symlink d3/d27/d38/d10c/l139 0 2024-04-25T15:58:17.720 INFO:tasks.workunit.client.0.smithi087.stdout:2/989: dread - d3/d27/d29/de9/f135 zero size 2024-04-25T15:58:17.721 INFO:tasks.workunit.client.0.smithi087.stdout:2/990: dread - d3/d2a/d48/d77/db6/f12a zero size 2024-04-25T15:58:17.724 INFO:tasks.workunit.client.0.smithi087.stdout:2/991: mknod d3/d27/d29/d4f/d5a/d6a/d88/de7/de5/c13a 0 2024-04-25T15:58:17.728 INFO:tasks.workunit.client.0.smithi087.stdout:4/972: dread d4/d10/d60/d56/d61/d3f/d42/d97/fa0 [0,4194304] 0 2024-04-25T15:58:17.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/973: dread - d4/d10/f123 zero size 2024-04-25T15:58:17.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/992: dread d3/d27/d29/d4f/d5a/d6a/d88/fc9 [0,4194304] 0 2024-04-25T15:58:17.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/974: dread d4/d10/d60/d52/d66/d15/df1/f117 [0,4194304] 0 2024-04-25T15:58:17.749 INFO:tasks.workunit.client.0.smithi087.stdout:4/975: dwrite d4/d10/d60/d52/d66/fdf [0,4194304] 0 2024-04-25T15:58:17.755 INFO:tasks.workunit.client.0.smithi087.stdout:4/976: write d4/d10/d60/d5c/d3a/d90/fe3 [402778,19190] 0 2024-04-25T15:58:17.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/993: dread d3/d2a/d1c/f92 [0,4194304] 0 2024-04-25T15:58:17.763 INFO:tasks.workunit.client.0.smithi087.stdout:4/977: dwrite d4/d10/d60/d5c/f115 [0,4194304] 0 2024-04-25T15:58:17.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/994: stat d3/d27/d29/d4f/d5a/d6a/d88/de7/dde/f11c 0 2024-04-25T15:58:17.766 INFO:tasks.workunit.client.0.smithi087.stdout:4/978: chown d4/d10/d60/f2f 424219 1 2024-04-25T15:58:17.768 INFO:tasks.workunit.client.0.smithi087.stdout:4/979: stat d4/d10/d60/d56/d61/d3f/d58/d5e/f118 0 2024-04-25T15:58:17.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/995: getdents d3/d27/d38 0 2024-04-25T15:58:17.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/996: rmdir d3/d2a/d81/d93 39 2024-04-25T15:58:17.773 INFO:tasks.workunit.client.0.smithi087.stdout:2/997: creat d3/d27/d29/d4f/de3/f13b x:0 0 0 2024-04-25T15:58:17.776 INFO:tasks.workunit.client.0.smithi087.stdout:7/685: sync 2024-04-25T15:58:17.776 INFO:tasks.workunit.client.0.smithi087.stdout:8/984: sync 2024-04-25T15:58:17.776 INFO:tasks.workunit.client.0.smithi087.stdout:9/879: sync 2024-04-25T15:58:17.778 INFO:tasks.workunit.client.0.smithi087.stdout:2/998: symlink d3/d20/d4a/d47/d112/d115/l13c 0 2024-04-25T15:58:17.779 INFO:tasks.workunit.client.0.smithi087.stdout:9/880: mkdir d6/d8/d12/db7/da9/d11c 0 2024-04-25T15:58:17.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/999: write d3/d27/f31 [4582177,35823] 0 2024-04-25T15:58:17.782 INFO:tasks.workunit.client.0.smithi087.stdout:9/881: mkdir d6/d8/d12/d11d 0 2024-04-25T15:58:17.783 INFO:tasks.workunit.client.0.smithi087.stdout:8/985: getdents d4/d1d/de1 0 2024-04-25T15:58:17.784 INFO:tasks.workunit.client.0.smithi087.stdout:9/882: chown d6/d8/d12/db7/d3a/d58/d72/dd2 420 1 2024-04-25T15:58:17.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/686: dwrite d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:17.786 INFO:tasks.workunit.client.0.smithi087.stdout:9/883: truncate d6/d3e/d63/dc2/fc3 1002700 0 2024-04-25T15:58:17.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/687: creat d1/d4/d18/fd7 x:0 0 0 2024-04-25T15:58:17.789 INFO:tasks.workunit.client.0.smithi087.stdout:8/986: rmdir d4/d8/d13b 0 2024-04-25T15:58:17.791 INFO:tasks.workunit.client.0.smithi087.stdout:7/688: symlink d1/d9/d8e/ld8 0 2024-04-25T15:58:17.792 INFO:tasks.workunit.client.0.smithi087.stdout:8/987: creat d4/d1d/d7c/dae/df8/f140 x:0 0 0 2024-04-25T15:58:17.793 INFO:tasks.workunit.client.0.smithi087.stdout:4/980: dread d4/d10/f3c [0,4194304] 0 2024-04-25T15:58:17.794 INFO:tasks.workunit.client.0.smithi087.stdout:8/988: read - d4/d1d/de1/dee/f100 zero size 2024-04-25T15:58:17.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/884: dwrite d6/d8/d12/db7/d3a/f69 [0,4194304] 0 2024-04-25T15:58:17.796 INFO:tasks.workunit.client.0.smithi087.stdout:4/981: rename d4/d10/d60/d5c to d4/d10/d60/d5c/d3a/d90/d141 22 2024-04-25T15:58:17.797 INFO:tasks.workunit.client.0.smithi087.stdout:9/885: write d6/dea/f112 [572261,109042] 0 2024-04-25T15:58:17.799 INFO:tasks.workunit.client.0.smithi087.stdout:4/982: stat d4/d10/d60/fb1 0 2024-04-25T15:58:17.800 INFO:tasks.workunit.client.0.smithi087.stdout:7/689: dwrite d1/d4/d18/d36/f71 [0,4194304] 0 2024-04-25T15:58:17.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/886: creat d6/d3e/d63/dc2/dde/f11e x:0 0 0 2024-04-25T15:58:17.801 INFO:tasks.workunit.client.0.smithi087.stdout:7/690: chown d1/d4/d18/cb3 46844836 1 2024-04-25T15:58:17.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/691: chown d1/d3c 2 1 2024-04-25T15:58:17.802 INFO:tasks.workunit.client.0.smithi087.stdout:8/989: mknod d4/d9c/db1/c141 0 2024-04-25T15:58:17.805 INFO:tasks.workunit.client.0.smithi087.stdout:4/983: unlink d4/d10/d60/d56/d61/df6/c105 0 2024-04-25T15:58:17.805 INFO:tasks.workunit.client.0.smithi087.stdout:9/887: dread d6/d8/d12/db7/d3a/f69 [0,4194304] 0 2024-04-25T15:58:17.806 INFO:tasks.workunit.client.0.smithi087.stdout:8/990: read d4/d1d/d17/f2e [288381,108446] 0 2024-04-25T15:58:17.807 INFO:tasks.workunit.client.0.smithi087.stdout:9/888: write d6/d8/d32/d57/dbf/ff6 [536173,36468] 0 2024-04-25T15:58:17.808 INFO:tasks.workunit.client.0.smithi087.stdout:8/991: chown d4/d8/dd/d85/d86/fca 340 1 2024-04-25T15:58:17.808 INFO:tasks.workunit.client.0.smithi087.stdout:7/692: mkdir d1/d4/dbc/dd9 0 2024-04-25T15:58:17.812 INFO:tasks.workunit.client.0.smithi087.stdout:4/984: dread d4/d10/d60/d5c/f54 [0,4194304] 0 2024-04-25T15:58:17.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/889: dread d6/d8/d12/db7/d3a/d7c/fab [0,4194304] 0 2024-04-25T15:58:17.813 INFO:tasks.workunit.client.0.smithi087.stdout:7/693: fdatasync d1/d1a/f66 0 2024-04-25T15:58:17.813 INFO:tasks.workunit.client.0.smithi087.stdout:9/890: write d6/d8/d48/fb5 [2859367,22135] 0 2024-04-25T15:58:17.815 INFO:tasks.workunit.client.0.smithi087.stdout:8/992: mknod d4/d1d/d14/dff/c142 0 2024-04-25T15:58:17.816 INFO:tasks.workunit.client.0.smithi087.stdout:7/694: mkdir d1/d9/dda 0 2024-04-25T15:58:17.817 INFO:tasks.workunit.client.0.smithi087.stdout:7/695: write d1/fd4 [346837,62887] 0 2024-04-25T15:58:17.818 INFO:tasks.workunit.client.0.smithi087.stdout:9/891: symlink d6/d8/d32/d57/l11f 0 2024-04-25T15:58:17.819 INFO:tasks.workunit.client.0.smithi087.stdout:7/696: dread - d1/d9f/f5e zero size 2024-04-25T15:58:17.822 INFO:tasks.workunit.client.0.smithi087.stdout:7/697: unlink d1/d4/fba 0 2024-04-25T15:58:17.824 INFO:tasks.workunit.client.0.smithi087.stdout:9/892: getdents d6/d8/d32 0 2024-04-25T15:58:17.830 INFO:tasks.workunit.client.0.smithi087.stdout:7/698: dread d1/d4/f55 [0,4194304] 0 2024-04-25T15:58:17.831 INFO:tasks.workunit.client.0.smithi087.stdout:9/893: dwrite d6/d8/d12/db7/d3a/d58/d72/ff1 [0,4194304] 0 2024-04-25T15:58:17.833 INFO:tasks.workunit.client.0.smithi087.stdout:7/699: creat d1/d3c/d6b/fdb x:0 0 0 2024-04-25T15:58:17.834 INFO:tasks.workunit.client.0.smithi087.stdout:7/700: read - d1/d3c/d6b/fc6 zero size 2024-04-25T15:58:17.837 INFO:tasks.workunit.client.0.smithi087.stdout:7/701: mknod d1/d3c/da3/cdc 0 2024-04-25T15:58:17.838 INFO:tasks.workunit.client.0.smithi087.stdout:7/702: truncate d1/d9/f9d 833190 0 2024-04-25T15:58:17.840 INFO:tasks.workunit.client.0.smithi087.stdout:9/894: rename d6/d8/d12/db7/d3a/d5b/d60/l1a to d6/d8/d12/db7/d3a/d58/d72/dd2/l120 0 2024-04-25T15:58:17.841 INFO:tasks.workunit.client.0.smithi087.stdout:7/703: stat d1/d4/d18/d36/f68 0 2024-04-25T15:58:17.844 INFO:tasks.workunit.client.0.smithi087.stdout:9/895: creat d6/f121 x:0 0 0 2024-04-25T15:58:17.845 INFO:tasks.workunit.client.0.smithi087.stdout:7/704: mknod d1/d4/d18/d36/cdd 0 2024-04-25T15:58:17.845 INFO:tasks.workunit.client.0.smithi087.stdout:8/993: write d4/d1d/d14/f31 [12497,106803] 0 2024-04-25T15:58:17.847 INFO:tasks.workunit.client.0.smithi087.stdout:9/896: unlink d6/d8/d12/db7/d3a/d5b/d60/c1b 0 2024-04-25T15:58:17.852 INFO:tasks.workunit.client.0.smithi087.stdout:8/994: link d4/d1d/d17/d101/l107 d4/d9c/d123/l143 0 2024-04-25T15:58:17.854 INFO:tasks.workunit.client.0.smithi087.stdout:7/705: rename d1/d1a/d7b/f7c to d1/d9f/fde 0 2024-04-25T15:58:17.855 INFO:tasks.workunit.client.0.smithi087.stdout:7/706: read - d1/d9f/f43 zero size 2024-04-25T15:58:17.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/707: write d1/d4/f10 [4720953,6540] 0 2024-04-25T15:58:17.866 INFO:tasks.workunit.client.0.smithi087.stdout:9/897: dread d6/d8/d12/db7/d3a/d5b/d60/d7f/fec [0,4194304] 0 2024-04-25T15:58:17.871 INFO:tasks.workunit.client.0.smithi087.stdout:8/995: dread d4/d1d/d7c/f23 [4194304,4194304] 0 2024-04-25T15:58:17.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/996: creat d4/d22/d43/f144 x:0 0 0 2024-04-25T15:58:17.875 INFO:tasks.workunit.client.0.smithi087.stdout:8/997: chown d4/d8/dd/l74 31 1 2024-04-25T15:58:17.878 INFO:tasks.workunit.client.0.smithi087.stdout:8/998: link d4/ff2 d4/d1d/d7c/dae/f145 0 2024-04-25T15:58:17.879 INFO:tasks.workunit.client.0.smithi087.stdout:8/999: fsync d4/d1d/d14/f2c 0 2024-04-25T15:58:17.907 INFO:tasks.workunit.client.0.smithi087.stdout:1/986: sync 2024-04-25T15:58:17.907 INFO:tasks.workunit.client.0.smithi087.stdout:3/878: sync 2024-04-25T15:58:17.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/934: sync 2024-04-25T15:58:17.909 INFO:tasks.workunit.client.0.smithi087.stdout:5/935: rmdir d9/d2f/d40/d4d/d7b/d5c/dc7 39 2024-04-25T15:58:17.911 INFO:tasks.workunit.client.0.smithi087.stdout:3/879: symlink d4/d17/d81/da6/d53/d68/de4/l10d 0 2024-04-25T15:58:17.912 INFO:tasks.workunit.client.0.smithi087.stdout:3/880: readlink d4/d17/d81/da6/d53/d68/de4/l10d 0 2024-04-25T15:58:17.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/936: mkdir d9/d91/d38/ded/d13c 0 2024-04-25T15:58:17.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/881: chown d4/d17/d24/d29/d58/dac/dc0/d3c/d62 1302 1 2024-04-25T15:58:17.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/987: link d3/dad/f146 d3/d12/d14/d29/d12d/f14d 0 2024-04-25T15:58:17.914 INFO:tasks.workunit.client.0.smithi087.stdout:3/882: truncate d4/f2c 4583336 0 2024-04-25T15:58:17.914 INFO:tasks.workunit.client.0.smithi087.stdout:1/988: truncate d3/dad/fde 563196 0 2024-04-25T15:58:17.914 INFO:tasks.workunit.client.0.smithi087.stdout:5/937: symlink d9/d91/d38/ded/d13c/l13d 0 2024-04-25T15:58:17.916 INFO:tasks.workunit.client.0.smithi087.stdout:3/883: rmdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62 39 2024-04-25T15:58:17.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/989: unlink d3/d12/d14/f17 0 2024-04-25T15:58:17.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/938: fsync d9/f2b 0 2024-04-25T15:58:17.920 INFO:tasks.workunit.client.0.smithi087.stdout:3/884: mknod d4/db/c10e 0 2024-04-25T15:58:17.922 INFO:tasks.workunit.client.0.smithi087.stdout:1/990: mknod d3/d12/d39/d64/dc0/d108/c14e 0 2024-04-25T15:58:17.927 INFO:tasks.workunit.client.0.smithi087.stdout:5/939: dwrite d9/d2f/d40/d4d/d7b/d8f/d11f/f127 [0,4194304] 0 2024-04-25T15:58:17.929 INFO:tasks.workunit.client.0.smithi087.stdout:5/940: chown d9/d91/d38/ded/d13c/l13d 34 1 2024-04-25T15:58:17.930 INFO:tasks.workunit.client.0.smithi087.stdout:3/885: getdents d4/d17/d81/da6/d53/d68 0 2024-04-25T15:58:17.931 INFO:tasks.workunit.client.0.smithi087.stdout:1/991: dwrite d3/d12/d14/d29/d65/fe7 [0,4194304] 0 2024-04-25T15:58:17.933 INFO:tasks.workunit.client.0.smithi087.stdout:1/992: readlink d3/d12/d14/d29/l145 0 2024-04-25T15:58:17.935 INFO:tasks.workunit.client.0.smithi087.stdout:3/886: unlink d4/d17/d24/lba 0 2024-04-25T15:58:17.940 INFO:tasks.workunit.client.0.smithi087.stdout:1/993: getdents d3/d12/d4d/da5 0 2024-04-25T15:58:17.942 INFO:tasks.workunit.client.0.smithi087.stdout:1/994: chown d3/d12/d39/c6f 159536 1 2024-04-25T15:58:17.946 INFO:tasks.workunit.client.0.smithi087.stdout:5/941: truncate d9/d91/d30/d70/f8e 1698503 0 2024-04-25T15:58:17.947 INFO:tasks.workunit.client.0.smithi087.stdout:3/887: dwrite d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/fd8 [0,4194304] 0 2024-04-25T15:58:17.948 INFO:tasks.workunit.client.0.smithi087.stdout:3/888: fsync d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d89/fe6 0 2024-04-25T15:58:17.948 INFO:tasks.workunit.client.0.smithi087.stdout:1/995: truncate d3/d12/d4d/f7e 1103166 0 2024-04-25T15:58:17.950 INFO:tasks.workunit.client.0.smithi087.stdout:5/942: chown d9/d2f/d3b/c69 55056 1 2024-04-25T15:58:17.950 INFO:tasks.workunit.client.0.smithi087.stdout:5/943: stat d9/c126 0 2024-04-25T15:58:17.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/996: symlink d3/d12/d14/d29/d67/l14f 0 2024-04-25T15:58:17.964 INFO:tasks.workunit.client.0.smithi087.stdout:5/944: creat d9/d2f/d40/d4d/d7b/f13e x:0 0 0 2024-04-25T15:58:17.966 INFO:tasks.workunit.client.0.smithi087.stdout:5/945: creat d9/d2f/d40/d4d/d7b/d8f/d11f/f13f x:0 0 0 2024-04-25T15:58:17.972 INFO:tasks.workunit.client.0.smithi087.stdout:3/889: truncate d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/fd8 1587208 0 2024-04-25T15:58:17.976 INFO:tasks.workunit.client.0.smithi087.stdout:5/946: write d9/d91/d30/d70/f71 [728615,5262] 0 2024-04-25T15:58:17.978 INFO:tasks.workunit.client.0.smithi087.stdout:5/947: chown d9/d91/d30/d56/caa 0 1 2024-04-25T15:58:17.980 INFO:tasks.workunit.client.0.smithi087.stdout:3/890: dwrite d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fb3 [0,4194304] 0 2024-04-25T15:58:17.981 INFO:tasks.workunit.client.0.smithi087.stdout:5/948: fdatasync d9/d91/d30/d70/d79/dae/de4/fd0 0 2024-04-25T15:58:17.982 INFO:tasks.workunit.client.0.smithi087.stdout:3/891: write d4/d17/d24/d29/d58/dac/d99/def/f102 [974250,22125] 0 2024-04-25T15:58:17.983 INFO:tasks.workunit.client.0.smithi087.stdout:3/892: chown d4/d17/f74 12 1 2024-04-25T15:58:17.984 INFO:tasks.workunit.client.0.smithi087.stdout:3/893: chown d4/d17/d81/da6/d53/f88 15990 1 2024-04-25T15:58:17.986 INFO:tasks.workunit.client.0.smithi087.stdout:1/997: dread d3/d12/d14/d29/d67/f10a [0,4194304] 0 2024-04-25T15:58:17.988 INFO:tasks.workunit.client.0.smithi087.stdout:5/949: truncate d9/d2f/d40/d4d/d7b/d5c/d5f/d44/d7e/fb4 502534 0 2024-04-25T15:58:17.990 INFO:tasks.workunit.client.0.smithi087.stdout:1/998: mknod d3/dfe/c150 0 2024-04-25T15:58:17.993 INFO:tasks.workunit.client.0.smithi087.stdout:1/999: mknod d3/d12/d4d/c151 0 2024-04-25T15:58:17.994 INFO:tasks.workunit.client.0.smithi087.stdout:5/950: creat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f140 x:0 0 0 2024-04-25T15:58:17.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/951: rmdir d9/d91/d30/d70/d79/dae/de4 39 2024-04-25T15:58:17.999 INFO:tasks.workunit.client.0.smithi087.stdout:3/894: dread d4/db/f4d [0,4194304] 0 2024-04-25T15:58:18.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/895: chown d4/f2c 739079329 1 2024-04-25T15:58:18.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/896: fsync d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/da1/faa 0 2024-04-25T15:58:18.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/897: truncate d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fbd 602336 0 2024-04-25T15:58:18.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/898: stat d4/d17/d24/d29/d58/dac/dc0/f2f 0 2024-04-25T15:58:18.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/899: mkdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/d10f 0 2024-04-25T15:58:18.009 INFO:tasks.workunit.client.0.smithi087.stdout:4/985: sync 2024-04-25T15:58:18.011 INFO:tasks.workunit.client.0.smithi087.stdout:3/900: creat d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/f110 x:0 0 0 2024-04-25T15:58:18.012 INFO:tasks.workunit.client.0.smithi087.stdout:4/986: read - d4/d10/d60/d56/d61/d3f/d42/d100/f106 zero size 2024-04-25T15:58:18.012 INFO:tasks.workunit.client.0.smithi087.stdout:5/952: write f2 [914811,60401] 0 2024-04-25T15:58:18.014 INFO:tasks.workunit.client.0.smithi087.stdout:5/953: readlink d9/l23 0 2024-04-25T15:58:18.015 INFO:tasks.workunit.client.0.smithi087.stdout:5/954: write d9/d91/f125 [687211,20162] 0 2024-04-25T15:58:18.029 INFO:tasks.workunit.client.0.smithi087.stdout:5/955: dwrite d9/d2f/d11b/f121 [0,4194304] 0 2024-04-25T15:58:18.035 INFO:tasks.workunit.client.0.smithi087.stdout:5/956: creat d9/d2f/d40/d4d/d7b/d5c/dc7/f141 x:0 0 0 2024-04-25T15:58:18.036 INFO:tasks.workunit.client.0.smithi087.stdout:5/957: write d9/d2f/d3b/fef [78017,125036] 0 2024-04-25T15:58:18.037 INFO:tasks.workunit.client.0.smithi087.stdout:4/987: dread d4/f5b [0,4194304] 0 2024-04-25T15:58:18.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/958: mkdir d9/d91/d38/ded/d13c/d142 0 2024-04-25T15:58:18.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/901: dread d4/d17/d24/d29/d58/f95 [0,4194304] 0 2024-04-25T15:58:18.041 INFO:tasks.workunit.client.0.smithi087.stdout:4/988: creat d4/d10/d60/d56/d61/d3f/f142 x:0 0 0 2024-04-25T15:58:18.042 INFO:tasks.workunit.client.0.smithi087.stdout:5/959: truncate d9/d91/d30/d70/d79/dae/fbc 698332 0 2024-04-25T15:58:18.043 INFO:tasks.workunit.client.0.smithi087.stdout:4/989: stat d4/d10/d60/d5c/lc8 0 2024-04-25T15:58:18.045 INFO:tasks.workunit.client.0.smithi087.stdout:4/990: write d4/d10/d60/d5c/d3a/d90/fe3 [516792,24481] 0 2024-04-25T15:58:18.048 INFO:tasks.workunit.client.0.smithi087.stdout:9/898: sync 2024-04-25T15:58:18.048 INFO:tasks.workunit.client.0.smithi087.stdout:7/708: sync 2024-04-25T15:58:18.048 INFO:tasks.workunit.client.0.smithi087.stdout:3/902: dwrite d4/f2c [0,4194304] 0 2024-04-25T15:58:18.049 INFO:tasks.workunit.client.0.smithi087.stdout:7/709: chown d1/d4/d18/d36/d5d 93601164 1 2024-04-25T15:58:18.051 INFO:tasks.workunit.client.0.smithi087.stdout:4/991: dread d4/d10/d60/d52/d66/fbe [0,4194304] 0 2024-04-25T15:58:18.052 INFO:tasks.workunit.client.0.smithi087.stdout:9/899: creat d6/dea/f122 x:0 0 0 2024-04-25T15:58:18.053 INFO:tasks.workunit.client.0.smithi087.stdout:7/710: truncate d1/d3c/f88 1565771 0 2024-04-25T15:58:18.056 INFO:tasks.workunit.client.0.smithi087.stdout:9/900: write d6/d3e/d63/f79 [3890326,47406] 0 2024-04-25T15:58:18.059 INFO:tasks.workunit.client.0.smithi087.stdout:3/903: dwrite d4/d17/d24/d29/fd5 [4194304,4194304] 0 2024-04-25T15:58:18.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/904: dread d4/d17/d24/d29/d58/dac/dc0/ff7 [0,4194304] 0 2024-04-25T15:58:18.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/960: dread d9/fa [0,4194304] 0 2024-04-25T15:58:18.068 INFO:tasks.workunit.client.0.smithi087.stdout:3/905: mkdir d4/d111 0 2024-04-25T15:58:18.070 INFO:tasks.workunit.client.0.smithi087.stdout:3/906: write d4/d17/d24/d29/d58/dac/d9c/f103 [532745,25158] 0 2024-04-25T15:58:18.073 INFO:tasks.workunit.client.0.smithi087.stdout:5/961: dwrite d9/f21 [0,4194304] 0 2024-04-25T15:58:18.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/962: unlink d9/d2f/d40/d4d/l6d 0 2024-04-25T15:58:18.079 INFO:tasks.workunit.client.0.smithi087.stdout:5/963: chown d9/d2f/l45 63 1 2024-04-25T15:58:18.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/992: dread d4/d10/d60/d56/fb5 [0,4194304] 0 2024-04-25T15:58:18.083 INFO:tasks.workunit.client.0.smithi087.stdout:9/901: dread d6/d8/fc [0,4194304] 0 2024-04-25T15:58:18.088 INFO:tasks.workunit.client.0.smithi087.stdout:5/964: dwrite d9/d91/d38/fdb [0,4194304] 0 2024-04-25T15:58:18.092 INFO:tasks.workunit.client.0.smithi087.stdout:4/993: rename d4/d10/d60/d5c/cf3 to d4/d10/d60/c143 0 2024-04-25T15:58:18.092 INFO:tasks.workunit.client.0.smithi087.stdout:5/965: rmdir d9/d2f/d40/d4d/d7b/d8f/d11f 39 2024-04-25T15:58:18.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/902: write d6/d45/f7a [2881716,100978] 0 2024-04-25T15:58:18.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/994: mkdir d4/d10/d60/d56/d61/d3f/d144 0 2024-04-25T15:58:18.096 INFO:tasks.workunit.client.0.smithi087.stdout:3/907: dread d4/d17/f2a [0,4194304] 0 2024-04-25T15:58:18.098 INFO:tasks.workunit.client.0.smithi087.stdout:5/966: mknod d9/d91/d30/d70/d79/d7d/d108/c143 0 2024-04-25T15:58:18.099 INFO:tasks.workunit.client.0.smithi087.stdout:5/967: readlink d9/d91/d30/d70/d79/d7d/ld2 0 2024-04-25T15:58:18.099 INFO:tasks.workunit.client.0.smithi087.stdout:9/903: symlink d6/d8/d12/db7/d3a/d5b/d60/dcd/d104/d116/l123 0 2024-04-25T15:58:18.101 INFO:tasks.workunit.client.0.smithi087.stdout:4/995: mknod d4/c145 0 2024-04-25T15:58:18.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/908: rmdir d4/d17/d24/d29/d58/dac/dc0/d5c 39 2024-04-25T15:58:18.105 INFO:tasks.workunit.client.0.smithi087.stdout:9/904: truncate d6/d8/d32/f35 283183 0 2024-04-25T15:58:18.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/996: dread d4/d10/d60/f6c [0,4194304] 0 2024-04-25T15:58:18.107 INFO:tasks.workunit.client.0.smithi087.stdout:3/909: chown d4/d17/d81/da6/d53/c6b 494711518 1 2024-04-25T15:58:18.109 INFO:tasks.workunit.client.0.smithi087.stdout:9/905: dread d6/d8/d12/db7/d3a/f40 [0,4194304] 0 2024-04-25T15:58:18.110 INFO:tasks.workunit.client.0.smithi087.stdout:4/997: rename d4/d10/d60/d56/d61/d3f to d4/d10/d60/d5c/de5/d146 0 2024-04-25T15:58:18.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/910: write d4/d17/d24/d29/d58/dac/f76 [900907,4505] 0 2024-04-25T15:58:18.113 INFO:tasks.workunit.client.0.smithi087.stdout:4/998: write d4/d10/d60/d56/ff7 [4937555,45438] 0 2024-04-25T15:58:18.117 INFO:tasks.workunit.client.0.smithi087.stdout:5/968: dwrite d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f50 [0,4194304] 0 2024-04-25T15:58:18.119 INFO:tasks.workunit.client.0.smithi087.stdout:4/999: unlink d4/d10/d60/d5c/de5/d146/d58/d5e/d7e/f96 0 2024-04-25T15:58:18.125 INFO:tasks.workunit.client.0.smithi087.stdout:3/911: link d4/db/fb8 d4/d17/d81/da6/d53/d68/da2/f112 0 2024-04-25T15:58:18.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/969: truncate d9/d2f/d40/d4d/de1/f138 580676 0 2024-04-25T15:58:18.127 INFO:tasks.workunit.client.0.smithi087.stdout:3/912: stat d4/d17/d24/d29/d58/l61 0 2024-04-25T15:58:18.130 INFO:tasks.workunit.client.0.smithi087.stdout:9/906: dread d6/d8/d48/f6e [0,4194304] 0 2024-04-25T15:58:18.130 INFO:tasks.workunit.client.0.smithi087.stdout:3/913: truncate d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fc7 5160151 0 2024-04-25T15:58:18.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/907: fsync d6/d8/d32/f41 0 2024-04-25T15:58:18.134 INFO:tasks.workunit.client.0.smithi087.stdout:3/914: mknod d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/c113 0 2024-04-25T15:58:18.135 INFO:tasks.workunit.client.0.smithi087.stdout:9/908: dread d6/d8/d32/f59 [0,4194304] 0 2024-04-25T15:58:18.140 INFO:tasks.workunit.client.0.smithi087.stdout:5/970: dread d9/d2f/d40/d4d/d7b/d5c/d5f/d44/fc3 [0,4194304] 0 2024-04-25T15:58:18.142 INFO:tasks.workunit.client.0.smithi087.stdout:3/915: write d4/d17/d24/d29/d58/dac/f7e [206229,118421] 0 2024-04-25T15:58:18.142 INFO:tasks.workunit.client.0.smithi087.stdout:9/909: dwrite d6/d8/f89 [0,4194304] 0 2024-04-25T15:58:18.144 INFO:tasks.workunit.client.0.smithi087.stdout:3/916: chown d4/d17/d81/da6/d53/d68/de4/l10d 26191803 1 2024-04-25T15:58:18.144 INFO:tasks.workunit.client.0.smithi087.stdout:9/910: chown d6/d8/d12/db7/d3a/d5b/d60/d1d/fe7 46039967 1 2024-04-25T15:58:18.145 INFO:tasks.workunit.client.0.smithi087.stdout:5/971: creat d9/d91/d38/f144 x:0 0 0 2024-04-25T15:58:18.148 INFO:tasks.workunit.client.0.smithi087.stdout:3/917: mknod d4/d17/d81/da6/c114 0 2024-04-25T15:58:18.149 INFO:tasks.workunit.client.0.smithi087.stdout:7/711: sync 2024-04-25T15:58:18.149 INFO:tasks.workunit.client.0.smithi087.stdout:9/911: mkdir d6/d8/d12/db7/d124 0 2024-04-25T15:58:18.149 INFO:tasks.workunit.client.0.smithi087.stdout:3/918: chown d4/d17/d24/d29/d58/dac/dc0/d3c/lff 19129 1 2024-04-25T15:58:18.154 INFO:tasks.workunit.client.0.smithi087.stdout:3/919: creat d4/d17/d24/d29/d58/dac/dc0/f115 x:0 0 0 2024-04-25T15:58:18.157 INFO:tasks.workunit.client.0.smithi087.stdout:3/920: mknod d4/d17/d24/d29/d58/dac/dc0/d3c/d62/db2/c116 0 2024-04-25T15:58:18.160 INFO:tasks.workunit.client.0.smithi087.stdout:7/712: dread d1/d4/d18/d36/d5d/f8d [0,4194304] 0 2024-04-25T15:58:18.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/713: chown d1/d3c/d6b/l8a 208923464 1 2024-04-25T15:58:18.163 INFO:tasks.workunit.client.0.smithi087.stdout:7/714: getdents d1/d4/dbc/dd9 0 2024-04-25T15:58:18.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/972: write d9/d91/f65 [5003923,38336] 0 2024-04-25T15:58:18.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/912: write d6/d8/d32/f4d [568964,104264] 0 2024-04-25T15:58:18.165 INFO:tasks.workunit.client.0.smithi087.stdout:7/715: symlink d1/d4/dbc/dd9/ldf 0 2024-04-25T15:58:18.166 INFO:tasks.workunit.client.0.smithi087.stdout:9/913: chown d6/d8/d32/d4c/caf 91909382 1 2024-04-25T15:58:18.168 INFO:tasks.workunit.client.0.smithi087.stdout:3/921: truncate d4/d17/d24/d29/d58/dac/dc0/d3c/f4b 3646698 0 2024-04-25T15:58:18.168 INFO:tasks.workunit.client.0.smithi087.stdout:9/914: chown d6/d8/d32/d57/c62 601496089 1 2024-04-25T15:58:18.169 INFO:tasks.workunit.client.0.smithi087.stdout:5/973: mkdir d9/d91/d30/d70/d79/d7d/d145 0 2024-04-25T15:58:18.169 INFO:tasks.workunit.client.0.smithi087.stdout:9/915: chown d6/d8/d12/db7/l3d 3 1 2024-04-25T15:58:18.170 INFO:tasks.workunit.client.0.smithi087.stdout:7/716: link d1/d3c/daa/fcc d1/d4/dcf/d45/fe0 0 2024-04-25T15:58:18.171 INFO:tasks.workunit.client.0.smithi087.stdout:3/922: symlink d4/d17/d24/d29/d107/l117 0 2024-04-25T15:58:18.172 INFO:tasks.workunit.client.0.smithi087.stdout:9/916: symlink d6/d8/d32/d57/dbf/l125 0 2024-04-25T15:58:18.177 INFO:tasks.workunit.client.0.smithi087.stdout:9/917: symlink d6/d8/d12/db7/d3a/d5b/d60/d81/d85/l126 0 2024-04-25T15:58:18.179 INFO:tasks.workunit.client.0.smithi087.stdout:7/717: getdents d1/d4/d18/d36/d5d 0 2024-04-25T15:58:18.180 INFO:tasks.workunit.client.0.smithi087.stdout:7/718: stat d1/d3c/fc5 0 2024-04-25T15:58:18.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/923: link d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/le0 d4/d17/d24/d29/d58/dac/dc0/d5c/l118 0 2024-04-25T15:58:18.181 INFO:tasks.workunit.client.0.smithi087.stdout:3/924: chown d4/d17/d81/da6/d53/d7d/fcb 2815520 1 2024-04-25T15:58:18.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/925: rename d4/d17/d81/da6/d53/d68/de4/dd3/d108 to d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/d10f/d119 0 2024-04-25T15:58:18.187 INFO:tasks.workunit.client.0.smithi087.stdout:5/974: write d9/d91/d30/d70/f8e [247520,46371] 0 2024-04-25T15:58:18.190 INFO:tasks.workunit.client.0.smithi087.stdout:3/926: rmdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62/db2 39 2024-04-25T15:58:18.191 INFO:tasks.workunit.client.0.smithi087.stdout:3/927: chown d4/d17/d81/da6/f55 0 1 2024-04-25T15:58:18.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/719: write d1/d9f/f5e [22910,106233] 0 2024-04-25T15:58:18.193 INFO:tasks.workunit.client.0.smithi087.stdout:3/928: truncate d4/d17/d24/d29/d58/dac/dc0/d5c/da5/fee 334553 0 2024-04-25T15:58:18.194 INFO:tasks.workunit.client.0.smithi087.stdout:7/720: chown d1/d3c/daa/ccd 4720 1 2024-04-25T15:58:18.194 INFO:tasks.workunit.client.0.smithi087.stdout:5/975: getdents d9/d91/d30/d56/d101 0 2024-04-25T15:58:18.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/929: read - d4/d17/d81/da6/d53/d68/de4/dd3/dec/fb1 zero size 2024-04-25T15:58:18.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/721: symlink d1/le1 0 2024-04-25T15:58:18.200 INFO:tasks.workunit.client.0.smithi087.stdout:3/930: rename d4/d17/d81/da6/d23/l80 to d4/d17/d24/d29/d58/dac/dc0/l11a 0 2024-04-25T15:58:18.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/976: dwrite d9/f21 [0,4194304] 0 2024-04-25T15:58:18.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/722: creat d1/d3c/fe2 x:0 0 0 2024-04-25T15:58:18.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/931: rmdir d4/d17/d24/d29/d58 39 2024-04-25T15:58:18.205 INFO:tasks.workunit.client.0.smithi087.stdout:7/723: stat d1/d4/dcf/d45/f61 0 2024-04-25T15:58:18.206 INFO:tasks.workunit.client.0.smithi087.stdout:3/932: dread - d4/d17/d24/d29/d58/dac/d99/fcc zero size 2024-04-25T15:58:18.208 INFO:tasks.workunit.client.0.smithi087.stdout:7/724: creat d1/d3c/d6b/fe3 x:0 0 0 2024-04-25T15:58:18.208 INFO:tasks.workunit.client.0.smithi087.stdout:3/933: fdatasync d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fbd 0 2024-04-25T15:58:18.209 INFO:tasks.workunit.client.0.smithi087.stdout:7/725: chown d1/d3c/daa/ccd 1 1 2024-04-25T15:58:18.213 INFO:tasks.workunit.client.0.smithi087.stdout:3/934: rename d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/da1/lae to d4/d17/d81/da6/d53/d7d/l11b 0 2024-04-25T15:58:18.214 INFO:tasks.workunit.client.0.smithi087.stdout:3/935: fsync d4/d17/f1b 0 2024-04-25T15:58:18.215 INFO:tasks.workunit.client.0.smithi087.stdout:5/977: dwrite d9/f2a [0,4194304] 0 2024-04-25T15:58:18.217 INFO:tasks.workunit.client.0.smithi087.stdout:7/726: dwrite d1/d4/f3d [0,4194304] 0 2024-04-25T15:58:18.220 INFO:tasks.workunit.client.0.smithi087.stdout:7/727: fsync d1/f8 0 2024-04-25T15:58:18.220 INFO:tasks.workunit.client.0.smithi087.stdout:7/728: rmdir d1/d9/d8e 39 2024-04-25T15:58:18.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/729: mkdir d1/d4/dcf/d45/de4 0 2024-04-25T15:58:18.224 INFO:tasks.workunit.client.0.smithi087.stdout:3/936: getdents d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9 0 2024-04-25T15:58:18.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/730: write d1/d3c/d6b/fdb [389687,3976] 0 2024-04-25T15:58:18.225 INFO:tasks.workunit.client.0.smithi087.stdout:7/731: truncate d1/f8 1484178 0 2024-04-25T15:58:18.226 INFO:tasks.workunit.client.0.smithi087.stdout:3/937: write d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fbd [435003,15467] 0 2024-04-25T15:58:18.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/938: dwrite d4/d17/d81/da6/d37/d51/fcf [0,4194304] 0 2024-04-25T15:58:18.242 INFO:tasks.workunit.client.0.smithi087.stdout:3/939: dread d4/db/f6c [0,4194304] 0 2024-04-25T15:58:18.244 INFO:tasks.workunit.client.0.smithi087.stdout:3/940: truncate d4/d17/d81/da6/d53/f75 1003121 0 2024-04-25T15:58:18.245 INFO:tasks.workunit.client.0.smithi087.stdout:3/941: write d4/d17/d24/f32 [432195,72197] 0 2024-04-25T15:58:18.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/942: symlink d4/d17/d81/da6/d53/d68/da2/l11c 0 2024-04-25T15:58:18.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/732: write d1/d4/f40 [5107916,123900] 0 2024-04-25T15:58:18.250 INFO:tasks.workunit.client.0.smithi087.stdout:3/943: write d4/d17/d24/d29/d58/dac/d99/fd1 [24995,130700] 0 2024-04-25T15:58:18.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/944: dread - d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f65 zero size 2024-04-25T15:58:18.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/945: dwrite d4/d17/d81/da6/d53/d68/de4/dd3/dec/fb1 [0,4194304] 0 2024-04-25T15:58:18.269 INFO:tasks.workunit.client.0.smithi087.stdout:3/946: dwrite d4/d17/d81/da6/d53/d68/de4/dd3/dec/da9/fc1 [0,4194304] 0 2024-04-25T15:58:18.273 INFO:tasks.workunit.client.0.smithi087.stdout:3/947: dread d4/d17/d24/d29/d58/f95 [0,4194304] 0 2024-04-25T15:58:18.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/948: dread - d4/d17/d24/d29/fed zero size 2024-04-25T15:58:18.282 INFO:tasks.workunit.client.0.smithi087.stdout:3/949: creat d4/d17/f11d x:0 0 0 2024-04-25T15:58:18.298 INFO:tasks.workunit.client.0.smithi087.stdout:9/918: sync 2024-04-25T15:58:18.302 INFO:tasks.workunit.client.0.smithi087.stdout:9/919: dread d6/d8/d48/f6e [0,4194304] 0 2024-04-25T15:58:18.303 INFO:tasks.workunit.client.0.smithi087.stdout:9/920: dread - d6/d8/d12/db7/d3a/d5b/d60/d81/f10f zero size 2024-04-25T15:58:18.306 INFO:tasks.workunit.client.0.smithi087.stdout:9/921: mknod d6/c127 0 2024-04-25T15:58:18.307 INFO:tasks.workunit.client.0.smithi087.stdout:3/950: chown d4/d17/d81/da6/d37/d51/lad 75 1 2024-04-25T15:58:18.308 INFO:tasks.workunit.client.0.smithi087.stdout:9/922: mkdir d6/d8/d32/d57/dbf/d128 0 2024-04-25T15:58:18.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/951: truncate d4/db/fda 4133331 0 2024-04-25T15:58:18.338 INFO:tasks.workunit.client.0.smithi087.stdout:9/923: dwrite d6/d8/d12/db7/d3a/d58/d72/f87 [0,4194304] 0 2024-04-25T15:58:18.341 INFO:tasks.workunit.client.0.smithi087.stdout:9/924: write d6/d8/d12/db7/d3a/d5b/d60/d81/ffd [1815564,67167] 0 2024-04-25T15:58:18.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/925: unlink d6/d8/d12/f5a 0 2024-04-25T15:58:18.354 INFO:tasks.workunit.client.0.smithi087.stdout:3/952: link d4/d17/d24/d29/d58/dac/dc0/d3c/f9d d4/d17/d24/d29/d58/dac/dc0/d5c/f11e 0 2024-04-25T15:58:18.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/926: mkdir d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d129 0 2024-04-25T15:58:18.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/953: truncate d4/d17/d24/d29/d58/dac/dc0/d82/f10a 216832 0 2024-04-25T15:58:18.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/954: write d4/d17/d81/da6/d53/d68/f92 [2144706,66579] 0 2024-04-25T15:58:18.364 INFO:tasks.workunit.client.0.smithi087.stdout:9/927: creat d6/f12a x:0 0 0 2024-04-25T15:58:18.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/978: sync 2024-04-25T15:58:18.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/979: chown d9/d2f/d40/d4d/d7b/d74/d83/fd8 559067883 1 2024-04-25T15:58:18.371 INFO:tasks.workunit.client.0.smithi087.stdout:3/955: getdents d4/d17/d81/da6/d53/d68/de4/dd3/dec 0 2024-04-25T15:58:18.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/980: dread - d9/d2f/d40/d4d/d7b/d8f/fe3 zero size 2024-04-25T15:58:18.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/981: rmdir d9/d91/d30/d70/d79/d94 39 2024-04-25T15:58:18.374 INFO:tasks.workunit.client.0.smithi087.stdout:3/956: mknod d4/d17/d81/da6/d53/d68/de4/c11f 0 2024-04-25T15:58:18.377 INFO:tasks.workunit.client.0.smithi087.stdout:3/957: mkdir d4/d17/d81/da6/d53/d120 0 2024-04-25T15:58:18.382 INFO:tasks.workunit.client.0.smithi087.stdout:5/982: write d9/d91/d30/d55/fa0 [823274,123868] 0 2024-04-25T15:58:18.383 INFO:tasks.workunit.client.0.smithi087.stdout:3/958: write d4/d17/d81/fb0 [392280,91825] 0 2024-04-25T15:58:18.386 INFO:tasks.workunit.client.0.smithi087.stdout:3/959: mknod d4/c121 0 2024-04-25T15:58:18.387 INFO:tasks.workunit.client.0.smithi087.stdout:5/983: creat d9/d2f/d40/d4d/d7b/d5c/d5f/d44/f146 x:0 0 0 2024-04-25T15:58:18.389 INFO:tasks.workunit.client.0.smithi087.stdout:5/984: read d9/d2f/d40/d4d/d7b/d5c/d5f/de8/f8d [3171200,20504] 0 2024-04-25T15:58:18.390 INFO:tasks.workunit.client.0.smithi087.stdout:3/960: dread d4/d17/d24/d29/d58/f95 [0,4194304] 0 2024-04-25T15:58:18.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/985: dwrite d9/d2f/d40/d4d/d7b/d8f/d11f/f127 [0,4194304] 0 2024-04-25T15:58:18.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/961: truncate d4/f2c 863448 0 2024-04-25T15:58:18.401 INFO:tasks.workunit.client.0.smithi087.stdout:3/962: symlink d4/d17/d24/l122 0 2024-04-25T15:58:18.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/963: symlink d4/d17/d81/da6/d53/d7d/l123 0 2024-04-25T15:58:18.405 INFO:tasks.workunit.client.0.smithi087.stdout:5/986: dwrite d9/d91/d38/fd1 [0,4194304] 0 2024-04-25T15:58:18.406 INFO:tasks.workunit.client.0.smithi087.stdout:5/987: write d9/d91/fe0 [2111581,59620] 0 2024-04-25T15:58:18.409 INFO:tasks.workunit.client.0.smithi087.stdout:3/964: creat d4/d17/d81/da6/d53/f124 x:0 0 0 2024-04-25T15:58:18.410 INFO:tasks.workunit.client.0.smithi087.stdout:3/965: chown d4/d17/d81/da6/d37/d51/fce 1 1 2024-04-25T15:58:18.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/988: creat d9/d2f/d40/d4d/de1/f147 x:0 0 0 2024-04-25T15:58:18.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/966: creat d4/d17/f125 x:0 0 0 2024-04-25T15:58:18.415 INFO:tasks.workunit.client.0.smithi087.stdout:5/989: symlink d9/d2f/d40/d4d/d7b/d8f/d11f/d135/l148 0 2024-04-25T15:58:18.416 INFO:tasks.workunit.client.0.smithi087.stdout:5/990: creat d9/d2f/d40/f149 x:0 0 0 2024-04-25T15:58:18.417 INFO:tasks.workunit.client.0.smithi087.stdout:3/967: mkdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94/d126 0 2024-04-25T15:58:18.420 INFO:tasks.workunit.client.0.smithi087.stdout:5/991: unlink d9/d2f/d3b/f89 0 2024-04-25T15:58:18.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/992: unlink d9/d2f/d40/f149 0 2024-04-25T15:58:18.424 INFO:tasks.workunit.client.0.smithi087.stdout:5/993: dread d9/d2f/d3b/fef [0,4194304] 0 2024-04-25T15:58:18.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/994: chown d9/d91/d30/d70/d79/dae/de4/f118 19253 1 2024-04-25T15:58:18.427 INFO:tasks.workunit.client.0.smithi087.stdout:5/995: dread - d9/d91/d30/d70/d79/dae/ff0 zero size 2024-04-25T15:58:18.430 INFO:tasks.workunit.client.0.smithi087.stdout:5/996: unlink d9/d91/d30/d70/d82/fa4 0 2024-04-25T15:58:18.431 INFO:tasks.workunit.client.0.smithi087.stdout:5/997: creat d9/d91/d30/f14a x:0 0 0 2024-04-25T15:58:18.433 INFO:tasks.workunit.client.0.smithi087.stdout:5/998: write d9/d2f/d3b/fef [183886,95852] 0 2024-04-25T15:58:18.437 INFO:tasks.workunit.client.0.smithi087.stdout:5/999: creat d9/d91/f14b x:0 0 0 2024-04-25T15:58:18.437 INFO:tasks.workunit.client.0.smithi087.stdout:3/968: dwrite d4/d17/f63 [0,4194304] 0 2024-04-25T15:58:18.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/969: creat d4/d17/d81/da6/d53/d68/de4/f127 x:0 0 0 2024-04-25T15:58:18.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/970: dread d4/d17/d81/da6/d53/fdf [0,4194304] 0 2024-04-25T15:58:18.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/971: unlink d4/d17/d81/da6/d53/c6b 0 2024-04-25T15:58:18.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/972: dwrite d4/d17/d24/d29/fd5 [4194304,4194304] 0 2024-04-25T15:58:18.457 INFO:tasks.workunit.client.0.smithi087.stdout:3/973: link l0 d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/da1/l128 0 2024-04-25T15:58:18.460 INFO:tasks.workunit.client.0.smithi087.stdout:3/974: mkdir d4/d17/d81/da6/d53/d68/de4/dd3/d129 0 2024-04-25T15:58:18.464 INFO:tasks.workunit.client.0.smithi087.stdout:3/975: creat d4/d17/d24/d29/d58/dac/dc0/f12a x:0 0 0 2024-04-25T15:58:18.466 INFO:tasks.workunit.client.0.smithi087.stdout:7/733: sync 2024-04-25T15:58:18.466 INFO:tasks.workunit.client.0.smithi087.stdout:3/976: mknod d4/d17/d24/d29/d58/dac/dc0/d3c/d62/db2/c12b 0 2024-04-25T15:58:18.467 INFO:tasks.workunit.client.0.smithi087.stdout:7/734: readlink d1/l21 0 2024-04-25T15:58:18.468 INFO:tasks.workunit.client.0.smithi087.stdout:3/977: stat d4/d17/d24/d29/d58/dac/dc0/d3c/d62/f64 0 2024-04-25T15:58:18.469 INFO:tasks.workunit.client.0.smithi087.stdout:7/735: mkdir d1/d4/d18/d98/de5 0 2024-04-25T15:58:18.470 INFO:tasks.workunit.client.0.smithi087.stdout:3/978: rmdir d4/d17/d24/d29/d58/dac/d99 39 2024-04-25T15:58:18.472 INFO:tasks.workunit.client.0.smithi087.stdout:3/979: fdatasync d4/d17/d81/da6/d37/d51/fce 0 2024-04-25T15:58:18.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/980: symlink d4/d17/d81/da6/d37/d51/l12c 0 2024-04-25T15:58:18.475 INFO:tasks.workunit.client.0.smithi087.stdout:7/736: dwrite d1/d1a/f50 [0,4194304] 0 2024-04-25T15:58:18.478 INFO:tasks.workunit.client.0.smithi087.stdout:3/981: mkdir d4/d17/d81/da6/d12d 0 2024-04-25T15:58:18.479 INFO:tasks.workunit.client.0.smithi087.stdout:7/737: mknod d1/d4/dbc/dd9/ce6 0 2024-04-25T15:58:18.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/982: creat d4/d17/d24/d29/d58/dac/dc0/d5c/da5/f12e x:0 0 0 2024-04-25T15:58:18.484 INFO:tasks.workunit.client.0.smithi087.stdout:3/983: stat d4/d17/d81/da6/d53/d68/de4/dd3/dec/da0/f110 0 2024-04-25T15:58:18.487 INFO:tasks.workunit.client.0.smithi087.stdout:3/984: symlink d4/d17/d81/da6/d53/d120/l12f 0 2024-04-25T15:58:18.491 INFO:tasks.workunit.client.0.smithi087.stdout:7/738: dread d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:18.492 INFO:tasks.workunit.client.0.smithi087.stdout:3/985: truncate d4/d17/d24/d29/d58/dac/dc0/d5c/f77 1572739 0 2024-04-25T15:58:18.493 INFO:tasks.workunit.client.0.smithi087.stdout:7/739: symlink d1/d9/le7 0 2024-04-25T15:58:18.495 INFO:tasks.workunit.client.0.smithi087.stdout:7/740: fsync d1/f74 0 2024-04-25T15:58:18.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/986: fdatasync d4/d17/d24/d29/d58/dac/d99/fa4 0 2024-04-25T15:58:18.499 INFO:tasks.workunit.client.0.smithi087.stdout:7/741: unlink d1/d3c/f64 0 2024-04-25T15:58:18.502 INFO:tasks.workunit.client.0.smithi087.stdout:7/742: rename d1/d4/dcf/d45/f5c to d1/d4/d7e/fe8 0 2024-04-25T15:58:18.506 INFO:tasks.workunit.client.0.smithi087.stdout:7/743: rename d1/d3c/da3 to d1/d3c/de9 0 2024-04-25T15:58:18.507 INFO:tasks.workunit.client.0.smithi087.stdout:7/744: dread - d1/d4/d18/d36/d5d/daf/fb0 zero size 2024-04-25T15:58:18.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/745: write d1/d1a/f50 [4693322,86810] 0 2024-04-25T15:58:18.511 INFO:tasks.workunit.client.0.smithi087.stdout:7/746: link d1/d3c/d6b/f79 d1/d4/d18/fea 0 2024-04-25T15:58:18.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/747: chown d1/d4/c49 1620820462 1 2024-04-25T15:58:18.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/748: creat d1/d1a/feb x:0 0 0 2024-04-25T15:58:18.519 INFO:tasks.workunit.client.0.smithi087.stdout:7/749: mkdir d1/d4/d18/d98/de5/dec 0 2024-04-25T15:58:18.519 INFO:tasks.workunit.client.0.smithi087.stdout:7/750: chown d1/d1a/f85 8160 1 2024-04-25T15:58:18.521 INFO:tasks.workunit.client.0.smithi087.stdout:7/751: symlink d1/d3c/de9/dac/led 0 2024-04-25T15:58:18.522 INFO:tasks.workunit.client.0.smithi087.stdout:7/752: fsync d1/d9/f92 0 2024-04-25T15:58:18.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/753: rmdir d1/d9/dda 0 2024-04-25T15:58:18.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/754: readlink d1/d4/dcf/lce 0 2024-04-25T15:58:18.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/755: write d1/d4/f69 [4873752,69610] 0 2024-04-25T15:58:18.532 INFO:tasks.workunit.client.0.smithi087.stdout:7/756: dwrite d1/d3c/f6e [0,4194304] 0 2024-04-25T15:58:18.536 INFO:tasks.workunit.client.0.smithi087.stdout:7/757: mknod d1/d3c/d6b/da1/db1/cee 0 2024-04-25T15:58:18.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/758: chown d1/d3c/de9/fb8 17071 1 2024-04-25T15:58:18.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/759: chown d1/d3c/daa/fcc 1 1 2024-04-25T15:58:18.542 INFO:tasks.workunit.client.0.smithi087.stdout:7/760: creat d1/d3c/daa/fef x:0 0 0 2024-04-25T15:58:18.545 INFO:tasks.workunit.client.0.smithi087.stdout:7/761: unlink d1/d3c/d6b/da1/db1/fbb 0 2024-04-25T15:58:18.547 INFO:tasks.workunit.client.0.smithi087.stdout:7/762: mknod d1/cf0 0 2024-04-25T15:58:18.547 INFO:tasks.workunit.client.0.smithi087.stdout:7/763: stat d1/d4/dcf/f30 0 2024-04-25T15:58:18.581 INFO:tasks.workunit.client.0.smithi087.stdout:9/928: sync 2024-04-25T15:58:18.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/987: sync 2024-04-25T15:58:18.669 INFO:tasks.workunit.client.0.smithi087.stdout:3/988: write d4/db/fe [1563730,12952] 0 2024-04-25T15:58:18.673 INFO:tasks.workunit.client.0.smithi087.stdout:3/989: mkdir d4/d17/d24/d29/d130 0 2024-04-25T15:58:18.690 INFO:tasks.workunit.client.0.smithi087.stdout:3/990: dwrite d4/db/fda [0,4194304] 0 2024-04-25T15:58:18.697 INFO:tasks.workunit.client.0.smithi087.stdout:3/991: creat d4/d17/d81/da6/f131 x:0 0 0 2024-04-25T15:58:18.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/764: sync 2024-04-25T15:58:18.708 INFO:tasks.workunit.client.0.smithi087.stdout:9/929: sync 2024-04-25T15:58:18.712 INFO:tasks.workunit.client.0.smithi087.stdout:7/765: symlink d1/d1a/lf1 0 2024-04-25T15:58:18.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/992: dread d4/d17/d24/d29/d58/dac/d9c/fab [0,4194304] 0 2024-04-25T15:58:18.735 INFO:tasks.workunit.client.0.smithi087.stdout:7/766: dread d1/d4/da5/fa6 [4194304,4194304] 0 2024-04-25T15:58:18.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/993: write d4/d17/d24/d29/d58/dac/d99/fcc [444597,84353] 0 2024-04-25T15:58:18.740 INFO:tasks.workunit.client.0.smithi087.stdout:9/930: dread d6/d8/d12/db7/d3a/d5b/d60/fe2 [0,4194304] 0 2024-04-25T15:58:18.740 INFO:tasks.workunit.client.0.smithi087.stdout:7/767: unlink d1/d3c/d6b/f84 0 2024-04-25T15:58:18.743 INFO:tasks.workunit.client.0.smithi087.stdout:9/931: write d6/d8/d32/d4c/fb1 [2034471,113975] 0 2024-04-25T15:58:18.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/994: mknod d4/d17/d81/da6/d9b/c132 0 2024-04-25T15:58:18.750 INFO:tasks.workunit.client.0.smithi087.stdout:7/768: rename d1/fd4 to d1/d4/d18/d98/de5/dec/ff2 0 2024-04-25T15:58:18.752 INFO:tasks.workunit.client.0.smithi087.stdout:7/769: fdatasync d1/d3c/d6b/fe3 0 2024-04-25T15:58:18.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/770: truncate d1/d1a/f66 602348 0 2024-04-25T15:58:18.766 INFO:tasks.workunit.client.0.smithi087.stdout:3/995: dwrite d4/d17/d24/d29/fa7 [0,4194304] 0 2024-04-25T15:58:18.774 INFO:tasks.workunit.client.0.smithi087.stdout:3/996: dread d4/d17/d24/d29/d58/dac/d99/fa4 [0,4194304] 0 2024-04-25T15:58:18.774 INFO:tasks.workunit.client.0.smithi087.stdout:9/932: dwrite d6/d8/d12/db7/d3a/d7c/fcf [0,4194304] 0 2024-04-25T15:58:18.776 INFO:tasks.workunit.client.0.smithi087.stdout:7/771: dwrite f0 [4194304,4194304] 0 2024-04-25T15:58:18.782 INFO:tasks.workunit.client.0.smithi087.stdout:9/933: symlink d6/d8/d32/d57/d66/d75/l12b 0 2024-04-25T15:58:18.784 INFO:tasks.workunit.client.0.smithi087.stdout:3/997: read d4/d17/d24/d29/f97 [390947,74768] 0 2024-04-25T15:58:18.789 INFO:tasks.workunit.client.0.smithi087.stdout:3/998: rmdir d4/d17/d24/d29/d58/dac/dc0/d3c/d62/d94 39 2024-04-25T15:58:18.791 INFO:tasks.workunit.client.0.smithi087.stdout:9/934: getdents d6/d3e/d92 0 2024-04-25T15:58:18.793 INFO:tasks.workunit.client.0.smithi087.stdout:3/999: chown d4/d17/d81/da6/d37/d51/fce 1530643 1 2024-04-25T15:58:18.795 INFO:tasks.workunit.client.0.smithi087.stdout:7/772: dread d1/d4/d7e/f96 [0,4194304] 0 2024-04-25T15:58:18.797 INFO:tasks.workunit.client.0.smithi087.stdout:7/773: rmdir d1/d4/dbc 39 2024-04-25T15:58:18.803 INFO:tasks.workunit.client.0.smithi087.stdout:7/774: dread d1/d9/f9d [0,4194304] 0 2024-04-25T15:58:18.804 INFO:tasks.workunit.client.0.smithi087.stdout:7/775: dread - d1/d9f/f43 zero size 2024-04-25T15:58:18.804 INFO:tasks.workunit.client.0.smithi087.stdout:7/776: chown d1/dd0 32505 1 2024-04-25T15:58:18.811 INFO:tasks.workunit.client.0.smithi087.stdout:7/777: write d1/d4/dcf/f6d [778013,79181] 0 2024-04-25T15:58:18.818 INFO:tasks.workunit.client.0.smithi087.stdout:7/778: dread d1/d4/dcf/d45/fc2 [0,4194304] 0 2024-04-25T15:58:18.819 INFO:tasks.workunit.client.0.smithi087.stdout:9/935: dread d6/d8/d12/db7/d3a/d58/fa3 [0,4194304] 0 2024-04-25T15:58:18.819 INFO:tasks.workunit.client.0.smithi087.stdout:7/779: readlink d1/d4/dcf/d45/la0 0 2024-04-25T15:58:18.821 INFO:tasks.workunit.client.0.smithi087.stdout:7/780: fsync d1/d1a/f62 0 2024-04-25T15:58:18.823 INFO:tasks.workunit.client.0.smithi087.stdout:9/936: getdents d6/d8/d12/db7/da9/d11c 0 2024-04-25T15:58:18.826 INFO:tasks.workunit.client.0.smithi087.stdout:9/937: creat d6/d8/d12/db7/f12c x:0 0 0 2024-04-25T15:58:18.828 INFO:tasks.workunit.client.0.smithi087.stdout:9/938: dread - d6/d8/d12/db7/f115 zero size 2024-04-25T15:58:18.830 INFO:tasks.workunit.client.0.smithi087.stdout:9/939: read d6/f51 [5728384,6105] 0 2024-04-25T15:58:18.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/940: mkdir d6/dea/d12d 0 2024-04-25T15:58:18.836 INFO:tasks.workunit.client.0.smithi087.stdout:9/941: stat d6/d8/d32/d57/d66/da7/da8/c119 0 2024-04-25T15:58:18.836 INFO:tasks.workunit.client.0.smithi087.stdout:7/781: dwrite d1/d1a/f6f [8388608,4194304] 0 2024-04-25T15:58:18.838 INFO:tasks.workunit.client.0.smithi087.stdout:7/782: mknod d1/d3c/de9/dac/cf3 0 2024-04-25T15:58:18.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/942: getdents d6/d8/d32/d57/d66/da7 0 2024-04-25T15:58:18.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/943: fdatasync f2 0 2024-04-25T15:58:18.845 INFO:tasks.workunit.client.0.smithi087.stdout:7/783: write d1/d4/d18/fea [5645198,83063] 0 2024-04-25T15:58:18.849 INFO:tasks.workunit.client.0.smithi087.stdout:7/784: symlink d1/d4/d18/d36/d5d/daf/lf4 0 2024-04-25T15:58:18.853 INFO:tasks.workunit.client.0.smithi087.stdout:7/785: mkdir d1/d9f/df5 0 2024-04-25T15:58:18.858 INFO:tasks.workunit.client.0.smithi087.stdout:9/944: dwrite d6/d8/d12/db7/d3a/d7c/fab [0,4194304] 0 2024-04-25T15:58:18.866 INFO:tasks.workunit.client.0.smithi087.stdout:7/786: dwrite d1/f19 [0,4194304] 0 2024-04-25T15:58:18.870 INFO:tasks.workunit.client.0.smithi087.stdout:7/787: dread d1/d9f/fb9 [0,4194304] 0 2024-04-25T15:58:18.870 INFO:tasks.workunit.client.0.smithi087.stdout:9/945: link d6/f1c d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d129/f12e 0 2024-04-25T15:58:18.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/788: chown d1/d3c/de9/dac/led 837 1 2024-04-25T15:58:18.872 INFO:tasks.workunit.client.0.smithi087.stdout:7/789: chown d1/f70 2752242 1 2024-04-25T15:58:18.876 INFO:tasks.workunit.client.0.smithi087.stdout:9/946: dread d6/d8/d12/db7/d3a/d5b/d60/f86 [0,4194304] 0 2024-04-25T15:58:18.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/947: truncate d6/d8/d32/fc7 8131801 0 2024-04-25T15:58:18.885 INFO:tasks.workunit.client.0.smithi087.stdout:7/790: dread d1/d4/dcf/f53 [0,4194304] 0 2024-04-25T15:58:18.889 INFO:tasks.workunit.client.0.smithi087.stdout:7/791: getdents d1/d9f 0 2024-04-25T15:58:18.890 INFO:tasks.workunit.client.0.smithi087.stdout:7/792: write d1/d4/fbe [624563,96166] 0 2024-04-25T15:58:18.893 INFO:tasks.workunit.client.0.smithi087.stdout:9/948: dread d6/d8/d48/f56 [0,4194304] 0 2024-04-25T15:58:18.897 INFO:tasks.workunit.client.0.smithi087.stdout:9/949: truncate d6/d8/d12/db7/f94 900185 0 2024-04-25T15:58:18.900 INFO:tasks.workunit.client.0.smithi087.stdout:7/793: dwrite d1/d4/dcf/f30 [0,4194304] 0 2024-04-25T15:58:18.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/950: symlink d6/d8/d12/db7/d3a/d5b/d60/d7f/dff/l12f 0 2024-04-25T15:58:18.907 INFO:tasks.workunit.client.0.smithi087.stdout:9/951: creat d6/d8/d12/d11d/f130 x:0 0 0 2024-04-25T15:58:18.911 INFO:tasks.workunit.client.0.smithi087.stdout:7/794: dwrite d1/d4/d18/fea [0,4194304] 0 2024-04-25T15:58:18.919 INFO:tasks.workunit.client.0.smithi087.stdout:7/795: creat d1/d4/dbc/dd9/ff6 x:0 0 0 2024-04-25T15:58:18.920 INFO:tasks.workunit.client.0.smithi087.stdout:7/796: chown d1/l2 935876449 1 2024-04-25T15:58:18.920 INFO:tasks.workunit.client.0.smithi087.stdout:9/952: dwrite d6/d8/d12/db7/d3a/d5b/d60/d81/f10f [0,4194304] 0 2024-04-25T15:58:18.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/953: stat d6/dea/f112 0 2024-04-25T15:58:18.924 INFO:tasks.workunit.client.0.smithi087.stdout:7/797: creat d1/d4/d18/d36/d5d/ff7 x:0 0 0 2024-04-25T15:58:18.927 INFO:tasks.workunit.client.0.smithi087.stdout:9/954: mkdir d6/dea/d12d/d131 0 2024-04-25T15:58:18.932 INFO:tasks.workunit.client.0.smithi087.stdout:7/798: link d1/d9/l9c d1/d1a/d7b/lf8 0 2024-04-25T15:58:18.934 INFO:tasks.workunit.client.0.smithi087.stdout:7/799: truncate d1/d1a/d7b/fc0 497694 0 2024-04-25T15:58:18.935 INFO:tasks.workunit.client.0.smithi087.stdout:7/800: write d1/d3c/fc1 [565069,23948] 0 2024-04-25T15:58:18.936 INFO:tasks.workunit.client.0.smithi087.stdout:9/955: dwrite d6/fa0 [0,4194304] 0 2024-04-25T15:58:18.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/801: chown d1/d9/f92 2410758 1 2024-04-25T15:58:18.940 INFO:tasks.workunit.client.0.smithi087.stdout:9/956: mknod d6/d8/d32/d57/d66/c132 0 2024-04-25T15:58:18.943 INFO:tasks.workunit.client.0.smithi087.stdout:9/957: mkdir d6/d8/d32/d57/d66/da7/d133 0 2024-04-25T15:58:18.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/802: dwrite d1/d3c/fc1 [0,4194304] 0 2024-04-25T15:58:18.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/803: chown d1/d3c/daa/fef 42 1 2024-04-25T15:58:18.958 INFO:tasks.workunit.client.0.smithi087.stdout:9/958: dread d6/d3e/d92/fe3 [0,4194304] 0 2024-04-25T15:58:18.958 INFO:tasks.workunit.client.0.smithi087.stdout:7/804: dwrite d1/d3c/fc5 [0,4194304] 0 2024-04-25T15:58:18.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/805: symlink d1/d1a/d7b/lf9 0 2024-04-25T15:58:18.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/806: chown d1/f8 4587293 1 2024-04-25T15:58:18.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/807: creat d1/d4/d18/d36/d5d/ffa x:0 0 0 2024-04-25T15:58:18.969 INFO:tasks.workunit.client.0.smithi087.stdout:7/808: getdents d1/d3c/d6b/da1 0 2024-04-25T15:58:18.973 INFO:tasks.workunit.client.0.smithi087.stdout:7/809: dread d1/d3c/d6b/f79 [0,4194304] 0 2024-04-25T15:58:18.973 INFO:tasks.workunit.client.0.smithi087.stdout:9/959: truncate d6/d8/d12/db7/d3a/d5b/d60/f95 1840879 0 2024-04-25T15:58:18.976 INFO:tasks.workunit.client.0.smithi087.stdout:9/960: rename d6/l11 to d6/d3e/l134 0 2024-04-25T15:58:18.977 INFO:tasks.workunit.client.0.smithi087.stdout:9/961: read - d6/dea/f122 zero size 2024-04-25T15:58:18.981 INFO:tasks.workunit.client.0.smithi087.stdout:7/810: dwrite d1/d4/d18/d36/d5d/ffa [0,4194304] 0 2024-04-25T15:58:18.983 INFO:tasks.workunit.client.0.smithi087.stdout:9/962: dread d6/fa0 [0,4194304] 0 2024-04-25T15:58:18.985 INFO:tasks.workunit.client.0.smithi087.stdout:9/963: write d6/d8/d12/f37 [1778357,61096] 0 2024-04-25T15:58:18.987 INFO:tasks.workunit.client.0.smithi087.stdout:7/811: dread d1/d4/da5/fa6 [4194304,4194304] 0 2024-04-25T15:58:18.989 INFO:tasks.workunit.client.0.smithi087.stdout:9/964: truncate d6/d8/d12/f2f 3232452 0 2024-04-25T15:58:18.989 INFO:tasks.workunit.client.0.smithi087.stdout:7/812: write d1/d1a/d7b/f8b [742072,45136] 0 2024-04-25T15:58:18.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/813: mkdir d1/d3c/d6b/dfb 0 2024-04-25T15:58:18.994 INFO:tasks.workunit.client.0.smithi087.stdout:9/965: link d6/d8/d32/d4c/db9/fd8 d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d102/d10e/f135 0 2024-04-25T15:58:18.997 INFO:tasks.workunit.client.0.smithi087.stdout:9/966: rmdir d6/d8/d12/db7/d101 0 2024-04-25T15:58:18.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/814: dwrite d1/d4/f40 [0,4194304] 0 2024-04-25T15:58:19.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/967: fdatasync d6/d8/d12/db7/d3a/d5b/d60/d1d/f2d 0 2024-04-25T15:58:19.001 INFO:tasks.workunit.client.0.smithi087.stdout:9/968: dread - d6/d8/d32/d4c/db9/fd8 zero size 2024-04-25T15:58:19.005 INFO:tasks.workunit.client.0.smithi087.stdout:7/815: link d1/d9/d8e/l9e d1/d4/dbc/lfc 0 2024-04-25T15:58:19.006 INFO:tasks.workunit.client.0.smithi087.stdout:7/816: write d1/d1a/f97 [8408731,130996] 0 2024-04-25T15:58:19.010 INFO:tasks.workunit.client.0.smithi087.stdout:9/969: link d6/f121 d6/d8/d12/db7/d3a/d5b/d60/d1d/f136 0 2024-04-25T15:58:19.011 INFO:tasks.workunit.client.0.smithi087.stdout:7/817: mkdir d1/d3c/d6b/da1/db1/dfd 0 2024-04-25T15:58:19.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/970: truncate d6/d3e/d63/dc2/dde/f11e 892471 0 2024-04-25T15:58:19.013 INFO:tasks.workunit.client.0.smithi087.stdout:9/971: read - d6/d8/d12/db7/d3a/d58/d7b/f10d zero size 2024-04-25T15:58:19.014 INFO:tasks.workunit.client.0.smithi087.stdout:9/972: chown d6/d8/d32/d57/f110 10318 1 2024-04-25T15:58:19.015 INFO:tasks.workunit.client.0.smithi087.stdout:7/818: getdents d1/d9/d8e 0 2024-04-25T15:58:19.020 INFO:tasks.workunit.client.0.smithi087.stdout:9/973: dwrite d6/d3e/fbb [0,4194304] 0 2024-04-25T15:58:19.026 INFO:tasks.workunit.client.0.smithi087.stdout:9/974: getdents d6/d8/d32/d4c/db9 0 2024-04-25T15:58:19.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/975: dwrite d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/d102/d10e/f135 [0,4194304] 0 2024-04-25T15:58:19.049 INFO:tasks.workunit.client.0.smithi087.stdout:9/976: rename d6/d3e/d63/dc2/l100 to d6/dea/l137 0 2024-04-25T15:58:19.063 INFO:tasks.workunit.client.0.smithi087.stdout:9/977: truncate d6/f51 1314458 0 2024-04-25T15:58:19.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/978: dwrite d6/d8/d12/f114 [0,4194304] 0 2024-04-25T15:58:19.075 INFO:tasks.workunit.client.0.smithi087.stdout:9/979: creat d6/d3e/d92/f138 x:0 0 0 2024-04-25T15:58:19.083 INFO:tasks.workunit.client.0.smithi087.stdout:9/980: dwrite d6/d8/d12/db7/d3a/fcc [0,4194304] 0 2024-04-25T15:58:19.084 INFO:tasks.workunit.client.0.smithi087.stdout:9/981: chown d6/d8/d32/f41 3 1 2024-04-25T15:58:19.086 INFO:tasks.workunit.client.0.smithi087.stdout:9/982: chown d6/d8/d12/db7/d3a/d5b/d60/dcd/ffe 9640596 1 2024-04-25T15:58:19.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/983: fdatasync d6/d8/d32/d4c/f82 0 2024-04-25T15:58:19.089 INFO:tasks.workunit.client.0.smithi087.stdout:9/984: fsync d6/d8/d12/db7/d3a/d5b/d60/dcd/ffe 0 2024-04-25T15:58:19.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/985: creat d6/d8/d12/db7/d124/f139 x:0 0 0 2024-04-25T15:58:19.095 INFO:tasks.workunit.client.0.smithi087.stdout:9/986: mknod d6/d8/d12/db7/d3a/d5b/d60/c13a 0 2024-04-25T15:58:19.096 INFO:tasks.workunit.client.0.smithi087.stdout:9/987: chown d6/d8/d12/db7/d3a/d5b/d60/d1d/f6c 20558 1 2024-04-25T15:58:19.096 INFO:tasks.workunit.client.0.smithi087.stdout:9/988: readlink d6/d3e/d92/ld9 0 2024-04-25T15:58:19.097 INFO:tasks.workunit.client.0.smithi087.stdout:9/989: chown d6/d8/d12/db7/f73 13612 1 2024-04-25T15:58:19.104 INFO:tasks.workunit.client.0.smithi087.stdout:9/990: dwrite d6/d8/f89 [4194304,4194304] 0 2024-04-25T15:58:19.104 INFO:tasks.workunit.client.0.smithi087.stdout:9/991: truncate d6/dea/f112 1206203 0 2024-04-25T15:58:19.109 INFO:tasks.workunit.client.0.smithi087.stdout:9/992: dread d6/d8/d32/d4c/db9/fd8 [0,4194304] 0 2024-04-25T15:58:19.111 INFO:tasks.workunit.client.0.smithi087.stdout:9/993: fsync d6/d8/d32/d4c/fb1 0 2024-04-25T15:58:19.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/994: rename d6/d8/d32/d4c/f82 to d6/d8/d12/db7/d3a/d58/d7b/f13b 0 2024-04-25T15:58:19.119 INFO:tasks.workunit.client.0.smithi087.stdout:9/995: write d6/f121 [968635,94173] 0 2024-04-25T15:58:19.120 INFO:tasks.workunit.client.0.smithi087.stdout:9/996: stat d6/d8/d32/d4c/db9/d10b 0 2024-04-25T15:58:19.125 INFO:tasks.workunit.client.0.smithi087.stdout:9/997: write d6/d8/d12/db7/d3a/d5b/d60/d81/d85/d99/fe4 [39082,37702] 0 2024-04-25T15:58:19.127 INFO:tasks.workunit.client.0.smithi087.stdout:9/998: unlink d6/d8/d32/fc5 0 2024-04-25T15:58:19.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/999: link d6/d8/d12/db7/d3a/d5b/d60/d81/fb3 d6/d8/d12/db7/d3a/d5b/d60/dcd/d104/f13c 0 2024-04-25T15:58:19.133 INFO:tasks.workunit.client.0.smithi087.stdout:7/819: sync 2024-04-25T15:58:19.136 INFO:tasks.workunit.client.0.smithi087.stdout:7/820: link d1/d9f/fb9 d1/dd0/ffe 0 2024-04-25T15:58:19.136 INFO:tasks.workunit.client.0.smithi087.stdout:7/821: chown d1/d1a/f66 521 1 2024-04-25T15:58:19.138 INFO:tasks.workunit.client.0.smithi087.stdout:7/822: symlink d1/d9f/df5/lff 0 2024-04-25T15:58:19.138 INFO:tasks.workunit.client.0.smithi087.stdout:7/823: chown d1/d3c/d6b/fc6 1813644 1 2024-04-25T15:58:19.140 INFO:tasks.workunit.client.0.smithi087.stdout:7/824: creat d1/d3c/d6b/da1/f100 x:0 0 0 2024-04-25T15:58:19.142 INFO:tasks.workunit.client.0.smithi087.stdout:7/825: read d1/f70 [7605240,114604] 0 2024-04-25T15:58:19.143 INFO:tasks.workunit.client.0.smithi087.stdout:7/826: dread d1/d9f/fb9 [0,4194304] 0 2024-04-25T15:58:19.145 INFO:tasks.workunit.client.0.smithi087.stdout:7/827: mkdir d1/d4/d18/d98/de5/d101 0 2024-04-25T15:58:19.149 INFO:tasks.workunit.client.0.smithi087.stdout:7/828: dread d1/f70 [0,4194304] 0 2024-04-25T15:58:19.152 INFO:tasks.workunit.client.0.smithi087.stdout:7/829: creat d1/d4/dcf/d45/de4/f102 x:0 0 0 2024-04-25T15:58:19.154 INFO:tasks.workunit.client.0.smithi087.stdout:7/830: creat d1/d4/d18/d98/de5/f103 x:0 0 0 2024-04-25T15:58:19.158 INFO:tasks.workunit.client.0.smithi087.stdout:7/831: rmdir d1/d4/dcf/d45/de4 39 2024-04-25T15:58:19.160 INFO:tasks.workunit.client.0.smithi087.stdout:7/832: dread d1/d9f/fb9 [0,4194304] 0 2024-04-25T15:58:19.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/833: readlink d1/d4/dcf/lce 0 2024-04-25T15:58:19.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/834: stat d1/d3c/f5a 0 2024-04-25T15:58:19.163 INFO:tasks.workunit.client.0.smithi087.stdout:7/835: mkdir d1/d3c/de9/dac/d104 0 2024-04-25T15:58:19.170 INFO:tasks.workunit.client.0.smithi087.stdout:7/836: dwrite d1/d4/f40 [4194304,4194304] 0 2024-04-25T15:58:19.174 INFO:tasks.workunit.client.0.smithi087.stdout:7/837: creat d1/d4/dcf/d45/f105 x:0 0 0 2024-04-25T15:58:19.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/838: chown d1/d3c/d6b 1 1 2024-04-25T15:58:19.176 INFO:tasks.workunit.client.0.smithi087.stdout:7/839: truncate d1/d4/f8c 1687837 0 2024-04-25T15:58:19.178 INFO:tasks.workunit.client.0.smithi087.stdout:7/840: symlink d1/d9f/l106 0 2024-04-25T15:58:19.181 INFO:tasks.workunit.client.0.smithi087.stdout:7/841: link d1/d4/d18/fd7 d1/d9/d8e/f107 0 2024-04-25T15:58:19.190 INFO:tasks.workunit.client.0.smithi087.stdout:7/842: dwrite d1/d4/dcf/d45/de4/f102 [0,4194304] 0 2024-04-25T15:58:19.194 INFO:tasks.workunit.client.0.smithi087.stdout:7/843: mkdir d1/d4/d18/dd5/d108 0 2024-04-25T15:58:19.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/844: rename d1/d4/d18/d36/d5d/daf/lf4 to d1/d4/l109 0 2024-04-25T15:58:19.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/845: rmdir d1/d4/dbc/dd9 39 2024-04-25T15:58:19.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/846: fdatasync d1/d4/f8c 0 2024-04-25T15:58:19.208 INFO:tasks.workunit.client.0.smithi087.stdout:7/847: write d1/d9f/fde [273914,93051] 0 2024-04-25T15:58:19.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/848: dwrite d1/d1a/f85 [0,4194304] 0 2024-04-25T15:58:19.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/849: link d1/d4/dcf/c80 d1/d4/d18/d98/de5/d101/c10a 0 2024-04-25T15:58:19.225 INFO:tasks.workunit.client.0.smithi087.stdout:7/850: mkdir d1/d4/dbc/d10b 0 2024-04-25T15:58:19.227 INFO:tasks.workunit.client.0.smithi087.stdout:7/851: symlink d1/d4/d7e/l10c 0 2024-04-25T15:58:19.229 INFO:tasks.workunit.client.0.smithi087.stdout:7/852: mknod d1/d3c/c10d 0 2024-04-25T15:58:19.233 INFO:tasks.workunit.client.0.smithi087.stdout:7/853: dread d1/f70 [0,4194304] 0 2024-04-25T15:58:19.235 INFO:tasks.workunit.client.0.smithi087.stdout:7/854: rmdir d1/dd0 39 2024-04-25T15:58:19.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/855: dwrite d1/d3c/f6e [4194304,4194304] 0 2024-04-25T15:58:19.259 INFO:tasks.workunit.client.0.smithi087.stdout:7/856: dwrite d1/d4/d18/d36/f95 [0,4194304] 0 2024-04-25T15:58:19.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/857: creat d1/d4/dcf/d45/f10e x:0 0 0 2024-04-25T15:58:19.269 INFO:tasks.workunit.client.0.smithi087.stdout:7/858: getdents d1/d3c/daa 0 2024-04-25T15:58:19.272 INFO:tasks.workunit.client.0.smithi087.stdout:7/859: getdents d1/d4/d18/dd5 0 2024-04-25T15:58:19.275 INFO:tasks.workunit.client.0.smithi087.stdout:7/860: creat d1/d9f/df5/f10f x:0 0 0 2024-04-25T15:58:19.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/861: link d1/d3c/daa/ccd d1/d4/d18/d98/c110 0 2024-04-25T15:58:19.280 INFO:tasks.workunit.client.0.smithi087.stdout:7/862: write f0 [6497448,95025] 0 2024-04-25T15:58:19.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/863: symlink d1/d4/d18/dd5/d108/l111 0 2024-04-25T15:58:19.296 INFO:tasks.workunit.client.0.smithi087.stdout:7/864: dread f0 [4194304,4194304] 0 2024-04-25T15:58:19.323 INFO:tasks.workunit.client.0.smithi087.stdout:7/865: creat d1/d4/d18/d36/d5d/daf/f112 x:0 0 0 2024-04-25T15:58:19.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:58:19.334 INFO:tasks.workunit.client.0.smithi087.stdout:7/866: link d1/d4/f8c d1/dd0/f113 0 2024-04-25T15:58:19.342 INFO:tasks.workunit.client.0.smithi087.stdout:7/867: rename d1/d4/d18/cb3 to d1/d3c/d6b/da1/db1/c114 0 2024-04-25T15:58:19.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/868: rename d1/d4/c67 to d1/d4/dbc/dd9/c115 0 2024-04-25T15:58:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 Processor -- start 2024-04-25T15:58:19.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 -- start start 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79a81529a0 0x7f79a8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a80c4e30 con 0x7f79a80ad990 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f79a80ae1b0 con 0x7f79a81529a0 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79afaf5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79a8072430 con 0x7f79a80adda0 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79a81529a0 0x7f79a8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79a81529a0 0x7f79a8071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56548/0 (socket says 172.21.15.87:56548) 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 -- 172.21.15.87:0/4224706234 learned_addr learned my addr 172.21.15.87:0/4224706234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ae092640 1 --2- 172.21.15.87:0/4224706234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 -- 172.21.15.87:0/4224706234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 msgr2=0x7f79a80c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:58:19.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 --2- 172.21.15.87:0/4224706234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a80c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 -- 172.21.15.87:0/4224706234 >> v1:172.21.15.155:6789/0 conn(0x7f79a80ad990 legacy=0x7f79a80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:19.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.478+0000 7f79ad891640 1 -- 172.21.15.87:0/4224706234 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a8074730 con 0x7f79a81529a0 2024-04-25T15:58:19.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79ad891640 1 --2- 172.21.15.87:0/4224706234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a81529a0 0x7f79a8071e50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009870 tx=0x7f79a401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5707125946707a3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:19.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79ac88f640 1 -- 172.21.15.87:0/4224706234 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40b0070 con 0x7f79a81529a0 2024-04-25T15:58:19.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79ac88f640 1 -- 172.21.15.87:0/4224706234 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a40ab600 con 0x7f79a81529a0 2024-04-25T15:58:19.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79ac88f640 1 -- 172.21.15.87:0/4224706234 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40ab9d0 con 0x7f79a81529a0 2024-04-25T15:58:19.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 -- 172.21.15.87:0/4224706234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a81529a0 msgr2=0x7f79a8071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:19.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 --2- 172.21.15.87:0/4224706234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a81529a0 0x7f79a8071e50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009870 tx=0x7f79a401c360 comp rx=0 tx=0).stop 2024-04-25T15:58:19.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 -- 172.21.15.87:0/4224706234 shutdown_connections 2024-04-25T15:58:19.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 --2- 172.21.15.87:0/4224706234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a80c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 --2- 172.21.15.87:0/4224706234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a81529a0 0x7f79a8071e50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 -- 172.21.15.87:0/4224706234 >> 172.21.15.87:0/4224706234 conn(0x7f79a80c8770 msgr2=0x7f79a80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:19.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 -- 172.21.15.87:0/4224706234 shutdown_connections 2024-04-25T15:58:19.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.482+0000 7f79afaf5640 1 -- 172.21.15.87:0/4224706234 wait complete. 2024-04-25T15:58:19.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 Processor -- start 2024-04-25T15:58:19.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- start start 2024-04-25T15:58:19.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 0x7f79a8156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:19.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:19.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79a81529a0 0x7f79a814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:19.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79a81622f0 con 0x7f79a80ad990 2024-04-25T15:58:19.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79a80ab1a0 con 0x7f79a81529a0 2024-04-25T15:58:19.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79a8162470 con 0x7f79a80adda0 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 0x7f79a8156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 0x7f79a8156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56560/0 (socket says 172.21.15.87:56560) 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 -- 172.21.15.87:0/3981691261 learned_addr learned my addr 172.21.15.87:0/3981691261 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ae092640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79a81529a0 0x7f79a814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad090640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 -- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 msgr2=0x7f79a814e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a814e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 -- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79a81529a0 msgr2=0x7f79a814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79a81529a0 0x7f79a814a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 -- 172.21.15.87:0/3981691261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a8156450 con 0x7f79a80ad990 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79ad891640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 0x7f79a8156c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f79a40ae040 tx=0x7f79a401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40ba020 con 0x7f79a80ad990 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a40b6420 con 0x7f79a80ad990 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a81585d0 con 0x7f79a80ad990 2024-04-25T15:58:19.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40b0040 con 0x7f79a80ad990 2024-04-25T15:58:19.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a8158b90 con 0x7f79a80ad990 2024-04-25T15:58:19.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.486+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a8069bb0 con 0x7f79a80ad990 2024-04-25T15:58:19.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.490+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f79a40bd020 con 0x7f79a80ad990 2024-04-25T15:58:19.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.490+0000 7f799e7fc640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f798c06f430 0x7f798c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:58:19.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.490+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f79a41297f0 con 0x7f79a80ad990 2024-04-25T15:58:19.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.490+0000 7f79ad090640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f798c06f430 0x7f798c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:58:19.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.490+0000 7f79ad090640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f798c06f430 0x7f798c071940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79a8071f50 tx=0x7f7998009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:58:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.494+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79a40c4030 con 0x7f79a80ad990 2024-04-25T15:58:19.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/869: sync 2024-04-25T15:58:19.510 INFO:tasks.workunit.client.0.smithi087.stdout:7/870: dread - d1/d4/d18/d36/d5d/daf/f112 zero size 2024-04-25T15:58:19.512 INFO:tasks.workunit.client.0.smithi087.stdout:7/871: mknod d1/d1a/d7b/c116 0 2024-04-25T15:58:19.513 INFO:tasks.workunit.client.0.smithi087.stdout:7/872: chown d1/d1a/feb 181379870 1 2024-04-25T15:58:19.513 INFO:tasks.workunit.client.0.smithi087.stdout:7/873: chown d1/d3c/de9/cdc 28 1 2024-04-25T15:58:19.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/874: creat d1/d3c/d6b/da1/db1/f117 x:0 0 0 2024-04-25T15:58:19.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/875: write d1/d9/f65 [6355733,110104] 0 2024-04-25T15:58:19.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/876: chown d1/d3c/d6b/da1/db1/dfd 1773141 1 2024-04-25T15:58:19.552 INFO:tasks.workunit.client.0.smithi087.stdout:7/877: write d1/d1a/f39 [1171422,85985] 0 2024-04-25T15:58:19.559 INFO:tasks.workunit.client.0.smithi087.stdout:7/878: dwrite d1/d3c/fe2 [0,4194304] 0 2024-04-25T15:58:19.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/879: unlink d1/d3c/daa/fef 0 2024-04-25T15:58:19.575 INFO:tasks.workunit.client.0.smithi087.stdout:7/880: dwrite d1/d4/dcf/d45/fc2 [0,4194304] 0 2024-04-25T15:58:19.576 INFO:tasks.workunit.client.0.smithi087.stdout:7/881: write d1/d4/d18/d36/d5d/ffa [4978969,48319] 0 2024-04-25T15:58:19.579 INFO:tasks.workunit.client.0.smithi087.stdout:7/882: creat d1/d3c/d6b/da1/f118 x:0 0 0 2024-04-25T15:58:19.586 INFO:tasks.workunit.client.0.smithi087.stdout:7/883: dwrite d1/d4/dcf/f30 [4194304,4194304] 0 2024-04-25T15:58:19.593 INFO:tasks.workunit.client.0.smithi087.stdout:7/884: dwrite d1/d1a/f6f [0,4194304] 0 2024-04-25T15:58:19.598 INFO:tasks.workunit.client.0.smithi087.stdout:7/885: unlink d1/d4/d18/c59 0 2024-04-25T15:58:19.600 INFO:tasks.workunit.client.0.smithi087.stdout:7/886: creat d1/d4/d18/f119 x:0 0 0 2024-04-25T15:58:19.602 INFO:tasks.workunit.client.0.smithi087.stdout:7/887: unlink d1/d4/f40 0 2024-04-25T15:58:19.603 INFO:tasks.workunit.client.0.smithi087.stdout:7/888: dread - d1/d3c/d6b/da1/f118 zero size 2024-04-25T15:58:19.623 INFO:tasks.workunit.client.0.smithi087.stdout:7/889: dread d1/d3c/de9/fb8 [0,4194304] 0 2024-04-25T15:58:19.624 INFO:tasks.workunit.client.0.smithi087.stdout:7/890: fsync d1/d4/d18/d98/de5/f103 0 2024-04-25T15:58:19.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/891: write d1/d9/d8e/f107 [13009,20787] 0 2024-04-25T15:58:19.633 INFO:tasks.workunit.client.0.smithi087.stdout:7/892: fsync d1/d1a/d7b/f8b 0 2024-04-25T15:58:19.637 INFO:tasks.workunit.client.0.smithi087.stdout:7/893: getdents d1/d4/d18/d36 0 2024-04-25T15:58:19.638 INFO:tasks.workunit.client.0.smithi087.stdout:7/894: mknod d1/d4/d18/c11a 0 2024-04-25T15:58:19.640 INFO:tasks.workunit.client.0.smithi087.stdout:7/895: symlink d1/d9/d8e/l11b 0 2024-04-25T15:58:19.641 INFO:tasks.workunit.client.0.smithi087.stdout:7/896: chown d1/d1a/d7b/c116 1 1 2024-04-25T15:58:19.649 INFO:tasks.workunit.client.0.smithi087.stdout:7/897: dwrite d1/d4/dcf/f53 [0,4194304] 0 2024-04-25T15:58:19.651 INFO:tasks.workunit.client.0.smithi087.stdout:7/898: write d1/d4/dbc/dd9/ff6 [481736,91753] 0 2024-04-25T15:58:19.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/899: mknod d1/d3c/c11c 0 2024-04-25T15:58:19.656 INFO:tasks.workunit.client.0.smithi087.stdout:7/900: mkdir d1/d4/dcf/d45/de4/d11d 0 2024-04-25T15:58:19.658 INFO:tasks.workunit.client.0.smithi087.stdout:7/901: write d1/d4/da5/fa6 [2829750,3857] 0 2024-04-25T15:58:19.665 INFO:tasks.workunit.client.0.smithi087.stdout:7/902: dwrite d1/d4/dcf/f38 [0,4194304] 0 2024-04-25T15:58:19.669 INFO:tasks.workunit.client.0.smithi087.stdout:7/903: mkdir d1/d4/dcf/d11e 0 2024-04-25T15:58:19.671 INFO:tasks.workunit.client.0.smithi087.stdout:7/904: write d1/d4/dcf/d45/f10e [924792,17690] 0 2024-04-25T15:58:19.673 INFO:tasks.workunit.client.0.smithi087.stdout:7/905: write d1/d4/d18/fea [3606254,107905] 0 2024-04-25T15:58:19.674 INFO:tasks.workunit.client.0.smithi087.stdout:7/906: write d1/dd0/ffe [2951534,54993] 0 2024-04-25T15:58:19.674 INFO:tasks.workunit.client.0.smithi087.stdout:7/907: read d1/f70 [3245969,87739] 0 2024-04-25T15:58:19.690 INFO:tasks.workunit.client.0.smithi087.stdout:7/908: truncate d1/d4/f3d 376692 0 2024-04-25T15:58:19.694 INFO:tasks.workunit.client.0.smithi087.stdout:7/909: rename d1/d9f/f73 to d1/d4/d18/d98/de5/d101/f11f 0 2024-04-25T15:58:19.696 INFO:tasks.workunit.client.0.smithi087.stdout:7/910: link d1/d4/d7e/f96 d1/d9/f120 0 2024-04-25T15:58:19.698 INFO:tasks.workunit.client.0.smithi087.stdout:7/911: write d1/d1a/f66 [93912,15174] 0 2024-04-25T15:58:19.700 INFO:tasks.workunit.client.0.smithi087.stdout:7/912: write d1/d3c/f6e [3498774,100101] 0 2024-04-25T15:58:19.700 INFO:tasks.workunit.client.0.smithi087.stdout:7/913: dread - d1/d1a/feb zero size 2024-04-25T15:58:19.717 INFO:tasks.workunit.client.0.smithi087.stdout:7/914: dread d1/d4/f10 [0,4194304] 0 2024-04-25T15:58:19.719 INFO:tasks.workunit.client.0.smithi087.stdout:7/915: creat d1/d3c/d6b/da1/f121 x:0 0 0 2024-04-25T15:58:19.720 INFO:tasks.workunit.client.0.smithi087.stdout:7/916: symlink d1/d1a/d7b/l122 0 2024-04-25T15:58:19.722 INFO:tasks.workunit.client.0.smithi087.stdout:7/917: creat d1/d4/d18/d98/de5/dec/f123 x:0 0 0 2024-04-25T15:58:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.718+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79a8156620 con 0x7f79a80ad990 2024-04-25T15:58:19.723 INFO:tasks.workunit.client.0.smithi087.stdout:7/918: fdatasync d1/d4/d18/d36/d5d/ff7 0 2024-04-25T15:58:19.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.718+0000 7f799e7fc640 1 -- 172.21.15.87:0/3981691261 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f79a4016070 con 0x7f79a80ad990 2024-04-25T15:58:19.724 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:58:19.724 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:58:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f798c06f430 msgr2=0x7f798c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f798c06f430 0x7f798c071940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79a8071f50 tx=0x7f7998009040 comp rx=0 tx=0).stop 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 msgr2=0x7f79a8156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 0x7f79a8156c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f79a40ae040 tx=0x7f79a401aba0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 shutdown_connections 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f798c06f430 0x7f798c071940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79a81529a0 0x7f79a814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79a80adda0 0x7f79a814e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 --2- 172.21.15.87:0/3981691261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79a80ad990 0x7f79a8156c40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:58:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 >> 172.21.15.87:0/3981691261 conn(0x7f79a80c8770 msgr2=0x7f79a806ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:58:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 shutdown_connections 2024-04-25T15:58:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:58:19.722+0000 7f79afaf5640 1 -- 172.21.15.87:0/3981691261 wait complete. 2024-04-25T15:58:19.728 INFO:tasks.workunit.client.0.smithi087.stdout:7/919: rename d1/d3c/d6b/da1/db1/cee to d1/d3c/c124 0 2024-04-25T15:58:19.728 INFO:tasks.workunit.client.0.smithi087.stdout:7/920: readlink d1/d4/dcf/d45/la0 0 2024-04-25T15:58:19.740 INFO:tasks.workunit.client.0.smithi087.stdout:7/921: truncate d1/d4/f3d 624163 0 2024-04-25T15:58:19.744 INFO:tasks.workunit.client.0.smithi087.stdout:7/922: dread d1/d3c/de9/fb8 [4194304,4194304] 0 2024-04-25T15:58:19.746 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-04-25T15:58:19.747 INFO:tasks.mds_thrash.fs.[b]:waiting for 59 secs before thrashing 2024-04-25T15:58:19.749 INFO:tasks.workunit.client.0.smithi087.stdout:7/923: dread d1/d4/dcf/d45/de4/f102 [0,4194304] 0 2024-04-25T15:58:19.751 INFO:tasks.workunit.client.0.smithi087.stdout:7/924: creat d1/d4/dbc/d10b/f125 x:0 0 0 2024-04-25T15:58:19.752 INFO:tasks.workunit.client.0.smithi087.stdout:7/925: symlink d1/d3c/l126 0 2024-04-25T15:58:19.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/926: dread d1/d3c/f6e [4194304,4194304] 0 2024-04-25T15:58:19.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/927: stat d1/d3c/d6b/da1/db1/c114 0 2024-04-25T15:58:19.758 INFO:tasks.workunit.client.0.smithi087.stdout:7/928: read - d1/d4/d18/d36/d5d/fb6 zero size 2024-04-25T15:58:19.773 INFO:tasks.workunit.client.0.smithi087.stdout:7/929: dread d1/d4/d18/d36/f71 [0,4194304] 0 2024-04-25T15:58:19.776 INFO:tasks.workunit.client.0.smithi087.stdout:7/930: link d1/d4/dcf/d45/fc2 d1/d1a/d7b/f127 0 2024-04-25T15:58:19.778 INFO:tasks.workunit.client.0.smithi087.stdout:7/931: creat d1/d3c/d6b/dfb/f128 x:0 0 0 2024-04-25T15:58:19.780 INFO:tasks.workunit.client.0.smithi087.stdout:7/932: creat d1/d3c/d6b/dfb/f129 x:0 0 0 2024-04-25T15:58:19.782 INFO:tasks.workunit.client.0.smithi087.stdout:7/933: creat d1/d4/d18/d98/f12a x:0 0 0 2024-04-25T15:58:19.783 INFO:tasks.workunit.client.0.smithi087.stdout:7/934: creat d1/d3c/d6b/f12b x:0 0 0 2024-04-25T15:58:19.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/935: symlink d1/d4/d18/d36/l12c 0 2024-04-25T15:58:19.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/936: dread - d1/d3c/d6b/dfb/f129 zero size 2024-04-25T15:58:19.789 INFO:tasks.workunit.client.0.smithi087.stdout:7/937: dread d1/d4/f47 [0,4194304] 0 2024-04-25T15:58:19.790 INFO:tasks.workunit.client.0.smithi087.stdout:7/938: mknod d1/d4/c12d 0 2024-04-25T15:58:19.793 INFO:tasks.workunit.client.0.smithi087.stdout:7/939: symlink d1/d4/d18/d98/l12e 0 2024-04-25T15:58:19.794 INFO:tasks.workunit.client.0.smithi087.stdout:7/940: symlink d1/d1a/l12f 0 2024-04-25T15:58:19.796 INFO:tasks.workunit.client.0.smithi087.stdout:7/941: mknod d1/d4/dcf/d45/c130 0 2024-04-25T15:58:19.805 INFO:tasks.workunit.client.0.smithi087.stdout:7/942: chown d1/d4/d18/d36/la2 79 1 2024-04-25T15:58:19.808 INFO:tasks.workunit.client.0.smithi087.stdout:7/943: write f0 [1659361,21205] 0 2024-04-25T15:58:19.810 INFO:tasks.workunit.client.0.smithi087.stdout:7/944: symlink d1/d9/l131 0 2024-04-25T15:58:19.814 INFO:tasks.workunit.client.0.smithi087.stdout:7/945: rename d1/d4/f3d to d1/d3c/f132 0 2024-04-25T15:58:19.816 INFO:tasks.workunit.client.0.smithi087.stdout:7/946: symlink d1/d4/dcf/d45/l133 0 2024-04-25T15:58:19.818 INFO:tasks.workunit.client.0.smithi087.stdout:7/947: fdatasync d1/d9f/fb9 0 2024-04-25T15:58:19.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/948: dwrite d1/d4/d18/d36/fa8 [0,4194304] 0 2024-04-25T15:58:19.837 INFO:tasks.workunit.client.0.smithi087.stdout:7/949: dwrite d1/d9f/f43 [0,4194304] 0 2024-04-25T15:58:19.841 INFO:tasks.workunit.client.0.smithi087.stdout:7/950: unlink d1/d3c/d6b/da1/db1/fc9 0 2024-04-25T15:58:19.842 INFO:tasks.workunit.client.0.smithi087.stdout:7/951: symlink d1/d4/d18/d98/l134 0 2024-04-25T15:58:19.844 INFO:tasks.workunit.client.0.smithi087.stdout:7/952: symlink d1/d3c/d6b/l135 0 2024-04-25T15:58:19.846 INFO:tasks.workunit.client.0.smithi087.stdout:7/953: mkdir d1/d3c/de9/dac/d136 0 2024-04-25T15:58:19.848 INFO:tasks.workunit.client.0.smithi087.stdout:7/954: truncate d1/d1a/d7b/f127 2988050 0 2024-04-25T15:58:19.849 INFO:tasks.workunit.client.0.smithi087.stdout:7/955: dread - d1/d1a/feb zero size 2024-04-25T15:58:19.855 INFO:tasks.workunit.client.0.smithi087.stdout:7/956: dread d1/d1a/f39 [0,4194304] 0 2024-04-25T15:58:19.860 INFO:tasks.workunit.client.0.smithi087.stdout:7/957: link d1/d4/dcf/c57 d1/d9f/c137 0 2024-04-25T15:58:19.875 INFO:tasks.workunit.client.0.smithi087.stdout:7/958: dwrite d1/d4/d18/d98/de5/d101/f11f [0,4194304] 0 2024-04-25T15:58:19.878 INFO:tasks.workunit.client.0.smithi087.stdout:7/959: truncate d1/d9/f9d 807700 0 2024-04-25T15:58:19.879 INFO:tasks.workunit.client.0.smithi087.stdout:7/960: rmdir d1/d4/d18/d98 39 2024-04-25T15:58:19.883 INFO:tasks.workunit.client.0.smithi087.stdout:7/961: creat d1/d4/dcf/f138 x:0 0 0 2024-04-25T15:58:19.885 INFO:tasks.workunit.client.0.smithi087.stdout:7/962: truncate d1/d1a/d7b/fc0 1154010 0 2024-04-25T15:58:19.887 INFO:tasks.workunit.client.0.smithi087.stdout:7/963: chown d1/d4/d18/d36/fb4 6179484 1 2024-04-25T15:58:19.894 INFO:tasks.workunit.client.0.smithi087.stdout:7/964: write d1/d3c/fc1 [4783365,76103] 0 2024-04-25T15:58:19.896 INFO:tasks.workunit.client.0.smithi087.stdout:7/965: write d1/d3c/de9/fb8 [7137698,93160] 0 2024-04-25T15:58:19.907 INFO:tasks.workunit.client.0.smithi087.stdout:7/966: dwrite d1/d4/f8c [0,4194304] 0 2024-04-25T15:58:19.908 INFO:tasks.workunit.client.0.smithi087.stdout:7/967: fdatasync d1/d3c/fe2 0 2024-04-25T15:58:19.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/968: dwrite d1/d9f/f43 [0,4194304] 0 2024-04-25T15:58:19.920 INFO:tasks.workunit.client.0.smithi087.stdout:7/969: mkdir d1/d4/da5/d139 0 2024-04-25T15:58:20.086 INFO:tasks.workunit.client.0.smithi087.stdout:7/970: sync 2024-04-25T15:58:20.091 INFO:tasks.workunit.client.0.smithi087.stdout:7/971: truncate d1/d4/d18/d36/d5d/daf/f112 584174 0 2024-04-25T15:58:20.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/972: creat d1/d3c/de9/dac/f13a x:0 0 0 2024-04-25T15:58:20.104 INFO:tasks.workunit.client.0.smithi087.stdout:7/973: dread d1/f8 [0,4194304] 0 2024-04-25T15:58:20.108 INFO:tasks.workunit.client.0.smithi087.stdout:7/974: readlink d1/d4/l109 0 2024-04-25T15:58:20.110 INFO:tasks.workunit.client.0.smithi087.stdout:7/975: mknod d1/d3c/de9/c13b 0 2024-04-25T15:58:20.115 INFO:tasks.workunit.client.0.smithi087.stdout:7/976: mknod d1/d4/dcf/d45/c13c 0 2024-04-25T15:58:20.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/977: sync 2024-04-25T15:58:20.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/978: dwrite d1/d4/da5/fa6 [8388608,4194304] 0 2024-04-25T15:58:20.210 INFO:tasks.workunit.client.0.smithi087.stdout:7/979: dread d1/d4/f8c [0,4194304] 0 2024-04-25T15:58:20.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/980: truncate d1/d3c/d6b/da1/f118 850895 0 2024-04-25T15:58:20.218 INFO:tasks.workunit.client.0.smithi087.stdout:7/981: chown d1/d4/dcf/d45/c4e 274085468 1 2024-04-25T15:58:20.220 INFO:tasks.workunit.client.0.smithi087.stdout:7/982: chown d1/d4/dcf/c57 2 1 2024-04-25T15:58:20.225 INFO:tasks.workunit.client.0.smithi087.stdout:7/983: symlink d1/d4/da5/d139/l13d 0 2024-04-25T15:58:20.245 INFO:tasks.workunit.client.0.smithi087.stdout:7/984: dwrite d1/d1a/d7b/f127 [0,4194304] 0 2024-04-25T15:58:20.261 INFO:tasks.workunit.client.0.smithi087.stdout:7/985: fsync d1/dd0/ffe 0 2024-04-25T15:58:20.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/986: readlink d1/d3c/de9/lbd 0 2024-04-25T15:58:20.274 INFO:tasks.workunit.client.0.smithi087.stdout:7/987: dread d1/d3c/fc1 [0,4194304] 0 2024-04-25T15:58:20.278 INFO:tasks.workunit.client.0.smithi087.stdout:7/988: mknod d1/d4/dbc/d10b/c13e 0 2024-04-25T15:58:20.280 INFO:tasks.workunit.client.0.smithi087.stdout:7/989: mknod d1/d4/da5/c13f 0 2024-04-25T15:58:20.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/990: truncate d1/d4/da5/fa6 568320 0 2024-04-25T15:58:20.332 INFO:tasks.workunit.client.0.smithi087.stdout:7/991: mkdir d1/d3c/de9/dac/d104/d140 0 2024-04-25T15:58:20.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/992: rmdir d1/d4/dbc/d10b 39 2024-04-25T15:58:20.366 INFO:tasks.workunit.client.0.smithi087.stdout:7/993: dwrite d1/d1a/f6f [0,4194304] 0 2024-04-25T15:58:20.376 INFO:tasks.workunit.client.0.smithi087.stdout:7/994: dread - d1/d4/d18/d36/d5d/daf/fb0 zero size 2024-04-25T15:58:20.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/995: readlink d1/d4/d18/d98/l134 0 2024-04-25T15:58:20.421 INFO:tasks.workunit.client.0.smithi087.stdout:7/996: dwrite d1/d3c/f58 [0,4194304] 0 2024-04-25T15:58:20.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/997: getdents d1/d4/dcf 0 2024-04-25T15:58:20.468 INFO:tasks.workunit.client.0.smithi087.stdout:7/998: dwrite d1/d4/d18/d36/f68 [0,4194304] 0 2024-04-25T15:58:20.470 INFO:tasks.workunit.client.0.smithi087.stdout:7/999: chown d1/d4/dcf/f38 33749314 1 2024-04-25T15:58:20.474 INFO:tasks.workunit.client.0.smithi087.stderr:+ rm -rf -- ./tmp.MQgXrN9THQ 2024-04-25T15:58:25.364 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T15:58:25.364 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-25T15:58:35.174 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T15:58:35.174 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T15:58:39.856 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:39.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:05.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.746+0000 7f9900042640 1 Processor -- start 2024-04-25T15:59:05.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.746+0000 7f9900042640 1 -- start start 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f9900042640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f98f8160e60 0x7f98f8163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f9900042640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f80c5120 con 0x7f98f80c4250 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f9900042640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f80c4b60 con 0x7f98f815ac30 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f9900042640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f98f80c3b20 con 0x7f98f8160e60 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fddde640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f98f80c4250 0x7f98f806ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53930/0 (socket says 172.21.15.87:53930) 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fddde640 1 -- 172.21.15.87:0/199293681 learned_addr learned my addr 172.21.15.87:0/199293681 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:05.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fe5df640 1 --2- 172.21.15.87:0/199293681 >> v2:172.21.15.155:3300/0 conn(0x7f98f8160e60 0x7f98f8163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172840480 0 0) 0x7f98f4001120 con 0x7f98f80c4250 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e4003530 con 0x7f98f80c4250 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106341558 0 0) 0x7f98f80c4b60 con 0x7f98f815ac30 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f4001120 con 0x7f98f815ac30 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fe5df640 1 -- 172.21.15.87:0/199293681 >> v1:172.21.15.155:6789/0 conn(0x7f98f815ac30 legacy=0x7f98f815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fe5df640 1 -- 172.21.15.87:0/199293681 >> v1:172.21.15.87:6789/0 conn(0x7f98f80c4250 legacy=0x7f98f806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:05.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.750+0000 7f98fe5df640 1 -- 172.21.15.87:0/199293681 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f80c4e40 con 0x7f98f8160e60 2024-04-25T15:59:05.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f98fe5df640 1 --2- 172.21.15.87:0/199293681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f8160e60 0x7f98f8163280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009d90 tx=0x7f98f001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ce01c544780dc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:05.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00b2070 con 0x7f98f8160e60 2024-04-25T15:59:05.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f00a57c0 con 0x7f98f8160e60 2024-04-25T15:59:05.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f98fcddc640 1 -- 172.21.15.87:0/199293681 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00a5b70 con 0x7f98f8160e60 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 -- 172.21.15.87:0/199293681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f8160e60 msgr2=0x7f98f8163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 --2- 172.21.15.87:0/199293681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f8160e60 0x7f98f8163280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009d90 tx=0x7f98f001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 -- 172.21.15.87:0/199293681 shutdown_connections 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 --2- 172.21.15.87:0/199293681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f8160e60 0x7f98f8163280 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 -- 172.21.15.87:0/199293681 >> 172.21.15.87:0/199293681 conn(0x7f98f806d780 msgr2=0x7f98f806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 -- 172.21.15.87:0/199293681 shutdown_connections 2024-04-25T15:59:05.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 -- 172.21.15.87:0/199293681 wait complete. 2024-04-25T15:59:05.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 Processor -- start 2024-04-25T15:59:05.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.754+0000 7f9900042640 1 -- start start 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f80c4250 0x7f98f815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 0x7f98f8162490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f8160e60 0x7f98f814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98f815b8d0 con 0x7f98f815ac30 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98f815b750 con 0x7f98f80c4250 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f98f8155100 con 0x7f98f8160e60 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 0x7f98f8162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 0x7f98f8162490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47578/0 (socket says 172.21.15.87:47578) 2024-04-25T15:59:05.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fddde640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f80c4250 0x7f98f815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 -- 172.21.15.87:0/1046653367 learned_addr learned my addr 172.21.15.87:0/1046653367 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 -- 172.21.15.87:0/1046653367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f8160e60 msgr2=0x7f98f814d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f8160e60 0x7f98f814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 -- 172.21.15.87:0/1046653367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f80c4250 msgr2=0x7f98f815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f80c4250 0x7f98f815cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 -- 172.21.15.87:0/1046653367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f8150c00 con 0x7f98f815ac30 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98fd5dd640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 0x7f98f8162490 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c460 tx=0x7f98e800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8017070 con 0x7f98f815ac30 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e80052f0 con 0x7f98f815ac30 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f8163290 con 0x7f98f815ac30 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8003840 con 0x7f98f815ac30 2024-04-25T15:59:05.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f815c080 con 0x7f98f815ac30 2024-04-25T15:59:05.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8069bb0 con 0x7f98f815ac30 2024-04-25T15:59:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f98e801a070 con 0x7f98f815ac30 2024-04-25T15:59:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.758+0000 7f98ee7fc640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f98dc06f400 0x7f98dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.762+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f98e808eab0 con 0x7f98f815ac30 2024-04-25T15:59:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.762+0000 7f98fddde640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f98dc06f400 0x7f98dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:05.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.762+0000 7f98fddde640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f98dc06f400 0x7f98dc071910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f98f4007fd0 tx=0x7f98f4007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:05.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:05.766+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98e805aee0 con 0x7f98f815ac30 2024-04-25T15:59:06.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.002+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98f8154930 con 0x7f98f815ac30 2024-04-25T15:59:06.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.002+0000 7f98ee7fc640 1 -- 172.21.15.87:0/1046653367 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f98e805f1e0 con 0x7f98f815ac30 2024-04-25T15:59:06.005 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:06.005 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:06.005 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:06.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f98dc06f400 msgr2=0x7f98dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f98dc06f400 0x7f98dc071910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f98f4007fd0 tx=0x7f98f4007d60 comp rx=0 tx=0).stop 2024-04-25T15:59:06.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 msgr2=0x7f98f8162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 0x7f98f8162490 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c460 tx=0x7f98e800c920 comp rx=0 tx=0).stop 2024-04-25T15:59:06.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 shutdown_connections 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f98dc06f400 0x7f98dc071910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f8160e60 0x7f98f814d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98f815ac30 0x7f98f8162490 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 --2- 172.21.15.87:0/1046653367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f80c4250 0x7f98f815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 >> 172.21.15.87:0/1046653367 conn(0x7f98f806d780 msgr2=0x7f98f8160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 shutdown_connections 2024-04-25T15:59:06.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.006+0000 7f9900042640 1 -- 172.21.15.87:0/1046653367 wait complete. 2024-04-25T15:59:06.025 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-04-25T15:59:06.026 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T15:59:06.026 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:59:06.042 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T15:59:06.042 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:06.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 Processor -- start 2024-04-25T15:59:06.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 -- start start 2024-04-25T15:59:06.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63240c92b0 0x7f63240c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:06.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240cac60 0x7f63240cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240c7d40 con 0x7f6324154ae0 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f632415a9e0 con 0x7f63240c92b0 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f632afcc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f632415ac30 con 0x7f63240cac60 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63240c92b0 0x7f63240c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63240c92b0 0x7f63240c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47594/0 (socket says 172.21.15.87:47594) 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 -- 172.21.15.87:0/3043259456 learned_addr learned my addr 172.21.15.87:0/3043259456 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6329569640 1 --2- 172.21.15.87:0/3043259456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240cac60 0x7f63240cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 -- 172.21.15.87:0/3043259456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240cac60 msgr2=0x7f63240cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 --2- 172.21.15.87:0/3043259456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240cac60 0x7f63240cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 -- 172.21.15.87:0/3043259456 >> v1:172.21.15.155:6789/0 conn(0x7f6324154ae0 legacy=0x7f6324157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.174+0000 7f6323fff640 1 -- 172.21.15.87:0/3043259456 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632415af10 con 0x7f63240c92b0 2024-04-25T15:59:06.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f6323fff640 1 --2- 172.21.15.87:0/3043259456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240c92b0 0x7f63240c96c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6310009870 tx=0x7f631001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1b92fcfc32c246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:06.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f63237fe640 1 -- 172.21.15.87:0/3043259456 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b1070 con 0x7f63240c92b0 2024-04-25T15:59:06.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f63237fe640 1 -- 172.21.15.87:0/3043259456 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63100a8050 con 0x7f63240c92b0 2024-04-25T15:59:06.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f63237fe640 1 -- 172.21.15.87:0/3043259456 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100ac860 con 0x7f63240c92b0 2024-04-25T15:59:06.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 -- 172.21.15.87:0/3043259456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240c92b0 msgr2=0x7f63240c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 --2- 172.21.15.87:0/3043259456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240c92b0 0x7f63240c96c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6310009870 tx=0x7f631001c4d0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 -- 172.21.15.87:0/3043259456 shutdown_connections 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 --2- 172.21.15.87:0/3043259456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240cac60 0x7f63240cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 --2- 172.21.15.87:0/3043259456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240c92b0 0x7f63240c96c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 -- 172.21.15.87:0/3043259456 >> 172.21.15.87:0/3043259456 conn(0x7f63240ae490 msgr2=0x7f63240ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 -- 172.21.15.87:0/3043259456 shutdown_connections 2024-04-25T15:59:06.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.178+0000 7f632afcc640 1 -- 172.21.15.87:0/3043259456 wait complete. 2024-04-25T15:59:06.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 Processor -- start 2024-04-25T15:59:06.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- start start 2024-04-25T15:59:06.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240c92b0 0x7f6324155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:06.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 0x7f6324159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6324154ae0 0x7f632414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f63240b2300 con 0x7f63240cac60 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f63240c7b20 con 0x7f6324154ae0 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63240b2480 con 0x7f63240c92b0 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 0x7f6324159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 0x7f6324159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47604/0 (socket says 172.21.15.87:47604) 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 -- 172.21.15.87:0/944638788 learned_addr learned my addr 172.21.15.87:0/944638788 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6329569640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6324154ae0 0x7f632414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6328d68640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240c92b0 0x7f6324155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 -- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240c92b0 msgr2=0x7f6324155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240c92b0 0x7f6324155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 -- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6324154ae0 msgr2=0x7f632414b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6324154ae0 0x7f632414b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 -- 172.21.15.87:0/944638788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6324159290 con 0x7f63240cac60 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f6323fff640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 0x7f6324159bd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f631001a100 tx=0x7f631001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b1040 con 0x7f63240cac60 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63100bc070 con 0x7f63240cac60 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632414c350 con 0x7f63240cac60 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100b7690 con 0x7f63240cac60 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63241f1a10 con 0x7f63240cac60 2024-04-25T15:59:06.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6324069bb0 con 0x7f63240cac60 2024-04-25T15:59:06.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.182+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f63100b7830 con 0x7f63240cac60 2024-04-25T15:59:06.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.186+0000 7f63217fa640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f630806f430 0x7f6308071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:06.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.186+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f6310129510 con 0x7f63240cac60 2024-04-25T15:59:06.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.186+0000 7f6328d68640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f630806f430 0x7f6308071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:06.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.186+0000 7f6328d68640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f630806f430 0x7f6308071940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6318001770 tx=0x7f6318009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:06.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.190+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6310016150 con 0x7f63240cac60 2024-04-25T15:59:06.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.386+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63240c8fc0 con 0x7f63240cac60 2024-04-25T15:59:06.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f63217fa640 1 -- 172.21.15.87:0/944638788 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f63100fe0a0 con 0x7f63240cac60 2024-04-25T15:59:06.390 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:06.390 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:06.390 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f630806f430 msgr2=0x7f6308071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f630806f430 0x7f6308071940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6318001770 tx=0x7f6318009040 comp rx=0 tx=0).stop 2024-04-25T15:59:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 msgr2=0x7f6324159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 0x7f6324159bd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f631001a100 tx=0x7f631001ad10 comp rx=0 tx=0).stop 2024-04-25T15:59:06.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 shutdown_connections 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f630806f430 0x7f6308071940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6324154ae0 0x7f632414b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63240cac60 0x7f6324159bd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 --2- 172.21.15.87:0/944638788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63240c92b0 0x7f6324155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 >> 172.21.15.87:0/944638788 conn(0x7f63240ae490 msgr2=0x7f63241620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 shutdown_connections 2024-04-25T15:59:06.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:06.390+0000 7f632afcc640 1 -- 172.21.15.87:0/944638788 wait complete. 2024-04-25T15:59:06.409 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:08.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:08.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.570+0000 7efd6d547640 1 Processor -- start 2024-04-25T15:59:08.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.570+0000 7efd6d547640 1 -- start start 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd6d547640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd681518b0 0x7efd6806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd6d547640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd680ad160 0x7efd680c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd6d547640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd68154fc0 con 0x7efd680c4620 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd6d547640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efd6806ed60 con 0x7efd680ad160 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd6d547640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd680acb20 con 0x7efd681518b0 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd680ad160 0x7efd680c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:08.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd680ad160 0x7efd680c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47616/0 (socket says 172.21.15.87:47616) 2024-04-25T15:59:08.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 -- 172.21.15.87:0/803998359 learned_addr learned my addr 172.21.15.87:0/803998359 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:08.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd66ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd681518b0 0x7efd6806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:08.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 -- 172.21.15.87:0/803998359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd681518b0 msgr2=0x7efd6806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:08.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 --2- 172.21.15.87:0/803998359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd681518b0 0x7efd6806f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 -- 172.21.15.87:0/803998359 >> v1:172.21.15.155:6789/0 conn(0x7efd680c4620 legacy=0x7efd68157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:08.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.574+0000 7efd5e7fc640 1 -- 172.21.15.87:0/803998359 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd680ace00 con 0x7efd680ad160 2024-04-25T15:59:08.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd5e7fc640 1 --2- 172.21.15.87:0/803998359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680ad160 0x7efd680c40e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efd5000bb10 tx=0x7efd5001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b9fe5b5eedc8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:08.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd667fc640 1 -- 172.21.15.87:0/803998359 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500b4070 con 0x7efd680ad160 2024-04-25T15:59:08.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd667fc640 1 -- 172.21.15.87:0/803998359 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd500a7d20 con 0x7efd680ad160 2024-04-25T15:59:08.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd667fc640 1 -- 172.21.15.87:0/803998359 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500af660 con 0x7efd680ad160 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 -- 172.21.15.87:0/803998359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680ad160 msgr2=0x7efd680c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 --2- 172.21.15.87:0/803998359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680ad160 0x7efd680c40e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efd5000bb10 tx=0x7efd5001ec30 comp rx=0 tx=0).stop 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 -- 172.21.15.87:0/803998359 shutdown_connections 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 --2- 172.21.15.87:0/803998359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680ad160 0x7efd680c40e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 --2- 172.21.15.87:0/803998359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd681518b0 0x7efd6806f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 -- 172.21.15.87:0/803998359 >> 172.21.15.87:0/803998359 conn(0x7efd680c8770 msgr2=0x7efd680c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:08.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 -- 172.21.15.87:0/803998359 shutdown_connections 2024-04-25T15:59:08.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.578+0000 7efd6d547640 1 -- 172.21.15.87:0/803998359 wait complete. 2024-04-25T15:59:08.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 Processor -- start 2024-04-25T15:59:08.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- start start 2024-04-25T15:59:08.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680ad160 0x7efd68151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:08.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 0x7efd68149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:08.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd681518b0 0x7efd68147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:08.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efd680c3330 con 0x7efd680c4620 2024-04-25T15:59:08.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd680c31b0 con 0x7efd681518b0 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd680c34b0 con 0x7efd680ad160 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 0x7efd68149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 0x7efd68149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47622/0 (socket says 172.21.15.87:47622) 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 -- 172.21.15.87:0/1112393283 learned_addr learned my addr 172.21.15.87:0/1112393283 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd66ffd640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680ad160 0x7efd68151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd677fe640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd681518b0 0x7efd68147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 -- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680ad160 msgr2=0x7efd68151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680ad160 0x7efd68151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 -- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd681518b0 msgr2=0x7efd68147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd681518b0 0x7efd68147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 -- 172.21.15.87:0/1112393283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd68152480 con 0x7efd680c4620 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5e7fc640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 0x7efd68149a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efd5001d2e0 tx=0x7efd5001b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:08.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500b4040 con 0x7efd680c4620 2024-04-25T15:59:08.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd68150a10 con 0x7efd680c4620 2024-04-25T15:59:08.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd500afb70 con 0x7efd680c4620 2024-04-25T15:59:08.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500b8430 con 0x7efd680c4620 2024-04-25T15:59:08.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd68150fb0 con 0x7efd680c4620 2024-04-25T15:59:08.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.582+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd68069bb0 con 0x7efd680c4620 2024-04-25T15:59:08.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.586+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efd500b85d0 con 0x7efd680c4620 2024-04-25T15:59:08.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.586+0000 7efd5ffff640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd4806f430 0x7efd48071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:08.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.586+0000 7efd66ffd640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd4806f430 0x7efd48071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:08.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.586+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7efd5012c590 con 0x7efd680c4620 2024-04-25T15:59:08.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.586+0000 7efd66ffd640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd4806f430 0x7efd48071940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd680aad60 tx=0x7efd58009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:08.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.590+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd50018820 con 0x7efd680c4620 2024-04-25T15:59:08.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.790+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd680c7e90 con 0x7efd680c4620 2024-04-25T15:59:08.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.790+0000 7efd5ffff640 1 -- 172.21.15.87:0/1112393283 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7efd500f8940 con 0x7efd680c4620 2024-04-25T15:59:08.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:08.793 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:08.793 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd4806f430 msgr2=0x7efd48071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd4806f430 0x7efd48071940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd680aad60 tx=0x7efd58009190 comp rx=0 tx=0).stop 2024-04-25T15:59:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 msgr2=0x7efd68149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 0x7efd68149a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efd5001d2e0 tx=0x7efd5001b9d0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 shutdown_connections 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efd4806f430 0x7efd48071940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd681518b0 0x7efd68147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd680c4620 0x7efd68149a10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 --2- 172.21.15.87:0/1112393283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd680ad160 0x7efd68151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 >> 172.21.15.87:0/1112393283 conn(0x7efd680c8770 msgr2=0x7efd680ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 shutdown_connections 2024-04-25T15:59:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:08.794+0000 7efd6d547640 1 -- 172.21.15.87:0/1112393283 wait complete. 2024-04-25T15:59:08.813 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:10.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:10.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:10.814 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:10.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.994+0000 7f5804981640 1 Processor -- start 2024-04-25T15:59:10.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.994+0000 7f5804981640 1 -- start start 2024-04-25T15:59:10.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f5804981640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5800158a00 0x7f58000ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:10.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f5804981640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158e10 0x7f5800152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:10.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f5804981640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5800063660 con 0x7f58000adfb0 2024-04-25T15:59:10.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f5804981640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f58000c5470 con 0x7f5800158a00 2024-04-25T15:59:10.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f5804981640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58000ab670 con 0x7f5800158e10 2024-04-25T15:59:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5800158a00 0x7f58000ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5800158a00 0x7f58000ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40498/0 (socket says 172.21.15.87:40498) 2024-04-25T15:59:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 -- 172.21.15.87:0/1262520147 learned_addr learned my addr 172.21.15.87:0/1262520147 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 -- 172.21.15.87:0/1262520147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158e10 msgr2=0x7f5800152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 --2- 172.21.15.87:0/1262520147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158e10 0x7f5800152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 -- 172.21.15.87:0/1262520147 >> v1:172.21.15.155:6789/0 conn(0x7f58000adfb0 legacy=0x7f58001552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:10.998+0000 7f57fe59c640 1 -- 172.21.15.87:0/1262520147 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58000ab930 con 0x7f5800158a00 2024-04-25T15:59:11.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.002+0000 7f57fe59c640 1 --2- 172.21.15.87:0/1262520147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800158a00 0x7f58000ada70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f58000721b0 tx=0x7f57f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5840d156ae07faf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:11.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f57fd59a640 1 -- 172.21.15.87:0/1262520147 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80b1070 con 0x7f5800158a00 2024-04-25T15:59:11.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f57fd59a640 1 -- 172.21.15.87:0/1262520147 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f80ac600 con 0x7f5800158a00 2024-04-25T15:59:11.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f57fd59a640 1 -- 172.21.15.87:0/1262520147 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80ac9d0 con 0x7f5800158a00 2024-04-25T15:59:11.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 -- 172.21.15.87:0/1262520147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800158a00 msgr2=0x7f58000ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:11.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 --2- 172.21.15.87:0/1262520147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800158a00 0x7f58000ada70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f58000721b0 tx=0x7f57f801c4d0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 -- 172.21.15.87:0/1262520147 shutdown_connections 2024-04-25T15:59:11.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 --2- 172.21.15.87:0/1262520147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158e10 0x7f5800152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 --2- 172.21.15.87:0/1262520147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5800158a00 0x7f58000ada70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 -- 172.21.15.87:0/1262520147 >> 172.21.15.87:0/1262520147 conn(0x7f580006d650 msgr2=0x7f58000c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:11.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 -- 172.21.15.87:0/1262520147 shutdown_connections 2024-04-25T15:59:11.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.006+0000 7f5804981640 1 -- 172.21.15.87:0/1262520147 wait complete. 2024-04-25T15:59:11.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 Processor -- start 2024-04-25T15:59:11.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- start start 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 0x7f5800073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158a00 0x7f5800148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5800158e10 0x7f5800153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58000af0f0 con 0x7f58000adfb0 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58000aef70 con 0x7f5800158e10 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58000749b0 con 0x7f5800158a00 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 0x7f5800073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 0x7f5800073000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40514/0 (socket says 172.21.15.87:40514) 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 -- 172.21.15.87:0/252492289 learned_addr learned my addr 172.21.15.87:0/252492289 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fed9d640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5800158e10 0x7f5800153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 -- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158a00 msgr2=0x7f5800148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158a00 0x7f5800148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 -- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5800158e10 msgr2=0x7f5800153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5800158e10 0x7f5800153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 -- 172.21.15.87:0/252492289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58001f4a80 con 0x7f58000adfb0 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57fe59c640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 0x7f5800073000 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f57f801ab80 tx=0x7f57f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80bb020 con 0x7f58000adfb0 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f80b7620 con 0x7f58000adfb0 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5800153fa0 con 0x7f58000adfb0 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80b1040 con 0x7f58000adfb0 2024-04-25T15:59:11.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5800154560 con 0x7f58000adfb0 2024-04-25T15:59:11.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.010+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5800069bb0 con 0x7f58000adfb0 2024-04-25T15:59:11.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.014+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f57f80be020 con 0x7f58000adfb0 2024-04-25T15:59:11.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.014+0000 7f57f6ffd640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f57e006f430 0x7f57e0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:11.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.014+0000 7f57fdd9b640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f57e006f430 0x7f57e0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:11.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.014+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f57f81297c0 con 0x7f58000adfb0 2024-04-25T15:59:11.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.014+0000 7f57fdd9b640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f57e006f430 0x7f57e0071940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5800063170 tx=0x7f57f0009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:11.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.018+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57f80c5070 con 0x7f58000adfb0 2024-04-25T15:59:11.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.218+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5800156d20 con 0x7f58000adfb0 2024-04-25T15:59:11.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.218+0000 7f57f6ffd640 1 -- 172.21.15.87:0/252492289 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f57f80160f0 con 0x7f58000adfb0 2024-04-25T15:59:11.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:11.220 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:11.220 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f57e006f430 msgr2=0x7f57e0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f57e006f430 0x7f57e0071940 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5800063170 tx=0x7f57f0009250 comp rx=0 tx=0).stop 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 msgr2=0x7f5800073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 0x7f5800073000 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f57f801ab80 tx=0x7f57f801ad10 comp rx=0 tx=0).stop 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 shutdown_connections 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f57e006f430 0x7f57e0071940 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5800158e10 0x7f5800153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5800158a00 0x7f5800148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 --2- 172.21.15.87:0/252492289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58000adfb0 0x7f5800073000 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 >> 172.21.15.87:0/252492289 conn(0x7f580006d650 msgr2=0x7f58000c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 shutdown_connections 2024-04-25T15:59:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:11.222+0000 7f5804981640 1 -- 172.21.15.87:0/252492289 wait complete. 2024-04-25T15:59:11.241 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:12.251 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-25T15:59:12.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-25T15:59:12.545 DEBUG:teuthology.parallel:result is None 2024-04-25T15:59:13.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:13.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 Processor -- start 2024-04-25T15:59:13.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 -- start start 2024-04-25T15:59:13.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcee81529a0 0x7fcee8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:13.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:13.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee80c4e30 con 0x7fcee80ad990 2024-04-25T15:59:13.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcee80ae1b0 con 0x7fcee81529a0 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fceed21d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcee8072430 con 0x7fcee80adda0 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcee81529a0 0x7fcee8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcee81529a0 0x7fcee8071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40518/0 (socket says 172.21.15.87:40518) 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 -- 172.21.15.87:0/1197760483 learned_addr learned my addr 172.21.15.87:0/1197760483 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee759e640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 -- 172.21.15.87:0/1197760483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 msgr2=0x7fcee80c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee80c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 -- 172.21.15.87:0/1197760483 >> v1:172.21.15.155:6789/0 conn(0x7fcee80ad990 legacy=0x7fcee80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee6d9d640 1 -- 172.21.15.87:0/1197760483 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee8074730 con 0x7fcee81529a0 2024-04-25T15:59:13.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.402+0000 7fcee759e640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee80c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:13.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fcee6d9d640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee81529a0 0x7fcee8071e50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fced8009870 tx=0x7fced801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b41a6997970ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:13.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fcee5d9b640 1 -- 172.21.15.87:0/1197760483 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced80b0070 con 0x7fcee81529a0 2024-04-25T15:59:13.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fcee5d9b640 1 -- 172.21.15.87:0/1197760483 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced80ab600 con 0x7fcee81529a0 2024-04-25T15:59:13.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fcee5d9b640 1 -- 172.21.15.87:0/1197760483 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced80ab9d0 con 0x7fcee81529a0 2024-04-25T15:59:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 -- 172.21.15.87:0/1197760483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee81529a0 msgr2=0x7fcee8071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee81529a0 0x7fcee8071e50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fced8009870 tx=0x7fced801c4d0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 -- 172.21.15.87:0/1197760483 shutdown_connections 2024-04-25T15:59:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee80c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 --2- 172.21.15.87:0/1197760483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee81529a0 0x7fcee8071e50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 -- 172.21.15.87:0/1197760483 >> 172.21.15.87:0/1197760483 conn(0x7fcee80c8770 msgr2=0x7fcee80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:13.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 -- 172.21.15.87:0/1197760483 shutdown_connections 2024-04-25T15:59:13.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.406+0000 7fceed21d640 1 -- 172.21.15.87:0/1197760483 wait complete. 2024-04-25T15:59:13.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 Processor -- start 2024-04-25T15:59:13.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 -- start start 2024-04-25T15:59:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 0x7fcee81f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee81efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcee81529a0 0x7fcee815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcee81622f0 con 0x7fcee80ad990 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcee80ab1a0 con 0x7fcee81529a0 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcee8162470 con 0x7fcee80adda0 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 0x7fcee81f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 0x7fcee81f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40534/0 (socket says 172.21.15.87:40534) 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 -- 172.21.15.87:0/2916358117 learned_addr learned my addr 172.21.15.87:0/2916358117 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee759e640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcee81529a0 0x7fcee815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 -- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 msgr2=0x7fcee81efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee81efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 -- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcee81529a0 msgr2=0x7fcee815d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcee81529a0 0x7fcee815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 -- 172.21.15.87:0/2916358117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee814f9f0 con 0x7fcee80ad990 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcee6d9d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 0x7fcee81f1c20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fced80ae040 tx=0x7fced801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced80ba020 con 0x7fcee80ad990 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced80b6640 con 0x7fcee80ad990 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee81f2740 con 0x7fcee80ad990 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.410+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced80b0040 con 0x7fcee80ad990 2024-04-25T15:59:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee815ea20 con 0x7fcee80ad990 2024-04-25T15:59:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee8069bb0 con 0x7fcee80ad990 2024-04-25T15:59:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fced80bd020 con 0x7fcee80ad990 2024-04-25T15:59:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fcecf7fe640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fced406f400 0x7fced4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fced8129b40 con 0x7fcee80ad990 2024-04-25T15:59:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fcee659c640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fced406f400 0x7fced4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:13.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.414+0000 7fcee659c640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fced406f400 0x7fced4071910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcedc000f70 tx=0x7fcedc0079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:13.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.418+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fced80c4030 con 0x7fcee80ad990 2024-04-25T15:59:13.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.614+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcee80c3760 con 0x7fcee80ad990 2024-04-25T15:59:13.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.614+0000 7fcecf7fe640 1 -- 172.21.15.87:0/2916358117 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7fced8016150 con 0x7fcee80ad990 2024-04-25T15:59:13.617 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:13.617 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:13.617 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:13.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fced406f400 msgr2=0x7fced4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:13.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fced406f400 0x7fced4071910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcedc000f70 tx=0x7fcedc0079e0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 msgr2=0x7fcee81f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:13.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 0x7fcee81f1c20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fced80ae040 tx=0x7fced801ad10 comp rx=0 tx=0).stop 2024-04-25T15:59:13.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 shutdown_connections 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fced406f400 0x7fced4071910 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcee81529a0 0x7fcee815d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee80adda0 0x7fcee81efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 --2- 172.21.15.87:0/2916358117 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee80ad990 0x7fcee81f1c20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 >> 172.21.15.87:0/2916358117 conn(0x7fcee80c8770 msgr2=0x7fcee8155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 shutdown_connections 2024-04-25T15:59:13.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:13.618+0000 7fceed21d640 1 -- 172.21.15.87:0/2916358117 wait complete. 2024-04-25T15:59:13.638 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:15.638 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efbd04640 1 Processor -- start 2024-04-25T15:59:15.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efbd04640 1 -- start start 2024-04-25T15:59:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efbd04640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ef40ad160 0x7f0ef40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efbd04640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef4154fc0 con 0x7f0ef40c4620 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efbd04640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef40acb20 con 0x7f0ef41518b0 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efbd04640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef406ed60 con 0x7f0ef40ad160 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0ef929f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ef40ad160 0x7f0ef40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efa2a1640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0ef40c4620 0x7f0ef415e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59074/0 (socket says 172.21.15.87:59074) 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0efa2a1640 1 -- 172.21.15.87:0/1939718738 learned_addr learned my addr 172.21.15.87:0/1939718738 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0ef929f640 1 -- 172.21.15.87:0/1939718738 >> v1:172.21.15.155:6789/0 conn(0x7f0ef41518b0 legacy=0x7f0ef406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0ef929f640 1 -- 172.21.15.87:0/1939718738 >> v1:172.21.15.87:6789/0 conn(0x7f0ef40c4620 legacy=0x7f0ef415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0ef8a9e640 1 -- 172.21.15.87:0/1939718738 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980259803 0 0) 0x7f0ef4154fc0 con 0x7f0ef40c4620 2024-04-25T15:59:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.798+0000 7f0ef929f640 1 -- 172.21.15.87:0/1939718738 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef40ace00 con 0x7f0ef40ad160 2024-04-25T15:59:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0ef929f640 1 --2- 172.21.15.87:0/1939718738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40ad160 0x7f0ef40c40e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0ef406eee0 tx=0x7f0ee401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e7fc5a5f340b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0ef8a9e640 1 -- 172.21.15.87:0/1939718738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40b1070 con 0x7f0ef40ad160 2024-04-25T15:59:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0ef8a9e640 1 -- 172.21.15.87:0/1939718738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40ac630 con 0x7f0ef40ad160 2024-04-25T15:59:15.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0ef8a9e640 1 -- 172.21.15.87:0/1939718738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40a8050 con 0x7f0ef40ad160 2024-04-25T15:59:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 -- 172.21.15.87:0/1939718738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40ad160 msgr2=0x7f0ef40c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 --2- 172.21.15.87:0/1939718738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40ad160 0x7f0ef40c40e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0ef406eee0 tx=0x7f0ee401c4a0 comp rx=0 tx=0).stop 2024-04-25T15:59:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 -- 172.21.15.87:0/1939718738 shutdown_connections 2024-04-25T15:59:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 --2- 172.21.15.87:0/1939718738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40ad160 0x7f0ef40c40e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 -- 172.21.15.87:0/1939718738 >> 172.21.15.87:0/1939718738 conn(0x7f0ef40c8770 msgr2=0x7f0ef40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 -- 172.21.15.87:0/1939718738 shutdown_connections 2024-04-25T15:59:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 -- 172.21.15.87:0/1939718738 wait complete. 2024-04-25T15:59:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 Processor -- start 2024-04-25T15:59:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.802+0000 7f0efbd04640 1 -- start start 2024-04-25T15:59:15.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40ad160 0x7f0ef40c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:15.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 0x7f0ef4147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef41518b0 0x7f0ef4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef41628f0 con 0x7f0ef40c4620 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4162a70 con 0x7f0ef41518b0 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef4162bf0 con 0x7f0ef40ad160 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 0x7f0ef4147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 0x7f0ef4147de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40554/0 (socket says 172.21.15.87:40554) 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 -- 172.21.15.87:0/3136617440 learned_addr learned my addr 172.21.15.87:0/3136617440 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efa2a1640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef41518b0 0x7f0ef4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 -- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40ad160 msgr2=0x7f0ef40c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40ad160 0x7f0ef40c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:15.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 -- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef41518b0 msgr2=0x7f0ef4141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef41518b0 0x7f0ef4141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 -- 172.21.15.87:0/3136617440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef40c3830 con 0x7f0ef40c4620 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efa2a1640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef41518b0 0x7f0ef4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0ef929f640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 0x7f0ef4147de0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40af040 tx=0x7f0ee401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40b1050 con 0x7f0ef40c4620 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40bd070 con 0x7f0ef40c4620 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef40c7fd0 con 0x7f0ef40c4620 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40b6870 con 0x7f0ef40c4620 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef415fe20 con 0x7f0ef40c4620 2024-04-25T15:59:15.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef4069bb0 con 0x7f0ef40c4620 2024-04-25T15:59:15.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.806+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0ee40b6a10 con 0x7f0ef40c4620 2024-04-25T15:59:15.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.810+0000 7f0eea7fc640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ed806f400 0x7f0ed8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:15.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.810+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f0ee4129bb0 con 0x7f0ef40c4620 2024-04-25T15:59:15.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.810+0000 7f0ef9aa0640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ed806f400 0x7f0ed8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:15.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.810+0000 7f0ef9aa0640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ed806f400 0x7f0ed8071910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0000f70 tx=0x7f0ef00079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:15.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:15.814+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ee4016090 con 0x7f0ef40c4620 2024-04-25T15:59:16.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.006+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ef40abfa0 con 0x7f0ef40c4620 2024-04-25T15:59:16.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0eea7fc640 1 -- 172.21.15.87:0/3136617440 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f0ee40f65a0 con 0x7f0ef40c4620 2024-04-25T15:59:16.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:16.009 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:16.010 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:16.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ed806f400 msgr2=0x7f0ed8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ed806f400 0x7f0ed8071910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0000f70 tx=0x7f0ef00079c0 comp rx=0 tx=0).stop 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 msgr2=0x7f0ef4147de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 0x7f0ef4147de0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40af040 tx=0x7f0ee401ace0 comp rx=0 tx=0).stop 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 shutdown_connections 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0ed806f400 0x7f0ed8071910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef41518b0 0x7f0ef4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef40c4620 0x7f0ef4147de0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 --2- 172.21.15.87:0/3136617440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40ad160 0x7f0ef40c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 >> 172.21.15.87:0/3136617440 conn(0x7f0ef40c8770 msgr2=0x7f0ef40c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 shutdown_connections 2024-04-25T15:59:16.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:16.010+0000 7f0efbd04640 1 -- 172.21.15.87:0/3136617440 wait complete. 2024-04-25T15:59:16.029 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:18.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:18.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 Processor -- start 2024-04-25T15:59:18.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 -- start start 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5890158a00 0x7f58900ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158e10 0x7f5890152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58900adfb0 0x7f5890152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f58900c5470 con 0x7f5890158a00 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5890063660 con 0x7f58900adfb0 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f5895d5a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58900ab670 con 0x7f5890158e10 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5890158a00 0x7f58900ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5890158a00 0x7f58900ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40560/0 (socket says 172.21.15.87:40560) 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 -- 172.21.15.87:0/805440126 learned_addr learned my addr 172.21.15.87:0/805440126 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588ffff640 1 --2- 172.21.15.87:0/805440126 >> v2:172.21.15.155:3300/0 conn(0x7f58900adfb0 0x7f5890152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588effd640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158e10 0x7f5890152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 -- 172.21.15.87:0/805440126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158e10 msgr2=0x7f5890152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158e10 0x7f5890152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 -- 172.21.15.87:0/805440126 >> v2:172.21.15.155:3300/0 conn(0x7f58900adfb0 msgr2=0x7f5890152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:18.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 --2- 172.21.15.87:0/805440126 >> v2:172.21.15.155:3300/0 conn(0x7f58900adfb0 0x7f5890152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588f7fe640 1 -- 172.21.15.87:0/805440126 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58900ab930 con 0x7f5890158a00 2024-04-25T15:59:18.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.186+0000 7f588effd640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158e10 0x7f5890152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f588f7fe640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158a00 0x7f58900ada70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5890071d00 tx=0x7f587801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300b767cc0f2ebb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f588e7fc640 1 -- 172.21.15.87:0/805440126 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780a7070 con 0x7f5890158a00 2024-04-25T15:59:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f588e7fc640 1 -- 172.21.15.87:0/805440126 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58780b0070 con 0x7f5890158a00 2024-04-25T15:59:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f588e7fc640 1 -- 172.21.15.87:0/805440126 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780ab890 con 0x7f5890158a00 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 -- 172.21.15.87:0/805440126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158a00 msgr2=0x7f58900ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158a00 0x7f58900ada70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5890071d00 tx=0x7f587801c4f0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 -- 172.21.15.87:0/805440126 shutdown_connections 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 --2- 172.21.15.87:0/805440126 >> v2:172.21.15.155:3300/0 conn(0x7f58900adfb0 0x7f5890152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158e10 0x7f5890152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 --2- 172.21.15.87:0/805440126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158a00 0x7f58900ada70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 -- 172.21.15.87:0/805440126 >> 172.21.15.87:0/805440126 conn(0x7f589006d650 msgr2=0x7f58900c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:18.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 -- 172.21.15.87:0/805440126 shutdown_connections 2024-04-25T15:59:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.190+0000 7f5895d5a640 1 -- 172.21.15.87:0/805440126 wait complete. 2024-04-25T15:59:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 Processor -- start 2024-04-25T15:59:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- start start 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58900adfb0 0x7f589014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158a00 0x7f58900c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 0x7f589014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58900af0f0 con 0x7f5890158e10 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58900aef70 con 0x7f58900adfb0 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5890155ad0 con 0x7f5890158a00 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 0x7f589014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 0x7f589014ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40568/0 (socket says 172.21.15.87:40568) 2024-04-25T15:59:18.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 -- 172.21.15.87:0/294230073 learned_addr learned my addr 172.21.15.87:0/294230073 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588f7fe640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58900adfb0 0x7f589014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588effd640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158a00 0x7f58900c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 -- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158a00 msgr2=0x7f58900c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158a00 0x7f58900c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 -- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58900adfb0 msgr2=0x7f589014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58900adfb0 0x7f589014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 -- 172.21.15.87:0/294230073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589014bfd0 con 0x7f5890158e10 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588effd640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158a00 0x7f58900c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f588ffff640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 0x7f589014ac70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5888007cf0 tx=0x7f588800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888014420 con 0x7f5890158e10 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5888019070 con 0x7f5890158e10 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58901f4050 con 0x7f5890158e10 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888014800 con 0x7f5890158e10 2024-04-25T15:59:18.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58901f4610 con 0x7f5890158e10 2024-04-25T15:59:18.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.194+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5890069bb0 con 0x7f5890158e10 2024-04-25T15:59:18.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.198+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f58880149a0 con 0x7f5890158e10 2024-04-25T15:59:18.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.198+0000 7f5887fff640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f587006f400 0x7f5870071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.198+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f588808fef0 con 0x7f5890158e10 2024-04-25T15:59:18.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.198+0000 7f588f7fe640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f587006f400 0x7f5870071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.198+0000 7f588f7fe640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f587006f400 0x7f5870071910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58780af000 tx=0x7f5878008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:18.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.202+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f588805c970 con 0x7f5890158e10 2024-04-25T15:59:18.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.398+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58900704e0 con 0x7f5890158e10 2024-04-25T15:59:18.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.398+0000 7f5887fff640 1 -- 172.21.15.87:0/294230073 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f588805c270 con 0x7f5890158e10 2024-04-25T15:59:18.399 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:18.400 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:18.400 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f587006f400 msgr2=0x7f5870071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f587006f400 0x7f5870071910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f58780af000 tx=0x7f5878008040 comp rx=0 tx=0).stop 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 msgr2=0x7f589014ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 0x7f589014ac70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5888007cf0 tx=0x7f588800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 shutdown_connections 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f587006f400 0x7f5870071910 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5890158e10 0x7f589014ac70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5890158a00 0x7f58900c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 --2- 172.21.15.87:0/294230073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58900adfb0 0x7f589014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 >> 172.21.15.87:0/294230073 conn(0x7f589006d650 msgr2=0x7f58901526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 shutdown_connections 2024-04-25T15:59:18.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.402+0000 7f5895d5a640 1 -- 172.21.15.87:0/294230073 wait complete. 2024-04-25T15:59:18.420 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:18.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 Processor -- start 2024-04-25T15:59:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 -- start start 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42181529a0 0x7f4218071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42180c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42180c4e30 con 0x7f42180ad990 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f42180ae1b0 con 0x7f42181529a0 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421f9d4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4218072430 con 0x7f42180adda0 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42180c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421d770640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42181529a0 0x7f4218071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42180c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:60144/0 (socket says 172.21.15.87:60144) 2024-04-25T15:59:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 -- 172.21.15.87:0/1332262280 learned_addr learned my addr 172.21.15.87:0/1332262280 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 -- 172.21.15.87:0/1332262280 >> v2:172.21.15.155:3300/0 conn(0x7f42181529a0 msgr2=0x7f4218071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 --2- 172.21.15.87:0/1332262280 >> v2:172.21.15.155:3300/0 conn(0x7f42181529a0 0x7f4218071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 -- 172.21.15.87:0/1332262280 >> v1:172.21.15.155:6789/0 conn(0x7f42180ad990 legacy=0x7f42180c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.910+0000 7f421df71640 1 -- 172.21.15.87:0/1332262280 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4218074730 con 0x7f42180adda0 2024-04-25T15:59:18.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421df71640 1 --2- 172.21.15.87:0/1332262280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42180c48f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4210009e50 tx=0x7f421001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc789d57b365588c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f420ffff640 1 -- 172.21.15.87:0/1332262280 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100a5660 con 0x7f42180adda0 2024-04-25T15:59:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f420ffff640 1 -- 172.21.15.87:0/1332262280 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42100a5800 con 0x7f42180adda0 2024-04-25T15:59:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f420ffff640 1 -- 172.21.15.87:0/1332262280 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100a5bd0 con 0x7f42180adda0 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 -- 172.21.15.87:0/1332262280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 msgr2=0x7f42180c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 --2- 172.21.15.87:0/1332262280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42180c48f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4210009e50 tx=0x7f421001c9a0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 -- 172.21.15.87:0/1332262280 shutdown_connections 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 --2- 172.21.15.87:0/1332262280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42180c48f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 --2- 172.21.15.87:0/1332262280 >> v2:172.21.15.155:3300/0 conn(0x7f42181529a0 0x7f4218071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 -- 172.21.15.87:0/1332262280 >> 172.21.15.87:0/1332262280 conn(0x7f42180c8770 msgr2=0x7f42180c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 -- 172.21.15.87:0/1332262280 shutdown_connections 2024-04-25T15:59:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.914+0000 7f421f9d4640 1 -- 172.21.15.87:0/1332262280 wait complete. 2024-04-25T15:59:18.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 Processor -- start 2024-04-25T15:59:18.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- start start 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42180ad990 0x7f4218151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42181eed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 0x7f421814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f42181622f0 con 0x7f42181529a0 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42180ab1a0 con 0x7f42180ad990 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4218162470 con 0x7f42180adda0 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 0x7f421814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 0x7f421814f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40578/0 (socket says 172.21.15.87:40578) 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 -- 172.21.15.87:0/4220442193 learned_addr learned my addr 172.21.15.87:0/4220442193 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421d770640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42180ad990 0x7f4218151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421cf6f640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42181eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 -- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 msgr2=0x7f42181eed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42181eed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 -- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42180ad990 msgr2=0x7f4218151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42180ad990 0x7f4218151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 -- 172.21.15.87:0/4220442193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421814cd70 con 0x7f42181529a0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421df71640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 0x7f421814f460 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f42100af040 tx=0x7f4210019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210009510 con 0x7f42181529a0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42181f2570 con 0x7f42181529a0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42100b8470 con 0x7f42181529a0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100b8860 con 0x7f42181529a0 2024-04-25T15:59:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421814d260 con 0x7f42181529a0 2024-04-25T15:59:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.918+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42181f2740 con 0x7f42181529a0 2024-04-25T15:59:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.922+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f42100c0020 con 0x7f42181529a0 2024-04-25T15:59:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.922+0000 7f420dffb640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41fc06f400 0x7f41fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.922+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f421012a950 con 0x7f42181529a0 2024-04-25T15:59:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.922+0000 7f421d770640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41fc06f400 0x7f41fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.922+0000 7f421d770640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41fc06f400 0x7f41fc071910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4218073d40 tx=0x7f4214008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:18.926+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42181f2740 con 0x7f42181529a0 2024-04-25T15:59:19.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.122+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4218069bb0 con 0x7f42181529a0 2024-04-25T15:59:19.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.122+0000 7f420dffb640 1 -- 172.21.15.87:0/4220442193 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f42100c7020 con 0x7f42181529a0 2024-04-25T15:59:19.124 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:19.124 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:19.124 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41fc06f400 msgr2=0x7f41fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41fc06f400 0x7f41fc071910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4218073d40 tx=0x7f4214008040 comp rx=0 tx=0).stop 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 msgr2=0x7f421814f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 0x7f421814f460 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f42100af040 tx=0x7f4210019740 comp rx=0 tx=0).stop 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 shutdown_connections 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41fc06f400 0x7f41fc071910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42181529a0 0x7f421814f460 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42180adda0 0x7f42181eed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 --2- 172.21.15.87:0/4220442193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42180ad990 0x7f4218151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 >> 172.21.15.87:0/4220442193 conn(0x7f42180c8770 msgr2=0x7f4218154240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 shutdown_connections 2024-04-25T15:59:19.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.126+0000 7f421f9d4640 1 -- 172.21.15.87:0/4220442193 wait complete. 2024-04-25T15:59:19.145 INFO:tasks.mds_thrash.fs.[b]:kill mds.b (rank=0) 2024-04-25T15:59:19.145 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:59:19.145 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:59:19.169 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:59:19.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:19.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd77ed640 1 Processor -- start 2024-04-25T15:59:19.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd77ed640 1 -- start start 2024-04-25T15:59:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd77ed640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 0x7fedd0163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd77ed640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd00c5120 con 0x7fedd015ac30 2024-04-25T15:59:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd77ed640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd00c4b60 con 0x7fedd00c4250 2024-04-25T15:59:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd77ed640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fedd00c3b20 con 0x7fedd0160e60 2024-04-25T15:59:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd4d88640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fedd015ac30 0x7fedd015b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59090/0 (socket says 172.21.15.87:59090) 2024-04-25T15:59:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd4d88640 1 -- 172.21.15.87:0/3743413156 learned_addr learned my addr 172.21.15.87:0/3743413156 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedd5d8a640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 0x7fedd0163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654814120 0 0) 0x7fedcc0014a0 con 0x7fedd015ac30 2024-04-25T15:59:19.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.318+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedbc003530 con 0x7fedd015ac30 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2738012277 0 0) 0x7fedbc003530 con 0x7fedd015ac30 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 msgr2=0x7fedd0163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 0x7fedd0163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 >> v1:172.21.15.155:6789/0 conn(0x7fedd00c4250 legacy=0x7fedd006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd00c4e40 con 0x7fedd015ac30 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fedcc001bd0 con 0x7fedd015ac30 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 >> v1:172.21.15.87:6789/0 conn(0x7fedd015ac30 legacy=0x7fedd015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedbc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 0x7fedbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedbc004d50 0x7fedbc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc00bb60 con 0x7fedbc0039f0 2024-04-25T15:59:19.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc00bce0 con 0x7fedbc004d50 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc00be90 con 0x7fedd0160e60 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedbc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd4d88640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 0x7fedbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5d8a640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedbc004d50 0x7fedbc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 -- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 msgr2=0x7fedbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd0160e60 0x7fedbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 -- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedbc004d50 msgr2=0x7fedbc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedbc004d50 0x7fedbc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 -- 172.21.15.87:0/3743413156 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc003530 con 0x7fedbc0039f0 2024-04-25T15:59:19.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5d8a640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedbc004d50 0x7fedbc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5589640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedbc003e20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fedd00721c0 tx=0x7fedc401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb5ec4c02885fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:19.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40b0070 con 0x7fedbc0039f0 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40ab600 con 0x7fedbc0039f0 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedc3fff640 1 -- 172.21.15.87:0/3743413156 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4001460 con 0x7fedbc0039f0 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd77ed640 1 -- 172.21.15.87:0/3743413156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 msgr2=0x7fedbc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3743413156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedbc003e20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fedd00721c0 tx=0x7fedc401c480 comp rx=0 tx=0).stop 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd5d8a640 1 -- 172.21.15.87:0/3743413156 reap_dead start 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd77ed640 1 -- 172.21.15.87:0/3743413156 shutdown_connections 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd77ed640 1 -- 172.21.15.87:0/3743413156 >> 172.21.15.87:0/3743413156 conn(0x7fedd006d780 msgr2=0x7fedd006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd77ed640 1 -- 172.21.15.87:0/3743413156 shutdown_connections 2024-04-25T15:59:19.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.322+0000 7fedd77ed640 1 -- 172.21.15.87:0/3743413156 wait complete. 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 Processor -- start 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 -- start start 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedd00c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd00c81a0 0x7fedd00c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd014d650 0x7fedd014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fedd015b8d0 con 0x7fedbc0039f0 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fedd015b750 con 0x7fedd014d650 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fedd0155100 con 0x7fedd00c81a0 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedd00c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedd00c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40608/0 (socket says 172.21.15.87:40608) 2024-04-25T15:59:19.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 -- 172.21.15.87:0/3873338108 learned_addr learned my addr 172.21.15.87:0/3873338108 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd4d88640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd00c81a0 0x7fedd00c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5d8a640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd014d650 0x7fedd014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 -- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd00c81a0 msgr2=0x7fedd00c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd00c81a0 0x7fedd00c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 -- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd014d650 msgr2=0x7fedd014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd014d650 0x7fedd014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 -- 172.21.15.87:0/3873338108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd014e3d0 con 0x7fedbc0039f0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5d8a640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd014d650 0x7fedd014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd5589640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedd00c90e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fedc40ae040 tx=0x7fedbc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40b0040 con 0x7fedbc0039f0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40bb070 con 0x7fedbc0039f0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd015b390 con 0x7fedbc0039f0 2024-04-25T15:59:19.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4005070 con 0x7fedbc0039f0 2024-04-25T15:59:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.326+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd00ca050 con 0x7fedbc0039f0 2024-04-25T15:59:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.330+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd0069bb0 con 0x7fedbc0039f0 2024-04-25T15:59:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.330+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fedc4005210 con 0x7fedbc0039f0 2024-04-25T15:59:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.330+0000 7fedc1ffb640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fedb406f400 0x7fedb4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:19.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.330+0000 7fedd4d88640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fedb406f400 0x7fedb4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.330+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fedc4129760 con 0x7fedbc0039f0 2024-04-25T15:59:19.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.330+0000 7fedd4d88640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fedb406f400 0x7fedb4071910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fedd0152640 tx=0x7fedcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:19.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.334+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedc40161f0 con 0x7fedbc0039f0 2024-04-25T15:59:19.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.530+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedd00c2ba0 con 0x7fedbc0039f0 2024-04-25T15:59:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.530+0000 7fedc1ffb640 1 -- 172.21.15.87:0/3873338108 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7fedc40f60c0 con 0x7fedbc0039f0 2024-04-25T15:59:19.533 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:19.533 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:19.533 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fedb406f400 msgr2=0x7fedb4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fedb406f400 0x7fedb4071910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fedd0152640 tx=0x7fedcc009040 comp rx=0 tx=0).stop 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 msgr2=0x7fedd00c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedd00c90e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fedc40ae040 tx=0x7fedbc005840 comp rx=0 tx=0).stop 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 shutdown_connections 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fedb406f400 0x7fedb4071910 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedd014d650 0x7fedd014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedd00c81a0 0x7fedd00c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 --2- 172.21.15.87:0/3873338108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedbc0039f0 0x7fedd00c90e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 >> 172.21.15.87:0/3873338108 conn(0x7fedd006d780 msgr2=0x7fedd01606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 shutdown_connections 2024-04-25T15:59:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:19.534+0000 7fedd77ed640 1 -- 172.21.15.87:0/3873338108 wait complete. 2024-04-25T15:59:19.552 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:20.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 Processor -- start 2024-04-25T15:59:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 -- start start 2024-04-25T15:59:20.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1f0154ae0 0x7fd1f0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f00c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cac60 0x7fd1f00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f015a9e0 con 0x7fd1f0154ae0 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd1f0158380 con 0x7fd1f00cac60 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f80c9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f00c7d40 con 0x7fd1f00c92b0 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1f0154ae0 0x7fd1f0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1f0154ae0 0x7fd1f0157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40610/0 (socket says 172.21.15.87:40610) 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 -- 172.21.15.87:0/238596834 learned_addr learned my addr 172.21.15.87:0/238596834 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 -- 172.21.15.87:0/238596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 msgr2=0x7fd1f00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 --2- 172.21.15.87:0/238596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f00c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 -- 172.21.15.87:0/238596834 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cac60 msgr2=0x7fd1f00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f6666640 1 --2- 172.21.15.87:0/238596834 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cac60 0x7fd1f00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 --2- 172.21.15.87:0/238596834 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cac60 0x7fd1f00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.578+0000 7fd1f5e65640 1 -- 172.21.15.87:0/238596834 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f015ac30 con 0x7fd1f0154ae0 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f5e65640 1 --2- 172.21.15.87:0/238596834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f0154ae0 0x7fd1f0157e40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00ca400 tx=0x7fd1ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431c058abcf2909 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f4e63640 1 -- 172.21.15.87:0/238596834 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0b2070 con 0x7fd1f0154ae0 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f4e63640 1 -- 172.21.15.87:0/238596834 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ec0a9070 con 0x7fd1f0154ae0 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f4e63640 1 -- 172.21.15.87:0/238596834 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0ad880 con 0x7fd1f0154ae0 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 -- 172.21.15.87:0/238596834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f0154ae0 msgr2=0x7fd1f0157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/238596834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f0154ae0 0x7fd1f0157e40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00ca400 tx=0x7fd1ec01c490 comp rx=0 tx=0).stop 2024-04-25T15:59:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 -- 172.21.15.87:0/238596834 shutdown_connections 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/238596834 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cac60 0x7fd1f00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/238596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f00c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/238596834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f0154ae0 0x7fd1f0157e40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 -- 172.21.15.87:0/238596834 >> 172.21.15.87:0/238596834 conn(0x7fd1f00ae490 msgr2=0x7fd1f00ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 -- 172.21.15.87:0/238596834 shutdown_connections 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 -- 172.21.15.87:0/238596834 wait complete. 2024-04-25T15:59:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 Processor -- start 2024-04-25T15:59:20.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.582+0000 7fd1f80c9640 1 -- start start 2024-04-25T15:59:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f01f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 0x7fd1f01590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f0154ae0 0x7fd1f014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f00c7a90 con 0x7fd1f00cac60 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f00c7910 con 0x7fd1f0154ae0 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f00b2300 con 0x7fd1f00c92b0 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 0x7fd1f01590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 0x7fd1f01590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40620/0 (socket says 172.21.15.87:40620) 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 -- 172.21.15.87:0/3927397477 learned_addr learned my addr 172.21.15.87:0/3927397477 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f6666640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f0154ae0 0x7fd1f014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 -- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 msgr2=0x7fd1f01f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5e65640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f01f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f01f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 -- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f0154ae0 msgr2=0x7fd1f014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f0154ae0 0x7fd1f014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 -- 172.21.15.87:0/3927397477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f014bc30 con 0x7fd1f00cac60 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5664640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 0x7fd1f01590d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b440 tx=0x7fd1e000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0015020 con 0x7fd1f00cac60 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e00118b0 con 0x7fd1f00cac60 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f00c6640 con 0x7fd1f00cac60 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011ca0 con 0x7fd1f00cac60 2024-04-25T15:59:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f00c6c00 con 0x7fd1f00cac60 2024-04-25T15:59:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f0069bb0 con 0x7fd1f00cac60 2024-04-25T15:59:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd1e0018020 con 0x7fd1f00cac60 2024-04-25T15:59:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1e67fc640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd1d406f400 0x7fd1d4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fd1e008f8c0 con 0x7fd1f00cac60 2024-04-25T15:59:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.586+0000 7fd1f5e65640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd1d406f400 0x7fd1d4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.590+0000 7fd1f5e65640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd1d406f400 0x7fd1d4071910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0af000 tx=0x7fd1ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:20.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.594+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1e001f020 con 0x7fd1f00cac60 2024-04-25T15:59:20.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.774+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1f00caa40 con 0x7fd1f00cac60 2024-04-25T15:59:20.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.774+0000 7fd1e67fc640 1 -- 172.21.15.87:0/3927397477 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7fd1e000d040 con 0x7fd1f00cac60 2024-04-25T15:59:20.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:20.776 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:20.776 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd1d406f400 msgr2=0x7fd1d4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd1d406f400 0x7fd1d4071910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0af000 tx=0x7fd1ec008040 comp rx=0 tx=0).stop 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 msgr2=0x7fd1f01590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 0x7fd1f01590d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b440 tx=0x7fd1e000b900 comp rx=0 tx=0).stop 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 shutdown_connections 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd1d406f400 0x7fd1d4071910 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f0154ae0 0x7fd1f014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1f00cac60 0x7fd1f01590d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 --2- 172.21.15.87:0/3927397477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00c92b0 0x7fd1f01f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:20.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 >> 172.21.15.87:0/3927397477 conn(0x7fd1f00ae490 msgr2=0x7fd1f00b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:20.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 shutdown_connections 2024-04-25T15:59:20.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:20.778+0000 7fd1f80c9640 1 -- 172.21.15.87:0/3927397477 wait complete. 2024-04-25T15:59:20.795 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:21.553 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:21.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 Processor -- start 2024-04-25T15:59:21.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 -- start start 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880ad160 0x7f50880c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50880c4620 0x7f508815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5088154fc0 con 0x7f50881518b0 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f508806ed60 con 0x7f50880c4620 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508e57e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50880acb20 con 0x7f50880ad160 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508cb1b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50880c4620 0x7f508815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:21.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f5087fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f50881518b0 0x7f508806f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36414/0 (socket says 172.21.15.87:36414) 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508cb1b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50880c4620 0x7f508815e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35628/0 (socket says 172.21.15.87:35628) 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f5087fff640 1 -- 172.21.15.87:0/3722170060 learned_addr learned my addr 172.21.15.87:0/3722170060 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f50877fe640 1 --2- 172.21.15.87:0/3722170060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880ad160 0x7f50880c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f5086ffd640 1 -- 172.21.15.87:0/3722170060 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464463216 0 0) 0x7f5088154fc0 con 0x7f50881518b0 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f5086ffd640 1 -- 172.21.15.87:0/3722170060 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5070003530 con 0x7f50881518b0 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508cb1b640 1 -- 172.21.15.87:0/3722170060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880ad160 msgr2=0x7f50880c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508cb1b640 1 --2- 172.21.15.87:0/3722170060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880ad160 0x7f50880c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508cb1b640 1 -- 172.21.15.87:0/3722170060 >> v1:172.21.15.87:6789/0 conn(0x7f50881518b0 legacy=0x7f508806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:21.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.713+0000 7f508cb1b640 1 -- 172.21.15.87:0/3722170060 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50880ace00 con 0x7f50880c4620 2024-04-25T15:59:21.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508cb1b640 1 --2- 172.21.15.87:0/3722170060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880c4620 0x7f508815e9b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5080009d90 tx=0x7f508001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90df628a30017a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:21.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f5086ffd640 1 -- 172.21.15.87:0/3722170060 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800b2070 con 0x7f50880c4620 2024-04-25T15:59:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f5086ffd640 1 -- 172.21.15.87:0/3722170060 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50800a5960 con 0x7f50880c4620 2024-04-25T15:59:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f5086ffd640 1 -- 172.21.15.87:0/3722170060 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800a5d30 con 0x7f50880c4620 2024-04-25T15:59:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 -- 172.21.15.87:0/3722170060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880c4620 msgr2=0x7f508815e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:21.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 --2- 172.21.15.87:0/3722170060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880c4620 0x7f508815e9b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5080009d90 tx=0x7f508001c970 comp rx=0 tx=0).stop 2024-04-25T15:59:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 -- 172.21.15.87:0/3722170060 shutdown_connections 2024-04-25T15:59:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 --2- 172.21.15.87:0/3722170060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880c4620 0x7f508815e9b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 --2- 172.21.15.87:0/3722170060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880ad160 0x7f50880c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 -- 172.21.15.87:0/3722170060 >> 172.21.15.87:0/3722170060 conn(0x7f50880c8770 msgr2=0x7f50880c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 -- 172.21.15.87:0/3722170060 shutdown_connections 2024-04-25T15:59:21.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.717+0000 7f508e57e640 1 -- 172.21.15.87:0/3722170060 wait complete. 2024-04-25T15:59:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 Processor -- start 2024-04-25T15:59:21.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- start start 2024-04-25T15:59:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 0x7f508813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880c4620 0x7f5088147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:21.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50881518b0 0x7f5088140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5088161710 con 0x7f50880ad160 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5088161890 con 0x7f50881518b0 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5088161a10 con 0x7f50880c4620 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 0x7f508813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 0x7f508813fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35632/0 (socket says 172.21.15.87:35632) 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 -- 172.21.15.87:0/3067862649 learned_addr learned my addr 172.21.15.87:0/3067862649 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f50877fe640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880c4620 0x7f5088147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508cb1b640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50881518b0 0x7f5088140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 -- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880c4620 msgr2=0x7f5088147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880c4620 0x7f5088147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 -- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50881518b0 msgr2=0x7f5088140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50881518b0 0x7f5088140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 -- 172.21.15.87:0/3067862649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5088148830 con 0x7f50880ad160 2024-04-25T15:59:21.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f50877fe640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880c4620 0x7f5088147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5087fff640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 0x7f508813fca0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c3c0 tx=0x7f507c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c017070 con 0x7f50880ad160 2024-04-25T15:59:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c005d10 con 0x7f50880ad160 2024-04-25T15:59:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c007310 con 0x7f50880ad160 2024-04-25T15:59:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50880c3990 con 0x7f50880ad160 2024-04-25T15:59:21.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5088149050 con 0x7f50880ad160 2024-04-25T15:59:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.721+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5088069bb0 con 0x7f50880ad160 2024-04-25T15:59:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.725+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f507c01a070 con 0x7f50880ad160 2024-04-25T15:59:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.725+0000 7f5084ff9640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f507406f430 0x7f5074071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.725+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7f507c08eed0 con 0x7f50880ad160 2024-04-25T15:59:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.725+0000 7f50877fe640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f507406f430 0x7f5074071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:21.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.725+0000 7f50877fe640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f507406f430 0x7f5074071940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5088145780 tx=0x7f5078008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:21.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.729+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f507c021020 con 0x7f50880ad160 2024-04-25T15:59:21.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5088148610 con 0x7f50880ad160 2024-04-25T15:59:21.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f5084ff9640 1 -- 172.21.15.87:0/3067862649 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7f507c05baf0 con 0x7f50880ad160 2024-04-25T15:59:21.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:21.927 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:21.927 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f507406f430 msgr2=0x7f5074071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:21.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f507406f430 0x7f5074071940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5088145780 tx=0x7f5078008040 comp rx=0 tx=0).stop 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 msgr2=0x7f508813fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 0x7f508813fca0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c3c0 tx=0x7f507c00c880 comp rx=0 tx=0).stop 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 shutdown_connections 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f507406f430 0x7f5074071940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50881518b0 0x7f5088140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50880c4620 0x7f5088147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 --2- 172.21.15.87:0/3067862649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50880ad160 0x7f508813fca0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 >> 172.21.15.87:0/3067862649 conn(0x7f50880c8770 msgr2=0x7f50880c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 shutdown_connections 2024-04-25T15:59:21.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:21.925+0000 7f508e57e640 1 -- 172.21.15.87:0/3067862649 wait complete. 2024-04-25T15:59:21.947 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:22.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:22.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.953+0000 7fd1385ac640 1 Processor -- start 2024-04-25T15:59:22.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.953+0000 7fd1385ac640 1 -- start start 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd1385ac640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1300ad160 0x7fd1300c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd1385ac640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd130154fc0 con 0x7fd1301518b0 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd1385ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1300acb20 con 0x7fd1300c4620 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd1385ac640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd13006ed60 con 0x7fd1300ad160 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd135b47640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1300ad160 0x7fd1300c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd136348640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd1301518b0 0x7fd13006f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36422/0 (socket says 172.21.15.87:36422) 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd136348640 1 -- 172.21.15.87:0/1628693299 learned_addr learned my addr 172.21.15.87:0/1628693299 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd135b47640 1 --2- 172.21.15.87:0/1628693299 >> v2:172.21.15.87:3300/0 conn(0x7fd1300ad160 0x7fd1300c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35646/0 (socket says 172.21.15.87:35646) 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd135b47640 1 -- 172.21.15.87:0/1628693299 >> v1:172.21.15.155:6789/0 conn(0x7fd1300c4620 legacy=0x7fd13015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd135b47640 1 -- 172.21.15.87:0/1628693299 >> v1:172.21.15.87:6789/0 conn(0x7fd1301518b0 legacy=0x7fd13006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd135b47640 1 -- 172.21.15.87:0/1628693299 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1300ace00 con 0x7fd1300ad160 2024-04-25T15:59:22.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.957+0000 7fd135346640 1 -- 172.21.15.87:0/1628693299 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944926823 0 0) 0x7fd130154fc0 con 0x7fd1301518b0 2024-04-25T15:59:22.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd135b47640 1 --2- 172.21.15.87:0/1628693299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1300ad160 0x7fd1300c40e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd13006eee0 tx=0x7fd12401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4e33d2b3236676 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:22.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd135346640 1 -- 172.21.15.87:0/1628693299 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240b2070 con 0x7fd1300ad160 2024-04-25T15:59:22.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd135346640 1 -- 172.21.15.87:0/1628693299 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1240a5900 con 0x7fd1300ad160 2024-04-25T15:59:22.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd135346640 1 -- 172.21.15.87:0/1628693299 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240a5cd0 con 0x7fd1300ad160 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 -- 172.21.15.87:0/1628693299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1300ad160 msgr2=0x7fd1300c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1628693299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1300ad160 0x7fd1300c40e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd13006eee0 tx=0x7fd12401c910 comp rx=0 tx=0).stop 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 -- 172.21.15.87:0/1628693299 shutdown_connections 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1628693299 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1300ad160 0x7fd1300c40e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 -- 172.21.15.87:0/1628693299 >> 172.21.15.87:0/1628693299 conn(0x7fd1300c8770 msgr2=0x7fd1300c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 -- 172.21.15.87:0/1628693299 shutdown_connections 2024-04-25T15:59:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 -- 172.21.15.87:0/1628693299 wait complete. 2024-04-25T15:59:22.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 Processor -- start 2024-04-25T15:59:22.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.961+0000 7fd1385ac640 1 -- start start 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1300ad160 0x7fd1300bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1300c4620 0x7fd1300c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 0x7fd13014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301628f0 con 0x7fd1301518b0 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd130162a70 con 0x7fd1300ad160 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd130162bf0 con 0x7fd1300c4620 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 0x7fd13014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:22.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 0x7fd13014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35662/0 (socket says 172.21.15.87:35662) 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 -- 172.21.15.87:0/1373321172 learned_addr learned my addr 172.21.15.87:0/1373321172 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136348640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1300ad160 0x7fd1300bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd135b47640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1300c4620 0x7fd1300c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 -- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1300c4620 msgr2=0x7fd1300c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1300c4620 0x7fd1300c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 -- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1300ad160 msgr2=0x7fd1300bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1300ad160 0x7fd1300bfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 -- 172.21.15.87:0/1373321172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1301594e0 con 0x7fd1301518b0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd136b49640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 0x7fd13014d710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd12000b440 tx=0x7fd12000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120015020 con 0x7fd1301518b0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd120011870 con 0x7fd1301518b0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120011c60 con 0x7fd1301518b0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1300beca0 con 0x7fd1301518b0 2024-04-25T15:59:22.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1300bf260 con 0x7fd1301518b0 2024-04-25T15:59:22.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd130069bb0 con 0x7fd1301518b0 2024-04-25T15:59:22.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd120018020 con 0x7fd1301518b0 2024-04-25T15:59:22.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.965+0000 7fd12effd640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd11c06f400 0x7fd11c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:22.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.969+0000 7fd136348640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd11c06f400 0x7fd11c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:22.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.969+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fd12008f6d0 con 0x7fd1301518b0 2024-04-25T15:59:22.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.969+0000 7fd136348640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd11c06f400 0x7fd11c071910 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd128000f70 tx=0x7fd128007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:22.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:22.973+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd12001f020 con 0x7fd1301518b0 2024-04-25T15:59:23.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.169+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd13015feb0 con 0x7fd1301518b0 2024-04-25T15:59:23.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.169+0000 7fd12effd640 1 -- 172.21.15.87:0/1373321172 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+6494 (secure 0 0 0) 0x7fd12005c0c0 con 0x7fd1301518b0 2024-04-25T15:59:23.173 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:23.173 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:57:58.402845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4966":{"gid":4966,"name":"d","rank":0,"incarnation":32,"state":"up:active","state_seq":15,"addr":"172.21.15.155:6833/2576881209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2576881209},{"type":"v1","addr":"172.21.15.155:6833","nonce":2576881209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4966,"qdb_cluster":[4966]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-04-25T15:59:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd11c06f400 msgr2=0x7fd11c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd11c06f400 0x7fd11c071910 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd128000f70 tx=0x7fd128007c10 comp rx=0 tx=0).stop 2024-04-25T15:59:23.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 msgr2=0x7fd13014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 0x7fd13014d710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd12000b440 tx=0x7fd12000b900 comp rx=0 tx=0).stop 2024-04-25T15:59:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 shutdown_connections 2024-04-25T15:59:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd11c06f400 0x7fd11c071910 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1301518b0 0x7fd13014d710 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:23.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1300c4620 0x7fd1300c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 --2- 172.21.15.87:0/1373321172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1300ad160 0x7fd1300bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 >> 172.21.15.87:0/1373321172 conn(0x7fd1300c8770 msgr2=0x7fd130150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 shutdown_connections 2024-04-25T15:59:23.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:23.173+0000 7fd1385ac640 1 -- 172.21.15.87:0/1373321172 wait complete. 2024-04-25T15:59:23.193 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-25T15:59:23.948 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:24.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 Processor -- start 2024-04-25T15:59:24.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 -- start start 2024-04-25T15:59:24.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcbc0cb030 0x7fdcbc15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:24.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 0x7fdcbc162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:24.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcbc0c7570 con 0x7fdcbc15ad90 2024-04-25T15:59:24.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdcbc15b8b0 con 0x7fdcbc0cb030 2024-04-25T15:59:24.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc2b35640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc15b5d0 con 0x7fdcbc160230 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc10d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 0x7fdcbc162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcbbfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcbc0cb030 0x7fdcbc15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc10d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 0x7fdcbc162650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:59208/0 (socket says 172.21.15.87:59208) 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.105+0000 7fdcc10d2640 1 -- 172.21.15.87:0/217949758 learned_addr learned my addr 172.21.15.87:0/217949758 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbbfff640 1 -- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 msgr2=0x7fdcbc162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbbfff640 1 --2- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 0x7fdcbc162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbbfff640 1 -- 172.21.15.87:0/217949758 >> v1:172.21.15.155:6789/0 conn(0x7fdcbc15ad90 legacy=0x7fdcbc0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbbfff640 1 -- 172.21.15.87:0/217949758 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc0c2290 con 0x7fdcbc0cb030 2024-04-25T15:59:24.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcc10d2640 1 --2- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 0x7fdcbc162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:59:24.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbbfff640 1 --2- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc0cb030 0x7fdcbc15fcf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097c0 tx=0x7fdcb001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a2f46f6c34c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:24.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbb7fe640 1 -- 172.21.15.87:0/217949758 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00b0070 con 0x7fdcbc0cb030 2024-04-25T15:59:24.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbb7fe640 1 -- 172.21.15.87:0/217949758 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00ab600 con 0x7fdcbc0cb030 2024-04-25T15:59:24.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcbb7fe640 1 -- 172.21.15.87:0/217949758 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00ab9d0 con 0x7fdcbc0cb030 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcc2b35640 1 -- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc0cb030 msgr2=0x7fdcbc15fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.109+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc0cb030 0x7fdcbc15fcf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097c0 tx=0x7fdcb001c380 comp rx=0 tx=0).stop 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- 172.21.15.87:0/217949758 shutdown_connections 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc160230 0x7fdcbc162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/217949758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc0cb030 0x7fdcbc15fcf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- 172.21.15.87:0/217949758 >> 172.21.15.87:0/217949758 conn(0x7fdcbc0c9330 msgr2=0x7fdcbc0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- 172.21.15.87:0/217949758 shutdown_connections 2024-04-25T15:59:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- 172.21.15.87:0/217949758 wait complete. 2024-04-25T15:59:24.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 Processor -- start 2024-04-25T15:59:24.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- start start 2024-04-25T15:59:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc0cb030 0x7fdcbc144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 0x7fdcbc1f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc160230 0x7fdcbc1f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc15b1a0 con 0x7fdcbc15ad90 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc0ca190 con 0x7fdcbc160230 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc2b35640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc15b320 con 0x7fdcbc0cb030 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 0x7fdcbc1f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 0x7fdcbc1f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35678/0 (socket says 172.21.15.87:35678) 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 -- 172.21.15.87:0/2000474641 learned_addr learned my addr 172.21.15.87:0/2000474641 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc08d1640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc0cb030 0x7fdcbc144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc10d2640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc160230 0x7fdcbc1f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 -- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc0cb030 msgr2=0x7fdcbc144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc0cb030 0x7fdcbc144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 -- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc160230 msgr2=0x7fdcbc1f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc160230 0x7fdcbc1f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 -- 172.21.15.87:0/2000474641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc1f3e70 con 0x7fdcbc15ad90 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcc10d2640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc160230 0x7fdcbc1f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:59:24.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.113+0000 7fdcbbfff640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 0x7fdcbc1f4630 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00ae040 tx=0x7fdcb0019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00b0040 con 0x7fdcbc15ad90 2024-04-25T15:59:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00ab400 con 0x7fdcbc15ad90 2024-04-25T15:59:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc1452e0 con 0x7fdcbc15ad90 2024-04-25T15:59:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0006e20 con 0x7fdcbc15ad90 2024-04-25T15:59:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc1f4110 con 0x7fdcbc15ad90 2024-04-25T15:59:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc069bb0 con 0x7fdcbc15ad90 2024-04-25T15:59:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdcb00bb020 con 0x7fdcbc15ad90 2024-04-25T15:59:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcb97fa640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdca806f430 0x7fdca8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcc08d1640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdca806f430 0x7fdca8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7125+0+0 (secure 0 0 0) 0x7fdcb01295b0 con 0x7fdcbc15ad90 2024-04-25T15:59:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.117+0000 7fdcc08d1640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdca806f430 0x7fdca8071940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0015b0 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:24.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.121+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdcb00c2020 con 0x7fdcbc15ad90 2024-04-25T15:59:24.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.329+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcbc1541c0 con 0x7fdcbc15ad90 2024-04-25T15:59:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.329+0000 7fdcb97fa640 1 -- 172.21.15.87:0/2000474641 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5658 (secure 0 0 0) 0x7fdcb0016090 con 0x7fdcbc15ad90 2024-04-25T15:59:24.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:24.331 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:24.289969+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-04-25T15:59:24.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdca806f430 msgr2=0x7fdca8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:24.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdca806f430 0x7fdca8071940 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0015b0 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 msgr2=0x7fdcbc1f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 0x7fdcbc1f4630 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00ae040 tx=0x7fdcb0019120 comp rx=0 tx=0).stop 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 shutdown_connections 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdca806f430 0x7fdca8071940 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcbc160230 0x7fdcbc1f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcbc15ad90 0x7fdcbc1f4630 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 --2- 172.21.15.87:0/2000474641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcbc0cb030 0x7fdcbc144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 >> 172.21.15.87:0/2000474641 conn(0x7fdcbc0c9330 msgr2=0x7fdcbc1525f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 shutdown_connections 2024-04-25T15:59:24.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:24.333+0000 7fdcc2b35640 1 -- 172.21.15.87:0/2000474641 wait complete. 2024-04-25T15:59:24.360 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:25.194 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:25.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff276db8640 1 Processor -- start 2024-04-25T15:59:25.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff276db8640 1 -- start start 2024-04-25T15:59:25.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff276db8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff270158e10 0x7ff270152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff276db8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff270063660 con 0x7ff270158a00 2024-04-25T15:59:25.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff276db8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2700ab670 con 0x7ff270152bc0 2024-04-25T15:59:25.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff276db8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff2700c5470 con 0x7ff270158e10 2024-04-25T15:59:25.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff274b54640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff270158a00 0x7ff2700ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36432/0 (socket says 172.21.15.87:36432) 2024-04-25T15:59:25.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff274b54640 1 -- 172.21.15.87:0/3453630200 learned_addr learned my addr 172.21.15.87:0/3453630200 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843310058 0 0) 0x7ff270063660 con 0x7ff270158a00 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26ffff640 1 --2- 172.21.15.87:0/3453630200 >> v2:172.21.15.155:3300/0 conn(0x7ff270158e10 0x7ff270152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff260003530 con 0x7ff270158a00 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1234979883 0 0) 0x7ff260003530 con 0x7ff270158a00 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 >> v2:172.21.15.155:3300/0 conn(0x7ff270158e10 msgr2=0x7ff270152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 --2- 172.21.15.87:0/3453630200 >> v2:172.21.15.155:3300/0 conn(0x7ff270158e10 0x7ff270152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 >> v1:172.21.15.155:6789/0 conn(0x7ff270152bc0 legacy=0x7ff27015fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2700ab930 con 0x7ff270158a00 2024-04-25T15:59:25.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ff2640016a0 con 0x7ff270158a00 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 >> v1:172.21.15.87:6789/0 conn(0x7ff270158a00 legacy=0x7ff2700ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600039c0 0x7ff260003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff260004810 0x7ff260004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2600051d0 0x7ff26000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff2700c5470 con 0x7ff2600051d0 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff26000c170 con 0x7ff2600039c0 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.329+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff26000c370 con 0x7ff260004810 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2600051d0 0x7ff26000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff274b54640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600039c0 0x7ff260003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff26ffff640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff260004810 0x7ff260004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 -- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff260004810 msgr2=0x7ff260004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff260004810 0x7ff260004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 -- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600039c0 msgr2=0x7ff260003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600039c0 0x7ff260003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 -- 172.21.15.87:0/3453630200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff260003530 con 0x7ff2600051d0 2024-04-25T15:59:25.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 -- 172.21.15.87:0/3453630200 reap_dead start 2024-04-25T15:59:25.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff275355640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2600051d0 0x7ff26000b9d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff268001e70 tx=0x7ff26801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c18df69d98537b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:25.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268001a90 con 0x7ff2600051d0 2024-04-25T15:59:25.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268003bc0 con 0x7ff2600051d0 2024-04-25T15:59:25.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.333+0000 7ff26f7fe640 1 -- 172.21.15.87:0/3453630200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2680050d0 con 0x7ff2600051d0 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- 172.21.15.87:0/3453630200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2600051d0 msgr2=0x7ff26000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2600051d0 0x7ff26000b9d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff268001e70 tx=0x7ff26801c6e0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- 172.21.15.87:0/3453630200 shutdown_connections 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 --2- 172.21.15.87:0/3453630200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2600051d0 0x7ff26000b9d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- 172.21.15.87:0/3453630200 >> 172.21.15.87:0/3453630200 conn(0x7ff27006d650 msgr2=0x7ff2700c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- 172.21.15.87:0/3453630200 shutdown_connections 2024-04-25T15:59:25.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- 172.21.15.87:0/3453630200 wait complete. 2024-04-25T15:59:25.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 Processor -- start 2024-04-25T15:59:25.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- start start 2024-04-25T15:59:25.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600051d0 0x7ff2701550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff270155600 0x7ff2701dede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 0x7ff2700c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff27006de30 con 0x7ff2701df320 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff2700634c0 con 0x7ff2600051d0 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff276db8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff2700ad1e0 con 0x7ff270155600 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff275355640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 0x7ff2700c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff275355640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 0x7ff2700c2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35698/0 (socket says 172.21.15.87:35698) 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.337+0000 7ff275355640 1 -- 172.21.15.87:0/1030502491 learned_addr learned my addr 172.21.15.87:0/1030502491 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff274b54640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600051d0 0x7ff2701550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26ffff640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff270155600 0x7ff2701dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff275355640 1 -- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff270155600 msgr2=0x7ff2701dede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff275355640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff270155600 0x7ff2701dede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff275355640 1 -- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600051d0 msgr2=0x7ff2701550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff275355640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600051d0 0x7ff2701550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff275355640 1 -- 172.21.15.87:0/1030502491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff270155b20 con 0x7ff2701df320 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26ffff640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff270155600 0x7ff2701dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff274b54640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600051d0 0x7ff2701550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff275355640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 0x7ff2700c2940 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff26801cc50 tx=0x7ff260005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2680ae070 con 0x7ff2701df320 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268006b60 con 0x7ff2701df320 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff270154300 con 0x7ff2701df320 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268001a90 con 0x7ff2701df320 2024-04-25T15:59:25.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701548c0 con 0x7ff2701df320 2024-04-25T15:59:25.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2701eb2a0 con 0x7ff2701df320 2024-04-25T15:59:25.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff2680a8650 con 0x7ff2701df320 2024-04-25T15:59:25.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26d7fa640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff25406f400 0x7ff254071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7ff268129270 con 0x7ff2701df320 2024-04-25T15:59:25.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.341+0000 7ff274b54640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff25406f400 0x7ff254071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.345+0000 7ff274b54640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff25406f400 0x7ff254071910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff264000c10 tx=0x7ff264001460 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:25.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.349+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff2680c1080 con 0x7ff2701df320 2024-04-25T15:59:25.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff270069bb0 con 0x7ff2701df320 2024-04-25T15:59:25.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff26d7fa640 1 -- 172.21.15.87:0/1030502491 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5658 (secure 0 0 0) 0x7ff2680163f0 con 0x7ff2701df320 2024-04-25T15:59:25.542 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:25.542 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:24.289969+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:25.542 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff25406f400 msgr2=0x7ff254071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff25406f400 0x7ff254071910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff264000c10 tx=0x7ff264001460 comp rx=0 tx=0).stop 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 msgr2=0x7ff2700c2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 0x7ff2700c2940 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff26801cc50 tx=0x7ff260005840 comp rx=0 tx=0).stop 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 shutdown_connections 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff25406f400 0x7ff254071910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2701df320 0x7ff2700c2940 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff270155600 0x7ff2701dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 --2- 172.21.15.87:0/1030502491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2600051d0 0x7ff2701550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 >> 172.21.15.87:0/1030502491 conn(0x7ff27006d650 msgr2=0x7ff2700aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:25.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 shutdown_connections 2024-04-25T15:59:25.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.541+0000 7ff276db8640 1 -- 172.21.15.87:0/1030502491 wait complete. 2024-04-25T15:59:25.561 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-04-25T15:59:25.561 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T15:59:25.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:25.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 Processor -- start 2024-04-25T15:59:25.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 -- start start 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba640c9fe0 0x7fba641551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fba6406c670 0x7fba6406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fba64152c80 con 0x7fba640c9fe0 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fba64070cb0 con 0x7fba6406c670 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba68ffb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba64070f90 con 0x7fba64152870 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba640c9fe0 0x7fba641551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba640c9fe0 0x7fba641551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35702/0 (socket says 172.21.15.87:35702) 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 -- 172.21.15.87:0/2656650556 learned_addr learned my addr 172.21.15.87:0/2656650556 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba6259c640 1 --2- 172.21.15.87:0/2656650556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba62d9d640 1 --2- 172.21.15.87:0/2656650556 >> v2:172.21.15.155:3300/0 conn(0x7fba6406c670 0x7fba6406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 -- 172.21.15.87:0/2656650556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 msgr2=0x7fba64159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 --2- 172.21.15.87:0/2656650556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 -- 172.21.15.87:0/2656650556 >> v2:172.21.15.155:3300/0 conn(0x7fba6406c670 msgr2=0x7fba6406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 --2- 172.21.15.87:0/2656650556 >> v2:172.21.15.155:3300/0 conn(0x7fba6406c670 0x7fba6406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.701+0000 7fba61d9b640 1 -- 172.21.15.87:0/2656650556 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba641587b0 con 0x7fba640c9fe0 2024-04-25T15:59:25.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba61d9b640 1 --2- 172.21.15.87:0/2656650556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba640c9fe0 0x7fba641551c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fba64070550 tx=0x7fba4c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50658dfeb505a021 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:25.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba6159a640 1 -- 172.21.15.87:0/2656650556 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b0070 con 0x7fba640c9fe0 2024-04-25T15:59:25.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba6159a640 1 -- 172.21.15.87:0/2656650556 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c0ab600 con 0x7fba640c9fe0 2024-04-25T15:59:25.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba6159a640 1 -- 172.21.15.87:0/2656650556 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0ab9d0 con 0x7fba640c9fe0 2024-04-25T15:59:25.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 -- 172.21.15.87:0/2656650556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba640c9fe0 msgr2=0x7fba641551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 --2- 172.21.15.87:0/2656650556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba640c9fe0 0x7fba641551c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fba64070550 tx=0x7fba4c01c490 comp rx=0 tx=0).stop 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 -- 172.21.15.87:0/2656650556 shutdown_connections 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 --2- 172.21.15.87:0/2656650556 >> v2:172.21.15.155:3300/0 conn(0x7fba6406c670 0x7fba6406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 --2- 172.21.15.87:0/2656650556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba640c9fe0 0x7fba641551c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 --2- 172.21.15.87:0/2656650556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 -- 172.21.15.87:0/2656650556 >> 172.21.15.87:0/2656650556 conn(0x7fba6406d780 msgr2=0x7fba6406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 -- 172.21.15.87:0/2656650556 shutdown_connections 2024-04-25T15:59:25.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.705+0000 7fba68ffb640 1 -- 172.21.15.87:0/2656650556 wait complete. 2024-04-25T15:59:25.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 Processor -- start 2024-04-25T15:59:25.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 -- start start 2024-04-25T15:59:25.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 0x7fba6414c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba640c9fe0 0x7fba641483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba64155880 con 0x7fba6406c670 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba64155700 con 0x7fba640c9fe0 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba68ffb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba640ae540 con 0x7fba64152870 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 0x7fba6414c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 0x7fba6414c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35712/0 (socket says 172.21.15.87:35712) 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 -- 172.21.15.87:0/127084212 learned_addr learned my addr 172.21.15.87:0/127084212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba62d9d640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba61d9b640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba640c9fe0 0x7fba641483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 -- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 msgr2=0x7fba64145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 -- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba640c9fe0 msgr2=0x7fba641483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.709+0000 7fba6259c640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba640c9fe0 0x7fba641483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba6259c640 1 -- 172.21.15.87:0/127084212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba640c8840 con 0x7fba6406c670 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba62d9d640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba61d9b640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba640c9fe0 0x7fba641483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba6259c640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 0x7fba6414c820 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fba5400d620 tx=0x7fba5400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540125f0 con 0x7fba6406c670 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba54019070 con 0x7fba6406c670 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba641f27b0 con 0x7fba6406c670 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540129b0 con 0x7fba6406c670 2024-04-25T15:59:25.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641f2a50 con 0x7fba6406c670 2024-04-25T15:59:25.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba64069bb0 con 0x7fba6406c670 2024-04-25T15:59:25.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fba54012b50 con 0x7fba6406c670 2024-04-25T15:59:25.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba5affd640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba4406f430 0x7fba44071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:25.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba61d9b640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba4406f430 0x7fba44071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:25.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7fba54090510 con 0x7fba6406c670 2024-04-25T15:59:25.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.713+0000 7fba61d9b640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba4406f430 0x7fba44071940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ad000 tx=0x7fba4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:25.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.717+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba5405d020 con 0x7fba6406c670 2024-04-25T15:59:25.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.909+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba6406a4a0 con 0x7fba6406c670 2024-04-25T15:59:25.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba5affd640 1 -- 172.21.15.87:0/127084212 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5658 (secure 0 0 0) 0x7fba5405c920 con 0x7fba6406c670 2024-04-25T15:59:25.913 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:25.914 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:24.289969+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:25.914 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-04-25T15:59:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba4406f430 msgr2=0x7fba44071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba4406f430 0x7fba44071940 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ad000 tx=0x7fba4c008040 comp rx=0 tx=0).stop 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 msgr2=0x7fba6414c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 0x7fba6414c820 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fba5400d620 tx=0x7fba5400dae0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 shutdown_connections 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fba4406f430 0x7fba44071940 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba64152870 0x7fba64145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba640c9fe0 0x7fba641483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 --2- 172.21.15.87:0/127084212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba6406c670 0x7fba6414c820 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 >> 172.21.15.87:0/127084212 conn(0x7fba6406d780 msgr2=0x7fba6406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 shutdown_connections 2024-04-25T15:59:25.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:25.913+0000 7fba68ffb640 1 -- 172.21.15.87:0/127084212 wait complete. 2024-04-25T15:59:25.942 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 42, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 42, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5583": { "addr": "172.21.15.87:6835/4111430078", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 4111430078, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 4111430078, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5583, "incarnation": 42, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:59:24.289969+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5583 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 40, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4235": { "addr": "172.21.15.155:6835/630698588", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 630698588, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 630698588, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 36, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 66 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:58:11.495138+0000", "qdb_cluster": [ 4235 ], "qdb_leader": 4235, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4235 } } } ], "standbys": [ { "addr": "172.21.15.87:6837/2477874160", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6836", "nonce": 2477874160, "type": "v2" }, { "addr": "172.21.15.87:6837", "nonce": 2477874160, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 41, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5140, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T15:59:26.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:26.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f84360640 1 Processor -- start 2024-04-25T15:59:26.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f84360640 1 -- start start 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f84360640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f7c15ad90 0x7f4f7c0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f84360640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c0c7570 con 0x7f4f7c0cae60 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f84360640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c15b8b0 con 0x7f4f7c0cb270 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f84360640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c15b5d0 con 0x7f4f7c15ad90 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f820fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f7c15ad90 0x7f4f7c0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f820fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4f7c15ad90 0x7f4f7c0ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35726/0 (socket says 172.21.15.87:35726) 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f820fc640 1 -- 172.21.15.87:0/1274745434 learned_addr learned my addr 172.21.15.87:0/1274745434 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f820fc640 1 -- 172.21.15.87:0/1274745434 >> v1:172.21.15.155:6789/0 conn(0x7f4f7c0cb270 legacy=0x7f4f7c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f820fc640 1 -- 172.21.15.87:0/1274745434 >> v1:172.21.15.87:6789/0 conn(0x7f4f7c0cae60 legacy=0x7f4f7c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.505+0000 7f4f820fc640 1 -- 172.21.15.87:0/1274745434 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0c2290 con 0x7f4f7c15ad90 2024-04-25T15:59:26.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f820fc640 1 --2- 172.21.15.87:0/1274745434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c15ad90 0x7f4f7c0ca920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009e50 tx=0x7f4f7401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bdf09ab309f361 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:26.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f810fa640 1 -- 172.21.15.87:0/1274745434 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f740a5590 con 0x7f4f7c15ad90 2024-04-25T15:59:26.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f810fa640 1 -- 172.21.15.87:0/1274745434 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740a5730 con 0x7f4f7c15ad90 2024-04-25T15:59:26.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f810fa640 1 -- 172.21.15.87:0/1274745434 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f740a5b00 con 0x7f4f7c15ad90 2024-04-25T15:59:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 -- 172.21.15.87:0/1274745434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c15ad90 msgr2=0x7f4f7c0ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 --2- 172.21.15.87:0/1274745434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c15ad90 0x7f4f7c0ca920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009e50 tx=0x7f4f7401c8d0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 -- 172.21.15.87:0/1274745434 shutdown_connections 2024-04-25T15:59:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 --2- 172.21.15.87:0/1274745434 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c15ad90 0x7f4f7c0ca920 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 -- 172.21.15.87:0/1274745434 >> 172.21.15.87:0/1274745434 conn(0x7f4f7c0c9330 msgr2=0x7f4f7c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 -- 172.21.15.87:0/1274745434 shutdown_connections 2024-04-25T15:59:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 -- 172.21.15.87:0/1274745434 wait complete. 2024-04-25T15:59:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 Processor -- start 2024-04-25T15:59:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 -- start start 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f7c0cae60 0x7f4f7c141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.509+0000 7f4f84360640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 0x7f4f7c147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7c15ad90 0x7f4f7c1f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0ca190 con 0x7f4f7c0cb270 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c154d30 con 0x7f4f7c0cae60 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c15b1a0 con 0x7f4f7c15ad90 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 0x7f4f7c147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 0x7f4f7c147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35734/0 (socket says 172.21.15.87:35734) 2024-04-25T15:59:26.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 -- 172.21.15.87:0/2281827919 learned_addr learned my addr 172.21.15.87:0/2281827919 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f820fc640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f7c0cae60 0x7f4f7c141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 -- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7c15ad90 msgr2=0x7f4f7c1f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f828fd640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7c15ad90 0x7f4f7c1f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7c15ad90 0x7f4f7c1f0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 -- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f7c0cae60 msgr2=0x7f4f7c141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f7c0cae60 0x7f4f7c141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 -- 172.21.15.87:0/2281827919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c159920 con 0x7f4f7c0cb270 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f820fc640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f7c0cae60 0x7f4f7c141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f818fb640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 0x7f4f7c147840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000c3d0 tx=0x7f4f7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f700052d0 con 0x7f4f7c0cb270 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f70005470 con 0x7f4f7c0cb270 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c159bc0 con 0x7f4f7c0cb270 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70007260 con 0x7f4f7c0cb270 2024-04-25T15:59:26.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c15a180 con 0x7f4f7c0cb270 2024-04-25T15:59:26.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c069bb0 con 0x7f4f7c0cb270 2024-04-25T15:59:26.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4f70007400 con 0x7f4f7c0cb270 2024-04-25T15:59:26.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f6effd640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4f6006f430 0x7f4f60071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:26.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f820fc640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4f6006f430 0x7f4f60071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:26.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.513+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7f4f7008f3e0 con 0x7f4f7c0cb270 2024-04-25T15:59:26.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.517+0000 7f4f820fc640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4f6006f430 0x7f4f60071940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f740ae000 tx=0x7f4f740a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:26.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.517+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f7c159920 con 0x7f4f7c0cb270 2024-04-25T15:59:26.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.721+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f7c147620 con 0x7f4f7c0cb270 2024-04-25T15:59:26.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f6effd640 1 -- 172.21.15.87:0/2281827919 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5658 (secure 0 0 0) 0x7f4f7005bef0 con 0x7f4f7c0cb270 2024-04-25T15:59:26.726 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:26.726 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:24.289969+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:26.726 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4f6006f430 msgr2=0x7f4f60071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4f6006f430 0x7f4f60071940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f740ae000 tx=0x7f4f740a7070 comp rx=0 tx=0).stop 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 msgr2=0x7f4f7c147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 0x7f4f7c147840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000c3d0 tx=0x7f4f7000c890 comp rx=0 tx=0).stop 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 shutdown_connections 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4f6006f430 0x7f4f60071940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7c15ad90 0x7f4f7c1f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f7c0cb270 0x7f4f7c147840 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 --2- 172.21.15.87:0/2281827919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f7c0cae60 0x7f4f7c141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:26.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 >> 172.21.15.87:0/2281827919 conn(0x7f4f7c0c9330 msgr2=0x7f4f7c157970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:26.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 shutdown_connections 2024-04-25T15:59:26.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:26.725+0000 7f4f84360640 1 -- 172.21.15.87:0/2281827919 wait complete. 2024-04-25T15:59:26.745 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:27.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:28.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 Processor -- start 2024-04-25T15:59:28.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 -- start start 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe4b00740d0 0x7fe4b00c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4b0154c90 0x7fe4b0161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b0063220 con 0x7fe4b00744e0 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b00c5570 con 0x7fe4b00740d0 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4b4f4c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe4b0074a90 con 0x7fe4b0154c90 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4add9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe4b00744e0 0x7fe4b0154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:36458/0 (socket says 172.21.15.87:36458) 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4ae59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe4b00740d0 0x7fe4b00c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4add9b640 1 -- 172.21.15.87:0/1239369095 learned_addr learned my addr 172.21.15.87:0/1239369095 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4ae59c640 1 -- 172.21.15.87:0/1239369095 >> v2:172.21.15.155:3300/0 conn(0x7fe4b0154c90 msgr2=0x7fe4b0161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4aed9d640 1 --2- 172.21.15.87:0/1239369095 >> v2:172.21.15.155:3300/0 conn(0x7fe4b0154c90 0x7fe4b0161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4ae59c640 1 --2- 172.21.15.87:0/1239369095 >> v2:172.21.15.155:3300/0 conn(0x7fe4b0154c90 0x7fe4b0161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4ae59c640 1 -- 172.21.15.87:0/1239369095 >> v1:172.21.15.87:6789/0 conn(0x7fe4b00744e0 legacy=0x7fe4b0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4ad59a640 1 -- 172.21.15.87:0/1239369095 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112361742 0 0) 0x7fe4b0063220 con 0x7fe4b00744e0 2024-04-25T15:59:28.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.081+0000 7fe4ae59c640 1 -- 172.21.15.87:0/1239369095 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b00634c0 con 0x7fe4b00740d0 2024-04-25T15:59:28.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4ae59c640 1 --2- 172.21.15.87:0/1239369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00740d0 0x7fe4b00c2370 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00c3550 tx=0x7fe4a001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2916a10ef4f5e8c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:28.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4ad59a640 1 -- 172.21.15.87:0/1239369095 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00b0070 con 0x7fe4b00740d0 2024-04-25T15:59:28.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4ad59a640 1 -- 172.21.15.87:0/1239369095 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00ab600 con 0x7fe4b00740d0 2024-04-25T15:59:28.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4ad59a640 1 -- 172.21.15.87:0/1239369095 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00ab9d0 con 0x7fe4b00740d0 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/1239369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00740d0 msgr2=0x7fe4b00c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 --2- 172.21.15.87:0/1239369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00740d0 0x7fe4b00c2370 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00c3550 tx=0x7fe4a001c3f0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/1239369095 shutdown_connections 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 --2- 172.21.15.87:0/1239369095 >> v2:172.21.15.155:3300/0 conn(0x7fe4b0154c90 0x7fe4b0161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 --2- 172.21.15.87:0/1239369095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00740d0 0x7fe4b00c2370 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/1239369095 >> 172.21.15.87:0/1239369095 conn(0x7fe4b006d650 msgr2=0x7fe4b00c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/1239369095 shutdown_connections 2024-04-25T15:59:28.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.085+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/1239369095 wait complete. 2024-04-25T15:59:28.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 Processor -- start 2024-04-25T15:59:28.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 -- start start 2024-04-25T15:59:28.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b00740d0 0x7fe4b0143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 0x7fe4b01f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b0154c90 0x7fe4b00ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b00c51e0 con 0x7fe4b00744e0 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b00c5060 con 0x7fe4b0154c90 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b0164bd0 con 0x7fe4b00740d0 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 0x7fe4b01f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 0x7fe4b01f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35750/0 (socket says 172.21.15.87:35750) 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 -- 172.21.15.87:0/2317619716 learned_addr learned my addr 172.21.15.87:0/2317619716 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4ae59c640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b00740d0 0x7fe4b0143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 -- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b00740d0 msgr2=0x7fe4b0143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4aed9d640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b0154c90 0x7fe4b00ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b00740d0 0x7fe4b0143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 -- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b0154c90 msgr2=0x7fe4b00ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b0154c90 0x7fe4b00ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 -- 172.21.15.87:0/2317619716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b014b090 con 0x7fe4b00744e0 2024-04-25T15:59:28.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4add9b640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 0x7fe4b01f4280 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c480 tx=0x7fe4a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:28.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4018070 con 0x7fe4b00744e0 2024-04-25T15:59:28.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a4007500 con 0x7fe4b00744e0 2024-04-25T15:59:28.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4004a30 con 0x7fe4b00744e0 2024-04-25T15:59:28.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/2317619716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b0070370 con 0x7fe4b00744e0 2024-04-25T15:59:28.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe4b4f4c640 1 -- 172.21.15.87:0/2317619716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b0070630 con 0x7fe4b00744e0 2024-04-25T15:59:28.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.089+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4880052a0 con 0x7fe4b00744e0 2024-04-25T15:59:28.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.093+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe4a401b070 con 0x7fe4b00744e0 2024-04-25T15:59:28.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.093+0000 7fe49effd640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe49006f400 0x7fe490071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.093+0000 7fe4ae59c640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe49006f400 0x7fe490071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.093+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7fe4a408eac0 con 0x7fe4b00744e0 2024-04-25T15:59:28.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.093+0000 7fe4ae59c640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe49006f400 0x7fe490071910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00ad000 tx=0x7fe4a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:28.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.097+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4a405b4f0 con 0x7fe4b00744e0 2024-04-25T15:59:28.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe488005860 con 0x7fe4b00744e0 2024-04-25T15:59:28.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49effd640 1 -- 172.21.15.87:0/2317619716 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5658 (secure 0 0 0) 0x7fe4a405adf0 con 0x7fe4b00744e0 2024-04-25T15:59:28.294 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:28.294 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:24.289969+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:28.294 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe49006f400 msgr2=0x7fe490071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe49006f400 0x7fe490071910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00ad000 tx=0x7fe4a0008040 comp rx=0 tx=0).stop 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 msgr2=0x7fe4b01f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 0x7fe4b01f4280 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c480 tx=0x7fe4a400c940 comp rx=0 tx=0).stop 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 shutdown_connections 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe49006f400 0x7fe490071910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4b0154c90 0x7fe4b00ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4b00744e0 0x7fe4b01f4280 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 --2- 172.21.15.87:0/2317619716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4b00740d0 0x7fe4b0143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 >> 172.21.15.87:0/2317619716 conn(0x7fe4b006d650 msgr2=0x7fe4b01569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 shutdown_connections 2024-04-25T15:59:28.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.293+0000 7fe49cff9640 1 -- 172.21.15.87:0/2317619716 wait complete. 2024-04-25T15:59:28.315 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T15:59:28.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:28.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 Processor -- start 2024-04-25T15:59:28.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 -- start start 2024-04-25T15:59:28.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f226c1529a0 0x7f226c071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c0ad990 0x7f226c0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226c072430 con 0x7f226c0c41e0 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f226c074730 con 0x7f226c1529a0 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2272d72640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f226c074a10 con 0x7f226c0ad990 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f226c1529a0 0x7f226c071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f226c1529a0 0x7f226c071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35762/0 (socket says 172.21.15.87:35762) 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 -- 172.21.15.87:0/44916636 learned_addr learned my addr 172.21.15.87:0/44916636 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f226bfff640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c0ad990 0x7f226c0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 -- 172.21.15.87:0/44916636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c0ad990 msgr2=0x7f226c0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c0ad990 0x7f226c0adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 -- 172.21.15.87:0/44916636 >> v1:172.21.15.155:6789/0 conn(0x7f226c0c41e0 legacy=0x7f226c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f2270b0e640 1 -- 172.21.15.87:0/44916636 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c074cf0 con 0x7f226c1529a0 2024-04-25T15:59:28.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.897+0000 7f226bfff640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c0ad990 0x7f226c0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:28.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2270b0e640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c1529a0 0x7f226c071e50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2260009870 tx=0x7f226001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ef6bfb037a1797 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:28.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f226b7fe640 1 -- 172.21.15.87:0/44916636 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600b0070 con 0x7f226c1529a0 2024-04-25T15:59:28.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f226b7fe640 1 -- 172.21.15.87:0/44916636 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22600ab600 con 0x7f226c1529a0 2024-04-25T15:59:28.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f226b7fe640 1 -- 172.21.15.87:0/44916636 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600ab9d0 con 0x7f226c1529a0 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 -- 172.21.15.87:0/44916636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c1529a0 msgr2=0x7f226c071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c1529a0 0x7f226c071e50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2260009870 tx=0x7f226001c490 comp rx=0 tx=0).stop 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 -- 172.21.15.87:0/44916636 shutdown_connections 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c0ad990 0x7f226c0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 --2- 172.21.15.87:0/44916636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c1529a0 0x7f226c071e50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 -- 172.21.15.87:0/44916636 >> 172.21.15.87:0/44916636 conn(0x7f226c0c8770 msgr2=0x7f226c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 -- 172.21.15.87:0/44916636 shutdown_connections 2024-04-25T15:59:28.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 -- 172.21.15.87:0/44916636 wait complete. 2024-04-25T15:59:28.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 Processor -- start 2024-04-25T15:59:28.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.901+0000 7f2272d72640 1 -- start start 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 0x7f226c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f226c0c41e0 0x7f226c1f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c1529a0 0x7f226c1f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f226c162470 con 0x7f226c0ad990 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f226c1622f0 con 0x7f226c0c41e0 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f226c1625f0 con 0x7f226c1529a0 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 0x7f226c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 0x7f226c15e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35776/0 (socket says 172.21.15.87:35776) 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 -- 172.21.15.87:0/990186905 learned_addr learned my addr 172.21.15.87:0/990186905 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f227130f640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c1529a0 0x7f226c1f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 -- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c1529a0 msgr2=0x7f226c1f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c1529a0 0x7f226c1f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 -- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f226c0c41e0 msgr2=0x7f226c1f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f226c0c41e0 0x7f226c1f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 -- 172.21.15.87:0/990186905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c1f0730 con 0x7f226c0ad990 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2270b0e640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 0x7f226c15e080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f22600ae040 tx=0x7f226001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600b0040 con 0x7f226c0ad990 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22600bc070 con 0x7f226c0ad990 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c143ab0 con 0x7f226c0ad990 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600b6860 con 0x7f226c0ad990 2024-04-25T15:59:28.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c1494f0 con 0x7f226c0ad990 2024-04-25T15:59:28.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f226c069bb0 con 0x7f226c0ad990 2024-04-25T15:59:28.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f22600b6a00 con 0x7f226c0ad990 2024-04-25T15:59:28.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.905+0000 7f22697fa640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f225006f400 0x7f2250071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:28.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.909+0000 7f226bfff640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f225006f400 0x7f2250071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:28.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.909+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7f2260129c10 con 0x7f226c0ad990 2024-04-25T15:59:28.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.909+0000 7f226bfff640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f225006f400 0x7f2250071910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f226c06daf0 tx=0x7f2258008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:28.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:28.913+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2260016110 con 0x7f226c0ad990 2024-04-25T15:59:29.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.109+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f226c0c3760 con 0x7f226c0ad990 2024-04-25T15:59:29.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.109+0000 7f22697fa640 1 -- 172.21.15.87:0/990186905 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5658 (secure 0 0 0) 0x7f226012d020 con 0x7f226c0ad990 2024-04-25T15:59:29.112 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:29.112 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:24.289969+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:29.113 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f225006f400 msgr2=0x7f2250071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f225006f400 0x7f2250071910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f226c06daf0 tx=0x7f2258008040 comp rx=0 tx=0).stop 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 msgr2=0x7f226c15e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 0x7f226c15e080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f22600ae040 tx=0x7f226001acd0 comp rx=0 tx=0).stop 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 shutdown_connections 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f225006f400 0x7f2250071910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f226c1529a0 0x7f226c1f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f226c0c41e0 0x7f226c1f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:29.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 --2- 172.21.15.87:0/990186905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f226c0ad990 0x7f226c15e080 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:29.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 >> 172.21.15.87:0/990186905 conn(0x7f226c0c8770 msgr2=0x7f226c0c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:29.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 shutdown_connections 2024-04-25T15:59:29.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:29.113+0000 7f2272d72640 1 -- 172.21.15.87:0/990186905 wait complete. 2024-04-25T15:59:29.133 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:30.316 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:30.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.473+0000 7f63fd536640 1 Processor -- start 2024-04-25T15:59:30.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.473+0000 7f63fd536640 1 -- start start 2024-04-25T15:59:30.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63fd536640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63f81517d0 0x7f63f80c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:30.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63fd536640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 0x7f63f815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:30.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63fd536640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f80c5290 con 0x7f63f80c9ae0 2024-04-25T15:59:30.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63fd536640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f63f80c5e80 con 0x7f63f81517d0 2024-04-25T15:59:30.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63fd536640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63f8154fd0 con 0x7f63f8157fc0 2024-04-25T15:59:30.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 0x7f63f815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:30.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f6ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63f81517d0 0x7f63f80c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:30.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 0x7f63f815ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:59290/0 (socket says 172.21.15.87:59290) 2024-04-25T15:59:30.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f77fe640 1 -- 172.21.15.87:0/1110882862 learned_addr learned my addr 172.21.15.87:0/1110882862 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:30.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f6ffd640 1 -- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 msgr2=0x7f63f815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:30.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f6ffd640 1 --2- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 0x7f63f815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f6ffd640 1 -- 172.21.15.87:0/1110882862 >> v1:172.21.15.155:6789/0 conn(0x7f63f80c9ae0 legacy=0x7f63f81578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:30.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f6ffd640 1 -- 172.21.15.87:0/1110882862 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f80c5550 con 0x7f63f81517d0 2024-04-25T15:59:30.479 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f77fe640 1 --2- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 0x7f63f815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:59:30.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.477+0000 7f63f6ffd640 1 --2- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f80c95a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63e80097c0 tx=0x7f63e801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1202226d4c3c5047 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:30.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63f5ffb640 1 -- 172.21.15.87:0/1110882862 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80b2070 con 0x7f63f81517d0 2024-04-25T15:59:30.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63f5ffb640 1 -- 172.21.15.87:0/1110882862 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e80ad640 con 0x7f63f81517d0 2024-04-25T15:59:30.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63f5ffb640 1 -- 172.21.15.87:0/1110882862 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80ada10 con 0x7f63f81517d0 2024-04-25T15:59:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 -- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 msgr2=0x7f63f80c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 --2- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f80c95a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63e80097c0 tx=0x7f63e801c4a0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 -- 172.21.15.87:0/1110882862 shutdown_connections 2024-04-25T15:59:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 --2- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f8157fc0 0x7f63f815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 --2- 172.21.15.87:0/1110882862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f80c95a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 -- 172.21.15.87:0/1110882862 >> 172.21.15.87:0/1110882862 conn(0x7f63f806d780 msgr2=0x7f63f806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 -- 172.21.15.87:0/1110882862 shutdown_connections 2024-04-25T15:59:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 -- 172.21.15.87:0/1110882862 wait complete. 2024-04-25T15:59:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 Processor -- start 2024-04-25T15:59:30.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.481+0000 7f63fd536640 1 -- start start 2024-04-25T15:59:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f80c9ae0 0x7f63f8143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f81f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 0x7f63f814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8158550 con 0x7f63f8157fc0 2024-04-25T15:59:30.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f63f81583d0 con 0x7f63f81517d0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63f80a8f70 con 0x7f63f80c9ae0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 0x7f63f814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 0x7f63f814d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35790/0 (socket says 172.21.15.87:35790) 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 -- 172.21.15.87:0/1181738638 learned_addr learned my addr 172.21.15.87:0/1181738638 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f6ffd640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f80c9ae0 0x7f63f8143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f67fc640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f81f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 -- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f80c9ae0 msgr2=0x7f63f8143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f80c9ae0 0x7f63f8143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 -- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 msgr2=0x7f63f81f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f81f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 -- 172.21.15.87:0/1181738638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f814a220 con 0x7f63f8157fc0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f6ffd640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f80c9ae0 0x7f63f8143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63f77fe640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 0x7f63f814d520 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f63f000efc0 tx=0x7f63f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:30.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f000cac0 con 0x7f63f8157fc0 2024-04-25T15:59:30.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f000cc60 con 0x7f63f8157fc0 2024-04-25T15:59:30.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f81f4790 con 0x7f63f8157fc0 2024-04-25T15:59:30.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0003bc0 con 0x7f63f8157fc0 2024-04-25T15:59:30.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f8149670 con 0x7f63f8157fc0 2024-04-25T15:59:30.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.485+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f8069bb0 con 0x7f63f8157fc0 2024-04-25T15:59:30.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.489+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f63f001b030 con 0x7f63f8157fc0 2024-04-25T15:59:30.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.489+0000 7f63df7fe640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f63e406f400 0x7f63e4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:30.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.489+0000 7f63f6ffd640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f63e406f400 0x7f63e4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:30.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.489+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7f63f0090a00 con 0x7f63f8157fc0 2024-04-25T15:59:30.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.489+0000 7f63f6ffd640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f63e406f400 0x7f63e4071910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f63e80af000 tx=0x7f63e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.505+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63f0022020 con 0x7f63f8157fc0 2024-04-25T15:59:30.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.705+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63f814e3c0 con 0x7f63f8157fc0 2024-04-25T15:59:30.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.705+0000 7f63df7fe640 1 -- 172.21.15.87:0/1181738638 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5659 (secure 0 0 0) 0x7f63f0010040 con 0x7f63f8157fc0 2024-04-25T15:59:30.707 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:30.707 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:29.431144+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:rejoin","state_seq":23,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:30.707 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 44 2024-04-25T15:59:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.705+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f63e406f400 msgr2=0x7f63e4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.705+0000 7f63fd536640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f63e406f400 0x7f63e4071910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f63e80af000 tx=0x7f63e8008040 comp rx=0 tx=0).stop 2024-04-25T15:59:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.705+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 msgr2=0x7f63f814d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 0x7f63f814d520 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f63f000efc0 tx=0x7f63f000c490 comp rx=0 tx=0).stop 2024-04-25T15:59:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 shutdown_connections 2024-04-25T15:59:30.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f63e406f400 0x7f63e4071910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63f8157fc0 0x7f63f814d520 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63f81517d0 0x7f63f81f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 --2- 172.21.15.87:0/1181738638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63f80c9ae0 0x7f63f8143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 >> 172.21.15.87:0/1181738638 conn(0x7f63f806d780 msgr2=0x7f63f806ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 shutdown_connections 2024-04-25T15:59:30.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:30.709+0000 7f63fd536640 1 -- 172.21.15.87:0/1181738638 wait complete. 2024-04-25T15:59:30.727 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T15:59:31.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:31.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41df60e640 1 Processor -- start 2024-04-25T15:59:31.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41df60e640 1 -- start start 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41df60e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41d80c48f0 0x7f41d8160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41df60e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d8072430 con 0x7f41d8071e50 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41df60e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d8074730 con 0x7f41d81529a0 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41df60e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f41d8074a10 con 0x7f41d80c48f0 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41dcba9640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f41d8071e50 0x7f41d80c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52532/0 (socket says 172.21.15.87:52532) 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41dcba9640 1 -- 172.21.15.87:0/554200007 learned_addr learned my addr 172.21.15.87:0/554200007 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:31.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41ddbab640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41d80c48f0 0x7f41d8160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:31.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41ddbab640 1 -- 172.21.15.87:0/554200007 >> v1:172.21.15.155:6789/0 conn(0x7f41d81529a0 legacy=0x7f41d80ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41ddbab640 1 -- 172.21.15.87:0/554200007 >> v1:172.21.15.87:6789/0 conn(0x7f41d8071e50 legacy=0x7f41d80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41cffff640 1 -- 172.21.15.87:0/554200007 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860559477 0 0) 0x7f41d8072430 con 0x7f41d8071e50 2024-04-25T15:59:31.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.293+0000 7f41ddbab640 1 -- 172.21.15.87:0/554200007 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d8074cf0 con 0x7f41d80c48f0 2024-04-25T15:59:31.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41ddbab640 1 --2- 172.21.15.87:0/554200007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d80c48f0 0x7f41d8160ae0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009d90 tx=0x7f41d001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494c9b78e3b52dc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:31.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41cffff640 1 -- 172.21.15.87:0/554200007 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00b2070 con 0x7f41d80c48f0 2024-04-25T15:59:31.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41cffff640 1 -- 172.21.15.87:0/554200007 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d00a57a0 con 0x7f41d80c48f0 2024-04-25T15:59:31.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41cffff640 1 -- 172.21.15.87:0/554200007 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00a5b70 con 0x7f41d80c48f0 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 -- 172.21.15.87:0/554200007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d80c48f0 msgr2=0x7f41d8160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 --2- 172.21.15.87:0/554200007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d80c48f0 0x7f41d8160ae0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009d90 tx=0x7f41d001c8e0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 -- 172.21.15.87:0/554200007 shutdown_connections 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 --2- 172.21.15.87:0/554200007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d80c48f0 0x7f41d8160ae0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 -- 172.21.15.87:0/554200007 >> 172.21.15.87:0/554200007 conn(0x7f41d80c8770 msgr2=0x7f41d80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 -- 172.21.15.87:0/554200007 shutdown_connections 2024-04-25T15:59:31.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 -- 172.21.15.87:0/554200007 wait complete. 2024-04-25T15:59:31.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 Processor -- start 2024-04-25T15:59:31.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.297+0000 7f41df60e640 1 -- start start 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 0x7f41d8149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d80c48f0 0x7f41d8145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d81529a0 0x7f41d8147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41d80c4d00 con 0x7f41d8071e50 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41d8163840 con 0x7f41d80c48f0 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41d80c6560 con 0x7f41d81529a0 2024-04-25T15:59:31.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 0x7f41d8149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 0x7f41d8149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39688/0 (socket says 172.21.15.87:39688) 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 -- 172.21.15.87:0/1950537308 learned_addr learned my addr 172.21.15.87:0/1950537308 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dcba9640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d80c48f0 0x7f41d8145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41ddbab640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d81529a0 0x7f41d8147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 -- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d81529a0 msgr2=0x7f41d8147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d81529a0 0x7f41d8147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 -- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d80c48f0 msgr2=0x7f41d8145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d80c48f0 0x7f41d8145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 -- 172.21.15.87:0/1950537308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d814a470 con 0x7f41d8071e50 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dcba9640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d80c48f0 0x7f41d8145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41dd3aa640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 0x7f41d8149f30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f41d400c3c0 tx=0x7f41d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4017070 con 0x7f41d8071e50 2024-04-25T15:59:31.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d40052d0 con 0x7f41d8071e50 2024-04-25T15:59:31.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d80c7160 con 0x7f41d8071e50 2024-04-25T15:59:31.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4003820 con 0x7f41d8071e50 2024-04-25T15:59:31.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d80c7720 con 0x7f41d8071e50 2024-04-25T15:59:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d8069bb0 con 0x7f41d8071e50 2024-04-25T15:59:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.301+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f41d401a070 con 0x7f41d8071e50 2024-04-25T15:59:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.305+0000 7f41cdffb640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41bc06f400 0x7f41bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.305+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7f41d408ec40 con 0x7f41d8071e50 2024-04-25T15:59:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.305+0000 7f41dcba9640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41bc06f400 0x7f41bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:31.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.305+0000 7f41dcba9640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41bc06f400 0x7f41bc071910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41d80c2c80 tx=0x7f41c8007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:31.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.309+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41d4005480 con 0x7f41d8071e50 2024-04-25T15:59:31.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.513+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41d80c3760 con 0x7f41d8071e50 2024-04-25T15:59:31.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.513+0000 7f41cdffb640 1 -- 172.21.15.87:0/1950537308 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5665 (secure 0 0 0) 0x7f41d405b550 con 0x7f41d8071e50 2024-04-25T15:59:31.517 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:31.517 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:30.568720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:clientreplay","state_seq":24,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:31.517 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 45 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41bc06f400 msgr2=0x7f41bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41bc06f400 0x7f41bc071910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41d80c2c80 tx=0x7f41c8007df0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 msgr2=0x7f41d8149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 0x7f41d8149f30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f41d400c3c0 tx=0x7f41d400c880 comp rx=0 tx=0).stop 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 shutdown_connections 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f41bc06f400 0x7f41bc071910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41d81529a0 0x7f41d8147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41d80c48f0 0x7f41d8145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 --2- 172.21.15.87:0/1950537308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d8071e50 0x7f41d8149f30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 >> 172.21.15.87:0/1950537308 conn(0x7f41d80c8770 msgr2=0x7f41d8150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 shutdown_connections 2024-04-25T15:59:31.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:31.517+0000 7f41df60e640 1 -- 172.21.15.87:0/1950537308 wait complete. 2024-04-25T15:59:31.539 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:32.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:32.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d46d3640 1 Processor -- start 2024-04-25T15:59:32.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d46d3640 1 -- start start 2024-04-25T15:59:32.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d46d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12cc0cb030 0x7f12cc15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:32.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d46d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc0c7570 con 0x7f12cc160230 2024-04-25T15:59:32.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d46d3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc15b8b0 con 0x7f12cc15ad90 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d46d3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f12cc15b5d0 con 0x7f12cc0cb030 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d2c70640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f12cc160230 0x7f12cc162650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52542/0 (socket says 172.21.15.87:52542) 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d1c6e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12cc0cb030 0x7f12cc15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d2c70640 1 -- 172.21.15.87:0/2750626098 learned_addr learned my addr 172.21.15.87:0/2750626098 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d1c6e640 1 -- 172.21.15.87:0/2750626098 >> v1:172.21.15.155:6789/0 conn(0x7f12cc15ad90 legacy=0x7f12cc0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d1c6e640 1 -- 172.21.15.87:0/2750626098 >> v1:172.21.15.87:6789/0 conn(0x7f12cc160230 legacy=0x7f12cc162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d146d640 1 -- 172.21.15.87:0/2750626098 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822871575 0 0) 0x7f12cc0c7570 con 0x7f12cc160230 2024-04-25T15:59:32.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.905+0000 7f12d1c6e640 1 -- 172.21.15.87:0/2750626098 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc0c2290 con 0x7f12cc0cb030 2024-04-25T15:59:32.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d1c6e640 1 --2- 172.21.15.87:0/2750626098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc15fcf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0097c0 tx=0x7f12bc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f1c05caf514552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:32.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d146d640 1 -- 172.21.15.87:0/2750626098 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0b0070 con 0x7f12cc0cb030 2024-04-25T15:59:32.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d146d640 1 -- 172.21.15.87:0/2750626098 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc0ab600 con 0x7f12cc0cb030 2024-04-25T15:59:32.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d146d640 1 -- 172.21.15.87:0/2750626098 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0ab9d0 con 0x7f12cc0cb030 2024-04-25T15:59:32.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 -- 172.21.15.87:0/2750626098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 msgr2=0x7f12cc15fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:32.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 --2- 172.21.15.87:0/2750626098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc15fcf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0097c0 tx=0x7f12bc01c380 comp rx=0 tx=0).stop 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 -- 172.21.15.87:0/2750626098 shutdown_connections 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 --2- 172.21.15.87:0/2750626098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc15fcf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 -- 172.21.15.87:0/2750626098 >> 172.21.15.87:0/2750626098 conn(0x7f12cc0c9330 msgr2=0x7f12cc0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 -- 172.21.15.87:0/2750626098 shutdown_connections 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 -- 172.21.15.87:0/2750626098 wait complete. 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 Processor -- start 2024-04-25T15:59:32.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.909+0000 7f12d46d3640 1 -- start start 2024-04-25T15:59:32.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:32.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12cc15ad90 0x7f12cc148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:32.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12cc160230 0x7f12cc1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:32.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc15b1a0 con 0x7f12cc0cb030 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0ca190 con 0x7f12cc15ad90 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc15b320 con 0x7f12cc160230 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc1417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39716/0 (socket says 172.21.15.87:39716) 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 -- 172.21.15.87:0/1690011505 learned_addr learned my addr 172.21.15.87:0/1690011505 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d1c6e640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12cc15ad90 0x7f12cc148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d2c70640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12cc160230 0x7f12cc1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 -- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12cc160230 msgr2=0x7f12cc1471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12cc160230 0x7f12cc1471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 -- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12cc15ad90 msgr2=0x7f12cc148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12cc15ad90 0x7f12cc148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:32.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 -- 172.21.15.87:0/1690011505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc0adbb0 con 0x7f12cc0cb030 2024-04-25T15:59:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d246f640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc1417f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f12c800c3f0 tx=0x7f12c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8017070 con 0x7f12cc0cb030 2024-04-25T15:59:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c80052d0 con 0x7f12cc0cb030 2024-04-25T15:59:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12cc0ade90 con 0x7f12cc0cb030 2024-04-25T15:59:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8003840 con 0x7f12cc0cb030 2024-04-25T15:59:32.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12cc1491b0 con 0x7f12cc0cb030 2024-04-25T15:59:32.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12cc069bb0 con 0x7f12cc0cb030 2024-04-25T15:59:32.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.913+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f12c801a070 con 0x7f12cc0cb030 2024-04-25T15:59:32.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.917+0000 7f12c2ffd640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f12b006f400 0x7f12b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:32.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.917+0000 7f12d1c6e640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f12b006f400 0x7f12b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:32.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.917+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7f12c808eae0 con 0x7f12cc0cb030 2024-04-25T15:59:32.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.917+0000 7f12d1c6e640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f12b006f400 0x7f12b0071910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0ad000 tx=0x7f12bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:32.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:32.921+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12c8005480 con 0x7f12cc0cb030 2024-04-25T15:59:33.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.137+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12cc15a750 con 0x7f12cc0cb030 2024-04-25T15:59:33.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.137+0000 7f12c2ffd640 1 -- 172.21.15.87:0/1690011505 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5666 (secure 0 0 0) 0x7f12c805ae30 con 0x7f12cc0cb030 2024-04-25T15:59:33.141 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:33.141 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:33.141 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 46 2024-04-25T15:59:33.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f12b006f400 msgr2=0x7f12b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f12b006f400 0x7f12b0071910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0ad000 tx=0x7f12bc008040 comp rx=0 tx=0).stop 2024-04-25T15:59:33.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 msgr2=0x7f12cc1417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc1417f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f12c800c3f0 tx=0x7f12c800c8b0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 shutdown_connections 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f12b006f400 0x7f12b0071910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12cc160230 0x7f12cc1471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12cc15ad90 0x7f12cc148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 --2- 172.21.15.87:0/1690011505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12cc0cb030 0x7f12cc1417f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 >> 172.21.15.87:0/1690011505 conn(0x7f12cc0c9330 msgr2=0x7f12cc153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 shutdown_connections 2024-04-25T15:59:33.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.141+0000 7f12d46d3640 1 -- 172.21.15.87:0/1690011505 wait complete. 2024-04-25T15:59:33.164 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4966 2024-04-25T15:59:33.164 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.d 2024-04-25T15:59:33.481 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-04-25T15:59:33.481+0000 7fea17a55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:59:33.540 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e7e3c640 1 Processor -- start 2024-04-25T15:59:33.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e7e3c640 1 -- start start 2024-04-25T15:59:33.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e7e3c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8e01578b0 0x7fa8e0157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e7e3c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e00c5290 con 0x7fa8e01517d0 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e7e3c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e00c5550 con 0x7fa8e0158200 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e7e3c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e00c5e80 con 0x7fa8e01578b0 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e53d7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8e01578b0 0x7fa8e0157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e53d7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8e01578b0 0x7fa8e0157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39730/0 (socket says 172.21.15.87:39730) 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e53d7640 1 -- 172.21.15.87:0/2200429525 learned_addr learned my addr 172.21.15.87:0/2200429525 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e53d7640 1 -- 172.21.15.87:0/2200429525 >> v1:172.21.15.155:6789/0 conn(0x7fa8e0158200 legacy=0x7fa8e015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e53d7640 1 -- 172.21.15.87:0/2200429525 >> v1:172.21.15.87:6789/0 conn(0x7fa8e01517d0 legacy=0x7fa8e00c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e4bd6640 1 -- 172.21.15.87:0/2200429525 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268957327 0 0) 0x7fa8e00c5290 con 0x7fa8e01517d0 2024-04-25T15:59:33.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.697+0000 7fa8e53d7640 1 -- 172.21.15.87:0/2200429525 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e00c5830 con 0x7fa8e01578b0 2024-04-25T15:59:33.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e53d7640 1 --2- 172.21.15.87:0/2200429525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01578b0 0x7fa8e0157cc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009870 tx=0x7fa8d001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62abea97febf4565 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e4bd6640 1 -- 172.21.15.87:0/2200429525 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00b2070 con 0x7fa8e01578b0 2024-04-25T15:59:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e4bd6640 1 -- 172.21.15.87:0/2200429525 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d00a9070 con 0x7fa8e01578b0 2024-04-25T15:59:33.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e4bd6640 1 -- 172.21.15.87:0/2200429525 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00ad880 con 0x7fa8e01578b0 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/2200429525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01578b0 msgr2=0x7fa8e0157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/2200429525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01578b0 0x7fa8e0157cc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009870 tx=0x7fa8d001c560 comp rx=0 tx=0).stop 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/2200429525 shutdown_connections 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/2200429525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01578b0 0x7fa8e0157cc0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/2200429525 >> 172.21.15.87:0/2200429525 conn(0x7fa8e006d780 msgr2=0x7fa8e006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/2200429525 shutdown_connections 2024-04-25T15:59:33.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.701+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/2200429525 wait complete. 2024-04-25T15:59:33.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 Processor -- start 2024-04-25T15:59:33.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 -- start start 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 0x7fa8e014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8e01578b0 0x7fa8e00ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8e0158200 0x7fa8e014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e00a8f70 con 0x7fa8e01517d0 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0151be0 con 0x7fa8e0158200 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e7e3c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e00a90f0 con 0x7fa8e01578b0 2024-04-25T15:59:33.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 0x7fa8e014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 0x7fa8e014cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39738/0 (socket says 172.21.15.87:39738) 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 -- 172.21.15.87:0/1441942916 learned_addr learned my addr 172.21.15.87:0/1441942916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e53d7640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8e01578b0 0x7fa8e00ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e63d9640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8e0158200 0x7fa8e014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 -- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8e01578b0 msgr2=0x7fa8e00ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8e01578b0 0x7fa8e00ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 -- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8e0158200 msgr2=0x7fa8e014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8e0158200 0x7fa8e014e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 -- 172.21.15.87:0/1441942916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e00ad5e0 con 0x7fa8e01517d0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8e5bd8640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 0x7fa8e014cf60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c410 tx=0x7fa8dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc017070 con 0x7fa8e01517d0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc003600 con 0x7fa8e01517d0 2024-04-25T15:59:33.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.705+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0039d0 con 0x7fa8e01517d0 2024-04-25T15:59:33.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e0156f20 con 0x7fa8e01517d0 2024-04-25T15:59:33.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e014fc90 con 0x7fa8e01517d0 2024-04-25T15:59:33.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e0069bb0 con 0x7fa8e01517d0 2024-04-25T15:59:33.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa8dc01a070 con 0x7fa8e01517d0 2024-04-25T15:59:33.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8d67fc640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8c406f430 0x7fa8c4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:33.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8e53d7640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8c406f430 0x7fa8c4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:33.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7211+0+0 (secure 0 0 0) 0x7fa8dc08eb00 con 0x7fa8e01517d0 2024-04-25T15:59:33.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.709+0000 7fa8e53d7640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8c406f430 0x7fa8c4071940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00af000 tx=0x7fa8d00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:33.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.713+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8dc05b530 con 0x7fa8e01517d0 2024-04-25T15:59:33.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.929+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8e00c4910 con 0x7fa8e01517d0 2024-04-25T15:59:33.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8d67fc640 1 -- 172.21.15.87:0/1441942916 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5666 (secure 0 0 0) 0x7fa8dc05ae30 con 0x7fa8e01517d0 2024-04-25T15:59:33.933 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:33.933 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5140,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:58:11.495138+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":66,"addr":"172.21.15.155:6835/630698588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":630698588},{"type":"v1","addr":"172.21.15.155:6835","nonce":630698588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4235,"qdb_cluster":[4235]},"id":2}]} 2024-04-25T15:59:33.934 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 46 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8c406f430 msgr2=0x7fa8c4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8c406f430 0x7fa8c4071940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00af000 tx=0x7fa8d00a7000 comp rx=0 tx=0).stop 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 msgr2=0x7fa8e014cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 0x7fa8e014cf60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c410 tx=0x7fa8dc00c8d0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 shutdown_connections 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa8c406f430 0x7fa8c4071940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8e0158200 0x7fa8e014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8e01578b0 0x7fa8e00ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 --2- 172.21.15.87:0/1441942916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e01517d0 0x7fa8e014cf60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 >> 172.21.15.87:0/1441942916 conn(0x7fa8e006d780 msgr2=0x7fa8e014b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:33.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 shutdown_connections 2024-04-25T15:59:33.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:33.933+0000 7fa8e7e3c640 1 -- 172.21.15.87:0/1441942916 wait complete. 2024-04-25T15:59:33.955 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T15:59:35.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.109+0000 7f800e73e640 1 Processor -- start 2024-04-25T15:59:36.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.109+0000 7f800e73e640 1 -- start start 2024-04-25T15:59:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f800e73e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 0x7f80081632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f800e73e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80080c53b0 con 0x7f8008157530 2024-04-25T15:59:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f800e73e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8008157b60 con 0x7f80080c8bc0 2024-04-25T15:59:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f800e73e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8008157940 con 0x7f8008160eb0 2024-04-25T15:59:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8007fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8008157530 0x7f8008074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52568/0 (socket says 172.21.15.87:52568) 2024-04-25T15:59:36.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8007fff640 1 -- 172.21.15.87:0/3912285990 learned_addr learned my addr 172.21.15.87:0/3912285990 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:36.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685027661 0 0) 0x7f7ff8001120 con 0x7f8008157530 2024-04-25T15:59:36.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff4003530 con 0x7f8008157530 2024-04-25T15:59:36.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1756853635 0 0) 0x7f7ff4003530 con 0x7f8008157530 2024-04-25T15:59:36.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f800ccdb640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 0x7f80081632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 msgr2=0x7f80081632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 0x7f80081632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 >> v1:172.21.15.155:6789/0 conn(0x7f80080c8bc0 legacy=0x7f80080c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8008157e40 con 0x7f8008157530 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f7ff8001850 con 0x7f8008157530 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 >> v1:172.21.15.87:6789/0 conn(0x7f8008157530 legacy=0x7f8008074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40039f0 0x7f7ff4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 0x7f7ff400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8008157940 con 0x7f7ff4004810 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff4005640 con 0x7f7ff40039f0 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff400bf40 con 0x7f8008160eb0 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f80077fe640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f8007fff640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40039f0 0x7f7ff4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f80077fe640 1 -- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 msgr2=0x7f7ff400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:59:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f80077fe640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8008160eb0 0x7f7ff400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f80077fe640 1 -- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40039f0 msgr2=0x7f7ff4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f80077fe640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff40039f0 0x7f7ff4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.113+0000 7f80077fe640 1 -- 172.21.15.87:0/3912285990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff4003530 con 0x7f7ff4004810 2024-04-25T15:59:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f80077fe640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0001860 tx=0x7f7ff001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ef5c5f7b7a4a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00b0070 con 0x7f7ff4004810 2024-04-25T15:59:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff00ab600 con 0x7f7ff4004810 2024-04-25T15:59:36.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f8006ffd640 1 -- 172.21.15.87:0/3912285990 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0001460 con 0x7f7ff4004810 2024-04-25T15:59:36.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800e73e640 1 -- 172.21.15.87:0/3912285990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff4004810 msgr2=0x7f7ff4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800e73e640 1 --2- 172.21.15.87:0/3912285990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ff4004810 0x7f7ff4004c20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0001860 tx=0x7f7ff001c4c0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800ccdb640 1 -- 172.21.15.87:0/3912285990 reap_dead start 2024-04-25T15:59:36.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800e73e640 1 -- 172.21.15.87:0/3912285990 shutdown_connections 2024-04-25T15:59:36.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800e73e640 1 -- 172.21.15.87:0/3912285990 >> 172.21.15.87:0/3912285990 conn(0x7f80080ac550 msgr2=0x7f80080ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:36.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800e73e640 1 -- 172.21.15.87:0/3912285990 shutdown_connections 2024-04-25T15:59:36.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.117+0000 7f800e73e640 1 -- 172.21.15.87:0/3912285990 wait complete. 2024-04-25T15:59:36.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 Processor -- start 2024-04-25T15:59:36.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 -- start start 2024-04-25T15:59:36.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff4004810 0x7f800815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 0x7f80081f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80080aaba0 0x7f800814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8008074870 con 0x7f80080ac140 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f80080aa230 con 0x7f7ff4004810 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f80080749f0 con 0x7f80080aaba0 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 0x7f80081f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 0x7f80081f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39752/0 (socket says 172.21.15.87:39752) 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 -- 172.21.15.87:0/3569182406 learned_addr learned my addr 172.21.15.87:0/3569182406 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800ccdb640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80080aaba0 0x7f800814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 -- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80080aaba0 msgr2=0x7f800814cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80080aaba0 0x7f800814cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f8007fff640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff4004810 0x7f800815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 -- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff4004810 msgr2=0x7f800815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff4004810 0x7f800815b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 -- 172.21.15.87:0/3569182406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80081f4b90 con 0x7f80080ac140 2024-04-25T15:59:36.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f80077fe640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 0x7f80081f3e60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00ae040 tx=0x7f7ff4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00b9030 con 0x7f80080ac140 2024-04-25T15:59:36.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff00ab7b0 con 0x7f80080ac140 2024-04-25T15:59:36.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8008159a90 con 0x7f80080ac140 2024-04-25T15:59:36.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00b0040 con 0x7f80080ac140 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.121+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800814f790 con 0x7f80080ac140 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.125+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8008069bb0 con 0x7f80080ac140 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.125+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7ff00bc070 con 0x7f80080ac140 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.125+0000 7f8004ff9640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7fe806f420 0x7f7fe8071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.125+0000 7f8007fff640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7fe806f420 0x7f7fe8071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.125+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f7ff0128e30 con 0x7f80080ac140 2024-04-25T15:59:36.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.125+0000 7f8007fff640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7fe806f420 0x7f7fe8071930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80019c0 tx=0x7f7ff8001610 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.129+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ff00c4020 con 0x7f80080ac140 2024-04-25T15:59:36.165 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-04-25T15:59:36.165 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:59:36.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T15:59:36.168 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:59:36.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:36.276 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-04-25T15:59:36.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 Processor -- start 2024-04-25T15:59:36.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 -- start start 2024-04-25T15:59:36.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb041529a0 0x7fcb04071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040ad990 0x7fcb040adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb04072430 con 0x7fcb040c41e0 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcb04074730 con 0x7fcb041529a0 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb041529a0 0x7fcb04071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb08a9a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcb04074a10 con 0x7fcb040ad990 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb041529a0 0x7fcb04071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39766/0 (socket says 172.21.15.87:39766) 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 -- 172.21.15.87:0/206676044 learned_addr learned my addr 172.21.15.87:0/206676044 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb01d9b640 1 --2- 172.21.15.87:0/206676044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040ad990 0x7fcb040adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 -- 172.21.15.87:0/206676044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040ad990 msgr2=0x7fcb040adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 --2- 172.21.15.87:0/206676044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040ad990 0x7fcb040adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 -- 172.21.15.87:0/206676044 >> v1:172.21.15.155:6789/0 conn(0x7fcb040c41e0 legacy=0x7fcb040c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.329+0000 7fcb0259c640 1 -- 172.21.15.87:0/206676044 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb04074cf0 con 0x7fcb041529a0 2024-04-25T15:59:36.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.333+0000 7fcb0259c640 1 --2- 172.21.15.87:0/206676044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb041529a0 0x7fcb04071e50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009870 tx=0x7fcaf401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be68d7d1b0c1a935 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.333+0000 7fcb0159a640 1 -- 172.21.15.87:0/206676044 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40b0070 con 0x7fcb041529a0 2024-04-25T15:59:36.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.333+0000 7fcb0159a640 1 -- 172.21.15.87:0/206676044 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf40ab600 con 0x7fcb041529a0 2024-04-25T15:59:36.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.333+0000 7fcb0159a640 1 -- 172.21.15.87:0/206676044 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40b0070 con 0x7fcb041529a0 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 -- 172.21.15.87:0/206676044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb041529a0 msgr2=0x7fcb04071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/206676044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb041529a0 0x7fcb04071e50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009870 tx=0x7fcaf401c4d0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 -- 172.21.15.87:0/206676044 shutdown_connections 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/206676044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040ad990 0x7fcb040adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/206676044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb041529a0 0x7fcb04071e50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 -- 172.21.15.87:0/206676044 >> 172.21.15.87:0/206676044 conn(0x7fcb040c8770 msgr2=0x7fcb040c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 -- 172.21.15.87:0/206676044 shutdown_connections 2024-04-25T15:59:36.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.337+0000 7fcb08a9a640 1 -- 172.21.15.87:0/206676044 wait complete. 2024-04-25T15:59:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 Processor -- start 2024-04-25T15:59:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 -- start start 2024-04-25T15:59:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 0x7fcb04151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040c41e0 0x7fcb04156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb04157210 0x7fcb0414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcb04162470 con 0x7fcb040ad990 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcb041622f0 con 0x7fcb04157210 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcb041625f0 con 0x7fcb040c41e0 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 0x7fcb04151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 0x7fcb04151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39778/0 (socket says 172.21.15.87:39778) 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 -- 172.21.15.87:0/2755184877 learned_addr learned my addr 172.21.15.87:0/2755184877 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb01d9b640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040c41e0 0x7fcb04156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb02d9d640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb04157210 0x7fcb0414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 -- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040c41e0 msgr2=0x7fcb04156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040c41e0 0x7fcb04156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 -- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb04157210 msgr2=0x7fcb0414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb04157210 0x7fcb0414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 -- 172.21.15.87:0/2755184877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb04159cb0 con 0x7fcb040ad990 2024-04-25T15:59:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb0259c640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 0x7fcb04151ab0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcaf401c510 tx=0x7fcaf4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40bb070 con 0x7fcb040ad990 2024-04-25T15:59:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf40ab9b0 con 0x7fcb040ad990 2024-04-25T15:59:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40b0040 con 0x7fcb040ad990 2024-04-25T15:59:36.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb041564f0 con 0x7fcb040ad990 2024-04-25T15:59:36.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.341+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb040c6dd0 con 0x7fcb040ad990 2024-04-25T15:59:36.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.345+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb04069bb0 con 0x7fcb040ad990 2024-04-25T15:59:36.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.353+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcaf4003620 con 0x7fcb040ad990 2024-04-25T15:59:36.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.353+0000 7fcaf2ffd640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcae406f400 0x7fcae4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.353+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7fcaf4129150 con 0x7fcb040ad990 2024-04-25T15:59:36.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.357+0000 7fcb01d9b640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcae406f400 0x7fcae4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.361+0000 7fcb01d9b640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcae406f400 0x7fcae4071910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406daf0 tx=0x7fcaf8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.385+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcaf4016150 con 0x7fcb040ad990 2024-04-25T15:59:36.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.493+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80080c9b30 con 0x7f80080ac140 2024-04-25T15:59:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.493+0000 7f8004ff9640 1 -- 172.21.15.87:0/3569182406 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5661 (secure 0 0 0) 0x7f7ff0016230 con 0x7f80080ac140 2024-04-25T15:59:36.497 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:36.497 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:34.293228+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:59:36.497 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 48 2024-04-25T15:59:36.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7fe806f420 msgr2=0x7f7fe8071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7fe806f420 0x7f7fe8071930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80019c0 tx=0x7f7ff8001610 comp rx=0 tx=0).stop 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 msgr2=0x7f80081f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 0x7f80081f3e60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00ae040 tx=0x7f7ff4005840 comp rx=0 tx=0).stop 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 shutdown_connections 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7fe806f420 0x7f7fe8071930 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80019c0 tx=0x7f7ff8001610 comp rx=0 tx=0).stop 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80080aaba0 0x7f800814cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80080ac140 0x7f80081f3e60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 --2- 172.21.15.87:0/3569182406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ff4004810 0x7f800815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.497+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 >> 172.21.15.87:0/3569182406 conn(0x7f80080ac550 msgr2=0x7f8008154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:36.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.501+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 shutdown_connections 2024-04-25T15:59:36.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.501+0000 7f800e73e640 1 -- 172.21.15.87:0/3569182406 wait complete. 2024-04-25T15:59:36.525 INFO:tasks.mds_thrash.fs.[b]:mds.b down, removed from mdsmap 2024-04-25T15:59:36.525 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T15:59:36.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:36.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.677+0000 7fbcafbe7640 1 Processor -- start 2024-04-25T15:59:36.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.677+0000 7fbcafbe7640 1 -- start start 2024-04-25T15:59:36.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcafbe7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbca815da90 0x7fbca815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcafbe7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca80c5290 con 0x7fbca81578b0 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcafbe7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca80c5550 con 0x7fbca81517d0 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcafbe7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbca80c5e80 con 0x7fbca815da90 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcad182640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbca81578b0 0x7fbca8157cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52582/0 (socket says 172.21.15.87:52582) 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcad182640 1 -- 172.21.15.87:0/1521867446 learned_addr learned my addr 172.21.15.87:0/1521867446 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 --2- 172.21.15.87:0/1521867446 >> v2:172.21.15.155:3300/0 conn(0x7fbca815da90 0x7fbca815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206203941 0 0) 0x7fbca80c5290 con 0x7fbca81578b0 2024-04-25T15:59:36.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc94005740 con 0x7fbca81578b0 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 400780042 0 0) 0x7fbc94005740 con 0x7fbca81578b0 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 >> v2:172.21.15.155:3300/0 conn(0x7fbca815da90 msgr2=0x7fbca815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 --2- 172.21.15.87:0/1521867446 >> v2:172.21.15.155:3300/0 conn(0x7fbca815da90 0x7fbca815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 >> v1:172.21.15.155:6789/0 conn(0x7fbca81517d0 legacy=0x7fbca80c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80c5830 con 0x7fbca81578b0 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fbc98001680 con 0x7fbca81578b0 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 >> v1:172.21.15.87:6789/0 conn(0x7fbca81578b0 legacy=0x7fbca8157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc94005bd0 0x7fbc94006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc94006a20 0x7fbc94006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbc9400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9400e330 con 0x7fbc940073c0 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9400e4e0 con 0x7fbc94005bd0 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9400e6e0 con 0x7fbc94006a20 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbc9400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcad983640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc94005bd0 0x7fbc94006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 -- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc94006a20 msgr2=0x7fbc94006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc94006a20 0x7fbc94006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 -- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc94005bd0 msgr2=0x7fbc94006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc94005bd0 0x7fbc94006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.681+0000 7fbcae184640 1 -- 172.21.15.87:0/1521867446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80c5830 con 0x7fbc940073c0 2024-04-25T15:59:36.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcae184640 1 -- 172.21.15.87:0/1521867446 reap_dead start 2024-04-25T15:59:36.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcae184640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbc9400dbe0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007a00 tx=0x7fbca001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a28b52dc47bfa51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0009c10 con 0x7fbc940073c0 2024-04-25T15:59:36.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca00a5c50 con 0x7fbc940073c0 2024-04-25T15:59:36.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcac981640 1 -- 172.21.15.87:0/1521867446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00039a0 con 0x7fbc940073c0 2024-04-25T15:59:36.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 -- 172.21.15.87:0/1521867446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 msgr2=0x7fbc9400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbc9400dbe0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbc94007a00 tx=0x7fbca001cc40 comp rx=0 tx=0).stop 2024-04-25T15:59:36.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 -- 172.21.15.87:0/1521867446 shutdown_connections 2024-04-25T15:59:36.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/1521867446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbc9400dbe0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 -- 172.21.15.87:0/1521867446 >> 172.21.15.87:0/1521867446 conn(0x7fbca806d780 msgr2=0x7fbca806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:36.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 -- 172.21.15.87:0/1521867446 shutdown_connections 2024-04-25T15:59:36.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.685+0000 7fbcafbe7640 1 -- 172.21.15.87:0/1521867446 wait complete. 2024-04-25T15:59:36.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 Processor -- start 2024-04-25T15:59:36.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 -- start start 2024-04-25T15:59:36.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbca814b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbca8150e50 0x7fbca80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbca8147f20 0x7fbca8148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80c5b10 con 0x7fbc940073c0 2024-04-25T15:59:36.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbca8151be0 con 0x7fbca8147f20 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbca80a8f70 con 0x7fbca8150e50 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbca814b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbca814b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39800/0 (socket says 172.21.15.87:39800) 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 -- 172.21.15.87:0/632407785 learned_addr learned my addr 172.21.15.87:0/632407785 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad182640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbca8150e50 0x7fbca80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcae184640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbca8147f20 0x7fbca8148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 -- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbca8150e50 msgr2=0x7fbca80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbca8150e50 0x7fbca80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 -- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbca8147f20 msgr2=0x7fbca8148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbca8147f20 0x7fbca8148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 -- 172.21.15.87:0/632407785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca8149720 con 0x7fbc940073c0 2024-04-25T15:59:36.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcae184640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbca8147f20 0x7fbca8148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:59:36.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcad983640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbca814b130 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbca400e490 tx=0x7fbca400e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4003a80 con 0x7fbc940073c0 2024-04-25T15:59:36.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca4003c40 con 0x7fbc940073c0 2024-04-25T15:59:36.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4003e30 con 0x7fbc940073c0 2024-04-25T15:59:36.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca8148870 con 0x7fbc940073c0 2024-04-25T15:59:36.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.689+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca81499c0 con 0x7fbc940073c0 2024-04-25T15:59:36.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca8069bb0 con 0x7fbc940073c0 2024-04-25T15:59:36.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbca401a020 con 0x7fbc940073c0 2024-04-25T15:59:36.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fbc9e7fc640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbc8c06f450 0x7fbc8c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:36.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7fbca408ec20 con 0x7fbc940073c0 2024-04-25T15:59:36.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fbcad182640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbc8c06f450 0x7fbc8c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:36.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb040c6b10 con 0x7fcb040ad990 2024-04-25T15:59:36.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.693+0000 7fbcad182640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbc8c06f450 0x7fbc8c071960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbc98001ec0 tx=0x7fbc98001790 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:36.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.697+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbca4021020 con 0x7fbc940073c0 2024-04-25T15:59:36.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcaf2ffd640 1 -- 172.21.15.87:0/2755184877 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5661 (secure 0 0 0) 0x7fcaf40f53a0 con 0x7fcb040ad990 2024-04-25T15:59:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:36.701 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:34.293228+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:59:36.701 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 48 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcae406f400 msgr2=0x7fcae4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcae406f400 0x7fcae4071910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcb0406daf0 tx=0x7fcaf8009190 comp rx=0 tx=0).stop 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 msgr2=0x7fcb04151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 0x7fcb04151ab0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcaf401c510 tx=0x7fcaf4019270 comp rx=0 tx=0).stop 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 shutdown_connections 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcae406f400 0x7fcae4071910 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb04157210 0x7fcb0414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb040c41e0 0x7fcb04156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 --2- 172.21.15.87:0/2755184877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb040ad990 0x7fcb04151ab0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.701+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 >> 172.21.15.87:0/2755184877 conn(0x7fcb040c8770 msgr2=0x7fcb040c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:36.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.709+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 shutdown_connections 2024-04-25T15:59:36.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.709+0000 7fcb08a9a640 1 -- 172.21.15.87:0/2755184877 wait complete. 2024-04-25T15:59:36.732 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-04-25T15:59:36.732 INFO:tasks.mds_thrash.fs.[a]:waiting for 16 secs before thrashing 2024-04-25T15:59:36.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbca80c4910 con 0x7fbc940073c0 2024-04-25T15:59:36.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbc9e7fc640 1 -- 172.21.15.87:0/632407785 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5661 (secure 0 0 0) 0x7fbca405b640 con 0x7fbc940073c0 2024-04-25T15:59:36.989 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:36.990 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:34.293228+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:59:36.990 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 48 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbc8c06f450 msgr2=0x7fbc8c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbc8c06f450 0x7fbc8c071960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbc98001ec0 tx=0x7fbc98001790 comp rx=0 tx=0).stop 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 msgr2=0x7fbca814b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbca814b130 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbca400e490 tx=0x7fbca400e950 comp rx=0 tx=0).stop 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 shutdown_connections 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbc8c06f450 0x7fbc8c071960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbca8147f20 0x7fbca8148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbca8150e50 0x7fbca80c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 --2- 172.21.15.87:0/632407785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc940073c0 0x7fbca814b130 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:36.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 >> 172.21.15.87:0/632407785 conn(0x7fbca806d780 msgr2=0x7fbca815d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:36.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 shutdown_connections 2024-04-25T15:59:36.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:36.989+0000 7fbcafbe7640 1 -- 172.21.15.87:0/632407785 wait complete. 2024-04-25T15:59:37.016 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 48, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 46, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5583": { "addr": "172.21.15.87:6835/4111430078", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 4111430078, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 4111430078, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5583, "incarnation": 42, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 25 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T15:59:32.444303+0000", "qdb_cluster": [ 5583 ], "qdb_leader": 5583, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5583 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 47, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5140": { "addr": "172.21.15.87:6837/2477874160", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6836", "nonce": 2477874160, "type": "v2" }, { "addr": "172.21.15.87:6837", "nonce": 2477874160, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5140, "incarnation": 47, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:59:34.293228+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5140 } } } ], "standbys": [ { "addr": "172.21.15.155:6833/2424832889", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 2424832889, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 2424832889, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 48, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5239, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T15:59:39.045 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.213+0000 7f19d1e5e640 1 Processor -- start 2024-04-25T15:59:39.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.213+0000 7f19d1e5e640 1 -- start start 2024-04-25T15:59:39.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19d1e5e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc15ad90 0x7f19cc0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19d1e5e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19cc0cae60 0x7f19cc0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19d1e5e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19cc157380 0x7f19cc157790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19d1e5e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f19cc0c7570 con 0x7f19cc0cae60 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19d1e5e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f19cc15b8b0 con 0x7f19cc157380 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19d1e5e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19cc15b5d0 con 0x7f19cc15ad90 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19cc0cae60 0x7f19cc0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19cc0cae60 0x7f19cc0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39816/0 (socket says 172.21.15.87:39816) 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 -- 172.21.15.87:0/3816434737 learned_addr learned my addr 172.21.15.87:0/3816434737 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19cbfff640 1 --2- 172.21.15.87:0/3816434737 >> v2:172.21.15.155:3300/0 conn(0x7f19cc157380 0x7f19cc157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19cb7fe640 1 --2- 172.21.15.87:0/3816434737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc15ad90 0x7f19cc0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 -- 172.21.15.87:0/3816434737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc15ad90 msgr2=0x7f19cc0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 --2- 172.21.15.87:0/3816434737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc15ad90 0x7f19cc0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 -- 172.21.15.87:0/3816434737 >> v2:172.21.15.155:3300/0 conn(0x7f19cc157380 msgr2=0x7f19cc157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 --2- 172.21.15.87:0/3816434737 >> v2:172.21.15.155:3300/0 conn(0x7f19cc157380 0x7f19cc157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 -- 172.21.15.87:0/3816434737 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc0c2290 con 0x7f19cc0cae60 2024-04-25T15:59:39.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19c3fff640 1 --2- 172.21.15.87:0/3816434737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc0cb270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f19cc069530 tx=0x7f19b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea20000f0d4b73a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:39.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19caffd640 1 -- 172.21.15.87:0/3816434737 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40b0070 con 0x7f19cc0cae60 2024-04-25T15:59:39.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19caffd640 1 -- 172.21.15.87:0/3816434737 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b40a4e50 con 0x7f19cc0cae60 2024-04-25T15:59:39.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.217+0000 7f19caffd640 1 -- 172.21.15.87:0/3816434737 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40ab820 con 0x7f19cc0cae60 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 -- 172.21.15.87:0/3816434737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 msgr2=0x7f19cc0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/3816434737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc0cb270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f19cc069530 tx=0x7f19b401c400 comp rx=0 tx=0).stop 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 -- 172.21.15.87:0/3816434737 shutdown_connections 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/3816434737 >> v2:172.21.15.155:3300/0 conn(0x7f19cc157380 0x7f19cc157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/3816434737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc0cb270 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/3816434737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc15ad90 0x7f19cc0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 -- 172.21.15.87:0/3816434737 >> 172.21.15.87:0/3816434737 conn(0x7f19cc0c9330 msgr2=0x7f19cc0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 -- 172.21.15.87:0/3816434737 shutdown_connections 2024-04-25T15:59:39.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 -- 172.21.15.87:0/3816434737 wait complete. 2024-04-25T15:59:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 Processor -- start 2024-04-25T15:59:39.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.221+0000 7f19d1e5e640 1 -- start start 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc157380 0x7f19cc1f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19cc15ad90 0x7f19cc140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc1580e0 con 0x7f19cc0cae60 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc0ca190 con 0x7f19cc15ad90 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19cc158260 con 0x7f19cc157380 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:39.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc14b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39832/0 (socket says 172.21.15.87:39832) 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 -- 172.21.15.87:0/1713616033 learned_addr learned my addr 172.21.15.87:0/1713616033 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c3fff640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc157380 0x7f19cc1f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 -- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc157380 msgr2=0x7f19cc1f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc157380 0x7f19cc1f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 -- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19cc15ad90 msgr2=0x7f19cc140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19cc15ad90 0x7f19cc140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 -- 172.21.15.87:0/1713616033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc152d80 con 0x7f19cc0cae60 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19cb7fe640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc14b2b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d5f0 tx=0x7f19bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0125f0 con 0x7f19cc0cae60 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc019070 con 0x7f19cc0cae60 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc141670 con 0x7f19cc0cae60 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0129b0 con 0x7f19cc0cae60 2024-04-25T15:59:39.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19cc146390 con 0x7f19cc0cae60 2024-04-25T15:59:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19cc069bb0 con 0x7f19cc0cae60 2024-04-25T15:59:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19bc012b50 con 0x7f19cc0cae60 2024-04-25T15:59:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c8ff9640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19ac06f430 0x7f19ac071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f19bc08fc10 con 0x7f19cc0cae60 2024-04-25T15:59:39.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.225+0000 7f19c3fff640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19ac06f430 0x7f19ac071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:39.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.229+0000 7f19c3fff640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19ac06f430 0x7f19ac071940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f19b40ad000 tx=0x7f19b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:39.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.237+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19bc05c5e0 con 0x7f19cc0cae60 2024-04-25T15:59:39.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.581+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19cc0c7760 con 0x7f19cc0cae60 2024-04-25T15:59:39.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19c8ff9640 1 -- 172.21.15.87:0/1713616033 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5661 (secure 0 0 0) 0x7f19bc05bee0 con 0x7f19cc0cae60 2024-04-25T15:59:39.585 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:39.585 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:34.293228+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:59:39.585 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 48 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19ac06f430 msgr2=0x7f19ac071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19ac06f430 0x7f19ac071940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f19b40ad000 tx=0x7f19b4008040 comp rx=0 tx=0).stop 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 msgr2=0x7f19cc14b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc14b2b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00d5f0 tx=0x7f19bc00dab0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 shutdown_connections 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f19ac06f430 0x7f19ac071940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19cc15ad90 0x7f19cc140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19cc157380 0x7f19cc1f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 --2- 172.21.15.87:0/1713616033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19cc0cae60 0x7f19cc14b2b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 >> 172.21.15.87:0/1713616033 conn(0x7f19cc0c9330 msgr2=0x7f19cc0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 shutdown_connections 2024-04-25T15:59:39.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:39.585+0000 7f19d1e5e640 1 -- 172.21.15.87:0/1713616033 wait complete. 2024-04-25T15:59:39.607 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-25T15:59:40.269 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:40.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:41.608 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:41.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.753+0000 7f14881d7640 1 Processor -- start 2024-04-25T15:59:41.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.753+0000 7f14881d7640 1 -- start start 2024-04-25T15:59:41.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f14881d7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f1480160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f14881d7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1480152d90 con 0x7f1480155320 2024-04-25T15:59:41.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f14881d7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14800a9cd0 con 0x7f1480152980 2024-04-25T15:59:41.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f14881d7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f14800aa290 con 0x7f1480155730 2024-04-25T15:59:41.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485772640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1480155320 0x7f1480074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59672/0 (socket says 172.21.15.87:59672) 2024-04-25T15:59:41.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485772640 1 -- 172.21.15.87:0/3487840817 learned_addr learned my addr 172.21.15.87:0/3487840817 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1486774640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f1480160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380935734 0 0) 0x7f1480152d90 con 0x7f1480155320 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f146c003530 con 0x7f1480155320 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 387347122 0 0) 0x7f146c003530 con 0x7f1480155320 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 msgr2=0x7f1480160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f1480160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 >> v1:172.21.15.155:6789/0 conn(0x7f1480152980 legacy=0x7f14800c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14800a9fb0 con 0x7f1480155320 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f1470001680 con 0x7f1480155320 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 >> v1:172.21.15.87:6789/0 conn(0x7f1480155320 legacy=0x7f1480074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f146c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f146c004810 0x7f146c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f146c0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f14800aa290 con 0x7f146c0039f0 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f146c00bb90 con 0x7f146c004810 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f146c00bd90 con 0x7f1480155730 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485f73640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f146c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485772640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f146c004810 0x7f146c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1486774640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f146c0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485f73640 1 -- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 msgr2=0x7f146c0052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485f73640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f146c0052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485f73640 1 -- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f146c004810 msgr2=0x7f146c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485f73640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f146c004810 0x7f146c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1485f73640 1 -- 172.21.15.87:0/3487840817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c003530 con 0x7f146c0039f0 2024-04-25T15:59:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.757+0000 7f1486774640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1480155730 0x7f146c0052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f1485f73640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f146c003e60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f147c001780 tx=0x7f147c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec3a0e49fe53699 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c0013a0 con 0x7f146c0039f0 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c0052f0 con 0x7f146c0039f0 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f1484f71640 1 -- 172.21.15.87:0/3487840817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c003840 con 0x7f146c0039f0 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 -- 172.21.15.87:0/3487840817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 msgr2=0x7f146c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 --2- 172.21.15.87:0/3487840817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f146c003e60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f147c001780 tx=0x7f147c01c420 comp rx=0 tx=0).stop 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f1486774640 1 -- 172.21.15.87:0/3487840817 reap_dead start 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 -- 172.21.15.87:0/3487840817 shutdown_connections 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 -- 172.21.15.87:0/3487840817 >> 172.21.15.87:0/3487840817 conn(0x7f14800ac550 msgr2=0x7f14800ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 -- 172.21.15.87:0/3487840817 shutdown_connections 2024-04-25T15:59:41.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 -- 172.21.15.87:0/3487840817 wait complete. 2024-04-25T15:59:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 Processor -- start 2024-04-25T15:59:41.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.761+0000 7f14881d7640 1 -- start start 2024-04-25T15:59:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f14801f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14800c0ca0 0x7f14800abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148014c420 0x7f148014ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1480074870 con 0x7f146c0039f0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f14801598b0 con 0x7f14800c0ca0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f14800749f0 con 0x7f148014c420 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f14801f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f14801f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59136/0 (socket says 172.21.15.87:59136) 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 -- 172.21.15.87:0/2586832539 learned_addr learned my addr 172.21.15.87:0/2586832539 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1486774640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148014c420 0x7f148014ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 -- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148014c420 msgr2=0x7f148014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148014c420 0x7f148014ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485772640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14800c0ca0 0x7f14800abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 -- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14800c0ca0 msgr2=0x7f14800abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14800c0ca0 0x7f14800abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 -- 172.21.15.87:0/2586832539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148014db30 con 0x7f146c0039f0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f1485f73640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f14801f2160 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f147c005040 tx=0x7f146c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c007a40 con 0x7f146c0039f0 2024-04-25T15:59:41.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c0bb070 con 0x7f146c0039f0 2024-04-25T15:59:41.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c0013a0 con 0x7f146c0039f0 2024-04-25T15:59:41.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1480150fc0 con 0x7f146c0039f0 2024-04-25T15:59:41.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148014d850 con 0x7f146c0039f0 2024-04-25T15:59:41.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1480069bb0 con 0x7f146c0039f0 2024-04-25T15:59:41.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f147c0b4040 con 0x7f146c0039f0 2024-04-25T15:59:41.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.765+0000 7f14767fc640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f146406f430 0x7f1464071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:41.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.769+0000 7f1485772640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f146406f430 0x7f1464071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:41.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.769+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f147c129870 con 0x7f146c0039f0 2024-04-25T15:59:41.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.769+0000 7f1485772640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f146406f430 0x7f1464071940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f148014cd40 tx=0x7f1470000f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:41.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.773+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f147c016130 con 0x7f146c0039f0 2024-04-25T15:59:41.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.981+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14801538a0 con 0x7f146c0039f0 2024-04-25T15:59:41.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.981+0000 7f14767fc640 1 -- 172.21.15.87:0/2586832539 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5665 (secure 0 0 0) 0x7f147c0f61b0 con 0x7f146c0039f0 2024-04-25T15:59:41.984 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:41.984 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:40.514202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:reconnect","state_seq":22,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T15:59:41.984 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 49 2024-04-25T15:59:41.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f146406f430 msgr2=0x7f1464071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f146406f430 0x7f1464071940 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f148014cd40 tx=0x7f1470000f00 comp rx=0 tx=0).stop 2024-04-25T15:59:41.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 msgr2=0x7f14801f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:41.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f14801f2160 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f147c005040 tx=0x7f146c005840 comp rx=0 tx=0).stop 2024-04-25T15:59:41.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 shutdown_connections 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f146406f430 0x7f1464071940 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148014c420 0x7f148014ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14800c0ca0 0x7f14800abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 --2- 172.21.15.87:0/2586832539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f146c0039f0 0x7f14801f2160 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 >> 172.21.15.87:0/2586832539 conn(0x7f14800ac550 msgr2=0x7f14800c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 shutdown_connections 2024-04-25T15:59:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:41.985+0000 7f14881d7640 1 -- 172.21.15.87:0/2586832539 wait complete. 2024-04-25T15:59:42.007 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-25T15:59:44.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 Processor -- start 2024-04-25T15:59:44.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 -- start start 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed801517d0 0x7fed800c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed800c9ae0 0x7fed801578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed800c5290 con 0x7fed80157df0 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fed800c5e80 con 0x7fed800c9ae0 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed85da4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed80154fd0 con 0x7fed801517d0 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed800c9ae0 0x7fed801578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed800c9ae0 0x7fed801578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59138/0 (socket says 172.21.15.87:59138) 2024-04-25T15:59:44.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 -- 172.21.15.87:0/1359038679 learned_addr learned my addr 172.21.15.87:0/1359038679 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:44.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7f7fe640 1 --2- 172.21.15.87:0/1359038679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed801517d0 0x7fed800c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:44.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 -- 172.21.15.87:0/1359038679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed801517d0 msgr2=0x7fed800c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:44.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 --2- 172.21.15.87:0/1359038679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed801517d0 0x7fed800c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 -- 172.21.15.87:0/1359038679 >> v1:172.21.15.155:6789/0 conn(0x7fed80157df0 legacy=0x7fed8006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:44.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.169+0000 7fed7effd640 1 -- 172.21.15.87:0/1359038679 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed800c5550 con 0x7fed800c9ae0 2024-04-25T15:59:44.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed7effd640 1 --2- 172.21.15.87:0/1359038679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed800c9ae0 0x7fed801578b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed74009870 tx=0x7fed7401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddb1d2a41459b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:44.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed7e7fc640 1 -- 172.21.15.87:0/1359038679 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740b0070 con 0x7fed800c9ae0 2024-04-25T15:59:44.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed7e7fc640 1 -- 172.21.15.87:0/1359038679 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740ab600 con 0x7fed800c9ae0 2024-04-25T15:59:44.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed7e7fc640 1 -- 172.21.15.87:0/1359038679 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740ab9d0 con 0x7fed800c9ae0 2024-04-25T15:59:44.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 -- 172.21.15.87:0/1359038679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed800c9ae0 msgr2=0x7fed801578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:44.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 --2- 172.21.15.87:0/1359038679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed800c9ae0 0x7fed801578b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fed74009870 tx=0x7fed7401c520 comp rx=0 tx=0).stop 2024-04-25T15:59:44.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 -- 172.21.15.87:0/1359038679 shutdown_connections 2024-04-25T15:59:44.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 --2- 172.21.15.87:0/1359038679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed800c9ae0 0x7fed801578b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 --2- 172.21.15.87:0/1359038679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed801517d0 0x7fed800c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 -- 172.21.15.87:0/1359038679 >> 172.21.15.87:0/1359038679 conn(0x7fed8006d780 msgr2=0x7fed8006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:44.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 -- 172.21.15.87:0/1359038679 shutdown_connections 2024-04-25T15:59:44.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 -- 172.21.15.87:0/1359038679 wait complete. 2024-04-25T15:59:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 Processor -- start 2024-04-25T15:59:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.173+0000 7fed85da4640 1 -- start start 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed800c9ae0 0x7fed800c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 0x7fed800c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed80157df0 0x7fed8014f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fed800a90f0 con 0x7fed801517d0 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed800a8f70 con 0x7fed80157df0 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed8006c670 con 0x7fed800c9ae0 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 0x7fed800c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 0x7fed800c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59140/0 (socket says 172.21.15.87:59140) 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 -- 172.21.15.87:0/3456694472 learned_addr learned my addr 172.21.15.87:0/3456694472 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7f7fe640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed800c9ae0 0x7fed800c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7ffff640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed80157df0 0x7fed8014f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 -- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed800c9ae0 msgr2=0x7fed800c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed800c9ae0 0x7fed800c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 -- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed80157df0 msgr2=0x7fed8014f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed80157df0 0x7fed8014f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 -- 172.21.15.87:0/3456694472 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed801f4f20 con 0x7fed801517d0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed7effd640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 0x7fed800c2a70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed740ae040 tx=0x7fed740192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740ba070 con 0x7fed801517d0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740b4640 con 0x7fed801517d0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed740b0040 con 0x7fed801517d0 2024-04-25T15:59:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8014ab60 con 0x7fed801517d0 2024-04-25T15:59:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8014a7f0 con 0x7fed801517d0 2024-04-25T15:59:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed80069bb0 con 0x7fed801517d0 2024-04-25T15:59:44.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fed740bd070 con 0x7fed801517d0 2024-04-25T15:59:44.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.177+0000 7fed67fff640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed6c06f430 0x7fed6c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:44.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.181+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7fed74128970 con 0x7fed801517d0 2024-04-25T15:59:44.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.181+0000 7fed7f7fe640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed6c06f430 0x7fed6c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:44.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.181+0000 7fed7f7fe640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed6c06f430 0x7fed6c071940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed800c3c00 tx=0x7fed70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:44.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.185+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed74016110 con 0x7fed801517d0 2024-04-25T15:59:44.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.433+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed801f4c90 con 0x7fed801517d0 2024-04-25T15:59:44.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.433+0000 7fed67fff640 1 -- 172.21.15.87:0/3456694472 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5669 (secure 0 0 0) 0x7fed740f5340 con 0x7fed801517d0 2024-04-25T15:59:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:44.436 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:44.436 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 51 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed6c06f430 msgr2=0x7fed6c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed6c06f430 0x7fed6c071940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed800c3c00 tx=0x7fed70008040 comp rx=0 tx=0).stop 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 msgr2=0x7fed800c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 0x7fed800c2a70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fed740ae040 tx=0x7fed740192c0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 shutdown_connections 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed6c06f430 0x7fed6c071940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed80157df0 0x7fed8014f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed801517d0 0x7fed800c2a70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 --2- 172.21.15.87:0/3456694472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed800c9ae0 0x7fed800c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:44.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 >> 172.21.15.87:0/3456694472 conn(0x7fed8006d780 msgr2=0x7fed80152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:44.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 shutdown_connections 2024-04-25T15:59:44.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:44.437+0000 7fed85da4640 1 -- 172.21.15.87:0/3456694472 wait complete. 2024-04-25T15:59:44.467 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=4235 2024-04-25T15:59:44.467 INFO:tasks.mds_thrash.fs.[b]:waiting for 4 secs before reviving mds.b 2024-04-25T15:59:47.553 INFO:tasks.ceph.mds.c.smithi087.stderr:2024-04-25T15:59:47.553+0000 7f5d88065640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:59:48.468 INFO:tasks.mds_thrash.fs.[b]:reviving mds.b 2024-04-25T15:59:48.469 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:59:48.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:59:48.472 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:59:48.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:48.597 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-25T15:59:48.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 Processor -- start 2024-04-25T15:59:48.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 -- start start 2024-04-25T15:59:48.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcfcc0a8cc0 0x7fcfcc1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:48.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfcc06c670 0x7fcfcc06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfcc152c80 con 0x7fcfcc152870 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcfcc0aebc0 con 0x7fcfcc06c670 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfd17df640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcfcc158f20 con 0x7fcfcc0a8cc0 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcb7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfcc06c670 0x7fcfcc06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcb7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfcc06c670 0x7fcfcc06ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59154/0 (socket says 172.21.15.87:59154) 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcb7fe640 1 -- 172.21.15.87:0/934361468 learned_addr learned my addr 172.21.15.87:0/934361468 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcb7fe640 1 -- 172.21.15.87:0/934361468 >> v2:172.21.15.155:3300/0 conn(0x7fcfcc0a8cc0 msgr2=0x7fcfcc1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcaffd640 1 --2- 172.21.15.87:0/934361468 >> v2:172.21.15.155:3300/0 conn(0x7fcfcc0a8cc0 0x7fcfcc1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcb7fe640 1 --2- 172.21.15.87:0/934361468 >> v2:172.21.15.155:3300/0 conn(0x7fcfcc0a8cc0 0x7fcfcc1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.657+0000 7fcfcb7fe640 1 -- 172.21.15.87:0/934361468 >> v1:172.21.15.155:6789/0 conn(0x7fcfcc152870 legacy=0x7fcfcc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfcb7fe640 1 -- 172.21.15.87:0/934361468 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfcc0ae8e0 con 0x7fcfcc06c670 2024-04-25T15:59:48.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfcaffd640 1 --2- 172.21.15.87:0/934361468 >> v2:172.21.15.155:3300/0 conn(0x7fcfcc0a8cc0 0x7fcfcc1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:48.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfcb7fe640 1 --2- 172.21.15.87:0/934361468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc06ca80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc06d6e0 tx=0x7fcfc401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffa02decdbeac91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:48.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfca7fc640 1 -- 172.21.15.87:0/934361468 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40a5720 con 0x7fcfcc06c670 2024-04-25T15:59:48.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfca7fc640 1 -- 172.21.15.87:0/934361468 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc40a58c0 con 0x7fcfcc06c670 2024-04-25T15:59:48.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfca7fc640 1 -- 172.21.15.87:0/934361468 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40a5c90 con 0x7fcfcc06c670 2024-04-25T15:59:48.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 -- 172.21.15.87:0/934361468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 msgr2=0x7fcfcc06ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:48.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 --2- 172.21.15.87:0/934361468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc06ca80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc06d6e0 tx=0x7fcfc401c860 comp rx=0 tx=0).stop 2024-04-25T15:59:48.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 -- 172.21.15.87:0/934361468 shutdown_connections 2024-04-25T15:59:48.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 --2- 172.21.15.87:0/934361468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc06ca80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 --2- 172.21.15.87:0/934361468 >> v2:172.21.15.155:3300/0 conn(0x7fcfcc0a8cc0 0x7fcfcc1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 -- 172.21.15.87:0/934361468 >> 172.21.15.87:0/934361468 conn(0x7fcfcc06d780 msgr2=0x7fcfcc06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:48.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 -- 172.21.15.87:0/934361468 shutdown_connections 2024-04-25T15:59:48.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.661+0000 7fcfd17df640 1 -- 172.21.15.87:0/934361468 wait complete. 2024-04-25T15:59:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 Processor -- start 2024-04-25T15:59:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 -- start start 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc14c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfcc0a8cc0 0x7fcfcc1f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfcc152870 0x7fcfcc0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcfcc0ac870 con 0x7fcfcc06c670 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfcc0ac6f0 con 0x7fcfcc152870 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfd17df640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfcc1623e0 con 0x7fcfcc0a8cc0 2024-04-25T15:59:48.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc14c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59162/0 (socket says 172.21.15.87:59162) 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 -- 172.21.15.87:0/3357705767 learned_addr learned my addr 172.21.15.87:0/3357705767 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcb7fe640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfcc152870 0x7fcfcc0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfc3fff640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfcc0a8cc0 0x7fcfcc1f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 -- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfcc0a8cc0 msgr2=0x7fcfcc1f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfcc0a8cc0 0x7fcfcc1f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 -- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfcc152870 msgr2=0x7fcfcc0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfcc152870 0x7fcfcc0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 -- 172.21.15.87:0/3357705767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfcc0abd40 con 0x7fcfcc06c670 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfc3fff640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfcc0a8cc0 0x7fcfcc1f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.665+0000 7fcfcaffd640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc14c620 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c820 tx=0x7fcfbc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc015070 con 0x7fcfcc06c670 2024-04-25T15:59:48.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc007a30 con 0x7fcfcc06c670 2024-04-25T15:59:48.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfcc1f28a0 con 0x7fcfcc06c670 2024-04-25T15:59:48.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc007e40 con 0x7fcfcc06c670 2024-04-25T15:59:48.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfcc14f3c0 con 0x7fcfcc06c670 2024-04-25T15:59:48.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfcc14f5c0 con 0x7fcfcc06c670 2024-04-25T15:59:48.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcfbc018070 con 0x7fcfcc06c670 2024-04-25T15:59:48.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc37fe640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcfac06f430 0x7fcfac071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:48.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc3fff640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcfac06f430 0x7fcfac071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:48.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7fcfbc08f7c0 con 0x7fcfcc06c670 2024-04-25T15:59:48.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.669+0000 7fcfc3fff640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcfac06f430 0x7fcfac071940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0ca3a0 tx=0x7fcfb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:48.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.677+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfcc14f5c0 con 0x7fcfcc06c670 2024-04-25T15:59:48.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfcc069bb0 con 0x7fcfcc06c670 2024-04-25T15:59:48.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfc37fe640 1 -- 172.21.15.87:0/3357705767 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5669 (secure 0 0 0) 0x7fcfcc0abd40 con 0x7fcfcc06c670 2024-04-25T15:59:48.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:48.898 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:48.898 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 51 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcfac06f430 msgr2=0x7fcfac071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcfac06f430 0x7fcfac071940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0ca3a0 tx=0x7fcfb4008040 comp rx=0 tx=0).stop 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 msgr2=0x7fcfcc14c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc14c620 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c820 tx=0x7fcfbc00cce0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 shutdown_connections 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcfac06f430 0x7fcfac071940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfcc152870 0x7fcfcc0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfcc0a8cc0 0x7fcfcc1f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 --2- 172.21.15.87:0/3357705767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfcc06c670 0x7fcfcc14c620 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 >> 172.21.15.87:0/3357705767 conn(0x7fcfcc06d780 msgr2=0x7fcfcc157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 shutdown_connections 2024-04-25T15:59:48.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:48.897+0000 7fcfd17df640 1 -- 172.21.15.87:0/3357705767 wait complete. 2024-04-25T15:59:48.922 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-25T15:59:50.923 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:51.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.065+0000 7f9fa5bfe640 1 Processor -- start 2024-04-25T15:59:51.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.065+0000 7f9fa5bfe640 1 -- start start 2024-04-25T15:59:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9fa5bfe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fa01529a0 0x7f9fa0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9fa5bfe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00ad990 0x7f9fa00adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9fa5bfe640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa0072430 con 0x7f9fa00c41e0 2024-04-25T15:59:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9fa5bfe640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa0074730 con 0x7f9fa01529a0 2024-04-25T15:59:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9fa5bfe640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa0074a10 con 0x7f9fa00ad990 2024-04-25T15:59:51.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00ad990 0x7f9fa00adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f9f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fa01529a0 0x7f9fa0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00ad990 0x7f9fa00adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:56080/0 (socket says 172.21.15.87:56080) 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f97fff640 1 -- 172.21.15.87:0/1437799808 learned_addr learned my addr 172.21.15.87:0/1437799808 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f9ffff640 1 --1- 172.21.15.87:0/1437799808 >> v1:172.21.15.155:6789/0 conn(0x7f9fa00c41e0 0x7f9fa00c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:42708/0 (socket says 172.21.15.87:42708) 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00ad990 msgr2=0x7f9fa00adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f9f7fe640 1 --2- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00ad990 0x7f9fa00adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1437799808 >> v1:172.21.15.155:6789/0 conn(0x7f9fa00c41e0 legacy=0x7f9fa00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:51.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.069+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1437799808 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa0074cf0 con 0x7f9fa01529a0 2024-04-25T15:59:51.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9f9f7fe640 1 --2- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa01529a0 0x7f9fa0071e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000dbe0 tx=0x7f9f90020720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c19b111a50d08c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:51.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9f9effd640 1 -- 172.21.15.87:0/1437799808 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f900b0070 con 0x7f9fa01529a0 2024-04-25T15:59:51.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9f9effd640 1 -- 172.21.15.87:0/1437799808 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9000d0d0 con 0x7f9fa01529a0 2024-04-25T15:59:51.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9f9effd640 1 -- 172.21.15.87:0/1437799808 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f900ac680 con 0x7f9fa01529a0 2024-04-25T15:59:51.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa01529a0 msgr2=0x7f9fa0071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa01529a0 0x7f9fa0071e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000dbe0 tx=0x7f9f90020720 comp rx=0 tx=0).stop 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1437799808 shutdown_connections 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa00ad990 0x7f9fa00adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1437799808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa01529a0 0x7f9fa0071e50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1437799808 >> 172.21.15.87:0/1437799808 conn(0x7f9fa00c8770 msgr2=0x7f9fa00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1437799808 shutdown_connections 2024-04-25T15:59:51.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.073+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1437799808 wait complete. 2024-04-25T15:59:51.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 Processor -- start 2024-04-25T15:59:51.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 -- start start 2024-04-25T15:59:51.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 0x7f9fa014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa00c41e0 0x7f9fa01ec6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa01529a0 0x7f9fa00c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0160460 con 0x7f9fa00ad990 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01602e0 con 0x7f9fa00c41e0 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa01605e0 con 0x7f9fa01529a0 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 0x7f9fa014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 0x7f9fa014ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52986/0 (socket says 172.21.15.87:52986) 2024-04-25T15:59:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1427188158 learned_addr learned my addr 172.21.15.87:0/1427188158 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:51.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f97fff640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa00c41e0 0x7f9fa01ec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:51.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9ffff640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa01529a0 0x7f9fa00c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:51.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa01529a0 msgr2=0x7f9fa00c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:51.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa01529a0 0x7f9fa00c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa00c41e0 msgr2=0x7f9fa01ec6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa00c41e0 0x7f9fa01ec6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 -- 172.21.15.87:0/1427188158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa014d9d0 con 0x7f9fa00ad990 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9f7fe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 0x7f9fa014ceb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000dbe0 tx=0x7f9f9001d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f900b0040 con 0x7f9fa00ad990 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f900b5670 con 0x7f9fa00ad990 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90006e20 con 0x7f9fa00ad990 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa0151980 con 0x7f9fa00ad990 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.077+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa014eb10 con 0x7f9fa00ad990 2024-04-25T15:59:51.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.081+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa0069bb0 con 0x7f9fa00ad990 2024-04-25T15:59:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.081+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f900b3070 con 0x7f9fa00ad990 2024-04-25T15:59:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.081+0000 7f9f9cff9640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8006f430 0x7f9f80071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.081+0000 7f9f97fff640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8006f430 0x7f9f80071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.081+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f9f9012d650 con 0x7f9fa00ad990 2024-04-25T15:59:51.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.081+0000 7f9f97fff640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8006f430 0x7f9f80071940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0146680 tx=0x7f9f88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:51.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.085+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f9001a3a0 con 0x7f9fa00ad990 2024-04-25T15:59:51.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.321+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fa0152480 con 0x7f9fa00ad990 2024-04-25T15:59:51.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.321+0000 7f9f9cff9640 1 -- 172.21.15.87:0/1427188158 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f9f900f9e80 con 0x7f9fa00ad990 2024-04-25T15:59:51.323 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:51.324 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:51.324 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T15:59:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8006f430 msgr2=0x7f9f80071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8006f430 0x7f9f80071940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0146680 tx=0x7f9f88008040 comp rx=0 tx=0).stop 2024-04-25T15:59:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 msgr2=0x7f9fa014ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 0x7f9fa014ceb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000dbe0 tx=0x7f9f9001d4c0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 shutdown_connections 2024-04-25T15:59:51.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8006f430 0x7f9f80071940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa01529a0 0x7f9fa00c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa00c41e0 0x7f9fa01ec6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 --2- 172.21.15.87:0/1427188158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa00ad990 0x7f9fa014ceb0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 >> 172.21.15.87:0/1427188158 conn(0x7f9fa00c8770 msgr2=0x7f9fa00c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 shutdown_connections 2024-04-25T15:59:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:51.325+0000 7f9fa5bfe640 1 -- 172.21.15.87:0/1427188158 wait complete. 2024-04-25T15:59:51.346 INFO:tasks.mds_thrash.fs.[b]:mds.b reported in up:standby state 2024-04-25T15:59:51.346 INFO:tasks.mds_thrash.fs.[b]:waiting for 17 secs before thrashing 2024-04-25T15:59:52.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:52.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 Processor -- start 2024-04-25T15:59:52.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 -- start start 2024-04-25T15:59:52.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e40c4620 0x7f25e415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e4154fc0 con 0x7f25e41518b0 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f25e406ed60 con 0x7f25e40c4620 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25ea1ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25e40acb20 con 0x7f25e40ad160 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e40c4620 0x7f25e415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e40c4620 0x7f25e415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52992/0 (socket says 172.21.15.87:52992) 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 -- 172.21.15.87:0/3163458891 learned_addr learned my addr 172.21.15.87:0/3163458891 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e2ffd640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 -- 172.21.15.87:0/3163458891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 msgr2=0x7f25e40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e40c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 -- 172.21.15.87:0/3163458891 >> v1:172.21.15.155:6789/0 conn(0x7f25e41518b0 legacy=0x7f25e406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e3fff640 1 -- 172.21.15.87:0/3163458891 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e40ace00 con 0x7f25e40c4620 2024-04-25T15:59:52.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.877+0000 7f25e2ffd640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e40c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:52.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25e3fff640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415e9b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009e50 tx=0x7f25dc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27d7c3d4edc268e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:52.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25e27fc640 1 -- 172.21.15.87:0/3163458891 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0a57a0 con 0x7f25e40c4620 2024-04-25T15:59:52.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25e27fc640 1 -- 172.21.15.87:0/3163458891 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc0a5940 con 0x7f25e40c4620 2024-04-25T15:59:52.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25e27fc640 1 -- 172.21.15.87:0/3163458891 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0a5d10 con 0x7f25e40c4620 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 -- 172.21.15.87:0/3163458891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 msgr2=0x7f25e415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415e9b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009e50 tx=0x7f25dc01c9f0 comp rx=0 tx=0).stop 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 -- 172.21.15.87:0/3163458891 shutdown_connections 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e40c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/3163458891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415e9b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 -- 172.21.15.87:0/3163458891 >> 172.21.15.87:0/3163458891 conn(0x7f25e40c8770 msgr2=0x7f25e40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 -- 172.21.15.87:0/3163458891 shutdown_connections 2024-04-25T15:59:52.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.881+0000 7f25ea1ca640 1 -- 172.21.15.87:0/3163458891 wait complete. 2024-04-25T15:59:52.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 Processor -- start 2024-04-25T15:59:52.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 -- start start 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e41f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e41518b0 0x7f25e4158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4161710 con 0x7f25e40c4620 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4161890 con 0x7f25e41518b0 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25e4161a10 con 0x7f25e40ad160 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53000/0 (socket says 172.21.15.87:53000) 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 -- 172.21.15.87:0/232114187 learned_addr learned my addr 172.21.15.87:0/232114187 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:52.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e3fff640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e41518b0 0x7f25e4158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e37fe640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e41f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 -- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 msgr2=0x7f25e41f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e41f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 -- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e41518b0 msgr2=0x7f25e4158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e41518b0 0x7f25e4158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 -- 172.21.15.87:0/232114187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e415a320 con 0x7f25e40c4620 2024-04-25T15:59:52.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25e2ffd640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415b3c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f25d800c7f0 tx=0x7f25d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:52.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8015070 con 0x7f25e40c4620 2024-04-25T15:59:52.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d8007820 con 0x7f25e40c4620 2024-04-25T15:59:52.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8007c10 con 0x7f25e40c4620 2024-04-25T15:59:52.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e415a600 con 0x7f25e40c4620 2024-04-25T15:59:52.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.885+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e415abc0 con 0x7f25e40c4620 2024-04-25T15:59:52.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.889+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e4069bb0 con 0x7f25e40c4620 2024-04-25T15:59:52.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.889+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f25d8018070 con 0x7f25e40c4620 2024-04-25T15:59:52.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.889+0000 7f25cbfff640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f25d006f430 0x7f25d0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:52.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.889+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f25d808fe20 con 0x7f25e40c4620 2024-04-25T15:59:52.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.889+0000 7f25e37fe640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f25d006f430 0x7f25d0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:52.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.889+0000 7f25e37fe640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f25d006f430 0x7f25d0071940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f25e40aad60 tx=0x7f25d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:52.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:52.893+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f25d805c7b0 con 0x7f25e40c4620 2024-04-25T15:59:53.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25e40c42b0 con 0x7f25e40c4620 2024-04-25T15:59:53.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25cbfff640 1 -- 172.21.15.87:0/232114187 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f25d805c0b0 con 0x7f25e40c4620 2024-04-25T15:59:53.122 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:53.122 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:53.122 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f25d006f430 msgr2=0x7f25d0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f25d006f430 0x7f25d0071940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f25e40aad60 tx=0x7f25d4008040 comp rx=0 tx=0).stop 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 msgr2=0x7f25e415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415b3c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f25d800c7f0 tx=0x7f25d800ccb0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 shutdown_connections 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f25d006f430 0x7f25d0071940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25e41518b0 0x7f25e4158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40c4620 0x7f25e415b3c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 --2- 172.21.15.87:0/232114187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25e40ad160 0x7f25e41f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 >> 172.21.15.87:0/232114187 conn(0x7f25e40c8770 msgr2=0x7f25e40c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:53.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 shutdown_connections 2024-04-25T15:59:53.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.121+0000 7f25ea1ca640 1 -- 172.21.15.87:0/232114187 wait complete. 2024-04-25T15:59:53.141 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-04-25T15:59:53.142 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:59:53.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:59:53.155 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:59:53.155 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:53.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.325+0000 7f518c8e5640 1 Processor -- start 2024-04-25T15:59:53.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.325+0000 7f518c8e5640 1 -- start start 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518c8e5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51880ad160 0x7f51880c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518c8e5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51880c4620 0x7f518815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518c8e5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5188154fc0 con 0x7f51881518b0 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518c8e5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f518806ed60 con 0x7f51880c4620 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518c8e5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f51880acb20 con 0x7f51880ad160 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518659c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f51881518b0 0x7f518806f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:55128/0 (socket says 172.21.15.87:55128) 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5186d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51880c4620 0x7f518815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518659c640 1 -- 172.21.15.87:0/1978615045 learned_addr learned my addr 172.21.15.87:0/1978615045 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5185d9b640 1 --2- 172.21.15.87:0/1978615045 >> v2:172.21.15.155:3300/0 conn(0x7f51880ad160 0x7f51880c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5186d9d640 1 -- 172.21.15.87:0/1978615045 >> v2:172.21.15.155:3300/0 conn(0x7f51880ad160 msgr2=0x7f51880c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5186d9d640 1 --2- 172.21.15.87:0/1978615045 >> v2:172.21.15.155:3300/0 conn(0x7f51880ad160 0x7f51880c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5186d9d640 1 -- 172.21.15.87:0/1978615045 >> v1:172.21.15.87:6789/0 conn(0x7f51881518b0 legacy=0x7f518806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f518559a640 1 -- 172.21.15.87:0/1978615045 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791413778 0 0) 0x7f5188154fc0 con 0x7f51881518b0 2024-04-25T15:59:53.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5186d9d640 1 -- 172.21.15.87:0/1978615045 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51880ace00 con 0x7f51880c4620 2024-04-25T15:59:53.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.329+0000 7f5185d9b640 1 --2- 172.21.15.87:0/1978615045 >> v2:172.21.15.155:3300/0 conn(0x7f51880ad160 0x7f51880c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:53.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f5186d9d640 1 --2- 172.21.15.87:0/1978615045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518815e9b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5188070d80 tx=0x7f518001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c721da01e281dea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:53.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518559a640 1 -- 172.21.15.87:0/1978615045 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800b2070 con 0x7f51880c4620 2024-04-25T15:59:53.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518559a640 1 -- 172.21.15.87:0/1978615045 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51800a5920 con 0x7f51880c4620 2024-04-25T15:59:53.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518559a640 1 -- 172.21.15.87:0/1978615045 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800a5cf0 con 0x7f51880c4620 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 -- 172.21.15.87:0/1978615045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 msgr2=0x7f518815e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 --2- 172.21.15.87:0/1978615045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518815e9b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5188070d80 tx=0x7f518001c930 comp rx=0 tx=0).stop 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 -- 172.21.15.87:0/1978615045 shutdown_connections 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 --2- 172.21.15.87:0/1978615045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518815e9b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 --2- 172.21.15.87:0/1978615045 >> v2:172.21.15.155:3300/0 conn(0x7f51880ad160 0x7f51880c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 -- 172.21.15.87:0/1978615045 >> 172.21.15.87:0/1978615045 conn(0x7f51880c8770 msgr2=0x7f51880c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 -- 172.21.15.87:0/1978615045 shutdown_connections 2024-04-25T15:59:53.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 -- 172.21.15.87:0/1978615045 wait complete. 2024-04-25T15:59:53.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 Processor -- start 2024-04-25T15:59:53.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.333+0000 7f518c8e5640 1 -- start start 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51880ad160 0x7f51880bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51881518b0 0x7f518814b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5188161710 con 0x7f51880c4620 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5188161890 con 0x7f51880ad160 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5188161a10 con 0x7f51881518b0 2024-04-25T15:59:53.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518814ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53022/0 (socket says 172.21.15.87:53022) 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 -- 172.21.15.87:0/618320493 learned_addr learned my addr 172.21.15.87:0/618320493 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518659c640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51880ad160 0x7f51880bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5186d9d640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51881518b0 0x7f518814b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 -- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51881518b0 msgr2=0x7f518814b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51881518b0 0x7f518814b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 -- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51880ad160 msgr2=0x7f51880bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51880ad160 0x7f51880bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 -- 172.21.15.87:0/618320493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5188158260 con 0x7f51880c4620 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518659c640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51880ad160 0x7f51880bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f5185d9b640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518814ef00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f517800c820 tx=0x7f517800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178015070 con 0x7f51880c4620 2024-04-25T15:59:53.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178007a30 con 0x7f51880c4620 2024-04-25T15:59:53.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178007e40 con 0x7f51880c4620 2024-04-25T15:59:53.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51881553a0 con 0x7f51880c4620 2024-04-25T15:59:53.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5188155960 con 0x7f51880c4620 2024-04-25T15:59:53.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5188069bb0 con 0x7f51880c4620 2024-04-25T15:59:53.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.337+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5178018070 con 0x7f51880c4620 2024-04-25T15:59:53.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.341+0000 7f517effd640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f516806f400 0x7f5168071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:53.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.341+0000 7f518659c640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f516806f400 0x7f5168071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:53.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.341+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f517808fb10 con 0x7f51880c4620 2024-04-25T15:59:53.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.341+0000 7f518659c640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f516806f400 0x7f5168071910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5170007fd0 tx=0x7f5170009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:53.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.345+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f517805c530 con 0x7f51880c4620 2024-04-25T15:59:53.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.525+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51880abfa0 con 0x7f51880c4620 2024-04-25T15:59:53.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f517effd640 1 -- 172.21.15.87:0/618320493 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f517805be30 con 0x7f51880c4620 2024-04-25T15:59:53.529 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:53.529 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:53.529 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f516806f400 msgr2=0x7f5168071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f516806f400 0x7f5168071910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5170007fd0 tx=0x7f5170009040 comp rx=0 tx=0).stop 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 msgr2=0x7f518814ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518814ef00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f517800c820 tx=0x7f517800cce0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 shutdown_connections 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f516806f400 0x7f5168071910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51881518b0 0x7f518814b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51880c4620 0x7f518814ef00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 --2- 172.21.15.87:0/618320493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51880ad160 0x7f51880bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:53.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 >> 172.21.15.87:0/618320493 conn(0x7f51880c8770 msgr2=0x7f51880c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:53.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 shutdown_connections 2024-04-25T15:59:53.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:53.529+0000 7f518c8e5640 1 -- 172.21.15.87:0/618320493 wait complete. 2024-04-25T15:59:53.548 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:59:55.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:55.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 Processor -- start 2024-04-25T15:59:55.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 -- start start 2024-04-25T15:59:55.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd20071e50 0x7fbd200c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:55.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd200c4720 0x7fbd2015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:55.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd20072430 con 0x7fbd201529a0 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbd20074730 con 0x7fbd20071e50 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd2573e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbd20074a10 con 0x7fbd200c4720 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd20071e50 0x7fbd200c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd20071e50 0x7fbd200c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53036/0 (socket says 172.21.15.87:53036) 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/28336831 learned_addr learned my addr 172.21.15.87:0/28336831 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1f7fe640 1 --2- 172.21.15.87:0/28336831 >> v2:172.21.15.155:3300/0 conn(0x7fbd200c4720 0x7fbd2015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/28336831 >> v2:172.21.15.155:3300/0 conn(0x7fbd200c4720 msgr2=0x7fbd2015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 --2- 172.21.15.87:0/28336831 >> v2:172.21.15.155:3300/0 conn(0x7fbd200c4720 0x7fbd2015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/28336831 >> v1:172.21.15.155:6789/0 conn(0x7fbd201529a0 legacy=0x7fbd200ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:55.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.709+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/28336831 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20074cf0 con 0x7fbd20071e50 2024-04-25T15:59:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd1e7fc640 1 --2- 172.21.15.87:0/28336831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd20071e50 0x7fbd200c41e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ae750 tx=0x7fbd0801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1bc02ffd6180c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd1dffb640 1 -- 172.21.15.87:0/28336831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd080b0070 con 0x7fbd20071e50 2024-04-25T15:59:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd1dffb640 1 -- 172.21.15.87:0/28336831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd080ab600 con 0x7fbd20071e50 2024-04-25T15:59:55.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd1dffb640 1 -- 172.21.15.87:0/28336831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd080ab9d0 con 0x7fbd20071e50 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 -- 172.21.15.87:0/28336831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd20071e50 msgr2=0x7fbd200c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 --2- 172.21.15.87:0/28336831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd20071e50 0x7fbd200c41e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ae750 tx=0x7fbd0801c450 comp rx=0 tx=0).stop 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 -- 172.21.15.87:0/28336831 shutdown_connections 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 --2- 172.21.15.87:0/28336831 >> v2:172.21.15.155:3300/0 conn(0x7fbd200c4720 0x7fbd2015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 --2- 172.21.15.87:0/28336831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd20071e50 0x7fbd200c41e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 -- 172.21.15.87:0/28336831 >> 172.21.15.87:0/28336831 conn(0x7fbd200c8770 msgr2=0x7fbd200c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 -- 172.21.15.87:0/28336831 shutdown_connections 2024-04-25T15:59:55.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 -- 172.21.15.87:0/28336831 wait complete. 2024-04-25T15:59:55.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 Processor -- start 2024-04-25T15:59:55.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.713+0000 7fbd2573e640 1 -- start start 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd20071e50 0x7fbd20145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 0x7fbd20146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201529a0 0x7fbd20143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbd201629b0 con 0x7fbd200c4720 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20162830 con 0x7fbd201529a0 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd20162b30 con 0x7fbd20071e50 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 0x7fbd20146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 0x7fbd20146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53050/0 (socket says 172.21.15.87:53050) 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/3354661279 learned_addr learned my addr 172.21.15.87:0/3354661279 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1f7fe640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201529a0 0x7fbd20143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:55.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd20071e50 msgr2=0x7fbd20145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1effd640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd20071e50 0x7fbd20145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd20071e50 0x7fbd20145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201529a0 msgr2=0x7fbd20143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201529a0 0x7fbd20143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 -- 172.21.15.87:0/3354661279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd200ac840 con 0x7fbd200c4720 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1effd640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd20071e50 0x7fbd20145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1f7fe640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201529a0 0x7fbd20143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd1e7fc640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 0x7fbd20146c20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd0801ab00 tx=0x7fbd0801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd080ba020 con 0x7fbd200c4720 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd080b6640 con 0x7fbd200c4720 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd201445f0 con 0x7fbd200c4720 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd080b0040 con 0x7fbd200c4720 2024-04-25T15:59:55.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd200ac320 con 0x7fbd200c4720 2024-04-25T15:59:55.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd20069bb0 con 0x7fbd200c4720 2024-04-25T15:59:55.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.717+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbd080bd020 con 0x7fbd200c4720 2024-04-25T15:59:55.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.721+0000 7fbd177fe640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbd0006f400 0x7fbd00071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:55.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.721+0000 7fbd1effd640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbd0006f400 0x7fbd00071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:55.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.721+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7fbd081296a0 con 0x7fbd200c4720 2024-04-25T15:59:55.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.721+0000 7fbd1effd640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbd0006f400 0x7fbd00071910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbd20073d40 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:55.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.725+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd080c4070 con 0x7fbd200c4720 2024-04-25T15:59:55.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.913+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd200c3760 con 0x7fbd200c4720 2024-04-25T15:59:55.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.913+0000 7fbd177fe640 1 -- 172.21.15.87:0/3354661279 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7fbd080160d0 con 0x7fbd200c4720 2024-04-25T15:59:55.915 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:55.915 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:55.915 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbd0006f400 msgr2=0x7fbd00071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbd0006f400 0x7fbd00071910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbd20073d40 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 msgr2=0x7fbd20146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 0x7fbd20146c20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd0801ab00 tx=0x7fbd0801ac90 comp rx=0 tx=0).stop 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 shutdown_connections 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbd0006f400 0x7fbd00071910 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201529a0 0x7fbd20143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd200c4720 0x7fbd20146c20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 --2- 172.21.15.87:0/3354661279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd20071e50 0x7fbd20145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:55.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 >> 172.21.15.87:0/3354661279 conn(0x7fbd200c8770 msgr2=0x7fbd200c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 shutdown_connections 2024-04-25T15:59:55.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:55.917+0000 7fbd2573e640 1 -- 172.21.15.87:0/3354661279 wait complete. 2024-04-25T15:59:55.935 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T15:59:57.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:59:58.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 Processor -- start 2024-04-25T15:59:58.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 -- start start 2024-04-25T15:59:58.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36d0071e50 0x7f36d00c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:58.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00c4720 0x7f36d015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d0072430 con 0x7f36d01529a0 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f36d0074730 con 0x7f36d0071e50 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36d5c63640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36d0074a10 con 0x7f36d00c4720 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36d0071e50 0x7f36d00c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36d0071e50 0x7f36d00c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53064/0 (socket says 172.21.15.87:53064) 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 -- 172.21.15.87:0/287938211 learned_addr learned my addr 172.21.15.87:0/287938211 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36cffff640 1 --2- 172.21.15.87:0/287938211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00c4720 0x7f36d015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 -- 172.21.15.87:0/287938211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00c4720 msgr2=0x7f36d015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 --2- 172.21.15.87:0/287938211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00c4720 0x7f36d015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 -- 172.21.15.87:0/287938211 >> v1:172.21.15.155:6789/0 conn(0x7f36d01529a0 legacy=0x7f36d00ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:58.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.097+0000 7f36ceffd640 1 -- 172.21.15.87:0/287938211 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d0074cf0 con 0x7f36d0071e50 2024-04-25T15:59:58.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36ceffd640 1 --2- 172.21.15.87:0/287938211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d0071e50 0x7f36d00c41e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009870 tx=0x7f36c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cb40fe5905cdc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:58.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36ce7fc640 1 -- 172.21.15.87:0/287938211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40b0070 con 0x7f36d0071e50 2024-04-25T15:59:58.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36ce7fc640 1 -- 172.21.15.87:0/287938211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c40ab600 con 0x7f36d0071e50 2024-04-25T15:59:58.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36ce7fc640 1 -- 172.21.15.87:0/287938211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40ab9d0 con 0x7f36d0071e50 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 -- 172.21.15.87:0/287938211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d0071e50 msgr2=0x7f36d00c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 --2- 172.21.15.87:0/287938211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d0071e50 0x7f36d00c41e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009870 tx=0x7f36c401c4d0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 -- 172.21.15.87:0/287938211 shutdown_connections 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 --2- 172.21.15.87:0/287938211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00c4720 0x7f36d015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 --2- 172.21.15.87:0/287938211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d0071e50 0x7f36d00c41e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 -- 172.21.15.87:0/287938211 >> 172.21.15.87:0/287938211 conn(0x7f36d00c8770 msgr2=0x7f36d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 -- 172.21.15.87:0/287938211 shutdown_connections 2024-04-25T15:59:58.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 -- 172.21.15.87:0/287938211 wait complete. 2024-04-25T15:59:58.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.101+0000 7f36d5c63640 1 Processor -- start 2024-04-25T15:59:58.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- start start 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d0071e50 0x7f36d00c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 0x7f36d00acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d01529a0 0x7f36d0143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f36d01629b0 con 0x7f36d00c4720 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36d0162830 con 0x7f36d01529a0 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36d0162b30 con 0x7f36d0071e50 2024-04-25T15:59:58.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 0x7f36d00acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 0x7f36d00acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53066/0 (socket says 172.21.15.87:53066) 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 -- 172.21.15.87:0/2493839538 learned_addr learned my addr 172.21.15.87:0/2493839538 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36cffff640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d01529a0 0x7f36d0143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36cf7fe640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d0071e50 0x7f36d00c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 -- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d0071e50 msgr2=0x7f36d00c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d0071e50 0x7f36d00c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 -- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d01529a0 msgr2=0x7f36d0143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d01529a0 0x7f36d0143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 -- 172.21.15.87:0/2493839538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d00ad790 con 0x7f36d00c4720 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36ceffd640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 0x7f36d00acd30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f36c40ae040 tx=0x7f36c4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40bb070 con 0x7f36d00c4720 2024-04-25T15:59:58.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c40b6430 con 0x7f36d00c4720 2024-04-25T15:59:58.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d00ac830 con 0x7f36d00c4720 2024-04-25T15:59:58.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c40b0040 con 0x7f36d00c4720 2024-04-25T15:59:58.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d00ac340 con 0x7f36d00c4720 2024-04-25T15:59:58.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.105+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d00ac160 con 0x7f36d00c4720 2024-04-25T15:59:58.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.109+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f36c40be070 con 0x7f36d00c4720 2024-04-25T15:59:58.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.109+0000 7f36b7fff640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f36bc06f400 0x7f36bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:59:58.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.109+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f36c4128f30 con 0x7f36d00c4720 2024-04-25T15:59:58.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.109+0000 7f36cf7fe640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f36bc06f400 0x7f36bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:59:58.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.109+0000 7f36cf7fe640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f36bc06f400 0x7f36bc071910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f36d0073d40 tx=0x7f36c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:59:58.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.113+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36d00ac160 con 0x7f36d00c4720 2024-04-25T15:59:58.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.305+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36d0069bb0 con 0x7f36d00c4720 2024-04-25T15:59:58.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36b7fff640 1 -- 172.21.15.87:0/2493839538 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f36c4016150 con 0x7f36d00c4720 2024-04-25T15:59:58.309 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T15:59:58.309 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T15:59:58.309 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f36bc06f400 msgr2=0x7f36bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f36bc06f400 0x7f36bc071910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f36d0073d40 tx=0x7f36c0009040 comp rx=0 tx=0).stop 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 msgr2=0x7f36d00acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 0x7f36d00acd30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f36c40ae040 tx=0x7f36c4019270 comp rx=0 tx=0).stop 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 shutdown_connections 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f36bc06f400 0x7f36bc071910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d01529a0 0x7f36d0143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d00c4720 0x7f36d00acd30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 --2- 172.21.15.87:0/2493839538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d0071e50 0x7f36d00c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:59:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 >> 172.21.15.87:0/2493839538 conn(0x7f36d00c8770 msgr2=0x7f36d006ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:59:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 shutdown_connections 2024-04-25T15:59:58.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T15:59:58.309+0000 7f36d5c63640 1 -- 172.21.15.87:0/2493839538 wait complete. 2024-04-25T15:59:58.329 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T16:00:00.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:00.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 Processor -- start 2024-04-25T16:00:00.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 -- start start 2024-04-25T16:00:00.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f193c0cb030 0x7f193c15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193c0c7570 con 0x7f193c15ad90 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f193c15b8b0 con 0x7f193c0cb030 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f1941a8e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f193c15b5d0 con 0x7f193c160230 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f193c0cb030 0x7f193c15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f193c0cb030 0x7f193c15fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53082/0 (socket says 172.21.15.87:53082) 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 -- 172.21.15.87:0/1572755924 learned_addr learned my addr 172.21.15.87:0/1572755924 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193bfff640 1 --2- 172.21.15.87:0/1572755924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 -- 172.21.15.87:0/1572755924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 msgr2=0x7f193c162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 --2- 172.21.15.87:0/1572755924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 -- 172.21.15.87:0/1572755924 >> v1:172.21.15.155:6789/0 conn(0x7f193c15ad90 legacy=0x7f193c0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:00.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.489+0000 7f193affd640 1 -- 172.21.15.87:0/1572755924 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c0c2290 con 0x7f193c0cb030 2024-04-25T16:00:00.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f193affd640 1 --2- 172.21.15.87:0/1572755924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c0cb030 0x7f193c15fcf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1930009870 tx=0x7f193001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8b68becae8c471 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:00.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f193a7fc640 1 -- 172.21.15.87:0/1572755924 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300b0070 con 0x7f193c0cb030 2024-04-25T16:00:00.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f193a7fc640 1 -- 172.21.15.87:0/1572755924 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300ab600 con 0x7f193c0cb030 2024-04-25T16:00:00.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f193a7fc640 1 -- 172.21.15.87:0/1572755924 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300ab9d0 con 0x7f193c0cb030 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 -- 172.21.15.87:0/1572755924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c0cb030 msgr2=0x7f193c15fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 --2- 172.21.15.87:0/1572755924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c0cb030 0x7f193c15fcf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1930009870 tx=0x7f193001c440 comp rx=0 tx=0).stop 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 -- 172.21.15.87:0/1572755924 shutdown_connections 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 --2- 172.21.15.87:0/1572755924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c162650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 --2- 172.21.15.87:0/1572755924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c0cb030 0x7f193c15fcf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 -- 172.21.15.87:0/1572755924 >> 172.21.15.87:0/1572755924 conn(0x7f193c0c9330 msgr2=0x7f193c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:00.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 -- 172.21.15.87:0/1572755924 shutdown_connections 2024-04-25T16:00:00.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.493+0000 7f1941a8e640 1 -- 172.21.15.87:0/1572755924 wait complete. 2024-04-25T16:00:00.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 Processor -- start 2024-04-25T16:00:00.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- start start 2024-04-25T16:00:00.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f193c0cb030 0x7f193c0c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:00.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 0x7f193c161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:00.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:00.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f193c15b1a0 con 0x7f193c15ad90 2024-04-25T16:00:00.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f193c0ca190 con 0x7f193c0cb030 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f193c15b320 con 0x7f193c160230 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 0x7f193c161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 0x7f193c161af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53090/0 (socket says 172.21.15.87:53090) 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 -- 172.21.15.87:0/235563241 learned_addr learned my addr 172.21.15.87:0/235563241 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193b7fe640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f193c0cb030 0x7f193c0c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193bfff640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 -- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 msgr2=0x7f193c14f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c14f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 -- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f193c0cb030 msgr2=0x7f193c0c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f193c0cb030 0x7f193c0c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 -- 172.21.15.87:0/235563241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c1f1380 con 0x7f193c15ad90 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193bfff640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f193affd640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 0x7f193c161af0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f19300ae040 tx=0x7f19300191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300b0040 con 0x7f193c15ad90 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300b4640 con 0x7f193c15ad90 2024-04-25T16:00:00.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300b4a30 con 0x7f193c15ad90 2024-04-25T16:00:00.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c14a260 con 0x7f193c15ad90 2024-04-25T16:00:00.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c1506c0 con 0x7f193c15ad90 2024-04-25T16:00:00.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.497+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193c069bb0 con 0x7f193c15ad90 2024-04-25T16:00:00.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.501+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f19300ab4c0 con 0x7f193c15ad90 2024-04-25T16:00:00.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.501+0000 7f1923fff640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f192806f400 0x7f1928071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:00.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.501+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f1930129580 con 0x7f193c15ad90 2024-04-25T16:00:00.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.501+0000 7f193b7fe640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f192806f400 0x7f1928071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:00.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.501+0000 7f193b7fe640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f192806f400 0x7f1928071910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f192c000f70 tx=0x7f192c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:00.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.505+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1930016150 con 0x7f193c15ad90 2024-04-25T16:00:00.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.701+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f193c1f10e0 con 0x7f193c15ad90 2024-04-25T16:00:00.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1923fff640 1 -- 172.21.15.87:0/235563241 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f193c1f10e0 con 0x7f193c15ad90 2024-04-25T16:00:00.706 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:00.706 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:00.706 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f192806f400 msgr2=0x7f1928071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f192806f400 0x7f1928071910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f192c000f70 tx=0x7f192c009040 comp rx=0 tx=0).stop 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 msgr2=0x7f193c161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 0x7f193c161af0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f19300ae040 tx=0x7f19300191e0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 shutdown_connections 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f192806f400 0x7f1928071910 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f193c160230 0x7f193c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f193c15ad90 0x7f193c161af0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 --2- 172.21.15.87:0/235563241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f193c0cb030 0x7f193c0c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:00.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 >> 172.21.15.87:0/235563241 conn(0x7f193c0c9330 msgr2=0x7f193c152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:00.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 shutdown_connections 2024-04-25T16:00:00.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:00.705+0000 7f1941a8e640 1 -- 172.21.15.87:0/235563241 wait complete. 2024-04-25T16:00:00.728 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T16:00:02.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:02.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.885+0000 7f43f7a5a640 1 Processor -- start 2024-04-25T16:00:02.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 -- start start 2024-04-25T16:00:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43f01529a0 0x7f43f0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f00adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43f00c41e0 0x7f43f00c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f43f0072430 con 0x7f43f01529a0 2024-04-25T16:00:02.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f43f0074730 con 0x7f43f00c41e0 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f7a5a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43f0074a10 con 0x7f43f00ad990 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43f01529a0 0x7f43f0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43f01529a0 0x7f43f0071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40872/0 (socket says 172.21.15.87:40872) 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 -- 172.21.15.87:0/2055928566 learned_addr learned my addr 172.21.15.87:0/2055928566 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f4ff5640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f00adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f5ff7640 1 --2- 172.21.15.87:0/2055928566 >> v2:172.21.15.155:3300/0 conn(0x7f43f00c41e0 0x7f43f00c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 -- 172.21.15.87:0/2055928566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 msgr2=0x7f43f00adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f00adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 -- 172.21.15.87:0/2055928566 >> v2:172.21.15.155:3300/0 conn(0x7f43f00c41e0 msgr2=0x7f43f00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:02.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 --2- 172.21.15.87:0/2055928566 >> v2:172.21.15.155:3300/0 conn(0x7f43f00c41e0 0x7f43f00c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f57f6640 1 -- 172.21.15.87:0/2055928566 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f0074cf0 con 0x7f43f01529a0 2024-04-25T16:00:02.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f4ff5640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f00adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:02.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.889+0000 7f43f5ff7640 1 --2- 172.21.15.87:0/2055928566 >> v2:172.21.15.155:3300/0 conn(0x7f43f00c41e0 0x7f43f00c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f57f6640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01529a0 0x7f43f0071e50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43f006fe90 tx=0x7f43ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ab9677299c2d6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43e7fff640 1 -- 172.21.15.87:0/2055928566 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0b0070 con 0x7f43f01529a0 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43e7fff640 1 -- 172.21.15.87:0/2055928566 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0ab600 con 0x7f43f01529a0 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43e7fff640 1 -- 172.21.15.87:0/2055928566 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0ab9d0 con 0x7f43f01529a0 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2055928566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01529a0 msgr2=0x7f43f0071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01529a0 0x7f43f0071e50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43f006fe90 tx=0x7f43ec01c490 comp rx=0 tx=0).stop 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2055928566 shutdown_connections 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2055928566 >> v2:172.21.15.155:3300/0 conn(0x7f43f00c41e0 0x7f43f00c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.894 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f00adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2055928566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01529a0 0x7f43f0071e50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2055928566 >> 172.21.15.87:0/2055928566 conn(0x7f43f00c8770 msgr2=0x7f43f00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2055928566 shutdown_connections 2024-04-25T16:00:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2055928566 wait complete. 2024-04-25T16:00:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 Processor -- start 2024-04-25T16:00:02.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.893+0000 7f43f7a5a640 1 -- start start 2024-04-25T16:00:02.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f0145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f00c41e0 0x7f43f01498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 0x7f43f01f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f43f0159340 con 0x7f43f01522f0 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43f01591c0 con 0x7f43f00c41e0 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43f01594c0 con 0x7f43f00ad990 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 0x7f43f01f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 0x7f43f01f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40886/0 (socket says 172.21.15.87:40886) 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 -- 172.21.15.87:0/2123368923 learned_addr learned my addr 172.21.15.87:0/2123368923 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f57f6640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f0145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f4ff5640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f00c41e0 0x7f43f01498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 -- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 msgr2=0x7f43f0145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f0145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 -- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f00c41e0 msgr2=0x7f43f01498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f00c41e0 0x7f43f01498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:02.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 -- 172.21.15.87:0/2123368923 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f00c8240 con 0x7f43f01522f0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f4ff5640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f00c41e0 0x7f43f01498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f5ff7640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 0x7f43f01f1c90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f43e800cde0 tx=0x7f43e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e800f680 con 0x7f43f01522f0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e800f840 con 0x7f43f01522f0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f0151af0 con 0x7f43f01522f0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e800fc30 con 0x7f43f01522f0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f0145f60 con 0x7f43f01522f0 2024-04-25T16:00:02.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f0069bb0 con 0x7f43f01522f0 2024-04-25T16:00:02.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f43e80213f0 con 0x7f43f01522f0 2024-04-25T16:00:02.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.897+0000 7f43e5ffb640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43d406f430 0x7f43d4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:02.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.901+0000 7f43f57f6640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43d406f430 0x7f43d4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:02.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.901+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f43e8090460 con 0x7f43f01522f0 2024-04-25T16:00:02.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.901+0000 7f43f57f6640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43d406f430 0x7f43d4071940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0ad000 tx=0x7f43ec0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:02.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:02.905+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43e8014030 con 0x7f43f01522f0 2024-04-25T16:00:03.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.097+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43f00c3760 con 0x7f43f01522f0 2024-04-25T16:00:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43e5ffb640 1 -- 172.21.15.87:0/2123368923 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f43e805cda0 con 0x7f43f01522f0 2024-04-25T16:00:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:03.101 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:03.101 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T16:00:03.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43d406f430 msgr2=0x7f43d4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43d406f430 0x7f43d4071940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0ad000 tx=0x7f43ec0a6000 comp rx=0 tx=0).stop 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 msgr2=0x7f43f01f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 0x7f43f01f1c90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f43e800cde0 tx=0x7f43e800a650 comp rx=0 tx=0).stop 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 shutdown_connections 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43d406f430 0x7f43d4071940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43f01522f0 0x7f43f01f1c90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f00c41e0 0x7f43f01498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 --2- 172.21.15.87:0/2123368923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f00ad990 0x7f43f0145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 >> 172.21.15.87:0/2123368923 conn(0x7f43f00c8770 msgr2=0x7f43f014c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 shutdown_connections 2024-04-25T16:00:03.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:03.101+0000 7f43f7a5a640 1 -- 172.21.15.87:0/2123368923 wait complete. 2024-04-25T16:00:03.122 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T16:00:05.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 Processor -- start 2024-04-25T16:00:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 -- start start 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05541593b0 0x7f0554152870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 0x7f055406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05540ae8e0 con 0x7f05540a8cc0 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f05540aebc0 con 0x7f05541593b0 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f055b234640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0554158f20 con 0x7f055406c670 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f05597d1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 0x7f055406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f0553fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05541593b0 0x7f0554152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f05597d1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 0x7f055406ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:42846/0 (socket says 172.21.15.87:42846) 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f0558fd0640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f05540a8cc0 0x7f0554155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:60038/0 (socket says 172.21.15.87:60038) 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.281+0000 7f05597d1640 1 -- 172.21.15.87:0/2553949453 learned_addr learned my addr 172.21.15.87:0/2553949453 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f0553fff640 1 -- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 msgr2=0x7f055406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f0553fff640 1 --2- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 0x7f055406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f0553fff640 1 -- 172.21.15.87:0/2553949453 >> v1:172.21.15.155:6789/0 conn(0x7f05540a8cc0 legacy=0x7f0554155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f0553fff640 1 -- 172.21.15.87:0/2553949453 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05541588d0 con 0x7f05541593b0 2024-04-25T16:00:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f05597d1640 1 --2- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 0x7f055406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:00:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f0553fff640 1 --2- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05541593b0 0x7f0554152870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05480097c0 tx=0x7f054801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d46b52165214256 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f05537fe640 1 -- 172.21.15.87:0/2553949453 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480b0070 con 0x7f05541593b0 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f05537fe640 1 -- 172.21.15.87:0/2553949453 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05480ab600 con 0x7f05541593b0 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f05537fe640 1 -- 172.21.15.87:0/2553949453 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480ab9d0 con 0x7f05541593b0 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f055b234640 1 -- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05541593b0 msgr2=0x7f0554152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.285+0000 7f055b234640 1 --2- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05541593b0 0x7f0554152870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f05480097c0 tx=0x7f054801c410 comp rx=0 tx=0).stop 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- 172.21.15.87:0/2553949453 shutdown_connections 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 --2- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f055406c670 0x7f055406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 --2- 172.21.15.87:0/2553949453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05541593b0 0x7f0554152870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- 172.21.15.87:0/2553949453 >> 172.21.15.87:0/2553949453 conn(0x7f055406d780 msgr2=0x7f055406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- 172.21.15.87:0/2553949453 shutdown_connections 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- 172.21.15.87:0/2553949453 wait complete. 2024-04-25T16:00:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 Processor -- start 2024-04-25T16:00:05.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- start start 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f055406c670 0x7f05541ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540a8cc0 0x7f05540c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 0x7f05540c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0554162560 con 0x7f05541593b0 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05541623e0 con 0x7f055406c670 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f055b234640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f05541626e0 con 0x7f05540a8cc0 2024-04-25T16:00:05.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 0x7f05540c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 0x7f05540c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40898/0 (socket says 172.21.15.87:40898) 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 -- 172.21.15.87:0/2607493366 learned_addr learned my addr 172.21.15.87:0/2607493366 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f0558fd0640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f055406c670 0x7f05541ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f0553fff640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540a8cc0 0x7f05540c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 -- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540a8cc0 msgr2=0x7f05540c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540a8cc0 0x7f05540c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 -- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f055406c670 msgr2=0x7f05541ee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f055406c670 0x7f05541ee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.289+0000 7f05597d1640 1 -- 172.21.15.87:0/2607493366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05540c7820 con 0x7f05541593b0 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f0553fff640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540a8cc0 0x7f05540c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05597d1640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 0x7f05540c99e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0544006e10 tx=0x7f054400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544004030 con 0x7f05541593b0 2024-04-25T16:00:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05440041d0 con 0x7f05541593b0 2024-04-25T16:00:05.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05540c7b00 con 0x7f05541593b0 2024-04-25T16:00:05.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054400c940 con 0x7f05541593b0 2024-04-25T16:00:05.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05540c80c0 con 0x7f05541593b0 2024-04-25T16:00:05.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05540c7590 con 0x7f05541593b0 2024-04-25T16:00:05.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f054400cae0 con 0x7f05541593b0 2024-04-25T16:00:05.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05517fa640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f054006f400 0x7f0540071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:05.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f0558fd0640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f054006f400 0x7f0540071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:05.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f054408f850 con 0x7f05541593b0 2024-04-25T16:00:05.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.293+0000 7f0558fd0640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f054006f400 0x7f0540071910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f054c0012f0 tx=0x7f054c001640 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:05.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.297+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0544017020 con 0x7f05541593b0 2024-04-25T16:00:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.489+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0554069bb0 con 0x7f05541593b0 2024-04-25T16:00:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.489+0000 7f05517fa640 1 -- 172.21.15.87:0/2607493366 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f054405bac0 con 0x7f05541593b0 2024-04-25T16:00:05.491 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:05.491 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f054006f400 msgr2=0x7f0540071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f054006f400 0x7f0540071910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f054c0012f0 tx=0x7f054c001640 comp rx=0 tx=0).stop 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 msgr2=0x7f05540c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 0x7f05540c99e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0544006e10 tx=0x7f054400ed20 comp rx=0 tx=0).stop 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 shutdown_connections 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f054006f400 0x7f0540071910 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05541593b0 0x7f05540c99e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05540a8cc0 0x7f05540c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 --2- 172.21.15.87:0/2607493366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f055406c670 0x7f05541ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 >> 172.21.15.87:0/2607493366 conn(0x7f055406d780 msgr2=0x7f0554156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 shutdown_connections 2024-04-25T16:00:05.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:05.493+0000 7f055b234640 1 -- 172.21.15.87:0/2607493366 wait complete. 2024-04-25T16:00:05.511 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T16:00:07.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:07.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 Processor -- start 2024-04-25T16:00:07.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 -- start start 2024-04-25T16:00:07.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c8015ac30 0x7f9c8015b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:07.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c8015b580 0x7f9c80161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c800c5120 con 0x7f9c800c4250 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9c800c3b20 con 0x7f9c8015b580 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c86f9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c80070e20 con 0x7f9c8015ac30 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c8553c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c8015b580 0x7f9c80161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c7ffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c8015ac30 0x7f9c8015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c8553c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c8015b580 0x7f9c80161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:50420/0 (socket says 172.21.15.87:50420) 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c8553c640 1 -- 172.21.15.87:0/2190906640 learned_addr learned my addr 172.21.15.87:0/2190906640 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.669+0000 7f9c84d3b640 1 --1- 172.21.15.87:0/2190906640 >> v1:172.21.15.155:6789/0 conn(0x7f9c800c4250 0x7f9c8006ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:60040/0 (socket says 172.21.15.87:60040) 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c8553c640 1 -- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c8015ac30 msgr2=0x7f9c8015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c8553c640 1 --2- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c8015ac30 0x7f9c8015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c8553c640 1 -- 172.21.15.87:0/2190906640 >> v1:172.21.15.155:6789/0 conn(0x7f9c800c4250 legacy=0x7f9c8006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:07.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c8553c640 1 -- 172.21.15.87:0/2190906640 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c800c4b60 con 0x7f9c8015b580 2024-04-25T16:00:07.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c8553c640 1 --2- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015b580 0x7f9c80161e60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009e50 tx=0x7f9c7801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d055c9cc1f131f28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:07.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c7f7fe640 1 -- 172.21.15.87:0/2190906640 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a5750 con 0x7f9c8015b580 2024-04-25T16:00:07.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c7f7fe640 1 -- 172.21.15.87:0/2190906640 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c780a58f0 con 0x7f9c8015b580 2024-04-25T16:00:07.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.673+0000 7f9c7f7fe640 1 -- 172.21.15.87:0/2190906640 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a5cc0 con 0x7f9c8015b580 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015b580 msgr2=0x7f9c80161e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015b580 0x7f9c80161e60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009e50 tx=0x7f9c7801c9a0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2190906640 shutdown_connections 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015b580 0x7f9c80161e60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2190906640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c8015ac30 0x7f9c8015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2190906640 >> 172.21.15.87:0/2190906640 conn(0x7f9c8006d780 msgr2=0x7f9c8006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2190906640 shutdown_connections 2024-04-25T16:00:07.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2190906640 wait complete. 2024-04-25T16:00:07.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 Processor -- start 2024-04-25T16:00:07.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- start start 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c800c4250 0x7f9c801500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015ac30 0x7f9c80150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 0x7f9c800c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9c800c47e0 con 0x7f9c8015b580 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c800c4660 con 0x7f9c8015ac30 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c86f9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c80155100 con 0x7f9c800c4250 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 0x7f9c800c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 0x7f9c800c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40902/0 (socket says 172.21.15.87:40902) 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 -- 172.21.15.87:0/2325307629 learned_addr learned my addr 172.21.15.87:0/2325307629 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c7ffff640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015ac30 0x7f9c80150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c84d3b640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c800c4250 0x7f9c801500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 -- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c800c4250 msgr2=0x7f9c801500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c800c4250 0x7f9c801500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 -- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015ac30 msgr2=0x7f9c80150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015ac30 0x7f9c80150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c8553c640 1 -- 172.21.15.87:0/2325307629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c801f4b30 con 0x7f9c8015b580 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.677+0000 7f9c84d3b640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c800c4250 0x7f9c801500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c8553c640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 0x7f9c800c8790 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c780af040 tx=0x7f9c78019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780bc020 con 0x7f9c8015b580 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c780b8670 con 0x7f9c8015b580 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8014f5c0 con 0x7f9c8015b580 2024-04-25T16:00:07.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a5750 con 0x7f9c8015b580 2024-04-25T16:00:07.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8014fb80 con 0x7f9c8015b580 2024-04-25T16:00:07.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c80069bb0 con 0x7f9c8015b580 2024-04-25T16:00:07.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9c780bf020 con 0x7f9c8015b580 2024-04-25T16:00:07.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c7d7fa640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9c6c06f400 0x7f9c6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:07.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f9c7812b000 con 0x7f9c8015b580 2024-04-25T16:00:07.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c84d3b640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9c6c06f400 0x7f9c6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:07.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.681+0000 7f9c84d3b640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9c6c06f400 0x7f9c6c071910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9c70007fd0 tx=0x7f9c70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:07.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.685+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c780c6030 con 0x7f9c8015b580 2024-04-25T16:00:07.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c801f48c0 con 0x7f9c8015b580 2024-04-25T16:00:07.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c7d7fa640 1 -- 172.21.15.87:0/2325307629 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f9c78016620 con 0x7f9c8015b580 2024-04-25T16:00:07.878 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:07.878 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:07.878 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T16:00:07.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9c6c06f400 msgr2=0x7f9c6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:07.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9c6c06f400 0x7f9c6c071910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9c70007fd0 tx=0x7f9c70009040 comp rx=0 tx=0).stop 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 msgr2=0x7f9c800c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 0x7f9c800c8790 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c780af040 tx=0x7f9c78019740 comp rx=0 tx=0).stop 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 shutdown_connections 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9c6c06f400 0x7f9c6c071910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.877+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c8015b580 0x7f9c800c8790 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.881+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8015ac30 0x7f9c80150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.881+0000 7f9c86f9f640 1 --2- 172.21.15.87:0/2325307629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c800c4250 0x7f9c801500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.881+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 >> 172.21.15.87:0/2325307629 conn(0x7f9c8006d780 msgr2=0x7f9c80157630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.881+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 shutdown_connections 2024-04-25T16:00:07.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:07.881+0000 7f9c86f9f640 1 -- 172.21.15.87:0/2325307629 wait complete. 2024-04-25T16:00:07.900 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-25T16:00:08.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:08.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 Processor -- start 2024-04-25T16:00:08.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 -- start start 2024-04-25T16:00:08.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 0x7f4e4c0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e4c0cae60 0x7f4e4c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e4c0c7570 con 0x7f4e4c157380 2024-04-25T16:00:08.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4e4c15b8b0 con 0x7f4e4c0cae60 2024-04-25T16:00:08.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e53dae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c15b5d0 con 0x7f4e4c15ad90 2024-04-25T16:00:08.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e5234b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4e4c157380 0x7f4e4c157790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32942/0 (socket says 172.21.15.87:32942) 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e5234b640 1 -- 172.21.15.87:0/2310225826 learned_addr learned my addr 172.21.15.87:0/2310225826 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e51349640 1 --2- 172.21.15.87:0/2310225826 >> v2:172.21.15.155:3300/0 conn(0x7f4e4c0cae60 0x7f4e4c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 0x7f4e4c0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907704897 0 0) 0x7f4e4c0c7570 con 0x7f4e4c157380 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.505+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e38003530 con 0x7f4e4c157380 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1778561893 0 0) 0x7f4e38003530 con 0x7f4e4c157380 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 msgr2=0x7f4e4c0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 0x7f4e4c0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 >> v2:172.21.15.155:3300/0 conn(0x7f4e4c0cae60 msgr2=0x7f4e4c0cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 --2- 172.21.15.87:0/2310225826 >> v2:172.21.15.155:3300/0 conn(0x7f4e4c0cae60 0x7f4e4c0cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c0c2290 con 0x7f4e4c157380 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f4e48001680 con 0x7f4e4c157380 2024-04-25T16:00:08.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 >> v1:172.21.15.87:6789/0 conn(0x7f4e4c157380 legacy=0x7f4e4c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e380039c0 0x7f4e38003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e38004810 0x7f4e38004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 0x7f4e38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c15b8b0 con 0x7f4e380039c0 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c15b5d0 con 0x7f4e38004810 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3800bb00 con 0x7f4e4c15ad90 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e380039c0 0x7f4e38003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 -- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 msgr2=0x7f4e38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c15ad90 0x7f4e38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 -- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e38004810 msgr2=0x7f4e38004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e38004810 0x7f4e38004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 -- 172.21.15.87:0/2310225826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e38003530 con 0x7f4e380039c0 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e380039c0 0x7f4e38003e30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009fc0 tx=0x7f4e4401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2179bc9f78b68898 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440b2070 con 0x7f4e380039c0 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e440a5ab0 con 0x7f4e380039c0 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e50b48640 1 -- 172.21.15.87:0/2310225826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44009c10 con 0x7f4e380039c0 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e53dae640 1 -- 172.21.15.87:0/2310225826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e380039c0 msgr2=0x7f4e38003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2310225826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e380039c0 0x7f4e38003e30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009fc0 tx=0x7f4e4401ccc0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e5234b640 1 -- 172.21.15.87:0/2310225826 reap_dead start 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e53dae640 1 -- 172.21.15.87:0/2310225826 shutdown_connections 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e53dae640 1 -- 172.21.15.87:0/2310225826 >> 172.21.15.87:0/2310225826 conn(0x7f4e4c0c9330 msgr2=0x7f4e4c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e53dae640 1 -- 172.21.15.87:0/2310225826 shutdown_connections 2024-04-25T16:00:08.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.509+0000 7f4e53dae640 1 -- 172.21.15.87:0/2310225826 wait complete. 2024-04-25T16:00:08.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 Processor -- start 2024-04-25T16:00:08.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 -- start start 2024-04-25T16:00:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e380039c0 0x7f4e4c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 0x7f4e4c153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c14f650 0x7f4e4c14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c15b1a0 con 0x7f4e4c14f240 2024-04-25T16:00:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4c0ca190 con 0x7f4e380039c0 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4c15b320 con 0x7f4e4c14f650 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 0x7f4e4c153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 0x7f4e4c153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40912/0 (socket says 172.21.15.87:40912) 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 -- 172.21.15.87:0/2810582609 learned_addr learned my addr 172.21.15.87:0/2810582609 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e380039c0 0x7f4e4c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e5234b640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c14f650 0x7f4e4c14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 -- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c14f650 msgr2=0x7f4e4c14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c14f650 0x7f4e4c14a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 -- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e380039c0 msgr2=0x7f4e4c150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e380039c0 0x7f4e4c150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 -- 172.21.15.87:0/2810582609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4c14b110 con 0x7f4e4c14f240 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e51349640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 0x7f4e4c153860 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00e820 tx=0x7f4e3c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c017070 con 0x7f4e4c14f240 2024-04-25T16:00:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00c8e0 con 0x7f4e4c14f240 2024-04-25T16:00:08.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00ccb0 con 0x7f4e4c14f240 2024-04-25T16:00:08.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4c151420 con 0x7f4e4c14f240 2024-04-25T16:00:08.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.513+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4c152d80 con 0x7f4e4c14f240 2024-04-25T16:00:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.517+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4c069bb0 con 0x7f4e4c14f240 2024-04-25T16:00:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.517+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4e3c01a070 con 0x7f4e4c14f240 2024-04-25T16:00:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.517+0000 7f4e427fc640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e3006f400 0x7f4e30071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.517+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f4e3c08f9d0 con 0x7f4e4c14f240 2024-04-25T16:00:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.517+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e3006f400 0x7f4e30071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.517+0000 7f4e51b4a640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e3006f400 0x7f4e30071910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4e440b0040 tx=0x7f4e440a7040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:08.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.521+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e3c05c3a0 con 0x7f4e4c14f240 2024-04-25T16:00:08.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.717+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e4c0c7760 con 0x7f4e4c14f240 2024-04-25T16:00:08.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e427fc640 1 -- 172.21.15.87:0/2810582609 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f4e3c05bca0 con 0x7f4e4c14f240 2024-04-25T16:00:08.721 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:08.721 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:08.722 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e3006f400 msgr2=0x7f4e30071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e3006f400 0x7f4e30071910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4e440b0040 tx=0x7f4e440a7040 comp rx=0 tx=0).stop 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 msgr2=0x7f4e4c153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 0x7f4e4c153860 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00e820 tx=0x7f4e3c00ece0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 shutdown_connections 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4e3006f400 0x7f4e30071910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e4c14f650 0x7f4e4c14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e4c14f240 0x7f4e4c153860 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 --2- 172.21.15.87:0/2810582609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e380039c0 0x7f4e4c150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 >> 172.21.15.87:0/2810582609 conn(0x7f4e4c0c9330 msgr2=0x7f4e4c14d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:08.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 shutdown_connections 2024-04-25T16:00:08.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.721+0000 7f4e53dae640 1 -- 172.21.15.87:0/2810582609 wait complete. 2024-04-25T16:00:08.743 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-04-25T16:00:08.743 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T16:00:08.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:00:08.760 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T16:00:08.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:08.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.953+0000 7f3907e69640 1 Processor -- start 2024-04-25T16:00:08.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.953+0000 7f3907e69640 1 -- start start 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3907e69640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39001529a0 0x7f3900071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3907e69640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39000ad990 0x7f39000adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3907e69640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3900072430 con 0x7f39000c41e0 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3907e69640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3900074730 con 0x7f39000ad990 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3907e69640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3900074a10 con 0x7f39001529a0 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39000ad990 0x7f39000adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39000ad990 0x7f39000adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40926/0 (socket says 172.21.15.87:40926) 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 -- 172.21.15.87:0/1096529431 learned_addr learned my addr 172.21.15.87:0/1096529431 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3906406640 1 --1- 172.21.15.87:0/1096529431 >> v1:172.21.15.87:6789/0 conn(0x7f39000c41e0 0x7f39000c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32944/0 (socket says 172.21.15.87:32944) 2024-04-25T16:00:08.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905c05640 1 --2- 172.21.15.87:0/1096529431 >> v2:172.21.15.155:3300/0 conn(0x7f39001529a0 0x7f3900071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 -- 172.21.15.87:0/1096529431 >> v2:172.21.15.155:3300/0 conn(0x7f39001529a0 msgr2=0x7f3900071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:08.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 --2- 172.21.15.87:0/1096529431 >> v2:172.21.15.155:3300/0 conn(0x7f39001529a0 0x7f3900071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 -- 172.21.15.87:0/1096529431 >> v1:172.21.15.87:6789/0 conn(0x7f39000c41e0 legacy=0x7f39000c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 -- 172.21.15.87:0/1096529431 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3900074cf0 con 0x7f39000ad990 2024-04-25T16:00:08.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3905404640 1 --2- 172.21.15.87:0/1096529431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000ad990 0x7f39000adda0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f39000ae520 tx=0x7f38f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d833c5f6fd61b18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:08.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3904c03640 1 -- 172.21.15.87:0/1096529431 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b0070 con 0x7f39000ad990 2024-04-25T16:00:08.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3904c03640 1 -- 172.21.15.87:0/1096529431 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40ab600 con 0x7f39000ad990 2024-04-25T16:00:08.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.957+0000 7f3904c03640 1 -- 172.21.15.87:0/1096529431 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40ab9d0 con 0x7f39000ad990 2024-04-25T16:00:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 -- 172.21.15.87:0/1096529431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000ad990 msgr2=0x7f39000adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 --2- 172.21.15.87:0/1096529431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000ad990 0x7f39000adda0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f39000ae520 tx=0x7f38f401c490 comp rx=0 tx=0).stop 2024-04-25T16:00:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 -- 172.21.15.87:0/1096529431 shutdown_connections 2024-04-25T16:00:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 --2- 172.21.15.87:0/1096529431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000ad990 0x7f39000adda0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 --2- 172.21.15.87:0/1096529431 >> v2:172.21.15.155:3300/0 conn(0x7f39001529a0 0x7f3900071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 -- 172.21.15.87:0/1096529431 >> 172.21.15.87:0/1096529431 conn(0x7f39000c8770 msgr2=0x7f39000c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 -- 172.21.15.87:0/1096529431 shutdown_connections 2024-04-25T16:00:08.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 -- 172.21.15.87:0/1096529431 wait complete. 2024-04-25T16:00:08.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 Processor -- start 2024-04-25T16:00:08.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.961+0000 7f3907e69640 1 -- start start 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39000ad990 0x7f39000c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 0x7f3900149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001529a0 0x7f39001488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3900162470 con 0x7f39000c41e0 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39001622f0 con 0x7f39000ad990 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39001625f0 con 0x7f39001529a0 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 0x7f3900149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 0x7f3900149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40936/0 (socket says 172.21.15.87:40936) 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 -- 172.21.15.87:0/3067931530 learned_addr learned my addr 172.21.15.87:0/3067931530 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905c05640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39000ad990 0x7f39000c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 -- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001529a0 msgr2=0x7f39001488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001529a0 0x7f39001488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 -- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39000ad990 msgr2=0x7f39000c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39000ad990 0x7f39000c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 -- 172.21.15.87:0/3067931530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39001571f0 con 0x7f39000c41e0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905404640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 0x7f3900149b40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ae040 tx=0x7f38f4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b0040 con 0x7f39000c41e0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f40b9070 con 0x7f39000c41e0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b4680 con 0x7f39000c41e0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39001ef230 con 0x7f39000c41e0 2024-04-25T16:00:08.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39001eef40 con 0x7f39000c41e0 2024-04-25T16:00:08.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3900069bb0 con 0x7f39000c41e0 2024-04-25T16:00:08.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f38f40b4820 con 0x7f39000c41e0 2024-04-25T16:00:08.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f38fe7fc640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f38ec06f430 0x7f38ec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:08.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905c05640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f38ec06f430 0x7f38ec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:08.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7297+0+0 (secure 0 0 0) 0x7f38f41294b0 con 0x7f39000c41e0 2024-04-25T16:00:08.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.965+0000 7f3905c05640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f38ec06f430 0x7f38ec071940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3900073d40 tx=0x7f38f000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:08.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:08.969+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f38f4016110 con 0x7f39000c41e0 2024-04-25T16:00:09.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.157+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39000c3760 con 0x7f39000c41e0 2024-04-25T16:00:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f38fe7fc640 1 -- 172.21.15.87:0/3067931530 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+6497 (secure 0 0 0) 0x7f38f40fce20 con 0x7f39000c41e0 2024-04-25T16:00:09.161 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:09.161 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T15:59:32.444303+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.87:6835/4111430078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4111430078},{"type":"v1","addr":"172.21.15.87:6835","nonce":4111430078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5583,"qdb_cluster":[5583]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 52 2024-04-25T16:00:09.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f38ec06f430 msgr2=0x7f38ec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:09.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f38ec06f430 0x7f38ec071940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3900073d40 tx=0x7f38f000b040 comp rx=0 tx=0).stop 2024-04-25T16:00:09.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 msgr2=0x7f3900149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:09.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 0x7f3900149b40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ae040 tx=0x7f38f4019230 comp rx=0 tx=0).stop 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 shutdown_connections 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f38ec06f430 0x7f38ec071940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39001529a0 0x7f39001488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000c41e0 0x7f3900149b40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 --2- 172.21.15.87:0/3067931530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39000ad990 0x7f39000c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 >> 172.21.15.87:0/3067931530 conn(0x7f39000c8770 msgr2=0x7f39000c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 shutdown_connections 2024-04-25T16:00:09.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:09.161+0000 7f3907e69640 1 -- 172.21.15.87:0/3067931530 wait complete. 2024-04-25T16:00:09.183 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:09.901 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:10.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 Processor -- start 2024-04-25T16:00:10.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 -- start start 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdf7c158a00 0x7fdf7c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdf7c0adfb0 0x7fdf7c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c0c5470 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c063660 con 0x7fdf7c158a00 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf81b5f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c0ab670 con 0x7fdf7c158e10 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdf7c0adfb0 0x7fdf7c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdf7c0adfb0 0x7fdf7c152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40950/0 (socket says 172.21.15.87:40950) 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 -- 172.21.15.87:0/3317885418 learned_addr learned my addr 172.21.15.87:0/3317885418 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7b7fe640 1 --2- 172.21.15.87:0/3317885418 >> v2:172.21.15.155:3300/0 conn(0x7fdf7c158a00 0x7fdf7c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7affd640 1 --2- 172.21.15.87:0/3317885418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 -- 172.21.15.87:0/3317885418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 msgr2=0x7fdf7c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:10.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 --2- 172.21.15.87:0/3317885418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 -- 172.21.15.87:0/3317885418 >> v2:172.21.15.155:3300/0 conn(0x7fdf7c158a00 msgr2=0x7fdf7c0ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:10.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 --2- 172.21.15.87:0/3317885418 >> v2:172.21.15.155:3300/0 conn(0x7fdf7c158a00 0x7fdf7c0ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.057+0000 7fdf7bfff640 1 -- 172.21.15.87:0/3317885418 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c0ab930 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf7bfff640 1 --2- 172.21.15.87:0/3317885418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c152bc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0721b0 tx=0x7fdf7401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89145082051423bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:10.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf7a7fc640 1 -- 172.21.15.87:0/3317885418 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf740a5800 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf7a7fc640 1 -- 172.21.15.87:0/3317885418 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740a59a0 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf7a7fc640 1 -- 172.21.15.87:0/3317885418 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf740a5d70 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3317885418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 msgr2=0x7fdf7c152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3317885418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c152bc0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0721b0 tx=0x7fdf7401c9c0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3317885418 shutdown_connections 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3317885418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c152bc0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3317885418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3317885418 >> v2:172.21.15.155:3300/0 conn(0x7fdf7c158a00 0x7fdf7c0ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3317885418 >> 172.21.15.87:0/3317885418 conn(0x7fdf7c06d650 msgr2=0x7fdf7c0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3317885418 shutdown_connections 2024-04-25T16:00:10.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.061+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3317885418 wait complete. 2024-04-25T16:00:10.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 Processor -- start 2024-04-25T16:00:10.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 -- start start 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c1ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c158a00 0x7fdf7c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0af0f0 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0aef70 con 0x7fdf7c158a00 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c155ad0 con 0x7fdf7c158e10 2024-04-25T16:00:10.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c1ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c1ef4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40956/0 (socket says 172.21.15.87:40956) 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 -- 172.21.15.87:0/3369218210 learned_addr learned my addr 172.21.15.87:0/3369218210 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7bfff640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7affd640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c158a00 0x7fdf7c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 -- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 msgr2=0x7fdf7c14e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c14e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 -- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c158a00 msgr2=0x7fdf7c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c158a00 0x7fdf7c15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 -- 172.21.15.87:0/3369218210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c15ca90 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7bfff640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf7b7fe640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c1ef4e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00d620 tx=0x7fdf6c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c018020 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6c014620 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0149f0 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c159d80 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.065+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c1efec0 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.069+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7c151770 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.069+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf6c01b020 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.069+0000 7fdf63fff640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf6806f400 0x7fdf68071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.069+0000 7fdf7affd640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf6806f400 0x7fdf68071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.069+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7fdf6c08fdc0 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.069+0000 7fdf7affd640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf6806f400 0x7fdf68071910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c153c80 tx=0x7fdf70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:10.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.073+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf7c151770 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.257+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf7c069bb0 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf63fff640 1 -- 172.21.15.87:0/3369218210 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5664 (secure 0 0 0) 0x7fdf6c022020 con 0x7fdf7c0adfb0 2024-04-25T16:00:10.261 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:10.261 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:09.300672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:10.261 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 53 2024-04-25T16:00:10.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf6806f400 msgr2=0x7fdf68071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf6806f400 0x7fdf68071910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c153c80 tx=0x7fdf70008040 comp rx=0 tx=0).stop 2024-04-25T16:00:10.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 msgr2=0x7fdf7c1ef4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c1ef4e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00d620 tx=0x7fdf6c00dae0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 shutdown_connections 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdf6806f400 0x7fdf68071910 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf7c158e10 0x7fdf7c14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf7c158a00 0x7fdf7c15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 --2- 172.21.15.87:0/3369218210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf7c0adfb0 0x7fdf7c1ef4e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 >> 172.21.15.87:0/3369218210 conn(0x7fdf7c06d650 msgr2=0x7fdf7c152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 shutdown_connections 2024-04-25T16:00:10.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.261+0000 7fdf81b5f640 1 -- 172.21.15.87:0/3369218210 wait complete. 2024-04-25T16:00:10.282 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-04-25T16:00:10.282 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T16:00:10.282 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:10.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:10.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:10.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 Processor -- start 2024-04-25T16:00:10.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 -- start start 2024-04-25T16:00:10.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648154f30 0x7f8648074110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f864806fdd0 0x7f86480c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86480701e0 con 0x7f864806f9c0 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f86480c46f0 con 0x7f864806fdd0 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864fa37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86480c4dc0 con 0x7f8648154f30 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864d7d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648154f30 0x7f8648074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864cfd2640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f864806f9c0 0x7f86480c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:60052/0 (socket says 172.21.15.87:60052) 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864cfd2640 1 -- 172.21.15.87:0/3241022877 learned_addr learned my addr 172.21.15.87:0/3241022877 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:10.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864dfd4640 1 --2- 172.21.15.87:0/3241022877 >> v2:172.21.15.155:3300/0 conn(0x7f864806fdd0 0x7f86480c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f863ffff640 1 -- 172.21.15.87:0/3241022877 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162679819 0 0) 0x7f86480701e0 con 0x7f864806f9c0 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f863ffff640 1 -- 172.21.15.87:0/3241022877 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8634003530 con 0x7f864806f9c0 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864dfd4640 1 -- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648154f30 msgr2=0x7f8648074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f863ffff640 1 -- 172.21.15.87:0/3241022877 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1368720014 0 0) 0x7f8634003530 con 0x7f864806f9c0 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864dfd4640 1 --2- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648154f30 0x7f8648074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864dfd4640 1 -- 172.21.15.87:0/3241022877 >> v1:172.21.15.155:6789/0 conn(0x7f864806f9c0 legacy=0x7f86480c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864dfd4640 1 -- 172.21.15.87:0/3241022877 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8648155340 con 0x7f864806fdd0 2024-04-25T16:00:10.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.425+0000 7f864d7d3640 1 --2- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648154f30 0x7f8648074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:00:10.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864dfd4640 1 --2- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864806fdd0 0x7f86480c59b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8640009d90 tx=0x7f864001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28113c26e6c404ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:10.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f863ffff640 1 -- 172.21.15.87:0/3241022877 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400b2070 con 0x7f864806fdd0 2024-04-25T16:00:10.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f863ffff640 1 -- 172.21.15.87:0/3241022877 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400a5510 con 0x7f864806fdd0 2024-04-25T16:00:10.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f863ffff640 1 -- 172.21.15.87:0/3241022877 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638001680 con 0x7f864806fdd0 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 -- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864806fdd0 msgr2=0x7f86480c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 --2- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864806fdd0 0x7f86480c59b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8640009d90 tx=0x7f864001c800 comp rx=0 tx=0).stop 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 -- 172.21.15.87:0/3241022877 shutdown_connections 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 --2- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864806fdd0 0x7f86480c59b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 --2- 172.21.15.87:0/3241022877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8648154f30 0x7f8648074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 -- 172.21.15.87:0/3241022877 >> 172.21.15.87:0/3241022877 conn(0x7f86480ab4d0 msgr2=0x7f86480ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 -- 172.21.15.87:0/3241022877 shutdown_connections 2024-04-25T16:00:10.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.429+0000 7f864fa37640 1 -- 172.21.15.87:0/3241022877 wait complete. 2024-04-25T16:00:10.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 Processor -- start 2024-04-25T16:00:10.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- start start 2024-04-25T16:00:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 0x7f864814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864806fdd0 0x7f86480a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8648154f30 0x7f864814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8648070d90 con 0x7f864806f9c0 2024-04-25T16:00:10.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8648070c10 con 0x7f8648154f30 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86481614c0 con 0x7f864806fdd0 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 0x7f864814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 0x7f864814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40972/0 (socket says 172.21.15.87:40972) 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 -- 172.21.15.87:0/4231893580 learned_addr learned my addr 172.21.15.87:0/4231893580 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864cfd2640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864806fdd0 0x7f86480a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864dfd4640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8648154f30 0x7f864814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 -- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864806fdd0 msgr2=0x7f86480a9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864806fdd0 0x7f86480a9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 -- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8648154f30 msgr2=0x7f864814a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8648154f30 0x7f864814a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 -- 172.21.15.87:0/4231893580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86480ad4b0 con 0x7f864806f9c0 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864dfd4640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8648154f30 0x7f864814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864d7d3640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 0x7f864814ccd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f864400e960 tx=0x7f864400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:10.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644017070 con 0x7f864806f9c0 2024-04-25T16:00:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f864400ca00 con 0x7f864806f9c0 2024-04-25T16:00:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86480ab260 con 0x7f864806f9c0 2024-04-25T16:00:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864400cdd0 con 0x7f864806f9c0 2024-04-25T16:00:10.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86480aaca0 con 0x7f864806f9c0 2024-04-25T16:00:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.433+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864806a980 con 0x7f864806f9c0 2024-04-25T16:00:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.437+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f864401a070 con 0x7f864806f9c0 2024-04-25T16:00:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.437+0000 7f863dffb640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f862c06f430 0x7f862c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.437+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f864408f640 con 0x7f864806f9c0 2024-04-25T16:00:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.437+0000 7f864cfd2640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f862c06f430 0x7f862c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:10.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.437+0000 7f864cfd2640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f862c06f430 0x7f862c071940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8638001020 tx=0x7f8638000fb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:10.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.441+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f864405b970 con 0x7f864806f9c0 2024-04-25T16:00:10.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.625+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86480c3b50 con 0x7f864806f9c0 2024-04-25T16:00:10.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.625+0000 7f863dffb640 1 -- 172.21.15.87:0/4231893580 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5664 (secure 0 0 0) 0x7f864405fc70 con 0x7f864806f9c0 2024-04-25T16:00:10.627 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:10.627 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:09.300672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:10.627 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 53 2024-04-25T16:00:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f862c06f430 msgr2=0x7f862c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f862c06f430 0x7f862c071940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8638001020 tx=0x7f8638000fb0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 msgr2=0x7f864814ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 0x7f864814ccd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f864400e960 tx=0x7f864400ee20 comp rx=0 tx=0).stop 2024-04-25T16:00:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 shutdown_connections 2024-04-25T16:00:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f862c06f430 0x7f862c071940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8648154f30 0x7f864814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f864806fdd0 0x7f86480a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 --2- 172.21.15.87:0/4231893580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f864806f9c0 0x7f864814ccd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 >> 172.21.15.87:0/4231893580 conn(0x7f86480ab4d0 msgr2=0x7f86480ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 shutdown_connections 2024-04-25T16:00:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:10.629+0000 7f864fa37640 1 -- 172.21.15.87:0/4231893580 wait complete. 2024-04-25T16:00:10.648 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 53, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 53, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5269": { "addr": "172.21.15.155:6835/3802722727", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 3802722727, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 3802722727, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5269, "incarnation": 53, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T16:00:09.300672+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5269 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 51, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5140": { "addr": "172.21.15.87:6837/2477874160", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6836", "nonce": 2477874160, "type": "v2" }, { "addr": "172.21.15.87:6837", "nonce": 2477874160, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5140, "incarnation": 47, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 24 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T15:59:43.498413+0000", "qdb_cluster": [ 5140 ], "qdb_leader": 5140, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5140 } } } ], "standbys": [ { "addr": "172.21.15.155:6833/2424832889", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 2424832889, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 2424832889, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 48, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5239, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T16:00:11.184 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:11.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 Processor -- start 2024-04-25T16:00:11.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 -- start start 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f722c155320 0x7f722c155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f722c074160 0x7f722c074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f722c0aa290 con 0x7f722c074160 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f722c1598b0 con 0x7f722c155320 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7230922640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f722c152d90 con 0x7f722c152980 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f722c074160 0x7f722c074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f7229d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f722c155320 0x7f722c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f722c074160 0x7f722c074570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34418/0 (socket says 172.21.15.87:34418) 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 -- 172.21.15.87:0/4185321565 learned_addr learned my addr 172.21.15.87:0/4185321565 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722a59c640 1 --2- 172.21.15.87:0/4185321565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 -- 172.21.15.87:0/4185321565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 msgr2=0x7f722c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 --2- 172.21.15.87:0/4185321565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c0c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 -- 172.21.15.87:0/4185321565 >> v2:172.21.15.155:3300/0 conn(0x7f722c155320 msgr2=0x7f722c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 --2- 172.21.15.87:0/4185321565 >> v2:172.21.15.155:3300/0 conn(0x7f722c155320 0x7f722c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.337+0000 7f722ad9d640 1 -- 172.21.15.87:0/4185321565 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c0ca2f0 con 0x7f722c074160 2024-04-25T16:00:11.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f722ad9d640 1 --2- 172.21.15.87:0/4185321565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c074160 0x7f722c074570 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f722c0507c0 tx=0x7f721c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5880b511f1ddee95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:11.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f722959a640 1 -- 172.21.15.87:0/4185321565 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0b0070 con 0x7f722c074160 2024-04-25T16:00:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f722959a640 1 -- 172.21.15.87:0/4185321565 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c0ab600 con 0x7f722c074160 2024-04-25T16:00:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f722959a640 1 -- 172.21.15.87:0/4185321565 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0ab9d0 con 0x7f722c074160 2024-04-25T16:00:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 -- 172.21.15.87:0/4185321565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c074160 msgr2=0x7f722c074570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 --2- 172.21.15.87:0/4185321565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c074160 0x7f722c074570 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f722c0507c0 tx=0x7f721c01c490 comp rx=0 tx=0).stop 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 -- 172.21.15.87:0/4185321565 shutdown_connections 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 --2- 172.21.15.87:0/4185321565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c074160 0x7f722c074570 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 --2- 172.21.15.87:0/4185321565 >> v2:172.21.15.155:3300/0 conn(0x7f722c155320 0x7f722c155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 --2- 172.21.15.87:0/4185321565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c0c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 -- 172.21.15.87:0/4185321565 >> 172.21.15.87:0/4185321565 conn(0x7f722c0ac550 msgr2=0x7f722c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 -- 172.21.15.87:0/4185321565 shutdown_connections 2024-04-25T16:00:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.341+0000 7f7230922640 1 -- 172.21.15.87:0/4185321565 wait complete. 2024-04-25T16:00:11.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 Processor -- start 2024-04-25T16:00:11.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- start start 2024-04-25T16:00:11.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c074160 0x7f722c1f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 0x7f722c14b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f722c158f70 con 0x7f722c155320 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f722c158c90 con 0x7f722c074160 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f722c0729c0 con 0x7f722c152980 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 0x7f722c14b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 0x7f722c14b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34426/0 (socket says 172.21.15.87:34426) 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 -- 172.21.15.87:0/644217528 learned_addr learned my addr 172.21.15.87:0/644217528 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722a59c640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c074160 0x7f722c1f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7229d9b640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 -- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 msgr2=0x7f722c151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:11.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 -- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c074160 msgr2=0x7f722c1f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c074160 0x7f722c1f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 -- 172.21.15.87:0/644217528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c150c70 con 0x7f722c155320 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722a59c640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c074160 0x7f722c1f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f722ad9d640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 0x7f722c14b5b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f721c01c970 tx=0x7f721c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0b9070 con 0x7f722c155320 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c0b4420 con 0x7f722c155320 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0b0040 con 0x7f722c155320 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c14db20 con 0x7f722c155320 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1f2d60 con 0x7f722c155320 2024-04-25T16:00:11.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.345+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c069bb0 con 0x7f722c155320 2024-04-25T16:00:11.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.349+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f721c0bc070 con 0x7f722c155320 2024-04-25T16:00:11.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.349+0000 7f7222ffd640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f720c06f400 0x7f720c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:11.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.349+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f721c128d70 con 0x7f722c155320 2024-04-25T16:00:11.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.349+0000 7f722a59c640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f720c06f400 0x7f720c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:11.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.349+0000 7f722a59c640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f720c06f400 0x7f720c071910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7214009fd0 tx=0x7f721400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:11.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.353+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f721c0c3080 con 0x7f722c155320 2024-04-25T16:00:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.549+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f722c0c9b90 con 0x7f722c155320 2024-04-25T16:00:11.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.549+0000 7f7222ffd640 1 -- 172.21.15.87:0/644217528 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5664 (secure 0 0 0) 0x7f721c016110 con 0x7f722c155320 2024-04-25T16:00:11.554 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:11.554 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:09.300672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 53 2024-04-25T16:00:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f720c06f400 msgr2=0x7f720c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f720c06f400 0x7f720c071910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7214009fd0 tx=0x7f721400d040 comp rx=0 tx=0).stop 2024-04-25T16:00:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 msgr2=0x7f722c14b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 0x7f722c14b5b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f721c01c970 tx=0x7f721c019230 comp rx=0 tx=0).stop 2024-04-25T16:00:11.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 shutdown_connections 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f720c06f400 0x7f720c071910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f722c155320 0x7f722c14b5b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f722c152980 0x7f722c151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 --2- 172.21.15.87:0/644217528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f722c074160 0x7f722c1f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 >> 172.21.15.87:0/644217528 conn(0x7f722c0ac550 msgr2=0x7f722c154440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 shutdown_connections 2024-04-25T16:00:11.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:11.553+0000 7f7230922640 1 -- 172.21.15.87:0/644217528 wait complete. 2024-04-25T16:00:11.575 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:12.649 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:12.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 Processor -- start 2024-04-25T16:00:12.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 -- start start 2024-04-25T16:00:12.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c158a00 0x7f030c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f030c0adfb0 0x7f030c15fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030c063660 con 0x7f030c158e10 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f030c0c5470 con 0x7f030c0adfb0 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0312be9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f030c0ab670 con 0x7f030c158a00 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f030bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f030c158e10 0x7f030c152680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41772/0 (socket says 172.21.15.87:41772) 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f030bfff640 1 -- 172.21.15.87:0/1245262654 learned_addr learned my addr 172.21.15.87:0/1245262654 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0310985640 1 --2- 172.21.15.87:0/1245262654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c158a00 0x7f030c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0311186640 1 --2- 172.21.15.87:0/1245262654 >> v2:172.21.15.155:3300/0 conn(0x7f030c0adfb0 0x7f030c15fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f030b7fe640 1 -- 172.21.15.87:0/1245262654 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724972563 0 0) 0x7f030c063660 con 0x7f030c158e10 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f030b7fe640 1 -- 172.21.15.87:0/1245262654 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f4003530 con 0x7f030c158e10 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0310985640 1 -- 172.21.15.87:0/1245262654 >> v2:172.21.15.155:3300/0 conn(0x7f030c0adfb0 msgr2=0x7f030c15fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0310985640 1 --2- 172.21.15.87:0/1245262654 >> v2:172.21.15.155:3300/0 conn(0x7f030c0adfb0 0x7f030c15fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:12.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0310985640 1 -- 172.21.15.87:0/1245262654 >> v1:172.21.15.87:6789/0 conn(0x7f030c158e10 legacy=0x7f030c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:12.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.809+0000 7f0310985640 1 -- 172.21.15.87:0/1245262654 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c0ab930 con 0x7f030c158a00 2024-04-25T16:00:12.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0310985640 1 --2- 172.21.15.87:0/1245262654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c158a00 0x7f030c0ada70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0097c0 tx=0x7f02fc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5866437de21a5dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:12.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f030b7fe640 1 -- 172.21.15.87:0/1245262654 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0ab430 con 0x7f030c158a00 2024-04-25T16:00:12.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f030b7fe640 1 -- 172.21.15.87:0/1245262654 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02fc0b0070 con 0x7f030c158a00 2024-04-25T16:00:12.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f030b7fe640 1 -- 172.21.15.87:0/1245262654 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0ab7d0 con 0x7f030c158a00 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 -- 172.21.15.87:0/1245262654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c158a00 msgr2=0x7f030c0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 --2- 172.21.15.87:0/1245262654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c158a00 0x7f030c0ada70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0097c0 tx=0x7f02fc01c470 comp rx=0 tx=0).stop 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 -- 172.21.15.87:0/1245262654 shutdown_connections 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 --2- 172.21.15.87:0/1245262654 >> v2:172.21.15.155:3300/0 conn(0x7f030c0adfb0 0x7f030c15fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 --2- 172.21.15.87:0/1245262654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c158a00 0x7f030c0ada70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 -- 172.21.15.87:0/1245262654 >> 172.21.15.87:0/1245262654 conn(0x7f030c06d650 msgr2=0x7f030c0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:12.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 -- 172.21.15.87:0/1245262654 shutdown_connections 2024-04-25T16:00:12.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.813+0000 7f0312be9640 1 -- 172.21.15.87:0/1245262654 wait complete. 2024-04-25T16:00:12.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 Processor -- start 2024-04-25T16:00:12.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 -- start start 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 0x7f030c1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030c158e10 0x7f030c145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c14e4b0 0x7f030c145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f030c0af0f0 con 0x7f030c0adfb0 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f030c0aef70 con 0x7f030c158e10 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f030c0749b0 con 0x7f030c14e4b0 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 0x7f030c1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 0x7f030c1442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34436/0 (socket says 172.21.15.87:34436) 2024-04-25T16:00:12.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 -- 172.21.15.87:0/723828615 learned_addr learned my addr 172.21.15.87:0/723828615 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0311186640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c14e4b0 0x7f030c145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f030bfff640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030c158e10 0x7f030c145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 -- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c14e4b0 msgr2=0x7f030c145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c14e4b0 0x7f030c145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 -- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030c158e10 msgr2=0x7f030c145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030c158e10 0x7f030c145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 -- 172.21.15.87:0/723828615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c142550 con 0x7f030c0adfb0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0310985640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 0x7f030c1442f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f02fc000c10 tx=0x7f02fc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc006e20 con 0x7f030c0adfb0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02fc0039b0 con 0x7f030c0adfb0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c1476a0 con 0x7f030c0adfb0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc003b60 con 0x7f030c0adfb0 2024-04-25T16:00:12.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.817+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c147c60 con 0x7f030c0adfb0 2024-04-25T16:00:12.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.821+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030c069bb0 con 0x7f030c0adfb0 2024-04-25T16:00:12.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.821+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f02fc0be020 con 0x7f030c0adfb0 2024-04-25T16:00:12.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.821+0000 7f03097fa640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f02f806f400 0x7f02f8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:12.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.821+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f02fc128f70 con 0x7f030c0adfb0 2024-04-25T16:00:12.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.821+0000 7f030bfff640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f02f806f400 0x7f02f8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:12.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.821+0000 7f030bfff640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f02f806f400 0x7f02f8071910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f030c14ef40 tx=0x7f0300009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:12.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:12.825+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02fc0c5020 con 0x7f030c0adfb0 2024-04-25T16:00:13.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.017+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f030c0704e0 con 0x7f030c0adfb0 2024-04-25T16:00:13.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f03097fa640 1 -- 172.21.15.87:0/723828615 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5664 (secure 0 0 0) 0x7f02fc016090 con 0x7f030c0adfb0 2024-04-25T16:00:13.021 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:09.300672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:13.022 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 53 2024-04-25T16:00:13.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f02f806f400 msgr2=0x7f02f8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f02f806f400 0x7f02f8071910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f030c14ef40 tx=0x7f0300009040 comp rx=0 tx=0).stop 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 msgr2=0x7f030c1442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 0x7f030c1442f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f02fc000c10 tx=0x7f02fc019210 comp rx=0 tx=0).stop 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 shutdown_connections 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f02f806f400 0x7f02f8071910 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f030c14e4b0 0x7f030c145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030c158e10 0x7f030c145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 --2- 172.21.15.87:0/723828615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030c0adfb0 0x7f030c1442f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 >> 172.21.15.87:0/723828615 conn(0x7f030c06d650 msgr2=0x7f030c1567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 shutdown_connections 2024-04-25T16:00:13.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.021+0000 7f0312be9640 1 -- 172.21.15.87:0/723828615 wait complete. 2024-04-25T16:00:13.042 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T16:00:13.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:13.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.733+0000 7f5e7b4fb640 1 Processor -- start 2024-04-25T16:00:13.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.733+0000 7f5e7b4fb640 1 -- start start 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e7b4fb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e741529a0 0x7f5e74071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e7b4fb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5e740adda0 0x7f5e740c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e7b4fb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e740c4e30 con 0x7f5e740ad990 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e7b4fb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5e740ae1b0 con 0x7f5e741529a0 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e7b4fb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5e74072430 con 0x7f5e740adda0 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79297640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e741529a0 0x7f5e74071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e78a96640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5e740ad990 0x7f5e740c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41784/0 (socket says 172.21.15.87:41784) 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e78a96640 1 -- 172.21.15.87:0/2818260454 learned_addr learned my addr 172.21.15.87:0/2818260454 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79a98640 1 --2- 172.21.15.87:0/2818260454 >> v2:172.21.15.155:3300/0 conn(0x7f5e740adda0 0x7f5e740c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:13.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79297640 1 -- 172.21.15.87:0/2818260454 >> v2:172.21.15.155:3300/0 conn(0x7f5e740adda0 msgr2=0x7f5e740c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:13.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79297640 1 --2- 172.21.15.87:0/2818260454 >> v2:172.21.15.155:3300/0 conn(0x7f5e740adda0 0x7f5e740c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79297640 1 -- 172.21.15.87:0/2818260454 >> v1:172.21.15.87:6789/0 conn(0x7f5e740ad990 legacy=0x7f5e740c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79297640 1 -- 172.21.15.87:0/2818260454 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e74074730 con 0x7f5e741529a0 2024-04-25T16:00:13.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79a98640 1 --2- 172.21.15.87:0/2818260454 >> v2:172.21.15.155:3300/0 conn(0x7f5e740adda0 0x7f5e740c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:13.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e79297640 1 --2- 172.21.15.87:0/2818260454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e741529a0 0x7f5e74071e50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e740ae750 tx=0x7f5e7001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11aea4ed7ae188f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:13.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.737+0000 7f5e6bfff640 1 -- 172.21.15.87:0/2818260454 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700b0070 con 0x7f5e741529a0 2024-04-25T16:00:13.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e6bfff640 1 -- 172.21.15.87:0/2818260454 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e700ab600 con 0x7f5e741529a0 2024-04-25T16:00:13.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e6bfff640 1 -- 172.21.15.87:0/2818260454 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700ab9d0 con 0x7f5e741529a0 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/2818260454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e741529a0 msgr2=0x7f5e74071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/2818260454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e741529a0 0x7f5e74071e50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e740ae750 tx=0x7f5e7001c3f0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/2818260454 shutdown_connections 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/2818260454 >> v2:172.21.15.155:3300/0 conn(0x7f5e740adda0 0x7f5e740c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/2818260454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e741529a0 0x7f5e74071e50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/2818260454 >> 172.21.15.87:0/2818260454 conn(0x7f5e740c8770 msgr2=0x7f5e740c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:13.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/2818260454 shutdown_connections 2024-04-25T16:00:13.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/2818260454 wait complete. 2024-04-25T16:00:13.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 Processor -- start 2024-04-25T16:00:13.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- start start 2024-04-25T16:00:13.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e740ad990 0x7f5e7415e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:13.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 0x7f5e741513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:13.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e741529a0 0x7f5e741f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:13.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5e741622f0 con 0x7f5e740adda0 2024-04-25T16:00:13.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e740ab1a0 con 0x7f5e741529a0 2024-04-25T16:00:13.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e7b4fb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5e74162470 con 0x7f5e740ad990 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e78a96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 0x7f5e741513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e78a96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 0x7f5e741513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34468/0 (socket says 172.21.15.87:34468) 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.741+0000 7f5e78a96640 1 -- 172.21.15.87:0/610970837 learned_addr learned my addr 172.21.15.87:0/610970837 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e79a98640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e741529a0 0x7f5e741f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e79297640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e740ad990 0x7f5e7415e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e78a96640 1 -- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e740ad990 msgr2=0x7f5e7415e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e78a96640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e740ad990 0x7f5e7415e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e78a96640 1 -- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e741529a0 msgr2=0x7f5e741f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e78a96640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e741529a0 0x7f5e741f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e78a96640 1 -- 172.21.15.87:0/610970837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e740ad570 con 0x7f5e740adda0 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e78a96640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 0x7f5e741513c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c340 tx=0x7f5e6400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:13.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e64017070 con 0x7f5e740adda0 2024-04-25T16:00:13.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e64005cf0 con 0x7f5e740adda0 2024-04-25T16:00:13.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e740ab8f0 con 0x7f5e740adda0 2024-04-25T16:00:13.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e64007310 con 0x7f5e740adda0 2024-04-25T16:00:13.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e74151e20 con 0x7f5e740adda0 2024-04-25T16:00:13.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e74069bb0 con 0x7f5e740adda0 2024-04-25T16:00:13.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5e6401a070 con 0x7f5e740adda0 2024-04-25T16:00:13.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e69ffb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e5806f430 0x7f5e58071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:13.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e79297640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e5806f430 0x7f5e58071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:13.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f5e6408eef0 con 0x7f5e740adda0 2024-04-25T16:00:13.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.745+0000 7f5e79297640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e5806f430 0x7f5e58071940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5e700ad000 tx=0x7f5e700a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:13.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.749+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e64021020 con 0x7f5e740adda0 2024-04-25T16:00:13.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.953+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e740c3760 con 0x7f5e740adda0 2024-04-25T16:00:13.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.953+0000 7f5e69ffb640 1 -- 172.21.15.87:0/610970837 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5664 (secure 0 0 0) 0x7f5e740ad570 con 0x7f5e740adda0 2024-04-25T16:00:13.956 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:13.956 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:09.300672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:13.956 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 53 2024-04-25T16:00:13.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e5806f430 msgr2=0x7f5e58071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e5806f430 0x7f5e58071940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5e700ad000 tx=0x7f5e700a6000 comp rx=0 tx=0).stop 2024-04-25T16:00:13.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 msgr2=0x7f5e741513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:13.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 0x7f5e741513c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c340 tx=0x7f5e6400c800 comp rx=0 tx=0).stop 2024-04-25T16:00:13.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 shutdown_connections 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e5806f430 0x7f5e58071940 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e741529a0 0x7f5e741f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740adda0 0x7f5e741513c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 --2- 172.21.15.87:0/610970837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e740ad990 0x7f5e7415e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 >> 172.21.15.87:0/610970837 conn(0x7f5e740c8770 msgr2=0x7f5e740c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 shutdown_connections 2024-04-25T16:00:13.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:13.957+0000 7f5e7b4fb640 1 -- 172.21.15.87:0/610970837 wait complete. 2024-04-25T16:00:13.977 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:15.042 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:15.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0597b99640 1 Processor -- start 2024-04-25T16:00:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0597b99640 1 -- start start 2024-04-25T16:00:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0597b99640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f059015ac30 0x7f059015b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0597b99640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05900c5120 con 0x7f059015b580 2024-04-25T16:00:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0597b99640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05900c4b60 con 0x7f05900c4250 2024-04-25T16:00:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0597b99640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f05900c3b20 con 0x7f059015ac30 2024-04-25T16:00:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0596136640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f059015b580 0x7f0590161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41790/0 (socket says 172.21.15.87:41790) 2024-04-25T16:00:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0596136640 1 -- 172.21.15.87:0/249520871 learned_addr learned my addr 172.21.15.87:0/249520871 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0595134640 1 --2- 172.21.15.87:0/249520871 >> v2:172.21.15.155:3300/0 conn(0x7f059015ac30 0x7f059015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480550201 0 0) 0x7f0580001120 con 0x7f059015b580 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.201+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0578003530 con 0x7f059015b580 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1229140969 0 0) 0x7f0578003530 con 0x7f059015b580 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 >> v2:172.21.15.155:3300/0 conn(0x7f059015ac30 msgr2=0x7f059015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 --2- 172.21.15.87:0/249520871 >> v2:172.21.15.155:3300/0 conn(0x7f059015ac30 0x7f059015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 >> v1:172.21.15.155:6789/0 conn(0x7f05900c4250 legacy=0x7f059006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05900c4e40 con 0x7f059015b580 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f0580001850 con 0x7f059015b580 2024-04-25T16:00:15.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 >> v1:172.21.15.87:6789/0 conn(0x7f059015b580 legacy=0x7f0590161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05780039c0 0x7f0578003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0578004810 0x7f0578004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f057800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f057800c1c0 con 0x7f0578005260 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f057800c370 con 0x7f0578004810 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f057800c570 con 0x7f05780039c0 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f057800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0595935640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05780039c0 0x7f0578003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0595134640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0578004810 0x7f0578004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 -- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05780039c0 msgr2=0x7f0578003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05780039c0 0x7f0578003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 -- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0578004810 msgr2=0x7f0578004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:15.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0578004810 0x7f0578004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 -- 172.21.15.87:0/249520871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0578003530 con 0x7f0578005260 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 -- 172.21.15.87:0/249520871 reap_dead start 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0596136640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f057800b9d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f058000c4c0 tx=0x7f058001f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd916540d2daeb24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058000c0e0 con 0x7f0578005260 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0580005b00 con 0x7f0578005260 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0594933640 1 -- 172.21.15.87:0/249520871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580007070 con 0x7f0578005260 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 -- 172.21.15.87:0/249520871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 msgr2=0x7f057800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f057800b9d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f058000c4c0 tx=0x7f058001f420 comp rx=0 tx=0).stop 2024-04-25T16:00:15.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 -- 172.21.15.87:0/249520871 shutdown_connections 2024-04-25T16:00:15.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 --2- 172.21.15.87:0/249520871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f057800b9d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 -- 172.21.15.87:0/249520871 >> 172.21.15.87:0/249520871 conn(0x7f059006d780 msgr2=0x7f059006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:15.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 -- 172.21.15.87:0/249520871 shutdown_connections 2024-04-25T16:00:15.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.205+0000 7f0597b99640 1 -- 172.21.15.87:0/249520871 wait complete. 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 Processor -- start 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 -- start start 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f0590153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05901e3250 0x7f05901f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05901f1570 0x7f059014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f05900c4660 con 0x7f0578005260 2024-04-25T16:00:15.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0590070e20 con 0x7f05901e3250 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f05900c47e0 con 0x7f05901f1570 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f0590153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f0590153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34474/0 (socket says 172.21.15.87:34474) 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 -- 172.21.15.87:0/2943631001 learned_addr learned my addr 172.21.15.87:0/2943631001 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595134640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05901e3250 0x7f05901f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 -- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05901f1570 msgr2=0x7f059014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0596136640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05901f1570 0x7f059014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05901f1570 0x7f059014fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 -- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05901e3250 msgr2=0x7f05901f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05901e3250 0x7f05901f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 -- 172.21.15.87:0/2943631001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05900c9ec0 con 0x7f0578005260 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595134640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05901e3250 0x7f05901f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0595935640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f0590153880 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f058800d7e0 tx=0x7f058800dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588003db0 con 0x7f0578005260 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588017070 con 0x7f0578005260 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05901528d0 con 0x7f0578005260 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058800b8f0 con 0x7f0578005260 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.209+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05901511d0 con 0x7f0578005260 2024-04-25T16:00:15.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.213+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0590069bb0 con 0x7f0578005260 2024-04-25T16:00:15.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.213+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f058800ba90 con 0x7f0578005260 2024-04-25T16:00:15.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.213+0000 7f058e7fc640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f057c06f430 0x7f057c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:15.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.213+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f058808fa50 con 0x7f0578005260 2024-04-25T16:00:15.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.213+0000 7f0595134640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f057c06f430 0x7f057c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:15.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.213+0000 7f0595134640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f057c06f430 0x7f057c071940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05901e3b70 tx=0x7f0584008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:15.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.217+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f058805c2a0 con 0x7f0578005260 2024-04-25T16:00:15.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.413+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0590155810 con 0x7f0578005260 2024-04-25T16:00:15.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f058e7fc640 1 -- 172.21.15.87:0/2943631001 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5664 (secure 0 0 0) 0x7f0588064290 con 0x7f0578005260 2024-04-25T16:00:15.417 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:15.417 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:14.390256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:15.417 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 55 2024-04-25T16:00:15.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f057c06f430 msgr2=0x7f057c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f057c06f430 0x7f057c071940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f05901e3b70 tx=0x7f0584008040 comp rx=0 tx=0).stop 2024-04-25T16:00:15.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 msgr2=0x7f0590153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f0590153880 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f058800d7e0 tx=0x7f058800dca0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 shutdown_connections 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f057c06f430 0x7f057c071940 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05901f1570 0x7f059014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05901e3250 0x7f05901f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 --2- 172.21.15.87:0/2943631001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0578005260 0x7f0590153880 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 >> 172.21.15.87:0/2943631001 conn(0x7f059006d780 msgr2=0x7f0590155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 shutdown_connections 2024-04-25T16:00:15.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:15.417+0000 7f0597b99640 1 -- 172.21.15.87:0/2943631001 wait complete. 2024-04-25T16:00:15.438 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T16:00:15.978 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:16.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.133+0000 7f499f9cd640 1 Processor -- start 2024-04-25T16:00:16.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499f9cd640 1 -- start start 2024-04-25T16:00:16.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499f9cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f49981529a0 0x7f4998071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:16.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499f9cd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49980ad990 0x7f49980adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499f9cd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4998072430 con 0x7f49980c41e0 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499f9cd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4998074730 con 0x7f49981529a0 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499f9cd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4998074a10 con 0x7f49980ad990 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499d769640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f49981529a0 0x7f4998071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499df6a640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f49980c41e0 0x7f49980c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41798/0 (socket says 172.21.15.87:41798) 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499df6a640 1 -- 172.21.15.87:0/2004166542 learned_addr learned my addr 172.21.15.87:0/2004166542 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499cf68640 1 --2- 172.21.15.87:0/2004166542 >> v2:172.21.15.155:3300/0 conn(0x7f49980ad990 0x7f49980adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499d769640 1 -- 172.21.15.87:0/2004166542 >> v2:172.21.15.155:3300/0 conn(0x7f49980ad990 msgr2=0x7f49980adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499d769640 1 --2- 172.21.15.87:0/2004166542 >> v2:172.21.15.155:3300/0 conn(0x7f49980ad990 0x7f49980adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499d769640 1 -- 172.21.15.87:0/2004166542 >> v1:172.21.15.87:6789/0 conn(0x7f49980c41e0 legacy=0x7f49980c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499d769640 1 -- 172.21.15.87:0/2004166542 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4998074cf0 con 0x7f49981529a0 2024-04-25T16:00:16.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.137+0000 7f499cf68640 1 --2- 172.21.15.87:0/2004166542 >> v2:172.21.15.155:3300/0 conn(0x7f49980ad990 0x7f49980adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:16.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499d769640 1 --2- 172.21.15.87:0/2004166542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f4998071e50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f49980ae690 tx=0x7f499401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceed458f3b31ad14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:16.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f498ffff640 1 -- 172.21.15.87:0/2004166542 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940b0070 con 0x7f49981529a0 2024-04-25T16:00:16.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f498ffff640 1 -- 172.21.15.87:0/2004166542 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940ab600 con 0x7f49981529a0 2024-04-25T16:00:16.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f498ffff640 1 -- 172.21.15.87:0/2004166542 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940ab9d0 con 0x7f49981529a0 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 -- 172.21.15.87:0/2004166542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 msgr2=0x7f4998071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2004166542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f4998071e50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f49980ae690 tx=0x7f499401c3f0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 -- 172.21.15.87:0/2004166542 shutdown_connections 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2004166542 >> v2:172.21.15.155:3300/0 conn(0x7f49980ad990 0x7f49980adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2004166542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f4998071e50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 -- 172.21.15.87:0/2004166542 >> 172.21.15.87:0/2004166542 conn(0x7f49980c8770 msgr2=0x7f49980c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 -- 172.21.15.87:0/2004166542 shutdown_connections 2024-04-25T16:00:16.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 -- 172.21.15.87:0/2004166542 wait complete. 2024-04-25T16:00:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 Processor -- start 2024-04-25T16:00:16.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.141+0000 7f499f9cd640 1 -- start start 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980ad990 0x7f4998151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980c41e0 0x7f49981f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f49981447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4998162470 con 0x7f49981529a0 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49981622f0 con 0x7f49980ad990 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49981625f0 con 0x7f49980c41e0 2024-04-25T16:00:16.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f49981447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f49981447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34488/0 (socket says 172.21.15.87:34488) 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 -- 172.21.15.87:0/2505648838 learned_addr learned my addr 172.21.15.87:0/2505648838 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499cf68640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980c41e0 0x7f49981f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499d769640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980ad990 0x7f4998151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 -- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980c41e0 msgr2=0x7f49981f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980c41e0 0x7f49981f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 -- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980ad990 msgr2=0x7f4998151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980ad990 0x7f4998151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 -- 172.21.15.87:0/2505648838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4998147580 con 0x7f49981529a0 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499cf68640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980c41e0 0x7f49981f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499df6a640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f49981447a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f499000ca50 tx=0x7f499000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990017070 con 0x7f49981529a0 2024-04-25T16:00:16.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499000ab50 con 0x7f49981529a0 2024-04-25T16:00:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49981f28e0 con 0x7f49981529a0 2024-04-25T16:00:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990012400 con 0x7f49981529a0 2024-04-25T16:00:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49981460b0 con 0x7f49981529a0 2024-04-25T16:00:16.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4998069bb0 con 0x7f49981529a0 2024-04-25T16:00:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f499001a070 con 0x7f49981529a0 2024-04-25T16:00:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.145+0000 7f498dffb640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f497c06f400 0x7f497c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.149+0000 7f499d769640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f497c06f400 0x7f497c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.149+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f499008f8f0 con 0x7f49981529a0 2024-04-25T16:00:16.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.149+0000 7f499d769640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f497c06f400 0x7f497c071910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f49940ad000 tx=0x7f4994008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:16.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.149+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f499005bbe0 con 0x7f49981529a0 2024-04-25T16:00:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49980c3760 con 0x7f49981529a0 2024-04-25T16:00:16.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f498dffb640 1 -- 172.21.15.87:0/2505648838 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5664 (secure 0 0 0) 0x7f499005fee0 con 0x7f49981529a0 2024-04-25T16:00:16.350 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:16.350 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:14.390256+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:16.350 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 55 2024-04-25T16:00:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f497c06f400 msgr2=0x7f497c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f497c06f400 0x7f497c071910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f49940ad000 tx=0x7f4994008040 comp rx=0 tx=0).stop 2024-04-25T16:00:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 msgr2=0x7f49981447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f49981447a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f499000ca50 tx=0x7f499000cf10 comp rx=0 tx=0).stop 2024-04-25T16:00:16.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 shutdown_connections 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f497c06f400 0x7f497c071910 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49981529a0 0x7f49981447a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980c41e0 0x7f49981f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 --2- 172.21.15.87:0/2505648838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980ad990 0x7f4998151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 >> 172.21.15.87:0/2505648838 conn(0x7f49980c8770 msgr2=0x7f499815f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.349+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 shutdown_connections 2024-04-25T16:00:16.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:16.353+0000 7f499f9cd640 1 -- 172.21.15.87:0/2505648838 wait complete. 2024-04-25T16:00:16.372 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:17.439 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:17.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.597+0000 7f333e916640 1 Processor -- start 2024-04-25T16:00:17.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.597+0000 7f333e916640 1 -- start start 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f333e916640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f333815ad90 0x7f33380ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f333e916640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f33380cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f333e916640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33380c7570 con 0x7f3338157380 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f333e916640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f333815b8b0 con 0x7f333815ad90 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f333e916640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f333815b5d0 con 0x7f33380cae60 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f33380cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f33380cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:42716/0 (socket says 172.21.15.87:42716) 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 -- 172.21.15.87:0/1832589169 learned_addr learned my addr 172.21.15.87:0/1832589169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:17.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f3337fff640 1 --2- 172.21.15.87:0/1832589169 >> v2:172.21.15.155:3300/0 conn(0x7f333815ad90 0x7f33380ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 -- 172.21.15.87:0/1832589169 >> v2:172.21.15.155:3300/0 conn(0x7f333815ad90 msgr2=0x7f33380ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 --2- 172.21.15.87:0/1832589169 >> v2:172.21.15.155:3300/0 conn(0x7f333815ad90 0x7f33380ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 -- 172.21.15.87:0/1832589169 >> v1:172.21.15.155:6789/0 conn(0x7f3338157380 legacy=0x7f3338157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f33377fe640 1 -- 172.21.15.87:0/1832589169 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33380c2290 con 0x7f33380cae60 2024-04-25T16:00:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.601+0000 7f3337fff640 1 --2- 172.21.15.87:0/1832589169 >> v2:172.21.15.155:3300/0 conn(0x7f333815ad90 0x7f33380ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:00:17.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f33377fe640 1 --2- 172.21.15.87:0/1832589169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f33380cb270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f332c009870 tx=0x7f332c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99efa53ba0d5e0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f3336ffd640 1 -- 172.21.15.87:0/1832589169 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0b0070 con 0x7f33380cae60 2024-04-25T16:00:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f3336ffd640 1 -- 172.21.15.87:0/1832589169 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c0ab600 con 0x7f33380cae60 2024-04-25T16:00:17.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f3336ffd640 1 -- 172.21.15.87:0/1832589169 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0ab9d0 con 0x7f33380cae60 2024-04-25T16:00:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 -- 172.21.15.87:0/1832589169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 msgr2=0x7f33380cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:17.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 --2- 172.21.15.87:0/1832589169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f33380cb270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f332c009870 tx=0x7f332c01c440 comp rx=0 tx=0).stop 2024-04-25T16:00:17.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 -- 172.21.15.87:0/1832589169 shutdown_connections 2024-04-25T16:00:17.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 --2- 172.21.15.87:0/1832589169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f33380cb270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 --2- 172.21.15.87:0/1832589169 >> v2:172.21.15.155:3300/0 conn(0x7f333815ad90 0x7f33380ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 -- 172.21.15.87:0/1832589169 >> 172.21.15.87:0/1832589169 conn(0x7f33380c9330 msgr2=0x7f33380c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:17.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 -- 172.21.15.87:0/1832589169 shutdown_connections 2024-04-25T16:00:17.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 -- 172.21.15.87:0/1832589169 wait complete. 2024-04-25T16:00:17.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 Processor -- start 2024-04-25T16:00:17.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.605+0000 7f333e916640 1 -- start start 2024-04-25T16:00:17.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f333814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:17.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3338157380 0x7f333814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:17.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 0x7f333814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:17.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f333815b1a0 con 0x7f333815ad90 2024-04-25T16:00:17.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33380ca190 con 0x7f3338157380 2024-04-25T16:00:17.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f333815b320 con 0x7f33380cae60 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 0x7f333814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 0x7f333814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34504/0 (socket says 172.21.15.87:34504) 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 -- 172.21.15.87:0/1964729980 learned_addr learned my addr 172.21.15.87:0/1964729980 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f3337fff640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f333814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f33377fe640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3338157380 0x7f333814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 -- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 msgr2=0x7f333814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f333814ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 -- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3338157380 msgr2=0x7f333814a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3338157380 0x7f333814a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 -- 172.21.15.87:0/1964729980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33381f19f0 con 0x7f333815ad90 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333ceb3640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 0x7f333814a5b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f333000c760 tx=0x7f333000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330003b80 con 0x7f333815ad90 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3330003d20 con 0x7f333815ad90 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33380addd0 con 0x7f333815ad90 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333000aa90 con 0x7f333815ad90 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33381f1710 con 0x7f333815ad90 2024-04-25T16:00:17.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.609+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33381f1500 con 0x7f333815ad90 2024-04-25T16:00:17.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.613+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f333000ac30 con 0x7f333815ad90 2024-04-25T16:00:17.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.613+0000 7f3334ff9640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332406f430 0x7f3324071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:17.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.613+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f333008f680 con 0x7f333815ad90 2024-04-25T16:00:17.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.613+0000 7f3337fff640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332406f430 0x7f3324071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:17.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.613+0000 7f3337fff640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332406f430 0x7f3324071940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3328009580 tx=0x7f3328009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:17.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.617+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f333005b8a0 con 0x7f333815ad90 2024-04-25T16:00:17.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.821+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3338069bb0 con 0x7f333815ad90 2024-04-25T16:00:17.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f3334ff9640 1 -- 172.21.15.87:0/1964729980 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5672 (secure 0 0 0) 0x7f333005fba0 con 0x7f333815ad90 2024-04-25T16:00:17.825 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:17.825 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:17.825 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 57 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332406f430 msgr2=0x7f3324071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332406f430 0x7f3324071940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3328009580 tx=0x7f3328009190 comp rx=0 tx=0).stop 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 msgr2=0x7f333814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 0x7f333814a5b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f333000c760 tx=0x7f333000cc20 comp rx=0 tx=0).stop 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 shutdown_connections 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332406f430 0x7f3324071940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f333815ad90 0x7f333814a5b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3338157380 0x7f333814a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 --2- 172.21.15.87:0/1964729980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33380cae60 0x7f333814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 >> 172.21.15.87:0/1964729980 conn(0x7f33380c9330 msgr2=0x7f33380c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 shutdown_connections 2024-04-25T16:00:17.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:17.825+0000 7f333e916640 1 -- 172.21.15.87:0/1964729980 wait complete. 2024-04-25T16:00:17.848 INFO:tasks.mds_thrash.fs.[a]:mds.b has gained rank=0, replacing gid=5583 2024-04-25T16:00:17.848 INFO:tasks.mds_thrash.fs.[a]:waiting for 3 secs before reviving mds.a 2024-04-25T16:00:18.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 Processor -- start 2024-04-25T16:00:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 -- start start 2024-04-25T16:00:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fecec155320 0x7fecec155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecec074160 0x7fecec074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecec152d90 con 0x7fecec152980 2024-04-25T16:00:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fecec0aa290 con 0x7fecec074160 2024-04-25T16:00:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf34ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fecec1598b0 con 0x7fecec155320 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecec074160 0x7fecec074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecec074160 0x7fecec074570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34518/0 (socket says 172.21.15.87:34518) 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 -- 172.21.15.87:0/808911647 learned_addr learned my addr 172.21.15.87:0/808911647 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf0a47640 1 --2- 172.21.15.87:0/808911647 >> v2:172.21.15.155:3300/0 conn(0x7fecec155320 0x7fecec155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 -- 172.21.15.87:0/808911647 >> v2:172.21.15.155:3300/0 conn(0x7fecec155320 msgr2=0x7fecec155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 --2- 172.21.15.87:0/808911647 >> v2:172.21.15.155:3300/0 conn(0x7fecec155320 0x7fecec155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 -- 172.21.15.87:0/808911647 >> v1:172.21.15.155:6789/0 conn(0x7fecec152980 legacy=0x7fecec0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.537+0000 7fecf1a49640 1 -- 172.21.15.87:0/808911647 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec0a9cd0 con 0x7fecec074160 2024-04-25T16:00:18.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf1a49640 1 --2- 172.21.15.87:0/808911647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec074570 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fecec069a50 tx=0x7fece401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3b9304ef746e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fece3fff640 1 -- 172.21.15.87:0/808911647 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40b0070 con 0x7fecec074160 2024-04-25T16:00:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fece3fff640 1 -- 172.21.15.87:0/808911647 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece40ab600 con 0x7fecec074160 2024-04-25T16:00:18.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fece3fff640 1 -- 172.21.15.87:0/808911647 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40ab9d0 con 0x7fecec074160 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 -- 172.21.15.87:0/808911647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 msgr2=0x7fecec074570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 --2- 172.21.15.87:0/808911647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec074570 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fecec069a50 tx=0x7fece401c450 comp rx=0 tx=0).stop 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 -- 172.21.15.87:0/808911647 shutdown_connections 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 --2- 172.21.15.87:0/808911647 >> v2:172.21.15.155:3300/0 conn(0x7fecec155320 0x7fecec155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 --2- 172.21.15.87:0/808911647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec074570 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 -- 172.21.15.87:0/808911647 >> 172.21.15.87:0/808911647 conn(0x7fecec0ac550 msgr2=0x7fecec0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 -- 172.21.15.87:0/808911647 shutdown_connections 2024-04-25T16:00:18.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.541+0000 7fecf34ac640 1 -- 172.21.15.87:0/808911647 wait complete. 2024-04-25T16:00:18.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 Processor -- start 2024-04-25T16:00:18.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 -- start start 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecec152980 0x7fecec1f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecec155320 0x7fecec15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fecec0729c0 con 0x7fecec074160 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fecec158f70 con 0x7fecec152980 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fecec072b40 con 0x7fecec155320 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34528/0 (socket says 172.21.15.87:34528) 2024-04-25T16:00:18.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 -- 172.21.15.87:0/332957578 learned_addr learned my addr 172.21.15.87:0/332957578 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1a49640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecec155320 0x7fecec15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf0a47640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecec152980 0x7fecec1f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 -- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecec155320 msgr2=0x7fecec15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecec155320 0x7fecec15e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 -- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecec152980 msgr2=0x7fecec1f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecec152980 0x7fecec1f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 -- 172.21.15.87:0/332957578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec1472c0 con 0x7fecec074160 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf0a47640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecec152980 0x7fecec1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf1248640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec146d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fece800ba50 tx=0x7fece800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8019070 con 0x7fecec074160 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece800cc20 con 0x7fecec074160 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec14fc70 con 0x7fecec074160 2024-04-25T16:00:18.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8014440 con 0x7fecec074160 2024-04-25T16:00:18.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.545+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec150230 con 0x7fecec074160 2024-04-25T16:00:18.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.549+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecec069bb0 con 0x7fecec074160 2024-04-25T16:00:18.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.549+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fece801c070 con 0x7fecec074160 2024-04-25T16:00:18.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.549+0000 7fece1ffb640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fecd006f400 0x7fecd0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:18.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.549+0000 7fecf0a47640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fecd006f400 0x7fecd0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:18.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.549+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7fece808f540 con 0x7fecec074160 2024-04-25T16:00:18.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.549+0000 7fecf0a47640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fecd006f400 0x7fecd0071910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecec155bb0 tx=0x7fecdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:18.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.553+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fece805b870 con 0x7fecec074160 2024-04-25T16:00:18.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.777+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecec0c9b90 con 0x7fecec074160 2024-04-25T16:00:18.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.777+0000 7fece1ffb640 1 -- 172.21.15.87:0/332957578 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5672 (secure 0 0 0) 0x7fece805fb70 con 0x7fecec074160 2024-04-25T16:00:18.780 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:18.780 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:18.781 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 57 2024-04-25T16:00:18.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fecd006f400 msgr2=0x7fecd0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:18.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fecd006f400 0x7fecd0071910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecec155bb0 tx=0x7fecdc008040 comp rx=0 tx=0).stop 2024-04-25T16:00:18.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 msgr2=0x7fecec146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:18.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec146d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fece800ba50 tx=0x7fece800bf10 comp rx=0 tx=0).stop 2024-04-25T16:00:18.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 shutdown_connections 2024-04-25T16:00:18.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fecd006f400 0x7fecd0071910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fecec155320 0x7fecec15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecec152980 0x7fecec1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 --2- 172.21.15.87:0/332957578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecec074160 0x7fecec146d80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:18.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 >> 172.21.15.87:0/332957578 conn(0x7fecec0ac550 msgr2=0x7fecec153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:18.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 shutdown_connections 2024-04-25T16:00:18.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:18.781+0000 7fecf34ac640 1 -- 172.21.15.87:0/332957578 wait complete. 2024-04-25T16:00:18.803 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:19.579 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-04-25T16:00:19.577+0000 7fbc71e50640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T16:00:20.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:20.848 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-04-25T16:00:20.848 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T16:00:20.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T16:00:20.851 INFO:tasks.ceph.mds.a:Started 2024-04-25T16:00:20.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:20.952 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-04-25T16:00:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 Processor -- start 2024-04-25T16:00:20.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 -- start start 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb1ec15ac30 0x7fb1ec15b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb1ec15b580 0x7fb1ec161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec0c5120 con 0x7fb1ec0c4250 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec0c3b20 con 0x7fb1ec15b580 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1f0ebf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec070e20 con 0x7fb1ec15ac30 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ea59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb1ec0c4250 0x7fb1ec06ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51646/0 (socket says 172.21.15.87:51646) 2024-04-25T16:00:20.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ea59c640 1 -- 172.21.15.87:0/1340447906 learned_addr learned my addr 172.21.15.87:0/1340447906 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ead9d640 1 --2- 172.21.15.87:0/1340447906 >> v2:172.21.15.87:3300/0 conn(0x7fb1ec15b580 0x7fb1ec161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1e9d9b640 1 --2- 172.21.15.87:0/1340447906 >> v2:172.21.15.155:3300/0 conn(0x7fb1ec15ac30 0x7fb1ec15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1e959a640 1 -- 172.21.15.87:0/1340447906 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715782484 0 0) 0x7fb1dc001120 con 0x7fb1ec0c4250 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1e959a640 1 -- 172.21.15.87:0/1340447906 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d4003530 con 0x7fb1ec0c4250 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ead9d640 1 -- 172.21.15.87:0/1340447906 >> v2:172.21.15.155:3300/0 conn(0x7fb1ec15ac30 msgr2=0x7fb1ec15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ead9d640 1 --2- 172.21.15.87:0/1340447906 >> v2:172.21.15.155:3300/0 conn(0x7fb1ec15ac30 0x7fb1ec15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ead9d640 1 -- 172.21.15.87:0/1340447906 >> v1:172.21.15.87:6789/0 conn(0x7fb1ec0c4250 legacy=0x7fb1ec06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:20.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.969+0000 7fb1ead9d640 1 -- 172.21.15.87:0/1340447906 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec0c4b60 con 0x7fb1ec15b580 2024-04-25T16:00:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.973+0000 7fb1ead9d640 1 --2- 172.21.15.87:0/1340447906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15b580 0x7fb1ec161e60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0c5d30 tx=0x7fb1e401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe6f9db4aa0e482 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.973+0000 7fb1e959a640 1 -- 172.21.15.87:0/1340447906 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40b2070 con 0x7fb1ec15b580 2024-04-25T16:00:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.973+0000 7fb1e959a640 1 -- 172.21.15.87:0/1340447906 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e40a5850 con 0x7fb1ec15b580 2024-04-25T16:00:20.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.973+0000 7fb1e959a640 1 -- 172.21.15.87:0/1340447906 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40a5c00 con 0x7fb1ec15b580 2024-04-25T16:00:20.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/1340447906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15b580 msgr2=0x7fb1ec161e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/1340447906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15b580 0x7fb1ec161e60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0c5d30 tx=0x7fb1e401c8a0 comp rx=0 tx=0).stop 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/1340447906 shutdown_connections 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/1340447906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15b580 0x7fb1ec161e60 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/1340447906 >> v2:172.21.15.155:3300/0 conn(0x7fb1ec15ac30 0x7fb1ec15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/1340447906 >> 172.21.15.87:0/1340447906 conn(0x7fb1ec06d780 msgr2=0x7fb1ec06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/1340447906 shutdown_connections 2024-04-25T16:00:20.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/1340447906 wait complete. 2024-04-25T16:00:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 Processor -- start 2024-04-25T16:00:20.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- start start 2024-04-25T16:00:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1ec0c4250 0x7fb1ec0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 0x7fb1ec157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1ec15b580 0x7fb1ec14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:20.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0c47e0 con 0x7fb1ec15ac30 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec0c4660 con 0x7fb1ec15b580 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1f0ebf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec155100 con 0x7fb1ec0c4250 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1e9d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 0x7fb1ec157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1e9d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 0x7fb1ec157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59116/0 (socket says 172.21.15.87:59116) 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1e9d9b640 1 -- 172.21.15.87:0/832315217 learned_addr learned my addr 172.21.15.87:0/832315217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1ea59c640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1ec0c4250 0x7fb1ec0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.977+0000 7fb1ead9d640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1ec15b580 0x7fb1ec14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1e9d9b640 1 -- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1ec0c4250 msgr2=0x7fb1ec0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1e9d9b640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1ec0c4250 0x7fb1ec0c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1e9d9b640 1 -- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1ec15b580 msgr2=0x7fb1ec14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1e9d9b640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1ec15b580 0x7fb1ec14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:20.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1e9d9b640 1 -- 172.21.15.87:0/832315217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec1f4bf0 con 0x7fb1ec15ac30 2024-04-25T16:00:20.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1e9d9b640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 0x7fb1ec157490 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000d620 tx=0x7fb1e000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:20.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000b620 con 0x7fb1ec15ac30 2024-04-25T16:00:20.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0019070 con 0x7fb1ec15ac30 2024-04-25T16:00:20.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec1f4e90 con 0x7fb1ec15ac30 2024-04-25T16:00:20.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000b9e0 con 0x7fb1ec15ac30 2024-04-25T16:00:20.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec156c90 con 0x7fb1ec15ac30 2024-04-25T16:00:20.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d00052a0 con 0x7fb1ec15ac30 2024-04-25T16:00:20.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb1e000bb80 con 0x7fb1ec15ac30 2024-04-25T16:00:20.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1daffd640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb1cc06f400 0x7fb1cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:20.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7fb1e008fc80 con 0x7fb1ec15ac30 2024-04-25T16:00:20.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1ea59c640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb1cc06f400 0x7fb1cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:20.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.981+0000 7fb1ea59c640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb1cc06f400 0x7fb1cc071910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc005890 tx=0x7fb1dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:20.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:20.989+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb1ec1f4bf0 con 0x7fb1ec15ac30 2024-04-25T16:00:21.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.001+0000 7f891c12e640 1 Processor -- start 2024-04-25T16:00:21.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.001+0000 7f891c12e640 1 -- start start 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f891c12e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8914152980 0x7f89140c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f891c12e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914155320 0x7f8914155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f891c12e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8914152d90 con 0x7f8914074160 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f891c12e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f89140aa290 con 0x7f8914152980 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f891c12e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89141598b0 con 0x7f8914155320 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f8919eca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8914152980 0x7f89140c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f89196c9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914155320 0x7f8914155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f8919eca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8914152980 0x7f89140c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:42354/0 (socket says 172.21.15.87:42354) 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f891a6cb640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8914074160 0x7f89140c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:40182/0 (socket says 172.21.15.87:40182) 2024-04-25T16:00:21.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f8919eca640 1 -- 172.21.15.87:0/2875241401 learned_addr learned my addr 172.21.15.87:0/2875241401 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f89196c9640 1 -- 172.21.15.87:0/2875241401 >> v2:172.21.15.155:3300/0 conn(0x7f8914152980 msgr2=0x7f89140c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f89196c9640 1 --2- 172.21.15.87:0/2875241401 >> v2:172.21.15.155:3300/0 conn(0x7f8914152980 0x7f89140c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f89196c9640 1 -- 172.21.15.87:0/2875241401 >> v1:172.21.15.155:6789/0 conn(0x7f8914074160 legacy=0x7f89140c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f89196c9640 1 -- 172.21.15.87:0/2875241401 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89140ca2f0 con 0x7f8914155320 2024-04-25T16:00:21.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.005+0000 7f89196c9640 1 --2- 172.21.15.87:0/2875241401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914155320 0x7f8914155730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89040097c0 tx=0x7f890401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf0f6a241dd8552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:21.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f8918ec8640 1 -- 172.21.15.87:0/2875241401 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040b0070 con 0x7f8914155320 2024-04-25T16:00:21.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f8918ec8640 1 -- 172.21.15.87:0/2875241401 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89040ab600 con 0x7f8914155320 2024-04-25T16:00:21.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f8918ec8640 1 -- 172.21.15.87:0/2875241401 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040ab9d0 con 0x7f8914155320 2024-04-25T16:00:21.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 -- 172.21.15.87:0/2875241401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914155320 msgr2=0x7f8914155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 --2- 172.21.15.87:0/2875241401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914155320 0x7f8914155730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89040097c0 tx=0x7f890401c410 comp rx=0 tx=0).stop 2024-04-25T16:00:21.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 -- 172.21.15.87:0/2875241401 shutdown_connections 2024-04-25T16:00:21.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 --2- 172.21.15.87:0/2875241401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914155320 0x7f8914155730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 --2- 172.21.15.87:0/2875241401 >> v2:172.21.15.155:3300/0 conn(0x7f8914152980 0x7f89140c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 -- 172.21.15.87:0/2875241401 >> 172.21.15.87:0/2875241401 conn(0x7f89140ac550 msgr2=0x7f89140ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:21.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 -- 172.21.15.87:0/2875241401 shutdown_connections 2024-04-25T16:00:21.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 -- 172.21.15.87:0/2875241401 wait complete. 2024-04-25T16:00:21.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 Processor -- start 2024-04-25T16:00:21.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.009+0000 7f891c12e640 1 -- start start 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 0x7f891414c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914152980 0x7f891414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8914155320 0x7f891414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8914158f70 con 0x7f8914074160 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8914158c90 con 0x7f8914155320 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89140729c0 con 0x7f8914152980 2024-04-25T16:00:21.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 0x7f891414c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 0x7f891414c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59122/0 (socket says 172.21.15.87:59122) 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 -- 172.21.15.87:0/1888594159 learned_addr learned my addr 172.21.15.87:0/1888594159 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 -- 172.21.15.87:0/1888594159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914152980 msgr2=0x7f891414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914152980 0x7f891414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 -- 172.21.15.87:0/1888594159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8914155320 msgr2=0x7f891414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8914155320 0x7f891414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 -- 172.21.15.87:0/1888594159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891415ebc0 con 0x7f8914074160 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f8919eca640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 0x7f891414c0e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f891000e7f0 tx=0x7f891000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910017070 con 0x7f8914074160 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891000c940 con 0x7f8914074160 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891415eea0 con 0x7f8914074160 2024-04-25T16:00:21.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000cd30 con 0x7f8914074160 2024-04-25T16:00:21.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891414e3b0 con 0x7f8914074160 2024-04-25T16:00:21.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8914069bb0 con 0x7f8914074160 2024-04-25T16:00:21.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f891001a070 con 0x7f8914074160 2024-04-25T16:00:21.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f890a7fc640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f88f806f430 0x7f88f8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:21.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f891008fc60 con 0x7f8914074160 2024-04-25T16:00:21.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.013+0000 7f89196c9640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f88f806f430 0x7f88f8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:21.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.017+0000 7f89196c9640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f88f806f430 0x7f88f8071940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f89040ad000 tx=0x7f8904004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:21.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.021+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f891005c440 con 0x7f8914074160 2024-04-25T16:00:21.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.197+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1d0005860 con 0x7fb1ec15ac30 2024-04-25T16:00:21.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1daffd640 1 -- 172.21.15.87:0/832315217 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5672 (secure 0 0 0) 0x7fb1e005c600 con 0x7fb1ec15ac30 2024-04-25T16:00:21.201 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:21.201 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 57 2024-04-25T16:00:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb1cc06f400 msgr2=0x7fb1cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb1cc06f400 0x7fb1cc071910 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc005890 tx=0x7fb1dc009040 comp rx=0 tx=0).stop 2024-04-25T16:00:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 msgr2=0x7fb1ec157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 0x7fb1ec157490 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000d620 tx=0x7fb1e000dae0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 shutdown_connections 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb1cc06f400 0x7fb1cc071910 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1ec15b580 0x7fb1ec14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1ec15ac30 0x7fb1ec157490 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 --2- 172.21.15.87:0/832315217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1ec0c4250 0x7fb1ec0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 >> 172.21.15.87:0/832315217 conn(0x7fb1ec06d780 msgr2=0x7fb1ec06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 shutdown_connections 2024-04-25T16:00:21.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.201+0000 7fb1f0ebf640 1 -- 172.21.15.87:0/832315217 wait complete. 2024-04-25T16:00:21.225 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:21.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.233+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f891415f8e0 con 0x7f8914074160 2024-04-25T16:00:21.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f890a7fc640 1 -- 172.21.15.87:0/1888594159 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5672 (secure 0 0 0) 0x7f891005bd40 con 0x7f8914074160 2024-04-25T16:00:21.236 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 57 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f88f806f430 msgr2=0x7f88f8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f88f806f430 0x7f88f8071940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f89040ad000 tx=0x7f8904004740 comp rx=0 tx=0).stop 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 msgr2=0x7f891414c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 0x7f891414c0e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f891000e7f0 tx=0x7f891000ecb0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 shutdown_connections 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f88f806f430 0x7f88f8071940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8914155320 0x7f891414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8914152980 0x7f891414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 --2- 172.21.15.87:0/1888594159 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8914074160 0x7f891414c0e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 >> 172.21.15.87:0/1888594159 conn(0x7f89140ac550 msgr2=0x7f89140ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 shutdown_connections 2024-04-25T16:00:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:21.237+0000 7f891c12e640 1 -- 172.21.15.87:0/1888594159 wait complete. 2024-04-25T16:00:21.257 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-04-25T16:00:23.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:23.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:23.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.393+0000 7f506a6f4640 1 Processor -- start 2024-04-25T16:00:23.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.393+0000 7f506a6f4640 1 -- start start 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f506a6f4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50641517d0 0x7f50640c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f506a6f4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5064157fc0 0x7f506415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f506a6f4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50640c5290 con 0x7f50640c9ae0 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f506a6f4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f50640c5e80 con 0x7f5064157fc0 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f506a6f4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5064154fd0 con 0x7f50641517d0 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5068c91640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5064157fc0 0x7f506415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f50637fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f50640c9ae0 0x7f50641578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51658/0 (socket says 172.21.15.87:51658) 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f50637fe640 1 -- 172.21.15.87:0/1670984120 learned_addr learned my addr 172.21.15.87:0/1670984120 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5068c91640 1 -- 172.21.15.87:0/1670984120 >> v2:172.21.15.155:3300/0 conn(0x7f50641517d0 msgr2=0x7f50640c95a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5068c91640 1 --2- 172.21.15.87:0/1670984120 >> v2:172.21.15.155:3300/0 conn(0x7f50641517d0 0x7f50640c95a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5068c91640 1 -- 172.21.15.87:0/1670984120 >> v1:172.21.15.87:6789/0 conn(0x7f50640c9ae0 legacy=0x7f50641578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5068c91640 1 -- 172.21.15.87:0/1670984120 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50640c5550 con 0x7f5064157fc0 2024-04-25T16:00:23.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5062ffd640 1 -- 172.21.15.87:0/1670984120 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213703684 0 0) 0x7f50640c5290 con 0x7f50640c9ae0 2024-04-25T16:00:23.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5068c91640 1 --2- 172.21.15.87:0/1670984120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f506415ea90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5064071020 tx=0x7f505c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e344a401d48817 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:23.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5062ffd640 1 -- 172.21.15.87:0/1670984120 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c00b2d0 con 0x7f5064157fc0 2024-04-25T16:00:23.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5062ffd640 1 -- 172.21.15.87:0/1670984120 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505c0a7810 con 0x7f5064157fc0 2024-04-25T16:00:23.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.397+0000 7f5062ffd640 1 -- 172.21.15.87:0/1670984120 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c0a7be0 con 0x7f5064157fc0 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- 172.21.15.87:0/1670984120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 msgr2=0x7f506415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 --2- 172.21.15.87:0/1670984120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f506415ea90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5064071020 tx=0x7f505c01eb50 comp rx=0 tx=0).stop 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- 172.21.15.87:0/1670984120 shutdown_connections 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 --2- 172.21.15.87:0/1670984120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f506415ea90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 --2- 172.21.15.87:0/1670984120 >> v2:172.21.15.155:3300/0 conn(0x7f50641517d0 0x7f50640c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- 172.21.15.87:0/1670984120 >> 172.21.15.87:0/1670984120 conn(0x7f506406d780 msgr2=0x7f506406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- 172.21.15.87:0/1670984120 shutdown_connections 2024-04-25T16:00:23.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- 172.21.15.87:0/1670984120 wait complete. 2024-04-25T16:00:23.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 Processor -- start 2024-04-25T16:00:23.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- start start 2024-04-25T16:00:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640c9ae0 0x7f5064156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641517d0 0x7f50641effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f50641f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5064158550 con 0x7f5064157fc0 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50641583d0 con 0x7f50640c9ae0 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.401+0000 7f506a6f4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50640a8f70 con 0x7f50641517d0 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f50641f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f50641f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59142/0 (socket says 172.21.15.87:59142) 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 -- 172.21.15.87:0/2332482520 learned_addr learned my addr 172.21.15.87:0/2332482520 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f50637fe640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641517d0 0x7f50641effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5063fff640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640c9ae0 0x7f5064156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 -- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641517d0 msgr2=0x7f50641effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641517d0 0x7f50641effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 -- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640c9ae0 msgr2=0x7f5064156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640c9ae0 0x7f5064156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 -- 172.21.15.87:0/2332482520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5064150650 con 0x7f5064157fc0 2024-04-25T16:00:23.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5068c91640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f50641f0510 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f505c025140 tx=0x7f505c01b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c009740 con 0x7f5064157fc0 2024-04-25T16:00:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505c0c0070 con 0x7f5064157fc0 2024-04-25T16:00:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50641f0af0 con 0x7f5064157fc0 2024-04-25T16:00:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5064150370 con 0x7f5064157fc0 2024-04-25T16:00:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c009b20 con 0x7f5064157fc0 2024-04-25T16:00:23.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5064069bb0 con 0x7f5064157fc0 2024-04-25T16:00:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.405+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f505c009cc0 con 0x7f5064157fc0 2024-04-25T16:00:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.409+0000 7f5060ff9640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.409+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7f505c12cbe0 con 0x7f5064157fc0 2024-04-25T16:00:23.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.409+0000 7f5063fff640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.409+0000 7f5063fff640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50640c3c00 tx=0x7f5054008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:23.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.413+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5064150650 con 0x7f5064157fc0 2024-04-25T16:00:23.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.417+0000 7fe48aec6640 1 Processor -- start 2024-04-25T16:00:23.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.417+0000 7fe48aec6640 1 -- start start 2024-04-25T16:00:23.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe48aec6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe48415ad90 0x7fe4840ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe48aec6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe4840cb270 0x7fe484157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe48aec6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4840c7570 con 0x7fe4840cae60 2024-04-25T16:00:23.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe48aec6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe48415b8b0 con 0x7fe48415ad90 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe48aec6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe48415b5d0 con 0x7fe4840cb270 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe48415ad90 0x7fe4840ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe48415ad90 0x7fe4840ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59156/0 (socket says 172.21.15.87:59156) 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 -- 172.21.15.87:0/4216933864 learned_addr learned my addr 172.21.15.87:0/4216933864 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe489463640 1 --2- 172.21.15.87:0/4216933864 >> v2:172.21.15.155:3300/0 conn(0x7fe4840cb270 0x7fe484157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 -- 172.21.15.87:0/4216933864 >> v2:172.21.15.155:3300/0 conn(0x7fe4840cb270 msgr2=0x7fe484157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 --2- 172.21.15.87:0/4216933864 >> v2:172.21.15.155:3300/0 conn(0x7fe4840cb270 0x7fe484157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 -- 172.21.15.87:0/4216933864 >> v1:172.21.15.155:6789/0 conn(0x7fe4840cae60 legacy=0x7fe484157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:23.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 -- 172.21.15.87:0/4216933864 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4840c2290 con 0x7fe48415ad90 2024-04-25T16:00:23.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe488c62640 1 --2- 172.21.15.87:0/4216933864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe48415ad90 0x7fe4840ca920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe4840c7470 tx=0x7fe47801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88a0f7c3dd89e18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:23.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe4837fe640 1 -- 172.21.15.87:0/4216933864 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4780b0070 con 0x7fe48415ad90 2024-04-25T16:00:23.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe4837fe640 1 -- 172.21.15.87:0/4216933864 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4780ab600 con 0x7fe48415ad90 2024-04-25T16:00:23.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.421+0000 7fe4837fe640 1 -- 172.21.15.87:0/4216933864 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4780ab9d0 con 0x7fe48415ad90 2024-04-25T16:00:23.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- 172.21.15.87:0/4216933864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe48415ad90 msgr2=0x7fe4840ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 --2- 172.21.15.87:0/4216933864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe48415ad90 0x7fe4840ca920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe4840c7470 tx=0x7fe47801c400 comp rx=0 tx=0).stop 2024-04-25T16:00:23.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- 172.21.15.87:0/4216933864 shutdown_connections 2024-04-25T16:00:23.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 --2- 172.21.15.87:0/4216933864 >> v2:172.21.15.155:3300/0 conn(0x7fe4840cb270 0x7fe484157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 --2- 172.21.15.87:0/4216933864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe48415ad90 0x7fe4840ca920 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- 172.21.15.87:0/4216933864 >> 172.21.15.87:0/4216933864 conn(0x7fe4840c9330 msgr2=0x7fe4840c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:23.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- 172.21.15.87:0/4216933864 shutdown_connections 2024-04-25T16:00:23.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- 172.21.15.87:0/4216933864 wait complete. 2024-04-25T16:00:23.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 Processor -- start 2024-04-25T16:00:23.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- start start 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 0x7fe4840cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4840cb270 0x7fe4841519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe48415ad90 0x7fe4840b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe48415b1a0 con 0x7fe4840cae60 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840ca190 con 0x7fe48415ad90 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe48aec6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe48415b320 con 0x7fe4840cb270 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 0x7fe4840cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 0x7fe4840cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59164/0 (socket says 172.21.15.87:59164) 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 -- 172.21.15.87:0/3637040969 learned_addr learned my addr 172.21.15.87:0/3637040969 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe483fff640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4840cb270 0x7fe4841519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe489463640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe48415ad90 0x7fe4840b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 -- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4840cb270 msgr2=0x7fe4841519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4840cb270 0x7fe4841519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 -- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe48415ad90 msgr2=0x7fe4840b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe48415ad90 0x7fe4840b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.425+0000 7fe488c62640 1 -- 172.21.15.87:0/3637040969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4841507e0 con 0x7fe4840cae60 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe488c62640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 0x7fe4840cb850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe4780ae040 tx=0x7fe4780191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4780b9070 con 0x7fe4840cae60 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4780b4600 con 0x7fe4840cae60 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4840af860 con 0x7fe4840cae60 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4780b0040 con 0x7fe4840cae60 2024-04-25T16:00:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe484150fc0 con 0x7fe4840cae60 2024-04-25T16:00:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe484069bb0 con 0x7fe4840cae60 2024-04-25T16:00:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe4780bc070 con 0x7fe4840cae60 2024-04-25T16:00:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe4817fa640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe46806f430 0x7fe468071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe483fff640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe46806f430 0x7fe468071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:23.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7383+0+0 (secure 0 0 0) 0x7fe478128af0 con 0x7fe4840cae60 2024-04-25T16:00:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.429+0000 7fe483fff640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe46806f430 0x7fe468071940 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe484157580 tx=0x7fe470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:23.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.437+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe478016110 con 0x7fe4840cae60 2024-04-25T16:00:23.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.649+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50640ca2e0 con 0x7f5064157fc0 2024-04-25T16:00:23.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f5060ff9640 1 -- 172.21.15.87:0/2332482520 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+6497 (secure 0 0 0) 0x7f505c018740 con 0x7f5064157fc0 2024-04-25T16:00:23.652 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:23.653 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:23.653 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 58 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 msgr2=0x7f5050071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50640c3c00 tx=0x7f5054008040 comp rx=0 tx=0).stop 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 msgr2=0x7f50641f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f50641f0510 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f505c025140 tx=0x7f505c01b8f0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 shutdown_connections 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5064157fc0 0x7f50641f0510 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641517d0 0x7f50641effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 --2- 172.21.15.87:0/2332482520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640c9ae0 0x7f5064156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 >> 172.21.15.87:0/2332482520 conn(0x7f506406d780 msgr2=0x7f5064143840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:23.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 shutdown_connections 2024-04-25T16:00:23.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.653+0000 7f506a6f4640 1 -- 172.21.15.87:0/2332482520 wait complete. 2024-04-25T16:00:23.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.665+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4840c7760 con 0x7fe4840cae60 2024-04-25T16:00:23.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.665+0000 7fe4817fa640 1 -- 172.21.15.87:0/3637040969 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+6497 (secure 0 0 0) 0x7fe4780f53e0 con 0x7fe4840cae60 2024-04-25T16:00:23.667 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:23.667 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48},{"gid":5946,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T15:59:43.498413+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5140":{"gid":5140,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":24,"addr":"172.21.15.87:6837/2477874160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2477874160},{"type":"v1","addr":"172.21.15.87:6837","nonce":2477874160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5140,"qdb_cluster":[5140]},"id":2}]} 2024-04-25T16:00:23.667 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 58 2024-04-25T16:00:23.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe46806f430 msgr2=0x7fe468071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe46806f430 0x7fe468071940 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe484157580 tx=0x7fe470009040 comp rx=0 tx=0).stop 2024-04-25T16:00:23.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 msgr2=0x7fe4840cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:23.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 0x7fe4840cb850 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe4780ae040 tx=0x7fe4780191a0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 shutdown_connections 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe46806f430 0x7fe468071940 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe48415ad90 0x7fe4840b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4840cb270 0x7fe4841519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 --2- 172.21.15.87:0/3637040969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4840cae60 0x7fe4840cb850 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 >> 172.21.15.87:0/3637040969 conn(0x7fe4840c9330 msgr2=0x7fe48406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 shutdown_connections 2024-04-25T16:00:23.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:23.669+0000 7fe48aec6640 1 -- 172.21.15.87:0/3637040969 wait complete. 2024-04-25T16:00:23.675 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:00:23.689 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-04-25T16:00:23.689 INFO:tasks.mds_thrash.fs.[a]:waiting for 2 secs before thrashing 2024-04-25T16:00:24.195 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T16:00:24.195 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T16:00:24.555 DEBUG:teuthology.parallel:result is None 2024-04-25T16:00:24.556 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T16:00:24.586 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T16:00:24.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T16:00:25.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:25.690 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:25.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cfb76640 1 Processor -- start 2024-04-25T16:00:25.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cfb76640 1 -- start start 2024-04-25T16:00:25.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cfb76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 0x7f33c806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cfb76640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c80c5120 con 0x7f33c815b340 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cfb76640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c80c4b60 con 0x7f33c8070490 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cfb76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33c80c3b20 con 0x7f33c80c4250 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33ce113640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f33c815b340 0x7f33c8161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51668/0 (socket says 172.21.15.87:51668) 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33ce113640 1 -- 172.21.15.87:0/1718721436 learned_addr learned my addr 172.21.15.87:0/1718721436 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cd912640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 0x7f33c806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704222549 0 0) 0x7f33c00014a0 con 0x7f33c815b340 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b4003530 con 0x7f33c815b340 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949981297 0 0) 0x7f33b4003530 con 0x7f33c815b340 2024-04-25T16:00:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 msgr2=0x7f33c806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 0x7f33c806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 >> v1:172.21.15.155:6789/0 conn(0x7f33c8070490 legacy=0x7f33c815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c80c4e40 con 0x7f33c815b340 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.829+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f33c0001bd0 con 0x7f33c815b340 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 >> v1:172.21.15.87:6789/0 conn(0x7f33c815b340 legacy=0x7f33c8161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b40039f0 0x7f33b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b4004810 0x7f33b4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 0x7f33b40052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f33b400bb60 con 0x7f33b4004810 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33b400bd10 con 0x7f33b40039f0 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33b400bf10 con 0x7f33c80c4250 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b4004810 0x7f33b4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd912640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b40039f0 0x7f33b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33ce113640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 0x7f33b40052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 -- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 msgr2=0x7f33b40052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:25.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c80c4250 0x7f33b40052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 -- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b40039f0 msgr2=0x7f33b4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:25.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b40039f0 0x7f33b4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 -- 172.21.15.87:0/1718721436 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b4003530 con 0x7f33b4004810 2024-04-25T16:00:25.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cd111640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b4004810 0x7f33b4004c20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f33c80c5d30 tx=0x7f33b801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2f355ce1f671af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:25.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80013a0 con 0x7f33b4004810 2024-04-25T16:00:25.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b80052f0 con 0x7f33b4004810 2024-04-25T16:00:25.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.833+0000 7f33cc910640 1 -- 172.21.15.87:0/1718721436 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8003840 con 0x7f33b4004810 2024-04-25T16:00:25.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- 172.21.15.87:0/1718721436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b4004810 msgr2=0x7f33b4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1718721436 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33b4004810 0x7f33b4004c20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f33c80c5d30 tx=0x7f33b801c380 comp rx=0 tx=0).stop 2024-04-25T16:00:25.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33ce113640 1 -- 172.21.15.87:0/1718721436 reap_dead start 2024-04-25T16:00:25.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- 172.21.15.87:0/1718721436 shutdown_connections 2024-04-25T16:00:25.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- 172.21.15.87:0/1718721436 >> 172.21.15.87:0/1718721436 conn(0x7f33c806d780 msgr2=0x7f33c806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:25.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- 172.21.15.87:0/1718721436 shutdown_connections 2024-04-25T16:00:25.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- 172.21.15.87:0/1718721436 wait complete. 2024-04-25T16:00:25.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 Processor -- start 2024-04-25T16:00:25.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- start start 2024-04-25T16:00:25.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b4004810 0x7f33c814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 0x7f33c81f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c815a280 0x7f33c81475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f33c8155280 con 0x7f33c8158fe0 2024-04-25T16:00:25.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33c8155100 con 0x7f33b4004810 2024-04-25T16:00:25.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cfb76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33c8163d90 con 0x7f33c815a280 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 0x7f33c81f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 0x7f33c81f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59186/0 (socket says 172.21.15.87:59186) 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 -- 172.21.15.87:0/1410219995 learned_addr learned my addr 172.21.15.87:0/1410219995 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33ce113640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c815a280 0x7f33c81475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd912640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b4004810 0x7f33c814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 -- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c815a280 msgr2=0x7f33c81475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c815a280 0x7f33c81475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 -- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b4004810 msgr2=0x7f33c814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b4004810 0x7f33c814fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 -- 172.21.15.87:0/1410219995 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c80ade10 con 0x7f33c8158fe0 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.837+0000 7f33cd111640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 0x7f33c81f1d20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f33b801c860 tx=0x7f33b4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8007a40 con 0x7f33c8158fe0 2024-04-25T16:00:25.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b80bb070 con 0x7f33c8158fe0 2024-04-25T16:00:25.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c80ae0f0 con 0x7f33c8158fe0 2024-04-25T16:00:25.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80013a0 con 0x7f33c8158fe0 2024-04-25T16:00:25.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c8158ac0 con 0x7f33c8158fe0 2024-04-25T16:00:25.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c80adb80 con 0x7f33c8158fe0 2024-04-25T16:00:25.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f33b80b4040 con 0x7f33c8158fe0 2024-04-25T16:00:25.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33be7fc640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ac06f430 0x7f33ac071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33cd912640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ac06f430 0x7f33ac071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f33b8129a60 con 0x7f33c8158fe0 2024-04-25T16:00:25.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.841+0000 7f33cd912640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ac06f430 0x7f33ac071940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f33c80721c0 tx=0x7f33c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:25.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.845+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33b8016090 con 0x7f33c8158fe0 2024-04-25T16:00:25.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.861+0000 7f00a6fe6640 1 Processor -- start 2024-04-25T16:00:25.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.861+0000 7f00a6fe6640 1 -- start start 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a6fe6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00a00a8cc0 0x7f00a01593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a6fe6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f00a0152870 0x7f00a0155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a6fe6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a0152c80 con 0x7f00a0155780 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a6fe6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f00a00aebc0 con 0x7f00a00a8cc0 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a6fe6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f00a0158f20 con 0x7f00a0152870 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00a00a8cc0 0x7f00a01593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00a00a8cc0 0x7f00a01593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59200/0 (socket says 172.21.15.87:59200) 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 -- 172.21.15.87:0/3048710971 learned_addr learned my addr 172.21.15.87:0/3048710971 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f009ffff640 1 --2- 172.21.15.87:0/3048710971 >> v2:172.21.15.155:3300/0 conn(0x7f00a0152870 0x7f00a0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 -- 172.21.15.87:0/3048710971 >> v2:172.21.15.155:3300/0 conn(0x7f00a0152870 msgr2=0x7f00a0155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:25.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 --2- 172.21.15.87:0/3048710971 >> v2:172.21.15.155:3300/0 conn(0x7f00a0152870 0x7f00a0155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 -- 172.21.15.87:0/3048710971 >> v1:172.21.15.155:6789/0 conn(0x7f00a0155780 legacy=0x7f00a006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:25.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.865+0000 7f00a4d82640 1 -- 172.21.15.87:0/3048710971 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a00ae8e0 con 0x7f00a00a8cc0 2024-04-25T16:00:25.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a4d82640 1 --2- 172.21.15.87:0/3048710971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01593b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f00a00c60a0 tx=0x7f009401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a61985091289c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:25.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f009f7fe640 1 -- 172.21.15.87:0/3048710971 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940b2070 con 0x7f00a00a8cc0 2024-04-25T16:00:25.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f009f7fe640 1 -- 172.21.15.87:0/3048710971 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940ad640 con 0x7f00a00a8cc0 2024-04-25T16:00:25.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f009f7fe640 1 -- 172.21.15.87:0/3048710971 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940ada10 con 0x7f00a00a8cc0 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 -- 172.21.15.87:0/3048710971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 msgr2=0x7f00a01593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/3048710971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01593b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f00a00c60a0 tx=0x7f009401c390 comp rx=0 tx=0).stop 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 -- 172.21.15.87:0/3048710971 shutdown_connections 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/3048710971 >> v2:172.21.15.155:3300/0 conn(0x7f00a0152870 0x7f00a0155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/3048710971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01593b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 -- 172.21.15.87:0/3048710971 >> 172.21.15.87:0/3048710971 conn(0x7f00a006d780 msgr2=0x7f00a006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 -- 172.21.15.87:0/3048710971 shutdown_connections 2024-04-25T16:00:25.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 -- 172.21.15.87:0/3048710971 wait complete. 2024-04-25T16:00:25.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 Processor -- start 2024-04-25T16:00:25.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.869+0000 7f00a6fe6640 1 -- start start 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0152870 0x7f00a015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00a0155780 0x7f00a0149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f00a00ac870 con 0x7f00a00a8cc0 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f00a00ac6f0 con 0x7f00a0152870 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f00a01623e0 con 0x7f00a0155780 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01f1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59216/0 (socket says 172.21.15.87:59216) 2024-04-25T16:00:25.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 -- 172.21.15.87:0/2122477650 learned_addr learned my addr 172.21.15.87:0/2122477650 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f009ffff640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0152870 0x7f00a015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a5583640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00a0155780 0x7f00a0149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 -- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00a0155780 msgr2=0x7f00a0149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00a0155780 0x7f00a0149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 -- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0152870 msgr2=0x7f00a015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0152870 0x7f00a015e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 -- 172.21.15.87:0/2122477650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a01f1540 con 0x7f00a00a8cc0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a4d82640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01f1000 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f00940b0040 tx=0x7f0094019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940bd070 con 0x7f00a00a8cc0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940b8430 con 0x7f00a00a8cc0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a01f4590 con 0x7f00a00a8cc0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940b2040 con 0x7f00a00a8cc0 2024-04-25T16:00:25.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a01f0800 con 0x7f00a00a8cc0 2024-04-25T16:00:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a01f0610 con 0x7f00a00a8cc0 2024-04-25T16:00:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f00940c0070 con 0x7f00a00a8cc0 2024-04-25T16:00:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.873+0000 7f009d7fa640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f008406f430 0x7f0084071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.877+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f0094129480 con 0x7f00a00a8cc0 2024-04-25T16:00:25.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.877+0000 7f009ffff640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f008406f430 0x7f0084071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.877+0000 7f009ffff640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f008406f430 0x7f0084071940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f00a015ec90 tx=0x7f008c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:25.881+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f00940160d0 con 0x7f00a00a8cc0 2024-04-25T16:00:26.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.073+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00a0069bb0 con 0x7f00a00a8cc0 2024-04-25T16:00:26.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.073+0000 7f009d7fa640 1 -- 172.21.15.87:0/2122477650 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5664 (secure 0 0 0) 0x7f00940f5e70 con 0x7f00a00a8cc0 2024-04-25T16:00:26.076 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:26.076 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:24.304374+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:26.076 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 59 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f008406f430 msgr2=0x7f0084071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f008406f430 0x7f0084071940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f00a015ec90 tx=0x7f008c008040 comp rx=0 tx=0).stop 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 msgr2=0x7f00a01f1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01f1000 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f00940b0040 tx=0x7f0094019130 comp rx=0 tx=0).stop 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 shutdown_connections 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f008406f430 0x7f0084071940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00a0155780 0x7f00a0149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00a0152870 0x7f00a015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 --2- 172.21.15.87:0/2122477650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00a00a8cc0 0x7f00a01f1000 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 >> 172.21.15.87:0/2122477650 conn(0x7f00a006d780 msgr2=0x7f00a01581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 shutdown_connections 2024-04-25T16:00:26.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.077+0000 7f00a6fe6640 1 -- 172.21.15.87:0/2122477650 wait complete. 2024-04-25T16:00:26.097 INFO:tasks.mds_thrash.fs.[a]:kill mds.b (rank=0) 2024-04-25T16:00:26.097 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T16:00:26.097 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:00:26.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.117+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33c8069bb0 con 0x7f33c8158fe0 2024-04-25T16:00:26.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.117+0000 7f33be7fc640 1 -- 172.21.15.87:0/1410219995 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5664 (secure 0 0 0) 0x7f33b80f6270 con 0x7f33c8158fe0 2024-04-25T16:00:26.120 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:26.120 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:24.304374+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:26.120 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 59 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ac06f430 msgr2=0x7f33ac071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ac06f430 0x7f33ac071940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f33c80721c0 tx=0x7f33c4008040 comp rx=0 tx=0).stop 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 msgr2=0x7f33c81f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 0x7f33c81f1d20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f33b801c860 tx=0x7f33b4005840 comp rx=0 tx=0).stop 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 shutdown_connections 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33ac06f430 0x7f33ac071940 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33c815a280 0x7f33c81475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33c8158fe0 0x7f33c81f1d20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 --2- 172.21.15.87:0/1410219995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33b4004810 0x7f33c814fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 >> 172.21.15.87:0/1410219995 conn(0x7f33c806d780 msgr2=0x7f33c81575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:26.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 shutdown_connections 2024-04-25T16:00:26.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.121+0000 7f33cfb76640 1 -- 172.21.15.87:0/1410219995 wait complete. 2024-04-25T16:00:26.124 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T16:00:26.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:26.142 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-04-25T16:00:26.142 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-25T16:00:26.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:26.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.281+0000 7f1e0a3f3640 1 Processor -- start 2024-04-25T16:00:26.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.281+0000 7f1e0a3f3640 1 -- start start 2024-04-25T16:00:26.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e0a3f3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040a8cc0 0x7f1e041593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e0a3f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1e04152870 0x7f1e04155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e0a3f3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e04152c80 con 0x7f1e04155780 2024-04-25T16:00:26.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e0a3f3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1e040aebc0 con 0x7f1e04152870 2024-04-25T16:00:26.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e0a3f3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e04158f20 con 0x7f1e040a8cc0 2024-04-25T16:00:26.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e08990640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1e04155780 0x7f1e0406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51680/0 (socket says 172.21.15.87:51680) 2024-04-25T16:00:26.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e08990640 1 -- 172.21.15.87:0/2271575535 learned_addr learned my addr 172.21.15.87:0/2271575535 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:26.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040a8cc0 0x7f1e041593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e037fe640 1 --2- 172.21.15.87:0/2271575535 >> v2:172.21.15.155:3300/0 conn(0x7f1e04152870 0x7f1e04155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980529159 0 0) 0x7f1e04152c80 con 0x7f1e04155780 2024-04-25T16:00:26.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dec003530 con 0x7f1e04155780 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553113257 0 0) 0x7f1dec003530 con 0x7f1e04155780 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040a8cc0 msgr2=0x7f1e041593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040a8cc0 0x7f1e041593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 >> v2:172.21.15.155:3300/0 conn(0x7f1e04152870 msgr2=0x7f1e04155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 --2- 172.21.15.87:0/2271575535 >> v2:172.21.15.155:3300/0 conn(0x7f1e04152870 0x7f1e04155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e040ae8e0 con 0x7f1e04155780 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f1dfc001a00 con 0x7f1e04155780 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 >> v1:172.21.15.87:6789/0 conn(0x7f1e04155780 legacy=0x7f1e0406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1dec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dec004810 0x7f1dec004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dec005280 0x7f1dec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1e040aebc0 con 0x7f1dec0039c0 2024-04-25T16:00:26.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e04158f20 con 0x7f1dec004810 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1dec00c1d0 con 0x7f1dec005280 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040a8cc0 0x7f1e041593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1dec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e037fe640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dec004810 0x7f1dec004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e08990640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dec005280 0x7f1dec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 -- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dec005280 msgr2=0x7f1dec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dec005280 0x7f1dec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 -- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dec004810 msgr2=0x7f1dec004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dec004810 0x7f1dec004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e03fff640 1 -- 172.21.15.87:0/2271575535 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec003530 con 0x7f1dec0039c0 2024-04-25T16:00:26.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.285+0000 7f1e037fe640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dec004810 0x7f1dec004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e03fff640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1dec003e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406f0b0 tx=0x7f1df401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78595ed1055c1f1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b0070 con 0x7f1dec0039c0 2024-04-25T16:00:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df40ab600 con 0x7f1dec0039c0 2024-04-25T16:00:26.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e02ffd640 1 -- 172.21.15.87:0/2271575535 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df400f040 con 0x7f1dec0039c0 2024-04-25T16:00:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/2271575535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 msgr2=0x7f1dec003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/2271575535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1dec003e50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406f0b0 tx=0x7f1df401c3e0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e08990640 1 -- 172.21.15.87:0/2271575535 reap_dead start 2024-04-25T16:00:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/2271575535 shutdown_connections 2024-04-25T16:00:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/2271575535 >> 172.21.15.87:0/2271575535 conn(0x7f1e0406d780 msgr2=0x7f1e0406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/2271575535 shutdown_connections 2024-04-25T16:00:26.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.289+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/2271575535 wait complete. 2024-04-25T16:00:26.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.293+0000 7f1e0a3f3640 1 Processor -- start 2024-04-25T16:00:26.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.293+0000 7f1e0a3f3640 1 -- start start 2024-04-25T16:00:26.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1e0414ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040c7b10 0x7f1e040c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e04157760 0x7f1e04157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1e040ac870 con 0x7f1dec0039c0 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e040ac6f0 con 0x7f1e04157760 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e041603d0 con 0x7f1e040c7b10 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1e0414ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1e0414ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59238/0 (socket says 172.21.15.87:59238) 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 -- 172.21.15.87:0/983497607 learned_addr learned my addr 172.21.15.87:0/983497607 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e037fe640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040c7b10 0x7f1e040c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e08990640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e04157760 0x7f1e04157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 -- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040c7b10 msgr2=0x7f1e040c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040c7b10 0x7f1e040c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 -- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e04157760 msgr2=0x7f1e04157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e04157760 0x7f1e04157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 -- 172.21.15.87:0/983497607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e04073130 con 0x7f1dec0039c0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e03fff640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1e0414ce30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1df401c8c0 tx=0x7f1dec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40bb020 con 0x7f1dec0039c0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df400f000 con 0x7f1dec0039c0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e040733f0 con 0x7f1dec0039c0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b0040 con 0x7f1dec0039c0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e040739b0 con 0x7f1dec0039c0 2024-04-25T16:00:26.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.297+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e04069bb0 con 0x7f1dec0039c0 2024-04-25T16:00:26.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.301+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1df40be020 con 0x7f1dec0039c0 2024-04-25T16:00:26.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.301+0000 7f1e00ff9640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1df006f400 0x7f1df0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.301+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f1df412a130 con 0x7f1dec0039c0 2024-04-25T16:00:26.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.301+0000 7f1e037fe640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1df006f400 0x7f1df0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.301+0000 7f1e037fe640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1df006f400 0x7f1df0071910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1df80090e0 tx=0x7f1df8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:26.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.309+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1df40c5020 con 0x7f1dec0039c0 2024-04-25T16:00:26.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.321+0000 7f5d2a5ba640 1 Processor -- start 2024-04-25T16:00:26.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.321+0000 7f5d2a5ba640 1 -- start start 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d2a5ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d24151700 0x7f5d2415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d2a5ba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2406dbd0 con 0x7f5d24074930 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d2a5ba640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d24154870 con 0x7f5d240aeca0 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d2a5ba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5d24070440 con 0x7f5d24151700 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d28b57640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d24151700 0x7f5d2415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d237fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5d24074930 0x7f5d2406f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51694/0 (socket says 172.21.15.87:51694) 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d237fe640 1 -- 172.21.15.87:0/4206339858 learned_addr learned my addr 172.21.15.87:0/4206339858 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d28b57640 1 -- 172.21.15.87:0/4206339858 >> v1:172.21.15.155:6789/0 conn(0x7f5d240aeca0 legacy=0x7f5d24154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:26.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d28b57640 1 -- 172.21.15.87:0/4206339858 >> v1:172.21.15.87:6789/0 conn(0x7f5d24074930 legacy=0x7f5d2406f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.325+0000 7f5d28b57640 1 -- 172.21.15.87:0/4206339858 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d24074d40 con 0x7f5d24151700 2024-04-25T16:00:26.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d28b57640 1 --2- 172.21.15.87:0/4206339858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24151700 0x7f5d2415fab0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009d90 tx=0x7f5d1c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5590ba0dcb0c506a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:26.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d22ffd640 1 -- 172.21.15.87:0/4206339858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b1070 con 0x7f5d24151700 2024-04-25T16:00:26.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d22ffd640 1 -- 172.21.15.87:0/4206339858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0a4bc0 con 0x7f5d24151700 2024-04-25T16:00:26.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d22ffd640 1 -- 172.21.15.87:0/4206339858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0ac440 con 0x7f5d24151700 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/4206339858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24151700 msgr2=0x7f5d2415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/4206339858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24151700 0x7f5d2415fab0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009d90 tx=0x7f5d1c01c3e0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/4206339858 shutdown_connections 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/4206339858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24151700 0x7f5d2415fab0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/4206339858 >> 172.21.15.87:0/4206339858 conn(0x7f5d2406d650 msgr2=0x7f5d240c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/4206339858 shutdown_connections 2024-04-25T16:00:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.329+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/4206339858 wait complete. 2024-04-25T16:00:26.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 Processor -- start 2024-04-25T16:00:26.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 -- start start 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 0x7f5d240ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d240aeca0 0x7f5d24142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d24151700 0x7f5d241438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5d241635c0 con 0x7f5d24074930 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24163440 con 0x7f5d24151700 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d24163740 con 0x7f5d240aeca0 2024-04-25T16:00:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 0x7f5d240ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 0x7f5d240ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59258/0 (socket says 172.21.15.87:59258) 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 -- 172.21.15.87:0/354451752 learned_addr learned my addr 172.21.15.87:0/354451752 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d28b57640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d24151700 0x7f5d241438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d237fe640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d240aeca0 0x7f5d24142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 -- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d240aeca0 msgr2=0x7f5d24142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d240aeca0 0x7f5d24142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 -- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d24151700 msgr2=0x7f5d241438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d24151700 0x7f5d241438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 -- 172.21.15.87:0/354451752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d241447d0 con 0x7f5d24074930 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d23fff640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 0x7f5d240ae140 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d9c0 tx=0x7f5d1400de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1400edc0 con 0x7f5d24074930 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d14004020 con 0x7f5d24074930 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d240ad1d0 con 0x7f5d24074930 2024-04-25T16:00:26.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14004410 con 0x7f5d24074930 2024-04-25T16:00:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.333+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d240ad790 con 0x7f5d24074930 2024-04-25T16:00:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.337+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d24069bb0 con 0x7f5d24074930 2024-04-25T16:00:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.337+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5d14003600 con 0x7f5d24074930 2024-04-25T16:00:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.337+0000 7f5d20ff9640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5d1006f400 0x7f5d10071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.337+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f5d140918c0 con 0x7f5d24074930 2024-04-25T16:00:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.337+0000 7f5d237fe640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5d1006f400 0x7f5d10071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.337+0000 7f5d237fe640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5d1006f400 0x7f5d10071910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d2414cbe0 tx=0x7f5d18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:26.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.341+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d1405e160 con 0x7f5d24074930 2024-04-25T16:00:26.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.505+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e040ca430 con 0x7f1dec0039c0 2024-04-25T16:00:26.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.505+0000 7f1e00ff9640 1 -- 172.21.15.87:0/983497607 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5664 (secure 0 0 0) 0x7f1df4016120 con 0x7f1dec0039c0 2024-04-25T16:00:26.508 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:26.508 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:24.304374+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:26.508 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 59 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1df006f400 msgr2=0x7f1df0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1df006f400 0x7f1df0071910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1df80090e0 tx=0x7f1df8008040 comp rx=0 tx=0).stop 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 msgr2=0x7f1e0414ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1e0414ce30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1df401c8c0 tx=0x7f1dec005840 comp rx=0 tx=0).stop 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 shutdown_connections 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1df006f400 0x7f1df0071910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e04157760 0x7f1e04157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e040c7b10 0x7f1e040c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 --2- 172.21.15.87:0/983497607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0039c0 0x7f1e0414ce30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 >> 172.21.15.87:0/983497607 conn(0x7f1e0406d780 msgr2=0x7f1e04151190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 shutdown_connections 2024-04-25T16:00:26.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.509+0000 7f1e0a3f3640 1 -- 172.21.15.87:0/983497607 wait complete. 2024-04-25T16:00:26.528 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:26.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d24063090 con 0x7f5d24074930 2024-04-25T16:00:26.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d20ff9640 1 -- 172.21.15.87:0/354451752 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5664 (secure 0 0 0) 0x7f5d1405da60 con 0x7f5d24074930 2024-04-25T16:00:26.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:26.541 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:24.304374+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:26.542 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 59 2024-04-25T16:00:26.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5d1006f400 msgr2=0x7f5d10071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5d1006f400 0x7f5d10071910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d2414cbe0 tx=0x7f5d18009040 comp rx=0 tx=0).stop 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 msgr2=0x7f5d240ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 0x7f5d240ae140 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d9c0 tx=0x7f5d1400de80 comp rx=0 tx=0).stop 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 shutdown_connections 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5d1006f400 0x7f5d10071910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d24151700 0x7f5d241438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d240aeca0 0x7f5d24142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 --2- 172.21.15.87:0/354451752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d24074930 0x7f5d240ae140 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 >> 172.21.15.87:0/354451752 conn(0x7f5d2406d650 msgr2=0x7f5d24150940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 shutdown_connections 2024-04-25T16:00:26.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:26.541+0000 7f5d2a5ba640 1 -- 172.21.15.87:0/354451752 wait complete. 2024-04-25T16:00:26.562 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 59, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 57, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5269": { "addr": "172.21.15.155:6835/3802722727", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6834", "nonce": 3802722727, "type": "v2" }, { "addr": "172.21.15.155:6835", "nonce": 3802722727, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5269, "incarnation": 53, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T16:00:17.411541+0000", "qdb_cluster": [ 5269 ], "qdb_leader": 5269, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5269 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 59, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5946": { "addr": "172.21.15.87:6835/1331456773", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 1331456773, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 1331456773, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5946, "incarnation": 59, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T16:00:24.304374+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5946 } } } ], "standbys": [ { "addr": "172.21.15.155:6833/2424832889", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 2424832889, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 2424832889, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 48, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5239, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T16:00:28.530 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:28.563 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:28.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 Processor -- start 2024-04-25T16:00:28.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 -- start start 2024-04-25T16:00:28.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3278158a00 0x7f32780ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f32780adfb0 0x7f327815fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3278063660 con 0x7f3278158e10 2024-04-25T16:00:28.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f32780c5470 con 0x7f3278158a00 2024-04-25T16:00:28.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327eb28640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f32780ab670 con 0x7f32780adfb0 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3278158a00 0x7f32780ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3278158a00 0x7f32780ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59268/0 (socket says 172.21.15.87:59268) 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 -- 172.21.15.87:0/1259839750 learned_addr learned my addr 172.21.15.87:0/1259839750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327d0c5640 1 --2- 172.21.15.87:0/1259839750 >> v2:172.21.15.155:3300/0 conn(0x7f32780adfb0 0x7f327815fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 -- 172.21.15.87:0/1259839750 >> v2:172.21.15.155:3300/0 conn(0x7f32780adfb0 msgr2=0x7f327815fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 --2- 172.21.15.87:0/1259839750 >> v2:172.21.15.155:3300/0 conn(0x7f32780adfb0 0x7f327815fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 -- 172.21.15.87:0/1259839750 >> v1:172.21.15.155:6789/0 conn(0x7f3278158e10 legacy=0x7f3278152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:28.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.685+0000 7f327c8c4640 1 -- 172.21.15.87:0/1259839750 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780ab930 con 0x7f3278158a00 2024-04-25T16:00:28.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327c8c4640 1 --2- 172.21.15.87:0/1259839750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158a00 0x7f32780ada70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f32780721b0 tx=0x7f326c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2e2d819ca62f4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:28.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f32777fe640 1 -- 172.21.15.87:0/1259839750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c0ab650 con 0x7f3278158a00 2024-04-25T16:00:28.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f32777fe640 1 -- 172.21.15.87:0/1259839750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326c0b0070 con 0x7f3278158a00 2024-04-25T16:00:28.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f32777fe640 1 -- 172.21.15.87:0/1259839750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c0aba10 con 0x7f3278158a00 2024-04-25T16:00:28.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 -- 172.21.15.87:0/1259839750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158a00 msgr2=0x7f32780ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 --2- 172.21.15.87:0/1259839750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158a00 0x7f32780ada70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f32780721b0 tx=0x7f326c01c490 comp rx=0 tx=0).stop 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 -- 172.21.15.87:0/1259839750 shutdown_connections 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 --2- 172.21.15.87:0/1259839750 >> v2:172.21.15.155:3300/0 conn(0x7f32780adfb0 0x7f327815fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 --2- 172.21.15.87:0/1259839750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158a00 0x7f32780ada70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 -- 172.21.15.87:0/1259839750 >> 172.21.15.87:0/1259839750 conn(0x7f327806d650 msgr2=0x7f32780c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 -- 172.21.15.87:0/1259839750 shutdown_connections 2024-04-25T16:00:28.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.689+0000 7f327eb28640 1 -- 172.21.15.87:0/1259839750 wait complete. 2024-04-25T16:00:28.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 Processor -- start 2024-04-25T16:00:28.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- start start 2024-04-25T16:00:28.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32780adfb0 0x7f3278145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278158a00 0x7f32781f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 0x7f3278146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f32780af0f0 con 0x7f3278158e10 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f32780aef70 con 0x7f32780adfb0 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f32780749b0 con 0x7f3278158a00 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 0x7f3278146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 0x7f3278146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59284/0 (socket says 172.21.15.87:59284) 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 -- 172.21.15.87:0/1410482070 learned_addr learned my addr 172.21.15.87:0/1410482070 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327c8c4640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32780adfb0 0x7f3278145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f3277fff640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278158a00 0x7f32781f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 -- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278158a00 msgr2=0x7f32781f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278158a00 0x7f32781f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 -- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32780adfb0 msgr2=0x7f3278145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32780adfb0 0x7f3278145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 -- 172.21.15.87:0/1410482070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327814caf0 con 0x7f3278158e10 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327d0c5640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 0x7f3278146880 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3270007e90 tx=0x7f327000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270014420 con 0x7f3278158e10 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3270019070 con 0x7f3278158e10 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327814f610 con 0x7f3278158e10 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270014800 con 0x7f3278158e10 2024-04-25T16:00:28.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32781f1f20 con 0x7f3278158e10 2024-04-25T16:00:28.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.693+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327814cfa0 con 0x7f3278158e10 2024-04-25T16:00:28.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.697+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f32700149a0 con 0x7f3278158e10 2024-04-25T16:00:28.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.697+0000 7f32757fa640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f325c06f400 0x7f325c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.697+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f3270090150 con 0x7f3278158e10 2024-04-25T16:00:28.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.697+0000 7f327c8c4640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f325c06f400 0x7f325c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.697+0000 7f327c8c4640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f325c06f400 0x7f325c071910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f326c0af000 tx=0x7f326c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:28.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.705+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f327814cfa0 con 0x7f3278158e10 2024-04-25T16:00:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.709+0000 7fc78b1a1640 1 Processor -- start 2024-04-25T16:00:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.709+0000 7fc78b1a1640 1 -- start start 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78b1a1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc784158e10 0x7fc784152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78b1a1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc784063660 con 0x7fc784158a00 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78b1a1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7840ab670 con 0x7fc784152bc0 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78b1a1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc7840c5470 con 0x7fc784158e10 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc784158a00 0x7fc7840ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51696/0 (socket says 172.21.15.87:51696) 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 -- 172.21.15.87:0/3673586020 learned_addr learned my addr 172.21.15.87:0/3673586020 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc783fff640 1 --2- 172.21.15.87:0/3673586020 >> v2:172.21.15.155:3300/0 conn(0x7fc784158e10 0x7fc784152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34220134 0 0) 0x7fc784063660 con 0x7fc784158a00 2024-04-25T16:00:28.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc774003530 con 0x7fc784158a00 2024-04-25T16:00:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2185614166 0 0) 0x7fc774003530 con 0x7fc784158a00 2024-04-25T16:00:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 >> v2:172.21.15.155:3300/0 conn(0x7fc784158e10 msgr2=0x7fc784152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 --2- 172.21.15.87:0/3673586020 >> v2:172.21.15.155:3300/0 conn(0x7fc784158e10 0x7fc784152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 >> v1:172.21.15.155:6789/0 conn(0x7fc784152bc0 legacy=0x7fc78415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840ab930 con 0x7fc784158a00 2024-04-25T16:00:28.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fc7780016a0 con 0x7fc784158a00 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 >> v1:172.21.15.87:6789/0 conn(0x7fc784158a00 legacy=0x7fc7840ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc774003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc774004810 0x7fc774004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7740051b0 0x7fc77400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840c5470 con 0x7fc7740039c0 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc77400c100 con 0x7fc7740051b0 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc77400c300 con 0x7fc774004810 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc774003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78973e640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7740051b0 0x7fc77400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc783fff640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc774004810 0x7fc774004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 -- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc774004810 msgr2=0x7fc774004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc774004810 0x7fc774004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 -- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7740051b0 msgr2=0x7fc77400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:28.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7740051b0 0x7fc77400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc788f3d640 1 -- 172.21.15.87:0/3673586020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840ab930 con 0x7fc7740039c0 2024-04-25T16:00:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78973e640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7740051b0 0x7fc77400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:28.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.713+0000 7fc78973e640 1 -- 172.21.15.87:0/3673586020 reap_dead start 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc788f3d640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc774003e30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c340 tx=0x7fc77801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d857f12b89d8677a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778007e00 con 0x7fc7740039c0 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7780a9030 con 0x7fc7740039c0 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc7837fe640 1 -- 172.21.15.87:0/3673586020 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778005d00 con 0x7fc7740039c0 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 -- 172.21.15.87:0/3673586020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 msgr2=0x7fc774003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc774003e30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc77800c340 tx=0x7fc77801cd60 comp rx=0 tx=0).stop 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 -- 172.21.15.87:0/3673586020 shutdown_connections 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/3673586020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc774003e30 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 -- 172.21.15.87:0/3673586020 >> 172.21.15.87:0/3673586020 conn(0x7fc78406d650 msgr2=0x7fc7840c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:28.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 -- 172.21.15.87:0/3673586020 shutdown_connections 2024-04-25T16:00:28.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 -- 172.21.15.87:0/3673586020 wait complete. 2024-04-25T16:00:28.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 Processor -- start 2024-04-25T16:00:28.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.717+0000 7fc78b1a1640 1 -- start start 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc784157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7840c6d40 0x7fc7841561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc784149a20 0x7fc784149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840af0f0 con 0x7fc7740039c0 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840aef70 con 0x7fc7840c6d40 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7840749b0 con 0x7fc784149a20 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc784157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc784157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59312/0 (socket says 172.21.15.87:59312) 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 -- 172.21.15.87:0/1973945388 learned_addr learned my addr 172.21.15.87:0/1973945388 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78973e640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc784149a20 0x7fc784149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc783fff640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7840c6d40 0x7fc7841561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 -- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc784149a20 msgr2=0x7fc784149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc784149a20 0x7fc784149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 -- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7840c6d40 msgr2=0x7fc7841561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7840c6d40 0x7fc7841561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 -- 172.21.15.87:0/1973945388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc784156f30 con 0x7fc7740039c0 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc788f3d640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc784157e00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc778098560 tx=0x7fc774005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778000ee0 con 0x7fc7740039c0 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7780a5840 con 0x7fc7740039c0 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7841e0a60 con 0x7fc7740039c0 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780a5c30 con 0x7fc7740039c0 2024-04-25T16:00:28.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc78414a370 con 0x7fc7740039c0 2024-04-25T16:00:28.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784069bb0 con 0x7fc7740039c0 2024-04-25T16:00:28.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.721+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc7780047f0 con 0x7fc7740039c0 2024-04-25T16:00:28.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.725+0000 7fc7817fa640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc76806f5d0 0x7fc768071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:28.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.725+0000 7fc783fff640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc76806f5d0 0x7fc768071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:28.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.725+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7fc778129020 con 0x7fc7740039c0 2024-04-25T16:00:28.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.725+0000 7fc783fff640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc76806f5d0 0x7fc768071ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7841538a0 tx=0x7fc770008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:28.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.729+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc778016a70 con 0x7fc7740039c0 2024-04-25T16:00:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.913+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7840704e0 con 0x7fc7740039c0 2024-04-25T16:00:28.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc7817fa640 1 -- 172.21.15.87:0/1973945388 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5664 (secure 0 0 0) 0x7fc7780f5910 con 0x7fc7740039c0 2024-04-25T16:00:28.917 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:28.917 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:24.304374+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:28.917 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 59 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc76806f5d0 msgr2=0x7fc768071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc76806f5d0 0x7fc768071ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7841538a0 tx=0x7fc770008040 comp rx=0 tx=0).stop 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 msgr2=0x7fc784157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc784157e00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc778098560 tx=0x7fc774005840 comp rx=0 tx=0).stop 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 shutdown_connections 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc76806f5d0 0x7fc768071ae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc784149a20 0x7fc784149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7840c6d40 0x7fc7841561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 --2- 172.21.15.87:0/1973945388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7740039c0 0x7fc784157e00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 >> 172.21.15.87:0/1973945388 conn(0x7fc78406d650 msgr2=0x7fc78414f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 shutdown_connections 2024-04-25T16:00:28.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.917+0000 7fc78b1a1640 1 -- 172.21.15.87:0/1973945388 wait complete. 2024-04-25T16:00:28.937 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-25T16:00:28.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.953+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f327814f370 con 0x7f3278158e10 2024-04-25T16:00:28.953 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.953+0000 7f32757fa640 1 -- 172.21.15.87:0/1410482070 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5664 (secure 0 0 0) 0x7f327005c3a0 con 0x7f3278158e10 2024-04-25T16:00:28.953 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:28.953 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:24.304374+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:28.954 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 59 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f325c06f400 msgr2=0x7f325c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f325c06f400 0x7f325c071910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f326c0af000 tx=0x7f326c0a7000 comp rx=0 tx=0).stop 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 msgr2=0x7f3278146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 0x7f3278146880 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3270007e90 tx=0x7f327000e4b0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 shutdown_connections 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f325c06f400 0x7f325c071910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3278158e10 0x7f3278146880 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3278158a00 0x7f32781f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 --2- 172.21.15.87:0/1410482070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32780adfb0 0x7f3278145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:28.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 >> 172.21.15.87:0/1410482070 conn(0x7f327806d650 msgr2=0x7f3278156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:28.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 shutdown_connections 2024-04-25T16:00:28.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:28.957+0000 7f327eb28640 1 -- 172.21.15.87:0/1410482070 wait complete. 2024-04-25T16:00:28.981 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:30.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:30.982 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:31.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.097+0000 7f931c410640 1 Processor -- start 2024-04-25T16:00:31.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.097+0000 7f931c410640 1 -- start start 2024-04-25T16:00:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f931c410640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93141578b0 0x7f9314157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f931c410640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93140c5290 con 0x7f93141517d0 2024-04-25T16:00:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f931c410640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93140c5550 con 0x7f9314158200 2024-04-25T16:00:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f931c410640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f93140c5e80 con 0x7f93141578b0 2024-04-25T16:00:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f93199ab640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93141578b0 0x7f9314157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f93199ab640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93141578b0 0x7f9314157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59490/0 (socket says 172.21.15.87:59490) 2024-04-25T16:00:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f931a1ac640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f93141517d0 0x7f93140c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49386/0 (socket says 172.21.15.87:49386) 2024-04-25T16:00:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f93199ab640 1 -- 172.21.15.87:0/434976916 learned_addr learned my addr 172.21.15.87:0/434976916 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f93199ab640 1 -- 172.21.15.87:0/434976916 >> v1:172.21.15.155:6789/0 conn(0x7f9314158200 legacy=0x7f931415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f93199ab640 1 -- 172.21.15.87:0/434976916 >> v1:172.21.15.87:6789/0 conn(0x7f93141517d0 legacy=0x7f93140c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.101+0000 7f93199ab640 1 -- 172.21.15.87:0/434976916 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93140c5830 con 0x7f93141578b0 2024-04-25T16:00:31.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f93199ab640 1 --2- 172.21.15.87:0/434976916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f9314157cc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9304009870 tx=0x7f930401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3abf0dfcbf8b42e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:31.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f93191aa640 1 -- 172.21.15.87:0/434976916 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040b0070 con 0x7f93141578b0 2024-04-25T16:00:31.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f93191aa640 1 -- 172.21.15.87:0/434976916 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93040ab600 con 0x7f93141578b0 2024-04-25T16:00:31.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f93191aa640 1 -- 172.21.15.87:0/434976916 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040ab9d0 con 0x7f93141578b0 2024-04-25T16:00:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 -- 172.21.15.87:0/434976916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 msgr2=0x7f9314157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 --2- 172.21.15.87:0/434976916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f9314157cc0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9304009870 tx=0x7f930401c520 comp rx=0 tx=0).stop 2024-04-25T16:00:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 -- 172.21.15.87:0/434976916 shutdown_connections 2024-04-25T16:00:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 --2- 172.21.15.87:0/434976916 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f9314157cc0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 -- 172.21.15.87:0/434976916 >> 172.21.15.87:0/434976916 conn(0x7f931406d780 msgr2=0x7f931406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 -- 172.21.15.87:0/434976916 shutdown_connections 2024-04-25T16:00:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 -- 172.21.15.87:0/434976916 wait complete. 2024-04-25T16:00:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 Processor -- start 2024-04-25T16:00:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.105+0000 7f931c410640 1 -- start start 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93141517d0 0x7f93141f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f93140ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9314158200 0x7f93141f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f93140a8f70 con 0x7f93141578b0 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9314151be0 con 0x7f93141517d0 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f93140a90f0 con 0x7f9314158200 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f93140ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f93140ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59502/0 (socket says 172.21.15.87:59502) 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 -- 172.21.15.87:0/2588853132 learned_addr learned my addr 172.21.15.87:0/2588853132 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931a1ac640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93141517d0 0x7f93141f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931a9ad640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9314158200 0x7f93141f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 -- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9314158200 msgr2=0x7f93141f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9314158200 0x7f93141f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 -- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93141517d0 msgr2=0x7f93141f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93141517d0 0x7f93141f0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 -- 172.21.15.87:0/2588853132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93140c8a70 con 0x7f93141578b0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f93199ab640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f93140ae390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f930401abd0 tx=0x7f93040192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040bb070 con 0x7f93141578b0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93040b6650 con 0x7f93141578b0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040b0040 con 0x7f93141578b0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93140c84b0 con 0x7f93141578b0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93140c7ac0 con 0x7f93141578b0 2024-04-25T16:00:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.109+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9314069bb0 con 0x7f93141578b0 2024-04-25T16:00:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.113+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f93040be070 con 0x7f93141578b0 2024-04-25T16:00:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.113+0000 7f930affd640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f92f806f400 0x7f92f8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.113+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f9304129040 con 0x7f93141578b0 2024-04-25T16:00:31.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.113+0000 7f931a1ac640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f92f806f400 0x7f92f8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.113+0000 7f931a1ac640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f92f806f400 0x7f92f8071910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f930c007fd0 tx=0x7f930c005b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:31.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.117+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9304016110 con 0x7f93141578b0 2024-04-25T16:00:31.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 Processor -- start 2024-04-25T16:00:31.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 -- start start 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3dec0740d0 0x7f3dec0c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dec063220 con 0x7f3dec0744e0 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3dec0c5570 con 0x7f3dec0740d0 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df315e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec074a90 con 0x7f3dec154c90 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3dec0740d0 0x7f3dec0c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3dec0740d0 0x7f3dec0c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59516/0 (socket says 172.21.15.87:59516) 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 -- 172.21.15.87:0/770364959 learned_addr learned my addr 172.21.15.87:0/770364959 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 -- 172.21.15.87:0/770364959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 msgr2=0x7f3dec161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df16fb640 1 --2- 172.21.15.87:0/770364959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 --2- 172.21.15.87:0/770364959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 -- 172.21.15.87:0/770364959 >> v1:172.21.15.155:6789/0 conn(0x7f3dec0744e0 legacy=0x7f3dec154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:31.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.133+0000 7f3df0efa640 1 -- 172.21.15.87:0/770364959 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec0634c0 con 0x7f3dec0740d0 2024-04-25T16:00:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df0efa640 1 --2- 172.21.15.87:0/770364959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c2370 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009870 tx=0x7f3ddc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19636ae0b66e63bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3deb7fe640 1 -- 172.21.15.87:0/770364959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0b2070 con 0x7f3dec0740d0 2024-04-25T16:00:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3deb7fe640 1 -- 172.21.15.87:0/770364959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0a9070 con 0x7f3dec0740d0 2024-04-25T16:00:31.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3deb7fe640 1 -- 172.21.15.87:0/770364959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0ad880 con 0x7f3dec0740d0 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 -- 172.21.15.87:0/770364959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0740d0 msgr2=0x7f3dec0c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 --2- 172.21.15.87:0/770364959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c2370 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009870 tx=0x7f3ddc01c490 comp rx=0 tx=0).stop 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 -- 172.21.15.87:0/770364959 shutdown_connections 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 --2- 172.21.15.87:0/770364959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 --2- 172.21.15.87:0/770364959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c2370 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 -- 172.21.15.87:0/770364959 >> 172.21.15.87:0/770364959 conn(0x7f3dec06d650 msgr2=0x7f3dec0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 -- 172.21.15.87:0/770364959 shutdown_connections 2024-04-25T16:00:31.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 -- 172.21.15.87:0/770364959 wait complete. 2024-04-25T16:00:31.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 Processor -- start 2024-04-25T16:00:31.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.137+0000 7f3df315e640 1 -- start start 2024-04-25T16:00:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 0x7f3dec1f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec0c51e0 con 0x7f3dec0744e0 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec0c5060 con 0x7f3dec0740d0 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec164bd0 con 0x7f3dec154c90 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 0x7f3dec1f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 0x7f3dec1f0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59530/0 (socket says 172.21.15.87:59530) 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 -- 172.21.15.87:0/3214579747 learned_addr learned my addr 172.21.15.87:0/3214579747 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df0efa640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df16fb640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 -- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 msgr2=0x7f3dec142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 -- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dec0740d0 msgr2=0x7f3dec0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 -- 172.21.15.87:0/3214579747 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec150a80 con 0x7f3dec0744e0 2024-04-25T16:00:31.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3debfff640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 0x7f3dec1f0db0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3de000b3e0 tx=0x7f3de000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:31.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0015020 con 0x7f3dec0744e0 2024-04-25T16:00:31.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de0011850 con 0x7f3dec0744e0 2024-04-25T16:00:31.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011c40 con 0x7f3dec0744e0 2024-04-25T16:00:31.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dec1f42e0 con 0x7f3dec0744e0 2024-04-25T16:00:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dec1f48a0 con 0x7f3dec0744e0 2024-04-25T16:00:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dec069bb0 con 0x7f3dec0744e0 2024-04-25T16:00:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.141+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3de0018020 con 0x7f3dec0744e0 2024-04-25T16:00:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.145+0000 7f3de97fa640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3dd806f400 0x7f3dd8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.145+0000 7f3df0efa640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3dd806f400 0x7f3dd8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:31.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.145+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f3de008f9a0 con 0x7f3dec0744e0 2024-04-25T16:00:31.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.145+0000 7f3df0efa640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3dd806f400 0x7f3dd8071910 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0af000 tx=0x7f3ddc0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:31.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.149+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3de001f020 con 0x7f3dec0744e0 2024-04-25T16:00:31.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.329+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93140c7440 con 0x7f93141578b0 2024-04-25T16:00:31.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.329+0000 7f930affd640 1 -- 172.21.15.87:0/2588853132 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5664 (secure 0 0 0) 0x7f93040f58e0 con 0x7f93141578b0 2024-04-25T16:00:31.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:31.331 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:29.484180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:rejoin","state_seq":5,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:31.331 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 61 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f92f806f400 msgr2=0x7f92f8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f92f806f400 0x7f92f8071910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f930c007fd0 tx=0x7f930c005b80 comp rx=0 tx=0).stop 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 msgr2=0x7f93140ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f93140ae390 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f930401abd0 tx=0x7f93040192c0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 shutdown_connections 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f92f806f400 0x7f92f8071910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9314158200 0x7f93141f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93141578b0 0x7f93140ae390 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 --2- 172.21.15.87:0/2588853132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93141517d0 0x7f93141f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 >> 172.21.15.87:0/2588853132 conn(0x7f931406d780 msgr2=0x7f931406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:31.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 shutdown_connections 2024-04-25T16:00:31.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.333+0000 7f931c410640 1 -- 172.21.15.87:0/2588853132 wait complete. 2024-04-25T16:00:31.350 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-25T16:00:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.365+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dec0c8c30 con 0x7f3dec0744e0 2024-04-25T16:00:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.365+0000 7f3de97fa640 1 -- 172.21.15.87:0/3214579747 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5664 (secure 0 0 0) 0x7f3de005c1b0 con 0x7f3dec0744e0 2024-04-25T16:00:31.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:31.367 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:29.484180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:rejoin","state_seq":5,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-25T16:00:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 61 2024-04-25T16:00:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3dd806f400 msgr2=0x7f3dd8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3dd806f400 0x7f3dd8071910 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0af000 tx=0x7f3ddc0a7000 comp rx=0 tx=0).stop 2024-04-25T16:00:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 msgr2=0x7f3dec1f0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 0x7f3dec1f0db0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3de000b3e0 tx=0x7f3de000b8a0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 shutdown_connections 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3dd806f400 0x7f3dd8071910 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dec154c90 0x7f3dec142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dec0744e0 0x7f3dec1f0db0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 --2- 172.21.15.87:0/3214579747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dec0740d0 0x7f3dec0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 >> 172.21.15.87:0/3214579747 conn(0x7f3dec06d650 msgr2=0x7f3dec155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 shutdown_connections 2024-04-25T16:00:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:31.369+0000 7f3df315e640 1 -- 172.21.15.87:0/3214579747 wait complete. 2024-04-25T16:00:31.386 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:31.513 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T16:00:31.514 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-04-25T16:00:31.526 INFO:tasks.mds_thrash:joining mds_thrasher 2024-04-25T16:00:33.351 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:33.387 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:33.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fdaa1508640 1 Processor -- start 2024-04-25T16:00:33.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fdaa1508640 1 -- start start 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fdaa1508640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fda9c15da90 0x7fda9c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fdaa1508640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c0c5290 con 0x7fda9c1517d0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fdaa1508640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c0c5550 con 0x7fda9c1578b0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fdaa1508640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fda9c0c5e80 con 0x7fda9c15da90 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda9affd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fda9c1517d0 0x7fda9c0c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49396/0 (socket says 172.21.15.87:49396) 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda9affd640 1 -- 172.21.15.87:0/1623750222 learned_addr learned my addr 172.21.15.87:0/1623750222 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda9b7fe640 1 --2- 172.21.15.87:0/1623750222 >> v2:172.21.15.155:3300/0 conn(0x7fda9c15da90 0x7fda9c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652278171 0 0) 0x7fda9c0c5290 con 0x7fda9c1517d0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda84003530 con 0x7fda9c1517d0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2937532475 0 0) 0x7fda84003530 con 0x7fda9c1517d0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 >> v2:172.21.15.155:3300/0 conn(0x7fda9c15da90 msgr2=0x7fda9c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 --2- 172.21.15.87:0/1623750222 >> v2:172.21.15.155:3300/0 conn(0x7fda9c15da90 0x7fda9c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 >> v1:172.21.15.155:6789/0 conn(0x7fda9c1578b0 legacy=0x7fda9c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c0c5830 con 0x7fda9c1517d0 2024-04-25T16:00:33.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fda94001680 con 0x7fda9c1517d0 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 >> v1:172.21.15.87:6789/0 conn(0x7fda9c1517d0 legacy=0x7fda9c0c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda840039c0 0x7fda84003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda84004810 0x7fda84004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda840051d0 0x7fda8400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda8400e350 con 0x7fda840039c0 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fda8400e500 con 0x7fda84004810 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fda8400e700 con 0x7fda840051d0 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.513+0000 7fda9affd640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda840039c0 0x7fda84003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9b7fe640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda840051d0 0x7fda8400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9a7fc640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda84004810 0x7fda84004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9affd640 1 -- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda840051d0 msgr2=0x7fda8400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9affd640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda840051d0 0x7fda8400dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9affd640 1 -- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda84004810 msgr2=0x7fda84004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:33.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9affd640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda84004810 0x7fda84004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9affd640 1 -- 172.21.15.87:0/1623750222 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda84003530 con 0x7fda840039c0 2024-04-25T16:00:33.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9a7fc640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda84004810 0x7fda84004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:33.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9b7fe640 1 -- 172.21.15.87:0/1623750222 reap_dead start 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda9affd640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda840039c0 0x7fda84003e30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0c3c00 tx=0x7fda9401cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d65b99ceda11b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94007d40 con 0x7fda840039c0 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940a9020 con 0x7fda840039c0 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fda99ffb640 1 -- 172.21.15.87:0/1623750222 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94005ae0 con 0x7fda840039c0 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 -- 172.21.15.87:0/1623750222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda840039c0 msgr2=0x7fda84003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda840039c0 0x7fda84003e30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0c3c00 tx=0x7fda9401cb40 comp rx=0 tx=0).stop 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 -- 172.21.15.87:0/1623750222 shutdown_connections 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 --2- 172.21.15.87:0/1623750222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda840039c0 0x7fda84003e30 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 -- 172.21.15.87:0/1623750222 >> 172.21.15.87:0/1623750222 conn(0x7fda9c06d780 msgr2=0x7fda9c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 -- 172.21.15.87:0/1623750222 shutdown_connections 2024-04-25T16:00:33.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.517+0000 7fdaa1508640 1 -- 172.21.15.87:0/1623750222 wait complete. 2024-04-25T16:00:33.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 Processor -- start 2024-04-25T16:00:33.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 -- start start 2024-04-25T16:00:33.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840039c0 0x7fda9c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda9c14f2e0 0x7fda9c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 0x7fda9c14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c157cc0 con 0x7fda9c14a840 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c0a9180 con 0x7fda840039c0 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fda9c157e40 con 0x7fda9c14f2e0 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 0x7fda9c14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 0x7fda9c14ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59552/0 (socket says 172.21.15.87:59552) 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 -- 172.21.15.87:0/2463928442 learned_addr learned my addr 172.21.15.87:0/2463928442 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 -- 172.21.15.87:0/2463928442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda9c14f2e0 msgr2=0x7fda9c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda9c14f2e0 0x7fda9c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 -- 172.21.15.87:0/2463928442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840039c0 msgr2=0x7fda9c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840039c0 0x7fda9c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 -- 172.21.15.87:0/2463928442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c14eb20 con 0x7fda9c14a840 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda9b7fe640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 0x7fda9c14ac50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0c4cc0 tx=0x7fda8c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c016620 con 0x7fda9c14a840 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c01b070 con 0x7fda9c14a840 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c016a20 con 0x7fda9c14a840 2024-04-25T16:00:33.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c1eccf0 con 0x7fda9c14a840 2024-04-25T16:00:33.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.521+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c1ecfd0 con 0x7fda9c14a840 2024-04-25T16:00:33.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.525+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c1561c0 con 0x7fda9c14a840 2024-04-25T16:00:33.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.525+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fda8c016bc0 con 0x7fda9c14a840 2024-04-25T16:00:33.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.525+0000 7fda837fe640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fda8806f400 0x7fda88071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.525+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7fda8c090ff0 con 0x7fda9c14a840 2024-04-25T16:00:33.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.525+0000 7fda9affd640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fda8806f400 0x7fda88071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.525+0000 7fda9affd640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fda8806f400 0x7fda88071910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda940aa000 tx=0x7fda94000ff0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:33.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.529+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda9c1561c0 con 0x7fda9c14a840 2024-04-25T16:00:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5286aca640 1 Processor -- start 2024-04-25T16:00:33.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5286aca640 1 -- start start 2024-04-25T16:00:33.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5286aca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52801578b0 0x7f5280157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5286aca640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800c5290 con 0x7f5280158200 2024-04-25T16:00:33.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5286aca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52800c5550 con 0x7f52801517d0 2024-04-25T16:00:33.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5286aca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f52800c5e80 con 0x7f52801578b0 2024-04-25T16:00:33.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f527ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52801578b0 0x7f5280157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f527ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52801578b0 0x7f5280157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59554/0 (socket says 172.21.15.87:59554) 2024-04-25T16:00:33.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f5285067640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5280158200 0x7f528015ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49400/0 (socket says 172.21.15.87:49400) 2024-04-25T16:00:33.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f527ffff640 1 -- 172.21.15.87:0/519619275 learned_addr learned my addr 172.21.15.87:0/519619275 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:33.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f527ffff640 1 -- 172.21.15.87:0/519619275 >> v1:172.21.15.155:6789/0 conn(0x7f52801517d0 legacy=0x7f52800c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:33.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f527ffff640 1 -- 172.21.15.87:0/519619275 >> v1:172.21.15.87:6789/0 conn(0x7f5280158200 legacy=0x7f528015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.553+0000 7f527ffff640 1 -- 172.21.15.87:0/519619275 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52800c5830 con 0x7f52801578b0 2024-04-25T16:00:33.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f527ffff640 1 --2- 172.21.15.87:0/519619275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801578b0 0x7f5280157cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f527400bb10 tx=0x7f527401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dc680e44f89a84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:33.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f527f7fe640 1 -- 172.21.15.87:0/519619275 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740b4070 con 0x7f52801578b0 2024-04-25T16:00:33.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f527f7fe640 1 -- 172.21.15.87:0/519619275 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52740a79c0 con 0x7f52801578b0 2024-04-25T16:00:33.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f527f7fe640 1 -- 172.21.15.87:0/519619275 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740a7d90 con 0x7f52801578b0 2024-04-25T16:00:33.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 -- 172.21.15.87:0/519619275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801578b0 msgr2=0x7f5280157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 --2- 172.21.15.87:0/519619275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801578b0 0x7f5280157cc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f527400bb10 tx=0x7f527401ebf0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 -- 172.21.15.87:0/519619275 shutdown_connections 2024-04-25T16:00:33.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 --2- 172.21.15.87:0/519619275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801578b0 0x7f5280157cc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 -- 172.21.15.87:0/519619275 >> 172.21.15.87:0/519619275 conn(0x7f528006d780 msgr2=0x7f528006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:33.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 -- 172.21.15.87:0/519619275 shutdown_connections 2024-04-25T16:00:33.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 -- 172.21.15.87:0/519619275 wait complete. 2024-04-25T16:00:33.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 Processor -- start 2024-04-25T16:00:33.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.557+0000 7f5286aca640 1 -- start start 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 0x7f52800ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801578b0 0x7f528014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280158200 0x7f528014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52800a8f70 con 0x7f52801517d0 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5280151be0 con 0x7f5280158200 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f52800a90f0 con 0x7f52801578b0 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 0x7f52800ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 0x7f52800ae3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59558/0 (socket says 172.21.15.87:59558) 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 -- 172.21.15.87:0/1942778375 learned_addr learned my addr 172.21.15.87:0/1942778375 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5285067640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280158200 0x7f528014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527ffff640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801578b0 0x7f528014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 -- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801578b0 msgr2=0x7f528014ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801578b0 0x7f528014ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 -- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280158200 msgr2=0x7f528014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280158200 0x7f528014ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 -- 172.21.15.87:0/1942778375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5280074120 con 0x7f52801517d0 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5284866640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 0x7f52800ae3e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f527800b9c0 tx=0x7f527800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527800cba0 con 0x7f52801517d0 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527800cd40 con 0x7f52801517d0 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52800ad440 con 0x7f52801517d0 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278003bc0 con 0x7f52801517d0 2024-04-25T16:00:33.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52800ada00 con 0x7f52801517d0 2024-04-25T16:00:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5280069bb0 con 0x7f52801517d0 2024-04-25T16:00:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5278006d10 con 0x7f52801517d0 2024-04-25T16:00:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527d7fa640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f526c06f400 0x7f526c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f527808f4a0 con 0x7f52801517d0 2024-04-25T16:00:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.561+0000 7f527ffff640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f526c06f400 0x7f526c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:33.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.565+0000 7f527ffff640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f526c06f400 0x7f526c071910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f52740b1000 tx=0x7f52740a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:33.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.569+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f527805bdd0 con 0x7f52801517d0 2024-04-25T16:00:33.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.729+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda9c069bb0 con 0x7fda9c14a840 2024-04-25T16:00:33.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.729+0000 7fda837fe640 1 -- 172.21.15.87:0/2463928442 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7fda8c05d890 con 0x7fda9c14a840 2024-04-25T16:00:33.731 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:33.731 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:33.731 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fda8806f400 msgr2=0x7fda88071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fda8806f400 0x7fda88071910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda940aa000 tx=0x7fda94000ff0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 msgr2=0x7fda9c14ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 0x7fda9c14ac50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0c4cc0 tx=0x7fda8c00f520 comp rx=0 tx=0).stop 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 shutdown_connections 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fda8806f400 0x7fda88071910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda9c14a840 0x7fda9c14ac50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda9c14f2e0 0x7fda9c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 --2- 172.21.15.87:0/2463928442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840039c0 0x7fda9c156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 >> 172.21.15.87:0/2463928442 conn(0x7fda9c06d780 msgr2=0x7fda9c1e2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:33.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 shutdown_connections 2024-04-25T16:00:33.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.733+0000 7fdaa1508640 1 -- 172.21.15.87:0/2463928442 wait complete. 2024-04-25T16:00:33.753 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=5140 2024-04-25T16:00:33.753 INFO:tasks.mds_thrash.fs.[b]:waiting for 9 secs before reviving mds.c 2024-04-25T16:00:33.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.765+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5280151090 con 0x7f52801517d0 2024-04-25T16:00:33.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f527d7fa640 1 -- 172.21.15.87:0/1942778375 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7f527805b6d0 con 0x7f52801517d0 2024-04-25T16:00:33.768 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:33.768 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:33.768 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:33.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f526c06f400 msgr2=0x7f526c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f526c06f400 0x7f526c071910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f52740b1000 tx=0x7f52740a9070 comp rx=0 tx=0).stop 2024-04-25T16:00:33.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 msgr2=0x7f52800ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:33.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 0x7f52800ae3e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f527800b9c0 tx=0x7f527800be80 comp rx=0 tx=0).stop 2024-04-25T16:00:33.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 shutdown_connections 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f526c06f400 0x7f526c071910 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280158200 0x7f528014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801578b0 0x7f528014ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 --2- 172.21.15.87:0/1942778375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52801517d0 0x7f52800ae3e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 >> 172.21.15.87:0/1942778375 conn(0x7f528006d780 msgr2=0x7f52800c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 shutdown_connections 2024-04-25T16:00:33.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:33.769+0000 7f5286aca640 1 -- 172.21.15.87:0/1942778375 wait complete. 2024-04-25T16:00:33.789 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:35.790 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:35.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 Processor -- start 2024-04-25T16:00:35.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 -- start start 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b481518b0 0x7f3b4806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b4806fa10 0x7f3b4815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b48154fc0 con 0x7f3b480ad160 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4806ed60 con 0x7f3b481518b0 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4c9cd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3b480acb20 con 0x7f3b4806fa10 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b481518b0 0x7f3b4806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b481518b0 0x7f3b4806f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59570/0 (socket says 172.21.15.87:59570) 2024-04-25T16:00:35.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b45d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3b480ad160 0x7f3b480c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49408/0 (socket says 172.21.15.87:49408) 2024-04-25T16:00:35.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 -- 172.21.15.87:0/1388205555 learned_addr learned my addr 172.21.15.87:0/1388205555 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:35.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 -- 172.21.15.87:0/1388205555 >> v2:172.21.15.155:3300/0 conn(0x7f3b4806fa10 msgr2=0x7f3b4815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:35.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 --2- 172.21.15.87:0/1388205555 >> v2:172.21.15.155:3300/0 conn(0x7f3b4806fa10 0x7f3b4815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:35.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 -- 172.21.15.87:0/1388205555 >> v1:172.21.15.87:6789/0 conn(0x7f3b480ad160 legacy=0x7f3b480c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:35.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.949+0000 7f3b4659c640 1 -- 172.21.15.87:0/1388205555 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b480ace00 con 0x7f3b481518b0 2024-04-25T16:00:35.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4659c640 1 --2- 172.21.15.87:0/1388205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b481518b0 0x7f3b4806f4d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3b480734e0 tx=0x7f3b3801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4c2821d28dbeed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:35.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4559a640 1 -- 172.21.15.87:0/1388205555 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380a7070 con 0x7f3b481518b0 2024-04-25T16:00:35.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4559a640 1 -- 172.21.15.87:0/1388205555 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b380b0070 con 0x7f3b481518b0 2024-04-25T16:00:35.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4559a640 1 -- 172.21.15.87:0/1388205555 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380ab890 con 0x7f3b481518b0 2024-04-25T16:00:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/1388205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b481518b0 msgr2=0x7f3b4806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/1388205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b481518b0 0x7f3b4806f4d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3b480734e0 tx=0x7f3b3801c540 comp rx=0 tx=0).stop 2024-04-25T16:00:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/1388205555 shutdown_connections 2024-04-25T16:00:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/1388205555 >> v2:172.21.15.155:3300/0 conn(0x7f3b4806fa10 0x7f3b4815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/1388205555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b481518b0 0x7f3b4806f4d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:35.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/1388205555 >> 172.21.15.87:0/1388205555 conn(0x7f3b480c8770 msgr2=0x7f3b480c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/1388205555 shutdown_connections 2024-04-25T16:00:35.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.953+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/1388205555 wait complete. 2024-04-25T16:00:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 Processor -- start 2024-04-25T16:00:35.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 -- start start 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 0x7f3b48150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b480ad160 0x7f3b4814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b481518b0 0x7f3b4814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48161710 con 0x7f3b4806fa10 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3b48161890 con 0x7f3b480ad160 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4c9cd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3b48161a10 con 0x7f3b481518b0 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 0x7f3b48150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 0x7f3b48150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59580/0 (socket says 172.21.15.87:59580) 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b4659c640 1 -- 172.21.15.87:0/2464235942 learned_addr learned my addr 172.21.15.87:0/2464235942 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:35.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b45d9b640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b480ad160 0x7f3b4814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.957+0000 7f3b46d9d640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b481518b0 0x7f3b4814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4659c640 1 -- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b481518b0 msgr2=0x7f3b4814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4659c640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b481518b0 0x7f3b4814aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4659c640 1 -- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b480ad160 msgr2=0x7f3b4814d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4659c640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b480ad160 0x7f3b4814d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4659c640 1 -- 172.21.15.87:0/2464235942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b481f1a40 con 0x7f3b4806fa10 2024-04-25T16:00:35.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b46d9d640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b481518b0 0x7f3b4814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:35.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4659c640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 0x7f3b48150db0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3b380ad040 tx=0x7f3b3801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:35.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380be5f0 con 0x7f3b4806fa10 2024-04-25T16:00:35.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b380be790 con 0x7f3b4806fa10 2024-04-25T16:00:35.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380beb40 con 0x7f3b4806fa10 2024-04-25T16:00:35.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4814c140 con 0x7f3b4806fa10 2024-04-25T16:00:35.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b481f16d0 con 0x7f3b4806fa10 2024-04-25T16:00:35.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.961+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b48069bb0 con 0x7f3b4806fa10 2024-04-25T16:00:35.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.965+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3b380c8420 con 0x7f3b4806fa10 2024-04-25T16:00:35.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.965+0000 7f3b36ffd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3b2806f450 0x7f3b28071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:35.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.965+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f3b3812a6b0 con 0x7f3b4806fa10 2024-04-25T16:00:35.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.969+0000 7f3b45d9b640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3b2806f450 0x7f3b28071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:35.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.969+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b380c4070 con 0x7f3b4806fa10 2024-04-25T16:00:35.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:35.973+0000 7f3b45d9b640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3b2806f450 0x7f3b28071960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b48154620 tx=0x7f3b3c007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:36.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.169+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b4814d6c0 con 0x7f3b4806fa10 2024-04-25T16:00:36.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.169+0000 7f3b36ffd640 1 -- 172.21.15.87:0/2464235942 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7f3b38016130 con 0x7f3b4806fa10 2024-04-25T16:00:36.171 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:36.171 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:36.171 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3b2806f450 msgr2=0x7f3b28071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3b2806f450 0x7f3b28071960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b48154620 tx=0x7f3b3c007cf0 comp rx=0 tx=0).stop 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 msgr2=0x7f3b48150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 0x7f3b48150db0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3b380ad040 tx=0x7f3b3801ad80 comp rx=0 tx=0).stop 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 shutdown_connections 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3b2806f450 0x7f3b28071960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b481518b0 0x7f3b4814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b480ad160 0x7f3b4814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 --2- 172.21.15.87:0/2464235942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4806fa10 0x7f3b48150db0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 >> 172.21.15.87:0/2464235942 conn(0x7f3b480c8770 msgr2=0x7f3b48073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 shutdown_connections 2024-04-25T16:00:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:36.173+0000 7f3b4c9cd640 1 -- 172.21.15.87:0/2464235942 wait complete. 2024-04-25T16:00:36.193 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:36.447 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-04-25T16:00:36.445+0000 7ff2f3cd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T16:00:38.194 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:38.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.353+0000 7f81d74cc640 1 Processor -- start 2024-04-25T16:00:38.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.353+0000 7f81d74cc640 1 -- start start 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d74cc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f81d01529a0 0x7f81d0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d74cc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d00ae1b0 con 0x7f81d00adda0 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d74cc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d0072430 con 0x7f81d00ad990 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d74cc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f81d0074730 con 0x7f81d01529a0 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f81d00adda0 0x7f81d00c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49418/0 (socket says 172.21.15.87:49418) 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 -- 172.21.15.87:0/1165012965 learned_addr learned my addr 172.21.15.87:0/1165012965 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5268640 1 --2- 172.21.15.87:0/1165012965 >> v2:172.21.15.155:3300/0 conn(0x7f81d01529a0 0x7f81d0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660595272 0 0) 0x7f81d00ae1b0 con 0x7f81d00adda0 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b8003530 con 0x7f81d00adda0 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006327587 0 0) 0x7f81b8003530 con 0x7f81d00adda0 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 >> v2:172.21.15.155:3300/0 conn(0x7f81d01529a0 msgr2=0x7f81d0071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 --2- 172.21.15.87:0/1165012965 >> v2:172.21.15.155:3300/0 conn(0x7f81d01529a0 0x7f81d0071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 >> v1:172.21.15.155:6789/0 conn(0x7f81d00ad990 legacy=0x7f81d00c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d0074a10 con 0x7f81d00adda0 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f81c8001680 con 0x7f81d00adda0 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 >> v1:172.21.15.87:6789/0 conn(0x7f81d00adda0 legacy=0x7f81d00c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b80039c0 0x7f81b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81b8004810 0x7f81b8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005260 0x7f81b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0074730 con 0x7f81b8005260 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81b800c1f0 con 0x7f81b80039c0 2024-04-25T16:00:38.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81b800c3f0 con 0x7f81b8004810 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005260 0x7f81b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5268640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b80039c0 0x7f81b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d4a67640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81b8004810 0x7f81b8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 -- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81b8004810 msgr2=0x7f81b8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81b8004810 0x7f81b8004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 -- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b80039c0 msgr2=0x7f81b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b80039c0 0x7f81b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5a69640 1 -- 172.21.15.87:0/1165012965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b8003530 con 0x7f81b8005260 2024-04-25T16:00:38.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.357+0000 7f81d5268640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b80039c0 0x7f81b8003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d5a69640 1 -- 172.21.15.87:0/1165012965 reap_dead start 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005260 0x7f81b800b9d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f81d00c2ce0 tx=0x7f81c801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80a22c242bb123a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8007d00 con 0x7f81b8005260 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c8005b00 con 0x7f81b8005260 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81cffff640 1 -- 172.21.15.87:0/1165012965 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8007070 con 0x7f81b8005260 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 -- 172.21.15.87:0/1165012965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005260 msgr2=0x7f81b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005260 0x7f81b800b9d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f81d00c2ce0 tx=0x7f81c801f370 comp rx=0 tx=0).stop 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 -- 172.21.15.87:0/1165012965 shutdown_connections 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1165012965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005260 0x7f81b800b9d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 -- 172.21.15.87:0/1165012965 >> 172.21.15.87:0/1165012965 conn(0x7f81d00c8770 msgr2=0x7f81d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 -- 172.21.15.87:0/1165012965 shutdown_connections 2024-04-25T16:00:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 -- 172.21.15.87:0/1165012965 wait complete. 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 Processor -- start 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.361+0000 7f81d74cc640 1 -- start start 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b8005260 0x7f81d0153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81d01eed30 0x7f81d00c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 0x7f81d0148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81d00ab1a0 con 0x7f81d0148750 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0074fd0 con 0x7f81b8005260 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81d0071e50 con 0x7f81d01eed30 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 0x7f81d0148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 0x7f81d0148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59602/0 (socket says 172.21.15.87:59602) 2024-04-25T16:00:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 -- 172.21.15.87:0/1102518114 learned_addr learned my addr 172.21.15.87:0/1102518114 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5268640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b8005260 0x7f81d0153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d4a67640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81d01eed30 0x7f81d00c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 -- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81d01eed30 msgr2=0x7f81d00c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81d01eed30 0x7f81d00c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 -- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b8005260 msgr2=0x7f81d0153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b8005260 0x7f81d0153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 -- 172.21.15.87:0/1102518114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d00c7b70 con 0x7f81d0148750 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d4a67640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81d01eed30 0x7f81d00c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5a69640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 0x7f81d0148b60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f81c809bac0 tx=0x7f81b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8001c40 con 0x7f81d0148750 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80049f0 con 0x7f81d0148750 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d01ec700 con 0x7f81d0148750 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8004da0 con 0x7f81d0148750 2024-04-25T16:00:38.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d01ebc20 con 0x7f81d0148750 2024-04-25T16:00:38.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d01537c0 con 0x7f81d0148750 2024-04-25T16:00:38.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f81c8007070 con 0x7f81d0148750 2024-04-25T16:00:38.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81cdffb640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f81bc06f400 0x7f81bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:38.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f81c812c6e0 con 0x7f81d0148750 2024-04-25T16:00:38.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.365+0000 7f81d5268640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f81bc06f400 0x7f81bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:38.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.369+0000 7f81d5268640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f81bc06f400 0x7f81bc071910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f81d0073d40 tx=0x7f81c000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:38.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.369+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81c8019080 con 0x7f81d0148750 2024-04-25T16:00:38.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81d00731c0 con 0x7f81d0148750 2024-04-25T16:00:38.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81cdffb640 1 -- 172.21.15.87:0/1102518114 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7f81c80f9060 con 0x7f81d0148750 2024-04-25T16:00:38.569 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:38.569 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:38.569 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:38.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f81bc06f400 msgr2=0x7f81bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f81bc06f400 0x7f81bc071910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f81d0073d40 tx=0x7f81c000d040 comp rx=0 tx=0).stop 2024-04-25T16:00:38.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 msgr2=0x7f81d0148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 0x7f81d0148b60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f81c809bac0 tx=0x7f81b8005840 comp rx=0 tx=0).stop 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 shutdown_connections 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f81bc06f400 0x7f81bc071910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81d0148750 0x7f81d0148b60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81d01eed30 0x7f81d00c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 --2- 172.21.15.87:0/1102518114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81b8005260 0x7f81d0153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 >> 172.21.15.87:0/1102518114 conn(0x7f81d00c8770 msgr2=0x7f81d014e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 shutdown_connections 2024-04-25T16:00:38.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:38.569+0000 7f81d74cc640 1 -- 172.21.15.87:0/1102518114 wait complete. 2024-04-25T16:00:38.591 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:40.514 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:40.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:40.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:40.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.757+0000 7fc221fc7640 1 Processor -- start 2024-04-25T16:00:40.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc221fc7640 1 -- start start 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc221fc7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc21c161410 0x7fc21c163830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc221fc7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc21c0c7570 con 0x7fc21c0cb030 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc221fc7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc21c15b8b0 con 0x7fc21c15ad90 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc221fc7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc21c15b5d0 con 0x7fc21c161410 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21affd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc21c0cb030 0x7fc21c15fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49434/0 (socket says 172.21.15.87:49434) 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21affd640 1 -- 172.21.15.87:0/3213141826 learned_addr learned my addr 172.21.15.87:0/3213141826 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:40.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3213141826 >> v2:172.21.15.155:3300/0 conn(0x7fc21c161410 0x7fc21c163830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197960201 0 0) 0x7fc21c0c7570 con 0x7fc21c0cb030 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc204003530 con 0x7fc21c0cb030 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1283555772 0 0) 0x7fc204003530 con 0x7fc21c0cb030 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 >> v2:172.21.15.155:3300/0 conn(0x7fc21c161410 msgr2=0x7fc21c163830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 --2- 172.21.15.87:0/3213141826 >> v2:172.21.15.155:3300/0 conn(0x7fc21c161410 0x7fc21c163830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 >> v1:172.21.15.155:6789/0 conn(0x7fc21c15ad90 legacy=0x7fc21c0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c0c2290 con 0x7fc21c0cb030 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fc210001680 con 0x7fc21c0cb030 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 >> v1:172.21.15.87:6789/0 conn(0x7fc21c0cb030 legacy=0x7fc21c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040039c0 0x7fc204003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc204004810 0x7fc204004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc20400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c15b5d0 con 0x7fc204005360 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc20400c290 con 0x7fc204004810 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc20400c490 con 0x7fc2040039c0 2024-04-25T16:00:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc20400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21b7fe640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040039c0 0x7fc204003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21affd640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc204004810 0x7fc204004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 -- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040039c0 msgr2=0x7fc204003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2040039c0 0x7fc204003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 -- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc204004810 msgr2=0x7fc204004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc204004810 0x7fc204004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.761+0000 7fc21bfff640 1 -- 172.21.15.87:0/3213141826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc204003530 con 0x7fc204005360 2024-04-25T16:00:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc21bfff640 1 -- 172.21.15.87:0/3213141826 reap_dead start 2024-04-25T16:00:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc20400b9d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc214009fc0 tx=0x7fc21401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4276ae01f1940ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214009c10 con 0x7fc204005360 2024-04-25T16:00:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc214003ba0 con 0x7fc204005360 2024-04-25T16:00:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc21a7fc640 1 -- 172.21.15.87:0/3213141826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2140a58b0 con 0x7fc204005360 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 -- 172.21.15.87:0/3213141826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 msgr2=0x7fc20400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc20400b9d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc214009fc0 tx=0x7fc21401ccc0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 -- 172.21.15.87:0/3213141826 shutdown_connections 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3213141826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc20400b9d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 -- 172.21.15.87:0/3213141826 >> 172.21.15.87:0/3213141826 conn(0x7fc21c0c9330 msgr2=0x7fc21c0c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 -- 172.21.15.87:0/3213141826 shutdown_connections 2024-04-25T16:00:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.765+0000 7fc221fc7640 1 -- 172.21.15.87:0/3213141826 wait complete. 2024-04-25T16:00:40.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 Processor -- start 2024-04-25T16:00:40.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- start start 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc21c1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc21c1634c0 0x7fc21c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc21c160f30 0x7fc21c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c15b1a0 con 0x7fc204005360 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c0ca190 con 0x7fc21c160f30 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc21c15b320 con 0x7fc21c1634c0 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc21c1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc21c1473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59624/0 (socket says 172.21.15.87:59624) 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 -- 172.21.15.87:0/3014702268 learned_addr learned my addr 172.21.15.87:0/3014702268 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc21c160f30 0x7fc21c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21affd640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc21c1634c0 0x7fc21c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 -- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc21c1634c0 msgr2=0x7fc21c159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc21c1634c0 0x7fc21c159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 -- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc21c160f30 msgr2=0x7fc21c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc21c160f30 0x7fc21c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 -- 172.21.15.87:0/3014702268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c06d620 con 0x7fc204005360 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21bfff640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc21c160f30 0x7fc21c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc21b7fe640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc21c1473d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e4d0 tx=0x7fc20c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0052e0 con 0x7fc204005360 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c018070 con 0x7fc204005360 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c003820 con 0x7fc204005360 2024-04-25T16:00:40.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c06cd80 con 0x7fc204005360 2024-04-25T16:00:40.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c06d340 con 0x7fc204005360 2024-04-25T16:00:40.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.769+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c069bb0 con 0x7fc204005360 2024-04-25T16:00:40.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.773+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc20c0039c0 con 0x7fc204005360 2024-04-25T16:00:40.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.773+0000 7fc203fff640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc20806f430 0x7fc208071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:40.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.773+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7fc20c08f620 con 0x7fc204005360 2024-04-25T16:00:40.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.773+0000 7fc21affd640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc20806f430 0x7fc208071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:40.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.773+0000 7fc21affd640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc20806f430 0x7fc208071940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc210001210 tx=0x7fc210001180 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.777+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc20c05bec0 con 0x7fc204005360 2024-04-25T16:00:40.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.969+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc21c0c7760 con 0x7fc204005360 2024-04-25T16:00:40.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc203fff640 1 -- 172.21.15.87:0/3014702268 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7fc20c005480 con 0x7fc204005360 2024-04-25T16:00:40.972 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:40.972 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:40.973 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:40.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc20806f430 msgr2=0x7fc208071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc20806f430 0x7fc208071940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc210001210 tx=0x7fc210001180 comp rx=0 tx=0).stop 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 msgr2=0x7fc21c1473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc21c1473d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00e4d0 tx=0x7fc20c00e990 comp rx=0 tx=0).stop 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 shutdown_connections 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc20806f430 0x7fc208071940 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc21c160f30 0x7fc21c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc21c1634c0 0x7fc21c159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 --2- 172.21.15.87:0/3014702268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc204005360 0x7fc21c1473d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 >> 172.21.15.87:0/3014702268 conn(0x7fc21c0c9330 msgr2=0x7fc21c06e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 shutdown_connections 2024-04-25T16:00:40.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:40.973+0000 7fc221fc7640 1 -- 172.21.15.87:0/3014702268 wait complete. 2024-04-25T16:00:40.992 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:42.754 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-04-25T16:00:42.754 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T16:00:42.755 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T16:00:42.757 INFO:tasks.ceph.mds.c:Started 2024-04-25T16:00:42.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:42.863 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2024-04-25T16:00:42.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.905+0000 7f8ff8f50640 1 Processor -- start 2024-04-25T16:00:42.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.905+0000 7f8ff8f50640 1 -- start start 2024-04-25T16:00:42.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.905+0000 7f8ff8f50640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:42.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8ff4155730 0x7f8ff415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff4152d90 con 0x7f8ff4155320 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40aa290 con 0x7f8ff4155730 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff41598b0 con 0x7f8ff4152980 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff2d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8ff4155730 0x7f8ff415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff1d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8ff4155320 0x7f8ff4074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57684/0 (socket says 172.21.15.87:57684) 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff1d9b640 1 -- 172.21.15.87:0/886722772 learned_addr learned my addr 172.21.15.87:0/886722772 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff259c640 1 --2- 172.21.15.87:0/886722772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/886722772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 msgr2=0x7f8ff40c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff2d9d640 1 --2- 172.21.15.87:0/886722772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff40c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/886722772 >> v1:172.21.15.87:6789/0 conn(0x7f8ff4155320 legacy=0x7f8ff4074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff159a640 1 -- 172.21.15.87:0/886722772 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1815018218 0 0) 0x7f8ff4152d90 con 0x7f8ff4155320 2024-04-25T16:00:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/886722772 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff40ca2f0 con 0x7f8ff4155730 2024-04-25T16:00:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff2d9d640 1 --2- 172.21.15.87:0/886722772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff415fca0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009d90 tx=0x7f8fec01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefba0e37814c3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff159a640 1 -- 172.21.15.87:0/886722772 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0b2070 con 0x7f8ff4155730 2024-04-25T16:00:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff159a640 1 -- 172.21.15.87:0/886722772 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a57c0 con 0x7f8ff4155730 2024-04-25T16:00:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff159a640 1 -- 172.21.15.87:0/886722772 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a5b90 con 0x7f8ff4155730 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- 172.21.15.87:0/886722772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 msgr2=0x7f8ff415fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/886722772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff415fca0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009d90 tx=0x7f8fec01c900 comp rx=0 tx=0).stop 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- 172.21.15.87:0/886722772 shutdown_connections 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/886722772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff415fca0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/886722772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff40c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- 172.21.15.87:0/886722772 >> 172.21.15.87:0/886722772 conn(0x7f8ff40ac550 msgr2=0x7f8ff40ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- 172.21.15.87:0/886722772 shutdown_connections 2024-04-25T16:00:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.909+0000 7f8ff8f50640 1 -- 172.21.15.87:0/886722772 wait complete. 2024-04-25T16:00:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 Processor -- start 2024-04-25T16:00:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 -- start start 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff41f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff4155320 0x7f8ff414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff4147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4158f70 con 0x7f8ff4155730 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4158a30 con 0x7f8ff4155320 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff4074870 con 0x7f8ff4152980 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff4147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff4147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50148/0 (socket says 172.21.15.87:50148) 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/121776026 learned_addr learned my addr 172.21.15.87:0/121776026 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff259c640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff41f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff1d9b640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff4155320 0x7f8ff414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 msgr2=0x7f8ff41f3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff41f3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff4155320 msgr2=0x7f8ff414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:42.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff4155320 0x7f8ff414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 -- 172.21.15.87:0/121776026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff414d400 con 0x7f8ff4155730 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff1d9b640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff4155320 0x7f8ff414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff2d9d640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff4147bc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b0040 tx=0x7f8fec0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0b2050 con 0x7f8ff4155730 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec0be070 con 0x7f8ff4155730 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff415ebc0 con 0x7f8ff4155730 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0ada90 con 0x7f8ff4155730 2024-04-25T16:00:42.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.913+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff415f180 con 0x7f8ff4155730 2024-04-25T16:00:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.917+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff4069bb0 con 0x7f8ff4155730 2024-04-25T16:00:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.917+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8fec0adc30 con 0x7f8ff4155730 2024-04-25T16:00:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.917+0000 7f8fe2ffd640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8fd406f400 0x7f8fd4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.917+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7f8fec12aa00 con 0x7f8ff4155730 2024-04-25T16:00:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.917+0000 7f8ff259c640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8fd406f400 0x7f8fd4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:42.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.917+0000 7f8ff259c640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8fd406f400 0x7f8fd4071910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a8d0 tx=0x7f8fe4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:42.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:42.921+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8fec016580 con 0x7f8ff4155730 2024-04-25T16:00:42.994 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:43.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.109+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ff40c9b90 con 0x7f8ff4155730 2024-04-25T16:00:43.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8fe2ffd640 1 -- 172.21.15.87:0/121776026 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7f8fec0f7330 con 0x7f8ff4155730 2024-04-25T16:00:43.112 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:43.112 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:43.113 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8fd406f400 msgr2=0x7f8fd4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8fd406f400 0x7f8fd4071910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a8d0 tx=0x7f8fe4008040 comp rx=0 tx=0).stop 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 msgr2=0x7f8ff4147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff4147bc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b0040 tx=0x7f8fec0196a0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 shutdown_connections 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8fd406f400 0x7f8fd4071910 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ff4155730 0x7f8ff4147bc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff4155320 0x7f8ff414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 --2- 172.21.15.87:0/121776026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff4152980 0x7f8ff41f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 >> 172.21.15.87:0/121776026 conn(0x7f8ff40ac550 msgr2=0x7f8ff4151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:43.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 shutdown_connections 2024-04-25T16:00:43.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.113+0000 7f8ff8f50640 1 -- 172.21.15.87:0/121776026 wait complete. 2024-04-25T16:00:43.134 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T16:00:43.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd6023a6640 1 Processor -- start 2024-04-25T16:00:43.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd6023a6640 1 -- start start 2024-04-25T16:00:43.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd6023a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5fc1593b0 0x7fd5fc152870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd6023a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5fc0ae8e0 con 0x7fd5fc06c670 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd6023a6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5fc1588d0 con 0x7fd5fc0a8cc0 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd6023a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd5fc0aebc0 con 0x7fd5fc1593b0 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5fb7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5fc1593b0 0x7fd5fc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5fb7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5fc1593b0 0x7fd5fc152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50158/0 (socket says 172.21.15.87:50158) 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5fb7fe640 1 -- 172.21.15.87:0/2774671407 learned_addr learned my addr 172.21.15.87:0/2774671407 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5fb7fe640 1 -- 172.21.15.87:0/2774671407 >> v1:172.21.15.155:6789/0 conn(0x7fd5fc0a8cc0 legacy=0x7fd5fc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5faffd640 1 -- 172.21.15.87:0/2774671407 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1143455848 0 0) 0x7fd5fc0ae8e0 con 0x7fd5fc06c670 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5fb7fe640 1 -- 172.21.15.87:0/2774671407 >> v1:172.21.15.87:6789/0 conn(0x7fd5fc06c670 legacy=0x7fd5fc15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.133+0000 7fd5fb7fe640 1 -- 172.21.15.87:0/2774671407 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc158bb0 con 0x7fd5fc1593b0 2024-04-25T16:00:43.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd5fb7fe640 1 --2- 172.21.15.87:0/2774671407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc1593b0 0x7fd5fc152870 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009870 tx=0x7fd5ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e2edd3c74f0518 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:43.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd5faffd640 1 -- 172.21.15.87:0/2774671407 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0b0070 con 0x7fd5fc1593b0 2024-04-25T16:00:43.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd5faffd640 1 -- 172.21.15.87:0/2774671407 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec0ab600 con 0x7fd5fc1593b0 2024-04-25T16:00:43.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd5faffd640 1 -- 172.21.15.87:0/2774671407 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0ab9d0 con 0x7fd5fc1593b0 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 -- 172.21.15.87:0/2774671407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc1593b0 msgr2=0x7fd5fc152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2774671407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc1593b0 0x7fd5fc152870 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009870 tx=0x7fd5ec01c490 comp rx=0 tx=0).stop 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 -- 172.21.15.87:0/2774671407 shutdown_connections 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2774671407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc1593b0 0x7fd5fc152870 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 -- 172.21.15.87:0/2774671407 >> 172.21.15.87:0/2774671407 conn(0x7fd5fc06d780 msgr2=0x7fd5fc06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 -- 172.21.15.87:0/2774671407 shutdown_connections 2024-04-25T16:00:43.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.137+0000 7fd6023a6640 1 -- 172.21.15.87:0/2774671407 wait complete. 2024-04-25T16:00:43.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 Processor -- start 2024-04-25T16:00:43.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- start start 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 0x7fd5fc0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0a8cc0 0x7fd5fc1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc1593b0 0x7fd5fc14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc06ce90 con 0x7fd5fc06c670 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc0ac900 con 0x7fd5fc1593b0 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc163d10 con 0x7fd5fc0a8cc0 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 0x7fd5fc0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 0x7fd5fc0c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50170/0 (socket says 172.21.15.87:50170) 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 -- 172.21.15.87:0/2967599114 learned_addr learned my addr 172.21.15.87:0/2967599114 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 -- 172.21.15.87:0/2967599114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0a8cc0 msgr2=0x7fd5fc1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0a8cc0 0x7fd5fc1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 -- 172.21.15.87:0/2967599114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc1593b0 msgr2=0x7fd5fc14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc1593b0 0x7fd5fc14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 -- 172.21.15.87:0/2967599114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc1523a0 con 0x7fd5fc06c670 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5fbfff640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 0x7fd5fc0c7870 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400b470 tx=0x7fd5e400b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4015030 con 0x7fd5fc06c670 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e4004020 con 0x7fd5fc06c670 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc14fe10 con 0x7fd5fc06c670 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4004410 con 0x7fd5fc06c670 2024-04-25T16:00:43.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc1500d0 con 0x7fd5fc06c670 2024-04-25T16:00:43.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.141+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5fc069bb0 con 0x7fd5fc06c670 2024-04-25T16:00:43.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.145+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd5e4018070 con 0x7fd5fc06c670 2024-04-25T16:00:43.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.145+0000 7fd5f8ff9640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd5dc06f430 0x7fd5dc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:43.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.145+0000 7fd5fb7fe640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd5dc06f430 0x7fd5dc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:43.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.145+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7469+0+0 (secure 0 0 0) 0x7fd5e408f400 con 0x7fd5fc06c670 2024-04-25T16:00:43.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.145+0000 7fd5fb7fe640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd5dc06f430 0x7fd5dc071940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0ad000 tx=0x7fd5ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:43.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.149+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5e405bcb0 con 0x7fd5fc06c670 2024-04-25T16:00:43.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.329+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5fc070890 con 0x7fd5fc06c670 2024-04-25T16:00:43.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd5f8ff9640 1 -- 172.21.15.87:0/2967599114 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5671 (secure 0 0 0) 0x7fd5e405b5b0 con 0x7fd5fc06c670 2024-04-25T16:00:43.332 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:43.332 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:17.411541+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":11,"addr":"172.21.15.155:6835/3802722727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3802722727},{"type":"v1","addr":"172.21.15.155:6835","nonce":3802722727}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:43.333 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 62 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd5dc06f430 msgr2=0x7fd5dc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd5dc06f430 0x7fd5dc071940 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0ad000 tx=0x7fd5ec008040 comp rx=0 tx=0).stop 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 msgr2=0x7fd5fc0c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 0x7fd5fc0c7870 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400b470 tx=0x7fd5e400b930 comp rx=0 tx=0).stop 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 shutdown_connections 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd5dc06f430 0x7fd5dc071940 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5fc1593b0 0x7fd5fc14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5fc0a8cc0 0x7fd5fc1488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 --2- 172.21.15.87:0/2967599114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5fc06c670 0x7fd5fc0c7870 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 >> 172.21.15.87:0/2967599114 conn(0x7fd5fc06d780 msgr2=0x7fd5fc14ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 shutdown_connections 2024-04-25T16:00:43.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:43.333+0000 7fd6023a6640 1 -- 172.21.15.87:0/2967599114 wait complete. 2024-04-25T16:00:43.352 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-25T16:00:45.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:45.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 Processor -- start 2024-04-25T16:00:45.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 -- start start 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158e10 0x7f12b0152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12b0152bc0 0x7f12b015fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b0063660 con 0x7f12b0158a00 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f12b00c5470 con 0x7f12b0152bc0 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b7131640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12b00ab670 con 0x7f12b0158e10 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b56ce640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12b0152bc0 0x7f12b015fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b4ecd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f12b0158a00 0x7f12b00ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57696/0 (socket says 172.21.15.87:57696) 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b4ecd640 1 -- 172.21.15.87:0/477545006 learned_addr learned my addr 172.21.15.87:0/477545006 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12affff640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158e10 0x7f12b0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b56ce640 1 -- 172.21.15.87:0/477545006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158e10 msgr2=0x7f12b0152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b56ce640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158e10 0x7f12b0152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b56ce640 1 -- 172.21.15.87:0/477545006 >> v1:172.21.15.87:6789/0 conn(0x7f12b0158a00 legacy=0x7f12b00ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12b56ce640 1 -- 172.21.15.87:0/477545006 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b00ab930 con 0x7f12b0152bc0 2024-04-25T16:00:45.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.313+0000 7f12affff640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158e10 0x7f12b0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:45.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b56ce640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0152bc0 0x7f12b015fb60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009d90 tx=0x7f12a801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400f4a66577efbca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12af7fe640 1 -- 172.21.15.87:0/477545006 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80b2070 con 0x7f12b0152bc0 2024-04-25T16:00:45.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12af7fe640 1 -- 172.21.15.87:0/477545006 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a80a58e0 con 0x7f12b0152bc0 2024-04-25T16:00:45.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12af7fe640 1 -- 172.21.15.87:0/477545006 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80a5cb0 con 0x7f12b0152bc0 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 -- 172.21.15.87:0/477545006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0152bc0 msgr2=0x7f12b015fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0152bc0 0x7f12b015fb60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009d90 tx=0x7f12a801c970 comp rx=0 tx=0).stop 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 -- 172.21.15.87:0/477545006 shutdown_connections 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0152bc0 0x7f12b015fb60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 --2- 172.21.15.87:0/477545006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158e10 0x7f12b0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 -- 172.21.15.87:0/477545006 >> 172.21.15.87:0/477545006 conn(0x7f12b006d650 msgr2=0x7f12b00c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 -- 172.21.15.87:0/477545006 shutdown_connections 2024-04-25T16:00:45.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 -- 172.21.15.87:0/477545006 wait complete. 2024-04-25T16:00:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 Processor -- start 2024-04-25T16:00:45.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.317+0000 7f12b7131640 1 -- start start 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12b0152bc0 0x7f12b01f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158a00 0x7f12b0145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 0x7f12b0142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00aef70 con 0x7f12b0158e10 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00ae180 con 0x7f12b0152bc0 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12b00af0f0 con 0x7f12b0158a00 2024-04-25T16:00:45.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 0x7f12b0142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 0x7f12b0142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50184/0 (socket says 172.21.15.87:50184) 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 -- 172.21.15.87:0/2884569760 learned_addr learned my addr 172.21.15.87:0/2884569760 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b4ecd640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12b0152bc0 0x7f12b01f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12affff640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158a00 0x7f12b0145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 -- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158a00 msgr2=0x7f12b0145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158a00 0x7f12b0145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 -- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12b0152bc0 msgr2=0x7f12b01f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12b0152bc0 0x7f12b01f0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 -- 172.21.15.87:0/2884569760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b00727a0 con 0x7f12b0158e10 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12affff640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158a00 0x7f12b0145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b4ecd640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12b0152bc0 0x7f12b01f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b56ce640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 0x7f12b0142580 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f12a80b0040 tx=0x7f12a8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80b2050 con 0x7f12b0158e10 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b0072a80 con 0x7f12b0158e10 2024-04-25T16:00:45.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a80be070 con 0x7f12b0158e10 2024-04-25T16:00:45.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80ada70 con 0x7f12b0158e10 2024-04-25T16:00:45.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b01f4960 con 0x7f12b0158e10 2024-04-25T16:00:45.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.321+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b0069bb0 con 0x7f12b0158e10 2024-04-25T16:00:45.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.325+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f12a80adc10 con 0x7f12b0158e10 2024-04-25T16:00:45.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.325+0000 7f12ad7fa640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f129406f400 0x7f1294071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.325+0000 7f12b4ecd640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f129406f400 0x7f1294071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.325+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f12a812ad20 con 0x7f12b0158e10 2024-04-25T16:00:45.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.325+0000 7f12b4ecd640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f129406f400 0x7f1294071910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000f70 tx=0x7f12a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.333+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12a8016560 con 0x7f12b0158e10 2024-04-25T16:00:45.353 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:45.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 Processor -- start 2024-04-25T16:00:45.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 -- start start 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7930154ae0 0x7f7930157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79300c96c0 0x7f79300b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300c9ad0 con 0x7f79300c92b0 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f793015a9e0 con 0x7f79300c96c0 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f7938324640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7930158380 con 0x7f7930154ae0 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f79368c1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79300c96c0 0x7f79300b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f79360c0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7930154ae0 0x7f7930157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f79358bf640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f79300c92b0 0x7f79300cac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:52808/0 (socket says 172.21.15.87:52808) 2024-04-25T16:00:45.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.481+0000 7f79358bf640 1 -- 172.21.15.87:0/1877479382 learned_addr learned my addr 172.21.15.87:0/1877479382 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:45.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79368c1640 1 -- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7930154ae0 msgr2=0x7f7930157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:45.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79368c1640 1 --2- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7930154ae0 0x7f7930157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79368c1640 1 -- 172.21.15.87:0/1877479382 >> v1:172.21.15.155:6789/0 conn(0x7f79300c92b0 legacy=0x7f79300cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79368c1640 1 -- 172.21.15.87:0/1877479382 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300c7d40 con 0x7f79300c96c0 2024-04-25T16:00:45.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79360c0640 1 --2- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7930154ae0 0x7f7930157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:00:45.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79368c1640 1 --2- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c96c0 0x7f79300b1af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7928009d90 tx=0x7f792801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e369538ca236c784 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79350be640 1 -- 172.21.15.87:0/1877479382 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280b2070 con 0x7f79300c96c0 2024-04-25T16:00:45.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79350be640 1 -- 172.21.15.87:0/1877479382 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79280a58b0 con 0x7f79300c96c0 2024-04-25T16:00:45.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.485+0000 7f79350be640 1 -- 172.21.15.87:0/1877479382 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280a5c80 con 0x7f79300c96c0 2024-04-25T16:00:45.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c96c0 msgr2=0x7f79300b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 --2- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c96c0 0x7f79300b1af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7928009d90 tx=0x7f792801c8e0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- 172.21.15.87:0/1877479382 shutdown_connections 2024-04-25T16:00:45.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 --2- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c96c0 0x7f79300b1af0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 --2- 172.21.15.87:0/1877479382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7930154ae0 0x7f7930157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- 172.21.15.87:0/1877479382 >> 172.21.15.87:0/1877479382 conn(0x7f79300ae490 msgr2=0x7f79300ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:45.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- 172.21.15.87:0/1877479382 shutdown_connections 2024-04-25T16:00:45.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- 172.21.15.87:0/1877479382 wait complete. 2024-04-25T16:00:45.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 Processor -- start 2024-04-25T16:00:45.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- start start 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c92b0 0x7f7930157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79300c96c0 0x7f79301560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 0x7f7930153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79300cb370 con 0x7f7930154ae0 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79300ca7e0 con 0x7f79300c92b0 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f7938324640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79300cb4f0 con 0x7f79300c96c0 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.489+0000 7f79368c1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 0x7f7930153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 0x7f7930153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50186/0 (socket says 172.21.15.87:50186) 2024-04-25T16:00:45.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 -- 172.21.15.87:0/3377165561 learned_addr learned my addr 172.21.15.87:0/3377165561 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:45.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79360c0640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c92b0 0x7f7930157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79358bf640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79300c96c0 0x7f79301560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 -- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79300c96c0 msgr2=0x7f79301560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79300c96c0 0x7f79301560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 -- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c92b0 msgr2=0x7f7930157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c92b0 0x7f7930157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 -- 172.21.15.87:0/3377165561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79301f4f90 con 0x7f7930154ae0 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79368c1640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 0x7f7930153910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f79280b0040 tx=0x7f7928019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280b2050 con 0x7f7930154ae0 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79280be070 con 0x7f7930154ae0 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280ad870 con 0x7f7930154ae0 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79301f5270 con 0x7f7930154ae0 2024-04-25T16:00:45.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79301f1490 con 0x7f7930154ae0 2024-04-25T16:00:45.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79300afcb0 con 0x7f7930154ae0 2024-04-25T16:00:45.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f79280ada10 con 0x7f7930154ae0 2024-04-25T16:00:45.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7926ffd640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f791406f430 0x7f7914071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f792812a2b0 con 0x7f7930154ae0 2024-04-25T16:00:45.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.493+0000 7f79360c0640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f791406f430 0x7f7914071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.497+0000 7f79360c0640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f791406f430 0x7f7914071940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f792c009580 tx=0x7f792c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.505+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79280c7020 con 0x7f7930154ae0 2024-04-25T16:00:45.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.545+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12b00c2fb0 con 0x7f12b0158e10 2024-04-25T16:00:45.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.545+0000 7f12ad7fa640 1 -- 172.21.15.87:0/2884569760 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5660 (secure 0 0 0) 0x7f12a80f74e0 con 0x7f12b0158e10 2024-04-25T16:00:45.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:45.545 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:43.549489+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:45.545 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 64 2024-04-25T16:00:45.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f129406f400 msgr2=0x7f1294071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f129406f400 0x7f1294071910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000f70 tx=0x7f12a4009040 comp rx=0 tx=0).stop 2024-04-25T16:00:45.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 msgr2=0x7f12b0142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 0x7f12b0142580 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f12a80b0040 tx=0x7f12a8019710 comp rx=0 tx=0).stop 2024-04-25T16:00:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 shutdown_connections 2024-04-25T16:00:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f129406f400 0x7f1294071910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12b0158e10 0x7f12b0142580 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12b0158a00 0x7f12b0145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 --2- 172.21.15.87:0/2884569760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12b0152bc0 0x7f12b01f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 >> 172.21.15.87:0/2884569760 conn(0x7f12b006d650 msgr2=0x7f12b01563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:45.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 shutdown_connections 2024-04-25T16:00:45.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.549+0000 7f12b7131640 1 -- 172.21.15.87:0/2884569760 wait complete. 2024-04-25T16:00:45.576 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T16:00:45.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7930069bb0 con 0x7f7930154ae0 2024-04-25T16:00:45.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7926ffd640 1 -- 172.21.15.87:0/3377165561 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5660 (secure 0 0 0) 0x7f7928016560 con 0x7f7930154ae0 2024-04-25T16:00:45.713 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:45.713 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:43.549489+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:45.713 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 64 2024-04-25T16:00:45.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f791406f430 msgr2=0x7f7914071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f791406f430 0x7f7914071940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f792c009580 tx=0x7f792c009190 comp rx=0 tx=0).stop 2024-04-25T16:00:45.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 msgr2=0x7f7930153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 0x7f7930153910 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f79280b0040 tx=0x7f7928019680 comp rx=0 tx=0).stop 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 shutdown_connections 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f791406f430 0x7f7914071940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7930154ae0 0x7f7930153910 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79300c96c0 0x7f79301560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 --2- 172.21.15.87:0/3377165561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79300c92b0 0x7f7930157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 >> 172.21.15.87:0/3377165561 conn(0x7f79300ae490 msgr2=0x7f7930162140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 shutdown_connections 2024-04-25T16:00:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.713+0000 7f7938324640 1 -- 172.21.15.87:0/3377165561 wait complete. 2024-04-25T16:00:45.732 INFO:tasks.mds_thrash.fs.[a]:mds.b down, removed from mdsmap 2024-04-25T16:00:45.732 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T16:00:45.732 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 Processor -- start 2024-04-25T16:00:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 -- start start 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f36181517d0 0x7f36180c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f36181578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36180c5290 con 0x7f3618157df0 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f36180c5e80 con 0x7f36181517d0 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361ca57640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3618154fd0 con 0x7f36180c9ae0 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f3616d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3618157df0 0x7f361806ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57712/0 (socket says 172.21.15.87:57712) 2024-04-25T16:00:45.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f3616d9d640 1 -- 172.21.15.87:0/669037883 learned_addr learned my addr 172.21.15.87:0/669037883 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361659c640 1 --2- 172.21.15.87:0/669037883 >> v2:172.21.15.155:3300/0 conn(0x7f36181517d0 0x7f36180c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f3615d9b640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f36181578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187420503 0 0) 0x7f36180c5290 con 0x7f3618157df0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3600003530 con 0x7f3618157df0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 903126717 0 0) 0x7f3600003530 con 0x7f3618157df0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 msgr2=0x7f36181578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f36181578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 >> v2:172.21.15.155:3300/0 conn(0x7f36181517d0 msgr2=0x7f36180c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 --2- 172.21.15.87:0/669037883 >> v2:172.21.15.155:3300/0 conn(0x7f36181517d0 0x7f36180c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36180c5550 con 0x7f3618157df0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f3610001a00 con 0x7f3618157df0 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 >> v1:172.21.15.87:6789/0 conn(0x7f3618157df0 legacy=0x7f361806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36000039c0 0x7f3600003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004810 0x7f3600004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f3600005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f360000dbe0 con 0x7f36000039c0 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36000099c0 con 0x7f3600004810 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3600009bc0 con 0x7f36180c9ae0 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.865+0000 7f361659c640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36000039c0 0x7f3600003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f3615d9b640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004810 0x7f3600004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f3616d9d640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f3600005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361659c640 1 -- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 msgr2=0x7f3600005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361659c640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f3600005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361659c640 1 -- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004810 msgr2=0x7f3600004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361659c640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004810 0x7f3600004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361659c640 1 -- 172.21.15.87:0/669037883 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3600003530 con 0x7f36000039c0 2024-04-25T16:00:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f3616d9d640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36180c9ae0 0x7f3600005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:45.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361659c640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36000039c0 0x7f3600003e30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ab0 tx=0x7f360801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c016966b15a4648 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080096b0 con 0x7f36000039c0 2024-04-25T16:00:45.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36080a6470 con 0x7f36000039c0 2024-04-25T16:00:45.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361559a640 1 -- 172.21.15.87:0/669037883 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36080a6820 con 0x7f36000039c0 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361ca57640 1 -- 172.21.15.87:0/669037883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36000039c0 msgr2=0x7f3600003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361ca57640 1 --2- 172.21.15.87:0/669037883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36000039c0 0x7f3600003e30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ab0 tx=0x7f360801ca90 comp rx=0 tx=0).stop 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f3616d9d640 1 -- 172.21.15.87:0/669037883 reap_dead start 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361ca57640 1 -- 172.21.15.87:0/669037883 shutdown_connections 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361ca57640 1 -- 172.21.15.87:0/669037883 >> 172.21.15.87:0/669037883 conn(0x7f361806d780 msgr2=0x7f361806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361ca57640 1 -- 172.21.15.87:0/669037883 shutdown_connections 2024-04-25T16:00:45.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.869+0000 7f361ca57640 1 -- 172.21.15.87:0/669037883 wait complete. 2024-04-25T16:00:45.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 Processor -- start 2024-04-25T16:00:45.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 -- start start 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36000039c0 0x7f3618156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36181f0250 0x7f36181ec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 0x7f36180a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f36180a90f0 con 0x7f36181ecbf0 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36180a8f70 con 0x7f36000039c0 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f361806c670 con 0x7f36181f0250 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 0x7f36180a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 0x7f36180a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50208/0 (socket says 172.21.15.87:50208) 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 -- 172.21.15.87:0/3412018060 learned_addr learned my addr 172.21.15.87:0/3412018060 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361659c640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36000039c0 0x7f3618156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3615d9b640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36181f0250 0x7f36181ec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 -- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36181f0250 msgr2=0x7f36181ec6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36181f0250 0x7f36181ec6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 -- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36000039c0 msgr2=0x7f3618156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36000039c0 0x7f3618156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 -- 172.21.15.87:0/3412018060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36180ab7a0 con 0x7f36181ecbf0 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361659c640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36000039c0 0x7f3618156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3616d9d640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 0x7f36180a9850 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f36100013e0 tx=0x7f361000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610004d70 con 0x7f36181ecbf0 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361000bb20 con 0x7f36181ecbf0 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36180aba80 con 0x7f36181ecbf0 2024-04-25T16:00:45.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610007070 con 0x7f36181ecbf0 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.873+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36180ac040 con 0x7f36181ecbf0 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.877+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3618069bb0 con 0x7f36181ecbf0 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.877+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f361001b020 con 0x7f36181ecbf0 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.877+0000 7f3606ffd640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f35f806f400 0x7f35f8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.877+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f361008fb60 con 0x7f36181ecbf0 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.877+0000 7f361659c640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f35f806f400 0x7f35f8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:45.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.877+0000 7f361659c640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f35f806f400 0x7f35f8071910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f36080ad000 tx=0x7f36080b2040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:45.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:45.881+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f361005c3a0 con 0x7f36181ecbf0 2024-04-25T16:00:46.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.073+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36181ec2d0 con 0x7f36181ecbf0 2024-04-25T16:00:46.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.073+0000 7f3606ffd640 1 -- 172.21.15.87:0/3412018060 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5660 (secure 0 0 0) 0x7f361005bca0 con 0x7f36181ecbf0 2024-04-25T16:00:46.074 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:46.074 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:43.549489+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:46.075 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 64 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f35f806f400 msgr2=0x7f35f8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f35f806f400 0x7f35f8071910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f36080ad000 tx=0x7f36080b2040 comp rx=0 tx=0).stop 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 msgr2=0x7f36180a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 0x7f36180a9850 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f36100013e0 tx=0x7f361000b4a0 comp rx=0 tx=0).stop 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 shutdown_connections 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f35f806f400 0x7f35f8071910 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36181ecbf0 0x7f36180a9850 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36181f0250 0x7f36181ec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 --2- 172.21.15.87:0/3412018060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36000039c0 0x7f3618156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 >> 172.21.15.87:0/3412018060 conn(0x7f361806d780 msgr2=0x7f3618158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 shutdown_connections 2024-04-25T16:00:46.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:46.077+0000 7f361ca57640 1 -- 172.21.15.87:0/3412018060 wait complete. 2024-04-25T16:00:46.094 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 64, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:09.584331+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 64, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_6069": { "addr": "172.21.15.87:6837/1282402609", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6836", "nonce": 1282402609, "type": "v2" }, { "addr": "172.21.15.87:6837", "nonce": 1282402609, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 6069, "incarnation": 64, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-25T16:00:43.549489+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6069 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-25T15:54:19.744734+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 62, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5946": { "addr": "172.21.15.87:6835/1331456773", "addrs": { "addrvec": [ { "addr": "172.21.15.87:6834", "nonce": 1331456773, "type": "v2" }, { "addr": "172.21.15.87:6835", "nonce": 1331456773, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5946, "incarnation": 59, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 6 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-25T16:00:31.489467+0000", "qdb_cluster": [ 5946 ], "qdb_leader": 5946, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5946 } } } ], "standbys": [ { "addr": "172.21.15.155:6833/2424832889", "addrs": { "addrvec": [ { "addr": "172.21.15.155:6832", "nonce": 2424832889, "type": "v2" }, { "addr": "172.21.15.155:6833", "nonce": 2424832889, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 48, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5239, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-25T16:00:47.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:47.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 Processor -- start 2024-04-25T16:00:47.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 -- start start 2024-04-25T16:00:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3008158a00 0x7f30080ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3008158e10 0x7f3008152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3008063660 con 0x7f30080adfb0 2024-04-25T16:00:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f30080c5470 con 0x7f3008158a00 2024-04-25T16:00:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300f4f6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f30080ab670 con 0x7f3008158e10 2024-04-25T16:00:47.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300d292640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3008158a00 0x7f30080ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300da93640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f30080adfb0 0x7f30081552c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57716/0 (socket says 172.21.15.87:57716) 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300da93640 1 -- 172.21.15.87:0/1916791533 learned_addr learned my addr 172.21.15.87:0/1916791533 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300ca91640 1 --2- 172.21.15.87:0/1916791533 >> v2:172.21.15.155:3300/0 conn(0x7f3008158e10 0x7f3008152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300d292640 1 -- 172.21.15.87:0/1916791533 >> v2:172.21.15.155:3300/0 conn(0x7f3008158e10 msgr2=0x7f3008152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300d292640 1 --2- 172.21.15.87:0/1916791533 >> v2:172.21.15.155:3300/0 conn(0x7f3008158e10 0x7f3008152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300d292640 1 -- 172.21.15.87:0/1916791533 >> v1:172.21.15.87:6789/0 conn(0x7f30080adfb0 legacy=0x7f30081552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300d292640 1 -- 172.21.15.87:0/1916791533 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30080ab930 con 0x7f3008158a00 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f2ffffff640 1 -- 172.21.15.87:0/1916791533 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832332758 0 0) 0x7f3008063660 con 0x7f30080adfb0 2024-04-25T16:00:47.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.721+0000 7f300ca91640 1 --2- 172.21.15.87:0/1916791533 >> v2:172.21.15.155:3300/0 conn(0x7f3008158e10 0x7f3008152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:47.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300d292640 1 --2- 172.21.15.87:0/1916791533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3008158a00 0x7f30080ada70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3008071f70 tx=0x7f300401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210492c8626f6afa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:47.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f2ffffff640 1 -- 172.21.15.87:0/1916791533 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30040b2070 con 0x7f3008158a00 2024-04-25T16:00:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f2ffffff640 1 -- 172.21.15.87:0/1916791533 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30040a9070 con 0x7f3008158a00 2024-04-25T16:00:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f2ffffff640 1 -- 172.21.15.87:0/1916791533 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30040ad880 con 0x7f3008158a00 2024-04-25T16:00:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 -- 172.21.15.87:0/1916791533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3008158a00 msgr2=0x7f30080ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 --2- 172.21.15.87:0/1916791533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3008158a00 0x7f30080ada70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3008071f70 tx=0x7f300401c450 comp rx=0 tx=0).stop 2024-04-25T16:00:47.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 -- 172.21.15.87:0/1916791533 shutdown_connections 2024-04-25T16:00:47.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 --2- 172.21.15.87:0/1916791533 >> v2:172.21.15.155:3300/0 conn(0x7f3008158e10 0x7f3008152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 --2- 172.21.15.87:0/1916791533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3008158a00 0x7f30080ada70 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 -- 172.21.15.87:0/1916791533 >> 172.21.15.87:0/1916791533 conn(0x7f300806d650 msgr2=0x7f30080c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:47.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 -- 172.21.15.87:0/1916791533 shutdown_connections 2024-04-25T16:00:47.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.725+0000 7f300f4f6640 1 -- 172.21.15.87:0/1916791533 wait complete. 2024-04-25T16:00:47.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 Processor -- start 2024-04-25T16:00:47.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- start start 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 0x7f30080741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008158a00 0x7f30081452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3008158e10 0x7f3008146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f30080af0f0 con 0x7f30080adfb0 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30080aef70 con 0x7f3008158a00 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30080749b0 con 0x7f3008158e10 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 0x7f30080741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:47.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 0x7f30080741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50226/0 (socket says 172.21.15.87:50226) 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 -- 172.21.15.87:0/3449633341 learned_addr learned my addr 172.21.15.87:0/3449633341 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300ca91640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008158a00 0x7f30081452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 -- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3008158e10 msgr2=0x7f3008146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3008158e10 0x7f3008146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 -- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008158a00 msgr2=0x7f30081452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008158a00 0x7f30081452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 -- 172.21.15.87:0/3449633341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30081f1a10 con 0x7f30080adfb0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300d292640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 0x7f30080741e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3004019060 tx=0x7f30040191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30040bc070 con 0x7f30080adfb0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30040b63f0 con 0x7f30080adfb0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30040b2040 con 0x7f30080adfb0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30080728d0 con 0x7f30080adfb0 2024-04-25T16:00:47.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3008074720 con 0x7f30080adfb0 2024-04-25T16:00:47.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.729+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3008069bb0 con 0x7f30080adfb0 2024-04-25T16:00:47.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.733+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f30040ab070 con 0x7f30080adfb0 2024-04-25T16:00:47.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.733+0000 7f2ffdffb640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2fec06f430 0x7f2fec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:47.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.733+0000 7f300ca91640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2fec06f430 0x7f2fec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:47.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.733+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f3004128960 con 0x7f30080adfb0 2024-04-25T16:00:47.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.733+0000 7f300ca91640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2fec06f430 0x7f2fec071940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8006fd0 tx=0x7f2ff8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:47.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.741+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30081f1a10 con 0x7f30080adfb0 2024-04-25T16:00:47.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.933+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30080704e0 con 0x7f30080adfb0 2024-04-25T16:00:47.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f2ffdffb640 1 -- 172.21.15.87:0/3449633341 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5660 (secure 0 0 0) 0x7f3004016070 con 0x7f30080adfb0 2024-04-25T16:00:47.936 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:47.936 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:43.549489+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:47.937 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 64 2024-04-25T16:00:47.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2fec06f430 msgr2=0x7f2fec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:47.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2fec06f430 0x7f2fec071940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8006fd0 tx=0x7f2ff8008040 comp rx=0 tx=0).stop 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 msgr2=0x7f30080741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 0x7f30080741e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3004019060 tx=0x7f30040191f0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 shutdown_connections 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f2fec06f430 0x7f2fec071940 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3008158e10 0x7f3008146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3008158a00 0x7f30081452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 --2- 172.21.15.87:0/3449633341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30080adfb0 0x7f30080741e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 >> 172.21.15.87:0/3449633341 conn(0x7f300806d650 msgr2=0x7f30080c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 shutdown_connections 2024-04-25T16:00:47.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:47.937+0000 7f300f4f6640 1 -- 172.21.15.87:0/3449633341 wait complete. 2024-04-25T16:00:47.963 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T16:00:48.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:48.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 Processor -- start 2024-04-25T16:00:48.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 -- start start 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbfb8152870 0x7fbfb8159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb806c670 0x7fbfb806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb81558d0 con 0x7fbfb80c9fe0 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb8152c80 con 0x7fbfb8152870 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbe494640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb8070cb0 con 0x7fbfb806c670 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbfb8152870 0x7fbfb8159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbfb80c9fe0 0x7fbfb81551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57730/0 (socket says 172.21.15.87:57730) 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb77fe640 1 -- 172.21.15.87:0/3306463651 learned_addr learned my addr 172.21.15.87:0/3306463651 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfbca31640 1 --2- 172.21.15.87:0/3306463651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb806c670 0x7fbfb806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:48.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb7fff640 1 -- 172.21.15.87:0/3306463651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb806c670 msgr2=0x7fbfb806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:48.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb7fff640 1 --2- 172.21.15.87:0/3306463651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb806c670 0x7fbfb806ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb7fff640 1 -- 172.21.15.87:0/3306463651 >> v1:172.21.15.87:6789/0 conn(0x7fbfb80c9fe0 legacy=0x7fbfb81551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:48.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.233+0000 7fbfb7fff640 1 -- 172.21.15.87:0/3306463651 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb8070f90 con 0x7fbfb8152870 2024-04-25T16:00:48.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfb7fff640 1 --2- 172.21.15.87:0/3306463651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb8152870 0x7fbfb8159290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80097c0 tx=0x7fbfa801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92adbfe5cf6e8c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:48.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfb6ffd640 1 -- 172.21.15.87:0/3306463651 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80b0070 con 0x7fbfb8152870 2024-04-25T16:00:48.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfb6ffd640 1 -- 172.21.15.87:0/3306463651 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa80ab600 con 0x7fbfb8152870 2024-04-25T16:00:48.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfb6ffd640 1 -- 172.21.15.87:0/3306463651 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80ab9d0 con 0x7fbfb8152870 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 -- 172.21.15.87:0/3306463651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb8152870 msgr2=0x7fbfb8159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 --2- 172.21.15.87:0/3306463651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb8152870 0x7fbfb8159290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80097c0 tx=0x7fbfa801c410 comp rx=0 tx=0).stop 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 -- 172.21.15.87:0/3306463651 shutdown_connections 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 --2- 172.21.15.87:0/3306463651 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb806c670 0x7fbfb806ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 --2- 172.21.15.87:0/3306463651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb8152870 0x7fbfb8159290 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 -- 172.21.15.87:0/3306463651 >> 172.21.15.87:0/3306463651 conn(0x7fbfb806d780 msgr2=0x7fbfb806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 -- 172.21.15.87:0/3306463651 shutdown_connections 2024-04-25T16:00:48.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 -- 172.21.15.87:0/3306463651 wait complete. 2024-04-25T16:00:48.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 Processor -- start 2024-04-25T16:00:48.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.237+0000 7fbfbe494640 1 -- start start 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 0x7fbfb81eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb80c9fe0 0x7fbfb814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb8152870 0x7fbfb81f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb8162360 con 0x7fbfb806c670 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80ca3f0 con 0x7fbfb8152870 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb81624e0 con 0x7fbfb80c9fe0 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 0x7fbfb81eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:48.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 0x7fbfb81eef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50232/0 (socket says 172.21.15.87:50232) 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 -- 172.21.15.87:0/2208391345 learned_addr learned my addr 172.21.15.87:0/2208391345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb77fe640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb80c9fe0 0x7fbfb814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbca31640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb8152870 0x7fbfb81f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 -- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb80c9fe0 msgr2=0x7fbfb814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb80c9fe0 0x7fbfb814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 -- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb8152870 msgr2=0x7fbfb81f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb8152870 0x7fbfb81f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 -- 172.21.15.87:0/2208391345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb81f1970 con 0x7fbfb806c670 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb7fff640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 0x7fbfb81eef60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbfa801a040 tx=0x7fbfa80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80b8020 con 0x7fbfb806c670 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa80b4410 con 0x7fbfb806c670 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb81f28b0 con 0x7fbfb806c670 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80b0040 con 0x7fbfb806c670 2024-04-25T16:00:48.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb80c9370 con 0x7fbfb806c670 2024-04-25T16:00:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb8069bb0 con 0x7fbfb806c670 2024-04-25T16:00:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.241+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbfa80bb020 con 0x7fbfb806c670 2024-04-25T16:00:48.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.245+0000 7fbfb4ff9640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbfa406f430 0x7fbfa4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.245+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fbfa8129250 con 0x7fbfb806c670 2024-04-25T16:00:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.245+0000 7fbfb77fe640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbfa406f430 0x7fbfa4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:48.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.245+0000 7fbfb77fe640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbfa406f430 0x7fbfa4071940 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80c9000 tx=0x7fbfac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:48.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.249+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfa80c2070 con 0x7fbfb806c670 2024-04-25T16:00:48.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.457+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfb8070840 con 0x7fbfb806c670 2024-04-25T16:00:48.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.457+0000 7fbfb4ff9640 1 -- 172.21.15.87:0/2208391345 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5660 (secure 0 0 0) 0x7fbfb81f1970 con 0x7fbfb806c670 2024-04-25T16:00:48.459 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:48.459 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:43.549489+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:48.459 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 64 2024-04-25T16:00:48.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbfa406f430 msgr2=0x7fbfa4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbfa406f430 0x7fbfa4071940 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80c9000 tx=0x7fbfac009040 comp rx=0 tx=0).stop 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 msgr2=0x7fbfb81eef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 0x7fbfb81eef60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbfa801a040 tx=0x7fbfa80191b0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 shutdown_connections 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fbfa406f430 0x7fbfa4071940 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb8152870 0x7fbfb81f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfb80c9fe0 0x7fbfb814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 --2- 172.21.15.87:0/2208391345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfb806c670 0x7fbfb81eef60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 >> 172.21.15.87:0/2208391345 conn(0x7fbfb806d780 msgr2=0x7fbfb81538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 shutdown_connections 2024-04-25T16:00:48.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:48.461+0000 7fbfbe494640 1 -- 172.21.15.87:0/2208391345 wait complete. 2024-04-25T16:00:48.485 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T16:00:49.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.117+0000 7f40f5d2d640 1 Processor -- start 2024-04-25T16:00:50.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.117+0000 7f40f5d2d640 1 -- start start 2024-04-25T16:00:50.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40f5d2d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40f00ad160 0x7f40f00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40f5d2d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40f00c4620 0x7f40f015e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40f5d2d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f0154fc0 con 0x7f40f01518b0 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40f5d2d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f40f006ed60 con 0x7f40f00ad160 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40f5d2d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f40f00acb20 con 0x7f40f00c4620 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40e6ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40f00ad160 0x7f40f00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40ef7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f40f01518b0 0x7f40f006f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57736/0 (socket says 172.21.15.87:57736) 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40ef7fe640 1 -- 172.21.15.87:0/458905193 learned_addr learned my addr 172.21.15.87:0/458905193 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40effff640 1 --2- 172.21.15.87:0/458905193 >> v2:172.21.15.155:3300/0 conn(0x7f40f00c4620 0x7f40f015e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40e6ffd640 1 -- 172.21.15.87:0/458905193 >> v2:172.21.15.155:3300/0 conn(0x7f40f00c4620 msgr2=0x7f40f015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40e6ffd640 1 --2- 172.21.15.87:0/458905193 >> v2:172.21.15.155:3300/0 conn(0x7f40f00c4620 0x7f40f015e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40e6ffd640 1 -- 172.21.15.87:0/458905193 >> v1:172.21.15.87:6789/0 conn(0x7f40f01518b0 legacy=0x7f40f006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40eeffd640 1 -- 172.21.15.87:0/458905193 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 763125638 0 0) 0x7f40f0154fc0 con 0x7f40f01518b0 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40e6ffd640 1 -- 172.21.15.87:0/458905193 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f00ace00 con 0x7f40f00ad160 2024-04-25T16:00:50.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.121+0000 7f40effff640 1 --2- 172.21.15.87:0/458905193 >> v2:172.21.15.155:3300/0 conn(0x7f40f00c4620 0x7f40f015e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40e6ffd640 1 --2- 172.21.15.87:0/458905193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00ad160 0x7f40f00c40e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f40f00734e0 tx=0x7f40d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7556384709ba5a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40eeffd640 1 -- 172.21.15.87:0/458905193 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80b1070 con 0x7f40f00ad160 2024-04-25T16:00:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40eeffd640 1 -- 172.21.15.87:0/458905193 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d80ac410 con 0x7f40f00ad160 2024-04-25T16:00:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40eeffd640 1 -- 172.21.15.87:0/458905193 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80ac7e0 con 0x7f40f00ad160 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 -- 172.21.15.87:0/458905193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00ad160 msgr2=0x7f40f00c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/458905193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00ad160 0x7f40f00c40e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f40f00734e0 tx=0x7f40d801c480 comp rx=0 tx=0).stop 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 -- 172.21.15.87:0/458905193 shutdown_connections 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/458905193 >> v2:172.21.15.155:3300/0 conn(0x7f40f00c4620 0x7f40f015e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/458905193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00ad160 0x7f40f00c40e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 -- 172.21.15.87:0/458905193 >> 172.21.15.87:0/458905193 conn(0x7f40f00c8770 msgr2=0x7f40f00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 -- 172.21.15.87:0/458905193 shutdown_connections 2024-04-25T16:00:50.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 -- 172.21.15.87:0/458905193 wait complete. 2024-04-25T16:00:50.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 Processor -- start 2024-04-25T16:00:50.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.125+0000 7f40f5d2d640 1 -- start start 2024-04-25T16:00:50.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f00ad160 0x7f40f01efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 0x7f40f00c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40f01518b0 0x7f40f014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0161710 con 0x7f40f00c4620 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0161890 con 0x7f40f00ad160 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f40f0161a10 con 0x7f40f01518b0 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 0x7f40f00c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 0x7f40f00c0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50246/0 (socket says 172.21.15.87:50246) 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 -- 172.21.15.87:0/103656307 learned_addr learned my addr 172.21.15.87:0/103656307 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ef7fe640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f00ad160 0x7f40f01efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40effff640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40f01518b0 0x7f40f014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 -- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40f01518b0 msgr2=0x7f40f014c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40f01518b0 0x7f40f014c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 -- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f00ad160 msgr2=0x7f40f01efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f00ad160 0x7f40f01efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 -- 172.21.15.87:0/103656307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f014d580 con 0x7f40f00c4620 2024-04-25T16:00:50.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40e6ffd640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 0x7f40f00c0550 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f40d80af040 tx=0x7f40d801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80bd070 con 0x7f40f00c4620 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d80b2040 con 0x7f40f00c4620 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f0156ed0 con 0x7f40f00c4620 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80b1050 con 0x7f40f00c4620 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f0157490 con 0x7f40f00c4620 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f0069bb0 con 0x7f40f00c4620 2024-04-25T16:00:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f40d80c0070 con 0x7f40f00c4620 2024-04-25T16:00:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ecff9640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40d006f400 0x7f40d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f40d81291f0 con 0x7f40f00c4620 2024-04-25T16:00:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ef7fe640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40d006f400 0x7f40d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.129+0000 7f40ef7fe640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40d006f400 0x7f40d0071910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000f70 tx=0x7f40e0007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:50.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.137+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f40d8016070 con 0x7f40f00c4620 2024-04-25T16:00:50.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.321+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40f00abfa0 con 0x7f40f00c4620 2024-04-25T16:00:50.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40ecff9640 1 -- 172.21.15.87:0/103656307 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5663 (secure 0 0 0) 0x7f40d80f5a30 con 0x7f40f00c4620 2024-04-25T16:00:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:50.325 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:48.661909+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:50.325 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 65 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40d006f400 msgr2=0x7f40d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40d006f400 0x7f40d0071910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000f70 tx=0x7f40e0007c10 comp rx=0 tx=0).stop 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 msgr2=0x7f40f00c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 0x7f40f00c0550 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f40d80af040 tx=0x7f40d801acc0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 shutdown_connections 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f40d006f400 0x7f40d0071910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f40f01518b0 0x7f40f014c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40f00c4620 0x7f40f00c0550 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 --2- 172.21.15.87:0/103656307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40f00ad160 0x7f40f01efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 >> 172.21.15.87:0/103656307 conn(0x7f40f00c8770 msgr2=0x7f40f0150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:50.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 shutdown_connections 2024-04-25T16:00:50.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.325+0000 7f40f5d2d640 1 -- 172.21.15.87:0/103656307 wait complete. 2024-04-25T16:00:50.343 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-25T16:00:50.486 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:50.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.641+0000 7f026b6a2640 1 Processor -- start 2024-04-25T16:00:50.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.641+0000 7f026b6a2640 1 -- start start 2024-04-25T16:00:50.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f026b6a2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f026b6a2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02640c5290 con 0x7f02641517d0 2024-04-25T16:00:50.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f026b6a2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02640c5550 con 0x7f0264158200 2024-04-25T16:00:50.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f026b6a2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02640c5e80 con 0x7f02641578b0 2024-04-25T16:00:50.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f026943e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f02641517d0 0x7f02640c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57748/0 (socket says 172.21.15.87:57748) 2024-04-25T16:00:50.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f026943e640 1 -- 172.21.15.87:0/149591069 learned_addr learned my addr 172.21.15.87:0/149591069 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f0268c3d640 1 --2- 172.21.15.87:0/149591069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580155909 0 0) 0x7f02640c5290 con 0x7f02641517d0 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0250005740 con 0x7f02641517d0 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437432868 0 0) 0x7f02640c5550 con 0x7f0264158200 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02640c5290 con 0x7f0264158200 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f0268c3d640 1 -- 172.21.15.87:0/149591069 >> v1:172.21.15.155:6789/0 conn(0x7f0264158200 legacy=0x7f026415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f0268c3d640 1 -- 172.21.15.87:0/149591069 >> v1:172.21.15.87:6789/0 conn(0x7f02641517d0 legacy=0x7f02640c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.645+0000 7f0268c3d640 1 -- 172.21.15.87:0/149591069 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02640c5830 con 0x7f02641578b0 2024-04-25T16:00:50.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f0268c3d640 1 --2- 172.21.15.87:0/149591069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264157cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02540097f0 tx=0x7f025401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57080281c19a9f73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:50.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02540b0070 con 0x7f02641578b0 2024-04-25T16:00:50.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02540ab600 con 0x7f02641578b0 2024-04-25T16:00:50.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f025bfff640 1 -- 172.21.15.87:0/149591069 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02540ab9d0 con 0x7f02641578b0 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 -- 172.21.15.87:0/149591069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 msgr2=0x7f0264157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 --2- 172.21.15.87:0/149591069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264157cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f02540097f0 tx=0x7f025401c4e0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 -- 172.21.15.87:0/149591069 shutdown_connections 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 --2- 172.21.15.87:0/149591069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264157cc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 -- 172.21.15.87:0/149591069 >> 172.21.15.87:0/149591069 conn(0x7f026406d780 msgr2=0x7f026406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 -- 172.21.15.87:0/149591069 shutdown_connections 2024-04-25T16:00:50.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 -- 172.21.15.87:0/149591069 wait complete. 2024-04-25T16:00:50.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 Processor -- start 2024-04-25T16:00:50.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.649+0000 7f026b6a2640 1 -- start start 2024-04-25T16:00:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02641517d0 0x7f0264155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 0x7f02640ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f02640a8f70 con 0x7f0264158200 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0264151be0 con 0x7f02641517d0 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02640a90f0 con 0x7f02641578b0 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 0x7f02640ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 0x7f02640ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50252/0 (socket says 172.21.15.87:50252) 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 -- 172.21.15.87:0/238838497 learned_addr learned my addr 172.21.15.87:0/238838497 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026943e640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02641517d0 0x7f0264155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0268c3d640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 -- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 msgr2=0x7f0264144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264144190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 -- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02641517d0 msgr2=0x7f0264155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02641517d0 0x7f0264155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 -- 172.21.15.87:0/238838497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02640c9280 con 0x7f0264158200 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0269c3f640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 0x7f02640ad520 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c6b0 tx=0x7f025c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:50.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c003b80 con 0x7f0264158200 2024-04-25T16:00:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f025c003d40 con 0x7f0264158200 2024-04-25T16:00:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02640c8fe0 con 0x7f0264158200 2024-04-25T16:00:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c005310 con 0x7f0264158200 2024-04-25T16:00:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02641446d0 con 0x7f0264158200 2024-04-25T16:00:50.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0264069bb0 con 0x7f0264158200 2024-04-25T16:00:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.653+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f025c0054b0 con 0x7f0264158200 2024-04-25T16:00:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.657+0000 7f0259ffb640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f024806f400 0x7f0248071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.657+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f025c08f770 con 0x7f0264158200 2024-04-25T16:00:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.657+0000 7f026943e640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f024806f400 0x7f0248071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:50.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.657+0000 7f026943e640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f024806f400 0x7f0248071910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02600011f0 tx=0x7f0260009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:50.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.661+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f025c05c040 con 0x7f0264158200 2024-04-25T16:00:50.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.857+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0264145180 con 0x7f0264158200 2024-04-25T16:00:50.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f0259ffb640 1 -- 172.21.15.87:0/238838497 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5660 (secure 0 0 0) 0x7f025c05b940 con 0x7f0264158200 2024-04-25T16:00:50.860 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:50.860 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:49.575499+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:rejoin","state_seq":4,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:50.860 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 66 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f024806f400 msgr2=0x7f0248071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f024806f400 0x7f0248071910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02600011f0 tx=0x7f0260009040 comp rx=0 tx=0).stop 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 msgr2=0x7f02640ad520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 0x7f02640ad520 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c6b0 tx=0x7f025c00cb70 comp rx=0 tx=0).stop 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 shutdown_connections 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f024806f400 0x7f0248071910 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0264158200 0x7f02640ad520 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02641578b0 0x7f0264144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 --2- 172.21.15.87:0/238838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02641517d0 0x7f0264155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 >> 172.21.15.87:0/238838497 conn(0x7f026406d780 msgr2=0x7f0264150a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 shutdown_connections 2024-04-25T16:00:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:50.861+0000 7f026b6a2640 1 -- 172.21.15.87:0/238838497 wait complete. 2024-04-25T16:00:50.881 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-25T16:00:52.344 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:52.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.505+0000 7f5eaf9dc640 1 Processor -- start 2024-04-25T16:00:52.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.505+0000 7f5eaf9dc640 1 -- start start 2024-04-25T16:00:52.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eaf9dc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:52.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eaf9dc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ea80adda0 0x7f5ea80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:52.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eaf9dc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea80c4e30 con 0x7f5ea80ad990 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eaf9dc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea80ae1b0 con 0x7f5ea80adda0 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eaf9dc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea8072430 con 0x7f5ea81529a0 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ea80adda0 0x7f5ea80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5ea80adda0 0x7f5ea80c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54376/0 (socket says 172.21.15.87:54376) 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 -- 172.21.15.87:0/4185951647 learned_addr learned my addr 172.21.15.87:0/4185951647 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 -- 172.21.15.87:0/4185951647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 msgr2=0x7f5ea8071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 --2- 172.21.15.87:0/4185951647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 -- 172.21.15.87:0/4185951647 >> v1:172.21.15.155:6789/0 conn(0x7f5ea80ad990 legacy=0x7f5ea80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:52.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 -- 172.21.15.87:0/4185951647 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea8074730 con 0x7f5ea80adda0 2024-04-25T16:00:52.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5eadf79640 1 --2- 172.21.15.87:0/4185951647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea80c48f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009e50 tx=0x7f5ea001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1698a8cca6af6ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:52.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5e9ffff640 1 -- 172.21.15.87:0/4185951647 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00ac020 con 0x7f5ea80adda0 2024-04-25T16:00:52.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5e9ffff640 1 -- 172.21.15.87:0/4185951647 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a6410 con 0x7f5ea80adda0 2024-04-25T16:00:52.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.509+0000 7f5e9ffff640 1 -- 172.21.15.87:0/4185951647 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a67e0 con 0x7f5ea80adda0 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/4185951647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 msgr2=0x7f5ea80c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/4185951647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea80c48f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009e50 tx=0x7f5ea001c780 comp rx=0 tx=0).stop 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/4185951647 shutdown_connections 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/4185951647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea80c48f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/4185951647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea8071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/4185951647 >> 172.21.15.87:0/4185951647 conn(0x7f5ea80c8770 msgr2=0x7f5ea80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/4185951647 shutdown_connections 2024-04-25T16:00:52.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/4185951647 wait complete. 2024-04-25T16:00:52.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 Processor -- start 2024-04-25T16:00:52.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- start start 2024-04-25T16:00:52.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea80ad990 0x7f5ea8147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:52.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea81f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:52.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea81480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:52.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81622f0 con 0x7f5ea80adda0 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea80ab1a0 con 0x7f5ea80ad990 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eaf9dc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea8162470 con 0x7f5ea81529a0 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eacf77640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea81f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eacf77640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea81f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54392/0 (socket says 172.21.15.87:54392) 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eacf77640 1 -- 172.21.15.87:0/2823528802 learned_addr learned my addr 172.21.15.87:0/2823528802 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.513+0000 7f5eadf79640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea81480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5ead778640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea80ad990 0x7f5ea8147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:52.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eacf77640 1 -- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 msgr2=0x7f5ea81480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eacf77640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea81480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eacf77640 1 -- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea80ad990 msgr2=0x7f5ea8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eacf77640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea80ad990 0x7f5ea8147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eacf77640 1 -- 172.21.15.87:0/2823528802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea8152190 con 0x7f5ea80adda0 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5ead778640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea80ad990 0x7f5ea8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eadf79640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea81480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eacf77640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea81f19b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800b410 tx=0x7f5e9800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98015020 con 0x7f5ea80adda0 2024-04-25T16:00:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e98011850 con 0x7f5ea80adda0 2024-04-25T16:00:52.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea814d850 con 0x7f5ea80adda0 2024-04-25T16:00:52.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98011c40 con 0x7f5ea80adda0 2024-04-25T16:00:52.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81506c0 con 0x7f5ea80adda0 2024-04-25T16:00:52.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea8069bb0 con 0x7f5ea80adda0 2024-04-25T16:00:52.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5e98018020 con 0x7f5ea80adda0 2024-04-25T16:00:52.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5e9dffb640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e8c06f400 0x7f5e8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:52.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f5e9808fde0 con 0x7f5ea80adda0 2024-04-25T16:00:52.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5ead778640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e8c06f400 0x7f5e8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:52.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.517+0000 7f5ead778640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e8c06f400 0x7f5e8c071910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8073d40 tx=0x7f5ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:52.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.521+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e9801f020 con 0x7f5ea80adda0 2024-04-25T16:00:52.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.721+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ea80c3720 con 0x7f5ea80adda0 2024-04-25T16:00:52.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5e9dffb640 1 -- 172.21.15.87:0/2823528802 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5667 (secure 0 0 0) 0x7f5e9805c700 con 0x7f5ea80adda0 2024-04-25T16:00:52.724 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:52.724 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:52.725 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 68 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e8c06f400 msgr2=0x7f5e8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e8c06f400 0x7f5e8c071910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8073d40 tx=0x7f5ea4008040 comp rx=0 tx=0).stop 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 msgr2=0x7f5ea81f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea81f19b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800b410 tx=0x7f5e9800b8d0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 shutdown_connections 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5e8c06f400 0x7f5e8c071910 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ea81529a0 0x7f5ea81480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5ea80adda0 0x7f5ea81f19b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 --2- 172.21.15.87:0/2823528802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ea80ad990 0x7f5ea8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:52.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 >> 172.21.15.87:0/2823528802 conn(0x7f5ea80c8770 msgr2=0x7f5ea8155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:52.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 shutdown_connections 2024-04-25T16:00:52.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:52.725+0000 7f5eaf9dc640 1 -- 172.21.15.87:0/2823528802 wait complete. 2024-04-25T16:00:52.746 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:active state 2024-04-25T16:00:52.746 INFO:tasks.mds_thrash.fs.[b]:stat['max_mds'] = 0 2024-04-25T16:00:52.746 INFO:tasks.mds_thrash.fs.[b]:stat['deactivate'] = 0 2024-04-25T16:00:52.746 INFO:tasks.mds_thrash.fs.[b]:stat['kill'] = 4 2024-04-25T16:00:52.746 INFO:tasks.mds_thrash:done joining 2024-04-25T16:00:52.747 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T16:00:52.758 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T16:00:52.759 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T16:00:52.759 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:00:52.765 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T16:00:52.765 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:00:52.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:00:52.881 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:00:53.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.017+0000 7f9f8f7e4640 1 Processor -- start 2024-04-25T16:00:53.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.017+0000 7f9f8f7e4640 1 -- start start 2024-04-25T16:00:53.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8f7e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9f880cb030 0x7f9f8815fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8f7e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f880c7570 con 0x7f9f8815ad90 2024-04-25T16:00:53.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8f7e4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8815b8b0 con 0x7f9f88160230 2024-04-25T16:00:53.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8f7e4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9f8815b5d0 con 0x7f9f880cb030 2024-04-25T16:00:53.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9f8815ad90 0x7f9f880ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57210/0 (socket says 172.21.15.87:57210) 2024-04-25T16:00:53.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 -- 172.21.15.87:0/130589030 learned_addr learned my addr 172.21.15.87:0/130589030 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8cd7f640 1 --2- 172.21.15.87:0/130589030 >> v2:172.21.15.155:3300/0 conn(0x7f9f880cb030 0x7f9f8815fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9612128 0 0) 0x7f9f880c7570 con 0x7f9f8815ad90 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f74003530 con 0x7f9f8815ad90 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2387953809 0 0) 0x7f9f74003530 con 0x7f9f8815ad90 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 >> v2:172.21.15.155:3300/0 conn(0x7f9f880cb030 msgr2=0x7f9f8815fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 --2- 172.21.15.87:0/130589030 >> v2:172.21.15.155:3300/0 conn(0x7f9f880cb030 0x7f9f8815fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 >> v1:172.21.15.155:6789/0 conn(0x7f9f88160230 legacy=0x7f9f88162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f880c2290 con 0x7f9f8815ad90 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f9f78001680 con 0x7f9f8815ad90 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 >> v1:172.21.15.87:6789/0 conn(0x7f9f8815ad90 legacy=0x7f9f880ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f740039c0 0x7f9f74003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f74004810 0x7f9f74004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f74005360 0x7f9f7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8815b5d0 con 0x7f9f740039c0 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7400c290 con 0x7f9f74005360 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7400c490 con 0x7f9f74004810 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f740039c0 0x7f9f74003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8dd81640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f74005360 0x7f9f7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8cd7f640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f74004810 0x7f9f74004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 -- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f74004810 msgr2=0x7f9f74004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f74004810 0x7f9f74004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 -- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f74005360 msgr2=0x7f9f7400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f74005360 0x7f9f7400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8dd81640 1 -- 172.21.15.87:0/130589030 reap_dead start 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8d580640 1 -- 172.21.15.87:0/130589030 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f74003530 con 0x7f9f740039c0 2024-04-25T16:00:53.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.021+0000 7f9f8cd7f640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f74004810 0x7f9f74004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8d580640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f740039c0 0x7f9f74003e30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800c1c0 tx=0x7f9f7801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575e65a00f4ba077 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78007d00 con 0x7f9f740039c0 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f780a9020 con 0x7f9f740039c0 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f7ffff640 1 -- 172.21.15.87:0/130589030 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78005ae0 con 0x7f9f740039c0 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/130589030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f740039c0 msgr2=0x7f9f74003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f740039c0 0x7f9f74003e30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800c1c0 tx=0x7f9f7801cc60 comp rx=0 tx=0).stop 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/130589030 shutdown_connections 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/130589030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f740039c0 0x7f9f74003e30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/130589030 >> 172.21.15.87:0/130589030 conn(0x7f9f880c9330 msgr2=0x7f9f880c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/130589030 shutdown_connections 2024-04-25T16:00:53.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/130589030 wait complete. 2024-04-25T16:00:53.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 Processor -- start 2024-04-25T16:00:53.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.025+0000 7f9f8f7e4640 1 -- start start 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f740039c0 0x7f9f88156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f8814c820 0x7f9f881f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 0x7f9f8814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f880ca2e0 con 0x7f9f880b1a50 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f880ca160 con 0x7f9f740039c0 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f880cad30 con 0x7f9f8814c820 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 0x7f9f8814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 0x7f9f8814b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54404/0 (socket says 172.21.15.87:54404) 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 -- 172.21.15.87:0/3242297345 learned_addr learned my addr 172.21.15.87:0/3242297345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8d580640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f740039c0 0x7f9f88156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8cd7f640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f8814c820 0x7f9f881f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 -- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f8814c820 msgr2=0x7f9f881f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f8814c820 0x7f9f881f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 -- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f740039c0 msgr2=0x7f9f88156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f740039c0 0x7f9f88156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 -- 172.21.15.87:0/3242297345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f880b2610 con 0x7f9f880b1a50 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8dd81640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 0x7f9f8814b780 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9f880c2570 tx=0x7f9f8000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80019070 con 0x7f9f880b1a50 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f80006b60 con 0x7f9f880b1a50 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80003980 con 0x7f9f880b1a50 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8814c5b0 con 0x7f9f880b1a50 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f88154870 con 0x7f9f880b1a50 2024-04-25T16:00:53.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.029+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f88069bb0 con 0x7f9f880b1a50 2024-04-25T16:00:53.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.033+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f8001c070 con 0x7f9f880b1a50 2024-04-25T16:00:53.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.033+0000 7f9f7dffb640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f6c06f400 0x7f9f6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.033+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f9f8008ef00 con 0x7f9f880b1a50 2024-04-25T16:00:53.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.033+0000 7f9f8d580640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f6c06f400 0x7f9f6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.033+0000 7f9f8d580640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f6c06f400 0x7f9f6c071910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9f780aa000 tx=0x7f9f88158390 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.037+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f880b2610 con 0x7f9f880b1a50 2024-04-25T16:00:53.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 Processor -- start 2024-04-25T16:00:53.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 -- start start 2024-04-25T16:00:53.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a88063220 con 0x7f3a880744e0 2024-04-25T16:00:53.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3a880c5570 con 0x7f3a880740d0 2024-04-25T16:00:53.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.041+0000 7f3a8d239640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a88074a90 con 0x7f3a88154c90 2024-04-25T16:00:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a86d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:56972/0 (socket says 172.21.15.87:56972) 2024-04-25T16:00:53.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 -- 172.21.15.87:0/3504813467 learned_addr learned my addr 172.21.15.87:0/3504813467 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:53.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 -- 172.21.15.87:0/3504813467 >> v2:172.21.15.155:3300/0 conn(0x7f3a880740d0 msgr2=0x7f3a880c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:53.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 --2- 172.21.15.87:0/3504813467 >> v2:172.21.15.155:3300/0 conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 -- 172.21.15.87:0/3504813467 >> v1:172.21.15.155:6789/0 conn(0x7f3a880744e0 legacy=0x7f3a88154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a8759e640 1 -- 172.21.15.87:0/3504813467 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a880634c0 con 0x7f3a88154c90 2024-04-25T16:00:53.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.045+0000 7f3a86d9d640 1 --2- 172.21.15.87:0/3504813467 >> v2:172.21.15.155:3300/0 conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:00:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8759e640 1 --2- 172.21.15.87:0/3504813467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88161e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009e50 tx=0x7f3a8001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=587e733fc98871df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a85d9b640 1 -- 172.21.15.87:0/3504813467 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a800a5770 con 0x7f3a88154c90 2024-04-25T16:00:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a85d9b640 1 -- 172.21.15.87:0/3504813467 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a800a5910 con 0x7f3a88154c90 2024-04-25T16:00:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a85d9b640 1 -- 172.21.15.87:0/3504813467 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a800a5ce0 con 0x7f3a88154c90 2024-04-25T16:00:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 -- 172.21.15.87:0/3504813467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 msgr2=0x7f3a88161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3504813467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88161e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009e50 tx=0x7f3a8001c9a0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 -- 172.21.15.87:0/3504813467 shutdown_connections 2024-04-25T16:00:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3504813467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88161e70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3504813467 >> v2:172.21.15.155:3300/0 conn(0x7f3a880740d0 0x7f3a880c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 -- 172.21.15.87:0/3504813467 >> 172.21.15.87:0/3504813467 conn(0x7f3a8806d650 msgr2=0x7f3a880c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 -- 172.21.15.87:0/3504813467 shutdown_connections 2024-04-25T16:00:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 -- 172.21.15.87:0/3504813467 wait complete. 2024-04-25T16:00:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 Processor -- start 2024-04-25T16:00:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.049+0000 7f3a8d239640 1 -- start start 2024-04-25T16:00:53.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a88148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a8806f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880c51e0 con 0x7f3a880744e0 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880c5060 con 0x7f3a880740d0 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a88164bd0 con 0x7f3a88154c90 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a8806f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a8806f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54414/0 (socket says 172.21.15.87:54414) 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 -- 172.21.15.87:0/3552728050 learned_addr learned my addr 172.21.15.87:0/3552728050 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8759e640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a86d9d640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a88148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 -- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 msgr2=0x7f3a88144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 -- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 msgr2=0x7f3a88148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a88148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 -- 172.21.15.87:0/3552728050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a881f1bb0 con 0x7f3a880744e0 2024-04-25T16:00:53.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8659c640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a8806f590 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c370 tx=0x7f3a7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780052d0 con 0x7f3a880744e0 2024-04-25T16:00:53.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a78005470 con 0x7f3a880744e0 2024-04-25T16:00:53.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a78007260 con 0x7f3a880744e0 2024-04-25T16:00:53.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8806edd0 con 0x7f3a880744e0 2024-04-25T16:00:53.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8806f070 con 0x7f3a880744e0 2024-04-25T16:00:53.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a88069bb0 con 0x7f3a880744e0 2024-04-25T16:00:53.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a78007400 con 0x7f3a880744e0 2024-04-25T16:00:53.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.053+0000 7f3a6f7fe640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a7406f430 0x7f3a74071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.057+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f3a7808ee90 con 0x7f3a880744e0 2024-04-25T16:00:53.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.057+0000 7f3a86d9d640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a7406f430 0x7f3a74071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.057+0000 7f3a86d9d640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a7406f430 0x7f3a74071940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009a50 tx=0x7f3a7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.061+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a7805b650 con 0x7f3a880744e0 2024-04-25T16:00:53.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.205+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f880cc440 con 0x7f9f880b1a50 2024-04-25T16:00:53.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.209+0000 7f9f7dffb640 1 -- 172.21.15.87:0/3242297345 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21989 (secure 0 0 0) 0x7f9f8005b180 con 0x7f9f880b1a50 2024-04-25T16:00:53.210 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:53.210 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:00:43.549189+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:00:53.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f6c06f400 msgr2=0x7f9f6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f6c06f400 0x7f9f6c071910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9f780aa000 tx=0x7f9f88158390 comp rx=0 tx=0).stop 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 msgr2=0x7f9f8814b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 0x7f9f8814b780 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9f880c2570 tx=0x7f9f8000ec10 comp rx=0 tx=0).stop 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 shutdown_connections 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f6c06f400 0x7f9f6c071910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f880b1a50 0x7f9f8814b780 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f8814c820 0x7f9f881f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 --2- 172.21.15.87:0/3242297345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f740039c0 0x7f9f88156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 >> 172.21.15.87:0/3242297345 conn(0x7f9f880c9330 msgr2=0x7f9f880ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 shutdown_connections 2024-04-25T16:00:53.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.213+0000 7f9f8f7e4640 1 -- 172.21.15.87:0/3242297345 wait complete. 2024-04-25T16:00:53.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T16:00:53.232 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T16:00:53.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a88145140 con 0x7f3a880744e0 2024-04-25T16:00:53.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a6f7fe640 1 -- 172.21.15.87:0/3552728050 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5667 (secure 0 0 0) 0x7f3a7805af50 con 0x7f3a880744e0 2024-04-25T16:00:53.258 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:53.258 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:00:53.258 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 68 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a7406f430 msgr2=0x7f3a74071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a7406f430 0x7f3a74071940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009a50 tx=0x7f3a7c008040 comp rx=0 tx=0).stop 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 msgr2=0x7f3a8806f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a8806f590 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c370 tx=0x7f3a7800c830 comp rx=0 tx=0).stop 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 shutdown_connections 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f3a7406f430 0x7f3a74071940 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a88154c90 0x7f3a88144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a880744e0 0x7f3a8806f590 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 --2- 172.21.15.87:0/3552728050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a880740d0 0x7f3a88148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.257+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 >> 172.21.15.87:0/3552728050 conn(0x7f3a8806d650 msgr2=0x7f3a88155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.261+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 shutdown_connections 2024-04-25T16:00:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.261+0000 7f3a8d239640 1 -- 172.21.15.87:0/3552728050 wait complete. 2024-04-25T16:00:53.278 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=5269 2024-04-25T16:00:53.279 INFO:tasks.mds_thrash.fs.[a]:waiting for 9 secs before reviving mds.b 2024-04-25T16:00:53.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 Processor -- start 2024-04-25T16:00:53.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 -- start start 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34f81518b0 0x7f34f806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 0x7f34f815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f8154fc0 con 0x7f34f80ad160 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f34f806ed60 con 0x7f34f81518b0 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f3500452640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34f80acb20 con 0x7f34f806fa10 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe1ee640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34f81518b0 0x7f34f806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 0x7f34f815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 0x7f34f815e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:57000/0 (socket says 172.21.15.87:57000) 2024-04-25T16:00:53.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 -- 172.21.15.87:0/3554614895 learned_addr learned my addr 172.21.15.87:0/3554614895 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:53.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 -- 172.21.15.87:0/3554614895 >> v2:172.21.15.155:3300/0 conn(0x7f34f81518b0 msgr2=0x7f34f806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:53.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 --2- 172.21.15.87:0/3554614895 >> v2:172.21.15.155:3300/0 conn(0x7f34f81518b0 0x7f34f806f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 -- 172.21.15.87:0/3554614895 >> v1:172.21.15.155:6789/0 conn(0x7f34f80ad160 legacy=0x7f34f80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.385+0000 7f34fe9ef640 1 -- 172.21.15.87:0/3554614895 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f80ace00 con 0x7f34f806fa10 2024-04-25T16:00:53.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f34fe9ef640 1 --2- 172.21.15.87:0/3554614895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 0x7f34f815e9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34f806eee0 tx=0x7f34f001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b621eb4181334d72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f34fd1ec640 1 -- 172.21.15.87:0/3554614895 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a7070 con 0x7f34f806fa10 2024-04-25T16:00:53.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f34fd1ec640 1 -- 172.21.15.87:0/3554614895 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f00b0070 con 0x7f34f806fa10 2024-04-25T16:00:53.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f34fd1ec640 1 -- 172.21.15.87:0/3554614895 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f00ab890 con 0x7f34f806fa10 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 -- 172.21.15.87:0/3554614895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 msgr2=0x7f34f815e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 --2- 172.21.15.87:0/3554614895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 0x7f34f815e9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34f806eee0 tx=0x7f34f001c540 comp rx=0 tx=0).stop 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 -- 172.21.15.87:0/3554614895 shutdown_connections 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 --2- 172.21.15.87:0/3554614895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f806fa10 0x7f34f815e9b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 --2- 172.21.15.87:0/3554614895 >> v2:172.21.15.155:3300/0 conn(0x7f34f81518b0 0x7f34f806f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 -- 172.21.15.87:0/3554614895 >> 172.21.15.87:0/3554614895 conn(0x7f34f80c8770 msgr2=0x7f34f80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 -- 172.21.15.87:0/3554614895 shutdown_connections 2024-04-25T16:00:53.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.389+0000 7f3500452640 1 -- 172.21.15.87:0/3554614895 wait complete. 2024-04-25T16:00:53.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 Processor -- start 2024-04-25T16:00:53.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- start start 2024-04-25T16:00:53.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 0x7f34f81f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f80ad160 0x7f34f80c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f81518b0 0x7f34f814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34f8161710 con 0x7f34f806fa10 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34f8161890 con 0x7f34f80ad160 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34f8161a10 con 0x7f34f81518b0 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 0x7f34f81f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 0x7f34f81f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54426/0 (socket says 172.21.15.87:54426) 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 -- 172.21.15.87:0/1988685930 learned_addr learned my addr 172.21.15.87:0/1988685930 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fd9ed640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f80ad160 0x7f34f80c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe9ef640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f81518b0 0x7f34f814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 -- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f81518b0 msgr2=0x7f34f814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f81518b0 0x7f34f814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 -- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f80ad160 msgr2=0x7f34f80c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f80ad160 0x7f34f80c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 -- 172.21.15.87:0/1988685930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f80c1a90 con 0x7f34f806fa10 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe9ef640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f81518b0 0x7f34f814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34fe1ee640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 0x7f34f81f2830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f34e800e870 tx=0x7f34e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8017070 con 0x7f34f806fa10 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e800c940 con 0x7f34f806fa10 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e800cd10 con 0x7f34f806fa10 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f80c0ff0 con 0x7f34f806fa10 2024-04-25T16:00:53.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f814d580 con 0x7f34f806fa10 2024-04-25T16:00:53.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.393+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f814d7c0 con 0x7f34f806fa10 2024-04-25T16:00:53.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.397+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f34e801a070 con 0x7f34f806fa10 2024-04-25T16:00:53.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.397+0000 7f34eeffd640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34dc06f400 0x7f34dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.397+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f34e808f740 con 0x7f34f806fa10 2024-04-25T16:00:53.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.397+0000 7f34fd9ed640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34dc06f400 0x7f34dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.397+0000 7f34fd9ed640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34dc06f400 0x7f34dc071910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f34f81ef9e0 tx=0x7f34f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.401+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34f814d7c0 con 0x7f34f806fa10 2024-04-25T16:00:53.557 INFO:tasks.ceph.mds.c.smithi087.stderr:2024-04-25T16:00:53.557+0000 7fd321598640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T16:00:53.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34f8069bb0 con 0x7f34f806fa10 2024-04-25T16:00:53.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f34eeffd640 1 -- 172.21.15.87:0/1988685930 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7f34e805c010 con 0x7f34f806fa10 2024-04-25T16:00:53.564 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T16:00:53.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34dc06f400 msgr2=0x7f34dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34dc06f400 0x7f34dc071910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f34f81ef9e0 tx=0x7f34f4009040 comp rx=0 tx=0).stop 2024-04-25T16:00:53.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 msgr2=0x7f34f81f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 0x7f34f81f2830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f34e800e870 tx=0x7f34e800ec70 comp rx=0 tx=0).stop 2024-04-25T16:00:53.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 shutdown_connections 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34dc06f400 0x7f34dc071910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34f81518b0 0x7f34f814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34f80ad160 0x7f34f80c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 --2- 172.21.15.87:0/1988685930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34f806fa10 0x7f34f81f2830 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 >> 172.21.15.87:0/1988685930 conn(0x7f34f80c8770 msgr2=0x7f34f80c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 shutdown_connections 2024-04-25T16:00:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.565+0000 7f3500452640 1 -- 172.21.15.87:0/1988685930 wait complete. 2024-04-25T16:00:53.589 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T16:00:53.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334ede4640 1 Processor -- start 2024-04-25T16:00:53.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334ede4640 1 -- start start 2024-04-25T16:00:53.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334ede4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3348154c90 0x7f3348162e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334ede4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3348063220 con 0x7f33480744e0 2024-04-25T16:00:53.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334ede4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33480c5570 con 0x7f33480740d0 2024-04-25T16:00:53.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334ede4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3348074a90 con 0x7f3348154c90 2024-04-25T16:00:53.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334d381640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3348154c90 0x7f3348162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f3347fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f33480744e0 0x7f3348154580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57226/0 (socket says 172.21.15.87:57226) 2024-04-25T16:00:53.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f3347fff640 1 -- 172.21.15.87:0/4242186876 learned_addr learned my addr 172.21.15.87:0/4242186876 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:53.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334d381640 1 -- 172.21.15.87:0/4242186876 >> v1:172.21.15.155:6789/0 conn(0x7f33480740d0 legacy=0x7f33480c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334d381640 1 -- 172.21.15.87:0/4242186876 >> v1:172.21.15.87:6789/0 conn(0x7f33480744e0 legacy=0x7f3348154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.737+0000 7f334d381640 1 -- 172.21.15.87:0/4242186876 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33480634c0 con 0x7f3348154c90 2024-04-25T16:00:53.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334d381640 1 --2- 172.21.15.87:0/4242186876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3348154c90 0x7f3348162e80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f33380097c0 tx=0x7f333801c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b811c45f4ca26c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f33477fe640 1 -- 172.21.15.87:0/4242186876 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33380b0070 con 0x7f3348154c90 2024-04-25T16:00:53.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f33477fe640 1 -- 172.21.15.87:0/4242186876 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33380ab600 con 0x7f3348154c90 2024-04-25T16:00:53.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f33477fe640 1 -- 172.21.15.87:0/4242186876 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33380ab9d0 con 0x7f3348154c90 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 -- 172.21.15.87:0/4242186876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3348154c90 msgr2=0x7f3348162e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 --2- 172.21.15.87:0/4242186876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3348154c90 0x7f3348162e80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f33380097c0 tx=0x7f333801c2a0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 -- 172.21.15.87:0/4242186876 shutdown_connections 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 --2- 172.21.15.87:0/4242186876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3348154c90 0x7f3348162e80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 -- 172.21.15.87:0/4242186876 >> 172.21.15.87:0/4242186876 conn(0x7f334806d650 msgr2=0x7f33480c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 -- 172.21.15.87:0/4242186876 shutdown_connections 2024-04-25T16:00:53.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.741+0000 7f334ede4640 1 -- 172.21.15.87:0/4242186876 wait complete. 2024-04-25T16:00:53.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 Processor -- start 2024-04-25T16:00:53.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 -- start start 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33480740d0 0x7f334806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 0x7f3348147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3348154c90 0x7f33480c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f33480c2c00 con 0x7f33480744e0 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33480c2a80 con 0x7f33480740d0 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33480c5060 con 0x7f3348154c90 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 0x7f3348147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 0x7f3348147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54444/0 (socket says 172.21.15.87:54444) 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 -- 172.21.15.87:0/2543173845 learned_addr learned my addr 172.21.15.87:0/2543173845 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334cb80640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33480740d0 0x7f334806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334d381640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3348154c90 0x7f33480c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 -- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3348154c90 msgr2=0x7f33480c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3348154c90 0x7f33480c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 -- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33480740d0 msgr2=0x7f334806f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33480740d0 0x7f334806f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 -- 172.21.15.87:0/2543173845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33481f17b0 con 0x7f33480744e0 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334d381640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3348154c90 0x7f33480c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f3347fff640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 0x7f3348147e70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f333000c780 tx=0x7f333000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330018070 con 0x7f33480744e0 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33300072d0 con 0x7f33480744e0 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33480702b0 con 0x7f33480744e0 2024-04-25T16:00:53.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.745+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33300047f0 con 0x7f33480744e0 2024-04-25T16:00:53.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334806e8f0 con 0x7f33480744e0 2024-04-25T16:00:53.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3348069bb0 con 0x7f33480744e0 2024-04-25T16:00:53.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f333001b070 con 0x7f33480744e0 2024-04-25T16:00:53.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f33457fa640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332806f430 0x7f3328071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:53.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f334cb80640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332806f430 0x7f3328071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:53.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f333008efb0 con 0x7f33480744e0 2024-04-25T16:00:53.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.749+0000 7f334cb80640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332806f430 0x7f3328071940 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f33400012f0 tx=0x7f3340009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:53.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.753+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f333005b280 con 0x7f33480744e0 2024-04-25T16:00:53.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.909+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f33481f14d0 con 0x7f33480744e0 2024-04-25T16:00:53.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.909+0000 7f33457fa640 1 -- 172.21.15.87:0/2543173845 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7f333005f580 con 0x7f33480744e0 2024-04-25T16:00:53.911 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:00:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332806f430 msgr2=0x7f3328071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332806f430 0x7f3328071940 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f33400012f0 tx=0x7f3340009040 comp rx=0 tx=0).stop 2024-04-25T16:00:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 msgr2=0x7f3348147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:53.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 0x7f3348147e70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f333000c780 tx=0x7f333000cc40 comp rx=0 tx=0).stop 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 shutdown_connections 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f332806f430 0x7f3328071940 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3348154c90 0x7f33480c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33480744e0 0x7f3348147e70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 --2- 172.21.15.87:0/2543173845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33480740d0 0x7f334806f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 >> 172.21.15.87:0/2543173845 conn(0x7f334806d650 msgr2=0x7f33481466a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 shutdown_connections 2024-04-25T16:00:53.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:53.913+0000 7f334ede4640 1 -- 172.21.15.87:0/2543173845 wait complete. 2024-04-25T16:00:53.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T16:00:54.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 Processor -- start 2024-04-25T16:00:54.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 -- start start 2024-04-25T16:00:54.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b741518b0 0x7f4b7406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b7406fa10 0x7f4b7415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b74154fc0 con 0x7f4b740ad160 2024-04-25T16:00:54.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7406ed60 con 0x7f4b7406fa10 2024-04-25T16:00:54.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7c069640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b740acb20 con 0x7f4b741518b0 2024-04-25T16:00:54.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b7406fa10 0x7f4b7415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b7406fa10 0x7f4b7415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54458/0 (socket says 172.21.15.87:54458) 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 -- 172.21.15.87:0/4263448864 learned_addr learned my addr 172.21.15.87:0/4263448864 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b79604640 1 --1- 172.21.15.87:0/4263448864 >> v1:172.21.15.155:6789/0 conn(0x7f4b740ad160 0x7f4b740c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:34800/0 (socket says 172.21.15.87:34800) 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b79e05640 1 --2- 172.21.15.87:0/4263448864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b741518b0 0x7f4b7406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 -- 172.21.15.87:0/4263448864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b741518b0 msgr2=0x7f4b7406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 --2- 172.21.15.87:0/4263448864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b741518b0 0x7f4b7406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 -- 172.21.15.87:0/4263448864 >> v1:172.21.15.155:6789/0 conn(0x7f4b740ad160 legacy=0x7f4b740c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.085+0000 7f4b7a606640 1 -- 172.21.15.87:0/4263448864 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b740ace00 con 0x7f4b7406fa10 2024-04-25T16:00:54.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7a606640 1 --2- 172.21.15.87:0/4263448864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7406fa10 0x7f4b7415e9b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009e50 tx=0x7f4b6c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f73b45a8cd824 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b78e03640 1 -- 172.21.15.87:0/4263448864 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0a5830 con 0x7f4b7406fa10 2024-04-25T16:00:54.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b78e03640 1 -- 172.21.15.87:0/4263448864 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0a59d0 con 0x7f4b7406fa10 2024-04-25T16:00:54.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b78e03640 1 -- 172.21.15.87:0/4263448864 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0a5da0 con 0x7f4b7406fa10 2024-04-25T16:00:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 -- 172.21.15.87:0/4263448864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7406fa10 msgr2=0x7f4b7415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 --2- 172.21.15.87:0/4263448864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7406fa10 0x7f4b7415e9b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009e50 tx=0x7f4b6c01ca30 comp rx=0 tx=0).stop 2024-04-25T16:00:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 -- 172.21.15.87:0/4263448864 shutdown_connections 2024-04-25T16:00:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 --2- 172.21.15.87:0/4263448864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b7406fa10 0x7f4b7415e9b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 --2- 172.21.15.87:0/4263448864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b741518b0 0x7f4b7406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 -- 172.21.15.87:0/4263448864 >> 172.21.15.87:0/4263448864 conn(0x7f4b740c8770 msgr2=0x7f4b740c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:54.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 -- 172.21.15.87:0/4263448864 shutdown_connections 2024-04-25T16:00:54.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 -- 172.21.15.87:0/4263448864 wait complete. 2024-04-25T16:00:54.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 Processor -- start 2024-04-25T16:00:54.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.089+0000 7f4b7c069640 1 -- start start 2024-04-25T16:00:54.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b7406fa10 0x7f4b7414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b740ad160 0x7f4b741f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 0x7f4b741f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4b74161710 con 0x7f4b741518b0 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b74161890 con 0x7f4b7406fa10 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b74161a10 con 0x7f4b740ad160 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 0x7f4b741f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 0x7f4b741f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54472/0 (socket says 172.21.15.87:54472) 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 -- 172.21.15.87:0/3221066181 learned_addr learned my addr 172.21.15.87:0/3221066181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b79604640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b740ad160 0x7f4b741f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b79e05640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b7406fa10 0x7f4b7414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 -- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b740ad160 msgr2=0x7f4b741f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b740ad160 0x7f4b741f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 -- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b7406fa10 msgr2=0x7f4b7414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b7406fa10 0x7f4b7414cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 -- 172.21.15.87:0/3221066181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b740c2b30 con 0x7f4b741518b0 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7a606640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 0x7f4b741f1590 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0af040 tx=0x7f4b6c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0bc020 con 0x7f4b741518b0 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0b8670 con 0x7f4b741518b0 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b741f1b70 con 0x7f4b741518b0 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0b8a40 con 0x7f4b741518b0 2024-04-25T16:00:54.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7414d420 con 0x7f4b741518b0 2024-04-25T16:00:54.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b740be740 con 0x7f4b741518b0 2024-04-25T16:00:54.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b6c0bf020 con 0x7f4b741518b0 2024-04-25T16:00:54.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.093+0000 7f4b6a7fc640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b5806f400 0x7f4b58071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.097+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f4b6c12ab80 con 0x7f4b741518b0 2024-04-25T16:00:54.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.097+0000 7f4b79e05640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b5806f400 0x7f4b58071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.097+0000 7f4b79e05640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b5806f400 0x7f4b58071910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b740aad60 tx=0x7f4b70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.097+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b6c0c6030 con 0x7f4b741518b0 2024-04-25T16:00:54.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f4b740c28c0 con 0x7f4b741518b0 2024-04-25T16:00:54.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b6a7fc640 1 -- 172.21.15.87:0/3221066181 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7f4b6c016620 con 0x7f4b741518b0 2024-04-25T16:00:54.261 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b5806f400 msgr2=0x7f4b58071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b5806f400 0x7f4b58071910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b740aad60 tx=0x7f4b70008040 comp rx=0 tx=0).stop 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 msgr2=0x7f4b741f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 0x7f4b741f1590 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0af040 tx=0x7f4b6c0197d0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 shutdown_connections 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b5806f400 0x7f4b58071910 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b741518b0 0x7f4b741f1590 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b740ad160 0x7f4b741f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 --2- 172.21.15.87:0/3221066181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b7406fa10 0x7f4b7414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 >> 172.21.15.87:0/3221066181 conn(0x7f4b740c8770 msgr2=0x7f4b740ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:54.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 shutdown_connections 2024-04-25T16:00:54.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.261+0000 7f4b7c069640 1 -- 172.21.15.87:0/3221066181 wait complete. 2024-04-25T16:00:54.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T16:00:54.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091ca9b640 1 Processor -- start 2024-04-25T16:00:54.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091ca9b640 1 -- start start 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091ca9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 0x7f0918155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091ca9b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09180a9e00 con 0x7f09180740a0 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091ca9b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09181552b0 con 0x7f0918152820 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091ca9b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0918155900 con 0x7f09180c9b60 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0916d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f09180740a0 0x7f091815fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57242/0 (socket says 172.21.15.87:57242) 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0916d9d640 1 -- 172.21.15.87:0/3124858554 learned_addr learned my addr 172.21.15.87:0/3124858554 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091659c640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 0x7f0918155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222656501 0 0) 0x7f09180a9e00 con 0x7f09180740a0 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0904003530 con 0x7f09180740a0 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 970959488 0 0) 0x7f0904003530 con 0x7f09180740a0 2024-04-25T16:00:54.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 msgr2=0x7f0918155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 0x7f0918155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 >> v1:172.21.15.155:6789/0 conn(0x7f0918152820 legacy=0x7f09180c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0918155590 con 0x7f09180740a0 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f0910001680 con 0x7f09180740a0 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 >> v1:172.21.15.87:6789/0 conn(0x7f09180740a0 legacy=0x7f091815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09040039f0 0x7f0904003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f0904004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 0x7f090400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0918155900 con 0x7f0904004810 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f09040055a0 con 0x7f09040039f0 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f090400bf10 con 0x7f09180c9b60 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0915d9b640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f0904004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f091659c640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09040039f0 0x7f0904003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0916d9d640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 0x7f090400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0915d9b640 1 -- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 msgr2=0x7f090400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:54.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0915d9b640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09180c9b60 0x7f090400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0915d9b640 1 -- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09040039f0 msgr2=0x7f0904003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:54.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0915d9b640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09040039f0 0x7f0904003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.425+0000 7f0915d9b640 1 -- 172.21.15.87:0/3124858554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0904003530 con 0x7f0904004810 2024-04-25T16:00:54.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f0915d9b640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f0904004c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f09180b0b80 tx=0x7f090001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da526a15c81f5ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09000013a0 con 0x7f0904004810 2024-04-25T16:00:54.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09000052f0 con 0x7f0904004810 2024-04-25T16:00:54.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091559a640 1 -- 172.21.15.87:0/3124858554 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900003840 con 0x7f0904004810 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091ca9b640 1 -- 172.21.15.87:0/3124858554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 msgr2=0x7f0904004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091ca9b640 1 --2- 172.21.15.87:0/3124858554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f0904004c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f09180b0b80 tx=0x7f090001c300 comp rx=0 tx=0).stop 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f0916d9d640 1 -- 172.21.15.87:0/3124858554 reap_dead start 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091ca9b640 1 -- 172.21.15.87:0/3124858554 shutdown_connections 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091ca9b640 1 -- 172.21.15.87:0/3124858554 >> 172.21.15.87:0/3124858554 conn(0x7f09180ac5c0 msgr2=0x7f09180ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091ca9b640 1 -- 172.21.15.87:0/3124858554 shutdown_connections 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.429+0000 7f091ca9b640 1 -- 172.21.15.87:0/3124858554 wait complete. 2024-04-25T16:00:54.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 Processor -- start 2024-04-25T16:00:54.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- start start 2024-04-25T16:00:54.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f091814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09180c3c40 0x7f09180c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f091806d810 0x7f091806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f09180748c0 con 0x7f0904004810 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f09180c8e20 con 0x7f09180c3c40 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0918161c60 con 0x7f091806d810 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f091814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f091814fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54486/0 (socket says 172.21.15.87:54486) 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 -- 172.21.15.87:0/375800633 learned_addr learned my addr 172.21.15.87:0/375800633 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f0915d9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09180c3c40 0x7f09180c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f0916d9d640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f091806d810 0x7f091806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 -- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f091806d810 msgr2=0x7f091806dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f091806d810 0x7f091806dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 -- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09180c3c40 msgr2=0x7f09180c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09180c3c40 0x7f09180c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 -- 172.21.15.87:0/375800633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09181459e0 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f0915d9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09180c3c40 0x7f09180c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f0916d9d640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f091806d810 0x7f091806dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091659c640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f091814fb10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0908009fc0 tx=0x7f09080115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080039a0 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090801b070 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091806f5c0 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908003b40 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091806e270 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.433+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091806f3b0 con 0x7f0904004810 2024-04-25T16:00:54.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.437+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0908003ce0 con 0x7f0904004810 2024-04-25T16:00:54.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.437+0000 7f090effd640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f08f806f430 0x7f08f8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.437+0000 7f0915d9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f08f806f430 0x7f08f8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.437+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f0908090500 con 0x7f0904004810 2024-04-25T16:00:54.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.437+0000 7f0915d9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f08f806f430 0x7f08f8071940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0918072fd0 tx=0x7f09000011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.441+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0908025020 con 0x7f0904004810 2024-04-25T16:00:54.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.597+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f091806f790 con 0x7f0904004810 2024-04-25T16:00:54.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.597+0000 7f090effd640 1 -- 172.21.15.87:0/375800633 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7f090805cdd0 con 0x7f0904004810 2024-04-25T16:00:54.598 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f08f806f430 msgr2=0x7f08f8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f08f806f430 0x7f08f8071940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0918072fd0 tx=0x7f09000011a0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 msgr2=0x7f091814fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f091814fb10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0908009fc0 tx=0x7f09080115a0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 shutdown_connections 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f08f806f430 0x7f08f8071940 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f091806d810 0x7f091806dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09180c3c40 0x7f09180c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 --2- 172.21.15.87:0/375800633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0904004810 0x7f091814fb10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 >> 172.21.15.87:0/375800633 conn(0x7f09180ac5c0 msgr2=0x7f09180ab370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:54.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 shutdown_connections 2024-04-25T16:00:54.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.601+0000 7f091ca9b640 1 -- 172.21.15.87:0/375800633 wait complete. 2024-04-25T16:00:54.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T16:00:54.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e85c7640 1 Processor -- start 2024-04-25T16:00:54.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e85c7640 1 -- start start 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e85c7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39e0155730 0x7f39e0160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e85c7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e0152d90 con 0x7f39e0152980 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e85c7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e00a9cd0 con 0x7f39e0155320 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e85c7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f39e00aa290 con 0x7f39e0155730 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e6b64640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39e0155730 0x7f39e0160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e6363640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f39e0152980 0x7f39e00c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57252/0 (socket says 172.21.15.87:57252) 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e6363640 1 -- 172.21.15.87:0/3926034918 learned_addr learned my addr 172.21.15.87:0/3926034918 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e6b64640 1 -- 172.21.15.87:0/3926034918 >> v1:172.21.15.155:6789/0 conn(0x7f39e0155320 legacy=0x7f39e0074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e6b64640 1 -- 172.21.15.87:0/3926034918 >> v1:172.21.15.87:6789/0 conn(0x7f39e0152980 legacy=0x7f39e00c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e5361640 1 -- 172.21.15.87:0/3926034918 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226974594 0 0) 0x7f39e0152d90 con 0x7f39e0152980 2024-04-25T16:00:54.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.765+0000 7f39e6b64640 1 -- 172.21.15.87:0/3926034918 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e00a9fb0 con 0x7f39e0155730 2024-04-25T16:00:54.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e6b64640 1 --2- 172.21.15.87:0/3926034918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155730 0x7f39e0160cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009d90 tx=0x7f39d801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297be09d61c033e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e5361640 1 -- 172.21.15.87:0/3926034918 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80b2070 con 0x7f39e0155730 2024-04-25T16:00:54.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e5361640 1 -- 172.21.15.87:0/3926034918 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d80a5760 con 0x7f39e0155730 2024-04-25T16:00:54.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e5361640 1 -- 172.21.15.87:0/3926034918 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80a5b30 con 0x7f39e0155730 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 -- 172.21.15.87:0/3926034918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155730 msgr2=0x7f39e0160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 --2- 172.21.15.87:0/3926034918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155730 0x7f39e0160cb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009d90 tx=0x7f39d801c8a0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 -- 172.21.15.87:0/3926034918 shutdown_connections 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 --2- 172.21.15.87:0/3926034918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155730 0x7f39e0160cb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 -- 172.21.15.87:0/3926034918 >> 172.21.15.87:0/3926034918 conn(0x7f39e00ac550 msgr2=0x7f39e00ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 -- 172.21.15.87:0/3926034918 shutdown_connections 2024-04-25T16:00:54.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.769+0000 7f39e85c7640 1 -- 172.21.15.87:0/3926034918 wait complete. 2024-04-25T16:00:54.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 Processor -- start 2024-04-25T16:00:54.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- start start 2024-04-25T16:00:54.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39e0152980 0x7f39e0157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 0x7f39e01eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39e0155730 0x7f39e01f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f39e00749f0 con 0x7f39e0155320 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39e0074870 con 0x7f39e0152980 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39e00729c0 con 0x7f39e0155730 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 0x7f39e01eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 0x7f39e01eef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54510/0 (socket says 172.21.15.87:54510) 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 -- 172.21.15.87:0/2452253608 learned_addr learned my addr 172.21.15.87:0/2452253608 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 -- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39e0155730 msgr2=0x7f39e01f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39e0155730 0x7f39e01f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 -- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39e0152980 msgr2=0x7f39e0157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e6363640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39e0152980 0x7f39e0157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39e0152980 0x7f39e0157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 -- 172.21.15.87:0/2452253608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e01efe00 con 0x7f39e0155320 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e5b62640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 0x7f39e01eef80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f39d000b3e0 tx=0x7f39d000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0015020 con 0x7f39e0155320 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d0011850 con 0x7f39e0155320 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e01eeaa0 con 0x7f39e0155320 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0011c40 con 0x7f39e0155320 2024-04-25T16:00:54.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e01f2ab0 con 0x7f39e0155320 2024-04-25T16:00:54.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.773+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e01f28c0 con 0x7f39e0155320 2024-04-25T16:00:54.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.777+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39d0018020 con 0x7f39e0155320 2024-04-25T16:00:54.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.777+0000 7f39d6ffd640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39c406f400 0x7f39c4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:54.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.777+0000 7f39e6363640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39c406f400 0x7f39c4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:54.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.777+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f39d008f8b0 con 0x7f39e0155320 2024-04-25T16:00:54.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.777+0000 7f39e6363640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39c406f400 0x7f39c4071910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000f70 tx=0x7f39dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:54.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.781+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39d001f020 con 0x7f39e0155320 2024-04-25T16:00:54.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.937+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f39e0069bb0 con 0x7f39e0155320 2024-04-25T16:00:54.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.937+0000 7f39d6ffd640 1 -- 172.21.15.87:0/2452253608 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7f39d005c180 con 0x7f39e0155320 2024-04-25T16:00:54.939 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:00:54.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39c406f400 msgr2=0x7f39c4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39c406f400 0x7f39c4071910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000f70 tx=0x7f39dc009040 comp rx=0 tx=0).stop 2024-04-25T16:00:54.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 msgr2=0x7f39e01eef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:54.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 0x7f39e01eef80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f39d000b3e0 tx=0x7f39d000b8a0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 shutdown_connections 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f39c406f400 0x7f39c4071910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39e0155730 0x7f39e01f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e0155320 0x7f39e01eef80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 --2- 172.21.15.87:0/2452253608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39e0152980 0x7f39e0157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 >> 172.21.15.87:0/2452253608 conn(0x7f39e00ac550 msgr2=0x7f39e01530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 shutdown_connections 2024-04-25T16:00:54.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:54.941+0000 7f39e85c7640 1 -- 172.21.15.87:0/2452253608 wait complete. 2024-04-25T16:00:54.959 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T16:00:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.093+0000 7f73c83af640 1 Processor -- start 2024-04-25T16:00:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.093+0000 7f73c83af640 1 -- start start 2024-04-25T16:00:55.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c83af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73c006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c83af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c0154fc0 con 0x7f73c006fa10 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c83af640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c00acb20 con 0x7f73c00ad160 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c83af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73c006ed60 con 0x7f73c01518b0 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f73c006fa10 0x7f73c015e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57254/0 (socket says 172.21.15.87:57254) 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 -- 172.21.15.87:0/1627562097 learned_addr learned my addr 172.21.15.87:0/1627562097 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c614b640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73c006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158900542 0 0) 0x7f73c0154fc0 con 0x7f73c006fa10 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ac003530 con 0x7f73c006fa10 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4140004515 0 0) 0x7f73ac003530 con 0x7f73c006fa10 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 msgr2=0x7f73c006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73c006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 >> v1:172.21.15.155:6789/0 conn(0x7f73c00ad160 legacy=0x7f73c00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c00ace00 con 0x7f73c006fa10 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f73b8001a00 con 0x7f73c006fa10 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 >> v1:172.21.15.87:6789/0 conn(0x7f73c006fa10 legacy=0x7f73c015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73ac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ac003f70 0x7f73ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ac004d50 0x7f73ac005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006ed60 con 0x7f73ac004d50 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac00bb60 con 0x7f73ac003f70 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac00bd60 con 0x7f73c01518b0 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ac004d50 0x7f73ac005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c614b640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73ac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c594a640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ac003f70 0x7f73ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 -- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 msgr2=0x7f73ac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73ac0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 -- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ac003f70 msgr2=0x7f73ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ac003f70 0x7f73ac004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 -- 172.21.15.87:0/1627562097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac003530 con 0x7f73ac004d50 2024-04-25T16:00:55.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c614b640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73c01518b0 0x7f73ac0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c694c640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ac004d50 0x7f73ac005160 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f73c00753c0 tx=0x7f73b801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f626a882f0127f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.097+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800a460 con 0x7f73ac004d50 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b80ad650 con 0x7f73ac004d50 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c5149640 1 -- 172.21.15.87:0/1627562097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80ada40 con 0x7f73ac004d50 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- 172.21.15.87:0/1627562097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ac004d50 msgr2=0x7f73ac005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 --2- 172.21.15.87:0/1627562097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73ac004d50 0x7f73ac005160 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f73c00753c0 tx=0x7f73b801d300 comp rx=0 tx=0).stop 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c694c640 1 -- 172.21.15.87:0/1627562097 reap_dead start 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- 172.21.15.87:0/1627562097 shutdown_connections 2024-04-25T16:00:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- 172.21.15.87:0/1627562097 >> 172.21.15.87:0/1627562097 conn(0x7f73c00c8770 msgr2=0x7f73c00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- 172.21.15.87:0/1627562097 shutdown_connections 2024-04-25T16:00:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- 172.21.15.87:0/1627562097 wait complete. 2024-04-25T16:00:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 Processor -- start 2024-04-25T16:00:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- start start 2024-04-25T16:00:55.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ac004d50 0x7f73c0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 0x7f73c014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73c0151ec0 0x7f73c01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00c4970 con 0x7f73c01579c0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00c47f0 con 0x7f73c0151ec0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c83af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73c0071e50 con 0x7f73ac004d50 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c594a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 0x7f73c014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c594a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 0x7f73c014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54524/0 (socket says 172.21.15.87:54524) 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c594a640 1 -- 172.21.15.87:0/2924935211 learned_addr learned my addr 172.21.15.87:0/2924935211 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c694c640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73c0151ec0 0x7f73c01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.101+0000 7f73c614b640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ac004d50 0x7f73c0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c594a640 1 -- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ac004d50 msgr2=0x7f73c0157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c594a640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ac004d50 0x7f73c0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c594a640 1 -- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73c0151ec0 msgr2=0x7f73c01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c594a640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73c0151ec0 0x7f73c01522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c594a640 1 -- 172.21.15.87:0/2924935211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c01ec5c0 con 0x7f73c01579c0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c594a640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 0x7f73c014dbb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73b000d4a0 tx=0x7f73b000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0005480 con 0x7f73c01579c0 2024-04-25T16:00:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b0017070 con 0x7f73c01579c0 2024-04-25T16:00:55.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c01ec8a0 con 0x7f73c01579c0 2024-04-25T16:00:55.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0003820 con 0x7f73c01579c0 2024-04-25T16:00:55.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01ece60 con 0x7f73c01579c0 2024-04-25T16:00:55.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c0158480 con 0x7f73c01579c0 2024-04-25T16:00:55.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f73b00039c0 con 0x7f73c01579c0 2024-04-25T16:00:55.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73b6ffd640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73a406f400 0x7f73a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c614b640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73a406f400 0x7f73a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f73b008f700 con 0x7f73c01579c0 2024-04-25T16:00:55.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.105+0000 7f73c614b640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73a406f400 0x7f73a4071910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f73c00aad60 tx=0x7f73bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.109+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73b005beb0 con 0x7f73c01579c0 2024-04-25T16:00:55.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.269+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f73c0069bb0 con 0x7f73c01579c0 2024-04-25T16:00:55.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.269+0000 7f73b6ffd640 1 -- 172.21.15.87:0/2924935211 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 20 entries v36) ==== 81+0+1226 (secure 0 0 0) 0x7f73b005b7b0 con 0x7f73c01579c0 2024-04-25T16:00:55.271 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:00:55.271 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:00:55.271 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:00:55.271 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:00:55.271 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:00:55.272 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:00:55.273 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:00:55.273 INFO:teuthology.orchestra.run.smithi087.stderr:listed 20 entries 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73a406f400 msgr2=0x7f73a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73a406f400 0x7f73a4071910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f73c00aad60 tx=0x7f73bc008040 comp rx=0 tx=0).stop 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 msgr2=0x7f73c014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 0x7f73c014dbb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f73b000d4a0 tx=0x7f73b000d960 comp rx=0 tx=0).stop 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 shutdown_connections 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f73a406f400 0x7f73a4071910 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73c0151ec0 0x7f73c01522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73c01579c0 0x7f73c014dbb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 --2- 172.21.15.87:0/2924935211 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ac004d50 0x7f73c0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 >> 172.21.15.87:0/2924935211 conn(0x7f73c00c8770 msgr2=0x7f73c014ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 shutdown_connections 2024-04-25T16:00:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.273+0000 7f73c83af640 1 -- 172.21.15.87:0/2924935211 wait complete. 2024-04-25T16:00:55.291 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-25T16:00:55.291 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:00:55.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:00:55.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b6721640 1 Processor -- start 2024-04-25T16:00:55.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b6721640 1 -- start start 2024-04-25T16:00:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b6721640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f87b0071e50 0x7f87b00c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b6721640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0072430 con 0x7f87b00c4720 2024-04-25T16:00:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b6721640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0074730 con 0x7f87b01529a0 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b6721640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f87b0074a10 con 0x7f87b0071e50 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b4cbe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f87b00c4720 0x7f87b015fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57268/0 (socket says 172.21.15.87:57268) 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b4cbe640 1 -- 172.21.15.87:0/1427720438 learned_addr learned my addr 172.21.15.87:0/1427720438 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1427720438 >> v2:172.21.15.155:3300/0 conn(0x7f87b0071e50 0x7f87b00c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85094338 0 0) 0x7f87b0072430 con 0x7f87b00c4720 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f879c003530 con 0x7f87b00c4720 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 837578509 0 0) 0x7f879c003530 con 0x7f87b00c4720 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 >> v2:172.21.15.155:3300/0 conn(0x7f87b0071e50 msgr2=0x7f87b00c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 --2- 172.21.15.87:0/1427720438 >> v2:172.21.15.155:3300/0 conn(0x7f87b0071e50 0x7f87b00c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 >> v1:172.21.15.155:6789/0 conn(0x7f87b01529a0 legacy=0x7f87b00ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0074cf0 con 0x7f87b00c4720 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f87a0001a00 con 0x7f87b00c4720 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 >> v1:172.21.15.87:6789/0 conn(0x7f87b00c4720 legacy=0x7f87b015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f879c003a10 0x7f879c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f879c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879c0052b0 0x7f879c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0074a10 con 0x7f879c004810 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f879c00c240 con 0x7f879c0052b0 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f879c00c440 con 0x7f879c003a10 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f879c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87affff640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f879c003a10 0x7f879c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b4cbe640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879c0052b0 0x7f879c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 -- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f879c003a10 msgr2=0x7f879c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f879c003a10 0x7f879c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 -- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879c0052b0 msgr2=0x7f879c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879c0052b0 0x7f879c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87af7fe640 1 -- 172.21.15.87:0/1427720438 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c003530 con 0x7f879c004810 2024-04-25T16:00:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b4cbe640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879c0052b0 0x7f879c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87b4cbe640 1 -- 172.21.15.87:0/1427720438 reap_dead start 2024-04-25T16:00:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.481+0000 7f87affff640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f879c003a10 0x7f879c003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f879c004c20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f87b006daf0 tx=0x7f879801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe7305c0695bfce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87980096b0 con 0x7f879c004810 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87980a8450 con 0x7f879c004810 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87aeffd640 1 -- 172.21.15.87:0/1427720438 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87980a8840 con 0x7f879c004810 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 -- 172.21.15.87:0/1427720438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 msgr2=0x7f879c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f879c004c20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f87b006daf0 tx=0x7f879801ca10 comp rx=0 tx=0).stop 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 -- 172.21.15.87:0/1427720438 shutdown_connections 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 --2- 172.21.15.87:0/1427720438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f879c004c20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 -- 172.21.15.87:0/1427720438 >> 172.21.15.87:0/1427720438 conn(0x7f87b00c8770 msgr2=0x7f87b00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:55.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 -- 172.21.15.87:0/1427720438 shutdown_connections 2024-04-25T16:00:55.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.485+0000 7f87b6721640 1 -- 172.21.15.87:0/1427720438 wait complete. 2024-04-25T16:00:55.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 Processor -- start 2024-04-25T16:00:55.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- start start 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f87b01f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87b00bdc80 0x7f87b01efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87b00be090 0x7f87b01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0158b30 con 0x7f879c004810 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f87b01589b0 con 0x7f87b00be090 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f87b0158cb0 con 0x7f87b00bdc80 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f87b01f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f87b01f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54546/0 (socket says 172.21.15.87:54546) 2024-04-25T16:00:55.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 -- 172.21.15.87:0/1199678150 learned_addr learned my addr 172.21.15.87:0/1199678150 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 -- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87b00bdc80 msgr2=0x7f87b01efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87b00bdc80 0x7f87b01efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 -- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87b00be090 msgr2=0x7f87b01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b4cbe640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87b00be090 0x7f87b01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87b00be090 0x7f87b01540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 -- 172.21.15.87:0/1199678150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b01f2980 con 0x7f879c004810 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87affff640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f87b01f20a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f87a800d4d0 tx=0x7f87a800d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8005480 con 0x7f879c004810 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a8017070 con 0x7f879c004810 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8003860 con 0x7f879c004810 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b01f2c60 con 0x7f879c004810 2024-04-25T16:00:55.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b0149de0 con 0x7f879c004810 2024-04-25T16:00:55.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b0069bb0 con 0x7f879c004810 2024-04-25T16:00:55.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.489+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f87a8003a00 con 0x7f879c004810 2024-04-25T16:00:55.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.493+0000 7f87acff9640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f879006f400 0x7f8790071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.493+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f879006f400 0x7f8790071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.493+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f87a808f6f0 con 0x7f879c004810 2024-04-25T16:00:55.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.493+0000 7f87af7fe640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f879006f400 0x7f8790071910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f87980af000 tx=0x7f8798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.497+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87a805bf30 con 0x7f879c004810 2024-04-25T16:00:55.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.657+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87b00c3760 con 0x7f879c004810 2024-04-25T16:00:55.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87acff9640 1 -- 172.21.15.87:0/1199678150 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21989 (secure 0 0 0) 0x7f87a805b830 con 0x7f879c004810 2024-04-25T16:00:55.661 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:00:55.661 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:00:43.549189+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:00:55.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f879006f400 msgr2=0x7f8790071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f879006f400 0x7f8790071910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f87980af000 tx=0x7f8798008040 comp rx=0 tx=0).stop 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 msgr2=0x7f87b01f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f87b01f20a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f87a800d4d0 tx=0x7f87a800d990 comp rx=0 tx=0).stop 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 shutdown_connections 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f879006f400 0x7f8790071910 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87b00be090 0x7f87b01540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87b00bdc80 0x7f87b01efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 --2- 172.21.15.87:0/1199678150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f879c004810 0x7f87b01f20a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 >> 172.21.15.87:0/1199678150 conn(0x7f87b00c8770 msgr2=0x7f87b0150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 shutdown_connections 2024-04-25T16:00:55.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.661+0000 7f87b6721640 1 -- 172.21.15.87:0/1199678150 wait complete. 2024-04-25T16:00:55.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T16:00:55.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T16:00:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 Processor -- start 2024-04-25T16:00:55.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 -- start start 2024-04-25T16:00:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040c8bc0 0x7fa2040c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa20415fea0 0x7fa2041622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2040c53b0 con 0x7fa204157530 2024-04-25T16:00:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa204157940 con 0x7fa20415fea0 2024-04-25T16:00:55.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20b96f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa204157b60 con 0x7fa2040c8bc0 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa209f0c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa20415fea0 0x7fa2041622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20970b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa204157530 0x7fa204074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57284/0 (socket says 172.21.15.87:57284) 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa20970b640 1 -- 172.21.15.87:0/2992252083 learned_addr learned my addr 172.21.15.87:0/2992252083 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa208f0a640 1 --2- 172.21.15.87:0/2992252083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040c8bc0 0x7fa2040c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa209f0c640 1 -- 172.21.15.87:0/2992252083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040c8bc0 msgr2=0x7fa2040c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa209f0c640 1 --2- 172.21.15.87:0/2992252083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040c8bc0 0x7fa2040c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa209f0c640 1 -- 172.21.15.87:0/2992252083 >> v1:172.21.15.87:6789/0 conn(0x7fa204157530 legacy=0x7fa204074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa1fbfff640 1 -- 172.21.15.87:0/2992252083 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035235600 0 0) 0x7fa1f4001120 con 0x7fa204157530 2024-04-25T16:00:55.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.829+0000 7fa209f0c640 1 -- 172.21.15.87:0/2992252083 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa204157e40 con 0x7fa20415fea0 2024-04-25T16:00:55.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa209f0c640 1 --2- 172.21.15.87:0/2992252083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa20415fea0 0x7fa2041622c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009d90 tx=0x7fa1fc01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0764da88bf374ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa1fbfff640 1 -- 172.21.15.87:0/2992252083 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0b2070 con 0x7fa20415fea0 2024-04-25T16:00:55.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa1fbfff640 1 -- 172.21.15.87:0/2992252083 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0a58e0 con 0x7fa20415fea0 2024-04-25T16:00:55.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa1fbfff640 1 -- 172.21.15.87:0/2992252083 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0a5cb0 con 0x7fa20415fea0 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 -- 172.21.15.87:0/2992252083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa20415fea0 msgr2=0x7fa2041622c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 --2- 172.21.15.87:0/2992252083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa20415fea0 0x7fa2041622c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009d90 tx=0x7fa1fc01c820 comp rx=0 tx=0).stop 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 -- 172.21.15.87:0/2992252083 shutdown_connections 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 --2- 172.21.15.87:0/2992252083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa20415fea0 0x7fa2041622c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 --2- 172.21.15.87:0/2992252083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2040c8bc0 0x7fa2040c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 -- 172.21.15.87:0/2992252083 >> 172.21.15.87:0/2992252083 conn(0x7fa2040ac550 msgr2=0x7fa2040ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:55.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 -- 172.21.15.87:0/2992252083 shutdown_connections 2024-04-25T16:00:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.833+0000 7fa20b96f640 1 -- 172.21.15.87:0/2992252083 wait complete. 2024-04-25T16:00:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 Processor -- start 2024-04-25T16:00:55.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- start start 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2040c8bc0 0x7fa2041614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 0x7fa204159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415fea0 0x7fa204158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa204074870 con 0x7fa204157530 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2040aa230 con 0x7fa2040c8bc0 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2040749f0 con 0x7fa20415fea0 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 0x7fa204159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 0x7fa204159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54568/0 (socket says 172.21.15.87:54568) 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 -- 172.21.15.87:0/3619583260 learned_addr learned my addr 172.21.15.87:0/3619583260 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa209f0c640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415fea0 0x7fa204158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20970b640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2040c8bc0 0x7fa2041614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 -- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415fea0 msgr2=0x7fa204158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415fea0 0x7fa204158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 -- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2040c8bc0 msgr2=0x7fa2041614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2040c8bc0 0x7fa2041614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 -- 172.21.15.87:0/3619583260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20415e900 con 0x7fa204157530 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa208f0a640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 0x7fa204159f80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c820 tx=0x7fa20000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200015070 con 0x7fa204157530 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa200007a30 con 0x7fa204157530 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20415c4d0 con 0x7fa204157530 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200007e20 con 0x7fa204157530 2024-04-25T16:00:55.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20415cd10 con 0x7fa204157530 2024-04-25T16:00:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.837+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20415ead0 con 0x7fa204157530 2024-04-25T16:00:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.841+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa200018070 con 0x7fa204157530 2024-04-25T16:00:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.841+0000 7fa1f9ffb640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1e806f400 0x7fa1e8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.841+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fa20008f890 con 0x7fa204157530 2024-04-25T16:00:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.841+0000 7fa20970b640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1e806f400 0x7fa1e8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:55.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.841+0000 7fa20970b640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1e806f400 0x7fa1e8071910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4000f70 tx=0x7fa1f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:55.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:55.845+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa20415ead0 con 0x7fa204157530 2024-04-25T16:00:56.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.009+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa204074ff0 con 0x7fa204157530 2024-04-25T16:00:56.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.009+0000 7fa1f9ffb640 1 -- 172.21.15.87:0/3619583260 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fa204074ff0 con 0x7fa204157530 2024-04-25T16:00:56.010 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1e806f400 msgr2=0x7fa1e8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1e806f400 0x7fa1e8071910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4000f70 tx=0x7fa1f4009040 comp rx=0 tx=0).stop 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 msgr2=0x7fa204159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 0x7fa204159f80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c820 tx=0x7fa20000cce0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 shutdown_connections 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa1e806f400 0x7fa1e8071910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa20415fea0 0x7fa204158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa204157530 0x7fa204159f80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 --2- 172.21.15.87:0/3619583260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2040c8bc0 0x7fa2041614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 >> 172.21.15.87:0/3619583260 conn(0x7fa2040ac550 msgr2=0x7fa204156400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 shutdown_connections 2024-04-25T16:00:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.013+0000 7fa20b96f640 1 -- 172.21.15.87:0/3619583260 wait complete. 2024-04-25T16:00:56.032 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T16:00:56.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a332d4640 1 Processor -- start 2024-04-25T16:00:56.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a332d4640 1 -- start start 2024-04-25T16:00:56.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a332d4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a2c0c48f0 0x7f5a2c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a332d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c072430 con 0x7f5a2c071e50 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a332d4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2c074730 con 0x7f5a2c1529a0 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a332d4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a2c074a10 con 0x7f5a2c0c48f0 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a3086f640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5a2c071e50 0x7f5a2c0c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57296/0 (socket says 172.21.15.87:57296) 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a3086f640 1 -- 172.21.15.87:0/3925947736 learned_addr learned my addr 172.21.15.87:0/3925947736 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a31871640 1 --2- 172.21.15.87:0/3925947736 >> v2:172.21.15.155:3300/0 conn(0x7f5a2c0c48f0 0x7f5a2c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884080948 0 0) 0x7f5a2c072430 con 0x7f5a2c071e50 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a14003530 con 0x7f5a2c071e50 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 870904637 0 0) 0x7f5a14003530 con 0x7f5a2c071e50 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 >> v2:172.21.15.155:3300/0 conn(0x7f5a2c0c48f0 msgr2=0x7f5a2c160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 --2- 172.21.15.87:0/3925947736 >> v2:172.21.15.155:3300/0 conn(0x7f5a2c0c48f0 0x7f5a2c160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 >> v1:172.21.15.155:6789/0 conn(0x7f5a2c1529a0 legacy=0x7f5a2c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2c074cf0 con 0x7f5a2c071e50 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f5a20001680 con 0x7f5a2c071e50 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 >> v1:172.21.15.87:6789/0 conn(0x7f5a2c071e50 legacy=0x7f5a2c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a140039c0 0x7f5a14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a14004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a14005260 0x7f5a1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2c074a10 con 0x7f5a14004810 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1400c1f0 con 0x7f5a140039c0 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.173+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1400c3f0 con 0x7f5a14005260 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a14004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a31070640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a140039c0 0x7f5a14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a31871640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a14005260 0x7f5a1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 -- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a14005260 msgr2=0x7f5a1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a14005260 0x7f5a1400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 -- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a140039c0 msgr2=0x7f5a14003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a140039c0 0x7f5a14003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a31871640 1 -- 172.21.15.87:0/3925947736 reap_dead start 2024-04-25T16:00:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 -- 172.21.15.87:0/3925947736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a14003530 con 0x7f5a14004810 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a3086f640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a14004c20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c06daf0 tx=0x7f5a2001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e25c753cbf349e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20007d00 con 0x7f5a14004810 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a200a9020 con 0x7f5a14004810 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a2bfff640 1 -- 172.21.15.87:0/3925947736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a200058e0 con 0x7f5a14004810 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 -- 172.21.15.87:0/3925947736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 msgr2=0x7f5a14004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a14004c20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c06daf0 tx=0x7f5a2001cb80 comp rx=0 tx=0).stop 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 -- 172.21.15.87:0/3925947736 shutdown_connections 2024-04-25T16:00:56.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 --2- 172.21.15.87:0/3925947736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a14004c20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 -- 172.21.15.87:0/3925947736 >> 172.21.15.87:0/3925947736 conn(0x7f5a2c0c8770 msgr2=0x7f5a2c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:56.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 -- 172.21.15.87:0/3925947736 shutdown_connections 2024-04-25T16:00:56.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.177+0000 7f5a332d4640 1 -- 172.21.15.87:0/3925947736 wait complete. 2024-04-25T16:00:56.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 Processor -- start 2024-04-25T16:00:56.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 -- start start 2024-04-25T16:00:56.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a2c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a2c1efd80 0x7f5a2c1f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2c1f0190 0x7f5a2c1f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2c0c4d00 con 0x7f5a14004810 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2c1587a0 con 0x7f5a2c1efd80 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2c1e46b0 con 0x7f5a2c1f0190 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a2c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a2c0bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54580/0 (socket says 172.21.15.87:54580) 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 -- 172.21.15.87:0/4158169736 learned_addr learned my addr 172.21.15.87:0/4158169736 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a3086f640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a2c1efd80 0x7f5a2c1f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31871640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2c1f0190 0x7f5a2c1f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 -- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2c1f0190 msgr2=0x7f5a2c1f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2c1f0190 0x7f5a2c1f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 -- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a2c1efd80 msgr2=0x7f5a2c1f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a2c1efd80 0x7f5a2c1f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 -- 172.21.15.87:0/4158169736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2c14b4e0 con 0x7f5a14004810 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a3086f640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a2c1efd80 0x7f5a2c1f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a31070640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a2c0bd770 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c000f90 tx=0x7f5a1c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c003b90 con 0x7f5a14004810 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c018070 con 0x7f5a14004810 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a2c14b7c0 con 0x7f5a14004810 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0050d0 con 0x7f5a14004810 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.181+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a2c14bd80 con 0x7f5a14004810 2024-04-25T16:00:56.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.185+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2c069bb0 con 0x7f5a14004810 2024-04-25T16:00:56.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.185+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5a1c005270 con 0x7f5a14004810 2024-04-25T16:00:56.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.185+0000 7f5a29ffb640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a1806f400 0x7f5a18071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.185+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f5a1c08f8a0 con 0x7f5a14004810 2024-04-25T16:00:56.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.185+0000 7f5a3086f640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a1806f400 0x7f5a18071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.185+0000 7f5a3086f640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a1806f400 0x7f5a18071910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5a200aa000 tx=0x7f5a2c072600 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.189+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a1c05c170 con 0x7f5a14004810 2024-04-25T16:00:56.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.337+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f5a2c150360 con 0x7f5a14004810 2024-04-25T16:00:56.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.337+0000 7f5a29ffb640 1 -- 172.21.15.87:0/4158169736 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7f5a1c05ba70 con 0x7f5a14004810 2024-04-25T16:00:56.339 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a1806f400 msgr2=0x7f5a18071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a1806f400 0x7f5a18071910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5a200aa000 tx=0x7f5a2c072600 comp rx=0 tx=0).stop 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 msgr2=0x7f5a2c0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a2c0bd770 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c000f90 tx=0x7f5a1c00ec80 comp rx=0 tx=0).stop 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 shutdown_connections 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5a1806f400 0x7f5a18071910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2c1f0190 0x7f5a2c1f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a2c1efd80 0x7f5a2c1f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 --2- 172.21.15.87:0/4158169736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a14004810 0x7f5a2c0bd770 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 >> 172.21.15.87:0/4158169736 conn(0x7f5a2c0c8770 msgr2=0x7f5a2c148b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:56.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 shutdown_connections 2024-04-25T16:00:56.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.341+0000 7f5a332d4640 1 -- 172.21.15.87:0/4158169736 wait complete. 2024-04-25T16:00:56.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T16:00:56.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.509+0000 7f89a0d4e640 1 Processor -- start 2024-04-25T16:00:56.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.509+0000 7f89a0d4e640 1 -- start start 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f89a0d4e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f899c15ac30 0x7f899c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f89a0d4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f89a0d4e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f899c0c5120 con 0x7f899c0c4250 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f89a0d4e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f899c0c3b20 con 0x7f899c15ac30 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f89a0d4e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f899c070e20 con 0x7f899c15b580 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f899c15ac30 0x7f899c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f899c15ac30 0x7f899c15b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54584/0 (socket says 172.21.15.87:54584) 2024-04-25T16:00:56.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 -- 172.21.15.87:0/2335162536 learned_addr learned my addr 172.21.15.87:0/2335162536 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:56.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f899ad9d640 1 --2- 172.21.15.87:0/2335162536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 -- 172.21.15.87:0/2335162536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 msgr2=0x7f899c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 --2- 172.21.15.87:0/2335162536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 -- 172.21.15.87:0/2335162536 >> v1:172.21.15.87:6789/0 conn(0x7f899c0c4250 legacy=0x7f899c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 -- 172.21.15.87:0/2335162536 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c0c4b60 con 0x7f899c15ac30 2024-04-25T16:00:56.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f8999d9b640 1 --2- 172.21.15.87:0/2335162536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c15b040 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f898c009870 tx=0x7f898c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7430df6e18779f39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f899959a640 1 -- 172.21.15.87:0/2335162536 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b0070 con 0x7f899c15ac30 2024-04-25T16:00:56.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f899959a640 1 -- 172.21.15.87:0/2335162536 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0ab600 con 0x7f899c15ac30 2024-04-25T16:00:56.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.513+0000 7f899959a640 1 -- 172.21.15.87:0/2335162536 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0ab9d0 con 0x7f899c15ac30 2024-04-25T16:00:56.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- 172.21.15.87:0/2335162536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 msgr2=0x7f899c15b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/2335162536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c15b040 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f898c009870 tx=0x7f898c01c360 comp rx=0 tx=0).stop 2024-04-25T16:00:56.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- 172.21.15.87:0/2335162536 shutdown_connections 2024-04-25T16:00:56.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/2335162536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c15b040 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/2335162536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- 172.21.15.87:0/2335162536 >> 172.21.15.87:0/2335162536 conn(0x7f899c06d780 msgr2=0x7f899c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:56.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- 172.21.15.87:0/2335162536 shutdown_connections 2024-04-25T16:00:56.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- 172.21.15.87:0/2335162536 wait complete. 2024-04-25T16:00:56.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 Processor -- start 2024-04-25T16:00:56.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- start start 2024-04-25T16:00:56.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c0c4250 0x7f899c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0c47e0 con 0x7f899c15ac30 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0c4660 con 0x7f899c0c4250 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f89a0d4e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f899c155100 con 0x7f899c15b580 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f8999d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f8999d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54596/0 (socket says 172.21.15.87:54596) 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.517+0000 7f8999d9b640 1 -- 172.21.15.87:0/4048957549 learned_addr learned my addr 172.21.15.87:0/4048957549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f899ad9d640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f899a59c640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c0c4250 0x7f899c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f8999d9b640 1 -- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 msgr2=0x7f899c150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f8999d9b640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f8999d9b640 1 -- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c0c4250 msgr2=0x7f899c153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f8999d9b640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c0c4250 0x7f899c153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f8999d9b640 1 -- 172.21.15.87:0/4048957549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c14d4c0 con 0x7f899c15ac30 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f8999d9b640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c14cf80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ae040 tx=0x7f898c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b0040 con 0x7f899c15ac30 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c0ab400 con 0x7f899c15ac30 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0b4660 con 0x7f899c15ac30 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c1537d0 con 0x7f899c15ac30 2024-04-25T16:00:56.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c153d90 con 0x7f899c15ac30 2024-04-25T16:00:56.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c069bb0 con 0x7f899c15ac30 2024-04-25T16:00:56.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f898c0bb020 con 0x7f899c15ac30 2024-04-25T16:00:56.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f898affd640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f897c06f430 0x7f897c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f899a59c640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f897c06f430 0x7f897c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f898c128da0 con 0x7f899c15ac30 2024-04-25T16:00:56.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.521+0000 7f899a59c640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f897c06f430 0x7f897c071940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f899c0721c0 tx=0x7f8990009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.525+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f898c0c2020 con 0x7f899c15ac30 2024-04-25T16:00:56.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.677+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f899c0c3540 con 0x7f899c15ac30 2024-04-25T16:00:56.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.677+0000 7f898affd640 1 -- 172.21.15.87:0/4048957549 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7f898c0a4e20 con 0x7f899c15ac30 2024-04-25T16:00:56.679 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:00:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f897c06f430 msgr2=0x7f897c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f897c06f430 0x7f897c071940 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f899c0721c0 tx=0x7f8990009040 comp rx=0 tx=0).stop 2024-04-25T16:00:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 msgr2=0x7f899c14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c14cf80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ae040 tx=0x7f898c019100 comp rx=0 tx=0).stop 2024-04-25T16:00:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 shutdown_connections 2024-04-25T16:00:56.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f897c06f430 0x7f897c071940 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899c15b580 0x7f899c150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f899c15ac30 0x7f899c14cf80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 --2- 172.21.15.87:0/4048957549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c0c4250 0x7f899c153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 >> 172.21.15.87:0/4048957549 conn(0x7f899c06d780 msgr2=0x7f899c073990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:56.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 shutdown_connections 2024-04-25T16:00:56.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.681+0000 7f89a0d4e640 1 -- 172.21.15.87:0/4048957549 wait complete. 2024-04-25T16:00:56.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T16:00:56.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd10b738640 1 Processor -- start 2024-04-25T16:00:56.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd10b738640 1 -- start start 2024-04-25T16:00:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd10b738640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 0x7fd104151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd10b738640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10406dbd0 con 0x7fd10406f8a0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd10b738640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd104154870 con 0x7fd1040aeca0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd10b738640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd104151c40 con 0x7fd104074930 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd109cd5640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd10406f8a0 0x7fd10415eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57324/0 (socket says 172.21.15.87:57324) 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd109cd5640 1 -- 172.21.15.87:0/254353470 learned_addr learned my addr 172.21.15.87:0/254353470 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677920502 0 0) 0x7fd1000014a0 con 0x7fd10406f8a0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd108cd3640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 0x7fd104151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.853+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0f0003530 con 0x7fd10406f8a0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3659289418 0 0) 0x7fd0f0003530 con 0x7fd10406f8a0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 msgr2=0x7fd104151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 0x7fd104151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 >> v1:172.21.15.155:6789/0 conn(0x7fd1040aeca0 legacy=0x7fd104154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd104074d40 con 0x7fd10406f8a0 2024-04-25T16:00:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fd100001bf0 con 0x7fd10406f8a0 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 >> v1:172.21.15.87:6789/0 conn(0x7fd10406f8a0 legacy=0x7fd10415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 0x7fd0f00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd0f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f0004d50 0x7fd0f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd104151c40 con 0x7fd0f0003f70 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f000dea0 con 0x7fd0f0004d50 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f000e0a0 con 0x7fd104074930 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd0f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd109cd5640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f0004d50 0x7fd0f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd1094d4640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 0x7fd0f00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 -- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 msgr2=0x7fd0f00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd104074930 0x7fd0f00039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 -- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f0004d50 msgr2=0x7fd0f0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:56.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f0004d50 0x7fd0f0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 -- 172.21.15.87:0/254353470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f0003530 con 0x7fd0f0003f70 2024-04-25T16:00:56.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd109cd5640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0f0004d50 0x7fd0f0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd108cd3640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd0f0004810 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009ab0 tx=0x7fd0f401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e2560d65778991 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40096b0 con 0x7fd0f0003f70 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f40a9450 con 0x7fd0f0003f70 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.857+0000 7fd0fbfff640 1 -- 172.21.15.87:0/254353470 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40a9840 con 0x7fd0f0003f70 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- 172.21.15.87:0/254353470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 msgr2=0x7fd0f0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 --2- 172.21.15.87:0/254353470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd0f0004810 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009ab0 tx=0x7fd0f401ca70 comp rx=0 tx=0).stop 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd109cd5640 1 -- 172.21.15.87:0/254353470 reap_dead start 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- 172.21.15.87:0/254353470 shutdown_connections 2024-04-25T16:00:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- 172.21.15.87:0/254353470 >> 172.21.15.87:0/254353470 conn(0x7fd10406d650 msgr2=0x7fd1040c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- 172.21.15.87:0/254353470 shutdown_connections 2024-04-25T16:00:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- 172.21.15.87:0/254353470 wait complete. 2024-04-25T16:00:56.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 Processor -- start 2024-04-25T16:00:56.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- start start 2024-04-25T16:00:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd104153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1041540e0 0x7fd1041e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1041e1f00 0x7fd104157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040700c0 con 0x7fd0f0003f70 2024-04-25T16:00:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd104063710 con 0x7fd1041e1f00 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd10b738640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd10406efa0 con 0x7fd1041540e0 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd104153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd104153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54618/0 (socket says 172.21.15.87:54618) 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 -- 172.21.15.87:0/1922361645 learned_addr learned my addr 172.21.15.87:0/1922361645 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd108cd3640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1041540e0 0x7fd1041e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd109cd5640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1041e1f00 0x7fd104157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 -- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1041540e0 msgr2=0x7fd1041e19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1041540e0 0x7fd1041e19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 -- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1041e1f00 msgr2=0x7fd104157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1041e1f00 0x7fd104157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.861+0000 7fd1094d4640 1 -- 172.21.15.87:0/1922361645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1041e3f30 con 0x7fd0f0003f70 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd1094d4640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd104153ba0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00d7a0 tx=0x7fd0fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc005270 con 0x7fd0f0003f70 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc017070 con 0x7fd0f0003f70 2024-04-25T16:00:56.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10414d900 con 0x7fd0f0003f70 2024-04-25T16:00:56.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00b6b0 con 0x7fd0f0003f70 2024-04-25T16:00:56.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1041530f0 con 0x7fd0f0003f70 2024-04-25T16:00:56.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd104069bb0 con 0x7fd0f0003f70 2024-04-25T16:00:56.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd0fc00b850 con 0x7fd0f0003f70 2024-04-25T16:00:56.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd0f9ffb640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd0e806f400 0x7fd0e8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:56.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fd0fc08f7f0 con 0x7fd0f0003f70 2024-04-25T16:00:56.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd108cd3640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd0e806f400 0x7fd0e8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:56.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.865+0000 7fd108cd3640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd0e806f400 0x7fd0e8071910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40ae000 tx=0x7fd0f40046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:56.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:56.869+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0fc05c030 con 0x7fd0f0003f70 2024-04-25T16:00:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.029+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fd104159c00 con 0x7fd0f0003f70 2024-04-25T16:00:57.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.033+0000 7fd0f9ffb640 1 -- 172.21.15.87:0/1922361645 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7fd0fc05b930 con 0x7fd0f0003f70 2024-04-25T16:00:57.032 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:00:57.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd0e806f400 msgr2=0x7fd0e8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd0e806f400 0x7fd0e8071910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40ae000 tx=0x7fd0f40046d0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 msgr2=0x7fd104153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd104153ba0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00d7a0 tx=0x7fd0fc00dc60 comp rx=0 tx=0).stop 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 shutdown_connections 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd0e806f400 0x7fd0e8071910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1041e1f00 0x7fd104157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1041540e0 0x7fd1041e19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 --2- 172.21.15.87:0/1922361645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0f0003f70 0x7fd104153ba0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 >> 172.21.15.87:0/1922361645 conn(0x7fd10406d650 msgr2=0x7fd10414a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 shutdown_connections 2024-04-25T16:00:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.037+0000 7fd10b738640 1 -- 172.21.15.87:0/1922361645 wait complete. 2024-04-25T16:00:57.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T16:00:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb8904f8640 1 Processor -- start 2024-04-25T16:00:57.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb8904f8640 1 -- start start 2024-04-25T16:00:57.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb8904f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb888157fc0 0x7fb88815faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb8904f8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8880737e0 con 0x7fb8880733d0 2024-04-25T16:00:57.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb8904f8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8880c5f40 con 0x7fb888072fc0 2024-04-25T16:00:57.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb8904f8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb8880c5cf0 con 0x7fb888157fc0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb88da93640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb8880733d0 0x7fb8881578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57328/0 (socket says 172.21.15.87:57328) 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb88da93640 1 -- 172.21.15.87:0/1836884203 learned_addr learned my addr 172.21.15.87:0/1836884203 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb88ea95640 1 --2- 172.21.15.87:0/1836884203 >> v2:172.21.15.155:3300/0 conn(0x7fb888157fc0 0x7fb88815faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392697291 0 0) 0x7fb8880737e0 con 0x7fb8880733d0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.205+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb874003530 con 0x7fb8880733d0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2925702063 0 0) 0x7fb874003530 con 0x7fb8880733d0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 >> v2:172.21.15.155:3300/0 conn(0x7fb888157fc0 msgr2=0x7fb88815faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 --2- 172.21.15.87:0/1836884203 >> v2:172.21.15.155:3300/0 conn(0x7fb888157fc0 0x7fb88815faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 >> v1:172.21.15.155:6789/0 conn(0x7fb888072fc0 legacy=0x7fb888073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8880c6220 con 0x7fb8880733d0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb878001680 con 0x7fb8880733d0 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 >> v1:172.21.15.87:6789/0 conn(0x7fb8880733d0 legacy=0x7fb8881578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb874003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb874004810 0x7fb874004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb874005260 0x7fb87400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb8880c5cf0 con 0x7fb8740039c0 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb87400c1f0 con 0x7fb874005260 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb87400e600 con 0x7fb874004810 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb874003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 -- 172.21.15.87:0/1836884203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb874004810 msgr2=0x7fb874004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb874004810 0x7fb874004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 -- 172.21.15.87:0/1836884203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb874005260 msgr2=0x7fb87400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb874005260 0x7fb87400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 -- 172.21.15.87:0/1836884203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb874003530 con 0x7fb8740039c0 2024-04-25T16:00:57.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88ea95640 1 -- 172.21.15.87:0/1836884203 reap_dead start 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88e294640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb874003e30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb884001750 tx=0x7fb88401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dae7f529fc773f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840013a0 con 0x7fb8740039c0 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8840052f0 con 0x7fb8740039c0 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb88d292640 1 -- 172.21.15.87:0/1836884203 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884003840 con 0x7fb8740039c0 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb8904f8640 1 -- 172.21.15.87:0/1836884203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 msgr2=0x7fb874003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.209+0000 7fb8904f8640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb874003e30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb884001750 tx=0x7fb88401c3c0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- 172.21.15.87:0/1836884203 shutdown_connections 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 --2- 172.21.15.87:0/1836884203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb874003e30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- 172.21.15.87:0/1836884203 >> 172.21.15.87:0/1836884203 conn(0x7fb888070000 msgr2=0x7fb888070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- 172.21.15.87:0/1836884203 shutdown_connections 2024-04-25T16:00:57.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- 172.21.15.87:0/1836884203 wait complete. 2024-04-25T16:00:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 Processor -- start 2024-04-25T16:00:57.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- start start 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb8881ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8880c22e0 0x7fb8880c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8880c26f0 0x7fb8881df220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb888158550 con 0x7fb8740039c0 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8881583d0 con 0x7fb8880c22e0 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb8904f8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb888151cb0 con 0x7fb8880c26f0 2024-04-25T16:00:57.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb8881ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb8881ed580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54636/0 (socket says 172.21.15.87:54636) 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 -- 172.21.15.87:0/568557484 learned_addr learned my addr 172.21.15.87:0/568557484 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88da93640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8880c22e0 0x7fb8880c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88ea95640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8880c26f0 0x7fb8881df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 -- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8880c26f0 msgr2=0x7fb8881df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8880c26f0 0x7fb8881df220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 -- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8880c22e0 msgr2=0x7fb8880c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8880c22e0 0x7fb8880c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 -- 172.21.15.87:0/568557484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8881edac0 con 0x7fb8740039c0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb88e294640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb8881ed580 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb884005040 tx=0x7fb874005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.213+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884007a40 con 0x7fb8740039c0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8840ba070 con 0x7fb8740039c0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8880c3090 con 0x7fb8740039c0 2024-04-25T16:00:57.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840054a0 con 0x7fb8740039c0 2024-04-25T16:00:57.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8880c3650 con 0x7fb8740039c0 2024-04-25T16:00:57.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb888069bb0 con 0x7fb8740039c0 2024-04-25T16:00:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb884007030 con 0x7fb8740039c0 2024-04-25T16:00:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb87effd640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb86c06f430 0x7fb86c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb88da93640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb86c06f430 0x7fb86c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fb884129900 con 0x7fb8740039c0 2024-04-25T16:00:57.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.217+0000 7fb88da93640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb86c06f430 0x7fb86c071940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb878001870 tx=0x7fb878001680 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:57.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.221+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8840160d0 con 0x7fb8740039c0 2024-04-25T16:00:57.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.373+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fb8880abb50 con 0x7fb8740039c0 2024-04-25T16:00:57.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.373+0000 7fb87effd640 1 -- 172.21.15.87:0/568557484 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7fb8840f6140 con 0x7fb8740039c0 2024-04-25T16:00:57.374 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:00:57.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb86c06f430 msgr2=0x7fb86c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb86c06f430 0x7fb86c071940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb878001870 tx=0x7fb878001680 comp rx=0 tx=0).stop 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 msgr2=0x7fb8881ed580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb8881ed580 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb884005040 tx=0x7fb874005840 comp rx=0 tx=0).stop 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 shutdown_connections 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb86c06f430 0x7fb86c071940 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8880c26f0 0x7fb8881df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8880c22e0 0x7fb8880c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 --2- 172.21.15.87:0/568557484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8740039c0 0x7fb8881ed580 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 >> 172.21.15.87:0/568557484 conn(0x7fb888070000 msgr2=0x7fb8880acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 shutdown_connections 2024-04-25T16:00:57.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.377+0000 7fb8904f8640 1 -- 172.21.15.87:0/568557484 wait complete. 2024-04-25T16:00:57.394 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T16:00:57.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 Processor -- start 2024-04-25T16:00:57.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 -- start start 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f100c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f100c155320 0x7f100c155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c152d90 con 0x7f100c074160 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f100c0aa290 con 0x7f100c155320 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1010901640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f100c1598b0 con 0x7f100c152980 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f100ad9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f100c074160 0x7f100c0c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:57338/0 (socket says 172.21.15.87:57338) 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f100ad9d640 1 -- 172.21.15.87:0/2721177357 learned_addr learned my addr 172.21.15.87:0/2721177357 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f1009d9b640 1 --2- 172.21.15.87:0/2721177357 >> v2:172.21.15.155:3300/0 conn(0x7f100c155320 0x7f100c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f100a59c640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f100c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433336279 0 0) 0x7f100c152d90 con 0x7f100c074160 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.545+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff4003530 con 0x7f100c074160 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2309204110 0 0) 0x7f0ff4003530 con 0x7f100c074160 2024-04-25T16:00:57.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 msgr2=0x7f100c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f100c0c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 >> v2:172.21.15.155:3300/0 conn(0x7f100c155320 msgr2=0x7f100c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 --2- 172.21.15.87:0/2721177357 >> v2:172.21.15.155:3300/0 conn(0x7f100c155320 0x7f100c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c0ca2f0 con 0x7f100c074160 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f0ffc001680 con 0x7f100c074160 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 >> v1:172.21.15.87:6789/0 conn(0x7f100c074160 legacy=0x7f100c0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f0ff4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff4004d50 0x7f0ff4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0aa290 con 0x7f0ff4004d50 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1598b0 con 0x7f0ff40039c0 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff400ba50 con 0x7f100c152980 2024-04-25T16:00:57.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff4004d50 0x7f0ff4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100a59c640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1009d9b640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f0ff4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 -- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 msgr2=0x7f0ff4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f0ff4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 -- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff40039c0 msgr2=0x7f0ff4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 -- 172.21.15.87:0/2721177357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff4003530 con 0x7f0ff4004d50 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100a59c640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ff40039c0 0x7f0ff4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:57.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1009d9b640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c152980 0x7f0ff4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:57.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff4004d50 0x7f0ff4005160 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c240 tx=0x7f0ffc01f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf907eb1f09d1ada server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:57.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc007d60 con 0x7f0ff4004d50 2024-04-25T16:00:57.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ffc005b00 con 0x7f0ff4004d50 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100959a640 1 -- 172.21.15.87:0/2721177357 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc007070 con 0x7f0ff4004d50 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1010901640 1 -- 172.21.15.87:0/2721177357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff4004d50 msgr2=0x7f0ff4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1010901640 1 --2- 172.21.15.87:0/2721177357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ff4004d50 0x7f0ff4005160 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c240 tx=0x7f0ffc01f430 comp rx=0 tx=0).stop 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f100ad9d640 1 -- 172.21.15.87:0/2721177357 reap_dead start 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1010901640 1 -- 172.21.15.87:0/2721177357 shutdown_connections 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1010901640 1 -- 172.21.15.87:0/2721177357 >> 172.21.15.87:0/2721177357 conn(0x7f100c0ac550 msgr2=0x7f100c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1010901640 1 -- 172.21.15.87:0/2721177357 shutdown_connections 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.549+0000 7f1010901640 1 -- 172.21.15.87:0/2721177357 wait complete. 2024-04-25T16:00:57.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 Processor -- start 2024-04-25T16:00:57.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 -- start start 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 0x7f100c0a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f100c0abc20 0x7f100c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c1ed970 0x7f100c1edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f100c1589b0 con 0x7f100c0ab810 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0a9fb0 con 0x7f100c0abc20 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f100c158c90 con 0x7f100c1ed970 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 0x7f100c0a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 0x7f100c0a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54656/0 (socket says 172.21.15.87:54656) 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 -- 172.21.15.87:0/2211394351 learned_addr learned my addr 172.21.15.87:0/2211394351 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1009d9b640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f100c0abc20 0x7f100c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100ad9d640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c1ed970 0x7f100c1edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 -- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c1ed970 msgr2=0x7f100c1edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c1ed970 0x7f100c1edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 -- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f100c0abc20 msgr2=0x7f100c0a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f100c0abc20 0x7f100c0a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 -- 172.21.15.87:0/2211394351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c157a70 con 0x7f100c0ab810 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100ad9d640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c1ed970 0x7f100c1edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f100a59c640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 0x7f100c0a8e80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f10000108d0 tx=0x7f1000010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100000f040 con 0x7f100c0ab810 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1000004220 con 0x7f100c0ab810 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c157d50 con 0x7f100c0ab810 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.553+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100000e960 con 0x7f100c0ab810 2024-04-25T16:00:57.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c06f4c0 con 0x7f100c0ab810 2024-04-25T16:00:57.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100c069bb0 con 0x7f100c0ab810 2024-04-25T16:00:57.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f100000eb00 con 0x7f100c0ab810 2024-04-25T16:00:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f0ffaffd640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0fec06f400 0x7f0fec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:00:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f100008fda0 con 0x7f100c0ab810 2024-04-25T16:00:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f1009d9b640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0fec06f400 0x7f0fec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:00:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.557+0000 7f1009d9b640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0fec06f400 0x7f0fec071910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f100c0c8710 tx=0x7f100400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:00:57.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.561+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1000018030 con 0x7f100c0ab810 2024-04-25T16:00:57.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.737+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f100c072120 con 0x7f100c0ab810 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.737+0000 7f0ffaffd640 1 -- 172.21.15.87:0/2211394351 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 20 entries v36) ==== 81+0+1226 (secure 0 0 0) 0x7f100005c670 con 0x7f100c0ab810 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:00:57.738 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:00:57.739 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:00:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:listed 20 entries 2024-04-25T16:00:57.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0fec06f400 msgr2=0x7f0fec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0fec06f400 0x7f0fec071910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f100c0c8710 tx=0x7f100400b040 comp rx=0 tx=0).stop 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 msgr2=0x7f100c0a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 0x7f100c0a8e80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f10000108d0 tx=0x7f1000010d90 comp rx=0 tx=0).stop 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 shutdown_connections 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f0fec06f400 0x7f0fec071910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f100c1ed970 0x7f100c1edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f100c0abc20 0x7f100c0a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 --2- 172.21.15.87:0/2211394351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c0ab810 0x7f100c0a8e80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 >> 172.21.15.87:0/2211394351 conn(0x7f100c0ac550 msgr2=0x7f100c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 shutdown_connections 2024-04-25T16:00:57.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:00:57.741+0000 7f1010901640 1 -- 172.21.15.87:0/2211394351 wait complete. 2024-04-25T16:00:57.760 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-04-25T16:00:57.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:00:57.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T16:00:57.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:00:57.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[36014]: fuse finished with error 0 and tester_r 0 2024-04-25T16:01:02.280 INFO:tasks.mds_thrash.fs.[a]:reviving mds.b 2024-04-25T16:01:02.280 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T16:01:02.280 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T16:01:02.283 INFO:tasks.ceph.mds.b:Started 2024-04-25T16:01:02.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:01:02.389 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-25T16:01:02.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 Processor -- start 2024-04-25T16:01:02.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 -- start start 2024-04-25T16:01:02.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4154158a00 0x7f41540ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f415415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4154063660 con 0x7f4154158e10 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f41540c5470 con 0x7f4154158a00 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f415b1b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41540ab670 con 0x7f41540adfb0 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4159756640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f415415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4158f55640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4154158a00 0x7f41540ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4159756640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f415415fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:46130/0 (socket says 172.21.15.87:46130) 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4159756640 1 -- 172.21.15.87:0/3940495294 learned_addr learned my addr 172.21.15.87:0/3940495294 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4158f55640 1 -- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 msgr2=0x7f415415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4158f55640 1 --2- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f415415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4158f55640 1 -- 172.21.15.87:0/3940495294 >> v1:172.21.15.155:6789/0 conn(0x7f4154158e10 legacy=0x7f4154152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f4158f55640 1 -- 172.21.15.87:0/3940495294 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41540ab930 con 0x7f4154158a00 2024-04-25T16:01:02.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.445+0000 7f41537fe640 1 -- 172.21.15.87:0/3940495294 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731796521 0 0) 0x7f4154063660 con 0x7f4154158e10 2024-04-25T16:01:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f4158f55640 1 --2- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158a00 0x7f41540ada70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41540c55f0 tx=0x7f414401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9057b8b31ce15c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f41537fe640 1 -- 172.21.15.87:0/3940495294 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440ab430 con 0x7f4154158a00 2024-04-25T16:01:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f41537fe640 1 -- 172.21.15.87:0/3940495294 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41440b0070 con 0x7f4154158a00 2024-04-25T16:01:02.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f41537fe640 1 -- 172.21.15.87:0/3940495294 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440ab7f0 con 0x7f4154158a00 2024-04-25T16:01:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 -- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158a00 msgr2=0x7f41540ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 --2- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158a00 0x7f41540ada70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41540c55f0 tx=0x7f414401c470 comp rx=0 tx=0).stop 2024-04-25T16:01:02.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 -- 172.21.15.87:0/3940495294 shutdown_connections 2024-04-25T16:01:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 --2- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f415415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 --2- 172.21.15.87:0/3940495294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158a00 0x7f41540ada70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 -- 172.21.15.87:0/3940495294 >> 172.21.15.87:0/3940495294 conn(0x7f415406d650 msgr2=0x7f41540c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 -- 172.21.15.87:0/3940495294 shutdown_connections 2024-04-25T16:01:02.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.449+0000 7f415b1b9640 1 -- 172.21.15.87:0/3940495294 wait complete. 2024-04-25T16:01:02.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 Processor -- start 2024-04-25T16:01:02.452 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 -- start start 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f41541f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 0x7f415414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158e10 0x7f4154151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41540af0f0 con 0x7f4154158a00 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41540aef70 con 0x7f4154158e10 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41540749b0 con 0x7f41540adfb0 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 0x7f415414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 0x7f415414dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45234/0 (socket says 172.21.15.87:45234) 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 -- 172.21.15.87:0/1974017741 learned_addr learned my addr 172.21.15.87:0/1974017741 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4159756640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158e10 0x7f4154151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4158f55640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f41541f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:02.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 -- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 msgr2=0x7f41541f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f41541f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 -- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158e10 msgr2=0x7f4154151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158e10 0x7f4154151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 -- 172.21.15.87:0/1974017741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4154155a50 con 0x7f4154158a00 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f4153fff640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 0x7f415414dc70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f414800c420 tx=0x7f414800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148017070 con 0x7f4154158a00 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41480052f0 con 0x7f4154158a00 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148003860 con 0x7f4154158a00 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4154151500 con 0x7f4154158a00 2024-04-25T16:01:02.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.453+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4154156010 con 0x7f4154158a00 2024-04-25T16:01:02.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.457+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4154069bb0 con 0x7f4154158a00 2024-04-25T16:01:02.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.457+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f414801a070 con 0x7f4154158a00 2024-04-25T16:01:02.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.457+0000 7f41517fa640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f414006f430 0x7f4140071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:02.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.457+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f414808ecd0 con 0x7f4154158a00 2024-04-25T16:01:02.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.457+0000 7f4158f55640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f414006f430 0x7f4140071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:02.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.457+0000 7f4158f55640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f414006f430 0x7f4140071940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f41440af000 tx=0x7f4144008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:02.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.461+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f414805ae20 con 0x7f4154158a00 2024-04-25T16:01:02.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.661+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41540704e0 con 0x7f4154158a00 2024-04-25T16:01:02.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.661+0000 7f41517fa640 1 -- 172.21.15.87:0/1974017741 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5667 (secure 0 0 0) 0x7f414805f120 con 0x7f4154158a00 2024-04-25T16:01:02.662 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:02.663 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:01:02.663 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 68 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f414006f430 msgr2=0x7f4140071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f414006f430 0x7f4140071940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f41440af000 tx=0x7f4144008040 comp rx=0 tx=0).stop 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 msgr2=0x7f415414dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 0x7f415414dc70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f414800c420 tx=0x7f414800c8e0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 shutdown_connections 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f414006f430 0x7f4140071940 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4154158e10 0x7f4154151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4154158a00 0x7f415414dc70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 --2- 172.21.15.87:0/1974017741 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41540adfb0 0x7f41541f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 >> 172.21.15.87:0/1974017741 conn(0x7f415406d650 msgr2=0x7f4154157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 shutdown_connections 2024-04-25T16:01:02.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:02.665+0000 7f415b1b9640 1 -- 172.21.15.87:0/1974017741 wait complete. 2024-04-25T16:01:02.686 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-25T16:01:04.047 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T16:01:04.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:04.048 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T16:01:04.067 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T16:01:04.067 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:01:04.074 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T16:01:04.075 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:01:04.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:01:04.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe05dbe9640 1 Processor -- start 2024-04-25T16:01:04.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe05dbe9640 1 -- start start 2024-04-25T16:01:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe05dbe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe05815b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe05dbe9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0580c5120 con 0x7fe05815b580 2024-04-25T16:01:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe05dbe9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0580c4b60 con 0x7fe0580c4250 2024-04-25T16:01:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe05dbe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe0580c3b20 con 0x7fe05815ac30 2024-04-25T16:01:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe057fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe05815b580 0x7fe058161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47948/0 (socket says 172.21.15.87:47948) 2024-04-25T16:01:04.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe057fff640 1 -- 172.21.15.87:0/3262801427 learned_addr learned my addr 172.21.15.87:0/3262801427 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:04.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe056ffd640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe05815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126007644 0 0) 0x7fe0500014a0 con 0x7fe05815b580 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe040003530 con 0x7fe05815b580 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4205012212 0 0) 0x7fe040003530 con 0x7fe05815b580 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 msgr2=0x7fe05815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe05815b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 >> v1:172.21.15.155:6789/0 conn(0x7fe0580c4250 legacy=0x7fe05806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0580c4e40 con 0x7fe05815b580 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fe050001bd0 con 0x7fe05815b580 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 >> v1:172.21.15.87:6789/0 conn(0x7fe05815b580 legacy=0x7fe058161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0400039f0 0x7fe040003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe040004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe040004d50 0x7fe040005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe04000bb60 con 0x7fe0400039f0 2024-04-25T16:01:04.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe04000bd10 con 0x7fe040004d50 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe04000bf10 con 0x7fe05815ac30 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe0577fe640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0400039f0 0x7fe040003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.285+0000 7fe056ffd640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe040004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe057fff640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe040004d50 0x7fe040005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0577fe640 1 -- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 msgr2=0x7fe040004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0577fe640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe040004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0577fe640 1 -- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe040004d50 msgr2=0x7fe040005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0577fe640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe040004d50 0x7fe040005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0577fe640 1 -- 172.21.15.87:0/3262801427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040003530 con 0x7fe0400039f0 2024-04-25T16:01:04.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe056ffd640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05815ac30 0x7fe040004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:04.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0577fe640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0400039f0 0x7fe040003e60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe048001750 tx=0x7fe04801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b17bc79fa5153e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0480013a0 con 0x7fe0400039f0 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0480052f0 con 0x7fe0400039f0 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe0567fc640 1 -- 172.21.15.87:0/3262801427 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048003840 con 0x7fe0400039f0 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe05dbe9640 1 -- 172.21.15.87:0/3262801427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0400039f0 msgr2=0x7fe040003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/3262801427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0400039f0 0x7fe040003e60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe048001750 tx=0x7fe04801c3e0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe057fff640 1 -- 172.21.15.87:0/3262801427 reap_dead start 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe05dbe9640 1 -- 172.21.15.87:0/3262801427 shutdown_connections 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe05dbe9640 1 -- 172.21.15.87:0/3262801427 >> 172.21.15.87:0/3262801427 conn(0x7fe05806d780 msgr2=0x7fe05806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe05dbe9640 1 -- 172.21.15.87:0/3262801427 shutdown_connections 2024-04-25T16:01:04.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.289+0000 7fe05dbe9640 1 -- 172.21.15.87:0/3262801427 wait complete. 2024-04-25T16:01:04.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 Processor -- start 2024-04-25T16:01:04.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 -- start start 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0400039f0 0x7fe0581f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 0x7fe0580ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05814ec10 0x7fe05814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe058155100 con 0x7fe05814e6c0 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe058070e20 con 0x7fe0400039f0 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe058155280 con 0x7fe05814ec10 2024-04-25T16:01:04.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 0x7fe0580ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 0x7fe0580ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45250/0 (socket says 172.21.15.87:45250) 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 -- 172.21.15.87:0/2566437620 learned_addr learned my addr 172.21.15.87:0/2566437620 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe057fff640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05814ec10 0x7fe05814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe0577fe640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0400039f0 0x7fe0581f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 -- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05814ec10 msgr2=0x7fe05814dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05814ec10 0x7fe05814dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 -- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0400039f0 msgr2=0x7fe0581f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0400039f0 0x7fe0581f0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 -- 172.21.15.87:0/2566437620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05814f200 con 0x7fe05814e6c0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe056ffd640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 0x7fe0580ade60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0108d0 tx=0x7fe04c010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00f040 con 0x7fe05814e6c0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c004220 con 0x7fe05814e6c0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0581f4c40 con 0x7fe05814e6c0 2024-04-25T16:01:04.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00e960 con 0x7fe05814e6c0 2024-04-25T16:01:04.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.293+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0580c78d0 con 0x7fe05814e6c0 2024-04-25T16:01:04.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.297+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe058069bb0 con 0x7fe05814e6c0 2024-04-25T16:01:04.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.297+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe04c00eb00 con 0x7fe05814e6c0 2024-04-25T16:01:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.297+0000 7fe03ffff640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe04406f430 0x7fe044071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.297+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fe04c0901a0 con 0x7fe05814e6c0 2024-04-25T16:01:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.297+0000 7fe0577fe640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe04406f430 0x7fe044071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.297+0000 7fe0577fe640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe04406f430 0x7fe044071940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe0580721c0 tx=0x7fe0480011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.301+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe04c018030 con 0x7fe05814e6c0 2024-04-25T16:01:04.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.465+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0580c3540 con 0x7fe05814e6c0 2024-04-25T16:01:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe03ffff640 1 -- 172.21.15.87:0/2566437620 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21989 (secure 0 0 0) 0x7fe04c05cb50 con 0x7fe05814e6c0 2024-04-25T16:01:04.469 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:04.470 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:00:43.549189+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:01:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe04406f430 msgr2=0x7fe044071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe04406f430 0x7fe044071940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe0580721c0 tx=0x7fe0480011a0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 msgr2=0x7fe0580ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 0x7fe0580ade60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0108d0 tx=0x7fe04c010d90 comp rx=0 tx=0).stop 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 shutdown_connections 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe04406f430 0x7fe044071940 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe05814ec10 0x7fe05814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe05814e6c0 0x7fe0580ade60 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 --2- 172.21.15.87:0/2566437620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0400039f0 0x7fe0581f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.469+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 >> 172.21.15.87:0/2566437620 conn(0x7fe05806d780 msgr2=0x7fe058156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.473+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 shutdown_connections 2024-04-25T16:01:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.473+0000 7fe05dbe9640 1 -- 172.21.15.87:0/2566437620 wait complete. 2024-04-25T16:01:04.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T16:01:04.494 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T16:01:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9e190d640 1 Processor -- start 2024-04-25T16:01:04.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9e190d640 1 -- start start 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9e190d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9dc1578b0 0x7fb9dc157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9e190d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc0c5290 con 0x7fb9dc158200 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9e190d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc0c5550 con 0x7fb9dc1517d0 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9e190d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb9dc0c5e80 con 0x7fb9dc1578b0 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9db7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb9dc158200 0x7fb9dc15ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47954/0 (socket says 172.21.15.87:47954) 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9db7fe640 1 -- 172.21.15.87:0/3411749531 learned_addr learned my addr 172.21.15.87:0/3411749531 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/3411749531 >> v2:172.21.15.155:3300/0 conn(0x7fb9dc1578b0 0x7fb9dc157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822084101 0 0) 0x7fb9dc0c5290 con 0x7fb9dc158200 2024-04-25T16:01:04.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.641+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9c4003530 con 0x7fb9dc158200 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3012969735 0 0) 0x7fb9c4003530 con 0x7fb9dc158200 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 >> v2:172.21.15.155:3300/0 conn(0x7fb9dc1578b0 msgr2=0x7fb9dc157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 --2- 172.21.15.87:0/3411749531 >> v2:172.21.15.155:3300/0 conn(0x7fb9dc1578b0 0x7fb9dc157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 >> v1:172.21.15.155:6789/0 conn(0x7fb9dc1517d0 legacy=0x7fb9dc0c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc0c5830 con 0x7fb9dc158200 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb9d4001a00 con 0x7fb9dc158200 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 >> v1:172.21.15.87:6789/0 conn(0x7fb9dc158200 legacy=0x7fb9dc15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9c4004810 0x7fb9c4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c40051d0 0x7fb9c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c400c140 con 0x7fb9c4004810 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c400c2f0 con 0x7fb9c40039c0 2024-04-25T16:01:04.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c400c4f0 con 0x7fb9c40051d0 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9c4004810 0x7fb9c4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9daffd640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9db7fe640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c40051d0 0x7fb9c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 -- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c40051d0 msgr2=0x7fb9c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c40051d0 0x7fb9c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 -- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9c40039c0 msgr2=0x7fb9c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 -- 172.21.15.87:0/3411749531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c4003530 con 0x7fb9c4004810 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9db7fe640 1 -- 172.21.15.87:0/3411749531 reap_dead start 2024-04-25T16:01:04.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9daffd640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:04.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9c4004810 0x7fb9c4004c20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009ae0 tx=0x7fb9d001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8ca3d69680d05a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00b2070 con 0x7fb9c4004810 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d00a5550 con 0x7fb9c4004810 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9d9ffb640 1 -- 172.21.15.87:0/3411749531 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00096b0 con 0x7fb9c4004810 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9e190d640 1 -- 172.21.15.87:0/3411749531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9c4004810 msgr2=0x7fb9c4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9e190d640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9c4004810 0x7fb9c4004c20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009ae0 tx=0x7fb9d001ca70 comp rx=0 tx=0).stop 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9e190d640 1 -- 172.21.15.87:0/3411749531 shutdown_connections 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9e190d640 1 --2- 172.21.15.87:0/3411749531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9c4004810 0x7fb9c4004c20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.645+0000 7fb9e190d640 1 -- 172.21.15.87:0/3411749531 >> 172.21.15.87:0/3411749531 conn(0x7fb9dc06d780 msgr2=0x7fb9dc06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- 172.21.15.87:0/3411749531 shutdown_connections 2024-04-25T16:01:04.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- 172.21.15.87:0/3411749531 wait complete. 2024-04-25T16:01:04.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 Processor -- start 2024-04-25T16:01:04.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- start start 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c4004810 0x7fb9dc144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9dc157170 0x7fb9dc1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 0x7fb9dc0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc151be0 con 0x7fb9dc145920 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc0ac6f0 con 0x7fb9dc157170 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9dc0ac870 con 0x7fb9c4004810 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 0x7fb9dc0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 0x7fb9dc0c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45264/0 (socket says 172.21.15.87:45264) 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 -- 172.21.15.87:0/1138860724 learned_addr learned my addr 172.21.15.87:0/1138860724 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9daffd640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c4004810 0x7fb9dc144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9dc157170 0x7fb9dc1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 -- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c4004810 msgr2=0x7fb9dc144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c4004810 0x7fb9dc144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 -- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9dc157170 msgr2=0x7fb9dc1451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9dc157170 0x7fb9dc1451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 -- 172.21.15.87:0/1138860724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc14ee90 con 0x7fb9dc145920 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9da7fc640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9dc157170 0x7fb9dc1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9db7fe640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 0x7fb9dc0c8490 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c4cc0 tx=0x7fb9d4011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4010040 con 0x7fb9dc145920 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d401a070 con 0x7fb9dc145920 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc1ef7d0 con 0x7fb9dc145920 2024-04-25T16:01:04.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400fb90 con 0x7fb9dc145920 2024-04-25T16:01:04.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.649+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc1efa70 con 0x7fb9dc145920 2024-04-25T16:01:04.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.653+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9dc069bb0 con 0x7fb9dc145920 2024-04-25T16:01:04.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.653+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9d400fd30 con 0x7fb9dc145920 2024-04-25T16:01:04.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.653+0000 7fb9c3fff640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9c806f430 0x7fb9c8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.653+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fb9d4092860 con 0x7fb9dc145920 2024-04-25T16:01:04.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.653+0000 7fb9daffd640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9c806f430 0x7fb9c8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.653+0000 7fb9daffd640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9c806f430 0x7fb9c8071940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc066350 tx=0x7fb9cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.657+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9d405f130 con 0x7fb9dc145920 2024-04-25T16:01:04.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:01:04.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.813+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb9dc0c4910 con 0x7fb9dc145920 2024-04-25T16:01:04.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.813+0000 7fb9c3fff640 1 -- 172.21.15.87:0/1138860724 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fb9d4067120 con 0x7fb9dc145920 2024-04-25T16:01:04.814 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T16:01:04.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9c806f430 msgr2=0x7fb9c8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9c806f430 0x7fb9c8071940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc066350 tx=0x7fb9cc009040 comp rx=0 tx=0).stop 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 msgr2=0x7fb9dc0c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 0x7fb9dc0c8490 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c4cc0 tx=0x7fb9d4011c20 comp rx=0 tx=0).stop 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 shutdown_connections 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb9c806f430 0x7fb9c8071940 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc145920 0x7fb9dc0c8490 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9dc157170 0x7fb9dc1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 --2- 172.21.15.87:0/1138860724 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9c4004810 0x7fb9dc144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 >> 172.21.15.87:0/1138860724 conn(0x7fb9dc06d780 msgr2=0x7fb9dc153790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 shutdown_connections 2024-04-25T16:01:04.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.817+0000 7fb9e190d640 1 -- 172.21.15.87:0/1138860724 wait complete. 2024-04-25T16:01:04.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.825+0000 7f63b80b1640 1 Processor -- start 2024-04-25T16:01:04.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.825+0000 7f63b80b1640 1 -- start start 2024-04-25T16:01:04.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63b0152980 0x7f63b00c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0155320 0x7f63b0155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b0152d90 con 0x7f63b0074160 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f63b00aa290 con 0x7f63b0152980 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63b01598b0 con 0x7f63b0155320 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b5e4d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63b0152980 0x7f63b00c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b664e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f63b0074160 0x7f63b00c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47956/0 (socket says 172.21.15.87:47956) 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b664e640 1 -- 172.21.15.87:0/1332193121 learned_addr learned my addr 172.21.15.87:0/1332193121 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b564c640 1 --2- 172.21.15.87:0/1332193121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0155320 0x7f63b0155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b5e4d640 1 -- 172.21.15.87:0/1332193121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0155320 msgr2=0x7f63b0155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b5e4d640 1 --2- 172.21.15.87:0/1332193121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0155320 0x7f63b0155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b5e4d640 1 -- 172.21.15.87:0/1332193121 >> v1:172.21.15.87:6789/0 conn(0x7f63b0074160 legacy=0x7f63b00c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b5e4d640 1 -- 172.21.15.87:0/1332193121 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b00ca2f0 con 0x7f63b0152980 2024-04-25T16:01:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b4e4b640 1 -- 172.21.15.87:0/1332193121 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671179093 0 0) 0x7f63b0152d90 con 0x7f63b0074160 2024-04-25T16:01:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b5e4d640 1 --2- 172.21.15.87:0/1332193121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0152980 0x7f63b00c9db0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0097c0 tx=0x7f63ac01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992d2661e1b3a6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b4e4b640 1 -- 172.21.15.87:0/1332193121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0b0070 con 0x7f63b0152980 2024-04-25T16:01:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b4e4b640 1 -- 172.21.15.87:0/1332193121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac0ab600 con 0x7f63b0152980 2024-04-25T16:01:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b4e4b640 1 -- 172.21.15.87:0/1332193121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0ab9d0 con 0x7f63b0152980 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 -- 172.21.15.87:0/1332193121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0152980 msgr2=0x7f63b00c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.829+0000 7f63b80b1640 1 --2- 172.21.15.87:0/1332193121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0152980 0x7f63b00c9db0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0097c0 tx=0x7f63ac01c410 comp rx=0 tx=0).stop 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 -- 172.21.15.87:0/1332193121 shutdown_connections 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 --2- 172.21.15.87:0/1332193121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0155320 0x7f63b0155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 --2- 172.21.15.87:0/1332193121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0152980 0x7f63b00c9db0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 -- 172.21.15.87:0/1332193121 >> 172.21.15.87:0/1332193121 conn(0x7f63b00ac550 msgr2=0x7f63b00ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 -- 172.21.15.87:0/1332193121 shutdown_connections 2024-04-25T16:01:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 -- 172.21.15.87:0/1332193121 wait complete. 2024-04-25T16:01:04.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 Processor -- start 2024-04-25T16:01:04.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.833+0000 7f63b80b1640 1 -- start start 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0074160 0x7f63b014bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b0152980 0x7f63b0151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 0x7f63b01f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0158f70 con 0x7f63b0155320 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0158c90 con 0x7f63b0152980 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63b00729c0 con 0x7f63b0074160 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 0x7f63b01f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 0x7f63b01f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45270/0 (socket says 172.21.15.87:45270) 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 -- 172.21.15.87:0/3428119851 learned_addr learned my addr 172.21.15.87:0/3428119851 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b5e4d640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0074160 0x7f63b014bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b564c640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b0152980 0x7f63b0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 -- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0074160 msgr2=0x7f63b014bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0074160 0x7f63b014bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 -- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b0152980 msgr2=0x7f63b0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b0152980 0x7f63b0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 -- 172.21.15.87:0/3428119851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b00c1100 con 0x7f63b0155320 2024-04-25T16:01:04.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b5e4d640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0074160 0x7f63b014bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:04.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b664e640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 0x7f63b01f2670 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c700 tx=0x7f63a800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8018070 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a800ce10 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b00c13e0 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a800a820 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b01f2150 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b0069bb0 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f63a801b070 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63a67fc640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f639406f400 0x7f6394071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f63a808ee30 con 0x7f63b0155320 2024-04-25T16:01:04.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.837+0000 7f63b5e4d640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f639406f400 0x7f6394071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.841+0000 7f63b5e4d640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f639406f400 0x7f6394071910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0ad000 tx=0x7f63ac0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.844 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.845+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63a805b700 con 0x7f63b0155320 2024-04-25T16:01:04.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4549250640 1 Processor -- start 2024-04-25T16:01:04.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4549250640 1 -- start start 2024-04-25T16:01:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4549250640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4544159290 0x7f45440c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4549250640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45441558d0 con 0x7f454406c670 2024-04-25T16:01:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4549250640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45441596a0 con 0x7f4544152870 2024-04-25T16:01:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4549250640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4544152c80 con 0x7f4544159290 2024-04-25T16:01:04.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f454359e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f454406c670 0x7f454415fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47960/0 (socket says 172.21.15.87:47960) 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f454359e640 1 -- 172.21.15.87:0/2696684855 learned_addr learned my addr 172.21.15.87:0/2696684855 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f454259c640 1 --2- 172.21.15.87:0/2696684855 >> v2:172.21.15.155:3300/0 conn(0x7f4544159290 0x7f45440c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915837169 0 0) 0x7f45441558d0 con 0x7f454406c670 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4530003530 con 0x7f454406c670 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1719993179 0 0) 0x7f4530003530 con 0x7f454406c670 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 >> v2:172.21.15.155:3300/0 conn(0x7f4544159290 msgr2=0x7f45440c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 --2- 172.21.15.87:0/2696684855 >> v2:172.21.15.155:3300/0 conn(0x7f4544159290 0x7f45440c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 >> v1:172.21.15.155:6789/0 conn(0x7f4544152870 legacy=0x7f45441551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4544070cb0 con 0x7f454406c670 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f453c001a00 con 0x7f454406c670 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 >> v1:172.21.15.87:6789/0 conn(0x7f454406c670 legacy=0x7f454415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f4530003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4530004810 0x7f4530004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4530005260 0x7f453000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4544152c80 con 0x7f45300039c0 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f453000c1f0 con 0x7f4530004810 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f453000c3f0 con 0x7f4530005260 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.977+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f4530003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f454259c640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4530004810 0x7f4530004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4542d9d640 1 -- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4530005260 msgr2=0x7f453000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f454359e640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4530005260 0x7f453000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4530005260 0x7f453000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4542d9d640 1 -- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4530004810 msgr2=0x7f4530004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4530004810 0x7f4530004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4542d9d640 1 -- 172.21.15.87:0/2696684855 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4530003530 con 0x7f45300039c0 2024-04-25T16:01:04.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f454359e640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4530005260 0x7f453000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:04.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f454359e640 1 -- 172.21.15.87:0/2696684855 reap_dead start 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f4530003e30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f452c001780 tx=0x7f452c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fd8abca5493834 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c0013a0 con 0x7f45300039c0 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452c0052f0 con 0x7f45300039c0 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4541d9b640 1 -- 172.21.15.87:0/2696684855 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c003840 con 0x7f45300039c0 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 -- 172.21.15.87:0/2696684855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 msgr2=0x7f4530003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f4530003e30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f452c001780 tx=0x7f452c01c400 comp rx=0 tx=0).stop 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 -- 172.21.15.87:0/2696684855 shutdown_connections 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 --2- 172.21.15.87:0/2696684855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f4530003e30 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 -- 172.21.15.87:0/2696684855 >> 172.21.15.87:0/2696684855 conn(0x7f454406d780 msgr2=0x7f454406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:04.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 -- 172.21.15.87:0/2696684855 shutdown_connections 2024-04-25T16:01:04.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.981+0000 7f4549250640 1 -- 172.21.15.87:0/2696684855 wait complete. 2024-04-25T16:01:04.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 Processor -- start 2024-04-25T16:01:04.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- start start 2024-04-25T16:01:04.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f454414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f454414bd50 0x7f45440aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45440ab210 0x7f45441e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4544158d70 con 0x7f45300039c0 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f454406ce90 con 0x7f45440ab210 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f45440ca3f0 con 0x7f454414bd50 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f454414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f454414cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45280/0 (socket says 172.21.15.87:45280) 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 -- 172.21.15.87:0/2501148956 learned_addr learned my addr 172.21.15.87:0/2501148956 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f454359e640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45440ab210 0x7f45441e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f454259c640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f454414bd50 0x7f45440aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 -- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f454414bd50 msgr2=0x7f45440aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f454414bd50 0x7f45440aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 -- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45440ab210 msgr2=0x7f45441e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45440ab210 0x7f45441e3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 -- 172.21.15.87:0/2501148956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45440aa230 con 0x7f45300039c0 2024-04-25T16:01:04.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f454359e640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45440ab210 0x7f45441e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4542d9d640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f454414cd40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f452c01c230 tx=0x7f4530005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c007a40 con 0x7f45300039c0 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452c0ba070 con 0x7f45300039c0 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45441efa00 con 0x7f45300039c0 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c0054a0 con 0x7f45300039c0 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45441efce0 con 0x7f45300039c0 2024-04-25T16:01:04.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.985+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4544069bb0 con 0x7f45300039c0 2024-04-25T16:01:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.989+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f452c007030 con 0x7f45300039c0 2024-04-25T16:01:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.989+0000 7f453b7fe640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f452406f400 0x7f4524071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.989+0000 7f454259c640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f452406f400 0x7f4524071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.989+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f452c129aa0 con 0x7f45300039c0 2024-04-25T16:01:04.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.989+0000 7f454259c640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f452406f400 0x7f4524071910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f45440c3cd0 tx=0x7f4534008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:04.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:04.993+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f452c016110 con 0x7f45300039c0 2024-04-25T16:01:05.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.037+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63b00c9b90 con 0x7f63b0155320 2024-04-25T16:01:05.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63a67fc640 1 -- 172.21.15.87:0/3428119851 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7f63a805b000 con 0x7f63b0155320 2024-04-25T16:01:05.041 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:05.041 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:01:05.041 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f639406f400 msgr2=0x7f6394071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f639406f400 0x7f6394071910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0ad000 tx=0x7f63ac0a6000 comp rx=0 tx=0).stop 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 msgr2=0x7f63b01f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 0x7f63b01f2670 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c700 tx=0x7f63a800cbc0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 shutdown_connections 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f639406f400 0x7f6394071910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63b0155320 0x7f63b01f2670 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63b0152980 0x7f63b0151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 --2- 172.21.15.87:0/3428119851 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63b0074160 0x7f63b014bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.043 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 >> 172.21.15.87:0/3428119851 conn(0x7f63b00ac550 msgr2=0x7f63b015ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 shutdown_connections 2024-04-25T16:01:05.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.041+0000 7f63b80b1640 1 -- 172.21.15.87:0/3428119851 wait complete. 2024-04-25T16:01:05.062 INFO:tasks.mds_thrash.fs.[a]:mds.b reported in up:standby state 2024-04-25T16:01:05.062 INFO:tasks.mds_thrash.fs.[a]:waiting for 55 secs before thrashing 2024-04-25T16:01:05.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.153+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f45440ae750 con 0x7f45300039c0 2024-04-25T16:01:05.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f453b7fe640 1 -- 172.21.15.87:0/2501148956 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7f452c0f6250 con 0x7f45300039c0 2024-04-25T16:01:05.156 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:01:05.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f452406f400 msgr2=0x7f4524071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f452406f400 0x7f4524071910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f45440c3cd0 tx=0x7f4534008040 comp rx=0 tx=0).stop 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 msgr2=0x7f454414cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f454414cd40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f452c01c230 tx=0x7f4530005840 comp rx=0 tx=0).stop 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 shutdown_connections 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f452406f400 0x7f4524071910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45440ab210 0x7f45441e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f454414bd50 0x7f45440aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 --2- 172.21.15.87:0/2501148956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f45300039c0 0x7f454414cd40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 >> 172.21.15.87:0/2501148956 conn(0x7f454406d780 msgr2=0x7f4544157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 shutdown_connections 2024-04-25T16:01:05.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.157+0000 7f4549250640 1 -- 172.21.15.87:0/2501148956 wait complete. 2024-04-25T16:01:05.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T16:01:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 Processor -- start 2024-04-25T16:01:05.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 -- start start 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd41518b0 0x7f5bd406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bd40ad160 0x7f5bd40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd4154fc0 con 0x7f5bd40c4620 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd406ed60 con 0x7f5bd40ad160 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdc5fb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd40acb20 con 0x7f5bd41518b0 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9b96640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bd40ad160 0x7f5bd40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdab98640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5bd40c4620 0x7f5bd4157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47974/0 (socket says 172.21.15.87:47974) 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bdab98640 1 -- 172.21.15.87:0/2088272368 learned_addr learned my addr 172.21.15.87:0/2088272368 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9395640 1 -- 172.21.15.87:0/2088272368 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703146020 0 0) 0x7f5bd4154fc0 con 0x7f5bd40c4620 2024-04-25T16:01:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9395640 1 -- 172.21.15.87:0/2088272368 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bc0003530 con 0x7f5bd40c4620 2024-04-25T16:01:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bda397640 1 --2- 172.21.15.87:0/2088272368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd41518b0 0x7f5bd406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9b96640 1 -- 172.21.15.87:0/2088272368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd41518b0 msgr2=0x7f5bd406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9b96640 1 --2- 172.21.15.87:0/2088272368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd41518b0 0x7f5bd406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9b96640 1 -- 172.21.15.87:0/2088272368 >> v1:172.21.15.87:6789/0 conn(0x7f5bd40c4620 legacy=0x7f5bd4157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9395640 1 -- 172.21.15.87:0/2088272368 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1737009042 0 0) 0x7f5bc0003530 con 0x7f5bd40c4620 2024-04-25T16:01:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.321+0000 7f5bd9b96640 1 -- 172.21.15.87:0/2088272368 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd40ace00 con 0x7f5bd40ad160 2024-04-25T16:01:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bd9b96640 1 --2- 172.21.15.87:0/2088272368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40ad160 0x7f5bd40c40e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40097c0 tx=0x7f5bc401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a594d0250389d0bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bd9395640 1 -- 172.21.15.87:0/2088272368 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40b0070 con 0x7f5bd40ad160 2024-04-25T16:01:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bd9395640 1 -- 172.21.15.87:0/2088272368 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc40ab400 con 0x7f5bd40ad160 2024-04-25T16:01:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bd9395640 1 -- 172.21.15.87:0/2088272368 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc001a00 con 0x7f5bd40ad160 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2088272368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40ad160 msgr2=0x7f5bd40c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2088272368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40ad160 0x7f5bd40c40e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40097c0 tx=0x7f5bc401c3c0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2088272368 shutdown_connections 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2088272368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd40ad160 0x7f5bd40c40e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2088272368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd41518b0 0x7f5bd406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2088272368 >> 172.21.15.87:0/2088272368 conn(0x7f5bd40c8770 msgr2=0x7f5bd40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2088272368 shutdown_connections 2024-04-25T16:01:05.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2088272368 wait complete. 2024-04-25T16:01:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 Processor -- start 2024-04-25T16:01:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.325+0000 7f5bdc5fb640 1 -- start start 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40ad160 0x7f5bd41f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd40c4620 0x7f5bd415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 0x7f5bd4156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd4161d60 con 0x7f5bd41518b0 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd4161be0 con 0x7f5bd40ad160 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd4161ee0 con 0x7f5bd40c4620 2024-04-25T16:01:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 0x7f5bd4156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 0x7f5bd4156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45290/0 (socket says 172.21.15.87:45290) 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 -- 172.21.15.87:0/2404204938 learned_addr learned my addr 172.21.15.87:0/2404204938 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bda397640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40ad160 0x7f5bd41f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bd9b96640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd40c4620 0x7f5bd415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 -- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd40c4620 msgr2=0x7f5bd415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd40c4620 0x7f5bd415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 -- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40ad160 msgr2=0x7f5bd41f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40ad160 0x7f5bd41f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 -- 172.21.15.87:0/2404204938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd4158c40 con 0x7f5bd41518b0 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bd9b96640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd40c4620 0x7f5bd415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdab98640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 0x7f5bd4156600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00cc00 tx=0x7f5bcc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc00ace0 con 0x7f5bd41518b0 2024-04-25T16:01:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bcc012400 con 0x7f5bd41518b0 2024-04-25T16:01:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd41f09b0 con 0x7f5bd41518b0 2024-04-25T16:01:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0127f0 con 0x7f5bd41518b0 2024-04-25T16:01:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd41f0c50 con 0x7f5bd41518b0 2024-04-25T16:01:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd4069bb0 con 0x7f5bd41518b0 2024-04-25T16:01:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.329+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5bcc012990 con 0x7f5bd41518b0 2024-04-25T16:01:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.333+0000 7f5bcaffd640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bb806f430 0x7f5bb8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.333+0000 7f5bda397640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bb806f430 0x7f5bb8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.333+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f5bcc090b90 con 0x7f5bd41518b0 2024-04-25T16:01:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.333+0000 7f5bda397640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bb806f430 0x7f5bb8071940 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40aad60 tx=0x7f5bd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.337+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5bcc05d420 con 0x7f5bd41518b0 2024-04-25T16:01:05.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.485+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f5bd40abfa0 con 0x7f5bd41518b0 2024-04-25T16:01:05.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bcaffd640 1 -- 172.21.15.87:0/2404204938 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7f5bcc05cd20 con 0x7f5bd41518b0 2024-04-25T16:01:05.488 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:01:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bb806f430 msgr2=0x7f5bb8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bb806f430 0x7f5bb8071940 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40aad60 tx=0x7f5bd0008040 comp rx=0 tx=0).stop 2024-04-25T16:01:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 msgr2=0x7f5bd4156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 0x7f5bd4156600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00cc00 tx=0x7f5bcc00a430 comp rx=0 tx=0).stop 2024-04-25T16:01:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 shutdown_connections 2024-04-25T16:01:05.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f5bb806f430 0x7f5bb8071940 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bd41518b0 0x7f5bd4156600 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bd40c4620 0x7f5bd415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 --2- 172.21.15.87:0/2404204938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bd40ad160 0x7f5bd41f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 >> 172.21.15.87:0/2404204938 conn(0x7f5bd40c8770 msgr2=0x7f5bd4073f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 shutdown_connections 2024-04-25T16:01:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.489+0000 7f5bdc5fb640 1 -- 172.21.15.87:0/2404204938 wait complete. 2024-04-25T16:01:05.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T16:01:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 Processor -- start 2024-04-25T16:01:05.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 -- start start 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 0x7fdf0015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf00160230 0x7fdf00162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf000c7570 con 0x7fdf0015ad90 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0015b8b0 con 0x7fdf000cb030 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf06ef9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0015b5d0 con 0x7fdf00160230 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdefffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 0x7fdf0015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdefffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 0x7fdf0015fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:55714/0 (socket says 172.21.15.87:55714) 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdefffff640 1 -- 172.21.15.87:0/651973608 learned_addr learned my addr 172.21.15.87:0/651973608 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:05.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.649+0000 7fdf05496640 1 --2- 172.21.15.87:0/651973608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf00160230 0x7fdf00162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf05496640 1 -- 172.21.15.87:0/651973608 >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 msgr2=0x7fdf0015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf05496640 1 --2- 172.21.15.87:0/651973608 >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 0x7fdf0015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf05496640 1 -- 172.21.15.87:0/651973608 >> v1:172.21.15.155:6789/0 conn(0x7fdf0015ad90 legacy=0x7fdf000ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf05496640 1 -- 172.21.15.87:0/651973608 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf000c2290 con 0x7fdf00160230 2024-04-25T16:01:05.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdefffff640 1 --2- 172.21.15.87:0/651973608 >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 0x7fdf0015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:01:05.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf05496640 1 --2- 172.21.15.87:0/651973608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf00160230 0x7fdf00162650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009d90 tx=0x7fdef801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87444a138ba7ba6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdeff7fe640 1 -- 172.21.15.87:0/651973608 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef80b2070 con 0x7fdf00160230 2024-04-25T16:01:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdeff7fe640 1 -- 172.21.15.87:0/651973608 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef80a5710 con 0x7fdf00160230 2024-04-25T16:01:05.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdeff7fe640 1 -- 172.21.15.87:0/651973608 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef80a5ae0 con 0x7fdf00160230 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 -- 172.21.15.87:0/651973608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf00160230 msgr2=0x7fdf00162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/651973608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf00160230 0x7fdf00162650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009d90 tx=0x7fdef801c850 comp rx=0 tx=0).stop 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 -- 172.21.15.87:0/651973608 shutdown_connections 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/651973608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf00160230 0x7fdf00162650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/651973608 >> v2:172.21.15.155:3300/0 conn(0x7fdf000cb030 0x7fdf0015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 -- 172.21.15.87:0/651973608 >> 172.21.15.87:0/651973608 conn(0x7fdf000c9330 msgr2=0x7fdf000c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 -- 172.21.15.87:0/651973608 shutdown_connections 2024-04-25T16:01:05.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.653+0000 7fdf06ef9640 1 -- 172.21.15.87:0/651973608 wait complete. 2024-04-25T16:01:05.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 Processor -- start 2024-04-25T16:01:05.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 -- start start 2024-04-25T16:01:05.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 0x7fdf000b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf0015ad90 0x7fdf00160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf00160230 0x7fdf000ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0015b1a0 con 0x7fdf000cb030 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000ca190 con 0x7fdf00160230 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0015b320 con 0x7fdf0015ad90 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 0x7fdf000b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 0x7fdf000b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45294/0 (socket says 172.21.15.87:45294) 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 -- 172.21.15.87:0/3650480957 learned_addr learned my addr 172.21.15.87:0/3650480957 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdefffff640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf0015ad90 0x7fdf00160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf05496640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf00160230 0x7fdf000ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 -- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf0015ad90 msgr2=0x7fdf00160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf0015ad90 0x7fdf00160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 -- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf00160230 msgr2=0x7fdf000ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf00160230 0x7fdf000ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 -- 172.21.15.87:0/3650480957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf000af5b0 con 0x7fdf000cb030 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf04c95640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 0x7fdf000b00b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdef000c3c0 tx=0x7fdef000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0017070 con 0x7fdf000cb030 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf001f4aa0 con 0x7fdf000cb030 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf00160ac0 con 0x7fdf000cb030 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef00052d0 con 0x7fdf000cb030 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.657+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef00054c0 con 0x7fdf000cb030 2024-04-25T16:01:05.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.661+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00052a0 con 0x7fdf000cb030 2024-04-25T16:01:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.661+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdef001a070 con 0x7fdf000cb030 2024-04-25T16:01:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.661+0000 7fdefd7fa640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdeec06f400 0x7fdeec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.661+0000 7fdefffff640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdeec06f400 0x7fdeec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.661+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fdef008eca0 con 0x7fdf000cb030 2024-04-25T16:01:05.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.661+0000 7fdefffff640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdeec06f400 0x7fdeec071910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdf0006eb50 tx=0x7fdef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.665+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdef005ad80 con 0x7fdf000cb030 2024-04-25T16:01:05.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.813+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fdee0005860 con 0x7fdf000cb030 2024-04-25T16:01:05.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdefd7fa640 1 -- 172.21.15.87:0/3650480957 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7fdef005f080 con 0x7fdf000cb030 2024-04-25T16:01:05.816 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:01:05.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdeec06f400 msgr2=0x7fdeec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdeec06f400 0x7fdeec071910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdf0006eb50 tx=0x7fdef4008040 comp rx=0 tx=0).stop 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 msgr2=0x7fdf000b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 0x7fdf000b00b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdef000c3c0 tx=0x7fdef000c880 comp rx=0 tx=0).stop 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 shutdown_connections 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdeec06f400 0x7fdeec071910 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf00160230 0x7fdf000ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf0015ad90 0x7fdf00160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 --2- 172.21.15.87:0/3650480957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf000cb030 0x7fdf000b00b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 >> 172.21.15.87:0/3650480957 conn(0x7fdf000c9330 msgr2=0x7fdf000c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 shutdown_connections 2024-04-25T16:01:05.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.817+0000 7fdf06ef9640 1 -- 172.21.15.87:0/3650480957 wait complete. 2024-04-25T16:01:05.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T16:01:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 Processor -- start 2024-04-25T16:01:05.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 -- start start 2024-04-25T16:01:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d4151700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3d406f8a0 0x7fd3d406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d406dbd0 con 0x7fd3d40aeca0 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d4151c40 con 0x7fd3d406f8a0 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3dab7f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d4070440 con 0x7fd3d4074930 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3d406f8a0 0x7fd3d406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3d406f8a0 0x7fd3d406fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45306/0 (socket says 172.21.15.87:45306) 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 -- 172.21.15.87:0/883465222 learned_addr learned my addr 172.21.15.87:0/883465222 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d3fff640 1 --2- 172.21.15.87:0/883465222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d4151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 -- 172.21.15.87:0/883465222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 msgr2=0x7fd3d4151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 --2- 172.21.15.87:0/883465222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d4151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 -- 172.21.15.87:0/883465222 >> v1:172.21.15.155:6789/0 conn(0x7fd3d40aeca0 legacy=0x7fd3d4154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.985+0000 7fd3d911c640 1 -- 172.21.15.87:0/883465222 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d4154870 con 0x7fd3d406f8a0 2024-04-25T16:01:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3d911c640 1 --2- 172.21.15.87:0/883465222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d406fcb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009e50 tx=0x7fd3cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb592528a5e8f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3d37fe640 1 -- 172.21.15.87:0/883465222 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0a56c0 con 0x7fd3d406f8a0 2024-04-25T16:01:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3d37fe640 1 -- 172.21.15.87:0/883465222 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc0a5860 con 0x7fd3d406f8a0 2024-04-25T16:01:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3d37fe640 1 -- 172.21.15.87:0/883465222 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0a5c30 con 0x7fd3d406f8a0 2024-04-25T16:01:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 -- 172.21.15.87:0/883465222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 msgr2=0x7fd3d406fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/883465222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d406fcb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009e50 tx=0x7fd3cc01c910 comp rx=0 tx=0).stop 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 -- 172.21.15.87:0/883465222 shutdown_connections 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/883465222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d4151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/883465222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d406fcb0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 -- 172.21.15.87:0/883465222 >> 172.21.15.87:0/883465222 conn(0x7fd3d406d650 msgr2=0x7fd3d40c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 -- 172.21.15.87:0/883465222 shutdown_connections 2024-04-25T16:01:05.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 -- 172.21.15.87:0/883465222 wait complete. 2024-04-25T16:01:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 Processor -- start 2024-04-25T16:01:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.989+0000 7fd3dab7f640 1 -- start start 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d41489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d41f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3d40aeca0 0x7fd3d40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d41612c0 con 0x7fd3d406f8a0 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4074410 con 0x7fd3d40aeca0 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d4161440 con 0x7fd3d4074930 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d41489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d41489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45318/0 (socket says 172.21.15.87:45318) 2024-04-25T16:01:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 -- 172.21.15.87:0/304731268 learned_addr learned my addr 172.21.15.87:0/304731268 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 -- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 msgr2=0x7fd3d41f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d911c640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3d40aeca0 0x7fd3d40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d3fff640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d41f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d41f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 -- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3d40aeca0 msgr2=0x7fd3d40c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3d40aeca0 0x7fd3d40c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 -- 172.21.15.87:0/304731268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d41540a0 con 0x7fd3d406f8a0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d3fff640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d41f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d891b640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d41489c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400e660 tx=0x7fd3c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40052d0 con 0x7fd3d406f8a0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c4005490 con 0x7fd3d406f8a0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d4154620 con 0x7fd3d406f8a0 2024-04-25T16:01:05.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4001890 con 0x7fd3d406f8a0 2024-04-25T16:01:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d4154340 con 0x7fd3d406f8a0 2024-04-25T16:01:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d4069bb0 con 0x7fd3d406f8a0 2024-04-25T16:01:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd3c4001a30 con 0x7fd3d406f8a0 2024-04-25T16:01:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d17fa640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3c006f430 0x7fd3c0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:05.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fd3c4091b20 con 0x7fd3d406f8a0 2024-04-25T16:01:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.993+0000 7fd3d3fff640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3c006f430 0x7fd3c0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:05.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:05.997+0000 7fd3d3fff640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3c006f430 0x7fd3c0071940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4158510 tx=0x7fd3c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.001+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3c4016020 con 0x7fd3d406f8a0 2024-04-25T16:01:06.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fd3d40c5710 con 0x7fd3d406f8a0 2024-04-25T16:01:06.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3d17fa640 1 -- 172.21.15.87:0/304731268 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7fd3c4064030 con 0x7fd3d406f8a0 2024-04-25T16:01:06.157 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:01:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3c006f430 msgr2=0x7fd3c0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3c006f430 0x7fd3c0071940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4158510 tx=0x7fd3c8008040 comp rx=0 tx=0).stop 2024-04-25T16:01:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 msgr2=0x7fd3d41489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d41489c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400e660 tx=0x7fd3c400eb20 comp rx=0 tx=0).stop 2024-04-25T16:01:06.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 shutdown_connections 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd3c006f430 0x7fd3c0071940 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3d40aeca0 0x7fd3d40c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3d4074930 0x7fd3d41f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 --2- 172.21.15.87:0/304731268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d406f8a0 0x7fd3d41489c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 >> 172.21.15.87:0/304731268 conn(0x7fd3d406d650 msgr2=0x7fd3d40726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 shutdown_connections 2024-04-25T16:01:06.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.157+0000 7fd3dab7f640 1 -- 172.21.15.87:0/304731268 wait complete. 2024-04-25T16:01:06.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T16:01:06.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 Processor -- start 2024-04-25T16:01:06.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 -- start start 2024-04-25T16:01:06.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3040154d00 0x7f3040154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f304006ee80 0x7f304006f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30400add10 con 0x7f304014d810 2024-04-25T16:01:06.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f30400adff0 con 0x7f304006ee80 2024-04-25T16:01:06.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f304662b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3040157010 con 0x7f3040154d00 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f304006ee80 0x7f304006f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f304006ee80 0x7f304006f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45324/0 (socket says 172.21.15.87:45324) 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 -- 172.21.15.87:0/4214618718 learned_addr learned my addr 172.21.15.87:0/4214618718 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f303f7fe640 1 --2- 172.21.15.87:0/4214618718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3040154d00 0x7f3040154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 -- 172.21.15.87:0/4214618718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3040154d00 msgr2=0x7f3040154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 --2- 172.21.15.87:0/4214618718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3040154d00 0x7f3040154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 -- 172.21.15.87:0/4214618718 >> v1:172.21.15.155:6789/0 conn(0x7f304014d810 legacy=0x7f3040157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.329+0000 7f3044bc8640 1 -- 172.21.15.87:0/4214618718 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30401572f0 con 0x7f304006ee80 2024-04-25T16:01:06.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f3044bc8640 1 --2- 172.21.15.87:0/4214618718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f304006ee80 0x7f304006f790 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3038009e50 tx=0x7f303801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14376a8db38bcd70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f303effd640 1 -- 172.21.15.87:0/4214618718 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30380a55d0 con 0x7f304006ee80 2024-04-25T16:01:06.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f303effd640 1 -- 172.21.15.87:0/4214618718 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30380a5770 con 0x7f304006ee80 2024-04-25T16:01:06.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f303effd640 1 -- 172.21.15.87:0/4214618718 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30380a5b40 con 0x7f304006ee80 2024-04-25T16:01:06.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 -- 172.21.15.87:0/4214618718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f304006ee80 msgr2=0x7f304006f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 --2- 172.21.15.87:0/4214618718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f304006ee80 0x7f304006f790 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3038009e50 tx=0x7f303801c910 comp rx=0 tx=0).stop 2024-04-25T16:01:06.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 -- 172.21.15.87:0/4214618718 shutdown_connections 2024-04-25T16:01:06.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 --2- 172.21.15.87:0/4214618718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3040154d00 0x7f3040154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 --2- 172.21.15.87:0/4214618718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f304006ee80 0x7f304006f790 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 -- 172.21.15.87:0/4214618718 >> 172.21.15.87:0/4214618718 conn(0x7f30400c8770 msgr2=0x7f30400c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:06.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 -- 172.21.15.87:0/4214618718 shutdown_connections 2024-04-25T16:01:06.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.333+0000 7f304662b640 1 -- 172.21.15.87:0/4214618718 wait complete. 2024-04-25T16:01:06.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 Processor -- start 2024-04-25T16:01:06.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- start start 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304006ee80 0x7f30400c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304014d810 0x7f30400ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 0x7f30401f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3040161c40 con 0x7f3040154d00 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3040161ac0 con 0x7f304006ee80 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3040161dc0 con 0x7f304014d810 2024-04-25T16:01:06.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 0x7f30401f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 0x7f30401f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45332/0 (socket says 172.21.15.87:45332) 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 -- 172.21.15.87:0/2167944996 learned_addr learned my addr 172.21.15.87:0/2167944996 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303ffff640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304006ee80 0x7f30400c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303f7fe640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304014d810 0x7f30400ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 -- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304014d810 msgr2=0x7f30400ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304014d810 0x7f30400ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 -- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304006ee80 msgr2=0x7f30400c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304006ee80 0x7f30400c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 -- 172.21.15.87:0/2167944996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30400748d0 con 0x7f3040154d00 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f3044bc8640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 0x7f30401f1240 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f30380af040 tx=0x7f30380196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30380bc020 con 0x7f3040154d00 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30380b8670 con 0x7f3040154d00 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3040074bb0 con 0x7f3040154d00 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038009510 con 0x7f3040154d00 2024-04-25T16:01:06.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30401f1c90 con 0x7f3040154d00 2024-04-25T16:01:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3040069bb0 con 0x7f3040154d00 2024-04-25T16:01:06.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f30380bf020 con 0x7f3040154d00 2024-04-25T16:01:06.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.337+0000 7f303cff9640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f302c06f400 0x7f302c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.341+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f303812a750 con 0x7f3040154d00 2024-04-25T16:01:06.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.341+0000 7f303ffff640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f302c06f400 0x7f302c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.341+0000 7f303ffff640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f302c06f400 0x7f302c071910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3040075050 tx=0x7f3030009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.345+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30380c6030 con 0x7f3040154d00 2024-04-25T16:01:06.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.517+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30400c7340 con 0x7f3040154d00 2024-04-25T16:01:06.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.517+0000 7f303cff9640 1 -- 172.21.15.87:0/2167944996 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 20 entries v36) ==== 81+0+1226 (secure 0 0 0) 0x7f3038016620 con 0x7f3040154d00 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:01:06.519 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:01:06.520 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:listed 20 entries 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f302c06f400 msgr2=0x7f302c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f302c06f400 0x7f302c071910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3040075050 tx=0x7f3030009040 comp rx=0 tx=0).stop 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 msgr2=0x7f30401f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 0x7f30401f1240 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f30380af040 tx=0x7f30380196b0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 shutdown_connections 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f302c06f400 0x7f302c071910 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3040154d00 0x7f30401f1240 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304014d810 0x7f30400ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 --2- 172.21.15.87:0/2167944996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304006ee80 0x7f30400c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 >> 172.21.15.87:0/2167944996 conn(0x7f30400c8770 msgr2=0x7f30401477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:06.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 shutdown_connections 2024-04-25T16:01:06.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.521+0000 7f304662b640 1 -- 172.21.15.87:0/2167944996 wait complete. 2024-04-25T16:01:06.542 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T16:01:06.542 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T16:01:06.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:01:06.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.697+0000 7f34bab9d640 1 Processor -- start 2024-04-25T16:01:06.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.697+0000 7f34bab9d640 1 -- start start 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34bab9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34b41529a0 0x7f34b4071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34bab9d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b40ae1b0 con 0x7f34b40adda0 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34bab9d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b4072430 con 0x7f34b40ad990 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34bab9d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f34b4074730 con 0x7f34b41529a0 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b913a640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f34b40adda0 0x7f34b40c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47986/0 (socket says 172.21.15.87:47986) 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b913a640 1 -- 172.21.15.87:0/489014098 learned_addr learned my addr 172.21.15.87:0/489014098 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 --2- 172.21.15.87:0/489014098 >> v2:172.21.15.155:3300/0 conn(0x7f34b41529a0 0x7f34b4071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870784875 0 0) 0x7f34b40ae1b0 con 0x7f34b40adda0 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f349c003530 con 0x7f34b40adda0 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2710340262 0 0) 0x7f349c003530 con 0x7f34b40adda0 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 >> v2:172.21.15.155:3300/0 conn(0x7f34b41529a0 msgr2=0x7f34b4071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 --2- 172.21.15.87:0/489014098 >> v2:172.21.15.155:3300/0 conn(0x7f34b41529a0 0x7f34b4071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 >> v1:172.21.15.155:6789/0 conn(0x7f34b40ad990 legacy=0x7f34b40c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b4074a10 con 0x7f34b40adda0 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f34ac001a00 con 0x7f34b40adda0 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 >> v1:172.21.15.87:6789/0 conn(0x7f34b40adda0 legacy=0x7f34b40c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f349c0039c0 0x7f349c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f349c004810 0x7f349c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c005260 0x7f349c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4074730 con 0x7f349c0039c0 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f349c00c1f0 con 0x7f349c004810 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f349c00c3f0 con 0x7f349c005260 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f349c0039c0 0x7f349c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b3fff640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f349c004810 0x7f349c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b913a640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c005260 0x7f349c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 -- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c005260 msgr2=0x7f349c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:06.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c005260 0x7f349c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 -- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f349c004810 msgr2=0x7f349c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:06.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f349c004810 0x7f349c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b8939640 1 -- 172.21.15.87:0/489014098 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c003530 con 0x7f349c0039c0 2024-04-25T16:01:06.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.701+0000 7f34b913a640 1 -- 172.21.15.87:0/489014098 reap_dead start 2024-04-25T16:01:06.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34b8939640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f349c0039c0 0x7f349c003e30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009ab0 tx=0x7f34a401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a272868d900284d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a40096b0 con 0x7f349c0039c0 2024-04-25T16:01:06.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a40a6450 con 0x7f349c0039c0 2024-04-25T16:01:06.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34b37fe640 1 -- 172.21.15.87:0/489014098 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a40a6840 con 0x7f349c0039c0 2024-04-25T16:01:06.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 -- 172.21.15.87:0/489014098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f349c0039c0 msgr2=0x7f349c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f349c0039c0 0x7f349c003e30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009ab0 tx=0x7f34a401ca70 comp rx=0 tx=0).stop 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 -- 172.21.15.87:0/489014098 shutdown_connections 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 --2- 172.21.15.87:0/489014098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f349c0039c0 0x7f349c003e30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 -- 172.21.15.87:0/489014098 >> 172.21.15.87:0/489014098 conn(0x7f34b40c8770 msgr2=0x7f34b40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 -- 172.21.15.87:0/489014098 shutdown_connections 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 -- 172.21.15.87:0/489014098 wait complete. 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 Processor -- start 2024-04-25T16:01:06.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.705+0000 7f34bab9d640 1 -- start start 2024-04-25T16:01:06.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c0039c0 0x7f34b41f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 0x7f34b414be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b4154340 0x7f34b41476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34b40c4b70 con 0x7f34b4153f30 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34b40c49f0 con 0x7f34b4154340 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34b40c4cf0 con 0x7f349c0039c0 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 0x7f34b414be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 0x7f34b414be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45348/0 (socket says 172.21.15.87:45348) 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 -- 172.21.15.87:0/3362944178 learned_addr learned my addr 172.21.15.87:0/3362944178 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b913a640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b4154340 0x7f34b41476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b8939640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c0039c0 0x7f34b41f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 -- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c0039c0 msgr2=0x7f34b41f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c0039c0 0x7f34b41f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 -- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b4154340 msgr2=0x7f34b41476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b4154340 0x7f34b41476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 -- 172.21.15.87:0/3362944178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b4155b80 con 0x7f34b4153f30 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b8939640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c0039c0 0x7f34b41f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b3fff640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 0x7f34b414be90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f34a8000c10 tx=0x7f34a800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8019070 con 0x7f34b4153f30 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a80052e0 con 0x7f34b4153f30 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b4155e20 con 0x7f34b4153f30 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8003800 con 0x7f34b4153f30 2024-04-25T16:01:06.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b41f2b70 con 0x7f34b4153f30 2024-04-25T16:01:06.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4069bb0 con 0x7f34b4153f30 2024-04-25T16:01:06.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f34a801c070 con 0x7f34b4153f30 2024-04-25T16:01:06.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.709+0000 7f34b17fa640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34a006f400 0x7f34a0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:06.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.713+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f34a808ef10 con 0x7f34b4153f30 2024-04-25T16:01:06.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.713+0000 7f34b8939640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34a006f400 0x7f34a0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:06.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.713+0000 7f34b8939640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34a006f400 0x7f34a0071910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f34a40ad000 tx=0x7f34a40046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:06.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.717+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34a805b100 con 0x7f34b4153f30 2024-04-25T16:01:06.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.865+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34b40c3760 con 0x7f34b4153f30 2024-04-25T16:01:06.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.869+0000 7f34b17fa640 1 -- 172.21.15.87:0/3362944178 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21989 (secure 0 0 0) 0x7f34a805f400 con 0x7f34b4153f30 2024-04-25T16:01:06.870 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:06.870 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:00:43.549189+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34a006f400 msgr2=0x7f34a0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34a006f400 0x7f34a0071910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f34a40ad000 tx=0x7f34a40046d0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 msgr2=0x7f34b414be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 0x7f34b414be90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f34a8000c10 tx=0x7f34a800e8a0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 shutdown_connections 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f34a006f400 0x7f34a0071910 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34b4154340 0x7f34b41476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b4153f30 0x7f34b414be90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 --2- 172.21.15.87:0/3362944178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f349c0039c0 0x7f34b41f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:06.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 >> 172.21.15.87:0/3362944178 conn(0x7f34b40c8770 msgr2=0x7f34b414e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:06.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 shutdown_connections 2024-04-25T16:01:06.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:06.873+0000 7f34bab9d640 1 -- 172.21.15.87:0/3362944178 wait complete. 2024-04-25T16:01:06.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:53:57.150923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-25T15:54:07.592284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-25T15:54:08.577402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-25T15:54:17.866410+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-25T15:54:18.720885+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T16:01:06.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T16:01:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.037+0000 7f8019346640 1 Processor -- start 2024-04-25T16:01:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.037+0000 7f8019346640 1 -- start start 2024-04-25T16:01:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8019346640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80141518b0 0x7f801406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8019346640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8014154fc0 con 0x7f801406fa10 2024-04-25T16:01:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8019346640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80140acb20 con 0x7f80140ad160 2024-04-25T16:01:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8019346640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f801406ed60 con 0x7f80141518b0 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8012ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80141518b0 0x7f801406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f80137fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f801406fa10 0x7f801415e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47994/0 (socket says 172.21.15.87:47994) 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8012ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f80141518b0 0x7f801406f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45364/0 (socket says 172.21.15.87:45364) 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f80137fe640 1 -- 172.21.15.87:0/2770355369 learned_addr learned my addr 172.21.15.87:0/2770355369 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8012ffd640 1 -- 172.21.15.87:0/2770355369 >> v1:172.21.15.155:6789/0 conn(0x7f80140ad160 legacy=0x7f80140c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8012ffd640 1 -- 172.21.15.87:0/2770355369 >> v1:172.21.15.87:6789/0 conn(0x7f801406fa10 legacy=0x7f801415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8012ffd640 1 -- 172.21.15.87:0/2770355369 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80140ace00 con 0x7f80141518b0 2024-04-25T16:01:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f80127fc640 1 -- 172.21.15.87:0/2770355369 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401427915 0 0) 0x7f8014154fc0 con 0x7f801406fa10 2024-04-25T16:01:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.041+0000 7f8012ffd640 1 --2- 172.21.15.87:0/2770355369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80141518b0 0x7f801406f4d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f801406eee0 tx=0x7f800401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c01a3a2ef70ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f80127fc640 1 -- 172.21.15.87:0/2770355369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040b1070 con 0x7f80141518b0 2024-04-25T16:01:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f80127fc640 1 -- 172.21.15.87:0/2770355369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80040ac5f0 con 0x7f80141518b0 2024-04-25T16:01:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f80127fc640 1 -- 172.21.15.87:0/2770355369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040ac9c0 con 0x7f80141518b0 2024-04-25T16:01:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- 172.21.15.87:0/2770355369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80141518b0 msgr2=0x7f801406f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 --2- 172.21.15.87:0/2770355369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80141518b0 0x7f801406f4d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f801406eee0 tx=0x7f800401c460 comp rx=0 tx=0).stop 2024-04-25T16:01:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- 172.21.15.87:0/2770355369 shutdown_connections 2024-04-25T16:01:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 --2- 172.21.15.87:0/2770355369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80141518b0 0x7f801406f4d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- 172.21.15.87:0/2770355369 >> 172.21.15.87:0/2770355369 conn(0x7f80140c8770 msgr2=0x7f80140c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- 172.21.15.87:0/2770355369 shutdown_connections 2024-04-25T16:01:07.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- 172.21.15.87:0/2770355369 wait complete. 2024-04-25T16:01:07.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 Processor -- start 2024-04-25T16:01:07.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- start start 2024-04-25T16:01:07.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 0x7f80141f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80140ad160 0x7f80141efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80141518b0 0x7f801414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f80141628f0 con 0x7f801406fa10 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8014162a70 con 0x7f80141518b0 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8019346640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8014162bf0 con 0x7f80140ad160 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8012ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 0x7f80141f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8012ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 0x7f80141f0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45370/0 (socket says 172.21.15.87:45370) 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f8012ffd640 1 -- 172.21.15.87:0/1833747749 learned_addr learned my addr 172.21.15.87:0/1833747749 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.045+0000 7f80137fe640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80141518b0 0x7f801414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800a7fc640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80140ad160 0x7f80141efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8012ffd640 1 -- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80140ad160 msgr2=0x7f80141efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8012ffd640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80140ad160 0x7f80141efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8012ffd640 1 -- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80141518b0 msgr2=0x7f801414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8012ffd640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80141518b0 0x7f801414ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8012ffd640 1 -- 172.21.15.87:0/1833747749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80141f1b10 con 0x7f801406fa10 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f80137fe640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80141518b0 0x7f801414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8012ffd640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 0x7f80141f0f60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f80040af040 tx=0x7f800401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040bd070 con 0x7f801406fa10 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80040b2040 con 0x7f801406fa10 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80040b1050 con 0x7f801406fa10 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80141eef50 con 0x7f801406fa10 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801414c720 con 0x7f801406fa10 2024-04-25T16:01:07.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8014069bb0 con 0x7f801406fa10 2024-04-25T16:01:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80040c0070 con 0x7f801406fa10 2024-04-25T16:01:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800bfff640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7ff406f400 0x7f7ff4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f8004129540 con 0x7f801406fa10 2024-04-25T16:01:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800a7fc640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7ff406f400 0x7f7ff4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.049+0000 7f800a7fc640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7ff406f400 0x7f7ff4071910 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a750 tx=0x7f7ffc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.053+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80040a9070 con 0x7f801406fa10 2024-04-25T16:01:07.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f80140abfa0 con 0x7f801406fa10 2024-04-25T16:01:07.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f800bfff640 1 -- 172.21.15.87:0/1833747749 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7f8004016050 con 0x7f801406fa10 2024-04-25T16:01:07.205 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7ff406f400 msgr2=0x7f7ff4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7ff406f400 0x7f7ff4071910 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a750 tx=0x7f7ffc008040 comp rx=0 tx=0).stop 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 msgr2=0x7f80141f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 0x7f80141f0f60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f80040af040 tx=0x7f800401aca0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 shutdown_connections 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f7ff406f400 0x7f7ff4071910 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80141518b0 0x7f801414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80140ad160 0x7f80141efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 --2- 172.21.15.87:0/1833747749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f801406fa10 0x7f80141f0f60 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 >> 172.21.15.87:0/1833747749 conn(0x7f80140c8770 msgr2=0x7f80140c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:07.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 shutdown_connections 2024-04-25T16:01:07.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.205+0000 7f8019346640 1 -- 172.21.15.87:0/1833747749 wait complete. 2024-04-25T16:01:07.228 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-25T16:01:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd174b4640 1 Processor -- start 2024-04-25T16:01:07.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd174b4640 1 -- start start 2024-04-25T16:01:07.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd174b4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 0x7fdd10071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd174b4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd100ae1b0 con 0x7fdd100adda0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd174b4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd10072430 con 0x7fdd100ad990 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd174b4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd10074730 con 0x7fdd101529a0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd15a51640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdd100adda0 0x7fdd100c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48008/0 (socket says 172.21.15.87:48008) 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd15a51640 1 -- 172.21.15.87:0/2350561488 learned_addr learned my addr 172.21.15.87:0/2350561488 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261331404 0 0) 0x7fdd100ae1b0 con 0x7fdd100adda0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd15250640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 0x7fdd10071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcf8003530 con 0x7fdd100adda0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3620077341 0 0) 0x7fdcf8003530 con 0x7fdd100adda0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 msgr2=0x7fdd10071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 0x7fdd10071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 >> v1:172.21.15.155:6789/0 conn(0x7fdd100ad990 legacy=0x7fdd100c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd10074a10 con 0x7fdd100adda0 2024-04-25T16:01:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fdd08001680 con 0x7fdd100adda0 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd15250640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 0x7fdd10071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 >> v1:172.21.15.87:6789/0 conn(0x7fdd100adda0 legacy=0x7fdd100c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcf80039f0 0x7fdcf8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcf8004810 0x7fdcf8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 0x7fdcf800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10074730 con 0x7fdcf8004810 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf8005560 con 0x7fdcf80039f0 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf800bf10 con 0x7fdd101529a0 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcf8004810 0x7fdcf8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd15250640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcf80039f0 0x7fdcf8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd14a4f640 1 -- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 msgr2=0x7fdcf800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd101529a0 0x7fdcf800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd14a4f640 1 -- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcf80039f0 msgr2=0x7fdcf8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcf80039f0 0x7fdcf8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.381+0000 7fdd14a4f640 1 -- 172.21.15.87:0/2350561488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf8003530 con 0x7fdcf8004810 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcf8004810 0x7fdcf8004c20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001750 tx=0x7fdd0401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52850b1def5e500 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040013a0 con 0x7fdcf8004810 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040052f0 con 0x7fdcf8004810 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd0ffff640 1 -- 172.21.15.87:0/2350561488 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04003840 con 0x7fdcf8004810 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd174b4640 1 -- 172.21.15.87:0/2350561488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcf8004810 msgr2=0x7fdcf8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd174b4640 1 --2- 172.21.15.87:0/2350561488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcf8004810 0x7fdcf8004c20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001750 tx=0x7fdd0401c3e0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd15a51640 1 -- 172.21.15.87:0/2350561488 reap_dead start 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd174b4640 1 -- 172.21.15.87:0/2350561488 shutdown_connections 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd174b4640 1 -- 172.21.15.87:0/2350561488 >> 172.21.15.87:0/2350561488 conn(0x7fdd100c8770 msgr2=0x7fdd100c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:07.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd174b4640 1 -- 172.21.15.87:0/2350561488 shutdown_connections 2024-04-25T16:01:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.385+0000 7fdd174b4640 1 -- 172.21.15.87:0/2350561488 wait complete. 2024-04-25T16:01:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 Processor -- start 2024-04-25T16:01:07.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 -- start start 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcf8004810 0x7fdd10154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 0x7fdd10148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1006f1a0 0x7fdd1006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10161470 con 0x7fdd10159380 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101612f0 con 0x7fdd1006f1a0 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd101615f0 con 0x7fdcf8004810 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 0x7fdd10148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 0x7fdd10148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45400/0 (socket says 172.21.15.87:45400) 2024-04-25T16:01:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 -- 172.21.15.87:0/3380183625 learned_addr learned my addr 172.21.15.87:0/3380183625 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd15a51640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1006f1a0 0x7fdd1006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd15250640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcf8004810 0x7fdd10154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 -- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcf8004810 msgr2=0x7fdd10154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcf8004810 0x7fdd10154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 -- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1006f1a0 msgr2=0x7fdd1006f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1006f1a0 0x7fdd1006f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 -- 172.21.15.87:0/3380183625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd101f32e0 con 0x7fdd10159380 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd14a4f640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 0x7fdd10148ae0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdd04005040 tx=0x7fdcf8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04007a40 con 0x7fdd10159380 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040bb070 con 0x7fdd10159380 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040013a0 con 0x7fdd10159380 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1015fc30 con 0x7fdd10159380 2024-04-25T16:01:07.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.389+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd101601f0 con 0x7fdd10159380 2024-04-25T16:01:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.393+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd10069bb0 con 0x7fdd10159380 2024-04-25T16:01:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.393+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdd040b4040 con 0x7fdd10159380 2024-04-25T16:01:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.393+0000 7fdd0dffb640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdcfc06f400 0x7fdcfc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.393+0000 7fdd15250640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdcfc06f400 0x7fdcfc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.393+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fdd0412a3a0 con 0x7fdd10159380 2024-04-25T16:01:07.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.393+0000 7fdd15250640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdcfc06f400 0x7fdcfc071910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdd10073d40 tx=0x7fdd0000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.397+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd040160f0 con 0x7fdd10159380 2024-04-25T16:01:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.557+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fdd100c2710 con 0x7fdd10159380 2024-04-25T16:01:07.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.557+0000 7fdd0dffb640 1 -- 172.21.15.87:0/3380183625 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7fdd040f6d50 con 0x7fdd10159380 2024-04-25T16:01:07.558 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:01:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdcfc06f400 msgr2=0x7fdcfc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdcfc06f400 0x7fdcfc071910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdd10073d40 tx=0x7fdd0000b040 comp rx=0 tx=0).stop 2024-04-25T16:01:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 msgr2=0x7fdd10148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 0x7fdd10148ae0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdd04005040 tx=0x7fdcf8005840 comp rx=0 tx=0).stop 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 shutdown_connections 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fdcfc06f400 0x7fdcfc071910 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd1006f1a0 0x7fdd1006f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd10159380 0x7fdd10148ae0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 --2- 172.21.15.87:0/3380183625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcf8004810 0x7fdd10154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 >> 172.21.15.87:0/3380183625 conn(0x7fdd100c8770 msgr2=0x7fdd101515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 shutdown_connections 2024-04-25T16:01:07.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.561+0000 7fdd174b4640 1 -- 172.21.15.87:0/3380183625 wait complete. 2024-04-25T16:01:07.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-25T16:01:07.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4baea98640 1 Processor -- start 2024-04-25T16:01:07.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4baea98640 1 -- start start 2024-04-25T16:01:07.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4baea98640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4ba8071e50 0x7f4ba80c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4baea98640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba8072430 con 0x7f4ba80c4720 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4baea98640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba8074730 con 0x7f4ba81529a0 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4baea98640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba8074a10 con 0x7f4ba8071e50 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bad035640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4ba80c4720 0x7f4ba815fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48010/0 (socket says 172.21.15.87:48010) 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bad035640 1 -- 172.21.15.87:0/1113542996 learned_addr learned my addr 172.21.15.87:0/1113542996 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/1113542996 >> v2:172.21.15.155:3300/0 conn(0x7f4ba8071e50 0x7f4ba80c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105373378 0 0) 0x7f4ba8072430 con 0x7f4ba80c4720 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b98003530 con 0x7f4ba80c4720 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2204599793 0 0) 0x7f4b98003530 con 0x7f4ba80c4720 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 >> v2:172.21.15.155:3300/0 conn(0x7f4ba8071e50 msgr2=0x7f4ba80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 --2- 172.21.15.87:0/1113542996 >> v2:172.21.15.155:3300/0 conn(0x7f4ba8071e50 0x7f4ba80c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 >> v1:172.21.15.155:6789/0 conn(0x7f4ba81529a0 legacy=0x7f4ba80ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba8074cf0 con 0x7f4ba80c4720 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f4ba0001a00 con 0x7f4ba80c4720 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 >> v1:172.21.15.87:6789/0 conn(0x7f4ba80c4720 legacy=0x7f4ba815fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b980039c0 0x7f4b98003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b98004810 0x7f4b98004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98005260 0x7f4b9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8074a10 con 0x7f4b98004810 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9800c1f0 con 0x7f4b98005260 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9800c3f0 con 0x7f4b980039c0 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b98004810 0x7f4b98004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bac834640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b980039c0 0x7f4b98003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bad035640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98005260 0x7f4b9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 -- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b980039c0 msgr2=0x7f4b98003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b980039c0 0x7f4b98003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 -- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98005260 msgr2=0x7f4b9800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98005260 0x7f4b9800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4ba7fff640 1 -- 172.21.15.87:0/1113542996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b98003530 con 0x7f4b98004810 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bac834640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b980039c0 0x7f4b98003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bad035640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98005260 0x7f4b9800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:07.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.721+0000 7f4bad035640 1 -- 172.21.15.87:0/1113542996 reap_dead start 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b98004810 0x7f4b98004c20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4ba806daf0 tx=0x7f4b9401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b8736cc264e7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940096b0 con 0x7f4b98004810 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b940a8450 con 0x7f4b98004810 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4ba77fe640 1 -- 172.21.15.87:0/1113542996 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940a8840 con 0x7f4b98004810 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 -- 172.21.15.87:0/1113542996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b98004810 msgr2=0x7f4b98004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b98004810 0x7f4b98004c20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4ba806daf0 tx=0x7f4b9401ca10 comp rx=0 tx=0).stop 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 -- 172.21.15.87:0/1113542996 shutdown_connections 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 --2- 172.21.15.87:0/1113542996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b98004810 0x7f4b98004c20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 -- 172.21.15.87:0/1113542996 >> 172.21.15.87:0/1113542996 conn(0x7f4ba80c8770 msgr2=0x7f4ba80c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:07.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 -- 172.21.15.87:0/1113542996 shutdown_connections 2024-04-25T16:01:07.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 -- 172.21.15.87:0/1113542996 wait complete. 2024-04-25T16:01:07.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 Processor -- start 2024-04-25T16:01:07.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.725+0000 7f4baea98640 1 -- start start 2024-04-25T16:01:07.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98004810 0x7f4ba80bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ba8148950 0x7f4ba81efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 0x7f4ba81f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8158b30 con 0x7f4ba81f2110 2024-04-25T16:01:07.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81589b0 con 0x7f4b98004810 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba8158cb0 con 0x7f4ba8148950 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 0x7f4ba81f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 0x7f4ba81f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45410/0 (socket says 172.21.15.87:45410) 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 -- 172.21.15.87:0/3730116096 learned_addr learned my addr 172.21.15.87:0/3730116096 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bac834640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98004810 0x7f4ba80bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ba8148950 0x7f4ba81efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 -- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ba8148950 msgr2=0x7f4ba81efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ba8148950 0x7f4ba81efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 -- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98004810 msgr2=0x7f4ba80bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98004810 0x7f4ba80bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 -- 172.21.15.87:0/3730116096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba814a1e0 con 0x7f4ba81f2110 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4ba7fff640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ba8148950 0x7f4ba81efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:07.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4bad035640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 0x7f4ba81f2520 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80753b0 tx=0x7f4ba000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0004d70 con 0x7f4ba81f2110 2024-04-25T16:01:07.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba000bb20 con 0x7f4ba81f2110 2024-04-25T16:01:07.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0007070 con 0x7f4ba81f2110 2024-04-25T16:01:07.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba8148650 con 0x7f4ba81f2110 2024-04-25T16:01:07.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba8149cc0 con 0x7f4ba81f2110 2024-04-25T16:01:07.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.729+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba81f2a60 con 0x7f4ba81f2110 2024-04-25T16:01:07.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.733+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4ba001b020 con 0x7f4ba81f2110 2024-04-25T16:01:07.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.733+0000 7f4ba57fa640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b8c06f430 0x7f4b8c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:07.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.733+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f4ba008f950 con 0x7f4ba81f2110 2024-04-25T16:01:07.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.733+0000 7f4bac834640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b8c06f430 0x7f4b8c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:07.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.733+0000 7f4bac834640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b8c06f430 0x7f4b8c071940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c10 tx=0x7f4b9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:07.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.737+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ba005c190 con 0x7f4ba81f2110 2024-04-25T16:01:07.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.885+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f4ba8149ab0 con 0x7f4ba81f2110 2024-04-25T16:01:07.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.885+0000 7f4ba57fa640 1 -- 172.21.15.87:0/3730116096 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7f4ba0064180 con 0x7f4ba81f2110 2024-04-25T16:01:07.885 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:01:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b8c06f430 msgr2=0x7f4b8c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b8c06f430 0x7f4b8c071940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c10 tx=0x7f4b9c009040 comp rx=0 tx=0).stop 2024-04-25T16:01:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 msgr2=0x7f4ba81f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 0x7f4ba81f2520 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80753b0 tx=0x7f4ba000b4a0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 shutdown_connections 2024-04-25T16:01:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f4b8c06f430 0x7f4b8c071940 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ba81f2110 0x7f4ba81f2520 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ba8148950 0x7f4ba81efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 --2- 172.21.15.87:0/3730116096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b98004810 0x7f4ba80bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 >> 172.21.15.87:0/3730116096 conn(0x7f4ba80c8770 msgr2=0x7f4ba814e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 shutdown_connections 2024-04-25T16:01:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:07.889+0000 7f4baea98640 1 -- 172.21.15.87:0/3730116096 wait complete. 2024-04-25T16:01:07.907 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-25T16:01:08.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.057+0000 7f8d34f68640 1 Processor -- start 2024-04-25T16:01:08.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.057+0000 7f8d34f68640 1 -- start start 2024-04-25T16:01:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d34f68640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d301529a0 0x7f8d30071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d34f68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d300ad990 0x7f8d300adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d34f68640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d30072430 con 0x7f8d300c41e0 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d34f68640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8d30074730 con 0x7f8d301529a0 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d34f68640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d30074a10 con 0x7f8d300ad990 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2e59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d301529a0 0x7f8d30071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d300ad990 0x7f8d300adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d300ad990 0x7f8d300adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:46346/0 (socket says 172.21.15.87:46346) 2024-04-25T16:01:08.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2dd9b640 1 -- 172.21.15.87:0/3719915018 learned_addr learned my addr 172.21.15.87:0/3719915018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:08.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2e59c640 1 -- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d300ad990 msgr2=0x7f8d300adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:08.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2e59c640 1 --2- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d300ad990 0x7f8d300adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2e59c640 1 -- 172.21.15.87:0/3719915018 >> v1:172.21.15.155:6789/0 conn(0x7f8d300c41e0 legacy=0x7f8d300c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.061+0000 7f8d2e59c640 1 -- 172.21.15.87:0/3719915018 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d30074cf0 con 0x7f8d301529a0 2024-04-25T16:01:08.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d2e59c640 1 --2- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d301529a0 0x7f8d30071e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8d200097c0 tx=0x7f8d2001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99aed11ce1c3d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d2d59a640 1 -- 172.21.15.87:0/3719915018 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d200b0070 con 0x7f8d301529a0 2024-04-25T16:01:08.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d2d59a640 1 -- 172.21.15.87:0/3719915018 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d200ab600 con 0x7f8d301529a0 2024-04-25T16:01:08.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d2d59a640 1 -- 172.21.15.87:0/3719915018 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d200ab9d0 con 0x7f8d301529a0 2024-04-25T16:01:08.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 -- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d301529a0 msgr2=0x7f8d30071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 --2- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d301529a0 0x7f8d30071e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8d200097c0 tx=0x7f8d2001c410 comp rx=0 tx=0).stop 2024-04-25T16:01:08.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 -- 172.21.15.87:0/3719915018 shutdown_connections 2024-04-25T16:01:08.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 --2- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d300ad990 0x7f8d300adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 --2- 172.21.15.87:0/3719915018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d301529a0 0x7f8d30071e50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 -- 172.21.15.87:0/3719915018 >> 172.21.15.87:0/3719915018 conn(0x7f8d300c8770 msgr2=0x7f8d300c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:08.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 -- 172.21.15.87:0/3719915018 shutdown_connections 2024-04-25T16:01:08.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 -- 172.21.15.87:0/3719915018 wait complete. 2024-04-25T16:01:08.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.065+0000 7f8d34f68640 1 Processor -- start 2024-04-25T16:01:08.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- start start 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300ad990 0x7f8d3014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 0x7f8d300c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d301f1880 0x7f8d3013fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d30162470 con 0x7f8d300c41e0 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301622f0 con 0x7f8d300ad990 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d301625f0 con 0x7f8d301f1880 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 0x7f8d300c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 0x7f8d300c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45412/0 (socket says 172.21.15.87:45412) 2024-04-25T16:01:08.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 -- 172.21.15.87:0/2963426492 learned_addr learned my addr 172.21.15.87:0/2963426492 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2ed9d640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d301f1880 0x7f8d3013fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2e59c640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300ad990 0x7f8d3014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 -- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d301f1880 msgr2=0x7f8d3013fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d301f1880 0x7f8d3013fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 -- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300ad990 msgr2=0x7f8d3014e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300ad990 0x7f8d3014e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 -- 172.21.15.87:0/2963426492 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300c6420 con 0x7f8d300c41e0 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2ed9d640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d301f1880 0x7f8d3013fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d2dd9b640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 0x7f8d300c5ee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e870 tx=0x7f8d1800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18017070 con 0x7f8d300c41e0 2024-04-25T16:01:08.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1800c940 con 0x7f8d300c41e0 2024-04-25T16:01:08.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d300c83a0 con 0x7f8d300c41e0 2024-04-25T16:01:08.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800cd10 con 0x7f8d300c41e0 2024-04-25T16:01:08.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3014dd30 con 0x7f8d300c41e0 2024-04-25T16:01:08.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.069+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d30069bb0 con 0x7f8d300c41e0 2024-04-25T16:01:08.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.073+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d1801a070 con 0x7f8d300c41e0 2024-04-25T16:01:08.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.073+0000 7f8d26ffd640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1006f400 0x7f8d10071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.073+0000 7f8d2e59c640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1006f400 0x7f8d10071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.073+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f8d1808fdb0 con 0x7f8d300c41e0 2024-04-25T16:01:08.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.073+0000 7f8d2e59c640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1006f400 0x7f8d10071910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ad000 tx=0x7f8d200a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.077+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d18094070 con 0x7f8d300c41e0 2024-04-25T16:01:08.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.237+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f8d30141170 con 0x7f8d300c41e0 2024-04-25T16:01:08.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.237+0000 7f8d26ffd640 1 -- 172.21.15.87:0/2963426492 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v36) ==== 99+0+11 (secure 0 0 0) 0x7f8d1805c440 con 0x7f8d300c41e0 2024-04-25T16:01:08.238 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-04-25T16:01:08.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1006f400 msgr2=0x7f8d10071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1006f400 0x7f8d10071910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ad000 tx=0x7f8d200a6000 comp rx=0 tx=0).stop 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 msgr2=0x7f8d300c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 0x7f8d300c5ee0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e870 tx=0x7f8d1800ed30 comp rx=0 tx=0).stop 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 shutdown_connections 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8d1006f400 0x7f8d10071910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d301f1880 0x7f8d3013fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d300c41e0 0x7f8d300c5ee0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 --2- 172.21.15.87:0/2963426492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d300ad990 0x7f8d3014e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 >> 172.21.15.87:0/2963426492 conn(0x7f8d300c8770 msgr2=0x7f8d300c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 shutdown_connections 2024-04-25T16:01:08.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.241+0000 7f8d34f68640 1 -- 172.21.15.87:0/2963426492 wait complete. 2024-04-25T16:01:08.261 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-25T16:01:08.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 Processor -- start 2024-04-25T16:01:08.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 -- start start 2024-04-25T16:01:08.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b0c0a8cc0 0x7f9b0c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c06c670 0x7f9b0c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c152c80 con 0x7f9b0c152870 2024-04-25T16:01:08.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c0aebc0 con 0x7f9b0c0a8cc0 2024-04-25T16:01:08.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b115fe640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c158f20 con 0x7f9b0c06c670 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b0c0a8cc0 0x7f9b0c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9b0c0a8cc0 0x7f9b0c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45414/0 (socket says 172.21.15.87:45414) 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 -- 172.21.15.87:0/853533034 learned_addr learned my addr 172.21.15.87:0/853533034 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0b7fe640 1 --2- 172.21.15.87:0/853533034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c06c670 0x7f9b0c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 -- 172.21.15.87:0/853533034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c06c670 msgr2=0x7f9b0c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 --2- 172.21.15.87:0/853533034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c06c670 0x7f9b0c06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 -- 172.21.15.87:0/853533034 >> v1:172.21.15.155:6789/0 conn(0x7f9b0c152870 legacy=0x7f9b0c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:08.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.413+0000 7f9b0affd640 1 -- 172.21.15.87:0/853533034 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c0ae8e0 con 0x7f9b0c0a8cc0 2024-04-25T16:01:08.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b0affd640 1 --2- 172.21.15.87:0/853533034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c1593b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0c60a0 tx=0x7f9afc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0626e07dac6f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b09ffb640 1 -- 172.21.15.87:0/853533034 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0b0070 con 0x7f9b0c0a8cc0 2024-04-25T16:01:08.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b09ffb640 1 -- 172.21.15.87:0/853533034 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0ab600 con 0x7f9b0c0a8cc0 2024-04-25T16:01:08.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b09ffb640 1 -- 172.21.15.87:0/853533034 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0ab9d0 con 0x7f9b0c0a8cc0 2024-04-25T16:01:08.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 -- 172.21.15.87:0/853533034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c0a8cc0 msgr2=0x7f9b0c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 --2- 172.21.15.87:0/853533034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c1593b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0c60a0 tx=0x7f9afc01c3b0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 -- 172.21.15.87:0/853533034 shutdown_connections 2024-04-25T16:01:08.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 --2- 172.21.15.87:0/853533034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c06c670 0x7f9b0c06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 --2- 172.21.15.87:0/853533034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c1593b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 -- 172.21.15.87:0/853533034 >> 172.21.15.87:0/853533034 conn(0x7f9b0c06d780 msgr2=0x7f9b0c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:08.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 -- 172.21.15.87:0/853533034 shutdown_connections 2024-04-25T16:01:08.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.417+0000 7f9b115fe640 1 -- 172.21.15.87:0/853533034 wait complete. 2024-04-25T16:01:08.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 Processor -- start 2024-04-25T16:01:08.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 -- start start 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 0x7f9b0c1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c152870 0x7f9b0c0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0ac870 con 0x7f9b0c06c670 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0ac6f0 con 0x7f9b0c0a8cc0 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c1623e0 con 0x7f9b0c152870 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 0x7f9b0c1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 0x7f9b0c1f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45416/0 (socket says 172.21.15.87:45416) 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 -- 172.21.15.87:0/1070891321 learned_addr learned my addr 172.21.15.87:0/1070891321 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:08.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0a7fc640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0b7fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c152870 0x7f9b0c0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 -- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c152870 msgr2=0x7f9b0c0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c152870 0x7f9b0c0c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 -- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b0c0a8cc0 msgr2=0x7f9b0c154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 -- 172.21.15.87:0/1070891321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c0744b0 con 0x7f9b0c06c670 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b0affd640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 0x7f9b0c1f4560 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0ae040 tx=0x7f9afc01abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0ba020 con 0x7f9b0c06c670 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc0b6420 con 0x7f9b0c06c670 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0b0040 con 0x7f9b0c06c670 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c14e1e0 con 0x7f9b0c06c670 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.421+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c1f3d60 con 0x7f9b0c06c670 2024-04-25T16:01:08.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.425+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c069bb0 con 0x7f9b0c06c670 2024-04-25T16:01:08.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.425+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9afc0bd020 con 0x7f9b0c06c670 2024-04-25T16:01:08.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.425+0000 7f9af37fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9af806f400 0x7f9af8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.425+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f9afc12a560 con 0x7f9b0c06c670 2024-04-25T16:01:08.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.425+0000 7f9b0a7fc640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9af806f400 0x7f9af8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.425+0000 7f9b0a7fc640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9af806f400 0x7f9af8071910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0ac6c0 tx=0x7f9b00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.429+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9afc0c4030 con 0x7f9b0c06c670 2024-04-25T16:01:08.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.585+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f9b0c070890 con 0x7f9b0c06c670 2024-04-25T16:01:08.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9af37fe640 1 -- 172.21.15.87:0/1070891321 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v36) ==== 95+0+11 (secure 0 0 0) 0x7f9afc0fde20 con 0x7f9b0c06c670 2024-04-25T16:01:08.588 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9af806f400 msgr2=0x7f9af8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9af806f400 0x7f9af8071910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0ac6c0 tx=0x7f9b00008040 comp rx=0 tx=0).stop 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 msgr2=0x7f9b0c1f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 0x7f9b0c1f4560 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0ae040 tx=0x7f9afc01abf0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 shutdown_connections 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9af806f400 0x7f9af8071910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b0c152870 0x7f9b0c0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b0c0a8cc0 0x7f9b0c154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 --2- 172.21.15.87:0/1070891321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b0c06c670 0x7f9b0c1f4560 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 >> 172.21.15.87:0/1070891321 conn(0x7f9b0c06d780 msgr2=0x7f9b0c156450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 shutdown_connections 2024-04-25T16:01:08.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.589+0000 7f9b115fe640 1 -- 172.21.15.87:0/1070891321 wait complete. 2024-04-25T16:01:08.610 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T16:01:08.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85f7f2640 1 Processor -- start 2024-04-25T16:01:08.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85f7f2640 1 -- start start 2024-04-25T16:01:08.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85f7f2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb858158e10 0x7fb858152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85f7f2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb858063660 con 0x7fb858158a00 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85f7f2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580ab670 con 0x7fb858152bc0 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85f7f2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb8580c5470 con 0x7fb858158e10 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85d58e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb858158a00 0x7fb8580ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48022/0 (socket says 172.21.15.87:48022) 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85d58e640 1 -- 172.21.15.87:0/821968314 learned_addr learned my addr 172.21.15.87:0/821968314 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85cd8d640 1 --2- 172.21.15.87:0/821968314 >> v2:172.21.15.155:3300/0 conn(0x7fb858158e10 0x7fb858152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994451284 0 0) 0x7fb858063660 con 0x7fb858158a00 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb844003530 con 0x7fb858158a00 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161059146 0 0) 0x7fb844003530 con 0x7fb858158a00 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 >> v2:172.21.15.155:3300/0 conn(0x7fb858158e10 msgr2=0x7fb858152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 --2- 172.21.15.87:0/821968314 >> v2:172.21.15.155:3300/0 conn(0x7fb858158e10 0x7fb858152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 >> v1:172.21.15.155:6789/0 conn(0x7fb858152bc0 legacy=0x7fb85815fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8580ab930 con 0x7fb858158a00 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb8540016a0 con 0x7fb858158a00 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 >> v1:172.21.15.87:6789/0 conn(0x7fb858158a00 legacy=0x7fb8580ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8440039c0 0x7fb844003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844004810 0x7fb844004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb844005280 0x7fb84400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580c5470 con 0x7fb844005280 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb84400c210 con 0x7fb844004810 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb84400c410 con 0x7fb8440039c0 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.753+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb844005280 0x7fb84400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85cd8d640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844004810 0x7fb844004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85d58e640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8440039c0 0x7fb844003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 -- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8440039c0 msgr2=0x7fb844003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:08.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8440039c0 0x7fb844003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 -- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844004810 msgr2=0x7fb844004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:08.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844004810 0x7fb844004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 -- 172.21.15.87:0/821968314 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb844003530 con 0x7fb844005280 2024-04-25T16:01:08.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85d58e640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8440039c0 0x7fb844003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:08.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 -- 172.21.15.87:0/821968314 reap_dead start 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb844005280 0x7fb84400b9d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb850001e70 tx=0x7fb85001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2ccf2d48f8892e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850001a90 con 0x7fb844005280 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb850003bc0 con 0x7fb844005280 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb84ffff640 1 -- 172.21.15.87:0/821968314 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500050d0 con 0x7fb844005280 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 -- 172.21.15.87:0/821968314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb844005280 msgr2=0x7fb84400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb844005280 0x7fb84400b9d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb850001e70 tx=0x7fb85001c780 comp rx=0 tx=0).stop 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 -- 172.21.15.87:0/821968314 shutdown_connections 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/821968314 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb844005280 0x7fb84400b9d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 -- 172.21.15.87:0/821968314 >> 172.21.15.87:0/821968314 conn(0x7fb85806d650 msgr2=0x7fb8580c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 -- 172.21.15.87:0/821968314 shutdown_connections 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.757+0000 7fb85f7f2640 1 -- 172.21.15.87:0/821968314 wait complete. 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 Processor -- start 2024-04-25T16:01:08.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- start start 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb844005280 0x7fb85814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8581e0330 0x7fb8581e0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 0x7fb8581eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb85806de30 con 0x7fb8581ee810 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580634c0 con 0x7fb8581e0330 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb8580ad1e0 con 0x7fb844005280 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 0x7fb8581eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 0x7fb8581eec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45430/0 (socket says 172.21.15.87:45430) 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 -- 172.21.15.87:0/2529789479 learned_addr learned my addr 172.21.15.87:0/2529789479 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85cd8d640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8581e0330 0x7fb8581e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85d58e640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb844005280 0x7fb85814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 -- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb844005280 msgr2=0x7fb85814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb844005280 0x7fb85814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 -- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8581e0330 msgr2=0x7fb8581e0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8581e0330 0x7fb8581e0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 -- 172.21.15.87:0/2529789479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858155740 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85cd8d640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8581e0330 0x7fb8581e0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85d58e640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb844005280 0x7fb85814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85dd8f640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 0x7fb8581eec20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb8500980b0 tx=0x7fb844005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500ae070 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500012e0 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85814ae00 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850007dc0 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8580c7b40 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.761+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858069bb0 con 0x7fb8581ee810 2024-04-25T16:01:08.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.765+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb8500050d0 con 0x7fb8581ee810 2024-04-25T16:01:08.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.765+0000 7fb84dffb640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb83c06f430 0x7fb83c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:08.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.765+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fb8501289e0 con 0x7fb8581ee810 2024-04-25T16:01:08.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.765+0000 7fb85d58e640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb83c06f430 0x7fb83c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:08.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.765+0000 7fb85d58e640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb83c06f430 0x7fb83c071940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb858063830 tx=0x7fb854009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:08.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.769+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb850016490 con 0x7fb8581ee810 2024-04-25T16:01:08.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb858151ec0 con 0x7fb8581ee810 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb84dffb640 1 -- 172.21.15.87:0/2529789479 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 20 entries v36) ==== 81+0+1226 (secure 0 0 0) 0x7fb8500f5190 con 0x7fb8581ee810 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/4111430078 2024-04-26T16:00:09.300147+0000 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6835/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:01:08.929 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2742361177 2024-04-26T15:55:34.243698+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6837/4061291849 2024-04-26T15:57:54.268614+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6835/2324940240 2024-04-26T15:55:14.236207+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6834/1293807006 2024-04-26T15:58:04.272003+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/1039729746 2024-04-26T15:56:59.258623+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6833/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/3802722727 2024-04-26T16:00:43.549129+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6832/2576881209 2024-04-26T15:59:24.289438+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6836/2477874160 2024-04-26T16:00:24.304082+0000 2024-04-25T16:01:08.930 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.155:6834/630698588 2024-04-26T15:59:34.292729+0000 2024-04-25T16:01:08.931 INFO:teuthology.orchestra.run.smithi087.stderr:listed 20 entries 2024-04-25T16:01:08.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb83c06f430 msgr2=0x7fb83c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb83c06f430 0x7fb83c071940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb858063830 tx=0x7fb854009040 comp rx=0 tx=0).stop 2024-04-25T16:01:08.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 msgr2=0x7fb8581eec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 0x7fb8581eec20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb8500980b0 tx=0x7fb844005840 comp rx=0 tx=0).stop 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 shutdown_connections 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb83c06f430 0x7fb83c071940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8581ee810 0x7fb8581eec20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8581e0330 0x7fb8581e0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 --2- 172.21.15.87:0/2529789479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb844005280 0x7fb85814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 >> 172.21.15.87:0/2529789479 conn(0x7fb85806d650 msgr2=0x7fb858156520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 shutdown_connections 2024-04-25T16:01:08.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:08.929+0000 7fb85f7f2640 1 -- 172.21.15.87:0/2529789479 wait complete. 2024-04-25T16:01:08.951 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-04-25T16:01:08.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:08.951 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-25T16:01:09.026 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:01:09.026 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi155.stderr:ceph-fuse[33195]: fuse finished with error 0 and tester_r 0 2024-04-25T16:01:10.568 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:10.571 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:15.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T16:01:15.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.128 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T16:01:15.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.221 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T16:01:15.227 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T16:01:15.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.227 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T16:01:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.283 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-25T16:01:15.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.473 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-25T16:01:15.479 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T16:01:15.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T16:01:15.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T16:01:15.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-04-25T16:01:15.726 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T16:01:15.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T16:01:15.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:01:15.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 Processor -- start 2024-04-25T16:01:15.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 -- start start 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb8c1529a0 0x7ffb8c071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c0adda0 0x7ffb8c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c0c4e30 con 0x7ffb8c0ad990 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8c0ae1b0 con 0x7ffb8c1529a0 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb90ffc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8c072430 con 0x7ffb8c0adda0 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8a59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb8c1529a0 0x7ffb8c071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb89d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffb8c0ad990 0x7ffb8c0c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44324/0 (socket says 172.21.15.87:44324) 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8a59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb8c1529a0 0x7ffb8c071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51682/0 (socket says 172.21.15.87:51682) 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb89d9b640 1 -- 172.21.15.87:0/1992151143 learned_addr learned my addr 172.21.15.87:0/1992151143 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:15.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1992151143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c0adda0 msgr2=0x7ffb8c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8ad9d640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c0adda0 0x7ffb8c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8a59c640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c0adda0 0x7ffb8c0c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8959a640 1 -- 172.21.15.87:0/1992151143 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203164775 0 0) 0x7ffb80001120 con 0x7ffb8c0ad990 2024-04-25T16:01:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1992151143 >> v1:172.21.15.87:6789/0 conn(0x7ffb8c0ad990 legacy=0x7ffb8c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1992151143 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c074730 con 0x7ffb8c1529a0 2024-04-25T16:01:15.896 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.892+0000 7ffb8ad9d640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c0adda0 0x7ffb8c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb8a59c640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c1529a0 0x7ffb8c071e50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0097c0 tx=0x7ffb7c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea46dde2fc0b0f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb8959a640 1 -- 172.21.15.87:0/1992151143 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0b0070 con 0x7ffb8c1529a0 2024-04-25T16:01:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb8959a640 1 -- 172.21.15.87:0/1992151143 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0ab600 con 0x7ffb8c1529a0 2024-04-25T16:01:15.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb8959a640 1 -- 172.21.15.87:0/1992151143 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0ab9d0 con 0x7ffb8c1529a0 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1992151143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c1529a0 msgr2=0x7ffb8c071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c1529a0 0x7ffb8c071e50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0097c0 tx=0x7ffb7c01c410 comp rx=0 tx=0).stop 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1992151143 shutdown_connections 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c0adda0 0x7ffb8c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1992151143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c1529a0 0x7ffb8c071e50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1992151143 >> 172.21.15.87:0/1992151143 conn(0x7ffb8c0c8770 msgr2=0x7ffb8c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1992151143 shutdown_connections 2024-04-25T16:01:15.898 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.896+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1992151143 wait complete. 2024-04-25T16:01:15.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 Processor -- start 2024-04-25T16:01:15.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- start start 2024-04-25T16:01:15.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 0x7ffb8c159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:15.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0adda0 0x7ffb8c14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:15.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c1529a0 0x7ffb8c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:15.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c1622f0 con 0x7ffb8c0ad990 2024-04-25T16:01:15.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c0ab1a0 con 0x7ffb8c0adda0 2024-04-25T16:01:15.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8c162470 con 0x7ffb8c1529a0 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 0x7ffb8c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 0x7ffb8c159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51690/0 (socket says 172.21.15.87:51690) 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1624588711 learned_addr learned my addr 172.21.15.87:0/1624588711 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb89d9b640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0adda0 0x7ffb8c14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8ad9d640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c1529a0 0x7ffb8c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c1529a0 msgr2=0x7ffb8c1f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c1529a0 0x7ffb8c1f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0adda0 msgr2=0x7ffb8c14e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0adda0 0x7ffb8c14e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 -- 172.21.15.87:0/1624588711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c1f2610 con 0x7ffb8c0ad990 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb89d9b640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0adda0 0x7ffb8c14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb8a59c640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 0x7ffb8c159170 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0ae040 tx=0x7ffb7c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0b0050 con 0x7ffb8c0ad990 2024-04-25T16:01:15.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0bc070 con 0x7ffb8c0ad990 2024-04-25T16:01:15.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c1f28f0 con 0x7ffb8c0ad990 2024-04-25T16:01:15.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0b5a70 con 0x7ffb8c0ad990 2024-04-25T16:01:15.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c156d00 con 0x7ffb8c0ad990 2024-04-25T16:01:15.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.900+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8c069bb0 con 0x7ffb8c0ad990 2024-04-25T16:01:15.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.904+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb7c0ab4c0 con 0x7ffb8c0ad990 2024-04-25T16:01:15.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.904+0000 7ffb7affd640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb6c06f430 0x7ffb6c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:15.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.904+0000 7ffb89d9b640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb6c06f430 0x7ffb6c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:15.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.904+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7ffb7c12a320 con 0x7ffb8c0ad990 2024-04-25T16:01:15.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.904+0000 7ffb89d9b640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb6c06f430 0x7ffb6c071940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0c2930 tx=0x7ffb80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:15.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:15.908+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb7c016090 con 0x7ffb8c0ad990 2024-04-25T16:01:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.068+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb8c1596b0 con 0x7ffb6c06f430 2024-04-25T16:01:16.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.088+0000 7ffb7affd640 1 -- 172.21.15.87:0/1624588711 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494241 (secure 0 0 0) 0x7ffb8c1596b0 con 0x7ffb6c06f430 2024-04-25T16:01:16.093 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:16.097 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb6c06f430 msgr2=0x7ffb6c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb6c06f430 0x7ffb6c071940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0c2930 tx=0x7ffb80009040 comp rx=0 tx=0).stop 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 msgr2=0x7ffb8c159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 0x7ffb8c159170 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0ae040 tx=0x7ffb7c01ac50 comp rx=0 tx=0).stop 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 shutdown_connections 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb6c06f430 0x7ffb6c071940 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb8c1529a0 0x7ffb8c1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0adda0 0x7ffb8c14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 --2- 172.21.15.87:0/1624588711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb8c0ad990 0x7ffb8c159170 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 >> 172.21.15.87:0/1624588711 conn(0x7ffb8c0c8770 msgr2=0x7ffb8c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 shutdown_connections 2024-04-25T16:01:16.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.092+0000 7ffb90ffc640 1 -- 172.21.15.87:0/1624588711 wait complete. 2024-04-25T16:01:16.115 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-25T16:01:15.277899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269198364,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7045,"num_read_kb":3737333,"num_write":65538,"num_write_kb":9067848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71569,"ondisk_log_size":71569,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1176528,"kb_used_data":529040,"kb_used_omap":12,"kb_used_meta":647411,"kb_avail":753798192,"statfs":{"total":773094113280,"available":771889348608,"internally_reserved":0,"allocated":541736960,"data_stored":539899168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":662949425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":189,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006109"},"pg_stats":[{"pgid":"5.18","version":"31'448","reported_seq":541,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560090+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T16:00:43.560090+0000","last_peered":"2024-04-25T16:00:43.560090+0000","last_clean":"2024-04-25T16:00:43.560090+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T16:00:43.560090+0000","last_undegraded":"2024-04-25T16:00:43.560090+0000","last_fullsized":"2024-04-25T16:00:43.560090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27881,"num_write":426,"num_write_kb":76310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"36'1437","reported_seq":1504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.593401+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T16:00:51.593401+0000","last_peered":"2024-04-25T16:00:51.593401+0000","last_clean":"2024-04-25T16:00:51.593401+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T16:00:51.593401+0000","last_undegraded":"2024-04-25T16:00:51.593401+0000","last_fullsized":"2024-04-25T16:00:51.593401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":18411,"num_write":1381,"num_write_kb":5019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'392","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.695464+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T16:00:51.695464+0000","last_peered":"2024-04-25T16:00:51.695464+0000","last_clean":"2024-04-25T16:00:51.695464+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T16:00:51.695464+0000","last_undegraded":"2024-04-25T16:00:51.695464+0000","last_fullsized":"2024-04-25T16:00:51.695464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12356,"num_write":363,"num_write_kb":47533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'229","reported_seq":271,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583062+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T16:00:43.583062+0000","last_peered":"2024-04-25T16:00:43.583062+0000","last_clean":"2024-04-25T16:00:43.583062+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T16:00:43.583062+0000","last_undegraded":"2024-04-25T16:00:43.583062+0000","last_fullsized":"2024-04-25T16:00:43.583062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":183,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'392","reported_seq":484,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562446+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T16:00:43.562446+0000","last_peered":"2024-04-25T16:00:43.562446+0000","last_clean":"2024-04-25T16:00:43.562446+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T16:00:43.562446+0000","last_undegraded":"2024-04-25T16:00:43.562446+0000","last_fullsized":"2024-04-25T16:00:43.562446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30984,"num_write":367,"num_write_kb":33760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"34'215","reported_seq":268,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.586373+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T16:00:43.586373+0000","last_peered":"2024-04-25T16:00:43.586373+0000","last_clean":"2024-04-25T16:00:43.586373+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T16:00:43.586373+0000","last_undegraded":"2024-04-25T16:00:43.586373+0000","last_fullsized":"2024-04-25T16:00:43.586373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":163,"num_write_kb":4188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'349","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570978+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T16:00:43.570978+0000","last_peered":"2024-04-25T16:00:43.570978+0000","last_clean":"2024-04-25T16:00:43.570978+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T16:00:43.570978+0000","last_undegraded":"2024-04-25T16:00:43.570978+0000","last_fullsized":"2024-04-25T16:00:43.570978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5423,"num_write":327,"num_write_kb":34935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'1396","reported_seq":1441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561108+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T16:00:43.561108+0000","last_peered":"2024-04-25T16:00:43.561108+0000","last_clean":"2024-04-25T16:00:43.561108+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T16:00:43.561108+0000","last_undegraded":"2024-04-25T16:00:43.561108+0000","last_fullsized":"2024-04-25T16:00:43.561108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1396,"log_dups_size":0,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1329,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"31'398","reported_seq":458,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576915+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T16:00:43.576915+0000","last_peered":"2024-04-25T16:00:43.576915+0000","last_clean":"2024-04-25T16:00:43.576915+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T16:00:43.576915+0000","last_undegraded":"2024-04-25T16:00:43.576915+0000","last_fullsized":"2024-04-25T16:00:43.576915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14376,"num_write":371,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"36'383","reported_seq":450,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681810+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T16:00:51.681810+0000","last_peered":"2024-04-25T16:00:51.681810+0000","last_clean":"2024-04-25T16:00:51.681810+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T16:00:51.681810+0000","last_undegraded":"2024-04-25T16:00:51.681810+0000","last_fullsized":"2024-04-25T16:00:51.681810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":45080,"num_write":303,"num_write_kb":12463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'366","reported_seq":455,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.623210+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T16:00:43.623210+0000","last_peered":"2024-04-25T16:00:43.623210+0000","last_clean":"2024-04-25T16:00:43.623210+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T16:00:43.623210+0000","last_undegraded":"2024-04-25T16:00:43.623210+0000","last_fullsized":"2024-04-25T16:00:43.623210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24540,"num_write":344,"num_write_kb":42834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'118","reported_seq":161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563312+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T16:00:43.563312+0000","last_peered":"2024-04-25T16:00:43.563312+0000","last_clean":"2024-04-25T16:00:43.563312+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T16:00:43.563312+0000","last_undegraded":"2024-04-25T16:00:43.563312+0000","last_fullsized":"2024-04-25T16:00:43.563312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":59,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'379","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618798+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T16:00:43.618798+0000","last_peered":"2024-04-25T16:00:43.618798+0000","last_clean":"2024-04-25T16:00:43.618798+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T16:00:43.618798+0000","last_undegraded":"2024-04-25T16:00:43.618798+0000","last_fullsized":"2024-04-25T16:00:43.618798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17536,"num_write":366,"num_write_kb":55228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"36'361","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.625597+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T16:00:51.625597+0000","last_peered":"2024-04-25T16:00:51.625597+0000","last_clean":"2024-04-25T16:00:51.625597+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T16:00:51.625597+0000","last_undegraded":"2024-04-25T16:00:51.625597+0000","last_fullsized":"2024-04-25T16:00:51.625597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":312,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'376","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.697044+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T16:00:51.697044+0000","last_peered":"2024-04-25T16:00:51.697044+0000","last_clean":"2024-04-25T16:00:51.697044+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T16:00:51.697044+0000","last_undegraded":"2024-04-25T16:00:51.697044+0000","last_fullsized":"2024-04-25T16:00:51.697044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31362,"num_write":348,"num_write_kb":63308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'407","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566429+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T16:00:43.566429+0000","last_peered":"2024-04-25T16:00:43.566429+0000","last_clean":"2024-04-25T16:00:43.566429+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T16:00:43.566429+0000","last_undegraded":"2024-04-25T16:00:43.566429+0000","last_fullsized":"2024-04-25T16:00:43.566429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":355,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'439","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563561+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T16:00:43.563561+0000","last_peered":"2024-04-25T16:00:43.563561+0000","last_clean":"2024-04-25T16:00:43.563561+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T16:00:43.563561+0000","last_undegraded":"2024-04-25T16:00:43.563561+0000","last_fullsized":"2024-04-25T16:00:43.563561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15953,"num_write":415,"num_write_kb":91831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"36'454","reported_seq":581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708278+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T16:00:51.708278+0000","last_peered":"2024-04-25T16:00:51.708278+0000","last_clean":"2024-04-25T16:00:51.708278+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T16:00:51.708278+0000","last_undegraded":"2024-04-25T16:00:51.708278+0000","last_fullsized":"2024-04-25T16:00:51.708278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":34259,"num_write":426,"num_write_kb":109355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'209","reported_seq":273,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.604101+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T16:00:51.604101+0000","last_peered":"2024-04-25T16:00:51.604101+0000","last_clean":"2024-04-25T16:00:51.604101+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T16:00:51.604101+0000","last_undegraded":"2024-04-25T16:00:51.604101+0000","last_fullsized":"2024-04-25T16:00:51.604101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":32780,"num_write":144,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'517","reported_seq":566,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563985+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T16:00:43.563985+0000","last_peered":"2024-04-25T16:00:43.563985+0000","last_clean":"2024-04-25T16:00:43.563985+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T16:00:43.563985+0000","last_undegraded":"2024-04-25T16:00:43.563985+0000","last_fullsized":"2024-04-25T16:00:43.563985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":469,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'399","reported_seq":479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558965+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T16:00:43.558965+0000","last_peered":"2024-04-25T16:00:43.558965+0000","last_clean":"2024-04-25T16:00:43.558965+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T16:00:43.558965+0000","last_undegraded":"2024-04-25T16:00:43.558965+0000","last_fullsized":"2024-04-25T16:00:43.558965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":26873,"num_write":378,"num_write_kb":71246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"35'429","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584166+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T16:00:43.584166+0000","last_peered":"2024-04-25T16:00:43.584166+0000","last_clean":"2024-04-25T16:00:43.584166+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T16:00:43.584166+0000","last_undegraded":"2024-04-25T16:00:43.584166+0000","last_fullsized":"2024-04-25T16:00:43.584166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42040,"num_write":408,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"34'200","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565925+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T16:00:43.565925+0000","last_peered":"2024-04-25T16:00:43.565925+0000","last_clean":"2024-04-25T16:00:43.565925+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T16:00:43.565925+0000","last_undegraded":"2024-04-25T16:00:43.565925+0000","last_fullsized":"2024-04-25T16:00:43.565925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'60","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567637+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T16:00:43.567637+0000","last_peered":"2024-04-25T16:00:43.567637+0000","last_clean":"2024-04-25T16:00:43.567637+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T16:00:43.567637+0000","last_undegraded":"2024-04-25T16:00:43.567637+0000","last_fullsized":"2024-04-25T16:00:43.567637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'380","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565677+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T16:00:43.565677+0000","last_peered":"2024-04-25T16:00:43.565677+0000","last_clean":"2024-04-25T16:00:43.565677+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T16:00:43.565677+0000","last_undegraded":"2024-04-25T16:00:43.565677+0000","last_fullsized":"2024-04-25T16:00:43.565677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24884,"num_write":362,"num_write_kb":71575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"35'377","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585642+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T16:00:43.585642+0000","last_peered":"2024-04-25T16:00:43.585642+0000","last_clean":"2024-04-25T16:00:43.585642+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T16:00:43.585642+0000","last_undegraded":"2024-04-25T16:00:43.585642+0000","last_fullsized":"2024-04-25T16:00:43.585642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7657,"num_write":351,"num_write_kb":21765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'69","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564212+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T16:00:43.564212+0000","last_peered":"2024-04-25T16:00:43.564212+0000","last_clean":"2024-04-25T16:00:43.564212+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T16:00:43.564212+0000","last_undegraded":"2024-04-25T16:00:43.564212+0000","last_fullsized":"2024-04-25T16:00:43.564212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'194","reported_seq":241,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":146,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"31'395","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620509+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T16:00:43.620509+0000","last_peered":"2024-04-25T16:00:43.620509+0000","last_clean":"2024-04-25T16:00:43.620509+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T16:00:43.620509+0000","last_undegraded":"2024-04-25T16:00:43.620509+0000","last_fullsized":"2024-04-25T16:00:43.620509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23834,"num_write":371,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"36'432","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699888+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T16:00:51.699888+0000","last_peered":"2024-04-25T16:00:51.699888+0000","last_clean":"2024-04-25T16:00:51.699888+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T16:00:51.699888+0000","last_undegraded":"2024-04-25T16:00:51.699888+0000","last_fullsized":"2024-04-25T16:00:51.699888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1051,"num_write":404,"num_write_kb":46183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"35'633","reported_seq":685,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.573910+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T16:00:43.573910+0000","last_peered":"2024-04-25T16:00:43.573910+0000","last_clean":"2024-04-25T16:00:43.573910+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T16:00:43.573910+0000","last_undegraded":"2024-04-25T16:00:43.573910+0000","last_fullsized":"2024-04-25T16:00:43.573910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":576,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'339","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566182+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T16:00:43.566182+0000","last_peered":"2024-04-25T16:00:43.566182+0000","last_clean":"2024-04-25T16:00:43.566182+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T16:00:43.566182+0000","last_undegraded":"2024-04-25T16:00:43.566182+0000","last_fullsized":"2024-04-25T16:00:43.566182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":287,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"31'408","reported_seq":519,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582757+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T16:00:43.582757+0000","last_peered":"2024-04-25T16:00:43.582757+0000","last_clean":"2024-04-25T16:00:43.582757+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T16:00:43.582757+0000","last_undegraded":"2024-04-25T16:00:43.582757+0000","last_fullsized":"2024-04-25T16:00:43.582757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":22153,"num_write":390,"num_write_kb":51497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"36'445","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702477+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T16:00:51.702477+0000","last_peered":"2024-04-25T16:00:51.702477+0000","last_clean":"2024-04-25T16:00:51.702477+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T16:00:51.702477+0000","last_undegraded":"2024-04-25T16:00:51.702477+0000","last_fullsized":"2024-04-25T16:00:51.702477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9563,"num_write":414,"num_write_kb":59478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'72","reported_seq":130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.629231+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T16:00:51.629231+0000","last_peered":"2024-04-25T16:00:51.629231+0000","last_clean":"2024-04-25T16:00:51.629231+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T16:00:51.629231+0000","last_undegraded":"2024-04-25T16:00:51.629231+0000","last_fullsized":"2024-04-25T16:00:51.629231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'291","reported_seq":548,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561716+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T16:00:43.561716+0000","last_peered":"2024-04-25T16:00:43.561716+0000","last_clean":"2024-04-25T16:00:43.561716+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T16:00:43.561716+0000","last_undegraded":"2024-04-25T16:00:43.561716+0000","last_fullsized":"2024-04-25T16:00:43.561716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465994,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":1569,"num_write":227,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"31'396","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559745+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T16:00:43.559745+0000","last_peered":"2024-04-25T16:00:43.559745+0000","last_clean":"2024-04-25T16:00:43.559745+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T16:00:43.559745+0000","last_undegraded":"2024-04-25T16:00:43.559745+0000","last_fullsized":"2024-04-25T16:00:43.559745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17201,"num_write":368,"num_write_kb":116540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'348","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584481+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T16:00:43.584481+0000","last_peered":"2024-04-25T16:00:43.584481+0000","last_clean":"2024-04-25T16:00:43.584481+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T16:00:43.584481+0000","last_undegraded":"2024-04-25T16:00:43.584481+0000","last_fullsized":"2024-04-25T16:00:43.584481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11261,"num_write":326,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"36'220","reported_seq":277,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707128+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T16:00:51.707128+0000","last_peered":"2024-04-25T16:00:51.707128+0000","last_clean":"2024-04-25T16:00:51.707128+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T16:00:51.707128+0000","last_undegraded":"2024-04-25T16:00:51.707128+0000","last_fullsized":"2024-04-25T16:00:51.707128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":264,"num_write":447,"num_write_kb":1604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"35'415","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582806+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T16:00:43.582806+0000","last_peered":"2024-04-25T16:00:43.582806+0000","last_clean":"2024-04-25T16:00:43.582806+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T16:00:43.582806+0000","last_undegraded":"2024-04-25T16:00:43.582806+0000","last_fullsized":"2024-04-25T16:00:43.582806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":348,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"31'355","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569759+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T16:00:43.569759+0000","last_peered":"2024-04-25T16:00:43.569759+0000","last_clean":"2024-04-25T16:00:43.569759+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T16:00:43.569759+0000","last_undegraded":"2024-04-25T16:00:43.569759+0000","last_fullsized":"2024-04-25T16:00:43.569759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":811,"num_write":334,"num_write_kb":50274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"36'395","reported_seq":478,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691697+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T16:00:51.691697+0000","last_peered":"2024-04-25T16:00:51.691697+0000","last_clean":"2024-04-25T16:00:51.691697+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T16:00:51.691697+0000","last_undegraded":"2024-04-25T16:00:51.691697+0000","last_fullsized":"2024-04-25T16:00:51.691697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17222,"num_write":367,"num_write_kb":107915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'211","reported_seq":262,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:46.021660+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T16:00:46.021660+0000","last_peered":"2024-04-25T16:00:46.021660+0000","last_clean":"2024-04-25T16:00:46.021660+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T16:00:46.021660+0000","last_undegraded":"2024-04-25T16:00:46.021660+0000","last_fullsized":"2024-04-25T16:00:46.021660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":156,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'73","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567937+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T16:00:43.567937+0000","last_peered":"2024-04-25T16:00:43.567937+0000","last_clean":"2024-04-25T16:00:43.567937+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T16:00:43.567937+0000","last_undegraded":"2024-04-25T16:00:43.567937+0000","last_fullsized":"2024-04-25T16:00:43.567937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'419","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569029+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T16:00:43.569029+0000","last_peered":"2024-04-25T16:00:43.569029+0000","last_clean":"2024-04-25T16:00:43.569029+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T16:00:43.569029+0000","last_undegraded":"2024-04-25T16:00:43.569029+0000","last_fullsized":"2024-04-25T16:00:43.569029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":27915,"num_write":400,"num_write_kb":113619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'436","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.703284+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T16:00:51.703284+0000","last_peered":"2024-04-25T16:00:51.703284+0000","last_clean":"2024-04-25T16:00:51.703284+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T16:00:51.703284+0000","last_undegraded":"2024-04-25T16:00:51.703284+0000","last_fullsized":"2024-04-25T16:00:51.703284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48041,"num_write":405,"num_write_kb":79758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'60","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564266+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T16:00:43.564266+0000","last_peered":"2024-04-25T16:00:43.564266+0000","last_clean":"2024-04-25T16:00:43.564266+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T16:00:43.564266+0000","last_undegraded":"2024-04-25T16:00:43.564266+0000","last_fullsized":"2024-04-25T16:00:43.564266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'647","reported_seq":695,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564966+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T16:00:43.564966+0000","last_peered":"2024-04-25T16:00:43.564966+0000","last_clean":"2024-04-25T16:00:43.564966+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T16:00:43.564966+0000","last_undegraded":"2024-04-25T16:00:43.564966+0000","last_fullsized":"2024-04-25T16:00:43.564966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":21962,"num_write":588,"num_write_kb":8473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'398","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570717+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T16:00:43.570717+0000","last_peered":"2024-04-25T16:00:43.570717+0000","last_clean":"2024-04-25T16:00:43.570717+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T16:00:43.570717+0000","last_undegraded":"2024-04-25T16:00:43.570717+0000","last_fullsized":"2024-04-25T16:00:43.570717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18043,"num_write":367,"num_write_kb":54591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'382","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565930+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T16:00:43.565930+0000","last_peered":"2024-04-25T16:00:43.565930+0000","last_clean":"2024-04-25T16:00:43.565930+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T16:00:43.565930+0000","last_undegraded":"2024-04-25T16:00:43.565930+0000","last_fullsized":"2024-04-25T16:00:43.565930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":351,"num_write_kb":26238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'641","reported_seq":698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.630615+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T16:00:43.630615+0000","last_peered":"2024-04-25T16:00:43.630615+0000","last_clean":"2024-04-25T16:00:43.630615+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T16:00:43.630615+0000","last_undegraded":"2024-04-25T16:00:43.630615+0000","last_fullsized":"2024-04-25T16:00:43.630615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":575,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'63","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563762+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T16:00:43.563762+0000","last_peered":"2024-04-25T16:00:43.563762+0000","last_clean":"2024-04-25T16:00:43.563762+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T16:00:43.563762+0000","last_undegraded":"2024-04-25T16:00:43.563762+0000","last_fullsized":"2024-04-25T16:00:43.563762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'417","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559349+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T16:00:43.559349+0000","last_peered":"2024-04-25T16:00:43.559349+0000","last_clean":"2024-04-25T16:00:43.559349+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T16:00:43.559349+0000","last_undegraded":"2024-04-25T16:00:43.559349+0000","last_fullsized":"2024-04-25T16:00:43.559349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":4695,"num_write":394,"num_write_kb":63230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'383","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562973+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T16:00:43.562973+0000","last_peered":"2024-04-25T16:00:43.562973+0000","last_clean":"2024-04-25T16:00:43.562973+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T16:00:43.562973+0000","last_undegraded":"2024-04-25T16:00:43.562973+0000","last_fullsized":"2024-04-25T16:00:43.562973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":357,"num_write_kb":25875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'325","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.575494+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T16:00:53.575494+0000","last_peered":"2024-04-25T16:00:53.575494+0000","last_clean":"2024-04-25T16:00:53.575494+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T16:00:53.575494+0000","last_undegraded":"2024-04-25T16:00:53.575494+0000","last_fullsized":"2024-04-25T16:00:53.575494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":1598,"num_write":259,"num_write_kb":1606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'73","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564080+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T16:00:43.564080+0000","last_peered":"2024-04-25T16:00:43.564080+0000","last_clean":"2024-04-25T16:00:43.564080+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T16:00:43.564080+0000","last_undegraded":"2024-04-25T16:00:43.564080+0000","last_fullsized":"2024-04-25T16:00:43.564080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'351","reported_seq":443,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621988+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T16:00:43.621988+0000","last_peered":"2024-04-25T16:00:43.621988+0000","last_clean":"2024-04-25T16:00:43.621988+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T16:00:43.621988+0000","last_undegraded":"2024-04-25T16:00:43.621988+0000","last_fullsized":"2024-04-25T16:00:43.621988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19848,"num_write":332,"num_write_kb":34180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"36'414","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.688373+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T16:00:51.688373+0000","last_peered":"2024-04-25T16:00:51.688373+0000","last_clean":"2024-04-25T16:00:51.688373+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T16:00:51.688373+0000","last_undegraded":"2024-04-25T16:00:51.688373+0000","last_fullsized":"2024-04-25T16:00:51.688373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":27907,"num_write":382,"num_write_kb":96848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'587","reported_seq":645,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.768045+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T16:00:43.768045+0000","last_peered":"2024-04-25T16:00:43.768045+0000","last_clean":"2024-04-25T16:00:43.768045+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T16:00:43.768045+0000","last_undegraded":"2024-04-25T16:00:43.768045+0000","last_fullsized":"2024-04-25T16:00:43.768045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":32151,"num_write":527,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'238","reported_seq":285,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571711+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T16:00:43.571711+0000","last_peered":"2024-04-25T16:00:43.571711+0000","last_clean":"2024-04-25T16:00:43.571711+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T16:00:43.571711+0000","last_undegraded":"2024-04-25T16:00:43.571711+0000","last_fullsized":"2024-04-25T16:00:43.571711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":156,"num_write":459,"num_write_kb":1609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'379","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.580092+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T16:00:43.580092+0000","last_peered":"2024-04-25T16:00:43.580092+0000","last_clean":"2024-04-25T16:00:43.580092+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T16:00:43.580092+0000","last_undegraded":"2024-04-25T16:00:43.580092+0000","last_fullsized":"2024-04-25T16:00:43.580092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":4720,"num_write":350,"num_write_kb":42976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'353","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642061+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T16:00:51.642061+0000","last_peered":"2024-04-25T16:00:51.642061+0000","last_clean":"2024-04-25T16:00:51.642061+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T16:00:51.642061+0000","last_undegraded":"2024-04-25T16:00:51.642061+0000","last_fullsized":"2024-04-25T16:00:51.642061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27299,"num_write":333,"num_write_kb":58716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.656733+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T16:00:51.656733+0000","last_peered":"2024-04-25T16:00:51.656733+0000","last_clean":"2024-04-25T16:00:51.656733+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T16:00:51.656733+0000","last_undegraded":"2024-04-25T16:00:51.656733+0000","last_fullsized":"2024-04-25T16:00:51.656733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.577654+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T16:00:43.577654+0000","last_peered":"2024-04-25T16:00:43.577654+0000","last_clean":"2024-04-25T16:00:43.577654+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T16:00:43.577654+0000","last_undegraded":"2024-04-25T16:00:43.577654+0000","last_fullsized":"2024-04-25T16:00:43.577654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'208","reported_seq":251,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561781+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T16:00:43.561781+0000","last_peered":"2024-04-25T16:00:43.561781+0000","last_clean":"2024-04-25T16:00:43.561781+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T16:00:43.561781+0000","last_undegraded":"2024-04-25T16:00:43.561781+0000","last_fullsized":"2024-04-25T16:00:43.561781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":141,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"31'402","reported_seq":508,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558941+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T16:00:43.558941+0000","last_peered":"2024-04-25T16:00:43.558941+0000","last_clean":"2024-04-25T16:00:43.558941+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T16:00:43.558941+0000","last_undegraded":"2024-04-25T16:00:43.558941+0000","last_fullsized":"2024-04-25T16:00:43.558941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45941,"num_write":380,"num_write_kb":54783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'411","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.579623+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T16:00:43.579623+0000","last_peered":"2024-04-25T16:00:43.579623+0000","last_clean":"2024-04-25T16:00:43.579623+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T16:00:43.579623+0000","last_undegraded":"2024-04-25T16:00:43.579623+0000","last_fullsized":"2024-04-25T16:00:43.579623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37252,"num_write":394,"num_write_kb":96094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'63","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707798+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T16:00:51.707798+0000","last_peered":"2024-04-25T16:00:51.707798+0000","last_clean":"2024-04-25T16:00:51.707798+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T16:00:51.707798+0000","last_undegraded":"2024-04-25T16:00:51.707798+0000","last_fullsized":"2024-04-25T16:00:51.707798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'123","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571142+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T16:00:43.571142+0000","last_peered":"2024-04-25T16:00:43.571142+0000","last_clean":"2024-04-25T16:00:43.571142+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T16:00:43.571142+0000","last_undegraded":"2024-04-25T16:00:43.571142+0000","last_fullsized":"2024-04-25T16:00:43.571142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":75,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'444","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557697+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T16:00:43.557697+0000","last_peered":"2024-04-25T16:00:43.557697+0000","last_clean":"2024-04-25T16:00:43.557697+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T16:00:43.557697+0000","last_undegraded":"2024-04-25T16:00:43.557697+0000","last_fullsized":"2024-04-25T16:00:43.557697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13011,"num_write":414,"num_write_kb":80257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'435","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698098+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T16:00:51.698098+0000","last_peered":"2024-04-25T16:00:51.698098+0000","last_clean":"2024-04-25T16:00:51.698098+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T16:00:51.698098+0000","last_undegraded":"2024-04-25T16:00:51.698098+0000","last_fullsized":"2024-04-25T16:00:51.698098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14130,"num_write":408,"num_write_kb":39042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"34'575","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.258432+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T16:00:44.258432+0000","last_peered":"2024-04-25T16:00:44.258432+0000","last_clean":"2024-04-25T16:00:44.258432+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T16:00:44.258432+0000","last_undegraded":"2024-04-25T16:00:44.258432+0000","last_fullsized":"2024-04-25T16:00:44.258432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":521,"num_write_kb":4332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'140","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567182+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T16:00:43.567182+0000","last_peered":"2024-04-25T16:00:43.567182+0000","last_clean":"2024-04-25T16:00:43.567182+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T16:00:43.567182+0000","last_undegraded":"2024-04-25T16:00:43.567182+0000","last_fullsized":"2024-04-25T16:00:43.567182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":20488,"num_write":73,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"31'446","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569564+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T16:00:43.569564+0000","last_peered":"2024-04-25T16:00:43.569564+0000","last_clean":"2024-04-25T16:00:43.569564+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T16:00:43.569564+0000","last_undegraded":"2024-04-25T16:00:43.569564+0000","last_fullsized":"2024-04-25T16:00:43.569564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17909,"num_write":426,"num_write_kb":58918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'390","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708088+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T16:00:51.708088+0000","last_peered":"2024-04-25T16:00:51.708088+0000","last_clean":"2024-04-25T16:00:51.708088+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T16:00:51.708088+0000","last_undegraded":"2024-04-25T16:00:51.708088+0000","last_fullsized":"2024-04-25T16:00:51.708088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39208,"num_write":362,"num_write_kb":67602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'283","reported_seq":344,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.627686+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T16:00:51.627686+0000","last_peered":"2024-04-25T16:00:51.627686+0000","last_clean":"2024-04-25T16:00:51.627686+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T16:00:51.627686+0000","last_undegraded":"2024-04-25T16:00:51.627686+0000","last_fullsized":"2024-04-25T16:00:51.627686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":236,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'548","reported_seq":593,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618215+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T16:00:43.618215+0000","last_peered":"2024-04-25T16:00:43.618215+0000","last_clean":"2024-04-25T16:00:43.618215+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T16:00:43.618215+0000","last_undegraded":"2024-04-25T16:00:43.618215+0000","last_fullsized":"2024-04-25T16:00:43.618215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":499,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'422","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557173+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T16:00:43.557173+0000","last_peered":"2024-04-25T16:00:43.557173+0000","last_clean":"2024-04-25T16:00:43.557173+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T16:00:43.557173+0000","last_undegraded":"2024-04-25T16:00:43.557173+0000","last_fullsized":"2024-04-25T16:00:43.557173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25440,"num_write":402,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'355","reported_seq":434,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706853+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T16:00:51.706853+0000","last_peered":"2024-04-25T16:00:51.706853+0000","last_clean":"2024-04-25T16:00:51.706853+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T16:00:51.706853+0000","last_undegraded":"2024-04-25T16:00:51.706853+0000","last_fullsized":"2024-04-25T16:00:51.706853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21419,"num_write":332,"num_write_kb":54133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'185","reported_seq":243,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.657326+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T16:00:51.657326+0000","last_peered":"2024-04-25T16:00:51.657326+0000","last_clean":"2024-04-25T16:00:51.657326+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T16:00:51.657326+0000","last_undegraded":"2024-04-25T16:00:51.657326+0000","last_fullsized":"2024-04-25T16:00:51.657326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":131,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"35'55","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561316+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T16:00:43.561316+0000","last_peered":"2024-04-25T16:00:43.561316+0000","last_clean":"2024-04-25T16:00:43.561316+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T16:00:43.561316+0000","last_undegraded":"2024-04-25T16:00:43.561316+0000","last_fullsized":"2024-04-25T16:00:43.561316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"31'370","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583347+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T16:00:43.583347+0000","last_peered":"2024-04-25T16:00:43.583347+0000","last_clean":"2024-04-25T16:00:43.583347+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T16:00:43.583347+0000","last_undegraded":"2024-04-25T16:00:43.583347+0000","last_fullsized":"2024-04-25T16:00:43.583347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":42885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'464","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691773+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T16:00:51.691773+0000","last_peered":"2024-04-25T16:00:51.691773+0000","last_clean":"2024-04-25T16:00:51.691773+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T16:00:51.691773+0000","last_undegraded":"2024-04-25T16:00:51.691773+0000","last_fullsized":"2024-04-25T16:00:51.691773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":34229,"num_write":431,"num_write_kb":50975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'302","reported_seq":391,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.577775+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T16:00:53.577775+0000","last_peered":"2024-04-25T16:00:53.577775+0000","last_clean":"2024-04-25T16:00:53.577775+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T16:00:53.577775+0000","last_undegraded":"2024-04-25T16:00:53.577775+0000","last_fullsized":"2024-04-25T16:00:53.577775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":5709,"num_write":249,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'222","reported_seq":264,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571367+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T16:00:43.571367+0000","last_peered":"2024-04-25T16:00:43.571367+0000","last_clean":"2024-04-25T16:00:43.571367+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T16:00:43.571367+0000","last_undegraded":"2024-04-25T16:00:43.571367+0000","last_fullsized":"2024-04-25T16:00:43.571367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":181,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'411","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619711+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T16:00:43.619711+0000","last_peered":"2024-04-25T16:00:43.619711+0000","last_clean":"2024-04-25T16:00:43.619711+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T16:00:43.619711+0000","last_undegraded":"2024-04-25T16:00:43.619711+0000","last_fullsized":"2024-04-25T16:00:43.619711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4854,"num_write":381,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"36'439","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676434+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T16:00:51.676434+0000","last_peered":"2024-04-25T16:00:51.676434+0000","last_clean":"2024-04-25T16:00:51.676434+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T16:00:51.676434+0000","last_undegraded":"2024-04-25T16:00:51.676434+0000","last_fullsized":"2024-04-25T16:00:51.676434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15516,"num_write":414,"num_write_kb":67395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562151+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T16:00:43.562151+0000","last_peered":"2024-04-25T16:00:43.562151+0000","last_clean":"2024-04-25T16:00:43.562151+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T16:00:43.562151+0000","last_undegraded":"2024-04-25T16:00:43.562151+0000","last_fullsized":"2024-04-25T16:00:43.562151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'72","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583932+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T16:00:43.583932+0000","last_peered":"2024-04-25T16:00:43.583932+0000","last_clean":"2024-04-25T16:00:43.583932+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T16:00:43.583932+0000","last_undegraded":"2024-04-25T16:00:43.583932+0000","last_fullsized":"2024-04-25T16:00:43.583932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'400","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619036+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T16:00:43.619036+0000","last_peered":"2024-04-25T16:00:43.619036+0000","last_clean":"2024-04-25T16:00:43.619036+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T16:00:43.619036+0000","last_undegraded":"2024-04-25T16:00:43.619036+0000","last_fullsized":"2024-04-25T16:00:43.619036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39850,"num_write":370,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"36'407","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691312+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T16:00:51.691312+0000","last_peered":"2024-04-25T16:00:51.691312+0000","last_clean":"2024-04-25T16:00:51.691312+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T16:00:51.691312+0000","last_undegraded":"2024-04-25T16:00:51.691312+0000","last_fullsized":"2024-04-25T16:00:51.691312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":33246,"num_write":383,"num_write_kb":97231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"36'72","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.704437+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T16:00:51.704437+0000","last_peered":"2024-04-25T16:00:51.704437+0000","last_clean":"2024-04-25T16:00:51.704437+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T16:00:51.704437+0000","last_undegraded":"2024-04-25T16:00:51.704437+0000","last_fullsized":"2024-04-25T16:00:51.704437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'282","reported_seq":345,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583847+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T16:00:43.583847+0000","last_peered":"2024-04-25T16:00:43.583847+0000","last_clean":"2024-04-25T16:00:43.583847+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T16:00:43.583847+0000","last_undegraded":"2024-04-25T16:00:43.583847+0000","last_fullsized":"2024-04-25T16:00:43.583847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":28701,"num_write":224,"num_write_kb":12419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'384","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583585+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T16:00:43.583585+0000","last_peered":"2024-04-25T16:00:43.583585+0000","last_clean":"2024-04-25T16:00:43.583585+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T16:00:43.583585+0000","last_undegraded":"2024-04-25T16:00:43.583585+0000","last_fullsized":"2024-04-25T16:00:43.583585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13411,"num_write":356,"num_write_kb":100243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'415","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.700278+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T16:00:51.700278+0000","last_peered":"2024-04-25T16:00:51.700278+0000","last_clean":"2024-04-25T16:00:51.700278+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T16:00:51.700278+0000","last_undegraded":"2024-04-25T16:00:51.700278+0000","last_fullsized":"2024-04-25T16:00:51.700278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13518,"num_write":393,"num_write_kb":67403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'925","reported_seq":993,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.592078+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T16:00:51.592078+0000","last_peered":"2024-04-25T16:00:51.592078+0000","last_clean":"2024-04-25T16:00:51.592078+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T16:00:51.592078+0000","last_undegraded":"2024-04-25T16:00:51.592078+0000","last_fullsized":"2024-04-25T16:00:51.592078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":28720,"num_write":874,"num_write_kb":8730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'142","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620409+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T16:00:43.620409+0000","last_peered":"2024-04-25T16:00:43.620409+0000","last_clean":"2024-04-25T16:00:43.620409+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T16:00:43.620409+0000","last_undegraded":"2024-04-25T16:00:43.620409+0000","last_fullsized":"2024-04-25T16:00:43.620409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":97,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"31'366","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583348+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T16:00:43.583348+0000","last_peered":"2024-04-25T16:00:43.583348+0000","last_clean":"2024-04-25T16:00:43.583348+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T16:00:43.583348+0000","last_undegraded":"2024-04-25T16:00:43.583348+0000","last_fullsized":"2024-04-25T16:00:43.583348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6536,"num_write":348,"num_write_kb":51835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"36'411","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705945+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T16:00:51.705945+0000","last_peered":"2024-04-25T16:00:51.705945+0000","last_clean":"2024-04-25T16:00:51.705945+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T16:00:51.705945+0000","last_undegraded":"2024-04-25T16:00:51.705945+0000","last_fullsized":"2024-04-25T16:00:51.705945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12973,"num_write":382,"num_write_kb":67863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'342","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.624046+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T16:00:51.624046+0000","last_peered":"2024-04-25T16:00:51.624046+0000","last_clean":"2024-04-25T16:00:51.624046+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T16:00:51.624046+0000","last_undegraded":"2024-04-25T16:00:51.624046+0000","last_fullsized":"2024-04-25T16:00:51.624046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":41004,"num_write":293,"num_write_kb":12450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'62","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564629+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T16:00:43.564629+0000","last_peered":"2024-04-25T16:00:43.564629+0000","last_clean":"2024-04-25T16:00:43.564629+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T16:00:43.564629+0000","last_undegraded":"2024-04-25T16:00:43.564629+0000","last_fullsized":"2024-04-25T16:00:43.564629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'409","reported_seq":505,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565353+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T16:00:43.565353+0000","last_peered":"2024-04-25T16:00:43.565353+0000","last_clean":"2024-04-25T16:00:43.565353+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T16:00:43.565353+0000","last_undegraded":"2024-04-25T16:00:43.565353+0000","last_fullsized":"2024-04-25T16:00:43.565353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30743,"num_write":387,"num_write_kb":71898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'393","reported_seq":487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684817+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T16:00:51.684817+0000","last_peered":"2024-04-25T16:00:51.684817+0000","last_clean":"2024-04-25T16:00:51.684817+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T16:00:51.684817+0000","last_undegraded":"2024-04-25T16:00:51.684817+0000","last_fullsized":"2024-04-25T16:00:51.684817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24508,"num_write":369,"num_write_kb":63737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'210","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:57.872968+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T16:00:57.872968+0000","last_peered":"2024-04-25T16:00:57.872968+0000","last_clean":"2024-04-25T16:00:57.872968+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T16:00:57.872968+0000","last_undegraded":"2024-04-25T16:00:57.872968+0000","last_fullsized":"2024-04-25T16:00:57.872968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":787,"num_write":162,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'536","reported_seq":590,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564408+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T16:00:43.564408+0000","last_peered":"2024-04-25T16:00:43.564408+0000","last_clean":"2024-04-25T16:00:43.564408+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T16:00:43.564408+0000","last_undegraded":"2024-04-25T16:00:43.564408+0000","last_fullsized":"2024-04-25T16:00:43.564408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24608,"num_write":474,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"31'470","reported_seq":569,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560394+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T16:00:43.560394+0000","last_peered":"2024-04-25T16:00:43.560394+0000","last_clean":"2024-04-25T16:00:43.560394+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T16:00:43.560394+0000","last_undegraded":"2024-04-25T16:00:43.560394+0000","last_fullsized":"2024-04-25T16:00:43.560394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31281,"num_write":455,"num_write_kb":108972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"36'380","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642794+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T16:00:51.642794+0000","last_peered":"2024-04-25T16:00:51.642794+0000","last_clean":"2024-04-25T16:00:51.642794+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T16:00:51.642794+0000","last_undegraded":"2024-04-25T16:00:51.642794+0000","last_fullsized":"2024-04-25T16:00:51.642794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":25762,"num_write":354,"num_write_kb":59652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'381","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.877917+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T16:00:45.877917+0000","last_peered":"2024-04-25T16:00:45.877917+0000","last_clean":"2024-04-25T16:00:45.877917+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T16:00:45.877917+0000","last_undegraded":"2024-04-25T16:00:45.877917+0000","last_fullsized":"2024-04-25T16:00:45.877917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8766,"num_write":314,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'141","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583710+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T16:00:43.583710+0000","last_peered":"2024-04-25T16:00:43.583710+0000","last_clean":"2024-04-25T16:00:43.583710+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T16:00:43.583710+0000","last_undegraded":"2024-04-25T16:00:43.583710+0000","last_fullsized":"2024-04-25T16:00:43.583710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494748,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":898,"num_write":91,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'426","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571429+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T16:00:43.571429+0000","last_peered":"2024-04-25T16:00:43.571429+0000","last_clean":"2024-04-25T16:00:43.571429+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T16:00:43.571429+0000","last_undegraded":"2024-04-25T16:00:43.571429+0000","last_fullsized":"2024-04-25T16:00:43.571429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13765,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"36'408","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621688+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T16:00:43.621688+0000","last_peered":"2024-04-25T16:00:43.621688+0000","last_clean":"2024-04-25T16:00:43.621688+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T16:00:43.621688+0000","last_undegraded":"2024-04-25T16:00:43.621688+0000","last_fullsized":"2024-04-25T16:00:43.621688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":381,"num_write_kb":62610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"36'68","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576238+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T16:00:43.576238+0000","last_peered":"2024-04-25T16:00:43.576238+0000","last_clean":"2024-04-25T16:00:43.576238+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T16:00:43.576238+0000","last_undegraded":"2024-04-25T16:00:43.576238+0000","last_fullsized":"2024-04-25T16:00:43.576238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'63","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582861+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T16:00:43.582861+0000","last_peered":"2024-04-25T16:00:43.582861+0000","last_clean":"2024-04-25T16:00:43.582861+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T16:00:43.582861+0000","last_undegraded":"2024-04-25T16:00:43.582861+0000","last_fullsized":"2024-04-25T16:00:43.582861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'354","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564245+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T16:00:43.564245+0000","last_peered":"2024-04-25T16:00:43.564245+0000","last_clean":"2024-04-25T16:00:43.564245+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T16:00:43.564245+0000","last_undegraded":"2024-04-25T16:00:43.564245+0000","last_fullsized":"2024-04-25T16:00:43.564245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17557,"num_write":333,"num_write_kb":46614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'111","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570878+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T16:00:43.570878+0000","last_peered":"2024-04-25T16:00:43.570878+0000","last_clean":"2024-04-25T16:00:43.570878+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T16:00:43.570878+0000","last_undegraded":"2024-04-25T16:00:43.570878+0000","last_fullsized":"2024-04-25T16:00:43.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":58,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'435","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684323+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T16:00:51.684323+0000","last_peered":"2024-04-25T16:00:51.684323+0000","last_clean":"2024-04-25T16:00:51.684323+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T16:00:51.684323+0000","last_undegraded":"2024-04-25T16:00:51.684323+0000","last_fullsized":"2024-04-25T16:00:51.684323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25415,"num_write":410,"num_write_kb":96682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'1093","reported_seq":1147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.543302+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T16:00:44.543302+0000","last_peered":"2024-04-25T16:00:44.543302+0000","last_clean":"2024-04-25T16:00:44.543302+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T16:00:44.543302+0000","last_undegraded":"2024-04-25T16:00:44.543302+0000","last_fullsized":"2024-04-25T16:00:44.543302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":1024,"num_write_kb":8705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"31'396","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570814+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T16:00:43.570814+0000","last_peered":"2024-04-25T16:00:43.570814+0000","last_clean":"2024-04-25T16:00:43.570814+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T16:00:43.570814+0000","last_undegraded":"2024-04-25T16:00:43.570814+0000","last_fullsized":"2024-04-25T16:00:43.570814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":20218,"num_write":374,"num_write_kb":83731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'99","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565603+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T16:00:43.565603+0000","last_peered":"2024-04-25T16:00:43.565603+0000","last_clean":"2024-04-25T16:00:43.565603+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T16:00:43.565603+0000","last_undegraded":"2024-04-25T16:00:43.565603+0000","last_fullsized":"2024-04-25T16:00:43.565603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12304,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'449","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585602+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T16:00:43.585602+0000","last_peered":"2024-04-25T16:00:43.585602+0000","last_clean":"2024-04-25T16:00:43.585602+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T16:00:43.585602+0000","last_undegraded":"2024-04-25T16:00:43.585602+0000","last_fullsized":"2024-04-25T16:00:43.585602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27119,"num_write":430,"num_write_kb":112459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'105","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.743069+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T16:00:45.743069+0000","last_peered":"2024-04-25T16:00:45.743069+0000","last_clean":"2024-04-25T16:00:45.743069+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T16:00:45.743069+0000","last_undegraded":"2024-04-25T16:00:45.743069+0000","last_fullsized":"2024-04-25T16:00:45.743069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":60,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"31'366","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564233+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T16:00:43.564233+0000","last_peered":"2024-04-25T16:00:43.564233+0000","last_clean":"2024-04-25T16:00:43.564233+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T16:00:43.564233+0000","last_undegraded":"2024-04-25T16:00:43.564233+0000","last_fullsized":"2024-04-25T16:00:43.564233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":31073,"num_write":335,"num_write_kb":72672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"34'620","reported_seq":678,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.348054+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T16:00:45.348054+0000","last_peered":"2024-04-25T16:00:45.348054+0000","last_clean":"2024-04-25T16:00:45.348054+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T16:00:45.348054+0000","last_undegraded":"2024-04-25T16:00:45.348054+0000","last_fullsized":"2024-04-25T16:00:45.348054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":551,"num_write_kb":12472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'393","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675955+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T16:00:51.675955+0000","last_peered":"2024-04-25T16:00:51.675955+0000","last_clean":"2024-04-25T16:00:51.675955+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T16:00:51.675955+0000","last_undegraded":"2024-04-25T16:00:51.675955+0000","last_fullsized":"2024-04-25T16:00:51.675955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31498,"num_write":372,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'337","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559283+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T16:00:43.559283+0000","last_peered":"2024-04-25T16:00:43.559283+0000","last_clean":"2024-04-25T16:00:43.559283+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T16:00:43.559283+0000","last_undegraded":"2024-04-25T16:00:43.559283+0000","last_fullsized":"2024-04-25T16:00:43.559283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":286,"num_write_kb":4236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'391","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566951+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T16:00:43.566951+0000","last_peered":"2024-04-25T16:00:43.566951+0000","last_clean":"2024-04-25T16:00:43.566951+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T16:00:43.566951+0000","last_undegraded":"2024-04-25T16:00:43.566951+0000","last_fullsized":"2024-04-25T16:00:43.566951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15625,"num_write":369,"num_write_kb":80649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"34'111","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584875+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T16:00:43.584875+0000","last_peered":"2024-04-25T16:00:43.584875+0000","last_clean":"2024-04-25T16:00:43.584875+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T16:00:43.584875+0000","last_undegraded":"2024-04-25T16:00:43.584875+0000","last_fullsized":"2024-04-25T16:00:43.584875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":57,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'382","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689989+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T16:00:51.689989+0000","last_peered":"2024-04-25T16:00:51.689989+0000","last_clean":"2024-04-25T16:00:51.689989+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T16:00:51.689989+0000","last_undegraded":"2024-04-25T16:00:51.689989+0000","last_fullsized":"2024-04-25T16:00:51.689989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28619,"num_write":357,"num_write_kb":42139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'305","reported_seq":358,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583900+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T16:00:43.583900+0000","last_peered":"2024-04-25T16:00:43.583900+0000","last_clean":"2024-04-25T16:00:43.583900+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T16:00:43.583900+0000","last_undegraded":"2024-04-25T16:00:43.583900+0000","last_fullsized":"2024-04-25T16:00:43.583900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":32783,"num_write":228,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"31'453","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585705+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T16:00:43.585705+0000","last_peered":"2024-04-25T16:00:43.585705+0000","last_clean":"2024-04-25T16:00:43.585705+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T16:00:43.585705+0000","last_undegraded":"2024-04-25T16:00:43.585705+0000","last_fullsized":"2024-04-25T16:00:43.585705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17355,"num_write":430,"num_write_kb":97199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'423","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702247+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T16:00:51.702247+0000","last_peered":"2024-04-25T16:00:51.702247+0000","last_clean":"2024-04-25T16:00:51.702247+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T16:00:51.702247+0000","last_undegraded":"2024-04-25T16:00:51.702247+0000","last_fullsized":"2024-04-25T16:00:51.702247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12292,"num_write":400,"num_write_kb":76879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"31'396","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562935+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T16:00:43.562935+0000","last_peered":"2024-04-25T16:00:43.562935+0000","last_clean":"2024-04-25T16:00:43.562935+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T16:00:43.562935+0000","last_undegraded":"2024-04-25T16:00:43.562935+0000","last_fullsized":"2024-04-25T16:00:43.562935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13093,"num_write":385,"num_write_kb":50492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'448","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.694727+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T16:00:51.694727+0000","last_peered":"2024-04-25T16:00:51.694727+0000","last_clean":"2024-04-25T16:00:51.694727+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T16:00:51.694727+0000","last_undegraded":"2024-04-25T16:00:51.694727+0000","last_fullsized":"2024-04-25T16:00:51.694727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":34274,"num_write":426,"num_write_kb":72417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"31'398","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618832+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T16:00:43.618832+0000","last_peered":"2024-04-25T16:00:43.618832+0000","last_clean":"2024-04-25T16:00:43.618832+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T16:00:43.618832+0000","last_undegraded":"2024-04-25T16:00:43.618832+0000","last_fullsized":"2024-04-25T16:00:43.618832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32843,"num_write":377,"num_write_kb":116675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"36'474","reported_seq":588,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.692733+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T16:00:51.692733+0000","last_peered":"2024-04-25T16:00:51.692733+0000","last_clean":"2024-04-25T16:00:51.692733+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T16:00:51.692733+0000","last_undegraded":"2024-04-25T16:00:51.692733+0000","last_fullsized":"2024-04-25T16:00:51.692733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33678,"num_write":445,"num_write_kb":67390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564869+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T16:00:43.564869+0000","last_peered":"2024-04-25T16:00:43.564869+0000","last_clean":"2024-04-25T16:00:43.564869+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T16:00:43.564869+0000","last_undegraded":"2024-04-25T16:00:43.564869+0000","last_fullsized":"2024-04-25T16:00:43.564869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19077,"num_write":388,"num_write_kb":75668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'415","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679135+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T16:00:51.679135+0000","last_peered":"2024-04-25T16:00:51.679135+0000","last_clean":"2024-04-25T16:00:51.679135+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T16:00:51.679135+0000","last_undegraded":"2024-04-25T16:00:51.679135+0000","last_fullsized":"2024-04-25T16:00:51.679135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15212,"num_write":389,"num_write_kb":87855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"31'469","reported_seq":572,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569399+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T16:00:43.569399+0000","last_peered":"2024-04-25T16:00:43.569399+0000","last_clean":"2024-04-25T16:00:43.569399+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T16:00:43.569399+0000","last_undegraded":"2024-04-25T16:00:43.569399+0000","last_fullsized":"2024-04-25T16:00:43.569399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":27411,"num_write":441,"num_write_kb":71769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"36'370","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699867+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T16:00:51.699867+0000","last_peered":"2024-04-25T16:00:51.699867+0000","last_clean":"2024-04-25T16:00:51.699867+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T16:00:51.699867+0000","last_undegraded":"2024-04-25T16:00:51.699867+0000","last_fullsized":"2024-04-25T16:00:51.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17348,"num_write":348,"num_write_kb":62807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"31'399","reported_seq":493,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566996+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T16:00:43.566996+0000","last_peered":"2024-04-25T16:00:43.566996+0000","last_clean":"2024-04-25T16:00:43.566996+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T16:00:43.566996+0000","last_undegraded":"2024-04-25T16:00:43.566996+0000","last_fullsized":"2024-04-25T16:00:43.566996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25133,"num_write":374,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"36'389","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9093,"num_write":358,"num_write_kb":54590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"31'414","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T16:00:43.570320+0000","last_peered":"2024-04-25T16:00:43.570320+0000","last_clean":"2024-04-25T16:00:43.570320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T16:00:43.570320+0000","last_undegraded":"2024-04-25T16:00:43.570320+0000","last_fullsized":"2024-04-25T16:00:43.570320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4145,"num_write":400,"num_write_kb":47343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"36'485","reported_seq":607,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.574681+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T16:00:43.574681+0000","last_peered":"2024-04-25T16:00:43.574681+0000","last_clean":"2024-04-25T16:00:43.574681+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T16:00:43.574681+0000","last_undegraded":"2024-04-25T16:00:43.574681+0000","last_fullsized":"2024-04-25T16:00:43.574681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40854,"num_write":458,"num_write_kb":125991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"31'410","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559076+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T16:00:43.559076+0000","last_peered":"2024-04-25T16:00:43.559076+0000","last_clean":"2024-04-25T16:00:43.559076+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T16:00:43.559076+0000","last_undegraded":"2024-04-25T16:00:43.559076+0000","last_fullsized":"2024-04-25T16:00:43.559076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26310,"num_write":391,"num_write_kb":68273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'398","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679994+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T16:00:51.679994+0000","last_peered":"2024-04-25T16:00:51.679994+0000","last_clean":"2024-04-25T16:00:51.679994+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T16:00:51.679994+0000","last_undegraded":"2024-04-25T16:00:51.679994+0000","last_fullsized":"2024-04-25T16:00:51.679994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4252,"num_write":382,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"31'416","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583427+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T16:00:43.583427+0000","last_peered":"2024-04-25T16:00:43.583427+0000","last_clean":"2024-04-25T16:00:43.583427+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T16:00:43.583427+0000","last_undegraded":"2024-04-25T16:00:43.583427+0000","last_fullsized":"2024-04-25T16:00:43.583427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38150,"num_write":393,"num_write_kb":63831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'452","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.661661+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T16:00:51.661661+0000","last_peered":"2024-04-25T16:00:51.661661+0000","last_clean":"2024-04-25T16:00:51.661661+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T16:00:51.661661+0000","last_undegraded":"2024-04-25T16:00:51.661661+0000","last_fullsized":"2024-04-25T16:00:51.661661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13732,"num_write":425,"num_write_kb":92170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"31'400","reported_seq":496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.572217+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T16:00:43.572217+0000","last_peered":"2024-04-25T16:00:43.572217+0000","last_clean":"2024-04-25T16:00:43.572217+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T16:00:43.572217+0000","last_undegraded":"2024-04-25T16:00:43.572217+0000","last_fullsized":"2024-04-25T16:00:43.572217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30630,"num_write":376,"num_write_kb":46781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"36'400","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.658583+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T16:00:51.658583+0000","last_peered":"2024-04-25T16:00:51.658583+0000","last_clean":"2024-04-25T16:00:51.658583+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T16:00:51.658583+0000","last_undegraded":"2024-04-25T16:00:51.658583+0000","last_fullsized":"2024-04-25T16:00:51.658583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":15673,"num_write":376,"num_write_kb":63098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"31'448","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558895+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T16:00:43.558895+0000","last_peered":"2024-04-25T16:00:43.558895+0000","last_clean":"2024-04-25T16:00:43.558895+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T16:00:43.558895+0000","last_undegraded":"2024-04-25T16:00:43.558895+0000","last_fullsized":"2024-04-25T16:00:43.558895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17288,"num_write":429,"num_write_kb":67321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"35'439","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620632+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T16:00:43.620632+0000","last_peered":"2024-04-25T16:00:43.620632+0000","last_clean":"2024-04-25T16:00:43.620632+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T16:00:43.620632+0000","last_undegraded":"2024-04-25T16:00:43.620632+0000","last_fullsized":"2024-04-25T16:00:43.620632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":44523,"num_write":420,"num_write_kb":101102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"31'449","reported_seq":563,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583236+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T16:00:43.583236+0000","last_peered":"2024-04-25T16:00:43.583236+0000","last_clean":"2024-04-25T16:00:43.583236+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T16:00:43.583236+0000","last_undegraded":"2024-04-25T16:00:43.583236+0000","last_fullsized":"2024-04-25T16:00:43.583236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42039,"num_write":424,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.639652+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T16:00:51.639652+0000","last_peered":"2024-04-25T16:00:51.639652+0000","last_clean":"2024-04-25T16:00:51.639652+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T16:00:51.639652+0000","last_undegraded":"2024-04-25T16:00:51.639652+0000","last_fullsized":"2024-04-25T16:00:51.639652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27977,"num_write":389,"num_write_kb":84131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"31'427","reported_seq":554,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565215+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T16:00:43.565215+0000","last_peered":"2024-04-25T16:00:43.565215+0000","last_clean":"2024-04-25T16:00:43.565215+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T16:00:43.565215+0000","last_undegraded":"2024-04-25T16:00:43.565215+0000","last_fullsized":"2024-04-25T16:00:43.565215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43629,"num_write":407,"num_write_kb":76072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"35'432","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564858+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T16:00:43.564858+0000","last_peered":"2024-04-25T16:00:43.564858+0000","last_clean":"2024-04-25T16:00:43.564858+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T16:00:43.564858+0000","last_undegraded":"2024-04-25T16:00:43.564858+0000","last_fullsized":"2024-04-25T16:00:43.564858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30618,"num_write":414,"num_write_kb":71070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"31'389","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559593+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T16:00:43.559593+0000","last_peered":"2024-04-25T16:00:43.559593+0000","last_clean":"2024-04-25T16:00:43.559593+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T16:00:43.559593+0000","last_undegraded":"2024-04-25T16:00:43.559593+0000","last_fullsized":"2024-04-25T16:00:43.559593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30549,"num_write":360,"num_write_kb":75006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"36'422","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.670952+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T16:00:51.670952+0000","last_peered":"2024-04-25T16:00:51.670952+0000","last_clean":"2024-04-25T16:00:51.670952+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T16:00:51.670952+0000","last_undegraded":"2024-04-25T16:00:51.670952+0000","last_fullsized":"2024-04-25T16:00:51.670952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39450,"num_write":395,"num_write_kb":75510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"31'437","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.617890+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T16:00:43.617890+0000","last_peered":"2024-04-25T16:00:43.617890+0000","last_clean":"2024-04-25T16:00:43.617890+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T16:00:43.617890+0000","last_undegraded":"2024-04-25T16:00:43.617890+0000","last_fullsized":"2024-04-25T16:00:43.617890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19085,"num_write":412,"num_write_kb":55082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"36'406","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699401+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T16:00:51.699401+0000","last_peered":"2024-04-25T16:00:51.699401+0000","last_clean":"2024-04-25T16:00:51.699401+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T16:00:51.699401+0000","last_undegraded":"2024-04-25T16:00:51.699401+0000","last_fullsized":"2024-04-25T16:00:51.699401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24863,"num_write":384,"num_write_kb":75591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"31'420","reported_seq":503,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562491+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T16:00:43.562491+0000","last_peered":"2024-04-25T16:00:43.562491+0000","last_clean":"2024-04-25T16:00:43.562491+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T16:00:43.562491+0000","last_undegraded":"2024-04-25T16:00:43.562491+0000","last_fullsized":"2024-04-25T16:00:43.562491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20260,"num_write":395,"num_write_kb":76151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'416","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707524+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T16:00:51.707524+0000","last_peered":"2024-04-25T16:00:51.707524+0000","last_clean":"2024-04-25T16:00:51.707524+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T16:00:51.707524+0000","last_undegraded":"2024-04-25T16:00:51.707524+0000","last_fullsized":"2024-04-25T16:00:51.707524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24467,"num_write":391,"num_write_kb":79816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"31'404","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562708+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T16:00:43.562708+0000","last_peered":"2024-04-25T16:00:43.562708+0000","last_clean":"2024-04-25T16:00:43.562708+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T16:00:43.562708+0000","last_undegraded":"2024-04-25T16:00:43.562708+0000","last_fullsized":"2024-04-25T16:00:43.562708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25761,"num_write":377,"num_write_kb":87528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"36'432","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705538+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T16:00:51.705538+0000","last_peered":"2024-04-25T16:00:51.705538+0000","last_clean":"2024-04-25T16:00:51.705538+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T16:00:51.705538+0000","last_undegraded":"2024-04-25T16:00:51.705538+0000","last_fullsized":"2024-04-25T16:00:51.705538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":33533,"num_write":410,"num_write_kb":87842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"31'400","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562996+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T16:00:43.562996+0000","last_peered":"2024-04-25T16:00:43.562996+0000","last_clean":"2024-04-25T16:00:43.562996+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T16:00:43.562996+0000","last_undegraded":"2024-04-25T16:00:43.562996+0000","last_fullsized":"2024-04-25T16:00:43.562996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29549,"num_write":386,"num_write_kb":55194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"36'394","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689283+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T16:00:51.689283+0000","last_peered":"2024-04-25T16:00:51.689283+0000","last_clean":"2024-04-25T16:00:51.689283+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T16:00:51.689283+0000","last_undegraded":"2024-04-25T16:00:51.689283+0000","last_fullsized":"2024-04-25T16:00:51.689283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46746,"num_write":370,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"31'338","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618796+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T16:00:43.618796+0000","last_peered":"2024-04-25T16:00:43.618796+0000","last_clean":"2024-04-25T16:00:43.618796+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T16:00:43.618796+0000","last_undegraded":"2024-04-25T16:00:43.618796+0000","last_fullsized":"2024-04-25T16:00:43.618796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9201,"num_write":322,"num_write_kb":37990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"36'397","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701141+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T16:00:51.701141+0000","last_peered":"2024-04-25T16:00:51.701141+0000","last_clean":"2024-04-25T16:00:51.701141+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T16:00:51.701141+0000","last_undegraded":"2024-04-25T16:00:51.701141+0000","last_fullsized":"2024-04-25T16:00:51.701141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14146,"num_write":373,"num_write_kb":38796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"31'395","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576883+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T16:00:43.576883+0000","last_peered":"2024-04-25T16:00:43.576883+0000","last_clean":"2024-04-25T16:00:43.576883+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T16:00:43.576883+0000","last_undegraded":"2024-04-25T16:00:43.576883+0000","last_fullsized":"2024-04-25T16:00:43.576883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":61604,"num_write":383,"num_write_kb":95809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"36'373","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583502+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T16:00:43.583502+0000","last_peered":"2024-04-25T16:00:43.583502+0000","last_clean":"2024-04-25T16:00:43.583502+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T16:00:43.583502+0000","last_undegraded":"2024-04-25T16:00:43.583502+0000","last_fullsized":"2024-04-25T16:00:43.583502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13278,"num_write":350,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"31'383","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585454+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T16:00:43.585454+0000","last_peered":"2024-04-25T16:00:43.585454+0000","last_clean":"2024-04-25T16:00:43.585454+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T16:00:43.585454+0000","last_undegraded":"2024-04-25T16:00:43.585454+0000","last_fullsized":"2024-04-25T16:00:43.585454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4096,"num_write":350,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'356","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684443+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T16:00:51.684443+0000","last_peered":"2024-04-25T16:00:51.684443+0000","last_clean":"2024-04-25T16:00:51.684443+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T16:00:51.684443+0000","last_undegraded":"2024-04-25T16:00:51.684443+0000","last_fullsized":"2024-04-25T16:00:51.684443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19489,"num_write":338,"num_write_kb":75079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"31'369","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557847+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T16:00:43.557847+0000","last_peered":"2024-04-25T16:00:43.557847+0000","last_clean":"2024-04-25T16:00:43.557847+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T16:00:43.557847+0000","last_undegraded":"2024-04-25T16:00:43.557847+0000","last_fullsized":"2024-04-25T16:00:43.557847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1693,"num_write":344,"num_write_kb":38100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"36'368","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706369+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T16:00:51.706369+0000","last_peered":"2024-04-25T16:00:51.706369+0000","last_clean":"2024-04-25T16:00:51.706369+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T16:00:51.706369+0000","last_undegraded":"2024-04-25T16:00:51.706369+0000","last_fullsized":"2024-04-25T16:00:51.706369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25999,"num_write":356,"num_write_kb":38429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"31'447","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576302+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T16:00:43.576302+0000","last_peered":"2024-04-25T16:00:43.576302+0000","last_clean":"2024-04-25T16:00:43.576302+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T16:00:43.576302+0000","last_undegraded":"2024-04-25T16:00:43.576302+0000","last_fullsized":"2024-04-25T16:00:43.576302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38032,"num_write":427,"num_write_kb":75902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"36'382","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681204+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T16:00:51.681204+0000","last_peered":"2024-04-25T16:00:51.681204+0000","last_clean":"2024-04-25T16:00:51.681204+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T16:00:51.681204+0000","last_undegraded":"2024-04-25T16:00:51.681204+0000","last_fullsized":"2024-04-25T16:00:51.681204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33238,"num_write":360,"num_write_kb":83325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"31'430","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618117+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T16:00:43.618117+0000","last_peered":"2024-04-25T16:00:43.618117+0000","last_clean":"2024-04-25T16:00:43.618117+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T16:00:43.618117+0000","last_undegraded":"2024-04-25T16:00:43.618117+0000","last_fullsized":"2024-04-25T16:00:43.618117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47776,"num_write":403,"num_write_kb":100333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"36'419","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.682360+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T16:00:51.682360+0000","last_peered":"2024-04-25T16:00:51.682360+0000","last_clean":"2024-04-25T16:00:51.682360+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T16:00:51.682360+0000","last_undegraded":"2024-04-25T16:00:51.682360+0000","last_fullsized":"2024-04-25T16:00:51.682360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31054,"num_write":404,"num_write_kb":100026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"31'457","reported_seq":596,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583419+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T16:00:43.583419+0000","last_peered":"2024-04-25T16:00:43.583419+0000","last_clean":"2024-04-25T16:00:43.583419+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T16:00:43.583419+0000","last_undegraded":"2024-04-25T16:00:43.583419+0000","last_fullsized":"2024-04-25T16:00:43.583419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56462,"num_write":435,"num_write_kb":97259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"36'357","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698267+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T16:00:51.698267+0000","last_peered":"2024-04-25T16:00:51.698267+0000","last_clean":"2024-04-25T16:00:51.698267+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T16:00:51.698267+0000","last_undegraded":"2024-04-25T16:00:51.698267+0000","last_fullsized":"2024-04-25T16:00:51.698267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9534,"num_write":325,"num_write_kb":26581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"31'417","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562885+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T16:00:43.562885+0000","last_peered":"2024-04-25T16:00:43.562885+0000","last_clean":"2024-04-25T16:00:43.562885+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T16:00:43.562885+0000","last_undegraded":"2024-04-25T16:00:43.562885+0000","last_fullsized":"2024-04-25T16:00:43.562885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28935,"num_write":390,"num_write_kb":55220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"36'446","reported_seq":557,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571000+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T16:00:43.571000+0000","last_peered":"2024-04-25T16:00:43.571000+0000","last_clean":"2024-04-25T16:00:43.571000+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T16:00:43.571000+0000","last_undegraded":"2024-04-25T16:00:43.571000+0000","last_fullsized":"2024-04-25T16:00:43.571000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":18239,"num_write":428,"num_write_kb":69651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"31'386","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562548+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T16:00:43.562548+0000","last_peered":"2024-04-25T16:00:43.562548+0000","last_clean":"2024-04-25T16:00:43.562548+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T16:00:43.562548+0000","last_undegraded":"2024-04-25T16:00:43.562548+0000","last_fullsized":"2024-04-25T16:00:43.562548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8859,"num_write":358,"num_write_kb":46267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'391","reported_seq":488,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676568+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T16:00:51.676568+0000","last_peered":"2024-04-25T16:00:51.676568+0000","last_clean":"2024-04-25T16:00:51.676568+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T16:00:51.676568+0000","last_undegraded":"2024-04-25T16:00:51.676568+0000","last_fullsized":"2024-04-25T16:00:51.676568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32236,"num_write":374,"num_write_kb":95777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"31'357","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619677+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T16:00:43.619677+0000","last_peered":"2024-04-25T16:00:43.619677+0000","last_clean":"2024-04-25T16:00:43.619677+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T16:00:43.619677+0000","last_undegraded":"2024-04-25T16:00:43.619677+0000","last_fullsized":"2024-04-25T16:00:43.619677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22705,"num_write":334,"num_write_kb":38119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"36'425","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.668379+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T16:00:51.668379+0000","last_peered":"2024-04-25T16:00:51.668379+0000","last_clean":"2024-04-25T16:00:51.668379+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T16:00:51.668379+0000","last_undegraded":"2024-04-25T16:00:51.668379+0000","last_fullsized":"2024-04-25T16:00:51.668379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22941,"num_write":404,"num_write_kb":72501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"31'377","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582939+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T16:00:43.582939+0000","last_peered":"2024-04-25T16:00:43.582939+0000","last_clean":"2024-04-25T16:00:43.582939+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T16:00:43.582939+0000","last_undegraded":"2024-04-25T16:00:43.582939+0000","last_fullsized":"2024-04-25T16:00:43.582939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10994,"num_write":357,"num_write_kb":50723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'404","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701848+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T16:00:51.701848+0000","last_peered":"2024-04-25T16:00:51.701848+0000","last_clean":"2024-04-25T16:00:51.701848+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T16:00:51.701848+0000","last_undegraded":"2024-04-25T16:00:51.701848+0000","last_fullsized":"2024-04-25T16:00:51.701848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11471,"num_write":379,"num_write_kb":75857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557154+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T16:00:43.557154+0000","last_peered":"2024-04-25T16:00:43.557154+0000","last_clean":"2024-04-25T16:00:43.557154+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T16:00:43.557154+0000","last_undegraded":"2024-04-25T16:00:43.557154+0000","last_fullsized":"2024-04-25T16:00:43.557154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20101,"num_write":381,"num_write_kb":55469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"35'349","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570822+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T16:00:43.570822+0000","last_peered":"2024-04-25T16:00:43.570822+0000","last_clean":"2024-04-25T16:00:43.570822+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T16:00:43.570822+0000","last_undegraded":"2024-04-25T16:00:43.570822+0000","last_fullsized":"2024-04-25T16:00:43.570822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9293,"num_write":327,"num_write_kb":37967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"31'359","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569043+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T16:00:43.569043+0000","last_peered":"2024-04-25T16:00:43.569043+0000","last_clean":"2024-04-25T16:00:43.569043+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T16:00:43.569043+0000","last_undegraded":"2024-04-25T16:00:43.569043+0000","last_fullsized":"2024-04-25T16:00:43.569043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33728,"num_write":336,"num_write_kb":95963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675862+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T16:00:51.675862+0000","last_peered":"2024-04-25T16:00:51.675862+0000","last_clean":"2024-04-25T16:00:51.675862+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T16:00:51.675862+0000","last_undegraded":"2024-04-25T16:00:51.675862+0000","last_fullsized":"2024-04-25T16:00:51.675862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15261,"num_write":373,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"31'453","reported_seq":603,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569482+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T16:00:43.569482+0000","last_peered":"2024-04-25T16:00:43.569482+0000","last_clean":"2024-04-25T16:00:43.569482+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T16:00:43.569482+0000","last_undegraded":"2024-04-25T16:00:43.569482+0000","last_fullsized":"2024-04-25T16:00:43.569482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":65459,"num_write":436,"num_write_kb":138981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"36'408","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.578583+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T16:00:43.578583+0000","last_peered":"2024-04-25T16:00:43.578583+0000","last_clean":"2024-04-25T16:00:43.578583+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T16:00:43.578583+0000","last_undegraded":"2024-04-25T16:00:43.578583+0000","last_fullsized":"2024-04-25T16:00:43.578583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":41811,"num_write":385,"num_write_kb":100198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2984,"num_read_kb":1496873,"num_write":24473,"num_write_kb":4464601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25921,"ondisk_log_size":25921,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":131985636,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":525,"num_read_kb":323765,"num_write":7010,"num_write_kb":134510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":264028160,"data_stored":263971272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8506,"ondisk_log_size":8506,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2716,"num_read_kb":1480093,"num_write":24434,"num_write_kb":4326556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25980,"ondisk_log_size":25980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":136622360,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":754,"num_read_kb":436547,"num_write":9520,"num_write_kb":140553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":273309696,"data_stored":273244720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11090,"ondisk_log_size":11090,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133788,"kb_used_data":66516,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94238052,"statfs":{"total":96636764160,"available":96499765248,"internally_reserved":0,"allocated":68112384,"data_stored":67887709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163488,"kb_used_data":78232,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94208352,"statfs":{"total":96636764160,"available":96469352448,"internally_reserved":0,"allocated":80109568,"data_stored":79880869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141440,"kb_used_data":43704,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94230400,"statfs":{"total":96636764160,"available":96491929600,"internally_reserved":0,"allocated":44752896,"data_stored":44525982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185596,"kb_used_data":91956,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94186244,"statfs":{"total":96636764160,"available":96446713856,"internally_reserved":0,"allocated":94162944,"data_stored":93928717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172076,"kb_used_data":96548,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94199764,"statfs":{"total":96636764160,"available":96460558336,"internally_reserved":0,"allocated":98865152,"data_stored":98627692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":22855680,"data_stored":22634176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173140,"kb_used_data":83724,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94198700,"statfs":{"total":96636764160,"available":96459468800,"internally_reserved":0,"allocated":85733376,"data_stored":85497868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131296,"kb_used_data":46040,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94240544,"statfs":{"total":96636764160,"available":96502317056,"internally_reserved":0,"allocated":47144960,"data_stored":46916155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30298112,"data_stored":30288669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9867264,"data_stored":9863389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35041280,"data_stored":35029885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26099712,"data_stored":26094295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46145536,"data_stored":46138016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":55021394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63422464,"data_stored":63410002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47611904,"data_stored":47603442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18243882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:01:16.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:01:16.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 Processor -- start 2024-04-25T16:01:16.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 -- start start 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0281578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa028157e10 0x7fa028161d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0281518b0 con 0x7fa0280726d0 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa028070440 con 0x7fa028157e10 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02f740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa0280701a0 con 0x7fa0281514a0 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa028157e10 0x7fa028161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa028157e10 0x7fa028161d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51696/0 (socket says 172.21.15.87:51696) 2024-04-25T16:01:16.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 -- 172.21.15.87:0/1115499846 learned_addr learned my addr 172.21.15.87:0/1115499846 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02ccdb640 1 --2- 172.21.15.87:0/1115499846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0281578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 -- 172.21.15.87:0/1115499846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 msgr2=0x7fa0281578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 --2- 172.21.15.87:0/1115499846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0281578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 -- 172.21.15.87:0/1115499846 >> v1:172.21.15.155:6789/0 conn(0x7fa0280726d0 legacy=0x7fa02806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.312+0000 7fa02dcdd640 1 -- 172.21.15.87:0/1115499846 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02815a9c0 con 0x7fa028157e10 2024-04-25T16:01:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02dcdd640 1 --2- 172.21.15.87:0/1115499846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa028157e10 0x7fa028161d50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa028072ae0 tx=0x7fa02001c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9517b4e43c2feb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:16.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa01ffff640 1 -- 172.21.15.87:0/1115499846 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200ac020 con 0x7fa028157e10 2024-04-25T16:01:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa01ffff640 1 -- 172.21.15.87:0/1115499846 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0200a6450 con 0x7fa028157e10 2024-04-25T16:01:16.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa01ffff640 1 -- 172.21.15.87:0/1115499846 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200a6820 con 0x7fa028157e10 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 -- 172.21.15.87:0/1115499846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa028157e10 msgr2=0x7fa028161d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 --2- 172.21.15.87:0/1115499846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa028157e10 0x7fa028161d50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa028072ae0 tx=0x7fa02001c6d0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 -- 172.21.15.87:0/1115499846 shutdown_connections 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 --2- 172.21.15.87:0/1115499846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0281578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 --2- 172.21.15.87:0/1115499846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa028157e10 0x7fa028161d50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 -- 172.21.15.87:0/1115499846 >> 172.21.15.87:0/1115499846 conn(0x7fa02806c670 msgr2=0x7fa02806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 -- 172.21.15.87:0/1115499846 shutdown_connections 2024-04-25T16:01:16.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.316+0000 7fa02f740640 1 -- 172.21.15.87:0/1115499846 wait complete. 2024-04-25T16:01:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 Processor -- start 2024-04-25T16:01:16.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 -- start start 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 0x7fa028148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0280acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa028157e10 0x7fa028145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa028158220 con 0x7fa0280726d0 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0280c33f0 con 0x7fa028157e10 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa02806db50 con 0x7fa0281514a0 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 0x7fa028148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 0x7fa028148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51706/0 (socket says 172.21.15.87:51706) 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 -- 172.21.15.87:0/3747127145 learned_addr learned my addr 172.21.15.87:0/3747127145 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:16.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02dcdd640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa028157e10 0x7fa028145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 -- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 msgr2=0x7fa0280acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02ccdb640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0280acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0280acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 -- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa028157e10 msgr2=0x7fa028145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa028157e10 0x7fa028145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 -- 172.21.15.87:0/3747127145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa028157200 con 0x7fa0280726d0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02d4dc640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 0x7fa028148cd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa02400c3f0 tx=0x7fa02400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa024011790 con 0x7fa0280726d0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa024017070 con 0x7fa0280726d0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0281f4af0 con 0x7fa0280726d0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa024011b70 con 0x7fa0280726d0 2024-04-25T16:01:16.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.320+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0280ac770 con 0x7fa0280726d0 2024-04-25T16:01:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.324+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa028069bb0 con 0x7fa0280726d0 2024-04-25T16:01:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.324+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa024011d10 con 0x7fa0280726d0 2024-04-25T16:01:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.324+0000 7fa01dffb640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa00c06f400 0x7fa00c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.324+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fa02408f4a0 con 0x7fa0280726d0 2024-04-25T16:01:16.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.324+0000 7fa02ccdb640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa00c06f400 0x7fa00c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.324+0000 7fa02ccdb640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa00c06f400 0x7fa00c071910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa02814fdb0 tx=0x7fa018008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:16.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.328+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa024021020 con 0x7fa0280726d0 2024-04-25T16:01:16.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.492+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa02814fb90 con 0x7fa00c06f400 2024-04-25T16:01:16.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.508+0000 7fa01dffb640 1 -- 172.21.15.87:0/3747127145 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494241 (secure 0 0 0) 0x7fa01800e4c0 con 0x7fa00c06f400 2024-04-25T16:01:16.516 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:16.519 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T16:01:16.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa00c06f400 msgr2=0x7fa00c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa00c06f400 0x7fa00c071910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa02814fdb0 tx=0x7fa018008040 comp rx=0 tx=0).stop 2024-04-25T16:01:16.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 msgr2=0x7fa028148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 0x7fa028148cd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa02400c3f0 tx=0x7fa02400c8b0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 shutdown_connections 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa00c06f400 0x7fa00c071910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa028157e10 0x7fa028145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0281514a0 0x7fa0280acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 --2- 172.21.15.87:0/3747127145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0280726d0 0x7fa028148cd0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 >> 172.21.15.87:0/3747127145 conn(0x7fa02806c670 msgr2=0x7fa02806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 shutdown_connections 2024-04-25T16:01:16.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.516+0000 7fa02f740640 1 -- 172.21.15.87:0/3747127145 wait complete. 2024-04-25T16:01:16.540 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-25T16:01:15.277899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269198364,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7045,"num_read_kb":3737333,"num_write":65538,"num_write_kb":9067848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71569,"ondisk_log_size":71569,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1176528,"kb_used_data":529040,"kb_used_omap":12,"kb_used_meta":647411,"kb_avail":753798192,"statfs":{"total":773094113280,"available":771889348608,"internally_reserved":0,"allocated":541736960,"data_stored":539899168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":662949425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":189,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006109"},"pg_stats":[{"pgid":"5.18","version":"31'448","reported_seq":541,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560090+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T16:00:43.560090+0000","last_peered":"2024-04-25T16:00:43.560090+0000","last_clean":"2024-04-25T16:00:43.560090+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T16:00:43.560090+0000","last_undegraded":"2024-04-25T16:00:43.560090+0000","last_fullsized":"2024-04-25T16:00:43.560090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27881,"num_write":426,"num_write_kb":76310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"36'1437","reported_seq":1504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.593401+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T16:00:51.593401+0000","last_peered":"2024-04-25T16:00:51.593401+0000","last_clean":"2024-04-25T16:00:51.593401+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T16:00:51.593401+0000","last_undegraded":"2024-04-25T16:00:51.593401+0000","last_fullsized":"2024-04-25T16:00:51.593401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":18411,"num_write":1381,"num_write_kb":5019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'392","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.695464+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T16:00:51.695464+0000","last_peered":"2024-04-25T16:00:51.695464+0000","last_clean":"2024-04-25T16:00:51.695464+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T16:00:51.695464+0000","last_undegraded":"2024-04-25T16:00:51.695464+0000","last_fullsized":"2024-04-25T16:00:51.695464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12356,"num_write":363,"num_write_kb":47533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'229","reported_seq":271,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583062+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T16:00:43.583062+0000","last_peered":"2024-04-25T16:00:43.583062+0000","last_clean":"2024-04-25T16:00:43.583062+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T16:00:43.583062+0000","last_undegraded":"2024-04-25T16:00:43.583062+0000","last_fullsized":"2024-04-25T16:00:43.583062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":183,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'392","reported_seq":484,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562446+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T16:00:43.562446+0000","last_peered":"2024-04-25T16:00:43.562446+0000","last_clean":"2024-04-25T16:00:43.562446+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T16:00:43.562446+0000","last_undegraded":"2024-04-25T16:00:43.562446+0000","last_fullsized":"2024-04-25T16:00:43.562446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30984,"num_write":367,"num_write_kb":33760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"34'215","reported_seq":268,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.586373+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T16:00:43.586373+0000","last_peered":"2024-04-25T16:00:43.586373+0000","last_clean":"2024-04-25T16:00:43.586373+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T16:00:43.586373+0000","last_undegraded":"2024-04-25T16:00:43.586373+0000","last_fullsized":"2024-04-25T16:00:43.586373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":163,"num_write_kb":4188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'349","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570978+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T16:00:43.570978+0000","last_peered":"2024-04-25T16:00:43.570978+0000","last_clean":"2024-04-25T16:00:43.570978+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T16:00:43.570978+0000","last_undegraded":"2024-04-25T16:00:43.570978+0000","last_fullsized":"2024-04-25T16:00:43.570978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5423,"num_write":327,"num_write_kb":34935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'1396","reported_seq":1441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561108+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T16:00:43.561108+0000","last_peered":"2024-04-25T16:00:43.561108+0000","last_clean":"2024-04-25T16:00:43.561108+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T16:00:43.561108+0000","last_undegraded":"2024-04-25T16:00:43.561108+0000","last_fullsized":"2024-04-25T16:00:43.561108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1396,"log_dups_size":0,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1329,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"31'398","reported_seq":458,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576915+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T16:00:43.576915+0000","last_peered":"2024-04-25T16:00:43.576915+0000","last_clean":"2024-04-25T16:00:43.576915+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T16:00:43.576915+0000","last_undegraded":"2024-04-25T16:00:43.576915+0000","last_fullsized":"2024-04-25T16:00:43.576915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14376,"num_write":371,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"36'383","reported_seq":450,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681810+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T16:00:51.681810+0000","last_peered":"2024-04-25T16:00:51.681810+0000","last_clean":"2024-04-25T16:00:51.681810+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T16:00:51.681810+0000","last_undegraded":"2024-04-25T16:00:51.681810+0000","last_fullsized":"2024-04-25T16:00:51.681810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":45080,"num_write":303,"num_write_kb":12463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'366","reported_seq":455,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.623210+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T16:00:43.623210+0000","last_peered":"2024-04-25T16:00:43.623210+0000","last_clean":"2024-04-25T16:00:43.623210+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T16:00:43.623210+0000","last_undegraded":"2024-04-25T16:00:43.623210+0000","last_fullsized":"2024-04-25T16:00:43.623210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24540,"num_write":344,"num_write_kb":42834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'118","reported_seq":161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563312+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T16:00:43.563312+0000","last_peered":"2024-04-25T16:00:43.563312+0000","last_clean":"2024-04-25T16:00:43.563312+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T16:00:43.563312+0000","last_undegraded":"2024-04-25T16:00:43.563312+0000","last_fullsized":"2024-04-25T16:00:43.563312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":59,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'379","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618798+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T16:00:43.618798+0000","last_peered":"2024-04-25T16:00:43.618798+0000","last_clean":"2024-04-25T16:00:43.618798+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T16:00:43.618798+0000","last_undegraded":"2024-04-25T16:00:43.618798+0000","last_fullsized":"2024-04-25T16:00:43.618798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17536,"num_write":366,"num_write_kb":55228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"36'361","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.625597+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T16:00:51.625597+0000","last_peered":"2024-04-25T16:00:51.625597+0000","last_clean":"2024-04-25T16:00:51.625597+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T16:00:51.625597+0000","last_undegraded":"2024-04-25T16:00:51.625597+0000","last_fullsized":"2024-04-25T16:00:51.625597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":312,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'376","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.697044+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T16:00:51.697044+0000","last_peered":"2024-04-25T16:00:51.697044+0000","last_clean":"2024-04-25T16:00:51.697044+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T16:00:51.697044+0000","last_undegraded":"2024-04-25T16:00:51.697044+0000","last_fullsized":"2024-04-25T16:00:51.697044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31362,"num_write":348,"num_write_kb":63308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'407","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566429+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T16:00:43.566429+0000","last_peered":"2024-04-25T16:00:43.566429+0000","last_clean":"2024-04-25T16:00:43.566429+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T16:00:43.566429+0000","last_undegraded":"2024-04-25T16:00:43.566429+0000","last_fullsized":"2024-04-25T16:00:43.566429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":355,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'439","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563561+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T16:00:43.563561+0000","last_peered":"2024-04-25T16:00:43.563561+0000","last_clean":"2024-04-25T16:00:43.563561+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T16:00:43.563561+0000","last_undegraded":"2024-04-25T16:00:43.563561+0000","last_fullsized":"2024-04-25T16:00:43.563561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15953,"num_write":415,"num_write_kb":91831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"36'454","reported_seq":581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708278+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T16:00:51.708278+0000","last_peered":"2024-04-25T16:00:51.708278+0000","last_clean":"2024-04-25T16:00:51.708278+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T16:00:51.708278+0000","last_undegraded":"2024-04-25T16:00:51.708278+0000","last_fullsized":"2024-04-25T16:00:51.708278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":34259,"num_write":426,"num_write_kb":109355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'209","reported_seq":273,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.604101+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T16:00:51.604101+0000","last_peered":"2024-04-25T16:00:51.604101+0000","last_clean":"2024-04-25T16:00:51.604101+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T16:00:51.604101+0000","last_undegraded":"2024-04-25T16:00:51.604101+0000","last_fullsized":"2024-04-25T16:00:51.604101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":32780,"num_write":144,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'517","reported_seq":566,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563985+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T16:00:43.563985+0000","last_peered":"2024-04-25T16:00:43.563985+0000","last_clean":"2024-04-25T16:00:43.563985+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T16:00:43.563985+0000","last_undegraded":"2024-04-25T16:00:43.563985+0000","last_fullsized":"2024-04-25T16:00:43.563985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":469,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'399","reported_seq":479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558965+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T16:00:43.558965+0000","last_peered":"2024-04-25T16:00:43.558965+0000","last_clean":"2024-04-25T16:00:43.558965+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T16:00:43.558965+0000","last_undegraded":"2024-04-25T16:00:43.558965+0000","last_fullsized":"2024-04-25T16:00:43.558965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":26873,"num_write":378,"num_write_kb":71246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"35'429","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584166+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T16:00:43.584166+0000","last_peered":"2024-04-25T16:00:43.584166+0000","last_clean":"2024-04-25T16:00:43.584166+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T16:00:43.584166+0000","last_undegraded":"2024-04-25T16:00:43.584166+0000","last_fullsized":"2024-04-25T16:00:43.584166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42040,"num_write":408,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"34'200","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565925+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T16:00:43.565925+0000","last_peered":"2024-04-25T16:00:43.565925+0000","last_clean":"2024-04-25T16:00:43.565925+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T16:00:43.565925+0000","last_undegraded":"2024-04-25T16:00:43.565925+0000","last_fullsized":"2024-04-25T16:00:43.565925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'60","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567637+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T16:00:43.567637+0000","last_peered":"2024-04-25T16:00:43.567637+0000","last_clean":"2024-04-25T16:00:43.567637+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T16:00:43.567637+0000","last_undegraded":"2024-04-25T16:00:43.567637+0000","last_fullsized":"2024-04-25T16:00:43.567637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'380","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565677+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T16:00:43.565677+0000","last_peered":"2024-04-25T16:00:43.565677+0000","last_clean":"2024-04-25T16:00:43.565677+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T16:00:43.565677+0000","last_undegraded":"2024-04-25T16:00:43.565677+0000","last_fullsized":"2024-04-25T16:00:43.565677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24884,"num_write":362,"num_write_kb":71575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"35'377","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585642+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T16:00:43.585642+0000","last_peered":"2024-04-25T16:00:43.585642+0000","last_clean":"2024-04-25T16:00:43.585642+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T16:00:43.585642+0000","last_undegraded":"2024-04-25T16:00:43.585642+0000","last_fullsized":"2024-04-25T16:00:43.585642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7657,"num_write":351,"num_write_kb":21765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'69","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564212+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T16:00:43.564212+0000","last_peered":"2024-04-25T16:00:43.564212+0000","last_clean":"2024-04-25T16:00:43.564212+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T16:00:43.564212+0000","last_undegraded":"2024-04-25T16:00:43.564212+0000","last_fullsized":"2024-04-25T16:00:43.564212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'194","reported_seq":241,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":146,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"31'395","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620509+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T16:00:43.620509+0000","last_peered":"2024-04-25T16:00:43.620509+0000","last_clean":"2024-04-25T16:00:43.620509+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T16:00:43.620509+0000","last_undegraded":"2024-04-25T16:00:43.620509+0000","last_fullsized":"2024-04-25T16:00:43.620509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23834,"num_write":371,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"36'432","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699888+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T16:00:51.699888+0000","last_peered":"2024-04-25T16:00:51.699888+0000","last_clean":"2024-04-25T16:00:51.699888+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T16:00:51.699888+0000","last_undegraded":"2024-04-25T16:00:51.699888+0000","last_fullsized":"2024-04-25T16:00:51.699888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1051,"num_write":404,"num_write_kb":46183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"35'633","reported_seq":685,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.573910+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T16:00:43.573910+0000","last_peered":"2024-04-25T16:00:43.573910+0000","last_clean":"2024-04-25T16:00:43.573910+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T16:00:43.573910+0000","last_undegraded":"2024-04-25T16:00:43.573910+0000","last_fullsized":"2024-04-25T16:00:43.573910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":576,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'339","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566182+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T16:00:43.566182+0000","last_peered":"2024-04-25T16:00:43.566182+0000","last_clean":"2024-04-25T16:00:43.566182+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T16:00:43.566182+0000","last_undegraded":"2024-04-25T16:00:43.566182+0000","last_fullsized":"2024-04-25T16:00:43.566182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":287,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"31'408","reported_seq":519,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582757+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T16:00:43.582757+0000","last_peered":"2024-04-25T16:00:43.582757+0000","last_clean":"2024-04-25T16:00:43.582757+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T16:00:43.582757+0000","last_undegraded":"2024-04-25T16:00:43.582757+0000","last_fullsized":"2024-04-25T16:00:43.582757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":22153,"num_write":390,"num_write_kb":51497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"36'445","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702477+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T16:00:51.702477+0000","last_peered":"2024-04-25T16:00:51.702477+0000","last_clean":"2024-04-25T16:00:51.702477+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T16:00:51.702477+0000","last_undegraded":"2024-04-25T16:00:51.702477+0000","last_fullsized":"2024-04-25T16:00:51.702477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9563,"num_write":414,"num_write_kb":59478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'72","reported_seq":130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.629231+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T16:00:51.629231+0000","last_peered":"2024-04-25T16:00:51.629231+0000","last_clean":"2024-04-25T16:00:51.629231+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T16:00:51.629231+0000","last_undegraded":"2024-04-25T16:00:51.629231+0000","last_fullsized":"2024-04-25T16:00:51.629231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'291","reported_seq":548,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561716+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T16:00:43.561716+0000","last_peered":"2024-04-25T16:00:43.561716+0000","last_clean":"2024-04-25T16:00:43.561716+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T16:00:43.561716+0000","last_undegraded":"2024-04-25T16:00:43.561716+0000","last_fullsized":"2024-04-25T16:00:43.561716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465994,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":1569,"num_write":227,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"31'396","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559745+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T16:00:43.559745+0000","last_peered":"2024-04-25T16:00:43.559745+0000","last_clean":"2024-04-25T16:00:43.559745+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T16:00:43.559745+0000","last_undegraded":"2024-04-25T16:00:43.559745+0000","last_fullsized":"2024-04-25T16:00:43.559745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17201,"num_write":368,"num_write_kb":116540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'348","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584481+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T16:00:43.584481+0000","last_peered":"2024-04-25T16:00:43.584481+0000","last_clean":"2024-04-25T16:00:43.584481+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T16:00:43.584481+0000","last_undegraded":"2024-04-25T16:00:43.584481+0000","last_fullsized":"2024-04-25T16:00:43.584481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11261,"num_write":326,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"36'220","reported_seq":277,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707128+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T16:00:51.707128+0000","last_peered":"2024-04-25T16:00:51.707128+0000","last_clean":"2024-04-25T16:00:51.707128+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T16:00:51.707128+0000","last_undegraded":"2024-04-25T16:00:51.707128+0000","last_fullsized":"2024-04-25T16:00:51.707128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":264,"num_write":447,"num_write_kb":1604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"35'415","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582806+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T16:00:43.582806+0000","last_peered":"2024-04-25T16:00:43.582806+0000","last_clean":"2024-04-25T16:00:43.582806+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T16:00:43.582806+0000","last_undegraded":"2024-04-25T16:00:43.582806+0000","last_fullsized":"2024-04-25T16:00:43.582806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":348,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"31'355","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569759+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T16:00:43.569759+0000","last_peered":"2024-04-25T16:00:43.569759+0000","last_clean":"2024-04-25T16:00:43.569759+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T16:00:43.569759+0000","last_undegraded":"2024-04-25T16:00:43.569759+0000","last_fullsized":"2024-04-25T16:00:43.569759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":811,"num_write":334,"num_write_kb":50274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"36'395","reported_seq":478,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691697+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T16:00:51.691697+0000","last_peered":"2024-04-25T16:00:51.691697+0000","last_clean":"2024-04-25T16:00:51.691697+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T16:00:51.691697+0000","last_undegraded":"2024-04-25T16:00:51.691697+0000","last_fullsized":"2024-04-25T16:00:51.691697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17222,"num_write":367,"num_write_kb":107915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'211","reported_seq":262,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:46.021660+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T16:00:46.021660+0000","last_peered":"2024-04-25T16:00:46.021660+0000","last_clean":"2024-04-25T16:00:46.021660+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T16:00:46.021660+0000","last_undegraded":"2024-04-25T16:00:46.021660+0000","last_fullsized":"2024-04-25T16:00:46.021660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":156,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'73","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567937+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T16:00:43.567937+0000","last_peered":"2024-04-25T16:00:43.567937+0000","last_clean":"2024-04-25T16:00:43.567937+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T16:00:43.567937+0000","last_undegraded":"2024-04-25T16:00:43.567937+0000","last_fullsized":"2024-04-25T16:00:43.567937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'419","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569029+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T16:00:43.569029+0000","last_peered":"2024-04-25T16:00:43.569029+0000","last_clean":"2024-04-25T16:00:43.569029+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T16:00:43.569029+0000","last_undegraded":"2024-04-25T16:00:43.569029+0000","last_fullsized":"2024-04-25T16:00:43.569029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":27915,"num_write":400,"num_write_kb":113619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'436","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.703284+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T16:00:51.703284+0000","last_peered":"2024-04-25T16:00:51.703284+0000","last_clean":"2024-04-25T16:00:51.703284+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T16:00:51.703284+0000","last_undegraded":"2024-04-25T16:00:51.703284+0000","last_fullsized":"2024-04-25T16:00:51.703284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48041,"num_write":405,"num_write_kb":79758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'60","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564266+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T16:00:43.564266+0000","last_peered":"2024-04-25T16:00:43.564266+0000","last_clean":"2024-04-25T16:00:43.564266+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T16:00:43.564266+0000","last_undegraded":"2024-04-25T16:00:43.564266+0000","last_fullsized":"2024-04-25T16:00:43.564266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'647","reported_seq":695,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564966+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T16:00:43.564966+0000","last_peered":"2024-04-25T16:00:43.564966+0000","last_clean":"2024-04-25T16:00:43.564966+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T16:00:43.564966+0000","last_undegraded":"2024-04-25T16:00:43.564966+0000","last_fullsized":"2024-04-25T16:00:43.564966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":21962,"num_write":588,"num_write_kb":8473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'398","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570717+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T16:00:43.570717+0000","last_peered":"2024-04-25T16:00:43.570717+0000","last_clean":"2024-04-25T16:00:43.570717+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T16:00:43.570717+0000","last_undegraded":"2024-04-25T16:00:43.570717+0000","last_fullsized":"2024-04-25T16:00:43.570717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18043,"num_write":367,"num_write_kb":54591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'382","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565930+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T16:00:43.565930+0000","last_peered":"2024-04-25T16:00:43.565930+0000","last_clean":"2024-04-25T16:00:43.565930+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T16:00:43.565930+0000","last_undegraded":"2024-04-25T16:00:43.565930+0000","last_fullsized":"2024-04-25T16:00:43.565930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":351,"num_write_kb":26238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'641","reported_seq":698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.630615+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T16:00:43.630615+0000","last_peered":"2024-04-25T16:00:43.630615+0000","last_clean":"2024-04-25T16:00:43.630615+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T16:00:43.630615+0000","last_undegraded":"2024-04-25T16:00:43.630615+0000","last_fullsized":"2024-04-25T16:00:43.630615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":575,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'63","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563762+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T16:00:43.563762+0000","last_peered":"2024-04-25T16:00:43.563762+0000","last_clean":"2024-04-25T16:00:43.563762+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T16:00:43.563762+0000","last_undegraded":"2024-04-25T16:00:43.563762+0000","last_fullsized":"2024-04-25T16:00:43.563762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'417","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559349+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T16:00:43.559349+0000","last_peered":"2024-04-25T16:00:43.559349+0000","last_clean":"2024-04-25T16:00:43.559349+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T16:00:43.559349+0000","last_undegraded":"2024-04-25T16:00:43.559349+0000","last_fullsized":"2024-04-25T16:00:43.559349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":4695,"num_write":394,"num_write_kb":63230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'383","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562973+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T16:00:43.562973+0000","last_peered":"2024-04-25T16:00:43.562973+0000","last_clean":"2024-04-25T16:00:43.562973+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T16:00:43.562973+0000","last_undegraded":"2024-04-25T16:00:43.562973+0000","last_fullsized":"2024-04-25T16:00:43.562973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":357,"num_write_kb":25875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'325","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.575494+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T16:00:53.575494+0000","last_peered":"2024-04-25T16:00:53.575494+0000","last_clean":"2024-04-25T16:00:53.575494+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T16:00:53.575494+0000","last_undegraded":"2024-04-25T16:00:53.575494+0000","last_fullsized":"2024-04-25T16:00:53.575494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":1598,"num_write":259,"num_write_kb":1606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'73","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564080+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T16:00:43.564080+0000","last_peered":"2024-04-25T16:00:43.564080+0000","last_clean":"2024-04-25T16:00:43.564080+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T16:00:43.564080+0000","last_undegraded":"2024-04-25T16:00:43.564080+0000","last_fullsized":"2024-04-25T16:00:43.564080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'351","reported_seq":443,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621988+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T16:00:43.621988+0000","last_peered":"2024-04-25T16:00:43.621988+0000","last_clean":"2024-04-25T16:00:43.621988+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T16:00:43.621988+0000","last_undegraded":"2024-04-25T16:00:43.621988+0000","last_fullsized":"2024-04-25T16:00:43.621988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19848,"num_write":332,"num_write_kb":34180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"36'414","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.688373+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T16:00:51.688373+0000","last_peered":"2024-04-25T16:00:51.688373+0000","last_clean":"2024-04-25T16:00:51.688373+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T16:00:51.688373+0000","last_undegraded":"2024-04-25T16:00:51.688373+0000","last_fullsized":"2024-04-25T16:00:51.688373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":27907,"num_write":382,"num_write_kb":96848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'587","reported_seq":645,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.768045+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T16:00:43.768045+0000","last_peered":"2024-04-25T16:00:43.768045+0000","last_clean":"2024-04-25T16:00:43.768045+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T16:00:43.768045+0000","last_undegraded":"2024-04-25T16:00:43.768045+0000","last_fullsized":"2024-04-25T16:00:43.768045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":32151,"num_write":527,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'238","reported_seq":285,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571711+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T16:00:43.571711+0000","last_peered":"2024-04-25T16:00:43.571711+0000","last_clean":"2024-04-25T16:00:43.571711+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T16:00:43.571711+0000","last_undegraded":"2024-04-25T16:00:43.571711+0000","last_fullsized":"2024-04-25T16:00:43.571711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":156,"num_write":459,"num_write_kb":1609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'379","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.580092+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T16:00:43.580092+0000","last_peered":"2024-04-25T16:00:43.580092+0000","last_clean":"2024-04-25T16:00:43.580092+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T16:00:43.580092+0000","last_undegraded":"2024-04-25T16:00:43.580092+0000","last_fullsized":"2024-04-25T16:00:43.580092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":4720,"num_write":350,"num_write_kb":42976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'353","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642061+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T16:00:51.642061+0000","last_peered":"2024-04-25T16:00:51.642061+0000","last_clean":"2024-04-25T16:00:51.642061+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T16:00:51.642061+0000","last_undegraded":"2024-04-25T16:00:51.642061+0000","last_fullsized":"2024-04-25T16:00:51.642061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27299,"num_write":333,"num_write_kb":58716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.656733+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T16:00:51.656733+0000","last_peered":"2024-04-25T16:00:51.656733+0000","last_clean":"2024-04-25T16:00:51.656733+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T16:00:51.656733+0000","last_undegraded":"2024-04-25T16:00:51.656733+0000","last_fullsized":"2024-04-25T16:00:51.656733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.577654+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T16:00:43.577654+0000","last_peered":"2024-04-25T16:00:43.577654+0000","last_clean":"2024-04-25T16:00:43.577654+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T16:00:43.577654+0000","last_undegraded":"2024-04-25T16:00:43.577654+0000","last_fullsized":"2024-04-25T16:00:43.577654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'208","reported_seq":251,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561781+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T16:00:43.561781+0000","last_peered":"2024-04-25T16:00:43.561781+0000","last_clean":"2024-04-25T16:00:43.561781+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T16:00:43.561781+0000","last_undegraded":"2024-04-25T16:00:43.561781+0000","last_fullsized":"2024-04-25T16:00:43.561781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":141,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"31'402","reported_seq":508,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558941+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T16:00:43.558941+0000","last_peered":"2024-04-25T16:00:43.558941+0000","last_clean":"2024-04-25T16:00:43.558941+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T16:00:43.558941+0000","last_undegraded":"2024-04-25T16:00:43.558941+0000","last_fullsized":"2024-04-25T16:00:43.558941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45941,"num_write":380,"num_write_kb":54783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'411","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.579623+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T16:00:43.579623+0000","last_peered":"2024-04-25T16:00:43.579623+0000","last_clean":"2024-04-25T16:00:43.579623+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T16:00:43.579623+0000","last_undegraded":"2024-04-25T16:00:43.579623+0000","last_fullsized":"2024-04-25T16:00:43.579623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37252,"num_write":394,"num_write_kb":96094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'63","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707798+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T16:00:51.707798+0000","last_peered":"2024-04-25T16:00:51.707798+0000","last_clean":"2024-04-25T16:00:51.707798+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T16:00:51.707798+0000","last_undegraded":"2024-04-25T16:00:51.707798+0000","last_fullsized":"2024-04-25T16:00:51.707798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'123","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571142+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T16:00:43.571142+0000","last_peered":"2024-04-25T16:00:43.571142+0000","last_clean":"2024-04-25T16:00:43.571142+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T16:00:43.571142+0000","last_undegraded":"2024-04-25T16:00:43.571142+0000","last_fullsized":"2024-04-25T16:00:43.571142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":75,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'444","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557697+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T16:00:43.557697+0000","last_peered":"2024-04-25T16:00:43.557697+0000","last_clean":"2024-04-25T16:00:43.557697+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T16:00:43.557697+0000","last_undegraded":"2024-04-25T16:00:43.557697+0000","last_fullsized":"2024-04-25T16:00:43.557697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13011,"num_write":414,"num_write_kb":80257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'435","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698098+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T16:00:51.698098+0000","last_peered":"2024-04-25T16:00:51.698098+0000","last_clean":"2024-04-25T16:00:51.698098+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T16:00:51.698098+0000","last_undegraded":"2024-04-25T16:00:51.698098+0000","last_fullsized":"2024-04-25T16:00:51.698098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14130,"num_write":408,"num_write_kb":39042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"34'575","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.258432+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T16:00:44.258432+0000","last_peered":"2024-04-25T16:00:44.258432+0000","last_clean":"2024-04-25T16:00:44.258432+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T16:00:44.258432+0000","last_undegraded":"2024-04-25T16:00:44.258432+0000","last_fullsized":"2024-04-25T16:00:44.258432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":521,"num_write_kb":4332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'140","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567182+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T16:00:43.567182+0000","last_peered":"2024-04-25T16:00:43.567182+0000","last_clean":"2024-04-25T16:00:43.567182+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T16:00:43.567182+0000","last_undegraded":"2024-04-25T16:00:43.567182+0000","last_fullsized":"2024-04-25T16:00:43.567182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":20488,"num_write":73,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"31'446","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569564+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T16:00:43.569564+0000","last_peered":"2024-04-25T16:00:43.569564+0000","last_clean":"2024-04-25T16:00:43.569564+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T16:00:43.569564+0000","last_undegraded":"2024-04-25T16:00:43.569564+0000","last_fullsized":"2024-04-25T16:00:43.569564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17909,"num_write":426,"num_write_kb":58918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'390","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708088+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T16:00:51.708088+0000","last_peered":"2024-04-25T16:00:51.708088+0000","last_clean":"2024-04-25T16:00:51.708088+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T16:00:51.708088+0000","last_undegraded":"2024-04-25T16:00:51.708088+0000","last_fullsized":"2024-04-25T16:00:51.708088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39208,"num_write":362,"num_write_kb":67602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'283","reported_seq":344,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.627686+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T16:00:51.627686+0000","last_peered":"2024-04-25T16:00:51.627686+0000","last_clean":"2024-04-25T16:00:51.627686+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T16:00:51.627686+0000","last_undegraded":"2024-04-25T16:00:51.627686+0000","last_fullsized":"2024-04-25T16:00:51.627686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":236,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'548","reported_seq":593,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618215+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T16:00:43.618215+0000","last_peered":"2024-04-25T16:00:43.618215+0000","last_clean":"2024-04-25T16:00:43.618215+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T16:00:43.618215+0000","last_undegraded":"2024-04-25T16:00:43.618215+0000","last_fullsized":"2024-04-25T16:00:43.618215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":499,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'422","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557173+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T16:00:43.557173+0000","last_peered":"2024-04-25T16:00:43.557173+0000","last_clean":"2024-04-25T16:00:43.557173+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T16:00:43.557173+0000","last_undegraded":"2024-04-25T16:00:43.557173+0000","last_fullsized":"2024-04-25T16:00:43.557173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25440,"num_write":402,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'355","reported_seq":434,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706853+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T16:00:51.706853+0000","last_peered":"2024-04-25T16:00:51.706853+0000","last_clean":"2024-04-25T16:00:51.706853+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T16:00:51.706853+0000","last_undegraded":"2024-04-25T16:00:51.706853+0000","last_fullsized":"2024-04-25T16:00:51.706853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21419,"num_write":332,"num_write_kb":54133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'185","reported_seq":243,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.657326+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T16:00:51.657326+0000","last_peered":"2024-04-25T16:00:51.657326+0000","last_clean":"2024-04-25T16:00:51.657326+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T16:00:51.657326+0000","last_undegraded":"2024-04-25T16:00:51.657326+0000","last_fullsized":"2024-04-25T16:00:51.657326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":131,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"35'55","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561316+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T16:00:43.561316+0000","last_peered":"2024-04-25T16:00:43.561316+0000","last_clean":"2024-04-25T16:00:43.561316+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T16:00:43.561316+0000","last_undegraded":"2024-04-25T16:00:43.561316+0000","last_fullsized":"2024-04-25T16:00:43.561316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"31'370","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583347+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T16:00:43.583347+0000","last_peered":"2024-04-25T16:00:43.583347+0000","last_clean":"2024-04-25T16:00:43.583347+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T16:00:43.583347+0000","last_undegraded":"2024-04-25T16:00:43.583347+0000","last_fullsized":"2024-04-25T16:00:43.583347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":42885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'464","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691773+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T16:00:51.691773+0000","last_peered":"2024-04-25T16:00:51.691773+0000","last_clean":"2024-04-25T16:00:51.691773+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T16:00:51.691773+0000","last_undegraded":"2024-04-25T16:00:51.691773+0000","last_fullsized":"2024-04-25T16:00:51.691773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":34229,"num_write":431,"num_write_kb":50975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'302","reported_seq":391,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.577775+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T16:00:53.577775+0000","last_peered":"2024-04-25T16:00:53.577775+0000","last_clean":"2024-04-25T16:00:53.577775+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T16:00:53.577775+0000","last_undegraded":"2024-04-25T16:00:53.577775+0000","last_fullsized":"2024-04-25T16:00:53.577775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":5709,"num_write":249,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'222","reported_seq":264,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571367+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T16:00:43.571367+0000","last_peered":"2024-04-25T16:00:43.571367+0000","last_clean":"2024-04-25T16:00:43.571367+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T16:00:43.571367+0000","last_undegraded":"2024-04-25T16:00:43.571367+0000","last_fullsized":"2024-04-25T16:00:43.571367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":181,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'411","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619711+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T16:00:43.619711+0000","last_peered":"2024-04-25T16:00:43.619711+0000","last_clean":"2024-04-25T16:00:43.619711+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T16:00:43.619711+0000","last_undegraded":"2024-04-25T16:00:43.619711+0000","last_fullsized":"2024-04-25T16:00:43.619711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4854,"num_write":381,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"36'439","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676434+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T16:00:51.676434+0000","last_peered":"2024-04-25T16:00:51.676434+0000","last_clean":"2024-04-25T16:00:51.676434+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T16:00:51.676434+0000","last_undegraded":"2024-04-25T16:00:51.676434+0000","last_fullsized":"2024-04-25T16:00:51.676434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15516,"num_write":414,"num_write_kb":67395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562151+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T16:00:43.562151+0000","last_peered":"2024-04-25T16:00:43.562151+0000","last_clean":"2024-04-25T16:00:43.562151+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T16:00:43.562151+0000","last_undegraded":"2024-04-25T16:00:43.562151+0000","last_fullsized":"2024-04-25T16:00:43.562151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'72","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583932+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T16:00:43.583932+0000","last_peered":"2024-04-25T16:00:43.583932+0000","last_clean":"2024-04-25T16:00:43.583932+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T16:00:43.583932+0000","last_undegraded":"2024-04-25T16:00:43.583932+0000","last_fullsized":"2024-04-25T16:00:43.583932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'400","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619036+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T16:00:43.619036+0000","last_peered":"2024-04-25T16:00:43.619036+0000","last_clean":"2024-04-25T16:00:43.619036+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T16:00:43.619036+0000","last_undegraded":"2024-04-25T16:00:43.619036+0000","last_fullsized":"2024-04-25T16:00:43.619036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39850,"num_write":370,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"36'407","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691312+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T16:00:51.691312+0000","last_peered":"2024-04-25T16:00:51.691312+0000","last_clean":"2024-04-25T16:00:51.691312+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T16:00:51.691312+0000","last_undegraded":"2024-04-25T16:00:51.691312+0000","last_fullsized":"2024-04-25T16:00:51.691312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":33246,"num_write":383,"num_write_kb":97231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"36'72","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.704437+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T16:00:51.704437+0000","last_peered":"2024-04-25T16:00:51.704437+0000","last_clean":"2024-04-25T16:00:51.704437+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T16:00:51.704437+0000","last_undegraded":"2024-04-25T16:00:51.704437+0000","last_fullsized":"2024-04-25T16:00:51.704437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'282","reported_seq":345,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583847+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T16:00:43.583847+0000","last_peered":"2024-04-25T16:00:43.583847+0000","last_clean":"2024-04-25T16:00:43.583847+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T16:00:43.583847+0000","last_undegraded":"2024-04-25T16:00:43.583847+0000","last_fullsized":"2024-04-25T16:00:43.583847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":28701,"num_write":224,"num_write_kb":12419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'384","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583585+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T16:00:43.583585+0000","last_peered":"2024-04-25T16:00:43.583585+0000","last_clean":"2024-04-25T16:00:43.583585+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T16:00:43.583585+0000","last_undegraded":"2024-04-25T16:00:43.583585+0000","last_fullsized":"2024-04-25T16:00:43.583585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13411,"num_write":356,"num_write_kb":100243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'415","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.700278+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T16:00:51.700278+0000","last_peered":"2024-04-25T16:00:51.700278+0000","last_clean":"2024-04-25T16:00:51.700278+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T16:00:51.700278+0000","last_undegraded":"2024-04-25T16:00:51.700278+0000","last_fullsized":"2024-04-25T16:00:51.700278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13518,"num_write":393,"num_write_kb":67403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'925","reported_seq":993,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.592078+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T16:00:51.592078+0000","last_peered":"2024-04-25T16:00:51.592078+0000","last_clean":"2024-04-25T16:00:51.592078+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T16:00:51.592078+0000","last_undegraded":"2024-04-25T16:00:51.592078+0000","last_fullsized":"2024-04-25T16:00:51.592078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":28720,"num_write":874,"num_write_kb":8730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'142","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620409+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T16:00:43.620409+0000","last_peered":"2024-04-25T16:00:43.620409+0000","last_clean":"2024-04-25T16:00:43.620409+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T16:00:43.620409+0000","last_undegraded":"2024-04-25T16:00:43.620409+0000","last_fullsized":"2024-04-25T16:00:43.620409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":97,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"31'366","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583348+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T16:00:43.583348+0000","last_peered":"2024-04-25T16:00:43.583348+0000","last_clean":"2024-04-25T16:00:43.583348+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T16:00:43.583348+0000","last_undegraded":"2024-04-25T16:00:43.583348+0000","last_fullsized":"2024-04-25T16:00:43.583348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6536,"num_write":348,"num_write_kb":51835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"36'411","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705945+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T16:00:51.705945+0000","last_peered":"2024-04-25T16:00:51.705945+0000","last_clean":"2024-04-25T16:00:51.705945+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T16:00:51.705945+0000","last_undegraded":"2024-04-25T16:00:51.705945+0000","last_fullsized":"2024-04-25T16:00:51.705945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12973,"num_write":382,"num_write_kb":67863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'342","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.624046+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T16:00:51.624046+0000","last_peered":"2024-04-25T16:00:51.624046+0000","last_clean":"2024-04-25T16:00:51.624046+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T16:00:51.624046+0000","last_undegraded":"2024-04-25T16:00:51.624046+0000","last_fullsized":"2024-04-25T16:00:51.624046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":41004,"num_write":293,"num_write_kb":12450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'62","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564629+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T16:00:43.564629+0000","last_peered":"2024-04-25T16:00:43.564629+0000","last_clean":"2024-04-25T16:00:43.564629+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T16:00:43.564629+0000","last_undegraded":"2024-04-25T16:00:43.564629+0000","last_fullsized":"2024-04-25T16:00:43.564629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'409","reported_seq":505,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565353+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T16:00:43.565353+0000","last_peered":"2024-04-25T16:00:43.565353+0000","last_clean":"2024-04-25T16:00:43.565353+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T16:00:43.565353+0000","last_undegraded":"2024-04-25T16:00:43.565353+0000","last_fullsized":"2024-04-25T16:00:43.565353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30743,"num_write":387,"num_write_kb":71898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'393","reported_seq":487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684817+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T16:00:51.684817+0000","last_peered":"2024-04-25T16:00:51.684817+0000","last_clean":"2024-04-25T16:00:51.684817+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T16:00:51.684817+0000","last_undegraded":"2024-04-25T16:00:51.684817+0000","last_fullsized":"2024-04-25T16:00:51.684817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24508,"num_write":369,"num_write_kb":63737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'210","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:57.872968+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T16:00:57.872968+0000","last_peered":"2024-04-25T16:00:57.872968+0000","last_clean":"2024-04-25T16:00:57.872968+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T16:00:57.872968+0000","last_undegraded":"2024-04-25T16:00:57.872968+0000","last_fullsized":"2024-04-25T16:00:57.872968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":787,"num_write":162,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'536","reported_seq":590,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564408+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T16:00:43.564408+0000","last_peered":"2024-04-25T16:00:43.564408+0000","last_clean":"2024-04-25T16:00:43.564408+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T16:00:43.564408+0000","last_undegraded":"2024-04-25T16:00:43.564408+0000","last_fullsized":"2024-04-25T16:00:43.564408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24608,"num_write":474,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"31'470","reported_seq":569,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560394+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T16:00:43.560394+0000","last_peered":"2024-04-25T16:00:43.560394+0000","last_clean":"2024-04-25T16:00:43.560394+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T16:00:43.560394+0000","last_undegraded":"2024-04-25T16:00:43.560394+0000","last_fullsized":"2024-04-25T16:00:43.560394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31281,"num_write":455,"num_write_kb":108972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"36'380","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642794+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T16:00:51.642794+0000","last_peered":"2024-04-25T16:00:51.642794+0000","last_clean":"2024-04-25T16:00:51.642794+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T16:00:51.642794+0000","last_undegraded":"2024-04-25T16:00:51.642794+0000","last_fullsized":"2024-04-25T16:00:51.642794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":25762,"num_write":354,"num_write_kb":59652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'381","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.877917+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T16:00:45.877917+0000","last_peered":"2024-04-25T16:00:45.877917+0000","last_clean":"2024-04-25T16:00:45.877917+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T16:00:45.877917+0000","last_undegraded":"2024-04-25T16:00:45.877917+0000","last_fullsized":"2024-04-25T16:00:45.877917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8766,"num_write":314,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'141","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583710+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T16:00:43.583710+0000","last_peered":"2024-04-25T16:00:43.583710+0000","last_clean":"2024-04-25T16:00:43.583710+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T16:00:43.583710+0000","last_undegraded":"2024-04-25T16:00:43.583710+0000","last_fullsized":"2024-04-25T16:00:43.583710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494748,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":898,"num_write":91,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'426","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571429+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T16:00:43.571429+0000","last_peered":"2024-04-25T16:00:43.571429+0000","last_clean":"2024-04-25T16:00:43.571429+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T16:00:43.571429+0000","last_undegraded":"2024-04-25T16:00:43.571429+0000","last_fullsized":"2024-04-25T16:00:43.571429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13765,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"36'408","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621688+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T16:00:43.621688+0000","last_peered":"2024-04-25T16:00:43.621688+0000","last_clean":"2024-04-25T16:00:43.621688+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T16:00:43.621688+0000","last_undegraded":"2024-04-25T16:00:43.621688+0000","last_fullsized":"2024-04-25T16:00:43.621688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":381,"num_write_kb":62610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"36'68","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576238+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T16:00:43.576238+0000","last_peered":"2024-04-25T16:00:43.576238+0000","last_clean":"2024-04-25T16:00:43.576238+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T16:00:43.576238+0000","last_undegraded":"2024-04-25T16:00:43.576238+0000","last_fullsized":"2024-04-25T16:00:43.576238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'63","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582861+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T16:00:43.582861+0000","last_peered":"2024-04-25T16:00:43.582861+0000","last_clean":"2024-04-25T16:00:43.582861+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T16:00:43.582861+0000","last_undegraded":"2024-04-25T16:00:43.582861+0000","last_fullsized":"2024-04-25T16:00:43.582861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'354","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564245+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T16:00:43.564245+0000","last_peered":"2024-04-25T16:00:43.564245+0000","last_clean":"2024-04-25T16:00:43.564245+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T16:00:43.564245+0000","last_undegraded":"2024-04-25T16:00:43.564245+0000","last_fullsized":"2024-04-25T16:00:43.564245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17557,"num_write":333,"num_write_kb":46614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'111","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570878+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T16:00:43.570878+0000","last_peered":"2024-04-25T16:00:43.570878+0000","last_clean":"2024-04-25T16:00:43.570878+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T16:00:43.570878+0000","last_undegraded":"2024-04-25T16:00:43.570878+0000","last_fullsized":"2024-04-25T16:00:43.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":58,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'435","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684323+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T16:00:51.684323+0000","last_peered":"2024-04-25T16:00:51.684323+0000","last_clean":"2024-04-25T16:00:51.684323+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T16:00:51.684323+0000","last_undegraded":"2024-04-25T16:00:51.684323+0000","last_fullsized":"2024-04-25T16:00:51.684323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25415,"num_write":410,"num_write_kb":96682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'1093","reported_seq":1147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.543302+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T16:00:44.543302+0000","last_peered":"2024-04-25T16:00:44.543302+0000","last_clean":"2024-04-25T16:00:44.543302+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T16:00:44.543302+0000","last_undegraded":"2024-04-25T16:00:44.543302+0000","last_fullsized":"2024-04-25T16:00:44.543302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":1024,"num_write_kb":8705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"31'396","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570814+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T16:00:43.570814+0000","last_peered":"2024-04-25T16:00:43.570814+0000","last_clean":"2024-04-25T16:00:43.570814+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T16:00:43.570814+0000","last_undegraded":"2024-04-25T16:00:43.570814+0000","last_fullsized":"2024-04-25T16:00:43.570814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":20218,"num_write":374,"num_write_kb":83731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'99","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565603+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T16:00:43.565603+0000","last_peered":"2024-04-25T16:00:43.565603+0000","last_clean":"2024-04-25T16:00:43.565603+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T16:00:43.565603+0000","last_undegraded":"2024-04-25T16:00:43.565603+0000","last_fullsized":"2024-04-25T16:00:43.565603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12304,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'449","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585602+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T16:00:43.585602+0000","last_peered":"2024-04-25T16:00:43.585602+0000","last_clean":"2024-04-25T16:00:43.585602+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T16:00:43.585602+0000","last_undegraded":"2024-04-25T16:00:43.585602+0000","last_fullsized":"2024-04-25T16:00:43.585602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27119,"num_write":430,"num_write_kb":112459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'105","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.743069+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T16:00:45.743069+0000","last_peered":"2024-04-25T16:00:45.743069+0000","last_clean":"2024-04-25T16:00:45.743069+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T16:00:45.743069+0000","last_undegraded":"2024-04-25T16:00:45.743069+0000","last_fullsized":"2024-04-25T16:00:45.743069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":60,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"31'366","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564233+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T16:00:43.564233+0000","last_peered":"2024-04-25T16:00:43.564233+0000","last_clean":"2024-04-25T16:00:43.564233+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T16:00:43.564233+0000","last_undegraded":"2024-04-25T16:00:43.564233+0000","last_fullsized":"2024-04-25T16:00:43.564233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":31073,"num_write":335,"num_write_kb":72672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"34'620","reported_seq":678,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.348054+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T16:00:45.348054+0000","last_peered":"2024-04-25T16:00:45.348054+0000","last_clean":"2024-04-25T16:00:45.348054+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T16:00:45.348054+0000","last_undegraded":"2024-04-25T16:00:45.348054+0000","last_fullsized":"2024-04-25T16:00:45.348054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":551,"num_write_kb":12472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'393","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675955+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T16:00:51.675955+0000","last_peered":"2024-04-25T16:00:51.675955+0000","last_clean":"2024-04-25T16:00:51.675955+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T16:00:51.675955+0000","last_undegraded":"2024-04-25T16:00:51.675955+0000","last_fullsized":"2024-04-25T16:00:51.675955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31498,"num_write":372,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'337","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559283+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T16:00:43.559283+0000","last_peered":"2024-04-25T16:00:43.559283+0000","last_clean":"2024-04-25T16:00:43.559283+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T16:00:43.559283+0000","last_undegraded":"2024-04-25T16:00:43.559283+0000","last_fullsized":"2024-04-25T16:00:43.559283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":286,"num_write_kb":4236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'391","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566951+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T16:00:43.566951+0000","last_peered":"2024-04-25T16:00:43.566951+0000","last_clean":"2024-04-25T16:00:43.566951+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T16:00:43.566951+0000","last_undegraded":"2024-04-25T16:00:43.566951+0000","last_fullsized":"2024-04-25T16:00:43.566951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15625,"num_write":369,"num_write_kb":80649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"34'111","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584875+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T16:00:43.584875+0000","last_peered":"2024-04-25T16:00:43.584875+0000","last_clean":"2024-04-25T16:00:43.584875+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T16:00:43.584875+0000","last_undegraded":"2024-04-25T16:00:43.584875+0000","last_fullsized":"2024-04-25T16:00:43.584875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":57,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'382","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689989+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T16:00:51.689989+0000","last_peered":"2024-04-25T16:00:51.689989+0000","last_clean":"2024-04-25T16:00:51.689989+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T16:00:51.689989+0000","last_undegraded":"2024-04-25T16:00:51.689989+0000","last_fullsized":"2024-04-25T16:00:51.689989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28619,"num_write":357,"num_write_kb":42139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'305","reported_seq":358,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583900+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T16:00:43.583900+0000","last_peered":"2024-04-25T16:00:43.583900+0000","last_clean":"2024-04-25T16:00:43.583900+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T16:00:43.583900+0000","last_undegraded":"2024-04-25T16:00:43.583900+0000","last_fullsized":"2024-04-25T16:00:43.583900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":32783,"num_write":228,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"31'453","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585705+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T16:00:43.585705+0000","last_peered":"2024-04-25T16:00:43.585705+0000","last_clean":"2024-04-25T16:00:43.585705+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T16:00:43.585705+0000","last_undegraded":"2024-04-25T16:00:43.585705+0000","last_fullsized":"2024-04-25T16:00:43.585705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17355,"num_write":430,"num_write_kb":97199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'423","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702247+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T16:00:51.702247+0000","last_peered":"2024-04-25T16:00:51.702247+0000","last_clean":"2024-04-25T16:00:51.702247+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T16:00:51.702247+0000","last_undegraded":"2024-04-25T16:00:51.702247+0000","last_fullsized":"2024-04-25T16:00:51.702247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12292,"num_write":400,"num_write_kb":76879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"31'396","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562935+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T16:00:43.562935+0000","last_peered":"2024-04-25T16:00:43.562935+0000","last_clean":"2024-04-25T16:00:43.562935+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T16:00:43.562935+0000","last_undegraded":"2024-04-25T16:00:43.562935+0000","last_fullsized":"2024-04-25T16:00:43.562935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13093,"num_write":385,"num_write_kb":50492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'448","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.694727+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T16:00:51.694727+0000","last_peered":"2024-04-25T16:00:51.694727+0000","last_clean":"2024-04-25T16:00:51.694727+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T16:00:51.694727+0000","last_undegraded":"2024-04-25T16:00:51.694727+0000","last_fullsized":"2024-04-25T16:00:51.694727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":34274,"num_write":426,"num_write_kb":72417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"31'398","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618832+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T16:00:43.618832+0000","last_peered":"2024-04-25T16:00:43.618832+0000","last_clean":"2024-04-25T16:00:43.618832+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T16:00:43.618832+0000","last_undegraded":"2024-04-25T16:00:43.618832+0000","last_fullsized":"2024-04-25T16:00:43.618832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32843,"num_write":377,"num_write_kb":116675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"36'474","reported_seq":588,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.692733+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T16:00:51.692733+0000","last_peered":"2024-04-25T16:00:51.692733+0000","last_clean":"2024-04-25T16:00:51.692733+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T16:00:51.692733+0000","last_undegraded":"2024-04-25T16:00:51.692733+0000","last_fullsized":"2024-04-25T16:00:51.692733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33678,"num_write":445,"num_write_kb":67390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564869+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T16:00:43.564869+0000","last_peered":"2024-04-25T16:00:43.564869+0000","last_clean":"2024-04-25T16:00:43.564869+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T16:00:43.564869+0000","last_undegraded":"2024-04-25T16:00:43.564869+0000","last_fullsized":"2024-04-25T16:00:43.564869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19077,"num_write":388,"num_write_kb":75668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'415","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679135+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T16:00:51.679135+0000","last_peered":"2024-04-25T16:00:51.679135+0000","last_clean":"2024-04-25T16:00:51.679135+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T16:00:51.679135+0000","last_undegraded":"2024-04-25T16:00:51.679135+0000","last_fullsized":"2024-04-25T16:00:51.679135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15212,"num_write":389,"num_write_kb":87855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"31'469","reported_seq":572,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569399+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T16:00:43.569399+0000","last_peered":"2024-04-25T16:00:43.569399+0000","last_clean":"2024-04-25T16:00:43.569399+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T16:00:43.569399+0000","last_undegraded":"2024-04-25T16:00:43.569399+0000","last_fullsized":"2024-04-25T16:00:43.569399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":27411,"num_write":441,"num_write_kb":71769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"36'370","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699867+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T16:00:51.699867+0000","last_peered":"2024-04-25T16:00:51.699867+0000","last_clean":"2024-04-25T16:00:51.699867+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T16:00:51.699867+0000","last_undegraded":"2024-04-25T16:00:51.699867+0000","last_fullsized":"2024-04-25T16:00:51.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17348,"num_write":348,"num_write_kb":62807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"31'399","reported_seq":493,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566996+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T16:00:43.566996+0000","last_peered":"2024-04-25T16:00:43.566996+0000","last_clean":"2024-04-25T16:00:43.566996+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T16:00:43.566996+0000","last_undegraded":"2024-04-25T16:00:43.566996+0000","last_fullsized":"2024-04-25T16:00:43.566996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25133,"num_write":374,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"36'389","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9093,"num_write":358,"num_write_kb":54590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"31'414","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T16:00:43.570320+0000","last_peered":"2024-04-25T16:00:43.570320+0000","last_clean":"2024-04-25T16:00:43.570320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T16:00:43.570320+0000","last_undegraded":"2024-04-25T16:00:43.570320+0000","last_fullsized":"2024-04-25T16:00:43.570320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4145,"num_write":400,"num_write_kb":47343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"36'485","reported_seq":607,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.574681+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T16:00:43.574681+0000","last_peered":"2024-04-25T16:00:43.574681+0000","last_clean":"2024-04-25T16:00:43.574681+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T16:00:43.574681+0000","last_undegraded":"2024-04-25T16:00:43.574681+0000","last_fullsized":"2024-04-25T16:00:43.574681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40854,"num_write":458,"num_write_kb":125991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"31'410","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559076+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T16:00:43.559076+0000","last_peered":"2024-04-25T16:00:43.559076+0000","last_clean":"2024-04-25T16:00:43.559076+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T16:00:43.559076+0000","last_undegraded":"2024-04-25T16:00:43.559076+0000","last_fullsized":"2024-04-25T16:00:43.559076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26310,"num_write":391,"num_write_kb":68273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'398","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679994+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T16:00:51.679994+0000","last_peered":"2024-04-25T16:00:51.679994+0000","last_clean":"2024-04-25T16:00:51.679994+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T16:00:51.679994+0000","last_undegraded":"2024-04-25T16:00:51.679994+0000","last_fullsized":"2024-04-25T16:00:51.679994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4252,"num_write":382,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"31'416","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583427+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T16:00:43.583427+0000","last_peered":"2024-04-25T16:00:43.583427+0000","last_clean":"2024-04-25T16:00:43.583427+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T16:00:43.583427+0000","last_undegraded":"2024-04-25T16:00:43.583427+0000","last_fullsized":"2024-04-25T16:00:43.583427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38150,"num_write":393,"num_write_kb":63831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'452","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.661661+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T16:00:51.661661+0000","last_peered":"2024-04-25T16:00:51.661661+0000","last_clean":"2024-04-25T16:00:51.661661+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T16:00:51.661661+0000","last_undegraded":"2024-04-25T16:00:51.661661+0000","last_fullsized":"2024-04-25T16:00:51.661661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13732,"num_write":425,"num_write_kb":92170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"31'400","reported_seq":496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.572217+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T16:00:43.572217+0000","last_peered":"2024-04-25T16:00:43.572217+0000","last_clean":"2024-04-25T16:00:43.572217+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T16:00:43.572217+0000","last_undegraded":"2024-04-25T16:00:43.572217+0000","last_fullsized":"2024-04-25T16:00:43.572217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30630,"num_write":376,"num_write_kb":46781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"36'400","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.658583+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T16:00:51.658583+0000","last_peered":"2024-04-25T16:00:51.658583+0000","last_clean":"2024-04-25T16:00:51.658583+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T16:00:51.658583+0000","last_undegraded":"2024-04-25T16:00:51.658583+0000","last_fullsized":"2024-04-25T16:00:51.658583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":15673,"num_write":376,"num_write_kb":63098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"31'448","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558895+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T16:00:43.558895+0000","last_peered":"2024-04-25T16:00:43.558895+0000","last_clean":"2024-04-25T16:00:43.558895+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T16:00:43.558895+0000","last_undegraded":"2024-04-25T16:00:43.558895+0000","last_fullsized":"2024-04-25T16:00:43.558895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17288,"num_write":429,"num_write_kb":67321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"35'439","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620632+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T16:00:43.620632+0000","last_peered":"2024-04-25T16:00:43.620632+0000","last_clean":"2024-04-25T16:00:43.620632+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T16:00:43.620632+0000","last_undegraded":"2024-04-25T16:00:43.620632+0000","last_fullsized":"2024-04-25T16:00:43.620632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":44523,"num_write":420,"num_write_kb":101102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"31'449","reported_seq":563,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583236+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T16:00:43.583236+0000","last_peered":"2024-04-25T16:00:43.583236+0000","last_clean":"2024-04-25T16:00:43.583236+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T16:00:43.583236+0000","last_undegraded":"2024-04-25T16:00:43.583236+0000","last_fullsized":"2024-04-25T16:00:43.583236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42039,"num_write":424,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.639652+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T16:00:51.639652+0000","last_peered":"2024-04-25T16:00:51.639652+0000","last_clean":"2024-04-25T16:00:51.639652+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T16:00:51.639652+0000","last_undegraded":"2024-04-25T16:00:51.639652+0000","last_fullsized":"2024-04-25T16:00:51.639652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27977,"num_write":389,"num_write_kb":84131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"31'427","reported_seq":554,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565215+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T16:00:43.565215+0000","last_peered":"2024-04-25T16:00:43.565215+0000","last_clean":"2024-04-25T16:00:43.565215+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T16:00:43.565215+0000","last_undegraded":"2024-04-25T16:00:43.565215+0000","last_fullsized":"2024-04-25T16:00:43.565215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43629,"num_write":407,"num_write_kb":76072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"35'432","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564858+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T16:00:43.564858+0000","last_peered":"2024-04-25T16:00:43.564858+0000","last_clean":"2024-04-25T16:00:43.564858+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T16:00:43.564858+0000","last_undegraded":"2024-04-25T16:00:43.564858+0000","last_fullsized":"2024-04-25T16:00:43.564858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30618,"num_write":414,"num_write_kb":71070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"31'389","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559593+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T16:00:43.559593+0000","last_peered":"2024-04-25T16:00:43.559593+0000","last_clean":"2024-04-25T16:00:43.559593+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T16:00:43.559593+0000","last_undegraded":"2024-04-25T16:00:43.559593+0000","last_fullsized":"2024-04-25T16:00:43.559593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30549,"num_write":360,"num_write_kb":75006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"36'422","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.670952+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T16:00:51.670952+0000","last_peered":"2024-04-25T16:00:51.670952+0000","last_clean":"2024-04-25T16:00:51.670952+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T16:00:51.670952+0000","last_undegraded":"2024-04-25T16:00:51.670952+0000","last_fullsized":"2024-04-25T16:00:51.670952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39450,"num_write":395,"num_write_kb":75510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"31'437","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.617890+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T16:00:43.617890+0000","last_peered":"2024-04-25T16:00:43.617890+0000","last_clean":"2024-04-25T16:00:43.617890+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T16:00:43.617890+0000","last_undegraded":"2024-04-25T16:00:43.617890+0000","last_fullsized":"2024-04-25T16:00:43.617890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19085,"num_write":412,"num_write_kb":55082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"36'406","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699401+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T16:00:51.699401+0000","last_peered":"2024-04-25T16:00:51.699401+0000","last_clean":"2024-04-25T16:00:51.699401+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T16:00:51.699401+0000","last_undegraded":"2024-04-25T16:00:51.699401+0000","last_fullsized":"2024-04-25T16:00:51.699401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24863,"num_write":384,"num_write_kb":75591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"31'420","reported_seq":503,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562491+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T16:00:43.562491+0000","last_peered":"2024-04-25T16:00:43.562491+0000","last_clean":"2024-04-25T16:00:43.562491+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T16:00:43.562491+0000","last_undegraded":"2024-04-25T16:00:43.562491+0000","last_fullsized":"2024-04-25T16:00:43.562491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20260,"num_write":395,"num_write_kb":76151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'416","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707524+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T16:00:51.707524+0000","last_peered":"2024-04-25T16:00:51.707524+0000","last_clean":"2024-04-25T16:00:51.707524+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T16:00:51.707524+0000","last_undegraded":"2024-04-25T16:00:51.707524+0000","last_fullsized":"2024-04-25T16:00:51.707524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24467,"num_write":391,"num_write_kb":79816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"31'404","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562708+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T16:00:43.562708+0000","last_peered":"2024-04-25T16:00:43.562708+0000","last_clean":"2024-04-25T16:00:43.562708+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T16:00:43.562708+0000","last_undegraded":"2024-04-25T16:00:43.562708+0000","last_fullsized":"2024-04-25T16:00:43.562708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25761,"num_write":377,"num_write_kb":87528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"36'432","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705538+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T16:00:51.705538+0000","last_peered":"2024-04-25T16:00:51.705538+0000","last_clean":"2024-04-25T16:00:51.705538+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T16:00:51.705538+0000","last_undegraded":"2024-04-25T16:00:51.705538+0000","last_fullsized":"2024-04-25T16:00:51.705538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":33533,"num_write":410,"num_write_kb":87842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"31'400","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562996+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T16:00:43.562996+0000","last_peered":"2024-04-25T16:00:43.562996+0000","last_clean":"2024-04-25T16:00:43.562996+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T16:00:43.562996+0000","last_undegraded":"2024-04-25T16:00:43.562996+0000","last_fullsized":"2024-04-25T16:00:43.562996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29549,"num_write":386,"num_write_kb":55194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"36'394","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689283+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T16:00:51.689283+0000","last_peered":"2024-04-25T16:00:51.689283+0000","last_clean":"2024-04-25T16:00:51.689283+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T16:00:51.689283+0000","last_undegraded":"2024-04-25T16:00:51.689283+0000","last_fullsized":"2024-04-25T16:00:51.689283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46746,"num_write":370,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"31'338","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618796+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T16:00:43.618796+0000","last_peered":"2024-04-25T16:00:43.618796+0000","last_clean":"2024-04-25T16:00:43.618796+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T16:00:43.618796+0000","last_undegraded":"2024-04-25T16:00:43.618796+0000","last_fullsized":"2024-04-25T16:00:43.618796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9201,"num_write":322,"num_write_kb":37990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"36'397","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701141+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T16:00:51.701141+0000","last_peered":"2024-04-25T16:00:51.701141+0000","last_clean":"2024-04-25T16:00:51.701141+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T16:00:51.701141+0000","last_undegraded":"2024-04-25T16:00:51.701141+0000","last_fullsized":"2024-04-25T16:00:51.701141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14146,"num_write":373,"num_write_kb":38796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"31'395","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576883+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T16:00:43.576883+0000","last_peered":"2024-04-25T16:00:43.576883+0000","last_clean":"2024-04-25T16:00:43.576883+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T16:00:43.576883+0000","last_undegraded":"2024-04-25T16:00:43.576883+0000","last_fullsized":"2024-04-25T16:00:43.576883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":61604,"num_write":383,"num_write_kb":95809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"36'373","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583502+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T16:00:43.583502+0000","last_peered":"2024-04-25T16:00:43.583502+0000","last_clean":"2024-04-25T16:00:43.583502+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T16:00:43.583502+0000","last_undegraded":"2024-04-25T16:00:43.583502+0000","last_fullsized":"2024-04-25T16:00:43.583502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13278,"num_write":350,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"31'383","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585454+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T16:00:43.585454+0000","last_peered":"2024-04-25T16:00:43.585454+0000","last_clean":"2024-04-25T16:00:43.585454+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T16:00:43.585454+0000","last_undegraded":"2024-04-25T16:00:43.585454+0000","last_fullsized":"2024-04-25T16:00:43.585454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4096,"num_write":350,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'356","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684443+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T16:00:51.684443+0000","last_peered":"2024-04-25T16:00:51.684443+0000","last_clean":"2024-04-25T16:00:51.684443+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T16:00:51.684443+0000","last_undegraded":"2024-04-25T16:00:51.684443+0000","last_fullsized":"2024-04-25T16:00:51.684443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19489,"num_write":338,"num_write_kb":75079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"31'369","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557847+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T16:00:43.557847+0000","last_peered":"2024-04-25T16:00:43.557847+0000","last_clean":"2024-04-25T16:00:43.557847+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T16:00:43.557847+0000","last_undegraded":"2024-04-25T16:00:43.557847+0000","last_fullsized":"2024-04-25T16:00:43.557847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1693,"num_write":344,"num_write_kb":38100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"36'368","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706369+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T16:00:51.706369+0000","last_peered":"2024-04-25T16:00:51.706369+0000","last_clean":"2024-04-25T16:00:51.706369+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T16:00:51.706369+0000","last_undegraded":"2024-04-25T16:00:51.706369+0000","last_fullsized":"2024-04-25T16:00:51.706369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25999,"num_write":356,"num_write_kb":38429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"31'447","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576302+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T16:00:43.576302+0000","last_peered":"2024-04-25T16:00:43.576302+0000","last_clean":"2024-04-25T16:00:43.576302+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T16:00:43.576302+0000","last_undegraded":"2024-04-25T16:00:43.576302+0000","last_fullsized":"2024-04-25T16:00:43.576302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38032,"num_write":427,"num_write_kb":75902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"36'382","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681204+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T16:00:51.681204+0000","last_peered":"2024-04-25T16:00:51.681204+0000","last_clean":"2024-04-25T16:00:51.681204+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T16:00:51.681204+0000","last_undegraded":"2024-04-25T16:00:51.681204+0000","last_fullsized":"2024-04-25T16:00:51.681204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33238,"num_write":360,"num_write_kb":83325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"31'430","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618117+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T16:00:43.618117+0000","last_peered":"2024-04-25T16:00:43.618117+0000","last_clean":"2024-04-25T16:00:43.618117+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T16:00:43.618117+0000","last_undegraded":"2024-04-25T16:00:43.618117+0000","last_fullsized":"2024-04-25T16:00:43.618117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47776,"num_write":403,"num_write_kb":100333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"36'419","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.682360+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T16:00:51.682360+0000","last_peered":"2024-04-25T16:00:51.682360+0000","last_clean":"2024-04-25T16:00:51.682360+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T16:00:51.682360+0000","last_undegraded":"2024-04-25T16:00:51.682360+0000","last_fullsized":"2024-04-25T16:00:51.682360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31054,"num_write":404,"num_write_kb":100026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"31'457","reported_seq":596,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583419+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T16:00:43.583419+0000","last_peered":"2024-04-25T16:00:43.583419+0000","last_clean":"2024-04-25T16:00:43.583419+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T16:00:43.583419+0000","last_undegraded":"2024-04-25T16:00:43.583419+0000","last_fullsized":"2024-04-25T16:00:43.583419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56462,"num_write":435,"num_write_kb":97259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"36'357","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698267+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T16:00:51.698267+0000","last_peered":"2024-04-25T16:00:51.698267+0000","last_clean":"2024-04-25T16:00:51.698267+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T16:00:51.698267+0000","last_undegraded":"2024-04-25T16:00:51.698267+0000","last_fullsized":"2024-04-25T16:00:51.698267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9534,"num_write":325,"num_write_kb":26581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"31'417","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562885+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T16:00:43.562885+0000","last_peered":"2024-04-25T16:00:43.562885+0000","last_clean":"2024-04-25T16:00:43.562885+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T16:00:43.562885+0000","last_undegraded":"2024-04-25T16:00:43.562885+0000","last_fullsized":"2024-04-25T16:00:43.562885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28935,"num_write":390,"num_write_kb":55220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"36'446","reported_seq":557,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571000+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T16:00:43.571000+0000","last_peered":"2024-04-25T16:00:43.571000+0000","last_clean":"2024-04-25T16:00:43.571000+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T16:00:43.571000+0000","last_undegraded":"2024-04-25T16:00:43.571000+0000","last_fullsized":"2024-04-25T16:00:43.571000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":18239,"num_write":428,"num_write_kb":69651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"31'386","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562548+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T16:00:43.562548+0000","last_peered":"2024-04-25T16:00:43.562548+0000","last_clean":"2024-04-25T16:00:43.562548+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T16:00:43.562548+0000","last_undegraded":"2024-04-25T16:00:43.562548+0000","last_fullsized":"2024-04-25T16:00:43.562548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8859,"num_write":358,"num_write_kb":46267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'391","reported_seq":488,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676568+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T16:00:51.676568+0000","last_peered":"2024-04-25T16:00:51.676568+0000","last_clean":"2024-04-25T16:00:51.676568+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T16:00:51.676568+0000","last_undegraded":"2024-04-25T16:00:51.676568+0000","last_fullsized":"2024-04-25T16:00:51.676568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32236,"num_write":374,"num_write_kb":95777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"31'357","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619677+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T16:00:43.619677+0000","last_peered":"2024-04-25T16:00:43.619677+0000","last_clean":"2024-04-25T16:00:43.619677+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T16:00:43.619677+0000","last_undegraded":"2024-04-25T16:00:43.619677+0000","last_fullsized":"2024-04-25T16:00:43.619677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22705,"num_write":334,"num_write_kb":38119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"36'425","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.668379+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T16:00:51.668379+0000","last_peered":"2024-04-25T16:00:51.668379+0000","last_clean":"2024-04-25T16:00:51.668379+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T16:00:51.668379+0000","last_undegraded":"2024-04-25T16:00:51.668379+0000","last_fullsized":"2024-04-25T16:00:51.668379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22941,"num_write":404,"num_write_kb":72501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"31'377","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582939+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T16:00:43.582939+0000","last_peered":"2024-04-25T16:00:43.582939+0000","last_clean":"2024-04-25T16:00:43.582939+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T16:00:43.582939+0000","last_undegraded":"2024-04-25T16:00:43.582939+0000","last_fullsized":"2024-04-25T16:00:43.582939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10994,"num_write":357,"num_write_kb":50723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'404","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701848+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T16:00:51.701848+0000","last_peered":"2024-04-25T16:00:51.701848+0000","last_clean":"2024-04-25T16:00:51.701848+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T16:00:51.701848+0000","last_undegraded":"2024-04-25T16:00:51.701848+0000","last_fullsized":"2024-04-25T16:00:51.701848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11471,"num_write":379,"num_write_kb":75857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557154+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T16:00:43.557154+0000","last_peered":"2024-04-25T16:00:43.557154+0000","last_clean":"2024-04-25T16:00:43.557154+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T16:00:43.557154+0000","last_undegraded":"2024-04-25T16:00:43.557154+0000","last_fullsized":"2024-04-25T16:00:43.557154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20101,"num_write":381,"num_write_kb":55469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"35'349","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570822+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T16:00:43.570822+0000","last_peered":"2024-04-25T16:00:43.570822+0000","last_clean":"2024-04-25T16:00:43.570822+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T16:00:43.570822+0000","last_undegraded":"2024-04-25T16:00:43.570822+0000","last_fullsized":"2024-04-25T16:00:43.570822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9293,"num_write":327,"num_write_kb":37967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"31'359","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569043+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T16:00:43.569043+0000","last_peered":"2024-04-25T16:00:43.569043+0000","last_clean":"2024-04-25T16:00:43.569043+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T16:00:43.569043+0000","last_undegraded":"2024-04-25T16:00:43.569043+0000","last_fullsized":"2024-04-25T16:00:43.569043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33728,"num_write":336,"num_write_kb":95963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675862+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T16:00:51.675862+0000","last_peered":"2024-04-25T16:00:51.675862+0000","last_clean":"2024-04-25T16:00:51.675862+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T16:00:51.675862+0000","last_undegraded":"2024-04-25T16:00:51.675862+0000","last_fullsized":"2024-04-25T16:00:51.675862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15261,"num_write":373,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"31'453","reported_seq":603,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569482+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T16:00:43.569482+0000","last_peered":"2024-04-25T16:00:43.569482+0000","last_clean":"2024-04-25T16:00:43.569482+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T16:00:43.569482+0000","last_undegraded":"2024-04-25T16:00:43.569482+0000","last_fullsized":"2024-04-25T16:00:43.569482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":65459,"num_write":436,"num_write_kb":138981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"36'408","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.578583+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T16:00:43.578583+0000","last_peered":"2024-04-25T16:00:43.578583+0000","last_clean":"2024-04-25T16:00:43.578583+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T16:00:43.578583+0000","last_undegraded":"2024-04-25T16:00:43.578583+0000","last_fullsized":"2024-04-25T16:00:43.578583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":41811,"num_write":385,"num_write_kb":100198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2984,"num_read_kb":1496873,"num_write":24473,"num_write_kb":4464601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25921,"ondisk_log_size":25921,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":131985636,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":525,"num_read_kb":323765,"num_write":7010,"num_write_kb":134510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":264028160,"data_stored":263971272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8506,"ondisk_log_size":8506,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2716,"num_read_kb":1480093,"num_write":24434,"num_write_kb":4326556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25980,"ondisk_log_size":25980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":136622360,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":754,"num_read_kb":436547,"num_write":9520,"num_write_kb":140553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":273309696,"data_stored":273244720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11090,"ondisk_log_size":11090,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133788,"kb_used_data":66516,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94238052,"statfs":{"total":96636764160,"available":96499765248,"internally_reserved":0,"allocated":68112384,"data_stored":67887709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163488,"kb_used_data":78232,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94208352,"statfs":{"total":96636764160,"available":96469352448,"internally_reserved":0,"allocated":80109568,"data_stored":79880869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141440,"kb_used_data":43704,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94230400,"statfs":{"total":96636764160,"available":96491929600,"internally_reserved":0,"allocated":44752896,"data_stored":44525982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185596,"kb_used_data":91956,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94186244,"statfs":{"total":96636764160,"available":96446713856,"internally_reserved":0,"allocated":94162944,"data_stored":93928717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172076,"kb_used_data":96548,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94199764,"statfs":{"total":96636764160,"available":96460558336,"internally_reserved":0,"allocated":98865152,"data_stored":98627692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":22855680,"data_stored":22634176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173140,"kb_used_data":83724,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94198700,"statfs":{"total":96636764160,"available":96459468800,"internally_reserved":0,"allocated":85733376,"data_stored":85497868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131296,"kb_used_data":46040,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94240544,"statfs":{"total":96636764160,"available":96502317056,"internally_reserved":0,"allocated":47144960,"data_stored":46916155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30298112,"data_stored":30288669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9867264,"data_stored":9863389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35041280,"data_stored":35029885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26099712,"data_stored":26094295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46145536,"data_stored":46138016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":55021394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63422464,"data_stored":63410002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47611904,"data_stored":47603442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18243882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:01:16.547 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T16:01:16.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:01:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 Processor -- start 2024-04-25T16:01:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 -- start start 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa86c0c92b0 0x7fa86c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa86c0c7d40 con 0x7fa86c154ae0 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa86c15a9e0 con 0x7fa86c0c92b0 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa870cb3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa86c15ac30 con 0x7fa86c0cac60 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa86c0c92b0 0x7fa86c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa86c0c92b0 0x7fa86c0c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51720/0 (socket says 172.21.15.87:51720) 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa86a59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa86c154ae0 0x7fa86c157e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44328/0 (socket says 172.21.15.87:44328) 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 -- 172.21.15.87:0/4233193353 learned_addr learned my addr 172.21.15.87:0/4233193353 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa86ad9d640 1 --2- 172.21.15.87:0/4233193353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 -- 172.21.15.87:0/4233193353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 msgr2=0x7fa86c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 --2- 172.21.15.87:0/4233193353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 -- 172.21.15.87:0/4233193353 >> v1:172.21.15.87:6789/0 conn(0x7fa86c154ae0 legacy=0x7fa86c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa869d9b640 1 -- 172.21.15.87:0/4233193353 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c15af10 con 0x7fa86c0c92b0 2024-04-25T16:01:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.736+0000 7fa86959a640 1 -- 172.21.15.87:0/4233193353 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891483826 0 0) 0x7fa86c0c7d40 con 0x7fa86c154ae0 2024-04-25T16:01:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa869d9b640 1 --2- 172.21.15.87:0/4233193353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c0c92b0 0x7fa86c0c96c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009870 tx=0x7fa85c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ebfc144038cb73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa86959a640 1 -- 172.21.15.87:0/4233193353 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0b1070 con 0x7fa86c0c92b0 2024-04-25T16:01:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa86959a640 1 -- 172.21.15.87:0/4233193353 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85c0a8050 con 0x7fa86c0c92b0 2024-04-25T16:01:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa86959a640 1 -- 172.21.15.87:0/4233193353 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0ac860 con 0x7fa86c0c92b0 2024-04-25T16:01:16.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 -- 172.21.15.87:0/4233193353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c0c92b0 msgr2=0x7fa86c0c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 --2- 172.21.15.87:0/4233193353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c0c92b0 0x7fa86c0c96c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009870 tx=0x7fa85c01c4d0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 -- 172.21.15.87:0/4233193353 shutdown_connections 2024-04-25T16:01:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 --2- 172.21.15.87:0/4233193353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c0c92b0 0x7fa86c0c96c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 --2- 172.21.15.87:0/4233193353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 -- 172.21.15.87:0/4233193353 >> 172.21.15.87:0/4233193353 conn(0x7fa86c0ae490 msgr2=0x7fa86c0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 -- 172.21.15.87:0/4233193353 shutdown_connections 2024-04-25T16:01:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.740+0000 7fa870cb3640 1 -- 172.21.15.87:0/4233193353 wait complete. 2024-04-25T16:01:16.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 Processor -- start 2024-04-25T16:01:16.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- start start 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa86c0c92b0 0x7fa86c161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 0x7fa86c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c0b2300 con 0x7fa86c154ae0 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c0c7b20 con 0x7fa86c0c92b0 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa86c0b2480 con 0x7fa86c0cac60 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 0x7fa86c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 0x7fa86c150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51736/0 (socket says 172.21.15.87:51736) 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 -- 172.21.15.87:0/2974300810 learned_addr learned my addr 172.21.15.87:0/2974300810 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86a59c640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa86c0c92b0 0x7fa86c161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa869d9b640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 -- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 msgr2=0x7fa86c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 -- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa86c0c92b0 msgr2=0x7fa86c161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa86c0c92b0 0x7fa86c161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 -- 172.21.15.87:0/2974300810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c14bad0 con 0x7fa86c154ae0 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86a59c640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa86c0c92b0 0x7fa86c161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa86ad9d640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 0x7fa86c150030 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa864007d40 tx=0x7fa86400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864014420 con 0x7fa86c154ae0 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa864019070 con 0x7fa86c154ae0 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864014820 con 0x7fa86c154ae0 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86c0adc20 con 0x7fa86c154ae0 2024-04-25T16:01:16.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86c0c6ca0 con 0x7fa86c154ae0 2024-04-25T16:01:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.744+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86c069bb0 con 0x7fa86c154ae0 2024-04-25T16:01:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.748+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa8640149c0 con 0x7fa86c154ae0 2024-04-25T16:01:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.748+0000 7fa85affd640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa84c06f430 0x7fa84c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.748+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fa864090180 con 0x7fa86c154ae0 2024-04-25T16:01:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.748+0000 7fa86a59c640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa84c06f430 0x7fa84c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.748+0000 7fa86a59c640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa84c06f430 0x7fa84c071940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa860000f70 tx=0x7fa860007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:16.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.752+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa86405c370 con 0x7fa86c154ae0 2024-04-25T16:01:16.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.912+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa86c0c9c30 con 0x7fa84c06f430 2024-04-25T16:01:16.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.928+0000 7fa85affd640 1 -- 172.21.15.87:0/2974300810 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494241 (secure 0 0 0) 0x7fa86c0c9c30 con 0x7fa84c06f430 2024-04-25T16:01:16.931 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:16.938 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa84c06f430 msgr2=0x7fa84c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa84c06f430 0x7fa84c071940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa860000f70 tx=0x7fa860007cb0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 msgr2=0x7fa86c150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 0x7fa86c150030 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa864007d40 tx=0x7fa86400e4b0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 shutdown_connections 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fa84c06f430 0x7fa84c071940 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa86c154ae0 0x7fa86c150030 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa86c0cac60 0x7fa86c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 --2- 172.21.15.87:0/2974300810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa86c0c92b0 0x7fa86c161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 >> 172.21.15.87:0/2974300810 conn(0x7fa86c0ae490 msgr2=0x7fa86c0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 shutdown_connections 2024-04-25T16:01:16.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:16.936+0000 7fa870cb3640 1 -- 172.21.15.87:0/2974300810 wait complete. 2024-04-25T16:01:16.961 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-25T16:01:15.277899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269198364,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7045,"num_read_kb":3737333,"num_write":65538,"num_write_kb":9067848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71569,"ondisk_log_size":71569,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1176528,"kb_used_data":529040,"kb_used_omap":12,"kb_used_meta":647411,"kb_avail":753798192,"statfs":{"total":773094113280,"available":771889348608,"internally_reserved":0,"allocated":541736960,"data_stored":539899168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":662949425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":189,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006109"},"pg_stats":[{"pgid":"5.18","version":"31'448","reported_seq":541,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560090+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T16:00:43.560090+0000","last_peered":"2024-04-25T16:00:43.560090+0000","last_clean":"2024-04-25T16:00:43.560090+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T16:00:43.560090+0000","last_undegraded":"2024-04-25T16:00:43.560090+0000","last_fullsized":"2024-04-25T16:00:43.560090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27881,"num_write":426,"num_write_kb":76310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"36'1437","reported_seq":1504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.593401+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T16:00:51.593401+0000","last_peered":"2024-04-25T16:00:51.593401+0000","last_clean":"2024-04-25T16:00:51.593401+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T16:00:51.593401+0000","last_undegraded":"2024-04-25T16:00:51.593401+0000","last_fullsized":"2024-04-25T16:00:51.593401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":18411,"num_write":1381,"num_write_kb":5019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'392","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.695464+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T16:00:51.695464+0000","last_peered":"2024-04-25T16:00:51.695464+0000","last_clean":"2024-04-25T16:00:51.695464+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T16:00:51.695464+0000","last_undegraded":"2024-04-25T16:00:51.695464+0000","last_fullsized":"2024-04-25T16:00:51.695464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12356,"num_write":363,"num_write_kb":47533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'229","reported_seq":271,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583062+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T16:00:43.583062+0000","last_peered":"2024-04-25T16:00:43.583062+0000","last_clean":"2024-04-25T16:00:43.583062+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T16:00:43.583062+0000","last_undegraded":"2024-04-25T16:00:43.583062+0000","last_fullsized":"2024-04-25T16:00:43.583062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":183,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'392","reported_seq":484,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562446+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T16:00:43.562446+0000","last_peered":"2024-04-25T16:00:43.562446+0000","last_clean":"2024-04-25T16:00:43.562446+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T16:00:43.562446+0000","last_undegraded":"2024-04-25T16:00:43.562446+0000","last_fullsized":"2024-04-25T16:00:43.562446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30984,"num_write":367,"num_write_kb":33760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"34'215","reported_seq":268,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.586373+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T16:00:43.586373+0000","last_peered":"2024-04-25T16:00:43.586373+0000","last_clean":"2024-04-25T16:00:43.586373+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T16:00:43.586373+0000","last_undegraded":"2024-04-25T16:00:43.586373+0000","last_fullsized":"2024-04-25T16:00:43.586373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":163,"num_write_kb":4188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'349","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570978+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T16:00:43.570978+0000","last_peered":"2024-04-25T16:00:43.570978+0000","last_clean":"2024-04-25T16:00:43.570978+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T16:00:43.570978+0000","last_undegraded":"2024-04-25T16:00:43.570978+0000","last_fullsized":"2024-04-25T16:00:43.570978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5423,"num_write":327,"num_write_kb":34935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'1396","reported_seq":1441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561108+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T16:00:43.561108+0000","last_peered":"2024-04-25T16:00:43.561108+0000","last_clean":"2024-04-25T16:00:43.561108+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T16:00:43.561108+0000","last_undegraded":"2024-04-25T16:00:43.561108+0000","last_fullsized":"2024-04-25T16:00:43.561108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1396,"log_dups_size":0,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1329,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"31'398","reported_seq":458,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576915+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T16:00:43.576915+0000","last_peered":"2024-04-25T16:00:43.576915+0000","last_clean":"2024-04-25T16:00:43.576915+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T16:00:43.576915+0000","last_undegraded":"2024-04-25T16:00:43.576915+0000","last_fullsized":"2024-04-25T16:00:43.576915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14376,"num_write":371,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"36'383","reported_seq":450,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681810+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T16:00:51.681810+0000","last_peered":"2024-04-25T16:00:51.681810+0000","last_clean":"2024-04-25T16:00:51.681810+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T16:00:51.681810+0000","last_undegraded":"2024-04-25T16:00:51.681810+0000","last_fullsized":"2024-04-25T16:00:51.681810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":45080,"num_write":303,"num_write_kb":12463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'366","reported_seq":455,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.623210+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T16:00:43.623210+0000","last_peered":"2024-04-25T16:00:43.623210+0000","last_clean":"2024-04-25T16:00:43.623210+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T16:00:43.623210+0000","last_undegraded":"2024-04-25T16:00:43.623210+0000","last_fullsized":"2024-04-25T16:00:43.623210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24540,"num_write":344,"num_write_kb":42834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'118","reported_seq":161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563312+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T16:00:43.563312+0000","last_peered":"2024-04-25T16:00:43.563312+0000","last_clean":"2024-04-25T16:00:43.563312+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T16:00:43.563312+0000","last_undegraded":"2024-04-25T16:00:43.563312+0000","last_fullsized":"2024-04-25T16:00:43.563312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":59,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'379","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618798+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T16:00:43.618798+0000","last_peered":"2024-04-25T16:00:43.618798+0000","last_clean":"2024-04-25T16:00:43.618798+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T16:00:43.618798+0000","last_undegraded":"2024-04-25T16:00:43.618798+0000","last_fullsized":"2024-04-25T16:00:43.618798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17536,"num_write":366,"num_write_kb":55228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"36'361","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.625597+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T16:00:51.625597+0000","last_peered":"2024-04-25T16:00:51.625597+0000","last_clean":"2024-04-25T16:00:51.625597+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T16:00:51.625597+0000","last_undegraded":"2024-04-25T16:00:51.625597+0000","last_fullsized":"2024-04-25T16:00:51.625597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":312,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'376","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.697044+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T16:00:51.697044+0000","last_peered":"2024-04-25T16:00:51.697044+0000","last_clean":"2024-04-25T16:00:51.697044+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T16:00:51.697044+0000","last_undegraded":"2024-04-25T16:00:51.697044+0000","last_fullsized":"2024-04-25T16:00:51.697044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31362,"num_write":348,"num_write_kb":63308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'407","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566429+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T16:00:43.566429+0000","last_peered":"2024-04-25T16:00:43.566429+0000","last_clean":"2024-04-25T16:00:43.566429+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T16:00:43.566429+0000","last_undegraded":"2024-04-25T16:00:43.566429+0000","last_fullsized":"2024-04-25T16:00:43.566429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":355,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'439","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563561+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T16:00:43.563561+0000","last_peered":"2024-04-25T16:00:43.563561+0000","last_clean":"2024-04-25T16:00:43.563561+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T16:00:43.563561+0000","last_undegraded":"2024-04-25T16:00:43.563561+0000","last_fullsized":"2024-04-25T16:00:43.563561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15953,"num_write":415,"num_write_kb":91831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"36'454","reported_seq":581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708278+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T16:00:51.708278+0000","last_peered":"2024-04-25T16:00:51.708278+0000","last_clean":"2024-04-25T16:00:51.708278+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T16:00:51.708278+0000","last_undegraded":"2024-04-25T16:00:51.708278+0000","last_fullsized":"2024-04-25T16:00:51.708278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":34259,"num_write":426,"num_write_kb":109355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'209","reported_seq":273,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.604101+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T16:00:51.604101+0000","last_peered":"2024-04-25T16:00:51.604101+0000","last_clean":"2024-04-25T16:00:51.604101+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T16:00:51.604101+0000","last_undegraded":"2024-04-25T16:00:51.604101+0000","last_fullsized":"2024-04-25T16:00:51.604101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":32780,"num_write":144,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'517","reported_seq":566,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563985+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T16:00:43.563985+0000","last_peered":"2024-04-25T16:00:43.563985+0000","last_clean":"2024-04-25T16:00:43.563985+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T16:00:43.563985+0000","last_undegraded":"2024-04-25T16:00:43.563985+0000","last_fullsized":"2024-04-25T16:00:43.563985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":469,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'399","reported_seq":479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558965+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T16:00:43.558965+0000","last_peered":"2024-04-25T16:00:43.558965+0000","last_clean":"2024-04-25T16:00:43.558965+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T16:00:43.558965+0000","last_undegraded":"2024-04-25T16:00:43.558965+0000","last_fullsized":"2024-04-25T16:00:43.558965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":26873,"num_write":378,"num_write_kb":71246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"35'429","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584166+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T16:00:43.584166+0000","last_peered":"2024-04-25T16:00:43.584166+0000","last_clean":"2024-04-25T16:00:43.584166+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T16:00:43.584166+0000","last_undegraded":"2024-04-25T16:00:43.584166+0000","last_fullsized":"2024-04-25T16:00:43.584166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42040,"num_write":408,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"34'200","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565925+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T16:00:43.565925+0000","last_peered":"2024-04-25T16:00:43.565925+0000","last_clean":"2024-04-25T16:00:43.565925+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T16:00:43.565925+0000","last_undegraded":"2024-04-25T16:00:43.565925+0000","last_fullsized":"2024-04-25T16:00:43.565925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'60","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567637+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T16:00:43.567637+0000","last_peered":"2024-04-25T16:00:43.567637+0000","last_clean":"2024-04-25T16:00:43.567637+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T16:00:43.567637+0000","last_undegraded":"2024-04-25T16:00:43.567637+0000","last_fullsized":"2024-04-25T16:00:43.567637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'380","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565677+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T16:00:43.565677+0000","last_peered":"2024-04-25T16:00:43.565677+0000","last_clean":"2024-04-25T16:00:43.565677+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T16:00:43.565677+0000","last_undegraded":"2024-04-25T16:00:43.565677+0000","last_fullsized":"2024-04-25T16:00:43.565677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24884,"num_write":362,"num_write_kb":71575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"35'377","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585642+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T16:00:43.585642+0000","last_peered":"2024-04-25T16:00:43.585642+0000","last_clean":"2024-04-25T16:00:43.585642+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T16:00:43.585642+0000","last_undegraded":"2024-04-25T16:00:43.585642+0000","last_fullsized":"2024-04-25T16:00:43.585642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7657,"num_write":351,"num_write_kb":21765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'69","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564212+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T16:00:43.564212+0000","last_peered":"2024-04-25T16:00:43.564212+0000","last_clean":"2024-04-25T16:00:43.564212+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T16:00:43.564212+0000","last_undegraded":"2024-04-25T16:00:43.564212+0000","last_fullsized":"2024-04-25T16:00:43.564212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'194","reported_seq":241,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":146,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"31'395","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620509+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T16:00:43.620509+0000","last_peered":"2024-04-25T16:00:43.620509+0000","last_clean":"2024-04-25T16:00:43.620509+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T16:00:43.620509+0000","last_undegraded":"2024-04-25T16:00:43.620509+0000","last_fullsized":"2024-04-25T16:00:43.620509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23834,"num_write":371,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"36'432","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699888+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T16:00:51.699888+0000","last_peered":"2024-04-25T16:00:51.699888+0000","last_clean":"2024-04-25T16:00:51.699888+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T16:00:51.699888+0000","last_undegraded":"2024-04-25T16:00:51.699888+0000","last_fullsized":"2024-04-25T16:00:51.699888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1051,"num_write":404,"num_write_kb":46183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"35'633","reported_seq":685,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.573910+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T16:00:43.573910+0000","last_peered":"2024-04-25T16:00:43.573910+0000","last_clean":"2024-04-25T16:00:43.573910+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T16:00:43.573910+0000","last_undegraded":"2024-04-25T16:00:43.573910+0000","last_fullsized":"2024-04-25T16:00:43.573910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":576,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'339","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566182+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T16:00:43.566182+0000","last_peered":"2024-04-25T16:00:43.566182+0000","last_clean":"2024-04-25T16:00:43.566182+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T16:00:43.566182+0000","last_undegraded":"2024-04-25T16:00:43.566182+0000","last_fullsized":"2024-04-25T16:00:43.566182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":287,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"31'408","reported_seq":519,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582757+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T16:00:43.582757+0000","last_peered":"2024-04-25T16:00:43.582757+0000","last_clean":"2024-04-25T16:00:43.582757+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T16:00:43.582757+0000","last_undegraded":"2024-04-25T16:00:43.582757+0000","last_fullsized":"2024-04-25T16:00:43.582757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":22153,"num_write":390,"num_write_kb":51497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"36'445","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702477+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T16:00:51.702477+0000","last_peered":"2024-04-25T16:00:51.702477+0000","last_clean":"2024-04-25T16:00:51.702477+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T16:00:51.702477+0000","last_undegraded":"2024-04-25T16:00:51.702477+0000","last_fullsized":"2024-04-25T16:00:51.702477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9563,"num_write":414,"num_write_kb":59478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'72","reported_seq":130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.629231+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T16:00:51.629231+0000","last_peered":"2024-04-25T16:00:51.629231+0000","last_clean":"2024-04-25T16:00:51.629231+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T16:00:51.629231+0000","last_undegraded":"2024-04-25T16:00:51.629231+0000","last_fullsized":"2024-04-25T16:00:51.629231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'291","reported_seq":548,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561716+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T16:00:43.561716+0000","last_peered":"2024-04-25T16:00:43.561716+0000","last_clean":"2024-04-25T16:00:43.561716+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T16:00:43.561716+0000","last_undegraded":"2024-04-25T16:00:43.561716+0000","last_fullsized":"2024-04-25T16:00:43.561716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465994,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":1569,"num_write":227,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"31'396","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559745+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T16:00:43.559745+0000","last_peered":"2024-04-25T16:00:43.559745+0000","last_clean":"2024-04-25T16:00:43.559745+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T16:00:43.559745+0000","last_undegraded":"2024-04-25T16:00:43.559745+0000","last_fullsized":"2024-04-25T16:00:43.559745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17201,"num_write":368,"num_write_kb":116540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'348","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584481+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T16:00:43.584481+0000","last_peered":"2024-04-25T16:00:43.584481+0000","last_clean":"2024-04-25T16:00:43.584481+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T16:00:43.584481+0000","last_undegraded":"2024-04-25T16:00:43.584481+0000","last_fullsized":"2024-04-25T16:00:43.584481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11261,"num_write":326,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"36'220","reported_seq":277,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707128+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T16:00:51.707128+0000","last_peered":"2024-04-25T16:00:51.707128+0000","last_clean":"2024-04-25T16:00:51.707128+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T16:00:51.707128+0000","last_undegraded":"2024-04-25T16:00:51.707128+0000","last_fullsized":"2024-04-25T16:00:51.707128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":264,"num_write":447,"num_write_kb":1604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"35'415","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582806+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T16:00:43.582806+0000","last_peered":"2024-04-25T16:00:43.582806+0000","last_clean":"2024-04-25T16:00:43.582806+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T16:00:43.582806+0000","last_undegraded":"2024-04-25T16:00:43.582806+0000","last_fullsized":"2024-04-25T16:00:43.582806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":348,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"31'355","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569759+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T16:00:43.569759+0000","last_peered":"2024-04-25T16:00:43.569759+0000","last_clean":"2024-04-25T16:00:43.569759+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T16:00:43.569759+0000","last_undegraded":"2024-04-25T16:00:43.569759+0000","last_fullsized":"2024-04-25T16:00:43.569759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":811,"num_write":334,"num_write_kb":50274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"36'395","reported_seq":478,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691697+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T16:00:51.691697+0000","last_peered":"2024-04-25T16:00:51.691697+0000","last_clean":"2024-04-25T16:00:51.691697+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T16:00:51.691697+0000","last_undegraded":"2024-04-25T16:00:51.691697+0000","last_fullsized":"2024-04-25T16:00:51.691697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17222,"num_write":367,"num_write_kb":107915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'211","reported_seq":262,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:46.021660+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T16:00:46.021660+0000","last_peered":"2024-04-25T16:00:46.021660+0000","last_clean":"2024-04-25T16:00:46.021660+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T16:00:46.021660+0000","last_undegraded":"2024-04-25T16:00:46.021660+0000","last_fullsized":"2024-04-25T16:00:46.021660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":156,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'73","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567937+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T16:00:43.567937+0000","last_peered":"2024-04-25T16:00:43.567937+0000","last_clean":"2024-04-25T16:00:43.567937+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T16:00:43.567937+0000","last_undegraded":"2024-04-25T16:00:43.567937+0000","last_fullsized":"2024-04-25T16:00:43.567937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'419","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569029+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T16:00:43.569029+0000","last_peered":"2024-04-25T16:00:43.569029+0000","last_clean":"2024-04-25T16:00:43.569029+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T16:00:43.569029+0000","last_undegraded":"2024-04-25T16:00:43.569029+0000","last_fullsized":"2024-04-25T16:00:43.569029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":27915,"num_write":400,"num_write_kb":113619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'436","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.703284+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T16:00:51.703284+0000","last_peered":"2024-04-25T16:00:51.703284+0000","last_clean":"2024-04-25T16:00:51.703284+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T16:00:51.703284+0000","last_undegraded":"2024-04-25T16:00:51.703284+0000","last_fullsized":"2024-04-25T16:00:51.703284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48041,"num_write":405,"num_write_kb":79758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'60","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564266+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T16:00:43.564266+0000","last_peered":"2024-04-25T16:00:43.564266+0000","last_clean":"2024-04-25T16:00:43.564266+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T16:00:43.564266+0000","last_undegraded":"2024-04-25T16:00:43.564266+0000","last_fullsized":"2024-04-25T16:00:43.564266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'647","reported_seq":695,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564966+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T16:00:43.564966+0000","last_peered":"2024-04-25T16:00:43.564966+0000","last_clean":"2024-04-25T16:00:43.564966+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T16:00:43.564966+0000","last_undegraded":"2024-04-25T16:00:43.564966+0000","last_fullsized":"2024-04-25T16:00:43.564966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":21962,"num_write":588,"num_write_kb":8473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'398","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570717+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T16:00:43.570717+0000","last_peered":"2024-04-25T16:00:43.570717+0000","last_clean":"2024-04-25T16:00:43.570717+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T16:00:43.570717+0000","last_undegraded":"2024-04-25T16:00:43.570717+0000","last_fullsized":"2024-04-25T16:00:43.570717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18043,"num_write":367,"num_write_kb":54591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'382","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565930+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T16:00:43.565930+0000","last_peered":"2024-04-25T16:00:43.565930+0000","last_clean":"2024-04-25T16:00:43.565930+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T16:00:43.565930+0000","last_undegraded":"2024-04-25T16:00:43.565930+0000","last_fullsized":"2024-04-25T16:00:43.565930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":351,"num_write_kb":26238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'641","reported_seq":698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.630615+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T16:00:43.630615+0000","last_peered":"2024-04-25T16:00:43.630615+0000","last_clean":"2024-04-25T16:00:43.630615+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T16:00:43.630615+0000","last_undegraded":"2024-04-25T16:00:43.630615+0000","last_fullsized":"2024-04-25T16:00:43.630615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":575,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'63","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563762+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T16:00:43.563762+0000","last_peered":"2024-04-25T16:00:43.563762+0000","last_clean":"2024-04-25T16:00:43.563762+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T16:00:43.563762+0000","last_undegraded":"2024-04-25T16:00:43.563762+0000","last_fullsized":"2024-04-25T16:00:43.563762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'417","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559349+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T16:00:43.559349+0000","last_peered":"2024-04-25T16:00:43.559349+0000","last_clean":"2024-04-25T16:00:43.559349+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T16:00:43.559349+0000","last_undegraded":"2024-04-25T16:00:43.559349+0000","last_fullsized":"2024-04-25T16:00:43.559349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":4695,"num_write":394,"num_write_kb":63230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'383","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562973+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T16:00:43.562973+0000","last_peered":"2024-04-25T16:00:43.562973+0000","last_clean":"2024-04-25T16:00:43.562973+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T16:00:43.562973+0000","last_undegraded":"2024-04-25T16:00:43.562973+0000","last_fullsized":"2024-04-25T16:00:43.562973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":357,"num_write_kb":25875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'325","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.575494+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T16:00:53.575494+0000","last_peered":"2024-04-25T16:00:53.575494+0000","last_clean":"2024-04-25T16:00:53.575494+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T16:00:53.575494+0000","last_undegraded":"2024-04-25T16:00:53.575494+0000","last_fullsized":"2024-04-25T16:00:53.575494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":1598,"num_write":259,"num_write_kb":1606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'73","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564080+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T16:00:43.564080+0000","last_peered":"2024-04-25T16:00:43.564080+0000","last_clean":"2024-04-25T16:00:43.564080+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T16:00:43.564080+0000","last_undegraded":"2024-04-25T16:00:43.564080+0000","last_fullsized":"2024-04-25T16:00:43.564080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'351","reported_seq":443,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621988+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T16:00:43.621988+0000","last_peered":"2024-04-25T16:00:43.621988+0000","last_clean":"2024-04-25T16:00:43.621988+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T16:00:43.621988+0000","last_undegraded":"2024-04-25T16:00:43.621988+0000","last_fullsized":"2024-04-25T16:00:43.621988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19848,"num_write":332,"num_write_kb":34180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"36'414","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.688373+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T16:00:51.688373+0000","last_peered":"2024-04-25T16:00:51.688373+0000","last_clean":"2024-04-25T16:00:51.688373+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T16:00:51.688373+0000","last_undegraded":"2024-04-25T16:00:51.688373+0000","last_fullsized":"2024-04-25T16:00:51.688373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":27907,"num_write":382,"num_write_kb":96848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'587","reported_seq":645,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.768045+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T16:00:43.768045+0000","last_peered":"2024-04-25T16:00:43.768045+0000","last_clean":"2024-04-25T16:00:43.768045+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T16:00:43.768045+0000","last_undegraded":"2024-04-25T16:00:43.768045+0000","last_fullsized":"2024-04-25T16:00:43.768045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":32151,"num_write":527,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'238","reported_seq":285,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571711+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T16:00:43.571711+0000","last_peered":"2024-04-25T16:00:43.571711+0000","last_clean":"2024-04-25T16:00:43.571711+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T16:00:43.571711+0000","last_undegraded":"2024-04-25T16:00:43.571711+0000","last_fullsized":"2024-04-25T16:00:43.571711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":156,"num_write":459,"num_write_kb":1609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'379","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.580092+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T16:00:43.580092+0000","last_peered":"2024-04-25T16:00:43.580092+0000","last_clean":"2024-04-25T16:00:43.580092+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T16:00:43.580092+0000","last_undegraded":"2024-04-25T16:00:43.580092+0000","last_fullsized":"2024-04-25T16:00:43.580092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":4720,"num_write":350,"num_write_kb":42976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'353","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642061+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T16:00:51.642061+0000","last_peered":"2024-04-25T16:00:51.642061+0000","last_clean":"2024-04-25T16:00:51.642061+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T16:00:51.642061+0000","last_undegraded":"2024-04-25T16:00:51.642061+0000","last_fullsized":"2024-04-25T16:00:51.642061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27299,"num_write":333,"num_write_kb":58716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.656733+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T16:00:51.656733+0000","last_peered":"2024-04-25T16:00:51.656733+0000","last_clean":"2024-04-25T16:00:51.656733+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T16:00:51.656733+0000","last_undegraded":"2024-04-25T16:00:51.656733+0000","last_fullsized":"2024-04-25T16:00:51.656733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.577654+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T16:00:43.577654+0000","last_peered":"2024-04-25T16:00:43.577654+0000","last_clean":"2024-04-25T16:00:43.577654+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T16:00:43.577654+0000","last_undegraded":"2024-04-25T16:00:43.577654+0000","last_fullsized":"2024-04-25T16:00:43.577654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'208","reported_seq":251,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561781+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T16:00:43.561781+0000","last_peered":"2024-04-25T16:00:43.561781+0000","last_clean":"2024-04-25T16:00:43.561781+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T16:00:43.561781+0000","last_undegraded":"2024-04-25T16:00:43.561781+0000","last_fullsized":"2024-04-25T16:00:43.561781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":141,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"31'402","reported_seq":508,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558941+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T16:00:43.558941+0000","last_peered":"2024-04-25T16:00:43.558941+0000","last_clean":"2024-04-25T16:00:43.558941+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T16:00:43.558941+0000","last_undegraded":"2024-04-25T16:00:43.558941+0000","last_fullsized":"2024-04-25T16:00:43.558941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45941,"num_write":380,"num_write_kb":54783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'411","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.579623+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T16:00:43.579623+0000","last_peered":"2024-04-25T16:00:43.579623+0000","last_clean":"2024-04-25T16:00:43.579623+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T16:00:43.579623+0000","last_undegraded":"2024-04-25T16:00:43.579623+0000","last_fullsized":"2024-04-25T16:00:43.579623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37252,"num_write":394,"num_write_kb":96094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'63","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707798+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T16:00:51.707798+0000","last_peered":"2024-04-25T16:00:51.707798+0000","last_clean":"2024-04-25T16:00:51.707798+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T16:00:51.707798+0000","last_undegraded":"2024-04-25T16:00:51.707798+0000","last_fullsized":"2024-04-25T16:00:51.707798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'123","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571142+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T16:00:43.571142+0000","last_peered":"2024-04-25T16:00:43.571142+0000","last_clean":"2024-04-25T16:00:43.571142+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T16:00:43.571142+0000","last_undegraded":"2024-04-25T16:00:43.571142+0000","last_fullsized":"2024-04-25T16:00:43.571142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":75,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'444","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557697+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T16:00:43.557697+0000","last_peered":"2024-04-25T16:00:43.557697+0000","last_clean":"2024-04-25T16:00:43.557697+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T16:00:43.557697+0000","last_undegraded":"2024-04-25T16:00:43.557697+0000","last_fullsized":"2024-04-25T16:00:43.557697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13011,"num_write":414,"num_write_kb":80257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'435","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698098+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T16:00:51.698098+0000","last_peered":"2024-04-25T16:00:51.698098+0000","last_clean":"2024-04-25T16:00:51.698098+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T16:00:51.698098+0000","last_undegraded":"2024-04-25T16:00:51.698098+0000","last_fullsized":"2024-04-25T16:00:51.698098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14130,"num_write":408,"num_write_kb":39042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"34'575","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.258432+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T16:00:44.258432+0000","last_peered":"2024-04-25T16:00:44.258432+0000","last_clean":"2024-04-25T16:00:44.258432+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T16:00:44.258432+0000","last_undegraded":"2024-04-25T16:00:44.258432+0000","last_fullsized":"2024-04-25T16:00:44.258432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":521,"num_write_kb":4332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'140","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567182+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T16:00:43.567182+0000","last_peered":"2024-04-25T16:00:43.567182+0000","last_clean":"2024-04-25T16:00:43.567182+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T16:00:43.567182+0000","last_undegraded":"2024-04-25T16:00:43.567182+0000","last_fullsized":"2024-04-25T16:00:43.567182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":20488,"num_write":73,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"31'446","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569564+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T16:00:43.569564+0000","last_peered":"2024-04-25T16:00:43.569564+0000","last_clean":"2024-04-25T16:00:43.569564+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T16:00:43.569564+0000","last_undegraded":"2024-04-25T16:00:43.569564+0000","last_fullsized":"2024-04-25T16:00:43.569564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17909,"num_write":426,"num_write_kb":58918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'390","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708088+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T16:00:51.708088+0000","last_peered":"2024-04-25T16:00:51.708088+0000","last_clean":"2024-04-25T16:00:51.708088+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T16:00:51.708088+0000","last_undegraded":"2024-04-25T16:00:51.708088+0000","last_fullsized":"2024-04-25T16:00:51.708088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39208,"num_write":362,"num_write_kb":67602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'283","reported_seq":344,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.627686+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T16:00:51.627686+0000","last_peered":"2024-04-25T16:00:51.627686+0000","last_clean":"2024-04-25T16:00:51.627686+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T16:00:51.627686+0000","last_undegraded":"2024-04-25T16:00:51.627686+0000","last_fullsized":"2024-04-25T16:00:51.627686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":236,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'548","reported_seq":593,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618215+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T16:00:43.618215+0000","last_peered":"2024-04-25T16:00:43.618215+0000","last_clean":"2024-04-25T16:00:43.618215+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T16:00:43.618215+0000","last_undegraded":"2024-04-25T16:00:43.618215+0000","last_fullsized":"2024-04-25T16:00:43.618215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":499,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'422","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557173+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T16:00:43.557173+0000","last_peered":"2024-04-25T16:00:43.557173+0000","last_clean":"2024-04-25T16:00:43.557173+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T16:00:43.557173+0000","last_undegraded":"2024-04-25T16:00:43.557173+0000","last_fullsized":"2024-04-25T16:00:43.557173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25440,"num_write":402,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'355","reported_seq":434,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706853+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T16:00:51.706853+0000","last_peered":"2024-04-25T16:00:51.706853+0000","last_clean":"2024-04-25T16:00:51.706853+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T16:00:51.706853+0000","last_undegraded":"2024-04-25T16:00:51.706853+0000","last_fullsized":"2024-04-25T16:00:51.706853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21419,"num_write":332,"num_write_kb":54133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'185","reported_seq":243,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.657326+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T16:00:51.657326+0000","last_peered":"2024-04-25T16:00:51.657326+0000","last_clean":"2024-04-25T16:00:51.657326+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T16:00:51.657326+0000","last_undegraded":"2024-04-25T16:00:51.657326+0000","last_fullsized":"2024-04-25T16:00:51.657326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":131,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"35'55","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561316+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T16:00:43.561316+0000","last_peered":"2024-04-25T16:00:43.561316+0000","last_clean":"2024-04-25T16:00:43.561316+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T16:00:43.561316+0000","last_undegraded":"2024-04-25T16:00:43.561316+0000","last_fullsized":"2024-04-25T16:00:43.561316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"31'370","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583347+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T16:00:43.583347+0000","last_peered":"2024-04-25T16:00:43.583347+0000","last_clean":"2024-04-25T16:00:43.583347+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T16:00:43.583347+0000","last_undegraded":"2024-04-25T16:00:43.583347+0000","last_fullsized":"2024-04-25T16:00:43.583347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":42885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'464","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691773+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T16:00:51.691773+0000","last_peered":"2024-04-25T16:00:51.691773+0000","last_clean":"2024-04-25T16:00:51.691773+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T16:00:51.691773+0000","last_undegraded":"2024-04-25T16:00:51.691773+0000","last_fullsized":"2024-04-25T16:00:51.691773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":34229,"num_write":431,"num_write_kb":50975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'302","reported_seq":391,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.577775+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T16:00:53.577775+0000","last_peered":"2024-04-25T16:00:53.577775+0000","last_clean":"2024-04-25T16:00:53.577775+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T16:00:53.577775+0000","last_undegraded":"2024-04-25T16:00:53.577775+0000","last_fullsized":"2024-04-25T16:00:53.577775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":5709,"num_write":249,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'222","reported_seq":264,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571367+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T16:00:43.571367+0000","last_peered":"2024-04-25T16:00:43.571367+0000","last_clean":"2024-04-25T16:00:43.571367+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T16:00:43.571367+0000","last_undegraded":"2024-04-25T16:00:43.571367+0000","last_fullsized":"2024-04-25T16:00:43.571367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":181,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'411","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619711+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T16:00:43.619711+0000","last_peered":"2024-04-25T16:00:43.619711+0000","last_clean":"2024-04-25T16:00:43.619711+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T16:00:43.619711+0000","last_undegraded":"2024-04-25T16:00:43.619711+0000","last_fullsized":"2024-04-25T16:00:43.619711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4854,"num_write":381,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"36'439","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676434+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T16:00:51.676434+0000","last_peered":"2024-04-25T16:00:51.676434+0000","last_clean":"2024-04-25T16:00:51.676434+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T16:00:51.676434+0000","last_undegraded":"2024-04-25T16:00:51.676434+0000","last_fullsized":"2024-04-25T16:00:51.676434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15516,"num_write":414,"num_write_kb":67395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562151+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T16:00:43.562151+0000","last_peered":"2024-04-25T16:00:43.562151+0000","last_clean":"2024-04-25T16:00:43.562151+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T16:00:43.562151+0000","last_undegraded":"2024-04-25T16:00:43.562151+0000","last_fullsized":"2024-04-25T16:00:43.562151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'72","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583932+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T16:00:43.583932+0000","last_peered":"2024-04-25T16:00:43.583932+0000","last_clean":"2024-04-25T16:00:43.583932+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T16:00:43.583932+0000","last_undegraded":"2024-04-25T16:00:43.583932+0000","last_fullsized":"2024-04-25T16:00:43.583932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'400","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619036+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T16:00:43.619036+0000","last_peered":"2024-04-25T16:00:43.619036+0000","last_clean":"2024-04-25T16:00:43.619036+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T16:00:43.619036+0000","last_undegraded":"2024-04-25T16:00:43.619036+0000","last_fullsized":"2024-04-25T16:00:43.619036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39850,"num_write":370,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"36'407","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691312+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T16:00:51.691312+0000","last_peered":"2024-04-25T16:00:51.691312+0000","last_clean":"2024-04-25T16:00:51.691312+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T16:00:51.691312+0000","last_undegraded":"2024-04-25T16:00:51.691312+0000","last_fullsized":"2024-04-25T16:00:51.691312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":33246,"num_write":383,"num_write_kb":97231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"36'72","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.704437+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T16:00:51.704437+0000","last_peered":"2024-04-25T16:00:51.704437+0000","last_clean":"2024-04-25T16:00:51.704437+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T16:00:51.704437+0000","last_undegraded":"2024-04-25T16:00:51.704437+0000","last_fullsized":"2024-04-25T16:00:51.704437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'282","reported_seq":345,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583847+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T16:00:43.583847+0000","last_peered":"2024-04-25T16:00:43.583847+0000","last_clean":"2024-04-25T16:00:43.583847+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T16:00:43.583847+0000","last_undegraded":"2024-04-25T16:00:43.583847+0000","last_fullsized":"2024-04-25T16:00:43.583847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":28701,"num_write":224,"num_write_kb":12419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'384","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583585+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T16:00:43.583585+0000","last_peered":"2024-04-25T16:00:43.583585+0000","last_clean":"2024-04-25T16:00:43.583585+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T16:00:43.583585+0000","last_undegraded":"2024-04-25T16:00:43.583585+0000","last_fullsized":"2024-04-25T16:00:43.583585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13411,"num_write":356,"num_write_kb":100243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'415","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.700278+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T16:00:51.700278+0000","last_peered":"2024-04-25T16:00:51.700278+0000","last_clean":"2024-04-25T16:00:51.700278+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T16:00:51.700278+0000","last_undegraded":"2024-04-25T16:00:51.700278+0000","last_fullsized":"2024-04-25T16:00:51.700278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13518,"num_write":393,"num_write_kb":67403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'925","reported_seq":993,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.592078+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T16:00:51.592078+0000","last_peered":"2024-04-25T16:00:51.592078+0000","last_clean":"2024-04-25T16:00:51.592078+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T16:00:51.592078+0000","last_undegraded":"2024-04-25T16:00:51.592078+0000","last_fullsized":"2024-04-25T16:00:51.592078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":28720,"num_write":874,"num_write_kb":8730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'142","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620409+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T16:00:43.620409+0000","last_peered":"2024-04-25T16:00:43.620409+0000","last_clean":"2024-04-25T16:00:43.620409+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T16:00:43.620409+0000","last_undegraded":"2024-04-25T16:00:43.620409+0000","last_fullsized":"2024-04-25T16:00:43.620409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":97,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"31'366","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583348+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T16:00:43.583348+0000","last_peered":"2024-04-25T16:00:43.583348+0000","last_clean":"2024-04-25T16:00:43.583348+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T16:00:43.583348+0000","last_undegraded":"2024-04-25T16:00:43.583348+0000","last_fullsized":"2024-04-25T16:00:43.583348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6536,"num_write":348,"num_write_kb":51835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"36'411","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705945+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T16:00:51.705945+0000","last_peered":"2024-04-25T16:00:51.705945+0000","last_clean":"2024-04-25T16:00:51.705945+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T16:00:51.705945+0000","last_undegraded":"2024-04-25T16:00:51.705945+0000","last_fullsized":"2024-04-25T16:00:51.705945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12973,"num_write":382,"num_write_kb":67863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'342","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.624046+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T16:00:51.624046+0000","last_peered":"2024-04-25T16:00:51.624046+0000","last_clean":"2024-04-25T16:00:51.624046+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T16:00:51.624046+0000","last_undegraded":"2024-04-25T16:00:51.624046+0000","last_fullsized":"2024-04-25T16:00:51.624046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":41004,"num_write":293,"num_write_kb":12450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'62","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564629+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T16:00:43.564629+0000","last_peered":"2024-04-25T16:00:43.564629+0000","last_clean":"2024-04-25T16:00:43.564629+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T16:00:43.564629+0000","last_undegraded":"2024-04-25T16:00:43.564629+0000","last_fullsized":"2024-04-25T16:00:43.564629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'409","reported_seq":505,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565353+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T16:00:43.565353+0000","last_peered":"2024-04-25T16:00:43.565353+0000","last_clean":"2024-04-25T16:00:43.565353+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T16:00:43.565353+0000","last_undegraded":"2024-04-25T16:00:43.565353+0000","last_fullsized":"2024-04-25T16:00:43.565353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30743,"num_write":387,"num_write_kb":71898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'393","reported_seq":487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684817+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T16:00:51.684817+0000","last_peered":"2024-04-25T16:00:51.684817+0000","last_clean":"2024-04-25T16:00:51.684817+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T16:00:51.684817+0000","last_undegraded":"2024-04-25T16:00:51.684817+0000","last_fullsized":"2024-04-25T16:00:51.684817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24508,"num_write":369,"num_write_kb":63737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'210","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:57.872968+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T16:00:57.872968+0000","last_peered":"2024-04-25T16:00:57.872968+0000","last_clean":"2024-04-25T16:00:57.872968+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T16:00:57.872968+0000","last_undegraded":"2024-04-25T16:00:57.872968+0000","last_fullsized":"2024-04-25T16:00:57.872968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":787,"num_write":162,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'536","reported_seq":590,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564408+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T16:00:43.564408+0000","last_peered":"2024-04-25T16:00:43.564408+0000","last_clean":"2024-04-25T16:00:43.564408+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T16:00:43.564408+0000","last_undegraded":"2024-04-25T16:00:43.564408+0000","last_fullsized":"2024-04-25T16:00:43.564408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24608,"num_write":474,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"31'470","reported_seq":569,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560394+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T16:00:43.560394+0000","last_peered":"2024-04-25T16:00:43.560394+0000","last_clean":"2024-04-25T16:00:43.560394+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T16:00:43.560394+0000","last_undegraded":"2024-04-25T16:00:43.560394+0000","last_fullsized":"2024-04-25T16:00:43.560394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31281,"num_write":455,"num_write_kb":108972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"36'380","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642794+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T16:00:51.642794+0000","last_peered":"2024-04-25T16:00:51.642794+0000","last_clean":"2024-04-25T16:00:51.642794+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T16:00:51.642794+0000","last_undegraded":"2024-04-25T16:00:51.642794+0000","last_fullsized":"2024-04-25T16:00:51.642794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":25762,"num_write":354,"num_write_kb":59652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'381","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.877917+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T16:00:45.877917+0000","last_peered":"2024-04-25T16:00:45.877917+0000","last_clean":"2024-04-25T16:00:45.877917+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T16:00:45.877917+0000","last_undegraded":"2024-04-25T16:00:45.877917+0000","last_fullsized":"2024-04-25T16:00:45.877917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8766,"num_write":314,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'141","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583710+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T16:00:43.583710+0000","last_peered":"2024-04-25T16:00:43.583710+0000","last_clean":"2024-04-25T16:00:43.583710+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T16:00:43.583710+0000","last_undegraded":"2024-04-25T16:00:43.583710+0000","last_fullsized":"2024-04-25T16:00:43.583710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494748,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":898,"num_write":91,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'426","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571429+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T16:00:43.571429+0000","last_peered":"2024-04-25T16:00:43.571429+0000","last_clean":"2024-04-25T16:00:43.571429+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T16:00:43.571429+0000","last_undegraded":"2024-04-25T16:00:43.571429+0000","last_fullsized":"2024-04-25T16:00:43.571429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13765,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"36'408","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621688+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T16:00:43.621688+0000","last_peered":"2024-04-25T16:00:43.621688+0000","last_clean":"2024-04-25T16:00:43.621688+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T16:00:43.621688+0000","last_undegraded":"2024-04-25T16:00:43.621688+0000","last_fullsized":"2024-04-25T16:00:43.621688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":381,"num_write_kb":62610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"36'68","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576238+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T16:00:43.576238+0000","last_peered":"2024-04-25T16:00:43.576238+0000","last_clean":"2024-04-25T16:00:43.576238+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T16:00:43.576238+0000","last_undegraded":"2024-04-25T16:00:43.576238+0000","last_fullsized":"2024-04-25T16:00:43.576238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'63","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582861+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T16:00:43.582861+0000","last_peered":"2024-04-25T16:00:43.582861+0000","last_clean":"2024-04-25T16:00:43.582861+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T16:00:43.582861+0000","last_undegraded":"2024-04-25T16:00:43.582861+0000","last_fullsized":"2024-04-25T16:00:43.582861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'354","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564245+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T16:00:43.564245+0000","last_peered":"2024-04-25T16:00:43.564245+0000","last_clean":"2024-04-25T16:00:43.564245+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T16:00:43.564245+0000","last_undegraded":"2024-04-25T16:00:43.564245+0000","last_fullsized":"2024-04-25T16:00:43.564245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17557,"num_write":333,"num_write_kb":46614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'111","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570878+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T16:00:43.570878+0000","last_peered":"2024-04-25T16:00:43.570878+0000","last_clean":"2024-04-25T16:00:43.570878+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T16:00:43.570878+0000","last_undegraded":"2024-04-25T16:00:43.570878+0000","last_fullsized":"2024-04-25T16:00:43.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":58,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'435","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684323+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T16:00:51.684323+0000","last_peered":"2024-04-25T16:00:51.684323+0000","last_clean":"2024-04-25T16:00:51.684323+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T16:00:51.684323+0000","last_undegraded":"2024-04-25T16:00:51.684323+0000","last_fullsized":"2024-04-25T16:00:51.684323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25415,"num_write":410,"num_write_kb":96682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'1093","reported_seq":1147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.543302+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T16:00:44.543302+0000","last_peered":"2024-04-25T16:00:44.543302+0000","last_clean":"2024-04-25T16:00:44.543302+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T16:00:44.543302+0000","last_undegraded":"2024-04-25T16:00:44.543302+0000","last_fullsized":"2024-04-25T16:00:44.543302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":1024,"num_write_kb":8705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"31'396","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570814+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T16:00:43.570814+0000","last_peered":"2024-04-25T16:00:43.570814+0000","last_clean":"2024-04-25T16:00:43.570814+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T16:00:43.570814+0000","last_undegraded":"2024-04-25T16:00:43.570814+0000","last_fullsized":"2024-04-25T16:00:43.570814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":20218,"num_write":374,"num_write_kb":83731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'99","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565603+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T16:00:43.565603+0000","last_peered":"2024-04-25T16:00:43.565603+0000","last_clean":"2024-04-25T16:00:43.565603+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T16:00:43.565603+0000","last_undegraded":"2024-04-25T16:00:43.565603+0000","last_fullsized":"2024-04-25T16:00:43.565603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12304,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'449","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585602+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T16:00:43.585602+0000","last_peered":"2024-04-25T16:00:43.585602+0000","last_clean":"2024-04-25T16:00:43.585602+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T16:00:43.585602+0000","last_undegraded":"2024-04-25T16:00:43.585602+0000","last_fullsized":"2024-04-25T16:00:43.585602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27119,"num_write":430,"num_write_kb":112459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'105","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.743069+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T16:00:45.743069+0000","last_peered":"2024-04-25T16:00:45.743069+0000","last_clean":"2024-04-25T16:00:45.743069+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T16:00:45.743069+0000","last_undegraded":"2024-04-25T16:00:45.743069+0000","last_fullsized":"2024-04-25T16:00:45.743069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":60,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"31'366","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564233+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T16:00:43.564233+0000","last_peered":"2024-04-25T16:00:43.564233+0000","last_clean":"2024-04-25T16:00:43.564233+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T16:00:43.564233+0000","last_undegraded":"2024-04-25T16:00:43.564233+0000","last_fullsized":"2024-04-25T16:00:43.564233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":31073,"num_write":335,"num_write_kb":72672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"34'620","reported_seq":678,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.348054+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T16:00:45.348054+0000","last_peered":"2024-04-25T16:00:45.348054+0000","last_clean":"2024-04-25T16:00:45.348054+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T16:00:45.348054+0000","last_undegraded":"2024-04-25T16:00:45.348054+0000","last_fullsized":"2024-04-25T16:00:45.348054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":551,"num_write_kb":12472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'393","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675955+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T16:00:51.675955+0000","last_peered":"2024-04-25T16:00:51.675955+0000","last_clean":"2024-04-25T16:00:51.675955+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T16:00:51.675955+0000","last_undegraded":"2024-04-25T16:00:51.675955+0000","last_fullsized":"2024-04-25T16:00:51.675955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31498,"num_write":372,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'337","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559283+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T16:00:43.559283+0000","last_peered":"2024-04-25T16:00:43.559283+0000","last_clean":"2024-04-25T16:00:43.559283+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T16:00:43.559283+0000","last_undegraded":"2024-04-25T16:00:43.559283+0000","last_fullsized":"2024-04-25T16:00:43.559283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":286,"num_write_kb":4236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'391","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566951+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T16:00:43.566951+0000","last_peered":"2024-04-25T16:00:43.566951+0000","last_clean":"2024-04-25T16:00:43.566951+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T16:00:43.566951+0000","last_undegraded":"2024-04-25T16:00:43.566951+0000","last_fullsized":"2024-04-25T16:00:43.566951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15625,"num_write":369,"num_write_kb":80649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"34'111","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584875+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T16:00:43.584875+0000","last_peered":"2024-04-25T16:00:43.584875+0000","last_clean":"2024-04-25T16:00:43.584875+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T16:00:43.584875+0000","last_undegraded":"2024-04-25T16:00:43.584875+0000","last_fullsized":"2024-04-25T16:00:43.584875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":57,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'382","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689989+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T16:00:51.689989+0000","last_peered":"2024-04-25T16:00:51.689989+0000","last_clean":"2024-04-25T16:00:51.689989+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T16:00:51.689989+0000","last_undegraded":"2024-04-25T16:00:51.689989+0000","last_fullsized":"2024-04-25T16:00:51.689989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28619,"num_write":357,"num_write_kb":42139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'305","reported_seq":358,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583900+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T16:00:43.583900+0000","last_peered":"2024-04-25T16:00:43.583900+0000","last_clean":"2024-04-25T16:00:43.583900+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T16:00:43.583900+0000","last_undegraded":"2024-04-25T16:00:43.583900+0000","last_fullsized":"2024-04-25T16:00:43.583900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":32783,"num_write":228,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"31'453","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585705+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T16:00:43.585705+0000","last_peered":"2024-04-25T16:00:43.585705+0000","last_clean":"2024-04-25T16:00:43.585705+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T16:00:43.585705+0000","last_undegraded":"2024-04-25T16:00:43.585705+0000","last_fullsized":"2024-04-25T16:00:43.585705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17355,"num_write":430,"num_write_kb":97199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'423","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702247+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T16:00:51.702247+0000","last_peered":"2024-04-25T16:00:51.702247+0000","last_clean":"2024-04-25T16:00:51.702247+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T16:00:51.702247+0000","last_undegraded":"2024-04-25T16:00:51.702247+0000","last_fullsized":"2024-04-25T16:00:51.702247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12292,"num_write":400,"num_write_kb":76879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"31'396","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562935+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T16:00:43.562935+0000","last_peered":"2024-04-25T16:00:43.562935+0000","last_clean":"2024-04-25T16:00:43.562935+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T16:00:43.562935+0000","last_undegraded":"2024-04-25T16:00:43.562935+0000","last_fullsized":"2024-04-25T16:00:43.562935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13093,"num_write":385,"num_write_kb":50492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'448","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.694727+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T16:00:51.694727+0000","last_peered":"2024-04-25T16:00:51.694727+0000","last_clean":"2024-04-25T16:00:51.694727+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T16:00:51.694727+0000","last_undegraded":"2024-04-25T16:00:51.694727+0000","last_fullsized":"2024-04-25T16:00:51.694727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":34274,"num_write":426,"num_write_kb":72417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"31'398","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618832+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T16:00:43.618832+0000","last_peered":"2024-04-25T16:00:43.618832+0000","last_clean":"2024-04-25T16:00:43.618832+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T16:00:43.618832+0000","last_undegraded":"2024-04-25T16:00:43.618832+0000","last_fullsized":"2024-04-25T16:00:43.618832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32843,"num_write":377,"num_write_kb":116675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"36'474","reported_seq":588,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.692733+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T16:00:51.692733+0000","last_peered":"2024-04-25T16:00:51.692733+0000","last_clean":"2024-04-25T16:00:51.692733+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T16:00:51.692733+0000","last_undegraded":"2024-04-25T16:00:51.692733+0000","last_fullsized":"2024-04-25T16:00:51.692733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33678,"num_write":445,"num_write_kb":67390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564869+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T16:00:43.564869+0000","last_peered":"2024-04-25T16:00:43.564869+0000","last_clean":"2024-04-25T16:00:43.564869+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T16:00:43.564869+0000","last_undegraded":"2024-04-25T16:00:43.564869+0000","last_fullsized":"2024-04-25T16:00:43.564869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19077,"num_write":388,"num_write_kb":75668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'415","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679135+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T16:00:51.679135+0000","last_peered":"2024-04-25T16:00:51.679135+0000","last_clean":"2024-04-25T16:00:51.679135+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T16:00:51.679135+0000","last_undegraded":"2024-04-25T16:00:51.679135+0000","last_fullsized":"2024-04-25T16:00:51.679135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15212,"num_write":389,"num_write_kb":87855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"31'469","reported_seq":572,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569399+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T16:00:43.569399+0000","last_peered":"2024-04-25T16:00:43.569399+0000","last_clean":"2024-04-25T16:00:43.569399+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T16:00:43.569399+0000","last_undegraded":"2024-04-25T16:00:43.569399+0000","last_fullsized":"2024-04-25T16:00:43.569399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":27411,"num_write":441,"num_write_kb":71769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"36'370","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699867+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T16:00:51.699867+0000","last_peered":"2024-04-25T16:00:51.699867+0000","last_clean":"2024-04-25T16:00:51.699867+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T16:00:51.699867+0000","last_undegraded":"2024-04-25T16:00:51.699867+0000","last_fullsized":"2024-04-25T16:00:51.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17348,"num_write":348,"num_write_kb":62807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"31'399","reported_seq":493,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566996+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T16:00:43.566996+0000","last_peered":"2024-04-25T16:00:43.566996+0000","last_clean":"2024-04-25T16:00:43.566996+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T16:00:43.566996+0000","last_undegraded":"2024-04-25T16:00:43.566996+0000","last_fullsized":"2024-04-25T16:00:43.566996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25133,"num_write":374,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"36'389","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9093,"num_write":358,"num_write_kb":54590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"31'414","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T16:00:43.570320+0000","last_peered":"2024-04-25T16:00:43.570320+0000","last_clean":"2024-04-25T16:00:43.570320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T16:00:43.570320+0000","last_undegraded":"2024-04-25T16:00:43.570320+0000","last_fullsized":"2024-04-25T16:00:43.570320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4145,"num_write":400,"num_write_kb":47343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"36'485","reported_seq":607,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.574681+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T16:00:43.574681+0000","last_peered":"2024-04-25T16:00:43.574681+0000","last_clean":"2024-04-25T16:00:43.574681+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T16:00:43.574681+0000","last_undegraded":"2024-04-25T16:00:43.574681+0000","last_fullsized":"2024-04-25T16:00:43.574681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40854,"num_write":458,"num_write_kb":125991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"31'410","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559076+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T16:00:43.559076+0000","last_peered":"2024-04-25T16:00:43.559076+0000","last_clean":"2024-04-25T16:00:43.559076+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T16:00:43.559076+0000","last_undegraded":"2024-04-25T16:00:43.559076+0000","last_fullsized":"2024-04-25T16:00:43.559076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26310,"num_write":391,"num_write_kb":68273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'398","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679994+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T16:00:51.679994+0000","last_peered":"2024-04-25T16:00:51.679994+0000","last_clean":"2024-04-25T16:00:51.679994+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T16:00:51.679994+0000","last_undegraded":"2024-04-25T16:00:51.679994+0000","last_fullsized":"2024-04-25T16:00:51.679994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4252,"num_write":382,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"31'416","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583427+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T16:00:43.583427+0000","last_peered":"2024-04-25T16:00:43.583427+0000","last_clean":"2024-04-25T16:00:43.583427+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T16:00:43.583427+0000","last_undegraded":"2024-04-25T16:00:43.583427+0000","last_fullsized":"2024-04-25T16:00:43.583427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38150,"num_write":393,"num_write_kb":63831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'452","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.661661+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T16:00:51.661661+0000","last_peered":"2024-04-25T16:00:51.661661+0000","last_clean":"2024-04-25T16:00:51.661661+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T16:00:51.661661+0000","last_undegraded":"2024-04-25T16:00:51.661661+0000","last_fullsized":"2024-04-25T16:00:51.661661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13732,"num_write":425,"num_write_kb":92170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"31'400","reported_seq":496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.572217+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T16:00:43.572217+0000","last_peered":"2024-04-25T16:00:43.572217+0000","last_clean":"2024-04-25T16:00:43.572217+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T16:00:43.572217+0000","last_undegraded":"2024-04-25T16:00:43.572217+0000","last_fullsized":"2024-04-25T16:00:43.572217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30630,"num_write":376,"num_write_kb":46781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"36'400","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.658583+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T16:00:51.658583+0000","last_peered":"2024-04-25T16:00:51.658583+0000","last_clean":"2024-04-25T16:00:51.658583+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T16:00:51.658583+0000","last_undegraded":"2024-04-25T16:00:51.658583+0000","last_fullsized":"2024-04-25T16:00:51.658583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":15673,"num_write":376,"num_write_kb":63098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"31'448","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558895+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T16:00:43.558895+0000","last_peered":"2024-04-25T16:00:43.558895+0000","last_clean":"2024-04-25T16:00:43.558895+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T16:00:43.558895+0000","last_undegraded":"2024-04-25T16:00:43.558895+0000","last_fullsized":"2024-04-25T16:00:43.558895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17288,"num_write":429,"num_write_kb":67321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"35'439","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620632+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T16:00:43.620632+0000","last_peered":"2024-04-25T16:00:43.620632+0000","last_clean":"2024-04-25T16:00:43.620632+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T16:00:43.620632+0000","last_undegraded":"2024-04-25T16:00:43.620632+0000","last_fullsized":"2024-04-25T16:00:43.620632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":44523,"num_write":420,"num_write_kb":101102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"31'449","reported_seq":563,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583236+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T16:00:43.583236+0000","last_peered":"2024-04-25T16:00:43.583236+0000","last_clean":"2024-04-25T16:00:43.583236+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T16:00:43.583236+0000","last_undegraded":"2024-04-25T16:00:43.583236+0000","last_fullsized":"2024-04-25T16:00:43.583236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42039,"num_write":424,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.639652+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T16:00:51.639652+0000","last_peered":"2024-04-25T16:00:51.639652+0000","last_clean":"2024-04-25T16:00:51.639652+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T16:00:51.639652+0000","last_undegraded":"2024-04-25T16:00:51.639652+0000","last_fullsized":"2024-04-25T16:00:51.639652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27977,"num_write":389,"num_write_kb":84131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"31'427","reported_seq":554,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565215+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T16:00:43.565215+0000","last_peered":"2024-04-25T16:00:43.565215+0000","last_clean":"2024-04-25T16:00:43.565215+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T16:00:43.565215+0000","last_undegraded":"2024-04-25T16:00:43.565215+0000","last_fullsized":"2024-04-25T16:00:43.565215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43629,"num_write":407,"num_write_kb":76072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"35'432","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564858+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T16:00:43.564858+0000","last_peered":"2024-04-25T16:00:43.564858+0000","last_clean":"2024-04-25T16:00:43.564858+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T16:00:43.564858+0000","last_undegraded":"2024-04-25T16:00:43.564858+0000","last_fullsized":"2024-04-25T16:00:43.564858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30618,"num_write":414,"num_write_kb":71070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"31'389","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559593+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T16:00:43.559593+0000","last_peered":"2024-04-25T16:00:43.559593+0000","last_clean":"2024-04-25T16:00:43.559593+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T16:00:43.559593+0000","last_undegraded":"2024-04-25T16:00:43.559593+0000","last_fullsized":"2024-04-25T16:00:43.559593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30549,"num_write":360,"num_write_kb":75006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"36'422","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.670952+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T16:00:51.670952+0000","last_peered":"2024-04-25T16:00:51.670952+0000","last_clean":"2024-04-25T16:00:51.670952+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T16:00:51.670952+0000","last_undegraded":"2024-04-25T16:00:51.670952+0000","last_fullsized":"2024-04-25T16:00:51.670952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39450,"num_write":395,"num_write_kb":75510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"31'437","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.617890+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T16:00:43.617890+0000","last_peered":"2024-04-25T16:00:43.617890+0000","last_clean":"2024-04-25T16:00:43.617890+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T16:00:43.617890+0000","last_undegraded":"2024-04-25T16:00:43.617890+0000","last_fullsized":"2024-04-25T16:00:43.617890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19085,"num_write":412,"num_write_kb":55082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"36'406","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699401+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T16:00:51.699401+0000","last_peered":"2024-04-25T16:00:51.699401+0000","last_clean":"2024-04-25T16:00:51.699401+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T16:00:51.699401+0000","last_undegraded":"2024-04-25T16:00:51.699401+0000","last_fullsized":"2024-04-25T16:00:51.699401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24863,"num_write":384,"num_write_kb":75591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"31'420","reported_seq":503,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562491+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T16:00:43.562491+0000","last_peered":"2024-04-25T16:00:43.562491+0000","last_clean":"2024-04-25T16:00:43.562491+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T16:00:43.562491+0000","last_undegraded":"2024-04-25T16:00:43.562491+0000","last_fullsized":"2024-04-25T16:00:43.562491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20260,"num_write":395,"num_write_kb":76151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'416","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707524+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T16:00:51.707524+0000","last_peered":"2024-04-25T16:00:51.707524+0000","last_clean":"2024-04-25T16:00:51.707524+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T16:00:51.707524+0000","last_undegraded":"2024-04-25T16:00:51.707524+0000","last_fullsized":"2024-04-25T16:00:51.707524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24467,"num_write":391,"num_write_kb":79816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"31'404","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562708+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T16:00:43.562708+0000","last_peered":"2024-04-25T16:00:43.562708+0000","last_clean":"2024-04-25T16:00:43.562708+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T16:00:43.562708+0000","last_undegraded":"2024-04-25T16:00:43.562708+0000","last_fullsized":"2024-04-25T16:00:43.562708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25761,"num_write":377,"num_write_kb":87528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"36'432","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705538+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T16:00:51.705538+0000","last_peered":"2024-04-25T16:00:51.705538+0000","last_clean":"2024-04-25T16:00:51.705538+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T16:00:51.705538+0000","last_undegraded":"2024-04-25T16:00:51.705538+0000","last_fullsized":"2024-04-25T16:00:51.705538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":33533,"num_write":410,"num_write_kb":87842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"31'400","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562996+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T16:00:43.562996+0000","last_peered":"2024-04-25T16:00:43.562996+0000","last_clean":"2024-04-25T16:00:43.562996+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T16:00:43.562996+0000","last_undegraded":"2024-04-25T16:00:43.562996+0000","last_fullsized":"2024-04-25T16:00:43.562996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29549,"num_write":386,"num_write_kb":55194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"36'394","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689283+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T16:00:51.689283+0000","last_peered":"2024-04-25T16:00:51.689283+0000","last_clean":"2024-04-25T16:00:51.689283+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T16:00:51.689283+0000","last_undegraded":"2024-04-25T16:00:51.689283+0000","last_fullsized":"2024-04-25T16:00:51.689283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46746,"num_write":370,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"31'338","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618796+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T16:00:43.618796+0000","last_peered":"2024-04-25T16:00:43.618796+0000","last_clean":"2024-04-25T16:00:43.618796+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T16:00:43.618796+0000","last_undegraded":"2024-04-25T16:00:43.618796+0000","last_fullsized":"2024-04-25T16:00:43.618796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9201,"num_write":322,"num_write_kb":37990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"36'397","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701141+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T16:00:51.701141+0000","last_peered":"2024-04-25T16:00:51.701141+0000","last_clean":"2024-04-25T16:00:51.701141+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T16:00:51.701141+0000","last_undegraded":"2024-04-25T16:00:51.701141+0000","last_fullsized":"2024-04-25T16:00:51.701141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14146,"num_write":373,"num_write_kb":38796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"31'395","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576883+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T16:00:43.576883+0000","last_peered":"2024-04-25T16:00:43.576883+0000","last_clean":"2024-04-25T16:00:43.576883+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T16:00:43.576883+0000","last_undegraded":"2024-04-25T16:00:43.576883+0000","last_fullsized":"2024-04-25T16:00:43.576883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":61604,"num_write":383,"num_write_kb":95809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"36'373","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583502+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T16:00:43.583502+0000","last_peered":"2024-04-25T16:00:43.583502+0000","last_clean":"2024-04-25T16:00:43.583502+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T16:00:43.583502+0000","last_undegraded":"2024-04-25T16:00:43.583502+0000","last_fullsized":"2024-04-25T16:00:43.583502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13278,"num_write":350,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"31'383","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585454+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T16:00:43.585454+0000","last_peered":"2024-04-25T16:00:43.585454+0000","last_clean":"2024-04-25T16:00:43.585454+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T16:00:43.585454+0000","last_undegraded":"2024-04-25T16:00:43.585454+0000","last_fullsized":"2024-04-25T16:00:43.585454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4096,"num_write":350,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'356","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684443+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T16:00:51.684443+0000","last_peered":"2024-04-25T16:00:51.684443+0000","last_clean":"2024-04-25T16:00:51.684443+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T16:00:51.684443+0000","last_undegraded":"2024-04-25T16:00:51.684443+0000","last_fullsized":"2024-04-25T16:00:51.684443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19489,"num_write":338,"num_write_kb":75079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"31'369","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557847+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T16:00:43.557847+0000","last_peered":"2024-04-25T16:00:43.557847+0000","last_clean":"2024-04-25T16:00:43.557847+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T16:00:43.557847+0000","last_undegraded":"2024-04-25T16:00:43.557847+0000","last_fullsized":"2024-04-25T16:00:43.557847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1693,"num_write":344,"num_write_kb":38100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"36'368","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706369+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T16:00:51.706369+0000","last_peered":"2024-04-25T16:00:51.706369+0000","last_clean":"2024-04-25T16:00:51.706369+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T16:00:51.706369+0000","last_undegraded":"2024-04-25T16:00:51.706369+0000","last_fullsized":"2024-04-25T16:00:51.706369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25999,"num_write":356,"num_write_kb":38429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"31'447","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576302+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T16:00:43.576302+0000","last_peered":"2024-04-25T16:00:43.576302+0000","last_clean":"2024-04-25T16:00:43.576302+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T16:00:43.576302+0000","last_undegraded":"2024-04-25T16:00:43.576302+0000","last_fullsized":"2024-04-25T16:00:43.576302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38032,"num_write":427,"num_write_kb":75902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"36'382","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681204+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T16:00:51.681204+0000","last_peered":"2024-04-25T16:00:51.681204+0000","last_clean":"2024-04-25T16:00:51.681204+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T16:00:51.681204+0000","last_undegraded":"2024-04-25T16:00:51.681204+0000","last_fullsized":"2024-04-25T16:00:51.681204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33238,"num_write":360,"num_write_kb":83325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"31'430","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618117+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T16:00:43.618117+0000","last_peered":"2024-04-25T16:00:43.618117+0000","last_clean":"2024-04-25T16:00:43.618117+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T16:00:43.618117+0000","last_undegraded":"2024-04-25T16:00:43.618117+0000","last_fullsized":"2024-04-25T16:00:43.618117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47776,"num_write":403,"num_write_kb":100333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"36'419","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.682360+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T16:00:51.682360+0000","last_peered":"2024-04-25T16:00:51.682360+0000","last_clean":"2024-04-25T16:00:51.682360+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T16:00:51.682360+0000","last_undegraded":"2024-04-25T16:00:51.682360+0000","last_fullsized":"2024-04-25T16:00:51.682360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31054,"num_write":404,"num_write_kb":100026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"31'457","reported_seq":596,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583419+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T16:00:43.583419+0000","last_peered":"2024-04-25T16:00:43.583419+0000","last_clean":"2024-04-25T16:00:43.583419+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T16:00:43.583419+0000","last_undegraded":"2024-04-25T16:00:43.583419+0000","last_fullsized":"2024-04-25T16:00:43.583419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56462,"num_write":435,"num_write_kb":97259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"36'357","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698267+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T16:00:51.698267+0000","last_peered":"2024-04-25T16:00:51.698267+0000","last_clean":"2024-04-25T16:00:51.698267+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T16:00:51.698267+0000","last_undegraded":"2024-04-25T16:00:51.698267+0000","last_fullsized":"2024-04-25T16:00:51.698267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9534,"num_write":325,"num_write_kb":26581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"31'417","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562885+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T16:00:43.562885+0000","last_peered":"2024-04-25T16:00:43.562885+0000","last_clean":"2024-04-25T16:00:43.562885+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T16:00:43.562885+0000","last_undegraded":"2024-04-25T16:00:43.562885+0000","last_fullsized":"2024-04-25T16:00:43.562885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28935,"num_write":390,"num_write_kb":55220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"36'446","reported_seq":557,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571000+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T16:00:43.571000+0000","last_peered":"2024-04-25T16:00:43.571000+0000","last_clean":"2024-04-25T16:00:43.571000+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T16:00:43.571000+0000","last_undegraded":"2024-04-25T16:00:43.571000+0000","last_fullsized":"2024-04-25T16:00:43.571000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":18239,"num_write":428,"num_write_kb":69651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"31'386","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562548+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T16:00:43.562548+0000","last_peered":"2024-04-25T16:00:43.562548+0000","last_clean":"2024-04-25T16:00:43.562548+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T16:00:43.562548+0000","last_undegraded":"2024-04-25T16:00:43.562548+0000","last_fullsized":"2024-04-25T16:00:43.562548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8859,"num_write":358,"num_write_kb":46267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'391","reported_seq":488,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676568+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T16:00:51.676568+0000","last_peered":"2024-04-25T16:00:51.676568+0000","last_clean":"2024-04-25T16:00:51.676568+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T16:00:51.676568+0000","last_undegraded":"2024-04-25T16:00:51.676568+0000","last_fullsized":"2024-04-25T16:00:51.676568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32236,"num_write":374,"num_write_kb":95777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"31'357","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619677+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T16:00:43.619677+0000","last_peered":"2024-04-25T16:00:43.619677+0000","last_clean":"2024-04-25T16:00:43.619677+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T16:00:43.619677+0000","last_undegraded":"2024-04-25T16:00:43.619677+0000","last_fullsized":"2024-04-25T16:00:43.619677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22705,"num_write":334,"num_write_kb":38119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"36'425","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.668379+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T16:00:51.668379+0000","last_peered":"2024-04-25T16:00:51.668379+0000","last_clean":"2024-04-25T16:00:51.668379+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T16:00:51.668379+0000","last_undegraded":"2024-04-25T16:00:51.668379+0000","last_fullsized":"2024-04-25T16:00:51.668379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22941,"num_write":404,"num_write_kb":72501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"31'377","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582939+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T16:00:43.582939+0000","last_peered":"2024-04-25T16:00:43.582939+0000","last_clean":"2024-04-25T16:00:43.582939+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T16:00:43.582939+0000","last_undegraded":"2024-04-25T16:00:43.582939+0000","last_fullsized":"2024-04-25T16:00:43.582939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10994,"num_write":357,"num_write_kb":50723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'404","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701848+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T16:00:51.701848+0000","last_peered":"2024-04-25T16:00:51.701848+0000","last_clean":"2024-04-25T16:00:51.701848+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T16:00:51.701848+0000","last_undegraded":"2024-04-25T16:00:51.701848+0000","last_fullsized":"2024-04-25T16:00:51.701848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11471,"num_write":379,"num_write_kb":75857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557154+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T16:00:43.557154+0000","last_peered":"2024-04-25T16:00:43.557154+0000","last_clean":"2024-04-25T16:00:43.557154+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T16:00:43.557154+0000","last_undegraded":"2024-04-25T16:00:43.557154+0000","last_fullsized":"2024-04-25T16:00:43.557154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20101,"num_write":381,"num_write_kb":55469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"35'349","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570822+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T16:00:43.570822+0000","last_peered":"2024-04-25T16:00:43.570822+0000","last_clean":"2024-04-25T16:00:43.570822+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T16:00:43.570822+0000","last_undegraded":"2024-04-25T16:00:43.570822+0000","last_fullsized":"2024-04-25T16:00:43.570822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9293,"num_write":327,"num_write_kb":37967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"31'359","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569043+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T16:00:43.569043+0000","last_peered":"2024-04-25T16:00:43.569043+0000","last_clean":"2024-04-25T16:00:43.569043+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T16:00:43.569043+0000","last_undegraded":"2024-04-25T16:00:43.569043+0000","last_fullsized":"2024-04-25T16:00:43.569043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33728,"num_write":336,"num_write_kb":95963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675862+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T16:00:51.675862+0000","last_peered":"2024-04-25T16:00:51.675862+0000","last_clean":"2024-04-25T16:00:51.675862+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T16:00:51.675862+0000","last_undegraded":"2024-04-25T16:00:51.675862+0000","last_fullsized":"2024-04-25T16:00:51.675862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15261,"num_write":373,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"31'453","reported_seq":603,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569482+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T16:00:43.569482+0000","last_peered":"2024-04-25T16:00:43.569482+0000","last_clean":"2024-04-25T16:00:43.569482+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T16:00:43.569482+0000","last_undegraded":"2024-04-25T16:00:43.569482+0000","last_fullsized":"2024-04-25T16:00:43.569482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":65459,"num_write":436,"num_write_kb":138981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"36'408","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.578583+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T16:00:43.578583+0000","last_peered":"2024-04-25T16:00:43.578583+0000","last_clean":"2024-04-25T16:00:43.578583+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T16:00:43.578583+0000","last_undegraded":"2024-04-25T16:00:43.578583+0000","last_fullsized":"2024-04-25T16:00:43.578583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":41811,"num_write":385,"num_write_kb":100198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2984,"num_read_kb":1496873,"num_write":24473,"num_write_kb":4464601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25921,"ondisk_log_size":25921,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":131985636,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":525,"num_read_kb":323765,"num_write":7010,"num_write_kb":134510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":264028160,"data_stored":263971272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8506,"ondisk_log_size":8506,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2716,"num_read_kb":1480093,"num_write":24434,"num_write_kb":4326556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25980,"ondisk_log_size":25980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":136622360,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":754,"num_read_kb":436547,"num_write":9520,"num_write_kb":140553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":273309696,"data_stored":273244720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11090,"ondisk_log_size":11090,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133788,"kb_used_data":66516,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94238052,"statfs":{"total":96636764160,"available":96499765248,"internally_reserved":0,"allocated":68112384,"data_stored":67887709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163488,"kb_used_data":78232,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94208352,"statfs":{"total":96636764160,"available":96469352448,"internally_reserved":0,"allocated":80109568,"data_stored":79880869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141440,"kb_used_data":43704,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94230400,"statfs":{"total":96636764160,"available":96491929600,"internally_reserved":0,"allocated":44752896,"data_stored":44525982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185596,"kb_used_data":91956,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94186244,"statfs":{"total":96636764160,"available":96446713856,"internally_reserved":0,"allocated":94162944,"data_stored":93928717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172076,"kb_used_data":96548,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94199764,"statfs":{"total":96636764160,"available":96460558336,"internally_reserved":0,"allocated":98865152,"data_stored":98627692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":22855680,"data_stored":22634176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173140,"kb_used_data":83724,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94198700,"statfs":{"total":96636764160,"available":96459468800,"internally_reserved":0,"allocated":85733376,"data_stored":85497868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131296,"kb_used_data":46040,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94240544,"statfs":{"total":96636764160,"available":96502317056,"internally_reserved":0,"allocated":47144960,"data_stored":46916155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30298112,"data_stored":30288669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9867264,"data_stored":9863389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35041280,"data_stored":35029885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26099712,"data_stored":26094295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46145536,"data_stored":46138016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":55021394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63422464,"data_stored":63410002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47611904,"data_stored":47603442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18243882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:01:16.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:01:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.152+0000 7fed52a68640 1 Processor -- start 2024-04-25T16:01:17.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.152+0000 7fed52a68640 1 -- start start 2024-04-25T16:01:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed52a68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c14d810 0x7fed4c157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed52a68640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed4c154d00 0x7fed4c154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed52a68640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4c157d50 con 0x7fed4c06f790 2024-04-25T16:01:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed52a68640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fed4c0add10 con 0x7fed4c154d00 2024-04-25T16:01:17.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed52a68640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c0adff0 con 0x7fed4c14d810 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed4bfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fed4c154d00 0x7fed4c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed50804640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c14d810 0x7fed4c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed51005640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fed4c06f790 0x7fed4c0c2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:35172/0 (socket says 172.21.15.87:35172) 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed51005640 1 -- 172.21.15.87:0/165745728 learned_addr learned my addr 172.21.15.87:0/165745728 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed50804640 1 -- 172.21.15.87:0/165745728 >> v2:172.21.15.155:3300/0 conn(0x7fed4c154d00 msgr2=0x7fed4c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed50804640 1 --2- 172.21.15.87:0/165745728 >> v2:172.21.15.155:3300/0 conn(0x7fed4c154d00 0x7fed4c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed50804640 1 -- 172.21.15.87:0/165745728 >> v1:172.21.15.155:6789/0 conn(0x7fed4c06f790 legacy=0x7fed4c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed50804640 1 -- 172.21.15.87:0/165745728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c157010 con 0x7fed4c14d810 2024-04-25T16:01:17.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.156+0000 7fed4bfff640 1 --2- 172.21.15.87:0/165745728 >> v2:172.21.15.155:3300/0 conn(0x7fed4c154d00 0x7fed4c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:01:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed50804640 1 --2- 172.21.15.87:0/165745728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c14d810 0x7fed4c157810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0097c0 tx=0x7fed3c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2985ec1d88c1296 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed4b7fe640 1 -- 172.21.15.87:0/165745728 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0b0070 con 0x7fed4c14d810 2024-04-25T16:01:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed4b7fe640 1 -- 172.21.15.87:0/165745728 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c0ab600 con 0x7fed4c14d810 2024-04-25T16:01:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed4b7fe640 1 -- 172.21.15.87:0/165745728 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0ab9d0 con 0x7fed4c14d810 2024-04-25T16:01:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 -- 172.21.15.87:0/165745728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c14d810 msgr2=0x7fed4c157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 --2- 172.21.15.87:0/165745728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c14d810 0x7fed4c157810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0097c0 tx=0x7fed3c01c380 comp rx=0 tx=0).stop 2024-04-25T16:01:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 -- 172.21.15.87:0/165745728 shutdown_connections 2024-04-25T16:01:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 --2- 172.21.15.87:0/165745728 >> v2:172.21.15.155:3300/0 conn(0x7fed4c154d00 0x7fed4c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 --2- 172.21.15.87:0/165745728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c14d810 0x7fed4c157810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 -- 172.21.15.87:0/165745728 >> 172.21.15.87:0/165745728 conn(0x7fed4c0c8770 msgr2=0x7fed4c0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 -- 172.21.15.87:0/165745728 shutdown_connections 2024-04-25T16:01:17.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 -- 172.21.15.87:0/165745728 wait complete. 2024-04-25T16:01:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 Processor -- start 2024-04-25T16:01:17.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.160+0000 7fed52a68640 1 -- start start 2024-04-25T16:01:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4c06f790 0x7fed4c1ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 0x7fed4c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c154d00 0x7fed4c13e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c155110 con 0x7fed4c14d810 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c06ffb0 con 0x7fed4c06f790 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c155290 con 0x7fed4c154d00 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 0x7fed4c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 0x7fed4c146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51742/0 (socket says 172.21.15.87:51742) 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 -- 172.21.15.87:0/1399809559 learned_addr learned my addr 172.21.15.87:0/1399809559 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed50804640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4c06f790 0x7fed4c1ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed51005640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c154d00 0x7fed4c13e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 -- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c154d00 msgr2=0x7fed4c13e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c154d00 0x7fed4c13e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 -- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4c06f790 msgr2=0x7fed4c1ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4c06f790 0x7fed4c1ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 -- 172.21.15.87:0/1399809559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c147af0 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed4bfff640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 0x7fed4c146630 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fed4000e940 tx=0x7fed4000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40016070 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c0ab9c0 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4000cc40 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4000b040 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c152ff0 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.164+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4c152de0 con 0x7fed4c14d810 2024-04-25T16:01:17.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.168+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fed40019070 con 0x7fed4c14d810 2024-04-25T16:01:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.168+0000 7fed497fa640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed3806f400 0x7fed38071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.168+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fed4008fc80 con 0x7fed4c14d810 2024-04-25T16:01:17.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.168+0000 7fed50804640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed3806f400 0x7fed38071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:17.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.168+0000 7fed50804640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed3806f400 0x7fed38071910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ad000 tx=0x7fed3c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:17.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.172+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed4005c4c0 con 0x7fed4c14d810 2024-04-25T16:01:17.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.332+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed4c069bb0 con 0x7fed4c14d810 2024-04-25T16:01:17.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.332+0000 7fed497fa640 1 -- 172.21.15.87:0/1399809559 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21989 (secure 0 0 0) 0x7fed4005bdc0 con 0x7fed4c14d810 2024-04-25T16:01:17.334 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:17.335 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:00:43.549189+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:01:17.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed3806f400 msgr2=0x7fed38071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:17.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed3806f400 0x7fed38071910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ad000 tx=0x7fed3c0a6000 comp rx=0 tx=0).stop 2024-04-25T16:01:17.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 msgr2=0x7fed4c146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 0x7fed4c146630 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fed4000e940 tx=0x7fed4000ee00 comp rx=0 tx=0).stop 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 shutdown_connections 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fed3806f400 0x7fed38071910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed4c154d00 0x7fed4c13e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed4c14d810 0x7fed4c146630 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 --2- 172.21.15.87:0/1399809559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed4c06f790 0x7fed4c1ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 >> 172.21.15.87:0/1399809559 conn(0x7fed4c0c8770 msgr2=0x7fed4c0c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 shutdown_connections 2024-04-25T16:01:17.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:17.336+0000 7fed52a68640 1 -- 172.21.15.87:0/1399809559 wait complete. 2024-04-25T16:01:18.358 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T16:01:18.358 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 Processor -- start 2024-04-25T16:01:18.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 -- start start 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f1504154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f150415a970 0x7f1504157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15040c5010 con 0x7f150406c670 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1504157840 con 0x7f150415a970 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f15088b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f15040c7d60 con 0x7f15040c8300 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f14fbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f150415a970 0x7f1504157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f1502d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f150406c670 0x7f1504070bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44340/0 (socket says 172.21.15.87:44340) 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f1502d9d640 1 -- 172.21.15.87:0/741662112 learned_addr learned my addr 172.21.15.87:0/741662112 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:18.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f150259c640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f1504154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f14fbfff640 1 -- 172.21.15.87:0/741662112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 msgr2=0x7f1504154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f14fbfff640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f1504154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f14fbfff640 1 -- 172.21.15.87:0/741662112 >> v1:172.21.15.87:6789/0 conn(0x7f150406c670 legacy=0x7f1504070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f14fbfff640 1 -- 172.21.15.87:0/741662112 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15040c8040 con 0x7f150415a970 2024-04-25T16:01:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f1501d9b640 1 -- 172.21.15.87:0/741662112 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73189096 0 0) 0x7f14fc0014a0 con 0x7f150406c670 2024-04-25T16:01:18.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.528+0000 7f150259c640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f1504154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f14fbfff640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504157cd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0097c0 tx=0x7f14ec01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a4a199a848e079 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f1501d9b640 1 -- 172.21.15.87:0/741662112 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0b0070 con 0x7f150415a970 2024-04-25T16:01:18.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f1501d9b640 1 -- 172.21.15.87:0/741662112 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec0ab600 con 0x7f150415a970 2024-04-25T16:01:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f1501d9b640 1 -- 172.21.15.87:0/741662112 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0ab9d0 con 0x7f150415a970 2024-04-25T16:01:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 -- 172.21.15.87:0/741662112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 msgr2=0x7f1504157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504157cd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0097c0 tx=0x7f14ec01c3e0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 -- 172.21.15.87:0/741662112 shutdown_connections 2024-04-25T16:01:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504157cd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 --2- 172.21.15.87:0/741662112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f1504154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 -- 172.21.15.87:0/741662112 >> 172.21.15.87:0/741662112 conn(0x7f15040ab4d0 msgr2=0x7f15040ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 -- 172.21.15.87:0/741662112 shutdown_connections 2024-04-25T16:01:18.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 -- 172.21.15.87:0/741662112 wait complete. 2024-04-25T16:01:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 Processor -- start 2024-04-25T16:01:18.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.532+0000 7f15088b9640 1 -- start start 2024-04-25T16:01:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150406c670 0x7f15040af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f15041f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f15040c9490 con 0x7f150415a970 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15040c9310 con 0x7f150406c670 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1504071710 con 0x7f15040c8300 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51764/0 (socket says 172.21.15.87:51764) 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 -- 172.21.15.87:0/2833781225 learned_addr learned my addr 172.21.15.87:0/2833781225 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f14fbfff640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f15041f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f150259c640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150406c670 0x7f15040af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 -- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 msgr2=0x7f15041f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15040c8300 0x7f15041f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 -- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150406c670 msgr2=0x7f15040af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150406c670 0x7f15040af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 -- 172.21.15.87:0/2833781225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15040ae300 con 0x7f150415a970 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f150259c640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f150406c670 0x7f15040af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f1502d9d640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504151090 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c6a0 tx=0x7f14fc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc018070 con 0x7f150415a970 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc004d70 con 0x7f150415a970 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15040ae5e0 con 0x7f150415a970 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00a880 con 0x7f150415a970 2024-04-25T16:01:18.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150414c5b0 con 0x7f150415a970 2024-04-25T16:01:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f150414f300 con 0x7f150415a970 2024-04-25T16:01:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.536+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f14fc01b070 con 0x7f150415a970 2024-04-25T16:01:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14faffd640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f14e406f430 0x7f14e4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f14fc08f3f0 con 0x7f150415a970 2024-04-25T16:01:18.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f150259c640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f14e406f430 0x7f14e4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14faffd640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f14e407a690 0x7f14e407cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 --> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14e407d250 con 0x7f14e407a690 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f14fc08f880 con 0x7f150415a970 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14fbfff640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f14e407a690 0x7f14e407cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f150259c640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f14e406f430 0x7f14e4071940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097a0 tx=0x7f14f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14fbfff640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f14e407a690 0x7f14e407cb80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.540+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== osd.0 v2:172.21.15.87:6816/3434086508 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14e407d250 con 0x7f14e407a690 2024-04-25T16:01:18.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 --> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f150414bef0 con 0x7f14e407a690 2024-04-25T16:01:18.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f14faffd640 1 -- 172.21.15.87:0/2833781225 <== osd.0 v2:172.21.15.87:6816/3434086508 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f150414bef0 con 0x7f14e407a690 2024-04-25T16:01:18.555 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:18.555 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:18.555 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f14e407a690 msgr2=0x7f14e407cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6816/3434086508,v1:172.21.15.87:6818/3434086508] conn(0x7f14e407a690 0x7f14e407cb80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f14e406f430 msgr2=0x7f14e4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f14e406f430 0x7f14e4071940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f14f40097a0 tx=0x7f14f4008040 comp rx=0 tx=0).stop 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 msgr2=0x7f1504151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 --2- 172.21.15.87:0/2833781225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f150415a970 0x7f1504151090 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c6a0 tx=0x7f14fc00cb60 comp rx=0 tx=0).stop 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f1502d9d640 1 -- 172.21.15.87:0/2833781225 reap_dead start 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 shutdown_connections 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 >> 172.21.15.87:0/2833781225 conn(0x7f15040ab4d0 msgr2=0x7f15040ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 shutdown_connections 2024-04-25T16:01:18.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.552+0000 7f15088b9640 1 -- 172.21.15.87:0/2833781225 wait complete. 2024-04-25T16:01:18.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T16:01:18.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.720+0000 7fb96edef640 1 Processor -- start 2024-04-25T16:01:18.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.720+0000 7fb96edef640 1 -- start start 2024-04-25T16:01:18.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96edef640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9680726d0 0x7fb9681514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96edef640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb96806d440 0x7fb96806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96edef640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9680701a0 con 0x7fb9681578d0 2024-04-25T16:01:18.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96edef640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb968070440 con 0x7fb96806d440 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96edef640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb96815a9c0 con 0x7fb9680726d0 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96d38c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb9681578d0 0x7fb968157ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44352/0 (socket says 172.21.15.87:44352) 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96d38c640 1 -- 172.21.15.87:0/2081055933 learned_addr learned my addr 172.21.15.87:0/2081055933 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb967fff640 1 --2- 172.21.15.87:0/2081055933 >> v2:172.21.15.87:3300/0 conn(0x7fb96806d440 0x7fb96806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb96cb8b640 1 --2- 172.21.15.87:0/2081055933 >> v2:172.21.15.155:3300/0 conn(0x7fb9680726d0 0x7fb9681514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb9677fe640 1 -- 172.21.15.87:0/2081055933 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339655463 0 0) 0x7fb9680701a0 con 0x7fb9681578d0 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb9677fe640 1 -- 172.21.15.87:0/2081055933 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb950003530 con 0x7fb9681578d0 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb967fff640 1 -- 172.21.15.87:0/2081055933 >> v2:172.21.15.155:3300/0 conn(0x7fb9680726d0 msgr2=0x7fb9681514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb967fff640 1 --2- 172.21.15.87:0/2081055933 >> v2:172.21.15.155:3300/0 conn(0x7fb9680726d0 0x7fb9681514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb967fff640 1 -- 172.21.15.87:0/2081055933 >> v1:172.21.15.87:6789/0 conn(0x7fb9681578d0 legacy=0x7fb968157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.724+0000 7fb967fff640 1 -- 172.21.15.87:0/2081055933 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9681573d0 con 0x7fb96806d440 2024-04-25T16:01:18.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb967fff640 1 --2- 172.21.15.87:0/2081055933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb96806d440 0x7fb96806d850 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb96806dfa0 tx=0x7fb95c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efeeb4f681c221d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb9677fe640 1 -- 172.21.15.87:0/2081055933 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0b0070 con 0x7fb96806d440 2024-04-25T16:01:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb9677fe640 1 -- 172.21.15.87:0/2081055933 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c0ab600 con 0x7fb96806d440 2024-04-25T16:01:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb9677fe640 1 -- 172.21.15.87:0/2081055933 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ab9d0 con 0x7fb96806d440 2024-04-25T16:01:18.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 -- 172.21.15.87:0/2081055933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb96806d440 msgr2=0x7fb96806d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 --2- 172.21.15.87:0/2081055933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb96806d440 0x7fb96806d850 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb96806dfa0 tx=0x7fb95c01c360 comp rx=0 tx=0).stop 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 -- 172.21.15.87:0/2081055933 shutdown_connections 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 --2- 172.21.15.87:0/2081055933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb96806d440 0x7fb96806d850 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 --2- 172.21.15.87:0/2081055933 >> v2:172.21.15.155:3300/0 conn(0x7fb9680726d0 0x7fb9681514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 -- 172.21.15.87:0/2081055933 >> 172.21.15.87:0/2081055933 conn(0x7fb96806c670 msgr2=0x7fb96806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 -- 172.21.15.87:0/2081055933 shutdown_connections 2024-04-25T16:01:18.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 -- 172.21.15.87:0/2081055933 wait complete. 2024-04-25T16:01:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 Processor -- start 2024-04-25T16:01:18.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.728+0000 7fb96edef640 1 -- start start 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96806d440 0x7fb968153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9680726d0 0x7fb9680adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 0x7fb968154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb968070fa0 con 0x7fb9681578d0 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb968164570 con 0x7fb96806d440 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb968154d70 con 0x7fb9680726d0 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 0x7fb968154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 0x7fb968154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51780/0 (socket says 172.21.15.87:51780) 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 -- 172.21.15.87:0/963558597 learned_addr learned my addr 172.21.15.87:0/963558597 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb967fff640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9680726d0 0x7fb9680adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96cb8b640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96806d440 0x7fb968153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 -- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9680726d0 msgr2=0x7fb9680adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9680726d0 0x7fb9680adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 -- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96806d440 msgr2=0x7fb968153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96806d440 0x7fb968153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 -- 172.21.15.87:0/963558597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9681f0880 con 0x7fb9681578d0 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96cb8b640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96806d440 0x7fb968153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96d38c640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 0x7fb968154050 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb96000cae0 tx=0x7fb96000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960017070 con 0x7fb9681578d0 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96000ac40 con 0x7fb9681578d0 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960012600 con 0x7fb9681578d0 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9681f0b60 con 0x7fb9681578d0 2024-04-25T16:01:18.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9681f1120 con 0x7fb9681578d0 2024-04-25T16:01:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb968069bb0 con 0x7fb9681578d0 2024-04-25T16:01:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb96001a070 con 0x7fb9681578d0 2024-04-25T16:01:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb9657fa640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb95406f400 0x7fb954071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fb96008f570 con 0x7fb9681578d0 2024-04-25T16:01:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96cb8b640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb95406f400 0x7fb954071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:18.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.732+0000 7fb96cb8b640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb95406f400 0x7fb954071910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9680631a0 tx=0x7fb958008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:18.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.740+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb96005b7f0 con 0x7fb9681578d0 2024-04-25T16:01:18.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb9680c2ae0 con 0x7fb95406f400 2024-04-25T16:01:18.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb9657fa640 1 -- 172.21.15.87:0/963558597 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb9680c2ae0 con 0x7fb95406f400 2024-04-25T16:01:18.898 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T16:01:18.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb95406f400 msgr2=0x7fb954071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb95406f400 0x7fb954071910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9680631a0 tx=0x7fb958008040 comp rx=0 tx=0).stop 2024-04-25T16:01:18.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 msgr2=0x7fb968154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:18.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 0x7fb968154050 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb96000cae0 tx=0x7fb96000a060 comp rx=0 tx=0).stop 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 shutdown_connections 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb95406f400 0x7fb954071910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9681578d0 0x7fb968154050 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9680726d0 0x7fb9680adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 --2- 172.21.15.87:0/963558597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb96806d440 0x7fb968153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.896+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 >> 172.21.15.87:0/963558597 conn(0x7fb96806c670 msgr2=0x7fb96806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.900+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 shutdown_connections 2024-04-25T16:01:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:18.900+0000 7fb96edef640 1 -- 172.21.15.87:0/963558597 wait complete. 2024-04-25T16:01:18.919 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T16:01:18.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703f1cb640 1 Processor -- start 2024-04-25T16:01:19.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703f1cb640 1 -- start start 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703f1cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 0x7f7038152870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703f1cb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70380ae8e0 con 0x7f70380a8cc0 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703f1cb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70381588d0 con 0x7f703806c670 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703f1cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70380aebc0 con 0x7f70381593b0 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703cf67640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f70380a8cc0 0x7f7038155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44362/0 (socket says 172.21.15.87:44362) 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703cf67640 1 -- 172.21.15.87:0/211891245 learned_addr learned my addr 172.21.15.87:0/211891245 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 0x7f7038152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444683388 0 0) 0x7f70380ae8e0 con 0x7f70380a8cc0 2024-04-25T16:01:19.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7028003530 con 0x7f70380a8cc0 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4292500913 0 0) 0x7f7028003530 con 0x7f70380a8cc0 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 msgr2=0x7f7038152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 0x7f7038152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 >> v1:172.21.15.155:6789/0 conn(0x7f703806c670 legacy=0x7f703815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7038158bb0 con 0x7f70380a8cc0 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f702c001680 con 0x7f70380a8cc0 2024-04-25T16:01:19.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 >> v1:172.21.15.87:6789/0 conn(0x7f70380a8cc0 legacy=0x7f7038155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70280039f0 0x7f7028003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028004810 0x7f7028004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 0x7f70280052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f70380aebc0 con 0x7f7028004810 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f702800bb90 con 0x7f70280039f0 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f702800bd90 con 0x7f70381593b0 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028004810 0x7f7028004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703cf67640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70280039f0 0x7f7028003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f703d768640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 0x7f70280052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 -- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 msgr2=0x7f70280052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70381593b0 0x7f70280052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 -- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70280039f0 msgr2=0x7f7028003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70280039f0 0x7f7028003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.060+0000 7f7037fff640 1 -- 172.21.15.87:0/211891245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7028003530 con 0x7f7028004810 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f7037fff640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028004810 0x7f7028004c20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f70380c4280 tx=0x7f702401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582f7c194a3c4ced server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70240096b0 con 0x7f7028004810 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70240a6410 con 0x7f7028004810 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f70377fe640 1 -- 172.21.15.87:0/211891245 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70240a6800 con 0x7f7028004810 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703f1cb640 1 -- 172.21.15.87:0/211891245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028004810 msgr2=0x7f7028004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703f1cb640 1 --2- 172.21.15.87:0/211891245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7028004810 0x7f7028004c20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f70380c4280 tx=0x7f702401ca30 comp rx=0 tx=0).stop 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703d768640 1 -- 172.21.15.87:0/211891245 reap_dead start 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703f1cb640 1 -- 172.21.15.87:0/211891245 shutdown_connections 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703f1cb640 1 -- 172.21.15.87:0/211891245 >> 172.21.15.87:0/211891245 conn(0x7f703806d780 msgr2=0x7f703806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703f1cb640 1 -- 172.21.15.87:0/211891245 shutdown_connections 2024-04-25T16:01:19.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.064+0000 7f703f1cb640 1 -- 172.21.15.87:0/211891245 wait complete. 2024-04-25T16:01:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 Processor -- start 2024-04-25T16:01:19.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- start start 2024-04-25T16:01:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7028004810 0x7f70380c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70381f29a0 0x7f70381600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70381f2db0 0x7f7038160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f703806ce90 con 0x7f70381f2db0 2024-04-25T16:01:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70380ac900 con 0x7f70381f29a0 2024-04-25T16:01:19.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7038152c80 con 0x7f7028004810 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70381f2db0 0x7f7038160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70381f2db0 0x7f7038160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51796/0 (socket says 172.21.15.87:51796) 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 -- 172.21.15.87:0/3539233074 learned_addr learned my addr 172.21.15.87:0/3539233074 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703cf67640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7028004810 0x7f70380c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f7037fff640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70381f29a0 0x7f70381600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 -- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7028004810 msgr2=0x7f70380c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7028004810 0x7f70380c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 -- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70381f29a0 msgr2=0x7f70381600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70381f29a0 0x7f70381600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 -- 172.21.15.87:0/3539233074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703814ce00 con 0x7f70381f2db0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f7037fff640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70381f29a0 0x7f70381600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703d768640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70381f2db0 0x7f7038160600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f703806d700 tx=0x7f703000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030003980 con 0x7f70381f2db0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7030018070 con 0x7f70381f2db0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703814c6a0 con 0x7f70381f2db0 2024-04-25T16:01:19.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030003d60 con 0x7f70381f2db0 2024-04-25T16:01:19.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381f21a0 con 0x7f70381f2db0 2024-04-25T16:01:19.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.068+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7038069bb0 con 0x7f70381f2db0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70300050d0 con 0x7f70381f2db0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701c06f400 0x7f701c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f7030090130 con 0x7f70381f2db0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f703cf67640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701c06f400 0x7f701c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7f701c07a660 0x7f701c07cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 --> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f703001de50 con 0x7f701c07a660 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f70300905c0 con 0x7f70381f2db0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f7037fff640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7f701c07a660 0x7f701c07cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f703cf67640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701c06f400 0x7f701c071910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f702c000c10 tx=0x7f702c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f7037fff640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7f701c07a660 0x7f701c07cb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.072+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== osd.1 v2:172.21.15.87:6817/4281742736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f703001de50 con 0x7f701c07a660 2024-04-25T16:01:19.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 --> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7038070890 con 0x7f701c07a660 2024-04-25T16:01:19.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f70357fa640 1 -- 172.21.15.87:0/3539233074 <== osd.1 v2:172.21.15.87:6817/4281742736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7038070890 con 0x7f701c07a660 2024-04-25T16:01:19.086 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:19.086 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:19.086 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7f701c07a660 msgr2=0x7f701c07cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6817/4281742736,v1:172.21.15.87:6820/4281742736] conn(0x7f701c07a660 0x7f701c07cb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701c06f400 msgr2=0x7f701c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f701c06f400 0x7f701c071910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f702c000c10 tx=0x7f702c009040 comp rx=0 tx=0).stop 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70381f2db0 msgr2=0x7f7038160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 --2- 172.21.15.87:0/3539233074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70381f2db0 0x7f7038160600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f703806d700 tx=0x7f703000ec10 comp rx=0 tx=0).stop 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703d768640 1 -- 172.21.15.87:0/3539233074 reap_dead start 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 shutdown_connections 2024-04-25T16:01:19.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 >> 172.21.15.87:0/3539233074 conn(0x7f703806d780 msgr2=0x7f703815adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 shutdown_connections 2024-04-25T16:01:19.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.084+0000 7f703f1cb640 1 -- 172.21.15.87:0/3539233074 wait complete. 2024-04-25T16:01:19.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T16:01:19.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.244+0000 7f1d654f1640 1 Processor -- start 2024-04-25T16:01:19.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.244+0000 7f1d654f1640 1 -- start start 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d654f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d601517d0 0x7f1d600c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d654f1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d600c9ae0 0x7f1d601578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d654f1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d600c5290 con 0x7f1d60157df0 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d654f1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1d600c5e80 con 0x7f1d600c9ae0 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d654f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d60154fd0 con 0x7f1d601517d0 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d600c9ae0 0x7f1d601578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d600c9ae0 0x7f1d601578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51798/0 (socket says 172.21.15.87:51798) 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 -- 172.21.15.87:0/1376576143 learned_addr learned my addr 172.21.15.87:0/1376576143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d5effd640 1 --2- 172.21.15.87:0/1376576143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d601517d0 0x7f1d600c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 -- 172.21.15.87:0/1376576143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d601517d0 msgr2=0x7f1d600c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 --2- 172.21.15.87:0/1376576143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d601517d0 0x7f1d600c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 -- 172.21.15.87:0/1376576143 >> v1:172.21.15.155:6789/0 conn(0x7f1d60157df0 legacy=0x7f1d6006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 -- 172.21.15.87:0/1376576143 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d600c5550 con 0x7f1d600c9ae0 2024-04-25T16:01:19.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d567fc640 1 --2- 172.21.15.87:0/1376576143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d600c9ae0 0x7f1d601578b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800bb10 tx=0x7f1d4801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3502809b1a89377a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d5e7fc640 1 -- 172.21.15.87:0/1376576143 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480b4070 con 0x7f1d600c9ae0 2024-04-25T16:01:19.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d5e7fc640 1 -- 172.21.15.87:0/1376576143 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d480a7b00 con 0x7f1d600c9ae0 2024-04-25T16:01:19.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.248+0000 7f1d5e7fc640 1 -- 172.21.15.87:0/1376576143 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480af440 con 0x7f1d600c9ae0 2024-04-25T16:01:19.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 -- 172.21.15.87:0/1376576143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d600c9ae0 msgr2=0x7f1d601578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 --2- 172.21.15.87:0/1376576143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d600c9ae0 0x7f1d601578b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800bb10 tx=0x7f1d4801ec30 comp rx=0 tx=0).stop 2024-04-25T16:01:19.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 -- 172.21.15.87:0/1376576143 shutdown_connections 2024-04-25T16:01:19.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 --2- 172.21.15.87:0/1376576143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d600c9ae0 0x7f1d601578b0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 --2- 172.21.15.87:0/1376576143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d601517d0 0x7f1d600c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 -- 172.21.15.87:0/1376576143 >> 172.21.15.87:0/1376576143 conn(0x7f1d6006d780 msgr2=0x7f1d6006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 -- 172.21.15.87:0/1376576143 shutdown_connections 2024-04-25T16:01:19.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 -- 172.21.15.87:0/1376576143 wait complete. 2024-04-25T16:01:19.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 Processor -- start 2024-04-25T16:01:19.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.252+0000 7f1d654f1640 1 -- start start 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d600c9ae0 0x7f1d60143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 0x7f1d601f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d60157df0 0x7f1d6013eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1d600a90f0 con 0x7f1d601517d0 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d600a8f70 con 0x7f1d60157df0 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6006c670 con 0x7f1d600c9ae0 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 0x7f1d601f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 0x7f1d601f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51808/0 (socket says 172.21.15.87:51808) 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 -- 172.21.15.87:0/600188444 learned_addr learned my addr 172.21.15.87:0/600188444 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d5effd640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d600c9ae0 0x7f1d60143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d5f7fe640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d60157df0 0x7f1d6013eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 -- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d600c9ae0 msgr2=0x7f1d60143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d600c9ae0 0x7f1d60143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 -- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d60157df0 msgr2=0x7f1d6013eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d60157df0 0x7f1d6013eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 -- 172.21.15.87:0/600188444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d600c7a00 con 0x7f1d601517d0 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d567fc640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 0x7f1d601f00d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b2c0 tx=0x7f1d4801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480b4040 con 0x7f1d601517d0 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d480a7900 con 0x7f1d601517d0 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d60142c90 con 0x7f1d601517d0 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480ba6a0 con 0x7f1d601517d0 2024-04-25T16:01:19.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d601f0db0 con 0x7f1d601517d0 2024-04-25T16:01:19.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d60069bb0 con 0x7f1d601517d0 2024-04-25T16:01:19.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.256+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1d480c1020 con 0x7f1d601517d0 2024-04-25T16:01:19.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.260+0000 7f1d57fff640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1d4006f400 0x7f1d40071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.260+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f1d4812c4a0 con 0x7f1d601517d0 2024-04-25T16:01:19.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.260+0000 7f1d5effd640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1d4006f400 0x7f1d40071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.260+0000 7f1d5effd640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1d4006f400 0x7f1d40071910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1d600c3c00 tx=0x7f1d50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.264+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d480c8020 con 0x7f1d601517d0 2024-04-25T16:01:19.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1d60075090 con 0x7f1d4006f400 2024-04-25T16:01:19.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d57fff640 1 -- 172.21.15.87:0/600188444 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1d60075090 con 0x7f1d4006f400 2024-04-25T16:01:19.421 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T16:01:19.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1d4006f400 msgr2=0x7f1d40071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1d4006f400 0x7f1d40071910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1d600c3c00 tx=0x7f1d50008040 comp rx=0 tx=0).stop 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 msgr2=0x7f1d601f00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 0x7f1d601f00d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b2c0 tx=0x7f1d4801b9d0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 shutdown_connections 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1d4006f400 0x7f1d40071910 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d60157df0 0x7f1d6013eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d601517d0 0x7f1d601f00d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 --2- 172.21.15.87:0/600188444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d600c9ae0 0x7f1d60143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.420+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 >> 172.21.15.87:0/600188444 conn(0x7f1d6006d780 msgr2=0x7f1d6006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.424+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 shutdown_connections 2024-04-25T16:01:19.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.424+0000 7f1d654f1640 1 -- 172.21.15.87:0/600188444 wait complete. 2024-04-25T16:01:19.443 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T16:01:19.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:19.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 Processor -- start 2024-04-25T16:01:19.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 -- start start 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f306815abb0 0x7f306815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f306815b500 0x7f3068161d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30680c4bd0 con 0x7f3068157ea0 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f30680c4250 con 0x7f306815abb0 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f306cb6a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f30680c4810 con 0x7f306815b500 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f306815abb0 0x7f306815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f306815abb0 0x7f306815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51820/0 (socket says 172.21.15.87:51820) 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 -- 172.21.15.87:0/475424514 learned_addr learned my addr 172.21.15.87:0/475424514 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3066d9d640 1 --2- 172.21.15.87:0/475424514 >> v2:172.21.15.155:3300/0 conn(0x7f306815b500 0x7f3068161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 -- 172.21.15.87:0/475424514 >> v2:172.21.15.155:3300/0 conn(0x7f306815b500 msgr2=0x7f3068161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 --2- 172.21.15.87:0/475424514 >> v2:172.21.15.155:3300/0 conn(0x7f306815b500 0x7f3068161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 -- 172.21.15.87:0/475424514 >> v1:172.21.15.155:6789/0 conn(0x7f3068157ea0 legacy=0x7f306806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.584+0000 7f3065d9b640 1 -- 172.21.15.87:0/475424514 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30680c4eb0 con 0x7f306815abb0 2024-04-25T16:01:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f3065d9b640 1 --2- 172.21.15.87:0/475424514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306815afc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f30680c7200 tx=0x7f305c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5ae1b053c33f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306559a640 1 -- 172.21.15.87:0/475424514 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b0070 con 0x7f306815abb0 2024-04-25T16:01:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306559a640 1 -- 172.21.15.87:0/475424514 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c0ab600 con 0x7f306815abb0 2024-04-25T16:01:19.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306559a640 1 -- 172.21.15.87:0/475424514 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ab9d0 con 0x7f306815abb0 2024-04-25T16:01:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 -- 172.21.15.87:0/475424514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 msgr2=0x7f306815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 --2- 172.21.15.87:0/475424514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306815afc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f30680c7200 tx=0x7f305c01c3c0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 -- 172.21.15.87:0/475424514 shutdown_connections 2024-04-25T16:01:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 --2- 172.21.15.87:0/475424514 >> v2:172.21.15.155:3300/0 conn(0x7f306815b500 0x7f3068161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 --2- 172.21.15.87:0/475424514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306815afc0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 -- 172.21.15.87:0/475424514 >> 172.21.15.87:0/475424514 conn(0x7f306806d780 msgr2=0x7f306806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 -- 172.21.15.87:0/475424514 shutdown_connections 2024-04-25T16:01:19.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.588+0000 7f306cb6a640 1 -- 172.21.15.87:0/475424514 wait complete. 2024-04-25T16:01:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 Processor -- start 2024-04-25T16:01:19.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 -- start start 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3068157ea0 0x7f30680c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f306815b500 0x7f3068152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3068154e60 con 0x7f306815abb0 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3068154ce0 con 0x7f3068157ea0 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3068164a80 con 0x7f306815b500 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306814fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51824/0 (socket says 172.21.15.87:51824) 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 -- 172.21.15.87:0/553015474 learned_addr learned my addr 172.21.15.87:0/553015474 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3066d9d640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f306815b500 0x7f3068152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306659c640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3068157ea0 0x7f30680c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 -- 172.21.15.87:0/553015474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f306815b500 msgr2=0x7f3068152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f306815b500 0x7f3068152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 -- 172.21.15.87:0/553015474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3068157ea0 msgr2=0x7f30680c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3068157ea0 0x7f30680c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 -- 172.21.15.87:0/553015474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3068150cb0 con 0x7f306815abb0 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3065d9b640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306814fc80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f305c01aa70 tx=0x7f305c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0ba020 con 0x7f306815abb0 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c0b6620 con 0x7f306815abb0 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30681509d0 con 0x7f306815abb0 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b0040 con 0x7f306815abb0 2024-04-25T16:01:19.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.592+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3068155ba0 con 0x7f306815abb0 2024-04-25T16:01:19.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3068150780 con 0x7f306815abb0 2024-04-25T16:01:19.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f305c0bd020 con 0x7f306815abb0 2024-04-25T16:01:19.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f304806f430 0x7f3048071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f306659c640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f304806f430 0x7f3048071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f305c12a0b0 con 0x7f306815abb0 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f304807a690 0x7f304807cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 --> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f305c0c1e50 con 0x7f304807a690 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f305c12a540 con 0x7f306815abb0 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3066d9d640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f304807a690 0x7f304807cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f306659c640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f304806f430 0x7f3048071940 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3068072780 tx=0x7f30600094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3066d9d640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f304807a690 0x7f304807cb80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.596+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== osd.2 v2:172.21.15.87:6808/3379569220 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f305c0c1e50 con 0x7f304807a690 2024-04-25T16:01:19.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.608+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 --> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3068155ec0 con 0x7f304807a690 2024-04-25T16:01:19.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f3056ffd640 1 -- 172.21.15.87:0/553015474 <== osd.2 v2:172.21.15.87:6808/3379569220 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3068155ec0 con 0x7f304807a690 2024-04-25T16:01:19.611 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:19.612 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:19.612 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:19.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f304807a690 msgr2=0x7f304807cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6808/3379569220,v1:172.21.15.87:6809/3379569220] conn(0x7f304807a690 0x7f304807cb80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f304806f430 msgr2=0x7f3048071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f304806f430 0x7f3048071940 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3068072780 tx=0x7f30600094d0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 msgr2=0x7f306814fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 --2- 172.21.15.87:0/553015474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f306815abb0 0x7f306814fc80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f305c01aa70 tx=0x7f305c01ac00 comp rx=0 tx=0).stop 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f3066d9d640 1 -- 172.21.15.87:0/553015474 reap_dead start 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 shutdown_connections 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 >> 172.21.15.87:0/553015474 conn(0x7f306806d780 msgr2=0x7f30680ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 shutdown_connections 2024-04-25T16:01:19.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.612+0000 7f306cb6a640 1 -- 172.21.15.87:0/553015474 wait complete. 2024-04-25T16:01:19.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T16:01:19.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 Processor -- start 2024-04-25T16:01:19.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 -- start start 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb110152980 0x7fb1100c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb110155320 0x7fb110155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb110152d90 con 0x7fb110074160 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb1100aa290 con 0x7fb110152980 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb116c8c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb1101598b0 con 0x7fb110155320 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb110152980 0x7fb1100c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb110152980 0x7fb1100c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51832/0 (socket says 172.21.15.87:51832) 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 -- 172.21.15.87:0/2494221466 learned_addr learned my addr 172.21.15.87:0/2494221466 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb10ffff640 1 --2- 172.21.15.87:0/2494221466 >> v2:172.21.15.155:3300/0 conn(0x7fb110155320 0x7fb110155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 -- 172.21.15.87:0/2494221466 >> v2:172.21.15.155:3300/0 conn(0x7fb110155320 msgr2=0x7fb110155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 --2- 172.21.15.87:0/2494221466 >> v2:172.21.15.155:3300/0 conn(0x7fb110155320 0x7fb110155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 -- 172.21.15.87:0/2494221466 >> v1:172.21.15.155:6789/0 conn(0x7fb110074160 legacy=0x7fb1100c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:19.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb114a28640 1 -- 172.21.15.87:0/2494221466 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1100ca2f0 con 0x7fb110152980 2024-04-25T16:01:19.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.776+0000 7fb10ffff640 1 --2- 172.21.15.87:0/2494221466 >> v2:172.21.15.155:3300/0 conn(0x7fb110155320 0x7fb110155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb114a28640 1 --2- 172.21.15.87:0/2494221466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb1100c9db0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb110069a50 tx=0x7fb10001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe71bcb940b417f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb10f7fe640 1 -- 172.21.15.87:0/2494221466 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1000b0070 con 0x7fb110152980 2024-04-25T16:01:19.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb10f7fe640 1 -- 172.21.15.87:0/2494221466 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1000ab600 con 0x7fb110152980 2024-04-25T16:01:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb10f7fe640 1 -- 172.21.15.87:0/2494221466 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ab9d0 con 0x7fb110152980 2024-04-25T16:01:19.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 -- 172.21.15.87:0/2494221466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 msgr2=0x7fb1100c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 --2- 172.21.15.87:0/2494221466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb1100c9db0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb110069a50 tx=0x7fb10001c450 comp rx=0 tx=0).stop 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 -- 172.21.15.87:0/2494221466 shutdown_connections 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 --2- 172.21.15.87:0/2494221466 >> v2:172.21.15.155:3300/0 conn(0x7fb110155320 0x7fb110155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 --2- 172.21.15.87:0/2494221466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb1100c9db0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 -- 172.21.15.87:0/2494221466 >> 172.21.15.87:0/2494221466 conn(0x7fb1100ac550 msgr2=0x7fb1100ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 -- 172.21.15.87:0/2494221466 shutdown_connections 2024-04-25T16:01:19.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.780+0000 7fb116c8c640 1 -- 172.21.15.87:0/2494221466 wait complete. 2024-04-25T16:01:19.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 Processor -- start 2024-04-25T16:01:19.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 -- start start 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb110074160 0x7fb11014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb110153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb110155320 0x7fb110149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb110158f70 con 0x7fb110152980 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb110158c90 con 0x7fb110074160 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1100729c0 con 0x7fb110155320 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb110153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb110153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51834/0 (socket says 172.21.15.87:51834) 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 -- 172.21.15.87:0/4147837766 learned_addr learned my addr 172.21.15.87:0/4147837766 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb114a28640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb110074160 0x7fb11014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb115229640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb110155320 0x7fb110149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 -- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb110155320 msgr2=0x7fb110149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb110155320 0x7fb110149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 -- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb110074160 msgr2=0x7fb11014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb110074160 0x7fb11014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 -- 172.21.15.87:0/4147837766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1101548b0 con 0x7fb110152980 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10ffff640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb110153360 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c7f0 tx=0x7fb10400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104015070 con 0x7fb110152980 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb104007820 con 0x7fb110152980 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1100c5160 con 0x7fb110152980 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104007c10 con 0x7fb110152980 2024-04-25T16:01:19.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.784+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1101f24a0 con 0x7fb110152980 2024-04-25T16:01:19.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.788+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1101f2210 con 0x7fb110152980 2024-04-25T16:01:19.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.788+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb104018070 con 0x7fb110152980 2024-04-25T16:01:19.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.788+0000 7fb10d7fa640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb0fc06f400 0x7fb0fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:19.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.788+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fb10408fa80 con 0x7fb110152980 2024-04-25T16:01:19.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.788+0000 7fb114a28640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb0fc06f400 0x7fb0fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:19.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.788+0000 7fb114a28640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb0fc06f400 0x7fb0fc071910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb1000ad000 tx=0x7fb1000a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:19.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.792+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb10405c2c0 con 0x7fb110152980 2024-04-25T16:01:19.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.956+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fb1100c9b90 con 0x7fb0fc06f400 2024-04-25T16:01:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.956+0000 7fb10d7fa640 1 -- 172.21.15.87:0/4147837766 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb1100c9b90 con 0x7fb0fc06f400 2024-04-25T16:01:19.958 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb0fc06f400 msgr2=0x7fb0fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb0fc06f400 0x7fb0fc071910 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb1000ad000 tx=0x7fb1000a6000 comp rx=0 tx=0).stop 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 msgr2=0x7fb110153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb110153360 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c7f0 tx=0x7fb10400ccb0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 shutdown_connections 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb0fc06f400 0x7fb0fc071910 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb110155320 0x7fb110149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb110152980 0x7fb110153360 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 --2- 172.21.15.87:0/4147837766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb110074160 0x7fb11014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:19.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 >> 172.21.15.87:0/4147837766 conn(0x7fb1100ac550 msgr2=0x7fb1101558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 shutdown_connections 2024-04-25T16:01:19.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:19.960+0000 7fb116c8c640 1 -- 172.21.15.87:0/4147837766 wait complete. 2024-04-25T16:01:19.982 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T16:01:19.982 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:20.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.136+0000 7f577e2e9640 1 Processor -- start 2024-04-25T16:01:20.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.136+0000 7f577e2e9640 1 -- start start 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577e2e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57781529a0 0x7f5778071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577e2e9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57780adda0 0x7f57780c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577e2e9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57780c4e30 con 0x7f57780ad990 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577e2e9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f57780ae1b0 con 0x7f57780adda0 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577e2e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5778072430 con 0x7f57781529a0 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57780adda0 0x7f57780c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57780adda0 0x7f57780c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51846/0 (socket says 172.21.15.87:51846) 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f57777fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f57780ad990 0x7f57780c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44378/0 (socket says 172.21.15.87:44378) 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 -- 172.21.15.87:0/3083096881 learned_addr learned my addr 172.21.15.87:0/3083096881 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f5777fff640 1 --2- 172.21.15.87:0/3083096881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57781529a0 0x7f5778071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 -- 172.21.15.87:0/3083096881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57781529a0 msgr2=0x7f5778071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 --2- 172.21.15.87:0/3083096881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57781529a0 0x7f5778071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 -- 172.21.15.87:0/3083096881 >> v1:172.21.15.87:6789/0 conn(0x7f57780ad990 legacy=0x7f57780c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 -- 172.21.15.87:0/3083096881 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5778074730 con 0x7f57780adda0 2024-04-25T16:01:20.142 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f5776ffd640 1 -- 172.21.15.87:0/3083096881 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532334531 0 0) 0x7f576c001120 con 0x7f57780ad990 2024-04-25T16:01:20.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.140+0000 7f577c886640 1 --2- 172.21.15.87:0/3083096881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f57780c48f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5770009e50 tx=0x7f577001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4319b97592c02f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f5776ffd640 1 -- 172.21.15.87:0/3083096881 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57700a5660 con 0x7f57780adda0 2024-04-25T16:01:20.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f5776ffd640 1 -- 172.21.15.87:0/3083096881 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57700a5800 con 0x7f57780adda0 2024-04-25T16:01:20.143 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f5776ffd640 1 -- 172.21.15.87:0/3083096881 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57700a5bd0 con 0x7f57780adda0 2024-04-25T16:01:20.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- 172.21.15.87:0/3083096881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 msgr2=0x7f57780c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 --2- 172.21.15.87:0/3083096881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f57780c48f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5770009e50 tx=0x7f577001c9a0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- 172.21.15.87:0/3083096881 shutdown_connections 2024-04-25T16:01:20.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 --2- 172.21.15.87:0/3083096881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f57780c48f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 --2- 172.21.15.87:0/3083096881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57781529a0 0x7f5778071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- 172.21.15.87:0/3083096881 >> 172.21.15.87:0/3083096881 conn(0x7f57780c8770 msgr2=0x7f57780c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- 172.21.15.87:0/3083096881 shutdown_connections 2024-04-25T16:01:20.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- 172.21.15.87:0/3083096881 wait complete. 2024-04-25T16:01:20.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 Processor -- start 2024-04-25T16:01:20.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- start start 2024-04-25T16:01:20.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57780ad990 0x7f57781eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f5778149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57781529a0 0x7f5778158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57781622f0 con 0x7f57780adda0 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57780ab1a0 con 0x7f57781529a0 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.144+0000 7f577e2e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5778162470 con 0x7f57780ad990 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f5778149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f5778149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51852/0 (socket says 172.21.15.87:51852) 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 -- 172.21.15.87:0/2933771317 learned_addr learned my addr 172.21.15.87:0/2933771317 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5777fff640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57780ad990 0x7f57781eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f577c886640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57781529a0 0x7f5778158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 -- 172.21.15.87:0/2933771317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57780ad990 msgr2=0x7f57781eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57780ad990 0x7f57781eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 -- 172.21.15.87:0/2933771317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57781529a0 msgr2=0x7f5778158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57781529a0 0x7f5778158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 -- 172.21.15.87:0/2933771317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57781f1670 con 0x7f57780adda0 2024-04-25T16:01:20.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f57777fe640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f5778149310 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c450 tx=0x7f576c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0074e0 con 0x7f57780adda0 2024-04-25T16:01:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0047f0 con 0x7f57780adda0 2024-04-25T16:01:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5778149df0 con 0x7f57780adda0 2024-04-25T16:01:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c007680 con 0x7f57780adda0 2024-04-25T16:01:20.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57781569b0 con 0x7f57780adda0 2024-04-25T16:01:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f577814a0d0 con 0x7f57780adda0 2024-04-25T16:01:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f576c011070 con 0x7f57780adda0 2024-04-25T16:01:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f576406f400 0x7f5764071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f576c08f590 con 0x7f57780adda0 2024-04-25T16:01:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5777fff640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f576406f400 0x7f5764071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f576407a660 0x7f576407cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 --> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f576407d220 con 0x7f576407a660 2024-04-25T16:01:20.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f576c096050 con 0x7f57780adda0 2024-04-25T16:01:20.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f577c886640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f576407a660 0x7f576407cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f5777fff640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f576406f400 0x7f5764071910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5778073d40 tx=0x7f5768008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.148+0000 7f577c886640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f576407a660 0x7f576407cb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.152+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== osd.3 v2:172.21.15.87:6800/2110638715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f576407d220 con 0x7f576407a660 2024-04-25T16:01:20.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 --> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5778069bb0 con 0x7f576407a660 2024-04-25T16:01:20.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f5774ff9640 1 -- 172.21.15.87:0/2933771317 <== osd.3 v2:172.21.15.87:6800/2110638715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5778069bb0 con 0x7f576407a660 2024-04-25T16:01:20.166 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:20.166 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:20.166 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f576407a660 msgr2=0x7f576407cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6800/2110638715,v1:172.21.15.87:6801/2110638715] conn(0x7f576407a660 0x7f576407cb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f576406f400 msgr2=0x7f5764071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f576406f400 0x7f5764071910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5778073d40 tx=0x7f5768008040 comp rx=0 tx=0).stop 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 msgr2=0x7f5778149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 --2- 172.21.15.87:0/2933771317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57780adda0 0x7f5778149310 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c450 tx=0x7f576c00c910 comp rx=0 tx=0).stop 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577c886640 1 -- 172.21.15.87:0/2933771317 reap_dead start 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 shutdown_connections 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 >> 172.21.15.87:0/2933771317 conn(0x7f57780c8770 msgr2=0x7f5778154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 shutdown_connections 2024-04-25T16:01:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.164+0000 7f577e2e9640 1 -- 172.21.15.87:0/2933771317 wait complete. 2024-04-25T16:01:20.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T16:01:20.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2da5f8640 1 Processor -- start 2024-04-25T16:01:20.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2da5f8640 1 -- start start 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2da5f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c48f0 0x7fd2d4160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2da5f8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d4072430 con 0x7fd2d4071e50 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2da5f8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d4074730 con 0x7fd2d41529a0 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2da5f8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d4074a10 con 0x7fd2d40c48f0 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2d37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd2d4071e50 0x7fd2d40c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44392/0 (socket says 172.21.15.87:44392) 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.328+0000 7fd2d37fe640 1 -- 172.21.15.87:0/1449085773 learned_addr learned my addr 172.21.15.87:0/1449085773 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/1449085773 >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c48f0 0x7fd2d4160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435398799 0 0) 0x7fd2d4072430 con 0x7fd2d4071e50 2024-04-25T16:01:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c0003530 con 0x7fd2d4071e50 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1682261627 0 0) 0x7fd2c0003530 con 0x7fd2d4071e50 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c48f0 msgr2=0x7fd2d4160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 --2- 172.21.15.87:0/1449085773 >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c48f0 0x7fd2d4160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 >> v1:172.21.15.155:6789/0 conn(0x7fd2d41529a0 legacy=0x7fd2d40ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d4074cf0 con 0x7fd2d4071e50 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fd2bc001680 con 0x7fd2d4071e50 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 >> v1:172.21.15.87:6789/0 conn(0x7fd2d4071e50 legacy=0x7fd2d40c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2c00039c0 0x7fd2c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c0004810 0x7fd2c0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4074a10 con 0x7fd2c0005260 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c000c1f0 con 0x7fd2c0004810 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c000c3f0 con 0x7fd2c00039c0 2024-04-25T16:01:20.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d3fff640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2c00039c0 0x7fd2c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d37fe640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c0004810 0x7fd2c0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 -- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2c00039c0 msgr2=0x7fd2c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2c00039c0 0x7fd2c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 -- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c0004810 msgr2=0x7fd2c0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2c0004810 0x7fd2c0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 -- 172.21.15.87:0/1449085773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c0003530 con 0x7fd2c0005260 2024-04-25T16:01:20.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 -- 172.21.15.87:0/1449085773 reap_dead start 2024-04-25T16:01:20.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2c000b9d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40c2ce0 tx=0x7fd2c401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c16c39fa4c544d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40096b0 con 0x7fd2c0005260 2024-04-25T16:01:20.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c4004020 con 0x7fd2c0005260 2024-04-25T16:01:20.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.332+0000 7fd2d2ffd640 1 -- 172.21.15.87:0/1449085773 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4004410 con 0x7fd2c0005260 2024-04-25T16:01:20.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- 172.21.15.87:0/1449085773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 msgr2=0x7fd2c000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2c000b9d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40c2ce0 tx=0x7fd2c401ca50 comp rx=0 tx=0).stop 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- 172.21.15.87:0/1449085773 shutdown_connections 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/1449085773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2c000b9d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- 172.21.15.87:0/1449085773 >> 172.21.15.87:0/1449085773 conn(0x7fd2d40c8770 msgr2=0x7fd2d40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- 172.21.15.87:0/1449085773 shutdown_connections 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- 172.21.15.87:0/1449085773 wait complete. 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 Processor -- start 2024-04-25T16:01:20.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- start start 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2d41e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40ab730 0x7fd2d40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2d40c7a60 0x7fd2d41486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40ab1a0 con 0x7fd2c0005260 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4072260 con 0x7fd2d40ab730 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2da5f8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d40c4d00 con 0x7fd2d40c7a60 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2d41e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2d41e0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51860/0 (socket says 172.21.15.87:51860) 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 -- 172.21.15.87:0/229064621 learned_addr learned my addr 172.21.15.87:0/229064621 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:20.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d37fe640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40ab730 0x7fd2d40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2d40c7a60 0x7fd2d41486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 -- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2d40c7a60 msgr2=0x7fd2d41486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2d40c7a60 0x7fd2d41486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 -- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40ab730 msgr2=0x7fd2d40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40ab730 0x7fd2d40c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 -- 172.21.15.87:0/229064621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d40c5890 con 0x7fd2c0005260 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d8b95640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2d40c7a60 0x7fd2d41486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d3fff640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2d41e0da0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e820 tx=0x7fd2cc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.336+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc003b90 con 0x7fd2c0005260 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2cc018070 con 0x7fd2c0005260 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d40c5ec0 con 0x7fd2c0005260 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0050d0 con 0x7fd2c0005260 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d40c5b50 con 0x7fd2c0005260 2024-04-25T16:01:20.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d4069bb0 con 0x7fd2c0005260 2024-04-25T16:01:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd2cc005270 con 0x7fd2c0005260 2024-04-25T16:01:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d0ff9640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd2b406f430 0x7fd2b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d37fe640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd2b406f430 0x7fd2b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fd2cc08fa80 con 0x7fd2c0005260 2024-04-25T16:01:20.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.340+0000 7fd2d37fe640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd2b406f430 0x7fd2b4071940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40c5360 tx=0x7fd2bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.344+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2cc05c230 con 0x7fd2c0005260 2024-04-25T16:01:20.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.500+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd2d40ad120 con 0x7fd2b406f430 2024-04-25T16:01:20.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.500+0000 7fd2d0ff9640 1 -- 172.21.15.87:0/229064621 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd2d40ad120 con 0x7fd2b406f430 2024-04-25T16:01:20.503 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T16:01:20.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd2b406f430 msgr2=0x7fd2b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd2b406f430 0x7fd2b4071940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40c5360 tx=0x7fd2bc009040 comp rx=0 tx=0).stop 2024-04-25T16:01:20.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 msgr2=0x7fd2d41e0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2d41e0da0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e820 tx=0x7fd2cc00ece0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 shutdown_connections 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd2b406f430 0x7fd2b4071940 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2d40c7a60 0x7fd2d41486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40ab730 0x7fd2d40c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 --2- 172.21.15.87:0/229064621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2c0005260 0x7fd2d41e0da0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 >> 172.21.15.87:0/229064621 conn(0x7fd2d40c8770 msgr2=0x7fd2d40c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 shutdown_connections 2024-04-25T16:01:20.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.504+0000 7fd2da5f8640 1 -- 172.21.15.87:0/229064621 wait complete. 2024-04-25T16:01:20.524 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T16:01:20.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:20.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.668+0000 7f8f4c23b640 1 Processor -- start 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.668+0000 7f8f4c23b640 1 -- start start 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f4c23b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8f440c4940 0x7f8f4415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f4c23b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 0x7f8f4406f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f4c23b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4415f400 con 0x7f8f4406ef00 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f4c23b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8f4415f6e0 con 0x7f8f440c4940 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f4c23b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4415f9c0 con 0x7f8f4415c4f0 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8f4406ef00 0x7f8f4415bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44402/0 (socket says 172.21.15.87:44402) 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 -- 172.21.15.87:0/2318728407 learned_addr learned my addr 172.21.15.87:0/2318728407 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803549966 0 0) 0x7f8f4415f400 con 0x7f8f4406ef00 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f30003530 con 0x7f8f4406ef00 2024-04-25T16:01:20.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f49fd7640 1 --2- 172.21.15.87:0/2318728407 >> v2:172.21.15.155:3300/0 conn(0x7f8f440c4940 0x7f8f4415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f4a7d8640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 0x7f8f4406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 573037538 0 0) 0x7f8f30003530 con 0x7f8f4406ef00 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 msgr2=0x7f8f4406f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 0x7f8f4406f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 >> v2:172.21.15.155:3300/0 conn(0x7f8f440c4940 msgr2=0x7f8f4415edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 --2- 172.21.15.87:0/2318728407 >> v2:172.21.15.155:3300/0 conn(0x7f8f440c4940 0x7f8f4415edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4415fca0 con 0x7f8f4406ef00 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f8f34001680 con 0x7f8f4406ef00 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 >> v1:172.21.15.87:6789/0 conn(0x7f8f4406ef00 legacy=0x7f8f4415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f300039c0 0x7f8f30003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004810 0x7f8f30004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 0x7f8f300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4415f6e0 con 0x7f8f30004810 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4415f9c0 con 0x7f8f300039c0 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3000bb80 con 0x7f8f4415c4f0 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004810 0x7f8f30004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 -- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 msgr2=0x7f8f300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4415c4f0 0x7f8f300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 -- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f300039c0 msgr2=0x7f8f30003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f49fd7640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f300039c0 0x7f8f30003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.672+0000 7f8f497d6640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f300039c0 0x7f8f30003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.696+0000 7f8f497d6640 1 -- 172.21.15.87:0/2318728407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f30003530 con 0x7f8f30004810 2024-04-25T16:01:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.696+0000 7f8f497d6640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004810 0x7f8f30004c20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8f34004ae0 tx=0x7f8f3401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6a5c46c1fad9a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.696+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34004d90 con 0x7f8f30004810 2024-04-25T16:01:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f34005ae0 con 0x7f8f30004810 2024-04-25T16:01:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f48fd5640 1 -- 172.21.15.87:0/2318728407 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34008110 con 0x7f8f30004810 2024-04-25T16:01:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- 172.21.15.87:0/2318728407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004810 msgr2=0x7f8f30004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 --2- 172.21.15.87:0/2318728407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004810 0x7f8f30004c20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8f34004ae0 tx=0x7f8f3401d300 comp rx=0 tx=0).stop 2024-04-25T16:01:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4a7d8640 1 -- 172.21.15.87:0/2318728407 reap_dead start 2024-04-25T16:01:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- 172.21.15.87:0/2318728407 shutdown_connections 2024-04-25T16:01:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- 172.21.15.87:0/2318728407 >> 172.21.15.87:0/2318728407 conn(0x7f8f440c8770 msgr2=0x7f8f440c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- 172.21.15.87:0/2318728407 shutdown_connections 2024-04-25T16:01:20.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- 172.21.15.87:0/2318728407 wait complete. 2024-04-25T16:01:20.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 Processor -- start 2024-04-25T16:01:20.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- start start 2024-04-25T16:01:20.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f30004810 0x7f8f44153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f44158c30 0x7f8f44167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f441681b0 0x7f8f440c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4409f390 con 0x7f8f441681b0 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4409f210 con 0x7f8f30004810 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.700+0000 7f8f4c23b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4409f510 con 0x7f8f44158c30 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f441681b0 0x7f8f440c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f441681b0 0x7f8f440c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51874/0 (socket says 172.21.15.87:51874) 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 -- 172.21.15.87:0/1690488761 learned_addr learned my addr 172.21.15.87:0/1690488761 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f49fd7640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f30004810 0x7f8f44153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 -- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f44158c30 msgr2=0x7f8f44167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f497d6640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f44158c30 0x7f8f44167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f44158c30 0x7f8f44167c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 -- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f30004810 msgr2=0x7f8f44153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f30004810 0x7f8f44153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 -- 172.21.15.87:0/1690488761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44158080 con 0x7f8f441681b0 2024-04-25T16:01:20.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4a7d8640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f441681b0 0x7f8f440c1790 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8f441451a0 tx=0x7f8f3c00d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0125f0 con 0x7f8f441681b0 2024-04-25T16:01:20.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3c019070 con 0x7f8f441681b0 2024-04-25T16:01:20.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4416b290 con 0x7f8f441681b0 2024-04-25T16:01:20.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0129d0 con 0x7f8f441681b0 2024-04-25T16:01:20.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4416b850 con 0x7f8f441681b0 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f4416bf10 con 0x7f8f441681b0 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8f3c012b70 con 0x7f8f441681b0 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2806f400 0x7f8f28071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f8f3c0904f0 con 0x7f8f441681b0 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f49fd7640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2806f400 0x7f8f28071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f8f2807a670 0x7f8f2807cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 --> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f3c025ec0 con 0x7f8f2807a670 2024-04-25T16:01:20.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8f3c090980 con 0x7f8f441681b0 2024-04-25T16:01:20.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f49fd7640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2806f400 0x7f8f28071910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8f40003fd0 tx=0x7f8f4000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.704+0000 7f8f497d6640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f8f2807a670 0x7f8f2807cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.708+0000 7f8f497d6640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f8f2807a670 0x7f8f2807cb60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.708+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== osd.4 v2:172.21.15.155:6824/1375627769 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f3c025ec0 con 0x7f8f2807a670 2024-04-25T16:01:20.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.720+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 --> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f44069bb0 con 0x7f8f2807a670 2024-04-25T16:01:20.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.720+0000 7f8f3a7fc640 1 -- 172.21.15.87:0/1690488761 <== osd.4 v2:172.21.15.155:6824/1375627769 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f44069bb0 con 0x7f8f2807a670 2024-04-25T16:01:20.723 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:20.723 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:20.723 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f8f2807a670 msgr2=0x7f8f2807cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.155:6824/1375627769,v1:172.21.15.155:6825/1375627769] conn(0x7f8f2807a670 0x7f8f2807cb60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2806f400 msgr2=0x7f8f28071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8f2806f400 0x7f8f28071910 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8f40003fd0 tx=0x7f8f4000b040 comp rx=0 tx=0).stop 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f441681b0 msgr2=0x7f8f440c1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 --2- 172.21.15.87:0/1690488761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f441681b0 0x7f8f440c1790 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8f441451a0 tx=0x7f8f3c00d820 comp rx=0 tx=0).stop 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4a7d8640 1 -- 172.21.15.87:0/1690488761 reap_dead start 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 shutdown_connections 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 >> 172.21.15.87:0/1690488761 conn(0x7f8f440c8770 msgr2=0x7f8f440c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 shutdown_connections 2024-04-25T16:01:20.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.724+0000 7f8f4c23b640 1 -- 172.21.15.87:0/1690488761 wait complete. 2024-04-25T16:01:20.743 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T16:01:20.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.876+0000 7f74e134a640 1 Processor -- start 2024-04-25T16:01:20.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.876+0000 7f74e134a640 1 -- start start 2024-04-25T16:01:20.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74e134a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74dc152870 0x7f74dc159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74e134a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74dc06c670 0x7f74dc06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74e134a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74dc1558d0 con 0x7f74dc0c9fe0 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74e134a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc152c80 con 0x7f74dc152870 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74e134a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc070cb0 con 0x7f74dc06c670 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74dc152870 0x7f74dc159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74dc152870 0x7f74dc159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51888/0 (socket says 172.21.15.87:51888) 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 -- 172.21.15.87:0/2861747468 learned_addr learned my addr 172.21.15.87:0/2861747468 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74db7fe640 1 --2- 172.21.15.87:0/2861747468 >> v2:172.21.15.155:3300/0 conn(0x7f74dc06c670 0x7f74dc06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 -- 172.21.15.87:0/2861747468 >> v2:172.21.15.155:3300/0 conn(0x7f74dc06c670 msgr2=0x7f74dc06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 --2- 172.21.15.87:0/2861747468 >> v2:172.21.15.155:3300/0 conn(0x7f74dc06c670 0x7f74dc06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 -- 172.21.15.87:0/2861747468 >> v1:172.21.15.155:6789/0 conn(0x7f74dc0c9fe0 legacy=0x7f74dc1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74daffd640 1 -- 172.21.15.87:0/2861747468 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc070f90 con 0x7f74dc152870 2024-04-25T16:01:20.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.880+0000 7f74db7fe640 1 --2- 172.21.15.87:0/2861747468 >> v2:172.21.15.155:3300/0 conn(0x7f74dc06c670 0x7f74dc06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:01:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74daffd640 1 --2- 172.21.15.87:0/2861747468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc152870 0x7f74dc159290 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f74dc156330 tx=0x7f74cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c252674ed6b26001 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74d9ffb640 1 -- 172.21.15.87:0/2861747468 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0b0070 con 0x7f74dc152870 2024-04-25T16:01:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74d9ffb640 1 -- 172.21.15.87:0/2861747468 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0ab600 con 0x7f74dc152870 2024-04-25T16:01:20.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74d9ffb640 1 -- 172.21.15.87:0/2861747468 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0ab9d0 con 0x7f74dc152870 2024-04-25T16:01:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 -- 172.21.15.87:0/2861747468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc152870 msgr2=0x7f74dc159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 --2- 172.21.15.87:0/2861747468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc152870 0x7f74dc159290 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f74dc156330 tx=0x7f74cc01c490 comp rx=0 tx=0).stop 2024-04-25T16:01:20.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 -- 172.21.15.87:0/2861747468 shutdown_connections 2024-04-25T16:01:20.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 --2- 172.21.15.87:0/2861747468 >> v2:172.21.15.155:3300/0 conn(0x7f74dc06c670 0x7f74dc06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 --2- 172.21.15.87:0/2861747468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc152870 0x7f74dc159290 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 -- 172.21.15.87:0/2861747468 >> 172.21.15.87:0/2861747468 conn(0x7f74dc06d780 msgr2=0x7f74dc06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:20.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 -- 172.21.15.87:0/2861747468 shutdown_connections 2024-04-25T16:01:20.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 -- 172.21.15.87:0/2861747468 wait complete. 2024-04-25T16:01:20.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 Processor -- start 2024-04-25T16:01:20.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.884+0000 7f74e134a640 1 -- start start 2024-04-25T16:01:20.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 0x7f74dc1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc0c9fe0 0x7f74dc154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc152870 0x7f74dc15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc162360 con 0x7f74dc06c670 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc0ca3f0 con 0x7f74dc0c9fe0 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc1624e0 con 0x7f74dc152870 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 0x7f74dc1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 0x7f74dc1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51904/0 (socket says 172.21.15.87:51904) 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 -- 172.21.15.87:0/2360789835 learned_addr learned my addr 172.21.15.87:0/2360789835 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74da7fc640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc0c9fe0 0x7f74dc154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 -- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc152870 msgr2=0x7f74dc15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74db7fe640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc152870 0x7f74dc15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc152870 0x7f74dc15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 -- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc0c9fe0 msgr2=0x7f74dc154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc0c9fe0 0x7f74dc154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 -- 172.21.15.87:0/2360789835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc1539d0 con 0x7f74dc06c670 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74daffd640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 0x7f74dc1497e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f74cc01a0c0 tx=0x7f74cc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0b8020 con 0x7f74dc06c670 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0b4410 con 0x7f74dc06c670 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0b0040 con 0x7f74dc06c670 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc1f4880 con 0x7f74dc06c670 2024-04-25T16:01:20.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc149d20 con 0x7f74dc06c670 2024-04-25T16:01:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc069bb0 con 0x7f74dc06c670 2024-04-25T16:01:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f74cc0bb020 con 0x7f74dc06c670 2024-04-25T16:01:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.888+0000 7f74c37fe640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f74c806f430 0x7f74c8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.892+0000 7f74da7fc640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f74c806f430 0x7f74c8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.892+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f74cc129990 con 0x7f74dc06c670 2024-04-25T16:01:20.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.892+0000 7f74da7fc640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f74c806f430 0x7f74c8071940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74dc14d970 tx=0x7f74d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:20.895 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:20.896+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74cc0c2070 con 0x7f74dc06c670 2024-04-25T16:01:21.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.060+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f74dc073040 con 0x7f74c806f430 2024-04-25T16:01:21.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.060+0000 7f74c37fe640 1 -- 172.21.15.87:0/2360789835 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f74dc073040 con 0x7f74c806f430 2024-04-25T16:01:21.062 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f74c806f430 msgr2=0x7f74c8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f74c806f430 0x7f74c8071940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74dc14d970 tx=0x7f74d0009040 comp rx=0 tx=0).stop 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 msgr2=0x7f74dc1497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 0x7f74dc1497e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f74cc01a0c0 tx=0x7f74cc019230 comp rx=0 tx=0).stop 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 shutdown_connections 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f74c806f430 0x7f74c8071940 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc152870 0x7f74dc15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc0c9fe0 0x7f74dc154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 --2- 172.21.15.87:0/2360789835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74dc06c670 0x7f74dc1497e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 >> 172.21.15.87:0/2360789835 conn(0x7f74dc06d780 msgr2=0x7f74dc0c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 shutdown_connections 2024-04-25T16:01:21.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.064+0000 7f74e134a640 1 -- 172.21.15.87:0/2360789835 wait complete. 2024-04-25T16:01:21.088 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T16:01:21.088 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:21.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.232+0000 7f43e59e8640 1 Processor -- start 2024-04-25T16:01:21.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.232+0000 7f43e59e8640 1 -- start start 2024-04-25T16:01:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.232+0000 7f43e59e8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 0x7f43e006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.232+0000 7f43e59e8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43e00ad160 0x7f43e00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.232+0000 7f43e59e8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e0154fc0 con 0x7f43e00c4620 2024-04-25T16:01:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43e59e8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f43e006ed60 con 0x7f43e00ad160 2024-04-25T16:01:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43e59e8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43e00acb20 con 0x7f43e01518b0 2024-04-25T16:01:21.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43df7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f43e00c4620 0x7f43e0157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35232/0 (socket says 172.21.15.87:35232) 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43df7fe640 1 -- 172.21.15.87:0/710718932 learned_addr learned my addr 172.21.15.87:0/710718932 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43d67fc640 1 --2- 172.21.15.87:0/710718932 >> v2:172.21.15.155:3300/0 conn(0x7f43e00ad160 0x7f43e00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 0x7f43e006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 934025429 0 0) 0x7f43e0154fc0 con 0x7f43e00c4620 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43cc003530 con 0x7f43e00c4620 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3309857708 0 0) 0x7f43cc003530 con 0x7f43e00c4620 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 msgr2=0x7f43e006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 0x7f43e006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 >> v2:172.21.15.155:3300/0 conn(0x7f43e00ad160 msgr2=0x7f43e00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 --2- 172.21.15.87:0/710718932 >> v2:172.21.15.155:3300/0 conn(0x7f43e00ad160 0x7f43e00c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00ace00 con 0x7f43e00c4620 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f43d8001a00 con 0x7f43e00c4620 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 >> v1:172.21.15.87:6789/0 conn(0x7f43e00c4620 legacy=0x7f43e0157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43cc0039c0 0x7f43cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 0x7f43cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43cc004d50 0x7f43cc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f43e006ed60 con 0x7f43cc0039c0 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43e00acb20 con 0x7f43cc004d50 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc00b9d0 con 0x7f43e01518b0 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43cc0039c0 0x7f43cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 -- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 msgr2=0x7f43cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43e01518b0 0x7f43cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43df7fe640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43cc004d50 0x7f43cc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 -- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43cc004d50 msgr2=0x7f43cc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43cc004d50 0x7f43cc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 -- 172.21.15.87:0/710718932 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc003530 con 0x7f43cc0039c0 2024-04-25T16:01:21.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43df7fe640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43cc004d50 0x7f43cc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43deffd640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43cc0039c0 0x7f43cc003e30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009ab0 tx=0x7f43d001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855321dd945e76d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00b2070 con 0x7f43cc0039c0 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d00a5640 con 0x7f43cc0039c0 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.236+0000 7f43de7fc640 1 -- 172.21.15.87:0/710718932 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d00096b0 con 0x7f43cc0039c0 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- 172.21.15.87:0/710718932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43cc0039c0 msgr2=0x7f43cc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 --2- 172.21.15.87:0/710718932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43cc0039c0 0x7f43cc003e30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009ab0 tx=0x7f43d001ca50 comp rx=0 tx=0).stop 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43df7fe640 1 -- 172.21.15.87:0/710718932 reap_dead start 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- 172.21.15.87:0/710718932 shutdown_connections 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- 172.21.15.87:0/710718932 >> 172.21.15.87:0/710718932 conn(0x7f43e00c8770 msgr2=0x7f43e00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- 172.21.15.87:0/710718932 shutdown_connections 2024-04-25T16:01:21.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- 172.21.15.87:0/710718932 wait complete. 2024-04-25T16:01:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 Processor -- start 2024-04-25T16:01:21.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- start start 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43cc0039c0 0x7f43e015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e01609d0 0x7f43e01f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43e01f19e0 0x7f43e0148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f43e006f860 con 0x7f43e01609d0 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43e006f6e0 con 0x7f43e01f19e0 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43e59e8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43e006f9e0 con 0x7f43cc0039c0 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e01609d0 0x7f43e01f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e01609d0 0x7f43e01f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55846/0 (socket says 172.21.15.87:55846) 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 -- 172.21.15.87:0/2298533307 learned_addr learned my addr 172.21.15.87:0/2298533307 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:21.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43df7fe640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43e01f19e0 0x7f43e0148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43deffd640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43cc0039c0 0x7f43e015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 -- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43cc0039c0 msgr2=0x7f43e015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43cc0039c0 0x7f43e015ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 -- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43e01f19e0 msgr2=0x7f43e0148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43e01f19e0 0x7f43e0148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 -- 172.21.15.87:0/2298533307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00c63a0 con 0x7f43e01609d0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43df7fe640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43e01f19e0 0x7f43e0148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43d67fc640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e01609d0 0x7f43e01f14a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e7f0 tx=0x7f43c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.240+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8017070 con 0x7f43e01609d0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c800c8e0 con 0x7f43e01609d0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e014b170 con 0x7f43e01609d0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c800eea0 con 0x7f43e01609d0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e01f0f80 con 0x7f43e01609d0 2024-04-25T16:01:21.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43e0069bb0 con 0x7f43e01609d0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f43c801a070 con 0x7f43e01609d0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43c006f430 0x7f43c0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f43c808fbc0 con 0x7f43e01609d0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43deffd640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43c006f430 0x7f43c0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f43c007a690 0x7f43c007cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 --> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43c80044c0 con 0x7f43c007a690 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f43c8090050 con 0x7f43e01609d0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43deffd640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43c006f430 0x7f43c0071940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f43d00af000 tx=0x7f43d00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43df7fe640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f43c007a690 0x7f43c007cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.244+0000 7f43df7fe640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f43c007a690 0x7f43c007cb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.248+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== osd.5 v2:172.21.15.155:6800/3453999396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c80044c0 con 0x7f43c007a690 2024-04-25T16:01:21.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 --> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f43e00c6150 con 0x7f43c007a690 2024-04-25T16:01:21.261 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43dcff9640 1 -- 172.21.15.87:0/2298533307 <== osd.5 v2:172.21.15.155:6800/3453999396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f43e00c6150 con 0x7f43c007a690 2024-04-25T16:01:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:21.262 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f43c007a690 msgr2=0x7f43c007cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.155:6800/3453999396,v1:172.21.15.155:6801/3453999396] conn(0x7f43c007a690 0x7f43c007cb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43c006f430 msgr2=0x7f43c0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f43c006f430 0x7f43c0071940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f43d00af000 tx=0x7f43d00046d0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e01609d0 msgr2=0x7f43e01f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 --2- 172.21.15.87:0/2298533307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43e01609d0 0x7f43e01f14a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e7f0 tx=0x7f43c800ecb0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43df7fe640 1 -- 172.21.15.87:0/2298533307 reap_dead start 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 shutdown_connections 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 >> 172.21.15.87:0/2298533307 conn(0x7f43e00c8770 msgr2=0x7f43e015fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 shutdown_connections 2024-04-25T16:01:21.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.260+0000 7f43e59e8640 1 -- 172.21.15.87:0/2298533307 wait complete. 2024-04-25T16:01:21.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T16:01:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.420+0000 7ffb6d2e7640 1 Processor -- start 2024-04-25T16:01:21.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.420+0000 7ffb6d2e7640 1 -- start start 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb6d2e7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb681529a0 0x7ffb68071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb6d2e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680ad990 0x7ffb680adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb6d2e7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffb680c41e0 0x7ffb680c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb6d2e7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ffb68072430 con 0x7ffb681529a0 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb6d2e7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffb68074730 con 0x7ffb680c41e0 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb6d2e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb68074a10 con 0x7ffb680ad990 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb681529a0 0x7ffb68071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb681529a0 0x7ffb68071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55860/0 (socket says 172.21.15.87:55860) 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 -- 172.21.15.87:0/3572276588 learned_addr learned my addr 172.21.15.87:0/3572276588 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb677fe640 1 --2- 172.21.15.87:0/3572276588 >> v2:172.21.15.155:3300/0 conn(0x7ffb680c41e0 0x7ffb680c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb667fc640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680ad990 0x7ffb680adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 -- 172.21.15.87:0/3572276588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680ad990 msgr2=0x7ffb680adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680ad990 0x7ffb680adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 -- 172.21.15.87:0/3572276588 >> v2:172.21.15.155:3300/0 conn(0x7ffb680c41e0 msgr2=0x7ffb680c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 --2- 172.21.15.87:0/3572276588 >> v2:172.21.15.155:3300/0 conn(0x7ffb680c41e0 0x7ffb680c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 -- 172.21.15.87:0/3572276588 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68074cf0 con 0x7ffb681529a0 2024-04-25T16:01:21.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb667fc640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680ad990 0x7ffb680adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb66ffd640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb68071e50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ffb6806fe90 tx=0x7ffb5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f072d5524463cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb65ffb640 1 -- 172.21.15.87:0/3572276588 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb580b0070 con 0x7ffb681529a0 2024-04-25T16:01:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb65ffb640 1 -- 172.21.15.87:0/3572276588 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb580ab600 con 0x7ffb681529a0 2024-04-25T16:01:21.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.424+0000 7ffb65ffb640 1 -- 172.21.15.87:0/3572276588 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb580ab9d0 con 0x7ffb681529a0 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3572276588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 msgr2=0x7ffb68071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb68071e50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ffb6806fe90 tx=0x7ffb5801c490 comp rx=0 tx=0).stop 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3572276588 shutdown_connections 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3572276588 >> v2:172.21.15.155:3300/0 conn(0x7ffb680c41e0 0x7ffb680c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680ad990 0x7ffb680adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3572276588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb68071e50 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3572276588 >> 172.21.15.87:0/3572276588 conn(0x7ffb680c8770 msgr2=0x7ffb680c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3572276588 shutdown_connections 2024-04-25T16:01:21.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3572276588 wait complete. 2024-04-25T16:01:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 Processor -- start 2024-04-25T16:01:21.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- start start 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb680ad990 0x7ffb680ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680c41e0 0x7ffb68150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb681f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffb68159340 con 0x7ffb681529a0 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb681591c0 con 0x7ffb680ad990 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb6d2e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb681594c0 con 0x7ffb680c41e0 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb681f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb681f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55870/0 (socket says 172.21.15.87:55870) 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 -- 172.21.15.87:0/3628089335 learned_addr learned my addr 172.21.15.87:0/3628089335 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb66ffd640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb680ad990 0x7ffb680ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb667fc640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680c41e0 0x7ffb68150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 -- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680c41e0 msgr2=0x7ffb68150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680c41e0 0x7ffb68150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 -- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb680ad990 msgr2=0x7ffb680ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb680ad990 0x7ffb680ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb677fe640 1 -- 172.21.15.87:0/3628089335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb681f0530 con 0x7ffb681529a0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.428+0000 7ffb667fc640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680c41e0 0x7ffb68150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb677fe640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb681f0fb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009fd0 tx=0x7ffb6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60014420 con 0x7ffb681529a0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb60019070 con 0x7ffb681529a0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6814e490 con 0x7ffb681529a0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60014800 con 0x7ffb681529a0 2024-04-25T16:01:21.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68151bb0 con 0x7ffb681529a0 2024-04-25T16:01:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb68150830 con 0x7ffb681529a0 2024-04-25T16:01:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb600149a0 con 0x7ffb681529a0 2024-04-25T16:01:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb4f7fe640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb5406f400 0x7ffb54071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb66ffd640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb5406f400 0x7ffb54071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7ffb60090150 con 0x7ffb681529a0 2024-04-25T16:01:21.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.432+0000 7ffb66ffd640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb5406f400 0x7ffb54071910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffb580ad000 tx=0x7ffb580a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.436+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb68150830 con 0x7ffb681529a0 2024-04-25T16:01:21.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.604+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ffb68069bb0 con 0x7ffb5406f400 2024-04-25T16:01:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb4f7fe640 1 -- 172.21.15.87:0/3628089335 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffb68069bb0 con 0x7ffb5406f400 2024-04-25T16:01:21.608 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T16:01:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb5406f400 msgr2=0x7ffb54071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb5406f400 0x7ffb54071910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffb580ad000 tx=0x7ffb580a6000 comp rx=0 tx=0).stop 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 msgr2=0x7ffb681f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb681f0fb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009fd0 tx=0x7ffb6000e4b0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 shutdown_connections 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ffb5406f400 0x7ffb54071910 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb681529a0 0x7ffb681f0fb0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb680c41e0 0x7ffb68150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 --2- 172.21.15.87:0/3628089335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb680ad990 0x7ffb680ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 >> 172.21.15.87:0/3628089335 conn(0x7ffb680c8770 msgr2=0x7ffb6814c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 shutdown_connections 2024-04-25T16:01:21.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.608+0000 7ffb6d2e7640 1 -- 172.21.15.87:0/3628089335 wait complete. 2024-04-25T16:01:21.630 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T16:01:21.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:21.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 Processor -- start 2024-04-25T16:01:21.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 -- start start 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ee41529a0 0x7f1ee4071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ee40adda0 0x7f1ee40c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee40c4e30 con 0x7f1ee40ad990 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee40ae1b0 con 0x7f1ee40adda0 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eec51d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee4072430 con 0x7f1ee41529a0 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1ee9ab8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1ee40ad990 0x7f1ee40c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35236/0 (socket says 172.21.15.87:35236) 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1ee9ab8640 1 -- 172.21.15.87:0/41791139 learned_addr learned my addr 172.21.15.87:0/41791139 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/41791139 >> v2:172.21.15.87:3300/0 conn(0x7f1ee40adda0 0x7f1ee40c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eea2b9640 1 --2- 172.21.15.87:0/41791139 >> v2:172.21.15.155:3300/0 conn(0x7f1ee41529a0 0x7f1ee4071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eeaaba640 1 -- 172.21.15.87:0/41791139 >> v2:172.21.15.155:3300/0 conn(0x7f1ee41529a0 msgr2=0x7f1ee4071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/41791139 >> v2:172.21.15.155:3300/0 conn(0x7f1ee41529a0 0x7f1ee4071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1ee92b7640 1 -- 172.21.15.87:0/41791139 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663962085 0 0) 0x7f1ed4001120 con 0x7f1ee40ad990 2024-04-25T16:01:21.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eeaaba640 1 -- 172.21.15.87:0/41791139 >> v1:172.21.15.87:6789/0 conn(0x7f1ee40ad990 legacy=0x7f1ee40c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eeaaba640 1 -- 172.21.15.87:0/41791139 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee4074730 con 0x7f1ee40adda0 2024-04-25T16:01:21.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.772+0000 7f1eea2b9640 1 --2- 172.21.15.87:0/41791139 >> v2:172.21.15.155:3300/0 conn(0x7f1ee41529a0 0x7f1ee4071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/41791139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40adda0 0x7f1ee40c48f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40ae520 tx=0x7f1edc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c63f0e7f9559d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1ee92b7640 1 -- 172.21.15.87:0/41791139 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0b2070 con 0x7f1ee40adda0 2024-04-25T16:01:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1ee92b7640 1 -- 172.21.15.87:0/41791139 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0a5760 con 0x7f1ee40adda0 2024-04-25T16:01:21.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1ee92b7640 1 -- 172.21.15.87:0/41791139 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0a5b30 con 0x7f1ee40adda0 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 -- 172.21.15.87:0/41791139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40adda0 msgr2=0x7f1ee40c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 --2- 172.21.15.87:0/41791139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40adda0 0x7f1ee40c48f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40ae520 tx=0x7f1edc01c8a0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 -- 172.21.15.87:0/41791139 shutdown_connections 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 --2- 172.21.15.87:0/41791139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40adda0 0x7f1ee40c48f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 --2- 172.21.15.87:0/41791139 >> v2:172.21.15.155:3300/0 conn(0x7f1ee41529a0 0x7f1ee4071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 -- 172.21.15.87:0/41791139 >> 172.21.15.87:0/41791139 conn(0x7f1ee40c8770 msgr2=0x7f1ee40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 -- 172.21.15.87:0/41791139 shutdown_connections 2024-04-25T16:01:21.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 -- 172.21.15.87:0/41791139 wait complete. 2024-04-25T16:01:21.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 Processor -- start 2024-04-25T16:01:21.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.776+0000 7f1eec51d640 1 -- start start 2024-04-25T16:01:21.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40ad990 0x7f1ee41f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee40adda0 0x7f1ee415e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee41529a0 0x7f1ee40ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee41622f0 con 0x7f1ee40ad990 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee40ab1a0 con 0x7f1ee41529a0 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee4162470 con 0x7f1ee40adda0 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40ad990 0x7f1ee41f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40ad990 0x7f1ee41f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55878/0 (socket says 172.21.15.87:55878) 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 -- 172.21.15.87:0/3157913170 learned_addr learned my addr 172.21.15.87:0/3157913170 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee41529a0 0x7f1ee40ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 -- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee40adda0 msgr2=0x7f1ee415e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ee40adda0 0x7f1ee415e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 -- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee41529a0 msgr2=0x7f1ee40ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee41529a0 0x7f1ee40ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 -- 172.21.15.87:0/3157913170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee41f1860 con 0x7f1ee40ad990 2024-04-25T16:01:21.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee41529a0 0x7f1ee40ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eea2b9640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40ad990 0x7f1ee41f1320 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c820 tx=0x7f1ee000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0015070 con 0x7f1ee40ad990 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee0007a30 con 0x7f1ee40ad990 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee40ad2f0 con 0x7f1ee40ad990 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0007de0 con 0x7f1ee40ad990 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee40ab960 con 0x7f1ee40ad990 2024-04-25T16:01:21.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ee40ab750 con 0x7f1ee40ad990 2024-04-25T16:01:21.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1ee0018070 con 0x7f1ee40ad990 2024-04-25T16:01:21.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1ec806f430 0x7f1ec8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1ee9ab8640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1ec806f430 0x7f1ec8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f1ee008fe10 con 0x7f1ee40ad990 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f1ec807a690 0x7f1ec807cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 --> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ec807d250 con 0x7f1ec807a690 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1ee00902a0 con 0x7f1ee40ad990 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.780+0000 7f1ee9ab8640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1ec806f430 0x7f1ec8071940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1ee414d000 tx=0x7f1ed4007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.784+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f1ec807a690 0x7f1ec807cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.784+0000 7f1eeaaba640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f1ec807a690 0x7f1ec807cb80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.784+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== osd.6 v2:172.21.15.155:6816/3434620802 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ec807d250 con 0x7f1ec807a690 2024-04-25T16:01:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.796+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 --> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1ee4069bb0 con 0x7f1ec807a690 2024-04-25T16:01:21.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.796+0000 7f1edaffd640 1 -- 172.21.15.87:0/3157913170 <== osd.6 v2:172.21.15.155:6816/3434620802 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1ee4069bb0 con 0x7f1ec807a690 2024-04-25T16:01:21.799 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:21.799 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:21.799 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f1ec807a690 msgr2=0x7f1ec807cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.155:6816/3434620802,v1:172.21.15.155:6817/3434620802] conn(0x7f1ec807a690 0x7f1ec807cb80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1ec806f430 msgr2=0x7f1ec8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f1ec806f430 0x7f1ec8071940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1ee414d000 tx=0x7f1ed4007970 comp rx=0 tx=0).stop 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40ad990 msgr2=0x7f1ee41f1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 --2- 172.21.15.87:0/3157913170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ee40ad990 0x7f1ee41f1320 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c820 tx=0x7f1ee000cce0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eeaaba640 1 -- 172.21.15.87:0/3157913170 reap_dead start 2024-04-25T16:01:21.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 shutdown_connections 2024-04-25T16:01:21.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 >> 172.21.15.87:0/3157913170 conn(0x7f1ee40c8770 msgr2=0x7f1ee414f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 shutdown_connections 2024-04-25T16:01:21.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.800+0000 7f1eec51d640 1 -- 172.21.15.87:0/3157913170 wait complete. 2024-04-25T16:01:21.818 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T16:01:21.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 Processor -- start 2024-04-25T16:01:21.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 -- start start 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f484c152870 0x7f484c159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f484c06c670 0x7f484c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f484c1558d0 con 0x7f484c0c9fe0 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f484c152c80 con 0x7f484c152870 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4853766640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f484c070cb0 con 0x7f484c06c670 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f484c152870 0x7f484c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f484c152870 0x7f484c159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55888/0 (socket says 172.21.15.87:55888) 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 -- 172.21.15.87:0/2281709676 learned_addr learned my addr 172.21.15.87:0/2281709676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851d03640 1 --2- 172.21.15.87:0/2281709676 >> v2:172.21.15.155:3300/0 conn(0x7f484c06c670 0x7f484c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 -- 172.21.15.87:0/2281709676 >> v2:172.21.15.155:3300/0 conn(0x7f484c06c670 msgr2=0x7f484c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 --2- 172.21.15.87:0/2281709676 >> v2:172.21.15.155:3300/0 conn(0x7f484c06c670 0x7f484c06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 -- 172.21.15.87:0/2281709676 >> v1:172.21.15.155:6789/0 conn(0x7f484c0c9fe0 legacy=0x7f484c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:21.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.956+0000 7f4851502640 1 -- 172.21.15.87:0/2281709676 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484c070f90 con 0x7f484c152870 2024-04-25T16:01:21.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.960+0000 7f4851502640 1 --2- 172.21.15.87:0/2281709676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c159290 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f484c156330 tx=0x7f484801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8671712969b547f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.960+0000 7f4843fff640 1 -- 172.21.15.87:0/2281709676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48480b0070 con 0x7f484c152870 2024-04-25T16:01:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.960+0000 7f4843fff640 1 -- 172.21.15.87:0/2281709676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48480ab600 con 0x7f484c152870 2024-04-25T16:01:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.960+0000 7f4843fff640 1 -- 172.21.15.87:0/2281709676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48480ab9d0 con 0x7f484c152870 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.960+0000 7f4853766640 1 -- 172.21.15.87:0/2281709676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 msgr2=0x7f484c159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.960+0000 7f4853766640 1 --2- 172.21.15.87:0/2281709676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c159290 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f484c156330 tx=0x7f484801c490 comp rx=0 tx=0).stop 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- 172.21.15.87:0/2281709676 shutdown_connections 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 --2- 172.21.15.87:0/2281709676 >> v2:172.21.15.155:3300/0 conn(0x7f484c06c670 0x7f484c06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 --2- 172.21.15.87:0/2281709676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c159290 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- 172.21.15.87:0/2281709676 >> 172.21.15.87:0/2281709676 conn(0x7f484c06d780 msgr2=0x7f484c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- 172.21.15.87:0/2281709676 shutdown_connections 2024-04-25T16:01:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- 172.21.15.87:0/2281709676 wait complete. 2024-04-25T16:01:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 Processor -- start 2024-04-25T16:01:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- start start 2024-04-25T16:01:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484c06c670 0x7f484c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f484c0c9fe0 0x7f484c1eee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f484c162360 con 0x7f484c152870 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f484c0ca3f0 con 0x7f484c0c9fe0 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f484c1624e0 con 0x7f484c06c670 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55902/0 (socket says 172.21.15.87:55902) 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 -- 172.21.15.87:0/1079773481 learned_addr learned my addr 172.21.15.87:0/1079773481 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851502640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484c06c670 0x7f484c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4850d01640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f484c0c9fe0 0x7f484c1eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 -- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484c06c670 msgr2=0x7f484c1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484c06c670 0x7f484c1f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 -- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f484c0c9fe0 msgr2=0x7f484c1eee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f484c0c9fe0 0x7f484c1eee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 -- 172.21.15.87:0/1079773481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484c0c8ae0 con 0x7f484c152870 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4851d03640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c153fc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4844009fd0 tx=0x7f484400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844014420 con 0x7f484c152870 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4844019070 con 0x7f484c152870 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484c0c9360 con 0x7f484c152870 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844014800 con 0x7f484c152870 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.964+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484c0c9080 con 0x7f484c152870 2024-04-25T16:01:21.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.968+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f484c069bb0 con 0x7f484c152870 2024-04-25T16:01:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.968+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f48440149a0 con 0x7f484c152870 2024-04-25T16:01:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.968+0000 7f4841ffb640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f483006f430 0x7f4830071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.968+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f4844090c30 con 0x7f484c152870 2024-04-25T16:01:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.968+0000 7f4851502640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f483006f430 0x7f4830071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:21.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.968+0000 7f4851502640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f483006f430 0x7f4830071940 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f48480ad000 tx=0x7f4848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:21.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:21.972+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f484405d4c0 con 0x7f484c152870 2024-04-25T16:01:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.136+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f484c06d530 con 0x7f483006f430 2024-04-25T16:01:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.136+0000 7f4841ffb640 1 -- 172.21.15.87:0/1079773481 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f484c06d530 con 0x7f483006f430 2024-04-25T16:01:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T16:01:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f483006f430 msgr2=0x7f4830071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f483006f430 0x7f4830071940 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f48480ad000 tx=0x7f4848008040 comp rx=0 tx=0).stop 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 msgr2=0x7f484c153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c153fc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4844009fd0 tx=0x7f484400e4b0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 shutdown_connections 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f483006f430 0x7f4830071940 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484c152870 0x7f484c153fc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f484c0c9fe0 0x7f484c1eee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 --2- 172.21.15.87:0/1079773481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484c06c670 0x7f484c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 >> 172.21.15.87:0/1079773481 conn(0x7f484c06d780 msgr2=0x7f484c156210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 shutdown_connections 2024-04-25T16:01:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.140+0000 7f4853766640 1 -- 172.21.15.87:0/1079773481 wait complete. 2024-04-25T16:01:22.162 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T16:01:22.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T16:01:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 Processor -- start 2024-04-25T16:01:22.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 -- start start 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f98440c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9844155320 0x7f9844155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9844152d90 con 0x7f9844074160 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f98440aa290 con 0x7f9844155320 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f984a65a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f98441598b0 con 0x7f9844152980 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9844155320 0x7f9844155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9844155320 0x7f9844155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55918/0 (socket says 172.21.15.87:55918) 2024-04-25T16:01:22.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 -- 172.21.15.87:0/3660512496 learned_addr learned my addr 172.21.15.87:0/3660512496 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f9848bf7640 1 --1- 172.21.15.87:0/3660512496 >> v1:172.21.15.87:6789/0 conn(0x7f9844074160 0x7f98440c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35244/0 (socket says 172.21.15.87:35244) 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f9843fff640 1 --2- 172.21.15.87:0/3660512496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f98440c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 -- 172.21.15.87:0/3660512496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 msgr2=0x7f98440c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 --2- 172.21.15.87:0/3660512496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f98440c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 -- 172.21.15.87:0/3660512496 >> v1:172.21.15.87:6789/0 conn(0x7f9844074160 legacy=0x7f98440c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f9842ffd640 1 -- 172.21.15.87:0/3660512496 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4021121314 0 0) 0x7f9844152d90 con 0x7f9844074160 2024-04-25T16:01:22.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.320+0000 7f98437fe640 1 -- 172.21.15.87:0/3660512496 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440ca2f0 con 0x7f9844155320 2024-04-25T16:01:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f98437fe640 1 --2- 172.21.15.87:0/3660512496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f9844155730 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9838009870 tx=0x7f983801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429b07ce95d0381c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f9842ffd640 1 -- 172.21.15.87:0/3660512496 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380b0070 con 0x7f9844155320 2024-04-25T16:01:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f9842ffd640 1 -- 172.21.15.87:0/3660512496 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380ab600 con 0x7f9844155320 2024-04-25T16:01:22.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f9842ffd640 1 -- 172.21.15.87:0/3660512496 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380ab9d0 con 0x7f9844155320 2024-04-25T16:01:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 -- 172.21.15.87:0/3660512496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 msgr2=0x7f9844155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 --2- 172.21.15.87:0/3660512496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f9844155730 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9838009870 tx=0x7f983801c4d0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 -- 172.21.15.87:0/3660512496 shutdown_connections 2024-04-25T16:01:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 --2- 172.21.15.87:0/3660512496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f9844155730 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 --2- 172.21.15.87:0/3660512496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f98440c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 -- 172.21.15.87:0/3660512496 >> 172.21.15.87:0/3660512496 conn(0x7f98440ac550 msgr2=0x7f98440ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:22.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 -- 172.21.15.87:0/3660512496 shutdown_connections 2024-04-25T16:01:22.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.324+0000 7f984a65a640 1 -- 172.21.15.87:0/3660512496 wait complete. 2024-04-25T16:01:22.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 Processor -- start 2024-04-25T16:01:22.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- start start 2024-04-25T16:01:22.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9844074160 0x7f98441eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f9844153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f98441494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9844158f70 con 0x7f9844155320 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9844158c90 con 0x7f9844074160 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f98440729c0 con 0x7f9844152980 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f98441494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f98441494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55932/0 (socket says 172.21.15.87:55932) 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 -- 172.21.15.87:0/1920242740 learned_addr learned my addr 172.21.15.87:0/1920242740 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9843fff640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9844074160 0x7f98441eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f98437fe640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f9844153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 -- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 msgr2=0x7f9844153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f9844153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 -- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9844074160 msgr2=0x7f98441eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9844074160 0x7f98441eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 -- 172.21.15.87:0/1920242740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440c0830 con 0x7f9844155320 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f98437fe640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9844152980 0x7f9844153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9848bf7640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f98441494f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f983400c3e0 tx=0x7f983400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98340074e0 con 0x7f9844155320 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98340047f0 con 0x7f9844155320 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98440affc0 con 0x7f9844155320 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834004be0 con 0x7f9844155320 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98440c0e80 con 0x7f9844155320 2024-04-25T16:01:22.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.328+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98440b04e0 con 0x7f9844155320 2024-04-25T16:01:22.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9834011070 con 0x7f9844155320 2024-04-25T16:01:22.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9840ff9640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983006f430 0x7f9830071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f983408fe10 con 0x7f9844155320 2024-04-25T16:01:22.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9843fff640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983006f430 0x7f9830071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9840ff9640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f983007a690 0x7f983007cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 --> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f983007d250 con 0x7f983007a690 2024-04-25T16:01:22.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f98340902a0 con 0x7f9844155320 2024-04-25T16:01:22.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f9843fff640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983006f430 0x7f9830071940 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f983c003fd0 tx=0x7f983c0039a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f98437fe640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f983007a690 0x7f983007cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.332+0000 7f98437fe640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f983007a690 0x7f983007cb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.336+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== osd.7 v2:172.21.15.155:6808/209384873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f983007d250 con 0x7f983007a690 2024-04-25T16:01:22.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 --> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9844069bb0 con 0x7f983007a690 2024-04-25T16:01:22.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f9840ff9640 1 -- 172.21.15.87:0/1920242740 <== osd.7 v2:172.21.15.155:6808/209384873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9844069bb0 con 0x7f983007a690 2024-04-25T16:01:22.349 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-25T16:01:22.349 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T16:01:22.350 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-25T16:01:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f983007a690 msgr2=0x7f983007cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.155:6808/209384873,v1:172.21.15.155:6809/209384873] conn(0x7f983007a690 0x7f983007cb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983006f430 msgr2=0x7f9830071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983006f430 0x7f9830071940 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f983c003fd0 tx=0x7f983c0039a0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 msgr2=0x7f98441494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 --2- 172.21.15.87:0/1920242740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9844155320 0x7f98441494f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f983400c3e0 tx=0x7f983400c8a0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f9848bf7640 1 -- 172.21.15.87:0/1920242740 reap_dead start 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 shutdown_connections 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 >> 172.21.15.87:0/1920242740 conn(0x7f98440ac550 msgr2=0x7f98440ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 shutdown_connections 2024-04-25T16:01:22.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.348+0000 7f984a65a640 1 -- 172.21.15.87:0/1920242740 wait complete. 2024-04-25T16:01:22.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T16:01:22.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 Processor -- start 2024-04-25T16:01:22.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 -- start start 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f506406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50640ad160 0x7f50640c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5064154fc0 con 0x7f50640c4620 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f506406ed60 con 0x7f50640ad160 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506bb74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50640acb20 con 0x7f50641518b0 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50640ad160 0x7f50640c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50640ad160 0x7f50640c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55938/0 (socket says 172.21.15.87:55938) 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 -- 172.21.15.87:0/4030955902 learned_addr learned my addr 172.21.15.87:0/4030955902 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:22.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f5069910640 1 --2- 172.21.15.87:0/4030955902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f506406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 -- 172.21.15.87:0/4030955902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 msgr2=0x7f506406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:22.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 --2- 172.21.15.87:0/4030955902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f506406f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 -- 172.21.15.87:0/4030955902 >> v1:172.21.15.155:6789/0 conn(0x7f50640c4620 legacy=0x7f5064157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.520 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.516+0000 7f506910f640 1 -- 172.21.15.87:0/4030955902 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50640ace00 con 0x7f50640ad160 2024-04-25T16:01:22.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506910f640 1 --2- 172.21.15.87:0/4030955902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640ad160 0x7f50640c40e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5058009870 tx=0x7f505801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f9c56d183be6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506890e640 1 -- 172.21.15.87:0/4030955902 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580a9640 con 0x7f50640ad160 2024-04-25T16:01:22.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506890e640 1 -- 172.21.15.87:0/4030955902 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580a97e0 con 0x7f50640ad160 2024-04-25T16:01:22.521 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506890e640 1 -- 172.21.15.87:0/4030955902 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580a9bb0 con 0x7f50640ad160 2024-04-25T16:01:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 -- 172.21.15.87:0/4030955902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640ad160 msgr2=0x7f50640c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 --2- 172.21.15.87:0/4030955902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640ad160 0x7f50640c40e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5058009870 tx=0x7f505801c560 comp rx=0 tx=0).stop 2024-04-25T16:01:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 -- 172.21.15.87:0/4030955902 shutdown_connections 2024-04-25T16:01:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 --2- 172.21.15.87:0/4030955902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640ad160 0x7f50640c40e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 --2- 172.21.15.87:0/4030955902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f506406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 -- 172.21.15.87:0/4030955902 >> 172.21.15.87:0/4030955902 conn(0x7f50640c8770 msgr2=0x7f50640c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 -- 172.21.15.87:0/4030955902 shutdown_connections 2024-04-25T16:01:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.520+0000 7f506bb74640 1 -- 172.21.15.87:0/4030955902 wait complete. 2024-04-25T16:01:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 Processor -- start 2024-04-25T16:01:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 -- start start 2024-04-25T16:01:22.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640ad160 0x7f50641492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 0x7f5064157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f5064155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5064161d60 con 0x7f50640c4620 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5064161be0 con 0x7f50640ad160 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5064161ee0 con 0x7f50641518b0 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 0x7f5064157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 0x7f5064157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55950/0 (socket says 172.21.15.87:55950) 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 -- 172.21.15.87:0/1104972524 learned_addr learned my addr 172.21.15.87:0/1104972524 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f5069910640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640ad160 0x7f50641492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506a111640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f5064155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 -- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 msgr2=0x7f5064155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f5064155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 -- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640ad160 msgr2=0x7f50641492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640ad160 0x7f50641492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 -- 172.21.15.87:0/1104972524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50641efe60 con 0x7f50640c4620 2024-04-25T16:01:22.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506910f640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 0x7f5064157060 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f505801ac10 tx=0x7f5058019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580b1800 con 0x7f50640c4620 2024-04-25T16:01:22.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580b19a0 con 0x7f50640c4620 2024-04-25T16:01:22.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580b1d90 con 0x7f50640c4620 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.524+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50640bda20 con 0x7f50640c4620 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50641efb80 con 0x7f50640c4620 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5064157b70 con 0x7f50640c4620 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50580bb3f0 con 0x7f50640c4620 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f50627fc640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f5069910640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f5058129e40 con 0x7f50640c4620 2024-04-25T16:01:22.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.528+0000 7f5069910640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f50640aad60 tx=0x7f505c009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.532+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5064157b70 con 0x7f50640c4620 2024-04-25T16:01:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.700+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f50640bd7d0 con 0x7f505006f430 2024-04-25T16:01:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.700+0000 7f50627fc640 1 -- 172.21.15.87:0/1104972524 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50640bd7d0 con 0x7f505006f430 2024-04-25T16:01:22.701 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 msgr2=0x7f5050071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f50640aad60 tx=0x7f505c009830 comp rx=0 tx=0).stop 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 msgr2=0x7f5064157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 0x7f5064157060 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f505801ac10 tx=0x7f5058019300 comp rx=0 tx=0).stop 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 shutdown_connections 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f505006f430 0x7f5050071940 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50641518b0 0x7f5064155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50640c4620 0x7f5064157060 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 --2- 172.21.15.87:0/1104972524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50640ad160 0x7f50641492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 >> 172.21.15.87:0/1104972524 conn(0x7f50640c8770 msgr2=0x7f50640ab400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 shutdown_connections 2024-04-25T16:01:22.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.704+0000 7f506bb74640 1 -- 172.21.15.87:0/1104972524 wait complete. 2024-04-25T16:01:22.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:01:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.868+0000 7ff902f1a640 1 Processor -- start 2024-04-25T16:01:22.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff902f1a640 1 -- start start 2024-04-25T16:01:22.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff902f1a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8fc071e50 0x7ff8fc0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff902f1a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc072430 con 0x7ff8fc1529a0 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff902f1a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc074730 con 0x7ff8fc0c4720 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff902f1a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff8fc074a10 con 0x7ff8fc071e50 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff8fbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8fc071e50 0x7ff8fc0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff900cb6640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff8fc1529a0 0x7ff8fc0ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:35246/0 (socket says 172.21.15.87:35246) 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff900cb6640 1 -- 172.21.15.87:0/2557268714 learned_addr learned my addr 172.21.15.87:0/2557268714 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff8fbfff640 1 -- 172.21.15.87:0/2557268714 >> v1:172.21.15.155:6789/0 conn(0x7ff8fc0c4720 legacy=0x7ff8fc15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff8fbfff640 1 -- 172.21.15.87:0/2557268714 >> v1:172.21.15.87:6789/0 conn(0x7ff8fc1529a0 legacy=0x7ff8fc0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.872+0000 7ff8fbfff640 1 -- 172.21.15.87:0/2557268714 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc074cf0 con 0x7ff8fc071e50 2024-04-25T16:01:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff8fbfff640 1 --2- 172.21.15.87:0/2557268714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc071e50 0x7ff8fc0c41e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00097c0 tx=0x7ff8f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131d877ba2ddb175 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff8fb7fe640 1 -- 172.21.15.87:0/2557268714 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00b0070 con 0x7ff8fc071e50 2024-04-25T16:01:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff8fb7fe640 1 -- 172.21.15.87:0/2557268714 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f00ab600 con 0x7ff8fc071e50 2024-04-25T16:01:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff8fb7fe640 1 -- 172.21.15.87:0/2557268714 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00a4e60 con 0x7ff8fc071e50 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 -- 172.21.15.87:0/2557268714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc071e50 msgr2=0x7ff8fc0c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2557268714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc071e50 0x7ff8fc0c41e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00097c0 tx=0x7ff8f001c3d0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 -- 172.21.15.87:0/2557268714 shutdown_connections 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2557268714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc071e50 0x7ff8fc0c41e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 -- 172.21.15.87:0/2557268714 >> 172.21.15.87:0/2557268714 conn(0x7ff8fc0c8770 msgr2=0x7ff8fc0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 -- 172.21.15.87:0/2557268714 shutdown_connections 2024-04-25T16:01:22.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 -- 172.21.15.87:0/2557268714 wait complete. 2024-04-25T16:01:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 Processor -- start 2024-04-25T16:01:22.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.876+0000 7ff902f1a640 1 -- start start 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc071e50 0x7ff8fc0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc0c4720 0x7ff8fc0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 0x7ff8fc1489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc163b90 con 0x7ff8fc1529a0 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc163a10 con 0x7ff8fc0c4720 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc163d10 con 0x7ff8fc071e50 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 0x7ff8fc1489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 0x7ff8fc1489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55970/0 (socket says 172.21.15.87:55970) 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 -- 172.21.15.87:0/2678273848 learned_addr learned my addr 172.21.15.87:0/2678273848 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8fbfff640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc0c4720 0x7ff8fc0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff900cb6640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc071e50 0x7ff8fc0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 -- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc071e50 msgr2=0x7ff8fc0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc071e50 0x7ff8fc0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 -- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc0c4720 msgr2=0x7ff8fc0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc0c4720 0x7ff8fc0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 -- 172.21.15.87:0/2678273848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc153d80 con 0x7ff8fc1529a0 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8fbfff640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc0c4720 0x7ff8fc0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff900cb6640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc071e50 0x7ff8fc0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff9014b7640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 0x7ff8fc1489d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400be90 tx=0x7ff8f400bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4019070 con 0x7ff8fc1529a0 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4014440 con 0x7ff8fc1529a0 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4014830 con 0x7ff8fc1529a0 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc1592a0 con 0x7ff8fc1529a0 2024-04-25T16:01:22.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc1584e0 con 0x7ff8fc1529a0 2024-04-25T16:01:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc069bb0 con 0x7ff8fc1529a0 2024-04-25T16:01:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff8f401c070 con 0x7ff8fc1529a0 2024-04-25T16:01:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8f97fa640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8e806f400 0x7ff8e8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff900cb6640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8e806f400 0x7ff8e8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:22.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.880+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7ff8f408fa40 con 0x7ff8fc1529a0 2024-04-25T16:01:22.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.884+0000 7ff900cb6640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8e806f400 0x7ff8e8071910 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec007fd0 tx=0x7ff8ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:22.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:22.884+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8f405c360 con 0x7ff8fc1529a0 2024-04-25T16:01:23.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.044+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8fc0c3760 con 0x7ff8e806f400 2024-04-25T16:01:23.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.060+0000 7ff8f97fa640 1 -- 172.21.15.87:0/2678273848 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494217 (secure 0 0 0) 0x7ff8fc0c3760 con 0x7ff8e806f400 2024-04-25T16:01:23.066 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:23.070 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8e806f400 msgr2=0x7ff8e8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8e806f400 0x7ff8e8071910 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec007fd0 tx=0x7ff8ec009040 comp rx=0 tx=0).stop 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 msgr2=0x7ff8fc1489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 0x7ff8fc1489d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400be90 tx=0x7ff8f400bf80 comp rx=0 tx=0).stop 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 shutdown_connections 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff8e806f400 0x7ff8e8071910 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8fc1529a0 0x7ff8fc1489d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8fc0c4720 0x7ff8fc0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 --2- 172.21.15.87:0/2678273848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8fc071e50 0x7ff8fc0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:23.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 >> 172.21.15.87:0/2678273848 conn(0x7ff8fc0c8770 msgr2=0x7ff8fc14f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:23.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 shutdown_connections 2024-04-25T16:01:23.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:23.064+0000 7ff902f1a640 1 -- 172.21.15.87:0/2678273848 wait complete. 2024-04-25T16:01:23.086 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-25T16:01:21.279873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269198364,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7045,"num_read_kb":3737333,"num_write":65538,"num_write_kb":9067848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71569,"ondisk_log_size":71569,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1176528,"kb_used_data":529040,"kb_used_omap":12,"kb_used_meta":647411,"kb_avail":753798192,"statfs":{"total":773094113280,"available":771889348608,"internally_reserved":0,"allocated":541736960,"data_stored":539899168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":662949425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":189,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004956"},"pg_stats":[{"pgid":"5.18","version":"31'448","reported_seq":541,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560090+0000","last_change":"2024-04-25T15:54:20.398123+0000","last_active":"2024-04-25T16:00:43.560090+0000","last_peered":"2024-04-25T16:00:43.560090+0000","last_clean":"2024-04-25T16:00:43.560090+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T16:00:43.560090+0000","last_undegraded":"2024-04-25T16:00:43.560090+0000","last_fullsized":"2024-04-25T16:00:43.560090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27881,"num_write":426,"num_write_kb":76310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"36'1437","reported_seq":1504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.593401+0000","last_change":"2024-04-25T15:54:09.218801+0000","last_active":"2024-04-25T16:00:51.593401+0000","last_peered":"2024-04-25T16:00:51.593401+0000","last_clean":"2024-04-25T16:00:51.593401+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T16:00:51.593401+0000","last_undegraded":"2024-04-25T16:00:51.593401+0000","last_fullsized":"2024-04-25T16:00:51.593401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":18411,"num_write":1381,"num_write_kb":5019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'392","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.695464+0000","last_change":"2024-04-25T15:54:10.251518+0000","last_active":"2024-04-25T16:00:51.695464+0000","last_peered":"2024-04-25T16:00:51.695464+0000","last_clean":"2024-04-25T16:00:51.695464+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T16:00:51.695464+0000","last_undegraded":"2024-04-25T16:00:51.695464+0000","last_fullsized":"2024-04-25T16:00:51.695464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12356,"num_write":363,"num_write_kb":47533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'229","reported_seq":271,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583062+0000","last_change":"2024-04-25T15:54:19.360764+0000","last_active":"2024-04-25T16:00:43.583062+0000","last_peered":"2024-04-25T16:00:43.583062+0000","last_clean":"2024-04-25T16:00:43.583062+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T16:00:43.583062+0000","last_undegraded":"2024-04-25T16:00:43.583062+0000","last_fullsized":"2024-04-25T16:00:43.583062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":183,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'392","reported_seq":484,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562446+0000","last_change":"2024-04-25T15:54:20.432039+0000","last_active":"2024-04-25T16:00:43.562446+0000","last_peered":"2024-04-25T16:00:43.562446+0000","last_clean":"2024-04-25T16:00:43.562446+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T16:00:43.562446+0000","last_undegraded":"2024-04-25T16:00:43.562446+0000","last_fullsized":"2024-04-25T16:00:43.562446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30984,"num_write":367,"num_write_kb":33760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"34'215","reported_seq":268,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.586373+0000","last_change":"2024-04-25T15:54:09.214174+0000","last_active":"2024-04-25T16:00:43.586373+0000","last_peered":"2024-04-25T16:00:43.586373+0000","last_clean":"2024-04-25T16:00:43.586373+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T16:00:43.586373+0000","last_undegraded":"2024-04-25T16:00:43.586373+0000","last_fullsized":"2024-04-25T16:00:43.586373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":163,"num_write_kb":4188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'349","reported_seq":413,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570978+0000","last_change":"2024-04-25T15:54:10.262256+0000","last_active":"2024-04-25T16:00:43.570978+0000","last_peered":"2024-04-25T16:00:43.570978+0000","last_clean":"2024-04-25T16:00:43.570978+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T16:00:43.570978+0000","last_undegraded":"2024-04-25T16:00:43.570978+0000","last_fullsized":"2024-04-25T16:00:43.570978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5423,"num_write":327,"num_write_kb":34935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'1396","reported_seq":1441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561108+0000","last_change":"2024-04-25T15:54:19.386307+0000","last_active":"2024-04-25T16:00:43.561108+0000","last_peered":"2024-04-25T16:00:43.561108+0000","last_clean":"2024-04-25T16:00:43.561108+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T16:00:43.561108+0000","last_undegraded":"2024-04-25T16:00:43.561108+0000","last_fullsized":"2024-04-25T16:00:43.561108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":1396,"log_dups_size":0,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1329,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"31'398","reported_seq":458,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576915+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T16:00:43.576915+0000","last_peered":"2024-04-25T16:00:43.576915+0000","last_clean":"2024-04-25T16:00:43.576915+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T16:00:43.576915+0000","last_undegraded":"2024-04-25T16:00:43.576915+0000","last_fullsized":"2024-04-25T16:00:43.576915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14376,"num_write":371,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"36'383","reported_seq":450,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681810+0000","last_change":"2024-04-25T15:54:09.225757+0000","last_active":"2024-04-25T16:00:51.681810+0000","last_peered":"2024-04-25T16:00:51.681810+0000","last_clean":"2024-04-25T16:00:51.681810+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T16:00:51.681810+0000","last_undegraded":"2024-04-25T16:00:51.681810+0000","last_fullsized":"2024-04-25T16:00:51.681810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":45080,"num_write":303,"num_write_kb":12463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'366","reported_seq":455,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.623210+0000","last_change":"2024-04-25T15:54:10.267474+0000","last_active":"2024-04-25T16:00:43.623210+0000","last_peered":"2024-04-25T16:00:43.623210+0000","last_clean":"2024-04-25T16:00:43.623210+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T16:00:43.623210+0000","last_undegraded":"2024-04-25T16:00:43.623210+0000","last_fullsized":"2024-04-25T16:00:43.623210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24540,"num_write":344,"num_write_kb":42834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'118","reported_seq":161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563312+0000","last_change":"2024-04-25T15:54:19.378231+0000","last_active":"2024-04-25T16:00:43.563312+0000","last_peered":"2024-04-25T16:00:43.563312+0000","last_clean":"2024-04-25T16:00:43.563312+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T16:00:43.563312+0000","last_undegraded":"2024-04-25T16:00:43.563312+0000","last_fullsized":"2024-04-25T16:00:43.563312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":59,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'379","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618798+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T16:00:43.618798+0000","last_peered":"2024-04-25T16:00:43.618798+0000","last_clean":"2024-04-25T16:00:43.618798+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T16:00:43.618798+0000","last_undegraded":"2024-04-25T16:00:43.618798+0000","last_fullsized":"2024-04-25T16:00:43.618798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17536,"num_write":366,"num_write_kb":55228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"36'361","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.625597+0000","last_change":"2024-04-25T15:54:09.222085+0000","last_active":"2024-04-25T16:00:51.625597+0000","last_peered":"2024-04-25T16:00:51.625597+0000","last_clean":"2024-04-25T16:00:51.625597+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T16:00:51.625597+0000","last_undegraded":"2024-04-25T16:00:51.625597+0000","last_fullsized":"2024-04-25T16:00:51.625597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":312,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'376","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.697044+0000","last_change":"2024-04-25T15:54:10.284555+0000","last_active":"2024-04-25T16:00:51.697044+0000","last_peered":"2024-04-25T16:00:51.697044+0000","last_clean":"2024-04-25T16:00:51.697044+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T16:00:51.697044+0000","last_undegraded":"2024-04-25T16:00:51.697044+0000","last_fullsized":"2024-04-25T16:00:51.697044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31362,"num_write":348,"num_write_kb":63308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'407","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566429+0000","last_change":"2024-04-25T15:54:19.374965+0000","last_active":"2024-04-25T16:00:43.566429+0000","last_peered":"2024-04-25T16:00:43.566429+0000","last_clean":"2024-04-25T16:00:43.566429+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T16:00:43.566429+0000","last_undegraded":"2024-04-25T16:00:43.566429+0000","last_fullsized":"2024-04-25T16:00:43.566429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:39.845692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":355,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'439","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563561+0000","last_change":"2024-04-25T15:54:20.426585+0000","last_active":"2024-04-25T16:00:43.563561+0000","last_peered":"2024-04-25T16:00:43.563561+0000","last_clean":"2024-04-25T16:00:43.563561+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T16:00:43.563561+0000","last_undegraded":"2024-04-25T16:00:43.563561+0000","last_fullsized":"2024-04-25T16:00:43.563561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15953,"num_write":415,"num_write_kb":91831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"36'454","reported_seq":581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708278+0000","last_change":"2024-04-25T15:54:10.259033+0000","last_active":"2024-04-25T16:00:51.708278+0000","last_peered":"2024-04-25T16:00:51.708278+0000","last_clean":"2024-04-25T16:00:51.708278+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T16:00:51.708278+0000","last_undegraded":"2024-04-25T16:00:51.708278+0000","last_fullsized":"2024-04-25T16:00:51.708278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:43.433896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":34259,"num_write":426,"num_write_kb":109355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'209","reported_seq":273,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.604101+0000","last_change":"2024-04-25T15:54:09.230248+0000","last_active":"2024-04-25T16:00:51.604101+0000","last_peered":"2024-04-25T16:00:51.604101+0000","last_clean":"2024-04-25T16:00:51.604101+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T16:00:51.604101+0000","last_undegraded":"2024-04-25T16:00:51.604101+0000","last_fullsized":"2024-04-25T16:00:51.604101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":32780,"num_write":144,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'517","reported_seq":566,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563985+0000","last_change":"2024-04-25T15:54:19.376492+0000","last_active":"2024-04-25T16:00:43.563985+0000","last_peered":"2024-04-25T16:00:43.563985+0000","last_clean":"2024-04-25T16:00:43.563985+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T16:00:43.563985+0000","last_undegraded":"2024-04-25T16:00:43.563985+0000","last_fullsized":"2024-04-25T16:00:43.563985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:12.929728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":469,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'399","reported_seq":479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558965+0000","last_change":"2024-04-25T15:54:20.416074+0000","last_active":"2024-04-25T16:00:43.558965+0000","last_peered":"2024-04-25T16:00:43.558965+0000","last_clean":"2024-04-25T16:00:43.558965+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T16:00:43.558965+0000","last_undegraded":"2024-04-25T16:00:43.558965+0000","last_fullsized":"2024-04-25T16:00:43.558965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:40.855957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":26873,"num_write":378,"num_write_kb":71246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"35'429","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584166+0000","last_change":"2024-04-25T15:54:10.243469+0000","last_active":"2024-04-25T16:00:43.584166+0000","last_peered":"2024-04-25T16:00:43.584166+0000","last_clean":"2024-04-25T16:00:43.584166+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T16:00:43.584166+0000","last_undegraded":"2024-04-25T16:00:43.584166+0000","last_fullsized":"2024-04-25T16:00:43.584166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42040,"num_write":408,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"34'200","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565925+0000","last_change":"2024-04-25T15:54:09.212438+0000","last_active":"2024-04-25T16:00:43.565925+0000","last_peered":"2024-04-25T16:00:43.565925+0000","last_clean":"2024-04-25T16:00:43.565925+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T16:00:43.565925+0000","last_undegraded":"2024-04-25T16:00:43.565925+0000","last_fullsized":"2024-04-25T16:00:43.565925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'60","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567637+0000","last_change":"2024-04-25T15:54:19.374774+0000","last_active":"2024-04-25T16:00:43.567637+0000","last_peered":"2024-04-25T16:00:43.567637+0000","last_clean":"2024-04-25T16:00:43.567637+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T16:00:43.567637+0000","last_undegraded":"2024-04-25T16:00:43.567637+0000","last_fullsized":"2024-04-25T16:00:43.567637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'380","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565677+0000","last_change":"2024-04-25T15:54:20.416239+0000","last_active":"2024-04-25T16:00:43.565677+0000","last_peered":"2024-04-25T16:00:43.565677+0000","last_clean":"2024-04-25T16:00:43.565677+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T16:00:43.565677+0000","last_undegraded":"2024-04-25T16:00:43.565677+0000","last_fullsized":"2024-04-25T16:00:43.565677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:51.730104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24884,"num_write":362,"num_write_kb":71575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"35'377","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585642+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T16:00:43.585642+0000","last_peered":"2024-04-25T16:00:43.585642+0000","last_clean":"2024-04-25T16:00:43.585642+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T16:00:43.585642+0000","last_undegraded":"2024-04-25T16:00:43.585642+0000","last_fullsized":"2024-04-25T16:00:43.585642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7657,"num_write":351,"num_write_kb":21765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'69","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564212+0000","last_change":"2024-04-25T15:54:09.212459+0000","last_active":"2024-04-25T16:00:43.564212+0000","last_peered":"2024-04-25T16:00:43.564212+0000","last_clean":"2024-04-25T16:00:43.564212+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T16:00:43.564212+0000","last_undegraded":"2024-04-25T16:00:43.564212+0000","last_fullsized":"2024-04-25T16:00:43.564212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'194","reported_seq":241,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:19.372512+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":146,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"31'395","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620509+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T16:00:43.620509+0000","last_peered":"2024-04-25T16:00:43.620509+0000","last_clean":"2024-04-25T16:00:43.620509+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T16:00:43.620509+0000","last_undegraded":"2024-04-25T16:00:43.620509+0000","last_fullsized":"2024-04-25T16:00:43.620509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23834,"num_write":371,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"36'432","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699888+0000","last_change":"2024-04-25T15:54:10.238066+0000","last_active":"2024-04-25T16:00:51.699888+0000","last_peered":"2024-04-25T16:00:51.699888+0000","last_clean":"2024-04-25T16:00:51.699888+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T16:00:51.699888+0000","last_undegraded":"2024-04-25T16:00:51.699888+0000","last_fullsized":"2024-04-25T16:00:51.699888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:43.819144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1051,"num_write":404,"num_write_kb":46183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"35'633","reported_seq":685,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.573910+0000","last_change":"2024-04-25T15:54:09.220790+0000","last_active":"2024-04-25T16:00:43.573910+0000","last_peered":"2024-04-25T16:00:43.573910+0000","last_clean":"2024-04-25T16:00:43.573910+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T16:00:43.573910+0000","last_undegraded":"2024-04-25T16:00:43.573910+0000","last_fullsized":"2024-04-25T16:00:43.573910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":576,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'339","reported_seq":387,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566182+0000","last_change":"2024-04-25T15:54:19.385655+0000","last_active":"2024-04-25T16:00:43.566182+0000","last_peered":"2024-04-25T16:00:43.566182+0000","last_clean":"2024-04-25T16:00:43.566182+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T16:00:43.566182+0000","last_undegraded":"2024-04-25T16:00:43.566182+0000","last_fullsized":"2024-04-25T16:00:43.566182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:15.393677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":287,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"31'408","reported_seq":519,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582757+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T16:00:43.582757+0000","last_peered":"2024-04-25T16:00:43.582757+0000","last_clean":"2024-04-25T16:00:43.582757+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T16:00:43.582757+0000","last_undegraded":"2024-04-25T16:00:43.582757+0000","last_fullsized":"2024-04-25T16:00:43.582757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":22153,"num_write":390,"num_write_kb":51497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"36'445","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702477+0000","last_change":"2024-04-25T15:54:10.239248+0000","last_active":"2024-04-25T16:00:51.702477+0000","last_peered":"2024-04-25T16:00:51.702477+0000","last_clean":"2024-04-25T16:00:51.702477+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T16:00:51.702477+0000","last_undegraded":"2024-04-25T16:00:51.702477+0000","last_fullsized":"2024-04-25T16:00:51.702477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9563,"num_write":414,"num_write_kb":59478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'72","reported_seq":130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.629231+0000","last_change":"2024-04-25T15:54:09.220332+0000","last_active":"2024-04-25T16:00:51.629231+0000","last_peered":"2024-04-25T16:00:51.629231+0000","last_clean":"2024-04-25T16:00:51.629231+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T16:00:51.629231+0000","last_undegraded":"2024-04-25T16:00:51.629231+0000","last_fullsized":"2024-04-25T16:00:51.629231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'291","reported_seq":548,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561716+0000","last_change":"2024-04-25T15:54:19.389351+0000","last_active":"2024-04-25T16:00:43.561716+0000","last_peered":"2024-04-25T16:00:43.561716+0000","last_clean":"2024-04-25T16:00:43.561716+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T16:00:43.561716+0000","last_undegraded":"2024-04-25T16:00:43.561716+0000","last_fullsized":"2024-04-25T16:00:43.561716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:49.302852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465994,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":1569,"num_write":227,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"31'396","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559745+0000","last_change":"2024-04-25T15:54:20.418134+0000","last_active":"2024-04-25T16:00:43.559745+0000","last_peered":"2024-04-25T16:00:43.559745+0000","last_clean":"2024-04-25T16:00:43.559745+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T16:00:43.559745+0000","last_undegraded":"2024-04-25T16:00:43.559745+0000","last_fullsized":"2024-04-25T16:00:43.559745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17201,"num_write":368,"num_write_kb":116540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'348","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584481+0000","last_change":"2024-04-25T15:54:10.253911+0000","last_active":"2024-04-25T16:00:43.584481+0000","last_peered":"2024-04-25T16:00:43.584481+0000","last_clean":"2024-04-25T16:00:43.584481+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T16:00:43.584481+0000","last_undegraded":"2024-04-25T16:00:43.584481+0000","last_fullsized":"2024-04-25T16:00:43.584481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11261,"num_write":326,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"36'220","reported_seq":277,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707128+0000","last_change":"2024-04-25T15:54:09.213520+0000","last_active":"2024-04-25T16:00:51.707128+0000","last_peered":"2024-04-25T16:00:51.707128+0000","last_clean":"2024-04-25T16:00:51.707128+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T16:00:51.707128+0000","last_undegraded":"2024-04-25T16:00:51.707128+0000","last_fullsized":"2024-04-25T16:00:51.707128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":264,"num_write":447,"num_write_kb":1604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"35'415","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582806+0000","last_change":"2024-04-25T15:54:19.383216+0000","last_active":"2024-04-25T16:00:43.582806+0000","last_peered":"2024-04-25T16:00:43.582806+0000","last_clean":"2024-04-25T16:00:43.582806+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T16:00:43.582806+0000","last_undegraded":"2024-04-25T16:00:43.582806+0000","last_fullsized":"2024-04-25T16:00:43.582806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":348,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"31'355","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569759+0000","last_change":"2024-04-25T15:54:20.415761+0000","last_active":"2024-04-25T16:00:43.569759+0000","last_peered":"2024-04-25T16:00:43.569759+0000","last_clean":"2024-04-25T16:00:43.569759+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T16:00:43.569759+0000","last_undegraded":"2024-04-25T16:00:43.569759+0000","last_fullsized":"2024-04-25T16:00:43.569759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.397414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":811,"num_write":334,"num_write_kb":50274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"36'395","reported_seq":478,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691697+0000","last_change":"2024-04-25T15:54:10.243898+0000","last_active":"2024-04-25T16:00:51.691697+0000","last_peered":"2024-04-25T16:00:51.691697+0000","last_clean":"2024-04-25T16:00:51.691697+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T16:00:51.691697+0000","last_undegraded":"2024-04-25T16:00:51.691697+0000","last_fullsized":"2024-04-25T16:00:51.691697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17222,"num_write":367,"num_write_kb":107915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'211","reported_seq":262,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:46.021660+0000","last_change":"2024-04-25T15:54:09.223931+0000","last_active":"2024-04-25T16:00:46.021660+0000","last_peered":"2024-04-25T16:00:46.021660+0000","last_clean":"2024-04-25T16:00:46.021660+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T16:00:46.021660+0000","last_undegraded":"2024-04-25T16:00:46.021660+0000","last_fullsized":"2024-04-25T16:00:46.021660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:12.909469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":156,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'73","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567937+0000","last_change":"2024-04-25T15:54:19.390104+0000","last_active":"2024-04-25T16:00:43.567937+0000","last_peered":"2024-04-25T16:00:43.567937+0000","last_clean":"2024-04-25T16:00:43.567937+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T16:00:43.567937+0000","last_undegraded":"2024-04-25T16:00:43.567937+0000","last_fullsized":"2024-04-25T16:00:43.567937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'419","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569029+0000","last_change":"2024-04-25T15:54:20.435147+0000","last_active":"2024-04-25T16:00:43.569029+0000","last_peered":"2024-04-25T16:00:43.569029+0000","last_clean":"2024-04-25T16:00:43.569029+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T16:00:43.569029+0000","last_undegraded":"2024-04-25T16:00:43.569029+0000","last_fullsized":"2024-04-25T16:00:43.569029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":27915,"num_write":400,"num_write_kb":113619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'436","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.703284+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T16:00:51.703284+0000","last_peered":"2024-04-25T16:00:51.703284+0000","last_clean":"2024-04-25T16:00:51.703284+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T16:00:51.703284+0000","last_undegraded":"2024-04-25T16:00:51.703284+0000","last_fullsized":"2024-04-25T16:00:51.703284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48041,"num_write":405,"num_write_kb":79758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'60","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564266+0000","last_change":"2024-04-25T15:54:09.217572+0000","last_active":"2024-04-25T16:00:43.564266+0000","last_peered":"2024-04-25T16:00:43.564266+0000","last_clean":"2024-04-25T16:00:43.564266+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T16:00:43.564266+0000","last_undegraded":"2024-04-25T16:00:43.564266+0000","last_fullsized":"2024-04-25T16:00:43.564266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:39.477208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'647","reported_seq":695,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564966+0000","last_change":"2024-04-25T15:54:19.389608+0000","last_active":"2024-04-25T16:00:43.564966+0000","last_peered":"2024-04-25T16:00:43.564966+0000","last_clean":"2024-04-25T16:00:43.564966+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T16:00:43.564966+0000","last_undegraded":"2024-04-25T16:00:43.564966+0000","last_fullsized":"2024-04-25T16:00:43.564966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":21962,"num_write":588,"num_write_kb":8473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'398","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570717+0000","last_change":"2024-04-25T15:54:20.432740+0000","last_active":"2024-04-25T16:00:43.570717+0000","last_peered":"2024-04-25T16:00:43.570717+0000","last_clean":"2024-04-25T16:00:43.570717+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T16:00:43.570717+0000","last_undegraded":"2024-04-25T16:00:43.570717+0000","last_fullsized":"2024-04-25T16:00:43.570717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:31.656025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18043,"num_write":367,"num_write_kb":54591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'382","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565930+0000","last_change":"2024-04-25T15:54:10.238049+0000","last_active":"2024-04-25T16:00:43.565930+0000","last_peered":"2024-04-25T16:00:43.565930+0000","last_clean":"2024-04-25T16:00:43.565930+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T16:00:43.565930+0000","last_undegraded":"2024-04-25T16:00:43.565930+0000","last_fullsized":"2024-04-25T16:00:43.565930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:55.283651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":351,"num_write_kb":26238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"34'641","reported_seq":698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.630615+0000","last_change":"2024-04-25T15:54:09.219652+0000","last_active":"2024-04-25T16:00:43.630615+0000","last_peered":"2024-04-25T16:00:43.630615+0000","last_clean":"2024-04-25T16:00:43.630615+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T16:00:43.630615+0000","last_undegraded":"2024-04-25T16:00:43.630615+0000","last_fullsized":"2024-04-25T16:00:43.630615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:54.274956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":575,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'63","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563762+0000","last_change":"2024-04-25T15:54:19.376310+0000","last_active":"2024-04-25T16:00:43.563762+0000","last_peered":"2024-04-25T16:00:43.563762+0000","last_clean":"2024-04-25T16:00:43.563762+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T16:00:43.563762+0000","last_undegraded":"2024-04-25T16:00:43.563762+0000","last_fullsized":"2024-04-25T16:00:43.563762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:40.740191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'417","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559349+0000","last_change":"2024-04-25T15:54:20.415569+0000","last_active":"2024-04-25T16:00:43.559349+0000","last_peered":"2024-04-25T16:00:43.559349+0000","last_clean":"2024-04-25T16:00:43.559349+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T16:00:43.559349+0000","last_undegraded":"2024-04-25T16:00:43.559349+0000","last_fullsized":"2024-04-25T16:00:43.559349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:41.782395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":4695,"num_write":394,"num_write_kb":63230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'383","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562973+0000","last_change":"2024-04-25T15:54:10.243188+0000","last_active":"2024-04-25T16:00:43.562973+0000","last_peered":"2024-04-25T16:00:43.562973+0000","last_clean":"2024-04-25T16:00:43.562973+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T16:00:43.562973+0000","last_undegraded":"2024-04-25T16:00:43.562973+0000","last_fullsized":"2024-04-25T16:00:43.562973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":357,"num_write_kb":25875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'325","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.575494+0000","last_change":"2024-04-25T15:54:09.197505+0000","last_active":"2024-04-25T16:00:53.575494+0000","last_peered":"2024-04-25T16:00:53.575494+0000","last_clean":"2024-04-25T16:00:53.575494+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T16:00:53.575494+0000","last_undegraded":"2024-04-25T16:00:53.575494+0000","last_fullsized":"2024-04-25T16:00:53.575494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":1598,"num_write":259,"num_write_kb":1606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'73","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564080+0000","last_change":"2024-04-25T15:54:19.394053+0000","last_active":"2024-04-25T16:00:43.564080+0000","last_peered":"2024-04-25T16:00:43.564080+0000","last_clean":"2024-04-25T16:00:43.564080+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T16:00:43.564080+0000","last_undegraded":"2024-04-25T16:00:43.564080+0000","last_fullsized":"2024-04-25T16:00:43.564080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'351","reported_seq":443,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621988+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T16:00:43.621988+0000","last_peered":"2024-04-25T16:00:43.621988+0000","last_clean":"2024-04-25T16:00:43.621988+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T16:00:43.621988+0000","last_undegraded":"2024-04-25T16:00:43.621988+0000","last_fullsized":"2024-04-25T16:00:43.621988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19848,"num_write":332,"num_write_kb":34180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"36'414","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.688373+0000","last_change":"2024-04-25T15:54:10.233768+0000","last_active":"2024-04-25T16:00:51.688373+0000","last_peered":"2024-04-25T16:00:51.688373+0000","last_clean":"2024-04-25T16:00:51.688373+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T16:00:51.688373+0000","last_undegraded":"2024-04-25T16:00:51.688373+0000","last_fullsized":"2024-04-25T16:00:51.688373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:38.929410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":27907,"num_write":382,"num_write_kb":96848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'587","reported_seq":645,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.768045+0000","last_change":"2024-04-25T15:54:09.211200+0000","last_active":"2024-04-25T16:00:43.768045+0000","last_peered":"2024-04-25T16:00:43.768045+0000","last_clean":"2024-04-25T16:00:43.768045+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T16:00:43.768045+0000","last_undegraded":"2024-04-25T16:00:43.768045+0000","last_fullsized":"2024-04-25T16:00:43.768045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":32151,"num_write":527,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'238","reported_seq":285,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571711+0000","last_change":"2024-04-25T15:54:19.377961+0000","last_active":"2024-04-25T16:00:43.571711+0000","last_peered":"2024-04-25T16:00:43.571711+0000","last_clean":"2024-04-25T16:00:43.571711+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T16:00:43.571711+0000","last_undegraded":"2024-04-25T16:00:43.571711+0000","last_fullsized":"2024-04-25T16:00:43.571711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.286835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":156,"num_write":459,"num_write_kb":1609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'379","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.580092+0000","last_change":"2024-04-25T15:54:20.426090+0000","last_active":"2024-04-25T16:00:43.580092+0000","last_peered":"2024-04-25T16:00:43.580092+0000","last_clean":"2024-04-25T16:00:43.580092+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T16:00:43.580092+0000","last_undegraded":"2024-04-25T16:00:43.580092+0000","last_fullsized":"2024-04-25T16:00:43.580092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":4720,"num_write":350,"num_write_kb":42976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'353","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642061+0000","last_change":"2024-04-25T15:54:10.286928+0000","last_active":"2024-04-25T16:00:51.642061+0000","last_peered":"2024-04-25T16:00:51.642061+0000","last_clean":"2024-04-25T16:00:51.642061+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T16:00:51.642061+0000","last_undegraded":"2024-04-25T16:00:51.642061+0000","last_fullsized":"2024-04-25T16:00:51.642061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27299,"num_write":333,"num_write_kb":58716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.656733+0000","last_change":"2024-04-25T15:54:09.218320+0000","last_active":"2024-04-25T16:00:51.656733+0000","last_peered":"2024-04-25T16:00:51.656733+0000","last_clean":"2024-04-25T16:00:51.656733+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T16:00:51.656733+0000","last_undegraded":"2024-04-25T16:00:51.656733+0000","last_fullsized":"2024-04-25T16:00:51.656733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.577654+0000","last_change":"2024-04-25T15:53:58.801052+0000","last_active":"2024-04-25T16:00:43.577654+0000","last_peered":"2024-04-25T16:00:43.577654+0000","last_clean":"2024-04-25T16:00:43.577654+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T16:00:43.577654+0000","last_undegraded":"2024-04-25T16:00:43.577654+0000","last_fullsized":"2024-04-25T16:00:43.577654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:53:57.389108+0000","last_clean_scrub_stamp":"2024-04-25T15:53:57.389108+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:10.048780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'208","reported_seq":251,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561781+0000","last_change":"2024-04-25T15:54:19.386441+0000","last_active":"2024-04-25T16:00:43.561781+0000","last_peered":"2024-04-25T16:00:43.561781+0000","last_clean":"2024-04-25T16:00:43.561781+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T16:00:43.561781+0000","last_undegraded":"2024-04-25T16:00:43.561781+0000","last_fullsized":"2024-04-25T16:00:43.561781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:40.772130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":141,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"31'402","reported_seq":508,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558941+0000","last_change":"2024-04-25T15:54:20.429341+0000","last_active":"2024-04-25T16:00:43.558941+0000","last_peered":"2024-04-25T16:00:43.558941+0000","last_clean":"2024-04-25T16:00:43.558941+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T16:00:43.558941+0000","last_undegraded":"2024-04-25T16:00:43.558941+0000","last_fullsized":"2024-04-25T16:00:43.558941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:59.618789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45941,"num_write":380,"num_write_kb":54783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'411","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.579623+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T16:00:43.579623+0000","last_peered":"2024-04-25T16:00:43.579623+0000","last_clean":"2024-04-25T16:00:43.579623+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T16:00:43.579623+0000","last_undegraded":"2024-04-25T16:00:43.579623+0000","last_fullsized":"2024-04-25T16:00:43.579623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:07.912006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37252,"num_write":394,"num_write_kb":96094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'63","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707798+0000","last_change":"2024-04-25T15:54:09.223060+0000","last_active":"2024-04-25T16:00:51.707798+0000","last_peered":"2024-04-25T16:00:51.707798+0000","last_clean":"2024-04-25T16:00:51.707798+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T16:00:51.707798+0000","last_undegraded":"2024-04-25T16:00:51.707798+0000","last_fullsized":"2024-04-25T16:00:51.707798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'123","reported_seq":166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571142+0000","last_change":"2024-04-25T15:54:19.380125+0000","last_active":"2024-04-25T16:00:43.571142+0000","last_peered":"2024-04-25T16:00:43.571142+0000","last_clean":"2024-04-25T16:00:43.571142+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T16:00:43.571142+0000","last_undegraded":"2024-04-25T16:00:43.571142+0000","last_fullsized":"2024-04-25T16:00:43.571142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:41.261233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":75,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'444","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557697+0000","last_change":"2024-04-25T15:54:20.413073+0000","last_active":"2024-04-25T16:00:43.557697+0000","last_peered":"2024-04-25T16:00:43.557697+0000","last_clean":"2024-04-25T16:00:43.557697+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T16:00:43.557697+0000","last_undegraded":"2024-04-25T16:00:43.557697+0000","last_fullsized":"2024-04-25T16:00:43.557697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:13.939993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13011,"num_write":414,"num_write_kb":80257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'435","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698098+0000","last_change":"2024-04-25T15:54:50.212257+0000","last_active":"2024-04-25T16:00:51.698098+0000","last_peered":"2024-04-25T16:00:51.698098+0000","last_clean":"2024-04-25T16:00:51.698098+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T16:00:51.698098+0000","last_undegraded":"2024-04-25T16:00:51.698098+0000","last_fullsized":"2024-04-25T16:00:51.698098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:31.880839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14130,"num_write":408,"num_write_kb":39042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"34'575","reported_seq":633,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.258432+0000","last_change":"2024-04-25T15:54:09.209128+0000","last_active":"2024-04-25T16:00:44.258432+0000","last_peered":"2024-04-25T16:00:44.258432+0000","last_clean":"2024-04-25T16:00:44.258432+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T16:00:44.258432+0000","last_undegraded":"2024-04-25T16:00:44.258432+0000","last_fullsized":"2024-04-25T16:00:44.258432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":521,"num_write_kb":4332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'140","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567182+0000","last_change":"2024-04-25T15:54:19.379154+0000","last_active":"2024-04-25T16:00:43.567182+0000","last_peered":"2024-04-25T16:00:43.567182+0000","last_clean":"2024-04-25T16:00:43.567182+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T16:00:43.567182+0000","last_undegraded":"2024-04-25T16:00:43.567182+0000","last_fullsized":"2024-04-25T16:00:43.567182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:42.285402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":20488,"num_write":73,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"31'446","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569564+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T16:00:43.569564+0000","last_peered":"2024-04-25T16:00:43.569564+0000","last_clean":"2024-04-25T16:00:43.569564+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T16:00:43.569564+0000","last_undegraded":"2024-04-25T16:00:43.569564+0000","last_fullsized":"2024-04-25T16:00:43.569564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17909,"num_write":426,"num_write_kb":58918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'390","reported_seq":513,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.708088+0000","last_change":"2024-04-25T15:54:10.299277+0000","last_active":"2024-04-25T16:00:51.708088+0000","last_peered":"2024-04-25T16:00:51.708088+0000","last_clean":"2024-04-25T16:00:51.708088+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T16:00:51.708088+0000","last_undegraded":"2024-04-25T16:00:51.708088+0000","last_fullsized":"2024-04-25T16:00:51.708088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:33.133816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39208,"num_write":362,"num_write_kb":67602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"34'283","reported_seq":344,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.627686+0000","last_change":"2024-04-25T15:54:09.197211+0000","last_active":"2024-04-25T16:00:51.627686+0000","last_peered":"2024-04-25T16:00:51.627686+0000","last_clean":"2024-04-25T16:00:51.627686+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T16:00:51.627686+0000","last_undegraded":"2024-04-25T16:00:51.627686+0000","last_fullsized":"2024-04-25T16:00:51.627686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":236,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'548","reported_seq":593,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618215+0000","last_change":"2024-04-25T15:54:19.387101+0000","last_active":"2024-04-25T16:00:43.618215+0000","last_peered":"2024-04-25T16:00:43.618215+0000","last_clean":"2024-04-25T16:00:43.618215+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T16:00:43.618215+0000","last_undegraded":"2024-04-25T16:00:43.618215+0000","last_fullsized":"2024-04-25T16:00:43.618215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:54.920960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":499,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'422","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557173+0000","last_change":"2024-04-25T15:54:20.410072+0000","last_active":"2024-04-25T16:00:43.557173+0000","last_peered":"2024-04-25T16:00:43.557173+0000","last_clean":"2024-04-25T16:00:43.557173+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T16:00:43.557173+0000","last_undegraded":"2024-04-25T16:00:43.557173+0000","last_fullsized":"2024-04-25T16:00:43.557173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:50.313117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25440,"num_write":402,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'355","reported_seq":434,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706853+0000","last_change":"2024-04-25T15:54:10.291289+0000","last_active":"2024-04-25T16:00:51.706853+0000","last_peered":"2024-04-25T16:00:51.706853+0000","last_clean":"2024-04-25T16:00:51.706853+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T16:00:51.706853+0000","last_undegraded":"2024-04-25T16:00:51.706853+0000","last_fullsized":"2024-04-25T16:00:51.706853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21419,"num_write":332,"num_write_kb":54133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'185","reported_seq":243,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.657326+0000","last_change":"2024-04-25T15:54:09.214464+0000","last_active":"2024-04-25T16:00:51.657326+0000","last_peered":"2024-04-25T16:00:51.657326+0000","last_clean":"2024-04-25T16:00:51.657326+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T16:00:51.657326+0000","last_undegraded":"2024-04-25T16:00:51.657326+0000","last_fullsized":"2024-04-25T16:00:51.657326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:44:06.572747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":131,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"35'55","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.561316+0000","last_change":"2024-04-25T15:54:19.370547+0000","last_active":"2024-04-25T16:00:43.561316+0000","last_peered":"2024-04-25T16:00:43.561316+0000","last_clean":"2024-04-25T16:00:43.561316+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T16:00:43.561316+0000","last_undegraded":"2024-04-25T16:00:43.561316+0000","last_fullsized":"2024-04-25T16:00:43.561316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:00.270077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"31'370","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583347+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T16:00:43.583347+0000","last_peered":"2024-04-25T16:00:43.583347+0000","last_clean":"2024-04-25T16:00:43.583347+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T16:00:43.583347+0000","last_undegraded":"2024-04-25T16:00:43.583347+0000","last_fullsized":"2024-04-25T16:00:43.583347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:18.309269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":42885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'464","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691773+0000","last_change":"2024-04-25T15:54:10.291900+0000","last_active":"2024-04-25T16:00:51.691773+0000","last_peered":"2024-04-25T16:00:51.691773+0000","last_clean":"2024-04-25T16:00:51.691773+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T16:00:51.691773+0000","last_undegraded":"2024-04-25T16:00:51.691773+0000","last_fullsized":"2024-04-25T16:00:51.691773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:32.109647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":34229,"num_write":431,"num_write_kb":50975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'302","reported_seq":391,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:53.577775+0000","last_change":"2024-04-25T15:54:09.191113+0000","last_active":"2024-04-25T16:00:53.577775+0000","last_peered":"2024-04-25T16:00:53.577775+0000","last_clean":"2024-04-25T16:00:53.577775+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T16:00:53.577775+0000","last_undegraded":"2024-04-25T16:00:53.577775+0000","last_fullsized":"2024-04-25T16:00:53.577775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":5709,"num_write":249,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'222","reported_seq":264,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571367+0000","last_change":"2024-04-25T15:54:19.373525+0000","last_active":"2024-04-25T16:00:43.571367+0000","last_peered":"2024-04-25T16:00:43.571367+0000","last_clean":"2024-04-25T16:00:43.571367+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T16:00:43.571367+0000","last_undegraded":"2024-04-25T16:00:43.571367+0000","last_fullsized":"2024-04-25T16:00:43.571367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:58.608524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":181,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'411","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619711+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T16:00:43.619711+0000","last_peered":"2024-04-25T16:00:43.619711+0000","last_clean":"2024-04-25T16:00:43.619711+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T16:00:43.619711+0000","last_undegraded":"2024-04-25T16:00:43.619711+0000","last_fullsized":"2024-04-25T16:00:43.619711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4854,"num_write":381,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"36'439","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676434+0000","last_change":"2024-04-25T15:54:10.250326+0000","last_active":"2024-04-25T16:00:51.676434+0000","last_peered":"2024-04-25T16:00:51.676434+0000","last_clean":"2024-04-25T16:00:51.676434+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T16:00:51.676434+0000","last_undegraded":"2024-04-25T16:00:51.676434+0000","last_fullsized":"2024-04-25T16:00:51.676434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15516,"num_write":414,"num_write_kb":67395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'66","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562151+0000","last_change":"2024-04-25T15:54:09.208240+0000","last_active":"2024-04-25T16:00:43.562151+0000","last_peered":"2024-04-25T16:00:43.562151+0000","last_clean":"2024-04-25T16:00:43.562151+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T16:00:43.562151+0000","last_undegraded":"2024-04-25T16:00:43.562151+0000","last_fullsized":"2024-04-25T16:00:43.562151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'72","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583932+0000","last_change":"2024-04-25T15:54:19.383285+0000","last_active":"2024-04-25T16:00:43.583932+0000","last_peered":"2024-04-25T16:00:43.583932+0000","last_clean":"2024-04-25T16:00:43.583932+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T16:00:43.583932+0000","last_undegraded":"2024-04-25T16:00:43.583932+0000","last_fullsized":"2024-04-25T16:00:43.583932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:46.700886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'400","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619036+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T16:00:43.619036+0000","last_peered":"2024-04-25T16:00:43.619036+0000","last_clean":"2024-04-25T16:00:43.619036+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T16:00:43.619036+0000","last_undegraded":"2024-04-25T16:00:43.619036+0000","last_fullsized":"2024-04-25T16:00:43.619036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39850,"num_write":370,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"36'407","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.691312+0000","last_change":"2024-04-25T15:54:10.291661+0000","last_active":"2024-04-25T16:00:51.691312+0000","last_peered":"2024-04-25T16:00:51.691312+0000","last_clean":"2024-04-25T16:00:51.691312+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T16:00:51.691312+0000","last_undegraded":"2024-04-25T16:00:51.691312+0000","last_fullsized":"2024-04-25T16:00:51.691312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":33246,"num_write":383,"num_write_kb":97231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"36'72","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.704437+0000","last_change":"2024-04-25T15:54:09.219088+0000","last_active":"2024-04-25T16:00:51.704437+0000","last_peered":"2024-04-25T16:00:51.704437+0000","last_clean":"2024-04-25T16:00:51.704437+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T16:00:51.704437+0000","last_undegraded":"2024-04-25T16:00:51.704437+0000","last_fullsized":"2024-04-25T16:00:51.704437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'282","reported_seq":345,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583847+0000","last_change":"2024-04-25T15:54:19.372557+0000","last_active":"2024-04-25T16:00:43.583847+0000","last_peered":"2024-04-25T16:00:43.583847+0000","last_clean":"2024-04-25T16:00:43.583847+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T16:00:43.583847+0000","last_undegraded":"2024-04-25T16:00:43.583847+0000","last_fullsized":"2024-04-25T16:00:43.583847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:41.032425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":28701,"num_write":224,"num_write_kb":12419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'384","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583585+0000","last_change":"2024-04-25T15:54:20.404132+0000","last_active":"2024-04-25T16:00:43.583585+0000","last_peered":"2024-04-25T16:00:43.583585+0000","last_clean":"2024-04-25T16:00:43.583585+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T16:00:43.583585+0000","last_undegraded":"2024-04-25T16:00:43.583585+0000","last_fullsized":"2024-04-25T16:00:43.583585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:55.371808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13411,"num_write":356,"num_write_kb":100243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'415","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.700278+0000","last_change":"2024-04-25T15:54:10.255549+0000","last_active":"2024-04-25T16:00:51.700278+0000","last_peered":"2024-04-25T16:00:51.700278+0000","last_clean":"2024-04-25T16:00:51.700278+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T16:00:51.700278+0000","last_undegraded":"2024-04-25T16:00:51.700278+0000","last_fullsized":"2024-04-25T16:00:51.700278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:13.963370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13518,"num_write":393,"num_write_kb":67403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"34'925","reported_seq":993,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.592078+0000","last_change":"2024-04-25T15:54:09.230106+0000","last_active":"2024-04-25T16:00:51.592078+0000","last_peered":"2024-04-25T16:00:51.592078+0000","last_clean":"2024-04-25T16:00:51.592078+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T16:00:51.592078+0000","last_undegraded":"2024-04-25T16:00:51.592078+0000","last_fullsized":"2024-04-25T16:00:51.592078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:25.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":28720,"num_write":874,"num_write_kb":8730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"35'142","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620409+0000","last_change":"2024-04-25T15:54:19.388570+0000","last_active":"2024-04-25T16:00:43.620409+0000","last_peered":"2024-04-25T16:00:43.620409+0000","last_clean":"2024-04-25T16:00:43.620409+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T16:00:43.620409+0000","last_undegraded":"2024-04-25T16:00:43.620409+0000","last_fullsized":"2024-04-25T16:00:43.620409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:25.899783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":97,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"31'366","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583348+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T16:00:43.583348+0000","last_peered":"2024-04-25T16:00:43.583348+0000","last_clean":"2024-04-25T16:00:43.583348+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T16:00:43.583348+0000","last_undegraded":"2024-04-25T16:00:43.583348+0000","last_fullsized":"2024-04-25T16:00:43.583348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:29.202297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6536,"num_write":348,"num_write_kb":51835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"36'411","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705945+0000","last_change":"2024-04-25T15:54:10.292573+0000","last_active":"2024-04-25T16:00:51.705945+0000","last_peered":"2024-04-25T16:00:51.705945+0000","last_clean":"2024-04-25T16:00:51.705945+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T16:00:51.705945+0000","last_undegraded":"2024-04-25T16:00:51.705945+0000","last_fullsized":"2024-04-25T16:00:51.705945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12973,"num_write":382,"num_write_kb":67863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'342","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.624046+0000","last_change":"2024-04-25T15:54:09.199297+0000","last_active":"2024-04-25T16:00:51.624046+0000","last_peered":"2024-04-25T16:00:51.624046+0000","last_clean":"2024-04-25T16:00:51.624046+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T16:00:51.624046+0000","last_undegraded":"2024-04-25T16:00:51.624046+0000","last_fullsized":"2024-04-25T16:00:51.624046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:02.017705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":41004,"num_write":293,"num_write_kb":12450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'62","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564629+0000","last_change":"2024-04-25T15:54:19.373431+0000","last_active":"2024-04-25T16:00:43.564629+0000","last_peered":"2024-04-25T16:00:43.564629+0000","last_clean":"2024-04-25T16:00:43.564629+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T16:00:43.564629+0000","last_undegraded":"2024-04-25T16:00:43.564629+0000","last_fullsized":"2024-04-25T16:00:43.564629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'409","reported_seq":505,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565353+0000","last_change":"2024-04-25T15:54:20.421886+0000","last_active":"2024-04-25T16:00:43.565353+0000","last_peered":"2024-04-25T16:00:43.565353+0000","last_clean":"2024-04-25T16:00:43.565353+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T16:00:43.565353+0000","last_undegraded":"2024-04-25T16:00:43.565353+0000","last_fullsized":"2024-04-25T16:00:43.565353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30743,"num_write":387,"num_write_kb":71898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'393","reported_seq":487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684817+0000","last_change":"2024-04-25T15:54:10.258138+0000","last_active":"2024-04-25T16:00:51.684817+0000","last_peered":"2024-04-25T16:00:51.684817+0000","last_clean":"2024-04-25T16:00:51.684817+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T16:00:51.684817+0000","last_undegraded":"2024-04-25T16:00:51.684817+0000","last_fullsized":"2024-04-25T16:00:51.684817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24508,"num_write":369,"num_write_kb":63737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'210","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:57.872968+0000","last_change":"2024-04-25T15:54:09.222392+0000","last_active":"2024-04-25T16:00:57.872968+0000","last_peered":"2024-04-25T16:00:57.872968+0000","last_clean":"2024-04-25T16:00:57.872968+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T16:00:57.872968+0000","last_undegraded":"2024-04-25T16:00:57.872968+0000","last_fullsized":"2024-04-25T16:00:57.872968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":787,"num_write":162,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'536","reported_seq":590,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564408+0000","last_change":"2024-04-25T15:54:19.378136+0000","last_active":"2024-04-25T16:00:43.564408+0000","last_peered":"2024-04-25T16:00:43.564408+0000","last_clean":"2024-04-25T16:00:43.564408+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T16:00:43.564408+0000","last_undegraded":"2024-04-25T16:00:43.564408+0000","last_fullsized":"2024-04-25T16:00:43.564408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24608,"num_write":474,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"31'470","reported_seq":569,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.560394+0000","last_change":"2024-04-25T15:54:20.402885+0000","last_active":"2024-04-25T16:00:43.560394+0000","last_peered":"2024-04-25T16:00:43.560394+0000","last_clean":"2024-04-25T16:00:43.560394+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T16:00:43.560394+0000","last_undegraded":"2024-04-25T16:00:43.560394+0000","last_fullsized":"2024-04-25T16:00:43.560394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31281,"num_write":455,"num_write_kb":108972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"36'380","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.642794+0000","last_change":"2024-04-25T15:54:10.268564+0000","last_active":"2024-04-25T16:00:51.642794+0000","last_peered":"2024-04-25T16:00:51.642794+0000","last_clean":"2024-04-25T16:00:51.642794+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T16:00:51.642794+0000","last_undegraded":"2024-04-25T16:00:51.642794+0000","last_fullsized":"2024-04-25T16:00:51.642794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":25762,"num_write":354,"num_write_kb":59652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'381","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.877917+0000","last_change":"2024-04-25T15:54:09.221224+0000","last_active":"2024-04-25T16:00:45.877917+0000","last_peered":"2024-04-25T16:00:45.877917+0000","last_clean":"2024-04-25T16:00:45.877917+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T16:00:45.877917+0000","last_undegraded":"2024-04-25T16:00:45.877917+0000","last_fullsized":"2024-04-25T16:00:45.877917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:33.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8766,"num_write":314,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'141","reported_seq":205,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583710+0000","last_change":"2024-04-25T15:54:19.373138+0000","last_active":"2024-04-25T16:00:43.583710+0000","last_peered":"2024-04-25T16:00:43.583710+0000","last_clean":"2024-04-25T16:00:43.583710+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T16:00:43.583710+0000","last_undegraded":"2024-04-25T16:00:43.583710+0000","last_fullsized":"2024-04-25T16:00:43.583710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:33.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494748,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":898,"num_write":91,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'426","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571429+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T16:00:43.571429+0000","last_peered":"2024-04-25T16:00:43.571429+0000","last_clean":"2024-04-25T16:00:43.571429+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T16:00:43.571429+0000","last_undegraded":"2024-04-25T16:00:43.571429+0000","last_fullsized":"2024-04-25T16:00:43.571429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13765,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"36'408","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.621688+0000","last_change":"2024-04-25T15:54:10.289511+0000","last_active":"2024-04-25T16:00:43.621688+0000","last_peered":"2024-04-25T16:00:43.621688+0000","last_clean":"2024-04-25T16:00:43.621688+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T16:00:43.621688+0000","last_undegraded":"2024-04-25T16:00:43.621688+0000","last_fullsized":"2024-04-25T16:00:43.621688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.620544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":381,"num_write_kb":62610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"36'68","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576238+0000","last_change":"2024-04-25T15:54:09.225161+0000","last_active":"2024-04-25T16:00:43.576238+0000","last_peered":"2024-04-25T16:00:43.576238+0000","last_clean":"2024-04-25T16:00:43.576238+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T16:00:43.576238+0000","last_undegraded":"2024-04-25T16:00:43.576238+0000","last_fullsized":"2024-04-25T16:00:43.576238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'63","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582861+0000","last_change":"2024-04-25T15:54:19.378220+0000","last_active":"2024-04-25T16:00:43.582861+0000","last_peered":"2024-04-25T16:00:43.582861+0000","last_clean":"2024-04-25T16:00:43.582861+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T16:00:43.582861+0000","last_undegraded":"2024-04-25T16:00:43.582861+0000","last_fullsized":"2024-04-25T16:00:43.582861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:15.387149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'354","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564245+0000","last_change":"2024-04-25T15:54:20.403207+0000","last_active":"2024-04-25T16:00:43.564245+0000","last_peered":"2024-04-25T16:00:43.564245+0000","last_clean":"2024-04-25T16:00:43.564245+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T16:00:43.564245+0000","last_undegraded":"2024-04-25T16:00:43.564245+0000","last_fullsized":"2024-04-25T16:00:43.564245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17557,"num_write":333,"num_write_kb":46614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'111","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570878+0000","last_change":"2024-04-25T15:54:19.386554+0000","last_active":"2024-04-25T16:00:43.570878+0000","last_peered":"2024-04-25T16:00:43.570878+0000","last_clean":"2024-04-25T16:00:43.570878+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T16:00:43.570878+0000","last_undegraded":"2024-04-25T16:00:43.570878+0000","last_fullsized":"2024-04-25T16:00:43.570878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":58,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'435","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684323+0000","last_change":"2024-04-25T15:54:10.248380+0000","last_active":"2024-04-25T16:00:51.684323+0000","last_peered":"2024-04-25T16:00:51.684323+0000","last_clean":"2024-04-25T16:00:51.684323+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T16:00:51.684323+0000","last_undegraded":"2024-04-25T16:00:51.684323+0000","last_fullsized":"2024-04-25T16:00:51.684323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25415,"num_write":410,"num_write_kb":96682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'1093","reported_seq":1147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:44.543302+0000","last_change":"2024-04-25T15:54:09.229722+0000","last_active":"2024-04-25T16:00:44.543302+0000","last_peered":"2024-04-25T16:00:44.543302+0000","last_clean":"2024-04-25T16:00:44.543302+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T16:00:44.543302+0000","last_undegraded":"2024-04-25T16:00:44.543302+0000","last_fullsized":"2024-04-25T16:00:44.543302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:20.799030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":1024,"num_write_kb":8705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"31'396","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570814+0000","last_change":"2024-04-25T15:54:20.426434+0000","last_active":"2024-04-25T16:00:43.570814+0000","last_peered":"2024-04-25T16:00:43.570814+0000","last_clean":"2024-04-25T16:00:43.570814+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T16:00:43.570814+0000","last_undegraded":"2024-04-25T16:00:43.570814+0000","last_fullsized":"2024-04-25T16:00:43.570814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.711150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":20218,"num_write":374,"num_write_kb":83731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'99","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565603+0000","last_change":"2024-04-25T15:54:19.396952+0000","last_active":"2024-04-25T16:00:43.565603+0000","last_peered":"2024-04-25T16:00:43.565603+0000","last_clean":"2024-04-25T16:00:43.565603+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T16:00:43.565603+0000","last_undegraded":"2024-04-25T16:00:43.565603+0000","last_fullsized":"2024-04-25T16:00:43.565603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:13.802973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12304,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'449","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585602+0000","last_change":"2024-04-25T15:54:10.234274+0000","last_active":"2024-04-25T16:00:43.585602+0000","last_peered":"2024-04-25T16:00:43.585602+0000","last_clean":"2024-04-25T16:00:43.585602+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T16:00:43.585602+0000","last_undegraded":"2024-04-25T16:00:43.585602+0000","last_fullsized":"2024-04-25T16:00:43.585602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:03.778142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27119,"num_write":430,"num_write_kb":112459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'105","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.743069+0000","last_change":"2024-04-25T15:54:09.221016+0000","last_active":"2024-04-25T16:00:45.743069+0000","last_peered":"2024-04-25T16:00:45.743069+0000","last_clean":"2024-04-25T16:00:45.743069+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T16:00:45.743069+0000","last_undegraded":"2024-04-25T16:00:45.743069+0000","last_fullsized":"2024-04-25T16:00:45.743069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:36.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":60,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"31'366","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564233+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T16:00:43.564233+0000","last_peered":"2024-04-25T16:00:43.564233+0000","last_clean":"2024-04-25T16:00:43.564233+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T16:00:43.564233+0000","last_undegraded":"2024-04-25T16:00:43.564233+0000","last_fullsized":"2024-04-25T16:00:43.564233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":31073,"num_write":335,"num_write_kb":72672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"34'620","reported_seq":678,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:45.348054+0000","last_change":"2024-04-25T15:54:09.213376+0000","last_active":"2024-04-25T16:00:45.348054+0000","last_peered":"2024-04-25T16:00:45.348054+0000","last_clean":"2024-04-25T16:00:45.348054+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T16:00:45.348054+0000","last_undegraded":"2024-04-25T16:00:45.348054+0000","last_fullsized":"2024-04-25T16:00:45.348054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:42:42.810449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":551,"num_write_kb":12472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'393","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675955+0000","last_change":"2024-04-25T15:54:10.251934+0000","last_active":"2024-04-25T16:00:51.675955+0000","last_peered":"2024-04-25T16:00:51.675955+0000","last_clean":"2024-04-25T16:00:51.675955+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T16:00:51.675955+0000","last_undegraded":"2024-04-25T16:00:51.675955+0000","last_fullsized":"2024-04-25T16:00:51.675955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31498,"num_write":372,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'337","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559283+0000","last_change":"2024-04-25T15:54:19.359364+0000","last_active":"2024-04-25T16:00:43.559283+0000","last_peered":"2024-04-25T16:00:43.559283+0000","last_clean":"2024-04-25T16:00:43.559283+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T16:00:43.559283+0000","last_undegraded":"2024-04-25T16:00:43.559283+0000","last_fullsized":"2024-04-25T16:00:43.559283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:23.114956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":286,"num_write_kb":4236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'391","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566951+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T16:00:43.566951+0000","last_peered":"2024-04-25T16:00:43.566951+0000","last_clean":"2024-04-25T16:00:43.566951+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T16:00:43.566951+0000","last_undegraded":"2024-04-25T16:00:43.566951+0000","last_fullsized":"2024-04-25T16:00:43.566951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:39.240429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15625,"num_write":369,"num_write_kb":80649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"34'111","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.584875+0000","last_change":"2024-04-25T15:54:09.214795+0000","last_active":"2024-04-25T16:00:43.584875+0000","last_peered":"2024-04-25T16:00:43.584875+0000","last_clean":"2024-04-25T16:00:43.584875+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T16:00:43.584875+0000","last_undegraded":"2024-04-25T16:00:43.584875+0000","last_fullsized":"2024-04-25T16:00:43.584875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:08.163471+0000","last_clean_scrub_stamp":"2024-04-25T15:54:08.163471+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:50.295139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":57,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'382","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689989+0000","last_change":"2024-04-25T15:54:10.245969+0000","last_active":"2024-04-25T16:00:51.689989+0000","last_peered":"2024-04-25T16:00:51.689989+0000","last_clean":"2024-04-25T16:00:51.689989+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T16:00:51.689989+0000","last_undegraded":"2024-04-25T16:00:51.689989+0000","last_fullsized":"2024-04-25T16:00:51.689989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:03.026400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28619,"num_write":357,"num_write_kb":42139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'305","reported_seq":358,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583900+0000","last_change":"2024-04-25T15:54:19.373424+0000","last_active":"2024-04-25T16:00:43.583900+0000","last_peered":"2024-04-25T16:00:43.583900+0000","last_clean":"2024-04-25T16:00:43.583900+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T16:00:43.583900+0000","last_undegraded":"2024-04-25T16:00:43.583900+0000","last_fullsized":"2024-04-25T16:00:43.583900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:18.323752+0000","last_clean_scrub_stamp":"2024-04-25T15:54:18.323752+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:30.645761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":32783,"num_write":228,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"31'453","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585705+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T16:00:43.585705+0000","last_peered":"2024-04-25T16:00:43.585705+0000","last_clean":"2024-04-25T16:00:43.585705+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T16:00:43.585705+0000","last_undegraded":"2024-04-25T16:00:43.585705+0000","last_fullsized":"2024-04-25T16:00:43.585705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:58.594021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17355,"num_write":430,"num_write_kb":97199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'423","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.702247+0000","last_change":"2024-04-25T15:54:10.250500+0000","last_active":"2024-04-25T16:00:51.702247+0000","last_peered":"2024-04-25T16:00:51.702247+0000","last_clean":"2024-04-25T16:00:51.702247+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T16:00:51.702247+0000","last_undegraded":"2024-04-25T16:00:51.702247+0000","last_fullsized":"2024-04-25T16:00:51.702247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12292,"num_write":400,"num_write_kb":76879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"31'396","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562935+0000","last_change":"2024-04-25T15:54:20.427539+0000","last_active":"2024-04-25T16:00:43.562935+0000","last_peered":"2024-04-25T16:00:43.562935+0000","last_clean":"2024-04-25T16:00:43.562935+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T16:00:43.562935+0000","last_undegraded":"2024-04-25T16:00:43.562935+0000","last_fullsized":"2024-04-25T16:00:43.562935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13093,"num_write":385,"num_write_kb":50492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'448","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.694727+0000","last_change":"2024-04-25T15:54:10.257482+0000","last_active":"2024-04-25T16:00:51.694727+0000","last_peered":"2024-04-25T16:00:51.694727+0000","last_clean":"2024-04-25T16:00:51.694727+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T16:00:51.694727+0000","last_undegraded":"2024-04-25T16:00:51.694727+0000","last_fullsized":"2024-04-25T16:00:51.694727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":34274,"num_write":426,"num_write_kb":72417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"31'398","reported_seq":495,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618832+0000","last_change":"2024-04-25T15:54:20.412528+0000","last_active":"2024-04-25T16:00:43.618832+0000","last_peered":"2024-04-25T16:00:43.618832+0000","last_clean":"2024-04-25T16:00:43.618832+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T16:00:43.618832+0000","last_undegraded":"2024-04-25T16:00:43.618832+0000","last_fullsized":"2024-04-25T16:00:43.618832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.238658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32843,"num_write":377,"num_write_kb":116675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"36'474","reported_seq":588,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.692733+0000","last_change":"2024-04-25T15:54:10.283769+0000","last_active":"2024-04-25T16:00:51.692733+0000","last_peered":"2024-04-25T16:00:51.692733+0000","last_clean":"2024-04-25T16:00:51.692733+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T16:00:51.692733+0000","last_undegraded":"2024-04-25T16:00:51.692733+0000","last_fullsized":"2024-04-25T16:00:51.692733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:30.694106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33678,"num_write":445,"num_write_kb":67390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564869+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T16:00:43.564869+0000","last_peered":"2024-04-25T16:00:43.564869+0000","last_clean":"2024-04-25T16:00:43.564869+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T16:00:43.564869+0000","last_undegraded":"2024-04-25T16:00:43.564869+0000","last_fullsized":"2024-04-25T16:00:43.564869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19077,"num_write":388,"num_write_kb":75668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'415","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679135+0000","last_change":"2024-04-25T15:54:10.232526+0000","last_active":"2024-04-25T16:00:51.679135+0000","last_peered":"2024-04-25T16:00:51.679135+0000","last_clean":"2024-04-25T16:00:51.679135+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T16:00:51.679135+0000","last_undegraded":"2024-04-25T16:00:51.679135+0000","last_fullsized":"2024-04-25T16:00:51.679135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15212,"num_write":389,"num_write_kb":87855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"31'469","reported_seq":572,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569399+0000","last_change":"2024-04-25T15:54:20.434006+0000","last_active":"2024-04-25T16:00:43.569399+0000","last_peered":"2024-04-25T16:00:43.569399+0000","last_clean":"2024-04-25T16:00:43.569399+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T16:00:43.569399+0000","last_undegraded":"2024-04-25T16:00:43.569399+0000","last_fullsized":"2024-04-25T16:00:43.569399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":27411,"num_write":441,"num_write_kb":71769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"36'370","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699867+0000","last_change":"2024-04-25T15:54:10.235544+0000","last_active":"2024-04-25T16:00:51.699867+0000","last_peered":"2024-04-25T16:00:51.699867+0000","last_clean":"2024-04-25T16:00:51.699867+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T16:00:51.699867+0000","last_undegraded":"2024-04-25T16:00:51.699867+0000","last_fullsized":"2024-04-25T16:00:51.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17348,"num_write":348,"num_write_kb":62807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"31'399","reported_seq":493,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.566996+0000","last_change":"2024-04-25T15:54:20.421118+0000","last_active":"2024-04-25T16:00:43.566996+0000","last_peered":"2024-04-25T16:00:43.566996+0000","last_clean":"2024-04-25T16:00:43.566996+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T16:00:43.566996+0000","last_undegraded":"2024-04-25T16:00:43.566996+0000","last_fullsized":"2024-04-25T16:00:43.566996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25133,"num_write":374,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"36'389","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.563669+0000","last_change":"2024-04-25T15:54:10.248846+0000","last_active":"2024-04-25T16:00:43.563669+0000","last_peered":"2024-04-25T16:00:43.563669+0000","last_clean":"2024-04-25T16:00:43.563669+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T16:00:43.563669+0000","last_undegraded":"2024-04-25T16:00:43.563669+0000","last_fullsized":"2024-04-25T16:00:43.563669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9093,"num_write":358,"num_write_kb":54590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"31'414","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570320+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T16:00:43.570320+0000","last_peered":"2024-04-25T16:00:43.570320+0000","last_clean":"2024-04-25T16:00:43.570320+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T16:00:43.570320+0000","last_undegraded":"2024-04-25T16:00:43.570320+0000","last_fullsized":"2024-04-25T16:00:43.570320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4145,"num_write":400,"num_write_kb":47343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"36'485","reported_seq":607,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.574681+0000","last_change":"2024-04-25T15:54:10.271116+0000","last_active":"2024-04-25T16:00:43.574681+0000","last_peered":"2024-04-25T16:00:43.574681+0000","last_clean":"2024-04-25T16:00:43.574681+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T16:00:43.574681+0000","last_undegraded":"2024-04-25T16:00:43.574681+0000","last_fullsized":"2024-04-25T16:00:43.574681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40854,"num_write":458,"num_write_kb":125991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"31'410","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559076+0000","last_change":"2024-04-25T15:54:20.416847+0000","last_active":"2024-04-25T16:00:43.559076+0000","last_peered":"2024-04-25T16:00:43.559076+0000","last_clean":"2024-04-25T16:00:43.559076+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T16:00:43.559076+0000","last_undegraded":"2024-04-25T16:00:43.559076+0000","last_fullsized":"2024-04-25T16:00:43.559076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26310,"num_write":391,"num_write_kb":68273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'398","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.679994+0000","last_change":"2024-04-25T15:54:10.238000+0000","last_active":"2024-04-25T16:00:51.679994+0000","last_peered":"2024-04-25T16:00:51.679994+0000","last_clean":"2024-04-25T16:00:51.679994+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T16:00:51.679994+0000","last_undegraded":"2024-04-25T16:00:51.679994+0000","last_fullsized":"2024-04-25T16:00:51.679994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:06.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4252,"num_write":382,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"31'416","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583427+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T16:00:43.583427+0000","last_peered":"2024-04-25T16:00:43.583427+0000","last_clean":"2024-04-25T16:00:43.583427+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T16:00:43.583427+0000","last_undegraded":"2024-04-25T16:00:43.583427+0000","last_fullsized":"2024-04-25T16:00:43.583427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.239336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38150,"num_write":393,"num_write_kb":63831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'452","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.661661+0000","last_change":"2024-04-25T15:54:10.279632+0000","last_active":"2024-04-25T16:00:51.661661+0000","last_peered":"2024-04-25T16:00:51.661661+0000","last_clean":"2024-04-25T16:00:51.661661+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T16:00:51.661661+0000","last_undegraded":"2024-04-25T16:00:51.661661+0000","last_fullsized":"2024-04-25T16:00:51.661661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13732,"num_write":425,"num_write_kb":92170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"31'400","reported_seq":496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.572217+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T16:00:43.572217+0000","last_peered":"2024-04-25T16:00:43.572217+0000","last_clean":"2024-04-25T16:00:43.572217+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T16:00:43.572217+0000","last_undegraded":"2024-04-25T16:00:43.572217+0000","last_fullsized":"2024-04-25T16:00:43.572217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30630,"num_write":376,"num_write_kb":46781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"36'400","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.658583+0000","last_change":"2024-04-25T15:54:10.237662+0000","last_active":"2024-04-25T16:00:51.658583+0000","last_peered":"2024-04-25T16:00:51.658583+0000","last_clean":"2024-04-25T16:00:51.658583+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T16:00:51.658583+0000","last_undegraded":"2024-04-25T16:00:51.658583+0000","last_fullsized":"2024-04-25T16:00:51.658583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:50.589761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":15673,"num_write":376,"num_write_kb":63098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"31'448","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.558895+0000","last_change":"2024-04-25T15:54:20.415428+0000","last_active":"2024-04-25T16:00:43.558895+0000","last_peered":"2024-04-25T16:00:43.558895+0000","last_clean":"2024-04-25T16:00:43.558895+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T16:00:43.558895+0000","last_undegraded":"2024-04-25T16:00:43.558895+0000","last_fullsized":"2024-04-25T16:00:43.558895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:16.403942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17288,"num_write":429,"num_write_kb":67321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"35'439","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.620632+0000","last_change":"2024-04-25T15:54:10.294254+0000","last_active":"2024-04-25T16:00:43.620632+0000","last_peered":"2024-04-25T16:00:43.620632+0000","last_clean":"2024-04-25T16:00:43.620632+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T16:00:43.620632+0000","last_undegraded":"2024-04-25T16:00:43.620632+0000","last_fullsized":"2024-04-25T16:00:43.620632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":44523,"num_write":420,"num_write_kb":101102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"31'449","reported_seq":563,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583236+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T16:00:43.583236+0000","last_peered":"2024-04-25T16:00:43.583236+0000","last_clean":"2024-04-25T16:00:43.583236+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T16:00:43.583236+0000","last_undegraded":"2024-04-25T16:00:43.583236+0000","last_fullsized":"2024-04-25T16:00:43.583236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:25.790958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42039,"num_write":424,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.639652+0000","last_change":"2024-04-25T15:54:50.214937+0000","last_active":"2024-04-25T16:00:51.639652+0000","last_peered":"2024-04-25T16:00:51.639652+0000","last_clean":"2024-04-25T16:00:51.639652+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T16:00:51.639652+0000","last_undegraded":"2024-04-25T16:00:51.639652+0000","last_fullsized":"2024-04-25T16:00:51.639652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:37.549300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27977,"num_write":389,"num_write_kb":84131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"31'427","reported_seq":554,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.565215+0000","last_change":"2024-04-25T15:54:20.418968+0000","last_active":"2024-04-25T16:00:43.565215+0000","last_peered":"2024-04-25T16:00:43.565215+0000","last_clean":"2024-04-25T16:00:43.565215+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T16:00:43.565215+0000","last_undegraded":"2024-04-25T16:00:43.565215+0000","last_fullsized":"2024-04-25T16:00:43.565215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:17.468394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43629,"num_write":407,"num_write_kb":76072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"35'432","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564858+0000","last_change":"2024-04-25T15:54:10.258670+0000","last_active":"2024-04-25T16:00:43.564858+0000","last_peered":"2024-04-25T16:00:43.564858+0000","last_clean":"2024-04-25T16:00:43.564858+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T16:00:43.564858+0000","last_undegraded":"2024-04-25T16:00:43.564858+0000","last_fullsized":"2024-04-25T16:00:43.564858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:40.574416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30618,"num_write":414,"num_write_kb":71070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"31'389","reported_seq":477,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.559593+0000","last_change":"2024-04-25T15:54:20.417916+0000","last_active":"2024-04-25T16:00:43.559593+0000","last_peered":"2024-04-25T16:00:43.559593+0000","last_clean":"2024-04-25T16:00:43.559593+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T16:00:43.559593+0000","last_undegraded":"2024-04-25T16:00:43.559593+0000","last_fullsized":"2024-04-25T16:00:43.559593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:23:34.449245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30549,"num_write":360,"num_write_kb":75006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"36'422","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.670952+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T16:00:51.670952+0000","last_peered":"2024-04-25T16:00:51.670952+0000","last_clean":"2024-04-25T16:00:51.670952+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T16:00:51.670952+0000","last_undegraded":"2024-04-25T16:00:51.670952+0000","last_fullsized":"2024-04-25T16:00:51.670952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:14.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39450,"num_write":395,"num_write_kb":75510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"31'437","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.617890+0000","last_change":"2024-04-25T15:54:20.428055+0000","last_active":"2024-04-25T16:00:43.617890+0000","last_peered":"2024-04-25T16:00:43.617890+0000","last_clean":"2024-04-25T16:00:43.617890+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T16:00:43.617890+0000","last_undegraded":"2024-04-25T16:00:43.617890+0000","last_fullsized":"2024-04-25T16:00:43.617890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:31.547235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19085,"num_write":412,"num_write_kb":55082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"36'406","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.699401+0000","last_change":"2024-04-25T15:54:10.258626+0000","last_active":"2024-04-25T16:00:51.699401+0000","last_peered":"2024-04-25T16:00:51.699401+0000","last_clean":"2024-04-25T16:00:51.699401+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T16:00:51.699401+0000","last_undegraded":"2024-04-25T16:00:51.699401+0000","last_fullsized":"2024-04-25T16:00:51.699401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:13.918163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24863,"num_write":384,"num_write_kb":75591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"31'420","reported_seq":503,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562491+0000","last_change":"2024-04-25T15:54:20.426425+0000","last_active":"2024-04-25T16:00:43.562491+0000","last_peered":"2024-04-25T16:00:43.562491+0000","last_clean":"2024-04-25T16:00:43.562491+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T16:00:43.562491+0000","last_undegraded":"2024-04-25T16:00:43.562491+0000","last_fullsized":"2024-04-25T16:00:43.562491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:42.042690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20260,"num_write":395,"num_write_kb":76151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'416","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.707524+0000","last_change":"2024-04-25T15:54:10.260917+0000","last_active":"2024-04-25T16:00:51.707524+0000","last_peered":"2024-04-25T16:00:51.707524+0000","last_clean":"2024-04-25T16:00:51.707524+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T16:00:51.707524+0000","last_undegraded":"2024-04-25T16:00:51.707524+0000","last_fullsized":"2024-04-25T16:00:51.707524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:49.456938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24467,"num_write":391,"num_write_kb":79816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"31'404","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562708+0000","last_change":"2024-04-25T15:54:20.422685+0000","last_active":"2024-04-25T16:00:43.562708+0000","last_peered":"2024-04-25T16:00:43.562708+0000","last_clean":"2024-04-25T16:00:43.562708+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T16:00:43.562708+0000","last_undegraded":"2024-04-25T16:00:43.562708+0000","last_fullsized":"2024-04-25T16:00:43.562708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25761,"num_write":377,"num_write_kb":87528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"36'432","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.705538+0000","last_change":"2024-04-25T15:54:10.259589+0000","last_active":"2024-04-25T16:00:51.705538+0000","last_peered":"2024-04-25T16:00:51.705538+0000","last_clean":"2024-04-25T16:00:51.705538+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T16:00:51.705538+0000","last_undegraded":"2024-04-25T16:00:51.705538+0000","last_fullsized":"2024-04-25T16:00:51.705538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":33533,"num_write":410,"num_write_kb":87842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"31'400","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562996+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T16:00:43.562996+0000","last_peered":"2024-04-25T16:00:43.562996+0000","last_clean":"2024-04-25T16:00:43.562996+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T16:00:43.562996+0000","last_undegraded":"2024-04-25T16:00:43.562996+0000","last_fullsized":"2024-04-25T16:00:43.562996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29549,"num_write":386,"num_write_kb":55194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"36'394","reported_seq":518,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.689283+0000","last_change":"2024-04-25T15:54:10.264657+0000","last_active":"2024-04-25T16:00:51.689283+0000","last_peered":"2024-04-25T16:00:51.689283+0000","last_clean":"2024-04-25T16:00:51.689283+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T16:00:51.689283+0000","last_undegraded":"2024-04-25T16:00:51.689283+0000","last_fullsized":"2024-04-25T16:00:51.689283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46746,"num_write":370,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"31'338","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618796+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T16:00:43.618796+0000","last_peered":"2024-04-25T16:00:43.618796+0000","last_clean":"2024-04-25T16:00:43.618796+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T16:00:43.618796+0000","last_undegraded":"2024-04-25T16:00:43.618796+0000","last_fullsized":"2024-04-25T16:00:43.618796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:49.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9201,"num_write":322,"num_write_kb":37990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"36'397","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701141+0000","last_change":"2024-04-25T15:54:10.238771+0000","last_active":"2024-04-25T16:00:51.701141+0000","last_peered":"2024-04-25T16:00:51.701141+0000","last_clean":"2024-04-25T16:00:51.701141+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T16:00:51.701141+0000","last_undegraded":"2024-04-25T16:00:51.701141+0000","last_fullsized":"2024-04-25T16:00:51.701141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:14.191269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14146,"num_write":373,"num_write_kb":38796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"31'395","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576883+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T16:00:43.576883+0000","last_peered":"2024-04-25T16:00:43.576883+0000","last_clean":"2024-04-25T16:00:43.576883+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T16:00:43.576883+0000","last_undegraded":"2024-04-25T16:00:43.576883+0000","last_fullsized":"2024-04-25T16:00:43.576883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:33.849869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":61604,"num_write":383,"num_write_kb":95809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"36'373","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583502+0000","last_change":"2024-04-25T15:54:10.251757+0000","last_active":"2024-04-25T16:00:43.583502+0000","last_peered":"2024-04-25T16:00:43.583502+0000","last_clean":"2024-04-25T16:00:43.583502+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T16:00:43.583502+0000","last_undegraded":"2024-04-25T16:00:43.583502+0000","last_fullsized":"2024-04-25T16:00:43.583502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:50.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13278,"num_write":350,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"31'383","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585454+0000","last_change":"2024-04-25T15:54:20.401102+0000","last_active":"2024-04-25T16:00:43.585454+0000","last_peered":"2024-04-25T16:00:43.585454+0000","last_clean":"2024-04-25T16:00:43.585454+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T16:00:43.585454+0000","last_undegraded":"2024-04-25T16:00:43.585454+0000","last_fullsized":"2024-04-25T16:00:43.585454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4096,"num_write":350,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'356","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.684443+0000","last_change":"2024-04-25T15:54:10.253426+0000","last_active":"2024-04-25T16:00:51.684443+0000","last_peered":"2024-04-25T16:00:51.684443+0000","last_clean":"2024-04-25T16:00:51.684443+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T16:00:51.684443+0000","last_undegraded":"2024-04-25T16:00:51.684443+0000","last_fullsized":"2024-04-25T16:00:51.684443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:59:40.485903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19489,"num_write":338,"num_write_kb":75079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"31'369","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557847+0000","last_change":"2024-04-25T15:54:20.413246+0000","last_active":"2024-04-25T16:00:43.557847+0000","last_peered":"2024-04-25T16:00:43.557847+0000","last_clean":"2024-04-25T16:00:43.557847+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T16:00:43.557847+0000","last_undegraded":"2024-04-25T16:00:43.557847+0000","last_fullsized":"2024-04-25T16:00:43.557847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:14.813238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1693,"num_write":344,"num_write_kb":38100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"36'368","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.706369+0000","last_change":"2024-04-25T15:54:50.210919+0000","last_active":"2024-04-25T16:00:51.706369+0000","last_peered":"2024-04-25T16:00:51.706369+0000","last_clean":"2024-04-25T16:00:51.706369+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T16:00:51.706369+0000","last_undegraded":"2024-04-25T16:00:51.706369+0000","last_fullsized":"2024-04-25T16:00:51.706369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25999,"num_write":356,"num_write_kb":38429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"31'447","reported_seq":559,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.576302+0000","last_change":"2024-04-25T15:54:20.422193+0000","last_active":"2024-04-25T16:00:43.576302+0000","last_peered":"2024-04-25T16:00:43.576302+0000","last_clean":"2024-04-25T16:00:43.576302+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T16:00:43.576302+0000","last_undegraded":"2024-04-25T16:00:43.576302+0000","last_fullsized":"2024-04-25T16:00:43.576302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:01.153272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38032,"num_write":427,"num_write_kb":75902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"36'382","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.681204+0000","last_change":"2024-04-25T15:54:10.265740+0000","last_active":"2024-04-25T16:00:51.681204+0000","last_peered":"2024-04-25T16:00:51.681204+0000","last_clean":"2024-04-25T16:00:51.681204+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T16:00:51.681204+0000","last_undegraded":"2024-04-25T16:00:51.681204+0000","last_fullsized":"2024-04-25T16:00:51.681204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:26.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33238,"num_write":360,"num_write_kb":83325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"31'430","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618117+0000","last_change":"2024-04-25T15:54:20.407063+0000","last_active":"2024-04-25T16:00:43.618117+0000","last_peered":"2024-04-25T16:00:43.618117+0000","last_clean":"2024-04-25T16:00:43.618117+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T16:00:43.618117+0000","last_undegraded":"2024-04-25T16:00:43.618117+0000","last_fullsized":"2024-04-25T16:00:43.618117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:33.147719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47776,"num_write":403,"num_write_kb":100333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"36'419","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.682360+0000","last_change":"2024-04-25T15:54:10.297531+0000","last_active":"2024-04-25T16:00:51.682360+0000","last_peered":"2024-04-25T16:00:51.682360+0000","last_clean":"2024-04-25T16:00:51.682360+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T16:00:51.682360+0000","last_undegraded":"2024-04-25T16:00:51.682360+0000","last_fullsized":"2024-04-25T16:00:51.682360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:04.651387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31054,"num_write":404,"num_write_kb":100026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"31'457","reported_seq":596,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583419+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T16:00:43.583419+0000","last_peered":"2024-04-25T16:00:43.583419+0000","last_clean":"2024-04-25T16:00:43.583419+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T16:00:43.583419+0000","last_undegraded":"2024-04-25T16:00:43.583419+0000","last_fullsized":"2024-04-25T16:00:43.583419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:24.681518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56462,"num_write":435,"num_write_kb":97259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"36'357","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.698267+0000","last_change":"2024-04-25T15:54:10.270450+0000","last_active":"2024-04-25T16:00:51.698267+0000","last_peered":"2024-04-25T16:00:51.698267+0000","last_clean":"2024-04-25T16:00:51.698267+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T16:00:51.698267+0000","last_undegraded":"2024-04-25T16:00:51.698267+0000","last_fullsized":"2024-04-25T16:00:51.698267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9534,"num_write":325,"num_write_kb":26581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"31'417","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562885+0000","last_change":"2024-04-25T15:54:20.416059+0000","last_active":"2024-04-25T16:00:43.562885+0000","last_peered":"2024-04-25T16:00:43.562885+0000","last_clean":"2024-04-25T16:00:43.562885+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T16:00:43.562885+0000","last_undegraded":"2024-04-25T16:00:43.562885+0000","last_fullsized":"2024-04-25T16:00:43.562885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.931225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28935,"num_write":390,"num_write_kb":55220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"36'446","reported_seq":557,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.571000+0000","last_change":"2024-04-25T15:54:10.275087+0000","last_active":"2024-04-25T16:00:43.571000+0000","last_peered":"2024-04-25T16:00:43.571000+0000","last_clean":"2024-04-25T16:00:43.571000+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T16:00:43.571000+0000","last_undegraded":"2024-04-25T16:00:43.571000+0000","last_fullsized":"2024-04-25T16:00:43.571000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":18239,"num_write":428,"num_write_kb":69651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"31'386","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.562548+0000","last_change":"2024-04-25T15:54:20.450663+0000","last_active":"2024-04-25T16:00:43.562548+0000","last_peered":"2024-04-25T16:00:43.562548+0000","last_clean":"2024-04-25T16:00:43.562548+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T16:00:43.562548+0000","last_undegraded":"2024-04-25T16:00:43.562548+0000","last_fullsized":"2024-04-25T16:00:43.562548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:36.675148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8859,"num_write":358,"num_write_kb":46267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'391","reported_seq":488,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.676568+0000","last_change":"2024-04-25T15:54:10.282923+0000","last_active":"2024-04-25T16:00:51.676568+0000","last_peered":"2024-04-25T16:00:51.676568+0000","last_clean":"2024-04-25T16:00:51.676568+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T16:00:51.676568+0000","last_undegraded":"2024-04-25T16:00:51.676568+0000","last_fullsized":"2024-04-25T16:00:51.676568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:53.999732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32236,"num_write":374,"num_write_kb":95777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"31'357","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619677+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T16:00:43.619677+0000","last_peered":"2024-04-25T16:00:43.619677+0000","last_clean":"2024-04-25T16:00:43.619677+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T16:00:43.619677+0000","last_undegraded":"2024-04-25T16:00:43.619677+0000","last_fullsized":"2024-04-25T16:00:43.619677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22705,"num_write":334,"num_write_kb":38119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"36'425","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.668379+0000","last_change":"2024-04-25T15:54:10.277646+0000","last_active":"2024-04-25T16:00:51.668379+0000","last_peered":"2024-04-25T16:00:51.668379+0000","last_clean":"2024-04-25T16:00:51.668379+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T16:00:51.668379+0000","last_undegraded":"2024-04-25T16:00:51.668379+0000","last_fullsized":"2024-04-25T16:00:51.668379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:46:40.151266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22941,"num_write":404,"num_write_kb":72501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"31'377","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582939+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T16:00:43.582939+0000","last_peered":"2024-04-25T16:00:43.582939+0000","last_clean":"2024-04-25T16:00:43.582939+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T16:00:43.582939+0000","last_undegraded":"2024-04-25T16:00:43.582939+0000","last_fullsized":"2024-04-25T16:00:43.582939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:34:31.184982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10994,"num_write":357,"num_write_kb":50723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'404","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.701848+0000","last_change":"2024-04-25T15:54:10.278693+0000","last_active":"2024-04-25T16:00:51.701848+0000","last_peered":"2024-04-25T16:00:51.701848+0000","last_clean":"2024-04-25T16:00:51.701848+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T16:00:51.701848+0000","last_undegraded":"2024-04-25T16:00:51.701848+0000","last_fullsized":"2024-04-25T16:00:51.701848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:51.118490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11471,"num_write":379,"num_write_kb":75857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"31'407","reported_seq":483,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.557154+0000","last_change":"2024-04-25T15:54:20.418422+0000","last_active":"2024-04-25T16:00:43.557154+0000","last_peered":"2024-04-25T16:00:43.557154+0000","last_clean":"2024-04-25T16:00:43.557154+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T16:00:43.557154+0000","last_undegraded":"2024-04-25T16:00:43.557154+0000","last_fullsized":"2024-04-25T16:00:43.557154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:42.271497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20101,"num_write":381,"num_write_kb":55469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"35'349","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570822+0000","last_change":"2024-04-25T15:54:10.241001+0000","last_active":"2024-04-25T16:00:43.570822+0000","last_peered":"2024-04-25T16:00:43.570822+0000","last_clean":"2024-04-25T16:00:43.570822+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T16:00:43.570822+0000","last_undegraded":"2024-04-25T16:00:43.570822+0000","last_fullsized":"2024-04-25T16:00:43.570822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:01.478992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9293,"num_write":327,"num_write_kb":37967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"31'359","reported_seq":454,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569043+0000","last_change":"2024-04-25T15:54:20.425832+0000","last_active":"2024-04-25T16:00:43.569043+0000","last_peered":"2024-04-25T16:00:43.569043+0000","last_clean":"2024-04-25T16:00:43.569043+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T16:00:43.569043+0000","last_undegraded":"2024-04-25T16:00:43.569043+0000","last_fullsized":"2024-04-25T16:00:43.569043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:08.077379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33728,"num_write":336,"num_write_kb":95963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"36'406","reported_seq":480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.675862+0000","last_change":"2024-04-25T15:54:10.244894+0000","last_active":"2024-04-25T16:00:51.675862+0000","last_peered":"2024-04-25T16:00:51.675862+0000","last_clean":"2024-04-25T16:00:51.675862+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T16:00:51.675862+0000","last_undegraded":"2024-04-25T16:00:51.675862+0000","last_fullsized":"2024-04-25T16:00:51.675862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:37.177739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15261,"num_write":373,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"31'453","reported_seq":603,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569482+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T16:00:43.569482+0000","last_peered":"2024-04-25T16:00:43.569482+0000","last_clean":"2024-04-25T16:00:43.569482+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T16:00:43.569482+0000","last_undegraded":"2024-04-25T16:00:43.569482+0000","last_fullsized":"2024-04-25T16:00:43.569482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:32.132351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":65459,"num_write":436,"num_write_kb":138981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"36'408","reported_seq":525,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.578583+0000","last_change":"2024-04-25T15:54:10.296898+0000","last_active":"2024-04-25T16:00:43.578583+0000","last_peered":"2024-04-25T16:00:43.578583+0000","last_clean":"2024-04-25T16:00:43.578583+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T16:00:43.578583+0000","last_undegraded":"2024-04-25T16:00:43.578583+0000","last_fullsized":"2024-04-25T16:00:43.578583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:57.135249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":41811,"num_write":385,"num_write_kb":100198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2984,"num_read_kb":1496873,"num_write":24473,"num_write_kb":4464601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25921,"ondisk_log_size":25921,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":131985636,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":525,"num_read_kb":323765,"num_write":7010,"num_write_kb":134510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":264028160,"data_stored":263971272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8506,"ondisk_log_size":8506,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2716,"num_read_kb":1480093,"num_write":24434,"num_write_kb":4326556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25980,"ondisk_log_size":25980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":136622360,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":754,"num_read_kb":436547,"num_write":9520,"num_write_kb":140553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":273309696,"data_stored":273244720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11090,"ondisk_log_size":11090,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133788,"kb_used_data":66516,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94238052,"statfs":{"total":96636764160,"available":96499765248,"internally_reserved":0,"allocated":68112384,"data_stored":67887709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163488,"kb_used_data":78232,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94208352,"statfs":{"total":96636764160,"available":96469352448,"internally_reserved":0,"allocated":80109568,"data_stored":79880869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141440,"kb_used_data":43704,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94230400,"statfs":{"total":96636764160,"available":96491929600,"internally_reserved":0,"allocated":44752896,"data_stored":44525982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185596,"kb_used_data":91956,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94186244,"statfs":{"total":96636764160,"available":96446713856,"internally_reserved":0,"allocated":94162944,"data_stored":93928717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172076,"kb_used_data":96548,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94199764,"statfs":{"total":96636764160,"available":96460558336,"internally_reserved":0,"allocated":98865152,"data_stored":98627692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":22855680,"data_stored":22634176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173140,"kb_used_data":83724,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94198700,"statfs":{"total":96636764160,"available":96459468800,"internally_reserved":0,"allocated":85733376,"data_stored":85497868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131296,"kb_used_data":46040,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94240544,"statfs":{"total":96636764160,"available":96502317056,"internally_reserved":0,"allocated":47144960,"data_stored":46916155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30298112,"data_stored":30288669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9867264,"data_stored":9863389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35041280,"data_stored":35029885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26099712,"data_stored":26094295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46145536,"data_stored":46138016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":55021394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63422464,"data_stored":63410002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47611904,"data_stored":47603442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18243882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:01:23.124 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.124 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.124 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.124 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.125 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.126 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.127 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.128 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.129 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T15:53:57.389108+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=53, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.130 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.131 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.132 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.133 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.134 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.135 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T15:54:08.163471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.136 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T15:54:18.323752+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=18, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.137 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.138 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.139 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.140 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.141 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.142 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.143 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.143 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:23.143 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T16:01:40.693 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:40.696 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:43.144 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:01:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.300+0000 7f20d4b2d640 1 Processor -- start 2024-04-25T16:01:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 -- start start 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20d01529a0 0x7f20d0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20d00ad990 0x7f20d00adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00c41e0 0x7f20d00c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f20d0072430 con 0x7f20d01529a0 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f20d0074730 con 0x7f20d00ad990 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20d4b2d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f20d0074a10 con 0x7f20d00c41e0 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20d01529a0 0x7f20d0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20d01529a0 0x7f20d0071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42986/0 (socket says 172.21.15.87:42986) 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 -- 172.21.15.87:0/818725361 learned_addr learned my addr 172.21.15.87:0/818725361 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ced9d640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00c41e0 0x7f20d00c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20cdd9b640 1 --2- 172.21.15.87:0/818725361 >> v2:172.21.15.155:3300/0 conn(0x7f20d00ad990 0x7f20d00adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 -- 172.21.15.87:0/818725361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00c41e0 msgr2=0x7f20d00c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00c41e0 0x7f20d00c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 -- 172.21.15.87:0/818725361 >> v2:172.21.15.155:3300/0 conn(0x7f20d00ad990 msgr2=0x7f20d00adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:01:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 --2- 172.21.15.87:0/818725361 >> v2:172.21.15.155:3300/0 conn(0x7f20d00ad990 0x7f20d00adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ce59c640 1 -- 172.21.15.87:0/818725361 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d0074cf0 con 0x7f20d01529a0 2024-04-25T16:01:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20ced9d640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00c41e0 0x7f20d00c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.304+0000 7f20cdd9b640 1 --2- 172.21.15.87:0/818725361 >> v2:172.21.15.155:3300/0 conn(0x7f20d00ad990 0x7f20d00adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20ce59c640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d0071e50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f20d00ae690 tx=0x7f20c001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681a6edb9e6010fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20cd59a640 1 -- 172.21.15.87:0/818725361 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c00a55e0 con 0x7f20d01529a0 2024-04-25T16:01:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20cd59a640 1 -- 172.21.15.87:0/818725361 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c00a5780 con 0x7f20d01529a0 2024-04-25T16:01:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20cd59a640 1 -- 172.21.15.87:0/818725361 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c00a5b50 con 0x7f20d01529a0 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 -- 172.21.15.87:0/818725361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 msgr2=0x7f20d0071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d0071e50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f20d00ae690 tx=0x7f20c001c960 comp rx=0 tx=0).stop 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 -- 172.21.15.87:0/818725361 shutdown_connections 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00c41e0 0x7f20d00c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/818725361 >> v2:172.21.15.155:3300/0 conn(0x7f20d00ad990 0x7f20d00adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/818725361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d0071e50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 -- 172.21.15.87:0/818725361 >> 172.21.15.87:0/818725361 conn(0x7f20d00c8770 msgr2=0x7f20d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 -- 172.21.15.87:0/818725361 shutdown_connections 2024-04-25T16:01:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 -- 172.21.15.87:0/818725361 wait complete. 2024-04-25T16:01:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 Processor -- start 2024-04-25T16:01:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.308+0000 7f20d4b2d640 1 -- start start 2024-04-25T16:01:43.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00ad990 0x7f20d01f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d00c41e0 0x7f20d0150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d014a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f20d0159340 con 0x7f20d01529a0 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20d01591c0 con 0x7f20d00c41e0 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f20d01594c0 con 0x7f20d00ad990 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d014a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d014a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42988/0 (socket says 172.21.15.87:42988) 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 -- 172.21.15.87:0/1308194183 learned_addr learned my addr 172.21.15.87:0/1308194183 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20cdd9b640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d00c41e0 0x7f20d0150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ce59c640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00ad990 0x7f20d01f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 -- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00ad990 msgr2=0x7f20d01f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00ad990 0x7f20d01f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 -- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d00c41e0 msgr2=0x7f20d0150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d00c41e0 0x7f20d0150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 -- 172.21.15.87:0/1308194183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d0152120 con 0x7f20d01529a0 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20cdd9b640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d00c41e0 0x7f20d0150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ce59c640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00ad990 0x7f20d01f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ced9d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d014a180 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c5f0 tx=0x7f20c800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8015070 con 0x7f20d01529a0 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c8011820 con 0x7f20d01529a0 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d0150850 con 0x7f20d01529a0 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011c10 con 0x7f20d01529a0 2024-04-25T16:01:43.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d0146c80 con 0x7f20d01529a0 2024-04-25T16:01:43.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d0069bb0 con 0x7f20d01529a0 2024-04-25T16:01:43.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f20c8018070 con 0x7f20d01529a0 2024-04-25T16:01:43.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20beffd640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:01:43.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f20c808f6e0 con 0x7f20d01529a0 2024-04-25T16:01:43.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.312+0000 7f20ce59c640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:01:43.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.316+0000 7f20ce59c640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f20c00ae000 tx=0x7f20c00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:01:43.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.320+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20c805bfb0 con 0x7f20d01529a0 2024-04-25T16:01:43.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.476+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20d00aded0 con 0x7f20b006f400 2024-04-25T16:01:43.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.512+0000 7f20beffd640 1 -- 172.21.15.87:0/1308194183 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494127 (secure 0 0 0) 0x7f20d00aded0 con 0x7f20b006f400 2024-04-25T16:01:43.518 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:01:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T16:01:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 msgr2=0x7f20b0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f20c00ae000 tx=0x7f20c00a7070 comp rx=0 tx=0).stop 2024-04-25T16:01:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 msgr2=0x7f20d014a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:01:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d014a180 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c5f0 tx=0x7f20c800cab0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 shutdown_connections 2024-04-25T16:01:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f20b006f400 0x7f20b0071910 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20d01529a0 0x7f20d014a180 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20d00c41e0 0x7f20d0150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 --2- 172.21.15.87:0/1308194183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20d00ad990 0x7f20d01f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:01:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 >> 172.21.15.87:0/1308194183 conn(0x7f20d00c8770 msgr2=0x7f20d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:01:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 shutdown_connections 2024-04-25T16:01:43.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:01:43.520+0000 7f20d4b2d640 1 -- 172.21.15.87:0/1308194183 wait complete. 2024-04-25T16:01:43.547 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T16:01:43.290898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269198364,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7045,"num_read_kb":3737333,"num_write":65538,"num_write_kb":9067848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71677,"ondisk_log_size":71677,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1159888,"kb_used_data":529040,"kb_used_omap":12,"kb_used_meta":630771,"kb_avail":753814832,"statfs":{"total":773094113280,"available":771906387968,"internally_reserved":0,"allocated":541736960,"data_stored":539899168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":645910065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005696"},"pg_stats":[{"pgid":"5.18","version":"31'448","reported_seq":551,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.576610+0000","last_change":"2024-04-25T16:01:36.576610+0000","last_active":"2024-04-25T16:01:36.576610+0000","last_peered":"2024-04-25T16:01:36.576610+0000","last_clean":"2024-04-25T16:01:36.576610+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T16:01:36.576610+0000","last_undegraded":"2024-04-25T16:01:36.576610+0000","last_fullsized":"2024-04-25T16:01:36.576610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'448","last_scrub_stamp":"2024-04-25T16:01:36.576149+0000","last_deep_scrub":"31'448","last_deep_scrub_stamp":"2024-04-25T16:01:36.576149+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.576149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:53.472515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27881,"num_write":426,"num_write_kb":76310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"36'1440","reported_seq":1516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.059005+0000","last_change":"2024-04-25T16:01:23.059063+0000","last_active":"2024-04-25T16:01:23.059005+0000","last_peered":"2024-04-25T16:01:23.059005+0000","last_clean":"2024-04-25T16:01:23.059005+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T16:01:23.059005+0000","last_undegraded":"2024-04-25T16:01:23.059005+0000","last_fullsized":"2024-04-25T16:01:23.059005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1440","last_scrub_stamp":"2024-04-25T16:01:23.058883+0000","last_deep_scrub":"36'1440","last_deep_scrub_stamp":"2024-04-25T16:01:23.058883+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.058883+0000","objects_scrubbed":3,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:08.187177+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":18411,"num_write":1381,"num_write_kb":5019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'392","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.517198+0000","last_change":"2024-04-25T16:01:32.517338+0000","last_active":"2024-04-25T16:01:32.517198+0000","last_peered":"2024-04-25T16:01:32.517198+0000","last_clean":"2024-04-25T16:01:32.517198+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T16:01:32.517198+0000","last_undegraded":"2024-04-25T16:01:32.517198+0000","last_fullsized":"2024-04-25T16:01:32.517198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'392","last_scrub_stamp":"2024-04-25T16:01:32.516842+0000","last_deep_scrub":"36'392","last_deep_scrub_stamp":"2024-04-25T16:01:32.516842+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.516842+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:16.444904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12356,"num_write":363,"num_write_kb":47533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'230","reported_seq":282,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.571100+0000","last_change":"2024-04-25T16:01:22.571100+0000","last_active":"2024-04-25T16:01:22.571100+0000","last_peered":"2024-04-25T16:01:22.571100+0000","last_clean":"2024-04-25T16:01:22.571100+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T16:01:22.571100+0000","last_undegraded":"2024-04-25T16:01:22.571100+0000","last_fullsized":"2024-04-25T16:01:22.571100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'230","last_scrub_stamp":"2024-04-25T16:01:22.570963+0000","last_deep_scrub":"36'230","last_deep_scrub_stamp":"2024-04-25T16:01:22.570963+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.570963+0000","objects_scrubbed":1,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:35.805251+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":183,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'392","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.910956+0000","last_change":"2024-04-25T16:01:40.911029+0000","last_active":"2024-04-25T16:01:40.910956+0000","last_peered":"2024-04-25T16:01:40.910956+0000","last_clean":"2024-04-25T16:01:40.910956+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T16:01:40.910956+0000","last_undegraded":"2024-04-25T16:01:40.910956+0000","last_fullsized":"2024-04-25T16:01:40.910956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'392","last_scrub_stamp":"2024-04-25T16:01:40.910707+0000","last_deep_scrub":"31'392","last_deep_scrub_stamp":"2024-04-25T16:01:40.910707+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.910707+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.751997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30984,"num_write":367,"num_write_kb":33760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"36'216","reported_seq":278,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.539450+0000","last_change":"2024-04-25T16:01:35.539525+0000","last_active":"2024-04-25T16:01:35.539450+0000","last_peered":"2024-04-25T16:01:35.539450+0000","last_clean":"2024-04-25T16:01:35.539450+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T16:01:35.539450+0000","last_undegraded":"2024-04-25T16:01:35.539450+0000","last_fullsized":"2024-04-25T16:01:35.539450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'216","last_scrub_stamp":"2024-04-25T16:01:35.539219+0000","last_deep_scrub":"36'216","last_deep_scrub_stamp":"2024-04-25T16:01:35.539219+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.539219+0000","objects_scrubbed":1,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:59.747599+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":163,"num_write_kb":4188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'349","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.068134+0000","last_change":"2024-04-25T16:01:20.068191+0000","last_active":"2024-04-25T16:01:20.068134+0000","last_peered":"2024-04-25T16:01:20.068134+0000","last_clean":"2024-04-25T16:01:20.068134+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T16:01:20.068134+0000","last_undegraded":"2024-04-25T16:01:20.068134+0000","last_fullsized":"2024-04-25T16:01:20.068134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'349","last_scrub_stamp":"2024-04-25T16:01:20.067996+0000","last_deep_scrub":"36'349","last_deep_scrub_stamp":"2024-04-25T16:01:20.067996+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.067996+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:07.683053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5423,"num_write":327,"num_write_kb":34935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'1398","reported_seq":1453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.680225+0000","last_change":"2024-04-25T16:01:24.680225+0000","last_active":"2024-04-25T16:01:24.680225+0000","last_peered":"2024-04-25T16:01:24.680225+0000","last_clean":"2024-04-25T16:01:24.680225+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T16:01:24.680225+0000","last_undegraded":"2024-04-25T16:01:24.680225+0000","last_fullsized":"2024-04-25T16:01:24.680225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1398","last_scrub_stamp":"2024-04-25T16:01:24.679844+0000","last_deep_scrub":"36'1398","last_deep_scrub_stamp":"2024-04-25T16:01:24.679844+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.679844+0000","objects_scrubbed":2,"log_size":1398,"log_dups_size":0,"ondisk_log_size":1398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:49.815907+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1329,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"31'398","reported_seq":459,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.577005+0000","last_change":"2024-04-25T15:54:20.440057+0000","last_active":"2024-04-25T16:00:43.577005+0000","last_peered":"2024-04-25T16:00:43.577005+0000","last_clean":"2024-04-25T16:00:43.577005+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T16:00:43.577005+0000","last_undegraded":"2024-04-25T16:00:43.577005+0000","last_fullsized":"2024-04-25T16:00:43.577005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14376,"num_write":371,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"36'387","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.202881+0000","last_change":"2024-04-25T16:01:40.202881+0000","last_active":"2024-04-25T16:01:40.202881+0000","last_peered":"2024-04-25T16:01:40.202881+0000","last_clean":"2024-04-25T16:01:40.202881+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T16:01:40.202881+0000","last_undegraded":"2024-04-25T16:01:40.202881+0000","last_fullsized":"2024-04-25T16:01:40.202881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'387","last_scrub_stamp":"2024-04-25T16:01:40.202546+0000","last_deep_scrub":"36'387","last_deep_scrub_stamp":"2024-04-25T16:01:40.202546+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.202546+0000","objects_scrubbed":4,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:47.676220+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":45080,"num_write":303,"num_write_kb":12463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'366","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.434004+0000","last_change":"2024-04-25T16:01:41.434004+0000","last_active":"2024-04-25T16:01:41.434004+0000","last_peered":"2024-04-25T16:01:41.434004+0000","last_clean":"2024-04-25T16:01:41.434004+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T16:01:41.434004+0000","last_undegraded":"2024-04-25T16:01:41.434004+0000","last_fullsized":"2024-04-25T16:01:41.434004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'366","last_scrub_stamp":"2024-04-25T16:01:41.433704+0000","last_deep_scrub":"36'366","last_deep_scrub_stamp":"2024-04-25T16:01:41.433704+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.433704+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:53.679713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24540,"num_write":344,"num_write_kb":42834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'119","reported_seq":171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.594729+0000","last_change":"2024-04-25T16:01:21.594803+0000","last_active":"2024-04-25T16:01:21.594729+0000","last_peered":"2024-04-25T16:01:21.594729+0000","last_clean":"2024-04-25T16:01:21.594729+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T16:01:21.594729+0000","last_undegraded":"2024-04-25T16:01:21.594729+0000","last_fullsized":"2024-04-25T16:01:21.594729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-25T16:01:21.594415+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-25T16:01:21.594415+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.594415+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:28.575399+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":59,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'379","reported_seq":442,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.618902+0000","last_change":"2024-04-25T15:54:20.429049+0000","last_active":"2024-04-25T16:00:43.618902+0000","last_peered":"2024-04-25T16:00:43.618902+0000","last_clean":"2024-04-25T16:00:43.618902+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T16:00:43.618902+0000","last_undegraded":"2024-04-25T16:00:43.618902+0000","last_fullsized":"2024-04-25T16:00:43.618902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17536,"num_write":366,"num_write_kb":55228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"36'363","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.108945+0000","last_change":"2024-04-25T16:01:38.108945+0000","last_active":"2024-04-25T16:01:38.108945+0000","last_peered":"2024-04-25T16:01:38.108945+0000","last_clean":"2024-04-25T16:01:38.108945+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T16:01:38.108945+0000","last_undegraded":"2024-04-25T16:01:38.108945+0000","last_fullsized":"2024-04-25T16:01:38.108945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'363","last_scrub_stamp":"2024-04-25T16:01:38.108596+0000","last_deep_scrub":"36'363","last_deep_scrub_stamp":"2024-04-25T16:01:38.108596+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.108596+0000","objects_scrubbed":2,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:17.270197+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":312,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'376","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.278484+0000","last_change":"2024-04-25T16:01:25.278484+0000","last_active":"2024-04-25T16:01:25.278484+0000","last_peered":"2024-04-25T16:01:25.278484+0000","last_clean":"2024-04-25T16:01:25.278484+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T16:01:25.278484+0000","last_undegraded":"2024-04-25T16:01:25.278484+0000","last_fullsized":"2024-04-25T16:01:25.278484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'376","last_scrub_stamp":"2024-04-25T16:01:25.278198+0000","last_deep_scrub":"36'376","last_deep_scrub_stamp":"2024-04-25T16:01:25.278198+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.278198+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:38.512487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31362,"num_write":348,"num_write_kb":63308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'410","reported_seq":466,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.656823+0000","last_change":"2024-04-25T16:01:27.656933+0000","last_active":"2024-04-25T16:01:27.656823+0000","last_peered":"2024-04-25T16:01:27.656823+0000","last_clean":"2024-04-25T16:01:27.656823+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T16:01:27.656823+0000","last_undegraded":"2024-04-25T16:01:27.656823+0000","last_fullsized":"2024-04-25T16:01:27.656823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'410","last_scrub_stamp":"2024-04-25T16:01:27.656586+0000","last_deep_scrub":"36'410","last_deep_scrub_stamp":"2024-04-25T16:01:27.656586+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.656586+0000","objects_scrubbed":3,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:21.941941+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":355,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'439","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.847430+0000","last_change":"2024-04-25T16:01:38.847522+0000","last_active":"2024-04-25T16:01:38.847430+0000","last_peered":"2024-04-25T16:01:38.847430+0000","last_clean":"2024-04-25T16:01:38.847430+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T16:01:38.847430+0000","last_undegraded":"2024-04-25T16:01:38.847430+0000","last_fullsized":"2024-04-25T16:01:38.847430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'439","last_scrub_stamp":"2024-04-25T16:01:38.847196+0000","last_deep_scrub":"31'439","last_deep_scrub_stamp":"2024-04-25T16:01:38.847196+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.847196+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:36.294066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15953,"num_write":415,"num_write_kb":91831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"36'454","reported_seq":590,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.703005+0000","last_change":"2024-04-25T16:01:25.703074+0000","last_active":"2024-04-25T16:01:25.703005+0000","last_peered":"2024-04-25T16:01:25.703005+0000","last_clean":"2024-04-25T16:01:25.703005+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T16:01:25.703005+0000","last_undegraded":"2024-04-25T16:01:25.703005+0000","last_fullsized":"2024-04-25T16:01:25.703005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'454","last_scrub_stamp":"2024-04-25T16:01:25.702790+0000","last_deep_scrub":"36'454","last_deep_scrub_stamp":"2024-04-25T16:01:25.702790+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.702790+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:10.496690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":34259,"num_write":426,"num_write_kb":109355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'212","reported_seq":285,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.169166+0000","last_change":"2024-04-25T16:01:41.169262+0000","last_active":"2024-04-25T16:01:41.169166+0000","last_peered":"2024-04-25T16:01:41.169166+0000","last_clean":"2024-04-25T16:01:41.169166+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T16:01:41.169166+0000","last_undegraded":"2024-04-25T16:01:41.169166+0000","last_fullsized":"2024-04-25T16:01:41.169166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'212","last_scrub_stamp":"2024-04-25T16:01:41.168935+0000","last_deep_scrub":"36'212","last_deep_scrub_stamp":"2024-04-25T16:01:41.168935+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.168935+0000","objects_scrubbed":3,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:03.569134+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":32780,"num_write":144,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'519","reported_seq":577,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.647558+0000","last_change":"2024-04-25T16:01:25.647646+0000","last_active":"2024-04-25T16:01:25.647558+0000","last_peered":"2024-04-25T16:01:25.647558+0000","last_clean":"2024-04-25T16:01:25.647558+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T16:01:25.647558+0000","last_undegraded":"2024-04-25T16:01:25.647558+0000","last_fullsized":"2024-04-25T16:01:25.647558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'519","last_scrub_stamp":"2024-04-25T16:01:25.647270+0000","last_deep_scrub":"36'519","last_deep_scrub_stamp":"2024-04-25T16:01:25.647270+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.647270+0000","objects_scrubbed":2,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:41.196713+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":469,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'399","reported_seq":488,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.598793+0000","last_change":"2024-04-25T16:01:32.598866+0000","last_active":"2024-04-25T16:01:32.598793+0000","last_peered":"2024-04-25T16:01:32.598793+0000","last_clean":"2024-04-25T16:01:32.598793+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T16:01:32.598793+0000","last_undegraded":"2024-04-25T16:01:32.598793+0000","last_fullsized":"2024-04-25T16:01:32.598793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'399","last_scrub_stamp":"2024-04-25T16:01:32.598539+0000","last_deep_scrub":"31'399","last_deep_scrub_stamp":"2024-04-25T16:01:32.598539+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.598539+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:59.630235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":26873,"num_write":378,"num_write_kb":71246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"35'429","reported_seq":553,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.523455+0000","last_change":"2024-04-25T16:01:34.523575+0000","last_active":"2024-04-25T16:01:34.523455+0000","last_peered":"2024-04-25T16:01:34.523455+0000","last_clean":"2024-04-25T16:01:34.523455+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T16:01:34.523455+0000","last_undegraded":"2024-04-25T16:01:34.523455+0000","last_fullsized":"2024-04-25T16:01:34.523455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'429","last_scrub_stamp":"2024-04-25T16:01:34.523199+0000","last_deep_scrub":"35'429","last_deep_scrub_stamp":"2024-04-25T16:01:34.523199+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.523199+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:13.684800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42040,"num_write":408,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'201","reported_seq":262,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.885258+0000","last_change":"2024-04-25T16:01:31.885344+0000","last_active":"2024-04-25T16:01:31.885258+0000","last_peered":"2024-04-25T16:01:31.885258+0000","last_clean":"2024-04-25T16:01:31.885258+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T16:01:31.885258+0000","last_undegraded":"2024-04-25T16:01:31.885258+0000","last_fullsized":"2024-04-25T16:01:31.885258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'201","last_scrub_stamp":"2024-04-25T16:01:31.885029+0000","last_deep_scrub":"36'201","last_deep_scrub_stamp":"2024-04-25T16:01:31.885029+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.885029+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:23.557782+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'60","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.599976+0000","last_change":"2024-04-25T16:01:35.600135+0000","last_active":"2024-04-25T16:01:35.599976+0000","last_peered":"2024-04-25T16:01:35.599976+0000","last_clean":"2024-04-25T16:01:35.599976+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T16:01:35.599976+0000","last_undegraded":"2024-04-25T16:01:35.599976+0000","last_fullsized":"2024-04-25T16:01:35.599976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2024-04-25T16:01:35.599701+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2024-04-25T16:01:35.599701+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.599701+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:09.646442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'380","reported_seq":471,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.549379+0000","last_change":"2024-04-25T16:01:37.549458+0000","last_active":"2024-04-25T16:01:37.549379+0000","last_peered":"2024-04-25T16:01:37.549379+0000","last_clean":"2024-04-25T16:01:37.549379+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T16:01:37.549379+0000","last_undegraded":"2024-04-25T16:01:37.549379+0000","last_fullsized":"2024-04-25T16:01:37.549379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2024-04-25T16:01:37.549134+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2024-04-25T16:01:37.549134+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.549134+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:21.477197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24884,"num_write":362,"num_write_kb":71575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"35'377","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.585702+0000","last_change":"2024-04-25T15:54:10.239926+0000","last_active":"2024-04-25T16:00:43.585702+0000","last_peered":"2024-04-25T16:00:43.585702+0000","last_clean":"2024-04-25T16:00:43.585702+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T16:00:43.585702+0000","last_undegraded":"2024-04-25T16:00:43.585702+0000","last_fullsized":"2024-04-25T16:00:43.585702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7657,"num_write":351,"num_write_kb":21765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'69","reported_seq":127,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.903704+0000","last_change":"2024-04-25T16:01:30.903844+0000","last_active":"2024-04-25T16:01:30.903704+0000","last_peered":"2024-04-25T16:01:30.903704+0000","last_clean":"2024-04-25T16:01:30.903704+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T16:01:30.903704+0000","last_undegraded":"2024-04-25T16:01:30.903704+0000","last_fullsized":"2024-04-25T16:01:30.903704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'69","last_scrub_stamp":"2024-04-25T16:01:30.903381+0000","last_deep_scrub":"36'69","last_deep_scrub_stamp":"2024-04-25T16:01:30.903381+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.903381+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:02.455987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'196","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.954136+0000","last_change":"2024-04-25T16:01:20.954307+0000","last_active":"2024-04-25T16:01:20.954136+0000","last_peered":"2024-04-25T16:01:20.954136+0000","last_clean":"2024-04-25T16:01:20.954136+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T16:01:20.954136+0000","last_undegraded":"2024-04-25T16:01:20.954136+0000","last_fullsized":"2024-04-25T16:01:20.954136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'196","last_scrub_stamp":"2024-04-25T16:01:20.953850+0000","last_deep_scrub":"36'196","last_deep_scrub_stamp":"2024-04-25T16:01:20.953850+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.953850+0000","objects_scrubbed":2,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.572425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":146,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"31'395","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:07.213480+0000","last_change":"2024-04-25T15:54:20.428722+0000","last_active":"2024-04-25T16:01:07.213480+0000","last_peered":"2024-04-25T16:01:07.213480+0000","last_clean":"2024-04-25T16:01:07.213480+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T16:01:07.213480+0000","last_undegraded":"2024-04-25T16:01:07.213480+0000","last_fullsized":"2024-04-25T16:01:07.213480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23834,"num_write":371,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"36'432","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.591822+0000","last_change":"2024-04-25T16:01:29.591889+0000","last_active":"2024-04-25T16:01:29.591822+0000","last_peered":"2024-04-25T16:01:29.591822+0000","last_clean":"2024-04-25T16:01:29.591822+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T16:01:29.591822+0000","last_undegraded":"2024-04-25T16:01:29.591822+0000","last_fullsized":"2024-04-25T16:01:29.591822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'432","last_scrub_stamp":"2024-04-25T16:01:29.591602+0000","last_deep_scrub":"36'432","last_deep_scrub_stamp":"2024-04-25T16:01:29.591602+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.591602+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:27.271312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1051,"num_write":404,"num_write_kb":46183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'634","reported_seq":695,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.141165+0000","last_change":"2024-04-25T16:01:37.141240+0000","last_active":"2024-04-25T16:01:37.141165+0000","last_peered":"2024-04-25T16:01:37.141165+0000","last_clean":"2024-04-25T16:01:37.141165+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T16:01:37.141165+0000","last_undegraded":"2024-04-25T16:01:37.141165+0000","last_fullsized":"2024-04-25T16:01:37.141165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'634","last_scrub_stamp":"2024-04-25T16:01:37.140954+0000","last_deep_scrub":"36'634","last_deep_scrub_stamp":"2024-04-25T16:01:37.140954+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.140954+0000","objects_scrubbed":1,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:03.068287+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":576,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'341","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.633927+0000","last_change":"2024-04-25T16:01:22.634008+0000","last_active":"2024-04-25T16:01:22.633927+0000","last_peered":"2024-04-25T16:01:22.633927+0000","last_clean":"2024-04-25T16:01:22.633927+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T16:01:22.633927+0000","last_undegraded":"2024-04-25T16:01:22.633927+0000","last_fullsized":"2024-04-25T16:01:22.633927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'341","last_scrub_stamp":"2024-04-25T16:01:22.633686+0000","last_deep_scrub":"36'341","last_deep_scrub_stamp":"2024-04-25T16:01:22.633686+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.633686+0000","objects_scrubbed":2,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:23.389079+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":287,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"31'408","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.582838+0000","last_change":"2024-04-25T15:54:20.424562+0000","last_active":"2024-04-25T16:00:43.582838+0000","last_peered":"2024-04-25T16:00:43.582838+0000","last_clean":"2024-04-25T16:00:43.582838+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T16:00:43.582838+0000","last_undegraded":"2024-04-25T16:00:43.582838+0000","last_fullsized":"2024-04-25T16:00:43.582838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":22153,"num_write":390,"num_write_kb":51497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"36'445","reported_seq":533,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.043426+0000","last_change":"2024-04-25T16:01:28.043496+0000","last_active":"2024-04-25T16:01:28.043426+0000","last_peered":"2024-04-25T16:01:28.043426+0000","last_clean":"2024-04-25T16:01:28.043426+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T16:01:28.043426+0000","last_undegraded":"2024-04-25T16:01:28.043426+0000","last_fullsized":"2024-04-25T16:01:28.043426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'445","last_scrub_stamp":"2024-04-25T16:01:28.043201+0000","last_deep_scrub":"36'445","last_deep_scrub_stamp":"2024-04-25T16:01:28.043201+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.043201+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:11.171831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9563,"num_write":414,"num_write_kb":59478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'73","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.700560+0000","last_change":"2024-04-25T16:01:29.700707+0000","last_active":"2024-04-25T16:01:29.700560+0000","last_peered":"2024-04-25T16:01:29.700560+0000","last_clean":"2024-04-25T16:01:29.700560+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T16:01:29.700560+0000","last_undegraded":"2024-04-25T16:01:29.700560+0000","last_fullsized":"2024-04-25T16:01:29.700560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-04-25T16:01:29.700264+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-04-25T16:01:29.700264+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.700264+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:45.249707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'292","reported_seq":558,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.658483+0000","last_change":"2024-04-25T16:01:26.658558+0000","last_active":"2024-04-25T16:01:26.658483+0000","last_peered":"2024-04-25T16:01:26.658483+0000","last_clean":"2024-04-25T16:01:26.658483+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T16:01:26.658483+0000","last_undegraded":"2024-04-25T16:01:26.658483+0000","last_fullsized":"2024-04-25T16:01:26.658483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-04-25T16:01:26.658271+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-04-25T16:01:26.658271+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.658271+0000","objects_scrubbed":1,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:09.786901+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465994,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":1569,"num_write":227,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"31'396","reported_seq":479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.605944+0000","last_change":"2024-04-25T16:01:39.606023+0000","last_active":"2024-04-25T16:01:39.605944+0000","last_peered":"2024-04-25T16:01:39.605944+0000","last_clean":"2024-04-25T16:01:39.605944+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T16:01:39.605944+0000","last_undegraded":"2024-04-25T16:01:39.605944+0000","last_fullsized":"2024-04-25T16:01:39.605944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'396","last_scrub_stamp":"2024-04-25T16:01:39.605684+0000","last_deep_scrub":"31'396","last_deep_scrub_stamp":"2024-04-25T16:01:39.605684+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.605684+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:18.767285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17201,"num_write":368,"num_write_kb":116540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'348","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.545334+0000","last_change":"2024-04-25T16:01:28.545404+0000","last_active":"2024-04-25T16:01:28.545334+0000","last_peered":"2024-04-25T16:01:28.545334+0000","last_clean":"2024-04-25T16:01:28.545334+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T16:01:28.545334+0000","last_undegraded":"2024-04-25T16:01:28.545334+0000","last_fullsized":"2024-04-25T16:01:28.545334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'348","last_scrub_stamp":"2024-04-25T16:01:28.545101+0000","last_deep_scrub":"36'348","last_deep_scrub_stamp":"2024-04-25T16:01:28.545101+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.545101+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:07.078710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11261,"num_write":326,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"36'221","reported_seq":287,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.882499+0000","last_change":"2024-04-25T16:01:32.882574+0000","last_active":"2024-04-25T16:01:32.882499+0000","last_peered":"2024-04-25T16:01:32.882499+0000","last_clean":"2024-04-25T16:01:32.882499+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T16:01:32.882499+0000","last_undegraded":"2024-04-25T16:01:32.882499+0000","last_fullsized":"2024-04-25T16:01:32.882499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'221","last_scrub_stamp":"2024-04-25T16:01:32.882276+0000","last_deep_scrub":"36'221","last_deep_scrub_stamp":"2024-04-25T16:01:32.882276+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.882276+0000","objects_scrubbed":1,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:25.310442+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":264,"num_write":447,"num_write_kb":1604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'417","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.548654+0000","last_change":"2024-04-25T16:01:27.548736+0000","last_active":"2024-04-25T16:01:27.548654+0000","last_peered":"2024-04-25T16:01:27.548654+0000","last_clean":"2024-04-25T16:01:27.548654+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T16:01:27.548654+0000","last_undegraded":"2024-04-25T16:01:27.548654+0000","last_fullsized":"2024-04-25T16:01:27.548654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'417","last_scrub_stamp":"2024-04-25T16:01:27.548435+0000","last_deep_scrub":"36'417","last_deep_scrub_stamp":"2024-04-25T16:01:27.548435+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.548435+0000","objects_scrubbed":2,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:00.322326+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":348,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"31'355","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.750393+0000","last_change":"2024-04-25T16:01:38.750465+0000","last_active":"2024-04-25T16:01:38.750393+0000","last_peered":"2024-04-25T16:01:38.750393+0000","last_clean":"2024-04-25T16:01:38.750393+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T16:01:38.750393+0000","last_undegraded":"2024-04-25T16:01:38.750393+0000","last_fullsized":"2024-04-25T16:01:38.750393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'355","last_scrub_stamp":"2024-04-25T16:01:38.750164+0000","last_deep_scrub":"31'355","last_deep_scrub_stamp":"2024-04-25T16:01:38.750164+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.750164+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:10.302769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":811,"num_write":334,"num_write_kb":50274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"36'395","reported_seq":487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.895277+0000","last_change":"2024-04-25T16:01:36.895347+0000","last_active":"2024-04-25T16:01:36.895277+0000","last_peered":"2024-04-25T16:01:36.895277+0000","last_clean":"2024-04-25T16:01:36.895277+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T16:01:36.895277+0000","last_undegraded":"2024-04-25T16:01:36.895277+0000","last_fullsized":"2024-04-25T16:01:36.895277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'395","last_scrub_stamp":"2024-04-25T16:01:36.895051+0000","last_deep_scrub":"36'395","last_deep_scrub_stamp":"2024-04-25T16:01:36.895051+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.895051+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.823113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17222,"num_write":367,"num_write_kb":107915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'212","reported_seq":272,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.150050+0000","last_change":"2024-04-25T16:01:39.150124+0000","last_active":"2024-04-25T16:01:39.150050+0000","last_peered":"2024-04-25T16:01:39.150050+0000","last_clean":"2024-04-25T16:01:39.150050+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T16:01:39.150050+0000","last_undegraded":"2024-04-25T16:01:39.150050+0000","last_fullsized":"2024-04-25T16:01:39.150050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'212","last_scrub_stamp":"2024-04-25T16:01:39.149816+0000","last_deep_scrub":"36'212","last_deep_scrub_stamp":"2024-04-25T16:01:39.149816+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.149816+0000","objects_scrubbed":1,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:03.358197+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":156,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'73","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.121425+0000","last_change":"2024-04-25T16:01:34.121502+0000","last_active":"2024-04-25T16:01:34.121425+0000","last_peered":"2024-04-25T16:01:34.121425+0000","last_clean":"2024-04-25T16:01:34.121425+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T16:01:34.121425+0000","last_undegraded":"2024-04-25T16:01:34.121425+0000","last_fullsized":"2024-04-25T16:01:34.121425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-04-25T16:01:34.121198+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-04-25T16:01:34.121198+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.121198+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:07.295163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'419","reported_seq":527,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.126656+0000","last_change":"2024-04-25T16:01:38.126724+0000","last_active":"2024-04-25T16:01:38.126656+0000","last_peered":"2024-04-25T16:01:38.126656+0000","last_clean":"2024-04-25T16:01:38.126656+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T16:01:38.126656+0000","last_undegraded":"2024-04-25T16:01:38.126656+0000","last_fullsized":"2024-04-25T16:01:38.126656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'419","last_scrub_stamp":"2024-04-25T16:01:38.126389+0000","last_deep_scrub":"31'419","last_deep_scrub_stamp":"2024-04-25T16:01:38.126389+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.126389+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:15.968299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":27915,"num_write":400,"num_write_kb":113619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'436","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:51.704980+0000","last_change":"2024-04-25T15:54:50.214162+0000","last_active":"2024-04-25T16:00:51.704980+0000","last_peered":"2024-04-25T16:00:51.704980+0000","last_clean":"2024-04-25T16:00:51.704980+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T16:00:51.704980+0000","last_undegraded":"2024-04-25T16:00:51.704980+0000","last_fullsized":"2024-04-25T16:00:51.704980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48041,"num_write":405,"num_write_kb":79758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'60","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.903681+0000","last_change":"2024-04-25T16:01:33.903833+0000","last_active":"2024-04-25T16:01:33.903681+0000","last_peered":"2024-04-25T16:01:33.903681+0000","last_clean":"2024-04-25T16:01:33.903681+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T16:01:33.903681+0000","last_undegraded":"2024-04-25T16:01:33.903681+0000","last_fullsized":"2024-04-25T16:01:33.903681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-04-25T16:01:33.903418+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-04-25T16:01:33.903418+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.903418+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:46.609264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'649","reported_seq":706,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.067718+0000","last_change":"2024-04-25T16:01:24.067806+0000","last_active":"2024-04-25T16:01:24.067718+0000","last_peered":"2024-04-25T16:01:24.067718+0000","last_clean":"2024-04-25T16:01:24.067718+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T16:01:24.067718+0000","last_undegraded":"2024-04-25T16:01:24.067718+0000","last_fullsized":"2024-04-25T16:01:24.067718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'649","last_scrub_stamp":"2024-04-25T16:01:24.067409+0000","last_deep_scrub":"36'649","last_deep_scrub_stamp":"2024-04-25T16:01:24.067409+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.067409+0000","objects_scrubbed":2,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:07.196039+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":21962,"num_write":588,"num_write_kb":8473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'398","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.128317+0000","last_change":"2024-04-25T16:01:37.128388+0000","last_active":"2024-04-25T16:01:37.128317+0000","last_peered":"2024-04-25T16:01:37.128317+0000","last_clean":"2024-04-25T16:01:37.128317+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T16:01:37.128317+0000","last_undegraded":"2024-04-25T16:01:37.128317+0000","last_fullsized":"2024-04-25T16:01:37.128317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'398","last_scrub_stamp":"2024-04-25T16:01:37.128076+0000","last_deep_scrub":"31'398","last_deep_scrub_stamp":"2024-04-25T16:01:37.128076+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.128076+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:49.833923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18043,"num_write":367,"num_write_kb":54591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'382","reported_seq":450,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.552931+0000","last_change":"2024-04-25T16:01:30.553007+0000","last_active":"2024-04-25T16:01:30.552931+0000","last_peered":"2024-04-25T16:01:30.552931+0000","last_clean":"2024-04-25T16:01:30.552931+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T16:01:30.552931+0000","last_undegraded":"2024-04-25T16:01:30.552931+0000","last_fullsized":"2024-04-25T16:01:30.552931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:30.552674+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:30.552674+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.552674+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:16.111582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":351,"num_write_kb":26238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'643","reported_seq":709,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.562019+0000","last_change":"2024-04-25T16:01:36.562096+0000","last_active":"2024-04-25T16:01:36.562019+0000","last_peered":"2024-04-25T16:01:36.562019+0000","last_clean":"2024-04-25T16:01:36.562019+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T16:01:36.562019+0000","last_undegraded":"2024-04-25T16:01:36.562019+0000","last_fullsized":"2024-04-25T16:01:36.562019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'643","last_scrub_stamp":"2024-04-25T16:01:36.561812+0000","last_deep_scrub":"36'643","last_deep_scrub_stamp":"2024-04-25T16:01:36.561812+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.561812+0000","objects_scrubbed":2,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.723413+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":575,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'63","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.983263+0000","last_change":"2024-04-25T16:01:21.983314+0000","last_active":"2024-04-25T16:01:21.983263+0000","last_peered":"2024-04-25T16:01:21.983263+0000","last_clean":"2024-04-25T16:01:21.983263+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T16:01:21.983263+0000","last_undegraded":"2024-04-25T16:01:21.983263+0000","last_fullsized":"2024-04-25T16:01:21.983263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-04-25T16:01:21.983129+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-04-25T16:01:21.983129+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.983129+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:47.119193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'417","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.603251+0000","last_change":"2024-04-25T16:01:31.603434+0000","last_active":"2024-04-25T16:01:31.603251+0000","last_peered":"2024-04-25T16:01:31.603251+0000","last_clean":"2024-04-25T16:01:31.603251+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T16:01:31.603251+0000","last_undegraded":"2024-04-25T16:01:31.603251+0000","last_fullsized":"2024-04-25T16:01:31.603251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'417","last_scrub_stamp":"2024-04-25T16:01:31.602953+0000","last_deep_scrub":"31'417","last_deep_scrub_stamp":"2024-04-25T16:01:31.602953+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.602953+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:47.152396+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":4695,"num_write":394,"num_write_kb":63230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'383","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.861581+0000","last_change":"2024-04-25T16:01:35.861654+0000","last_active":"2024-04-25T16:01:35.861581+0000","last_peered":"2024-04-25T16:01:35.861581+0000","last_clean":"2024-04-25T16:01:35.861581+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T16:01:35.861581+0000","last_undegraded":"2024-04-25T16:01:35.861581+0000","last_fullsized":"2024-04-25T16:01:35.861581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'383","last_scrub_stamp":"2024-04-25T16:01:35.861353+0000","last_deep_scrub":"36'383","last_deep_scrub_stamp":"2024-04-25T16:01:35.861353+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.861353+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:55.894256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":357,"num_write_kb":25875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'325","reported_seq":642,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.484388+0000","last_change":"2024-04-25T16:01:23.484470+0000","last_active":"2024-04-25T16:01:23.484388+0000","last_peered":"2024-04-25T16:01:23.484388+0000","last_clean":"2024-04-25T16:01:23.484388+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T16:01:23.484388+0000","last_undegraded":"2024-04-25T16:01:23.484388+0000","last_fullsized":"2024-04-25T16:01:23.484388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'325","last_scrub_stamp":"2024-04-25T16:01:23.484150+0000","last_deep_scrub":"36'325","last_deep_scrub_stamp":"2024-04-25T16:01:23.484150+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.484150+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:08.505818+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":1598,"num_write":259,"num_write_kb":1606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'74","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.950225+0000","last_change":"2024-04-25T16:01:25.950309+0000","last_active":"2024-04-25T16:01:25.950225+0000","last_peered":"2024-04-25T16:01:25.950225+0000","last_clean":"2024-04-25T16:01:25.950225+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T16:01:25.950225+0000","last_undegraded":"2024-04-25T16:01:25.950225+0000","last_fullsized":"2024-04-25T16:01:25.950225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-25T16:01:25.950003+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-25T16:01:25.950003+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.950003+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:39.184292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'351","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:52.210433+0000","last_change":"2024-04-25T15:54:20.447253+0000","last_active":"2024-04-25T16:00:52.210433+0000","last_peered":"2024-04-25T16:00:52.210433+0000","last_clean":"2024-04-25T16:00:52.210433+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T16:00:52.210433+0000","last_undegraded":"2024-04-25T16:00:52.210433+0000","last_fullsized":"2024-04-25T16:00:52.210433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19848,"num_write":332,"num_write_kb":34180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"36'414","reported_seq":533,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.028016+0000","last_change":"2024-04-25T16:01:26.028083+0000","last_active":"2024-04-25T16:01:26.028016+0000","last_peered":"2024-04-25T16:01:26.028016+0000","last_clean":"2024-04-25T16:01:26.028016+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T16:01:26.028016+0000","last_undegraded":"2024-04-25T16:01:26.028016+0000","last_fullsized":"2024-04-25T16:01:26.028016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'414","last_scrub_stamp":"2024-04-25T16:01:26.027800+0000","last_deep_scrub":"36'414","last_deep_scrub_stamp":"2024-04-25T16:01:26.027800+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.027800+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:08.877425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":27907,"num_write":382,"num_write_kb":96848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'589","reported_seq":656,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.105216+0000","last_change":"2024-04-25T16:01:36.105294+0000","last_active":"2024-04-25T16:01:36.105216+0000","last_peered":"2024-04-25T16:01:36.105216+0000","last_clean":"2024-04-25T16:01:36.105216+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T16:01:36.105216+0000","last_undegraded":"2024-04-25T16:01:36.105216+0000","last_fullsized":"2024-04-25T16:01:36.105216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'589","last_scrub_stamp":"2024-04-25T16:01:36.104989+0000","last_deep_scrub":"36'589","last_deep_scrub_stamp":"2024-04-25T16:01:36.104989+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.104989+0000","objects_scrubbed":2,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.033051+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":32151,"num_write":527,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'239","reported_seq":295,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.045609+0000","last_change":"2024-04-25T16:01:31.045684+0000","last_active":"2024-04-25T16:01:31.045609+0000","last_peered":"2024-04-25T16:01:31.045609+0000","last_clean":"2024-04-25T16:01:31.045609+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T16:01:31.045609+0000","last_undegraded":"2024-04-25T16:01:31.045609+0000","last_fullsized":"2024-04-25T16:01:31.045609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'239","last_scrub_stamp":"2024-04-25T16:01:31.045376+0000","last_deep_scrub":"36'239","last_deep_scrub_stamp":"2024-04-25T16:01:31.045376+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.045376+0000","objects_scrubbed":1,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:34.277966+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":156,"num_write":459,"num_write_kb":1609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'379","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.018160+0000","last_change":"2024-04-25T16:01:31.018230+0000","last_active":"2024-04-25T16:01:31.018160+0000","last_peered":"2024-04-25T16:01:31.018160+0000","last_clean":"2024-04-25T16:01:31.018160+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T16:01:31.018160+0000","last_undegraded":"2024-04-25T16:01:31.018160+0000","last_fullsized":"2024-04-25T16:01:31.018160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'379","last_scrub_stamp":"2024-04-25T16:01:31.017905+0000","last_deep_scrub":"31'379","last_deep_scrub_stamp":"2024-04-25T16:01:31.017905+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.017905+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:03.791796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":4720,"num_write":350,"num_write_kb":42976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'353","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.515406+0000","last_change":"2024-04-25T16:01:24.515477+0000","last_active":"2024-04-25T16:01:24.515406+0000","last_peered":"2024-04-25T16:01:24.515406+0000","last_clean":"2024-04-25T16:01:24.515406+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T16:01:24.515406+0000","last_undegraded":"2024-04-25T16:01:24.515406+0000","last_fullsized":"2024-04-25T16:01:24.515406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'353","last_scrub_stamp":"2024-04-25T16:01:24.515183+0000","last_deep_scrub":"36'353","last_deep_scrub_stamp":"2024-04-25T16:01:24.515183+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.515183+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:10.074091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27299,"num_write":333,"num_write_kb":58716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'66","reported_seq":124,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.485676+0000","last_change":"2024-04-25T16:01:34.485748+0000","last_active":"2024-04-25T16:01:34.485676+0000","last_peered":"2024-04-25T16:01:34.485676+0000","last_clean":"2024-04-25T16:01:34.485676+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T16:01:34.485676+0000","last_undegraded":"2024-04-25T16:01:34.485676+0000","last_fullsized":"2024-04-25T16:01:34.485676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-04-25T16:01:34.485459+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-04-25T16:01:34.485459+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.485459+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:18.413521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"36'74","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.051747+0000","last_change":"2024-04-25T16:01:35.051834+0000","last_active":"2024-04-25T16:01:35.051747+0000","last_peered":"2024-04-25T16:01:35.051747+0000","last_clean":"2024-04-25T16:01:35.051747+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T16:01:35.051747+0000","last_undegraded":"2024-04-25T16:01:35.051747+0000","last_fullsized":"2024-04-25T16:01:35.051747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-25T16:01:35.051512+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-25T16:01:35.051512+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.051512+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:55.084416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'209","reported_seq":261,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.701501+0000","last_change":"2024-04-25T16:01:34.701575+0000","last_active":"2024-04-25T16:01:34.701501+0000","last_peered":"2024-04-25T16:01:34.701501+0000","last_clean":"2024-04-25T16:01:34.701501+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T16:01:34.701501+0000","last_undegraded":"2024-04-25T16:01:34.701501+0000","last_fullsized":"2024-04-25T16:01:34.701501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'209","last_scrub_stamp":"2024-04-25T16:01:34.701272+0000","last_deep_scrub":"36'209","last_deep_scrub_stamp":"2024-04-25T16:01:34.701272+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.701272+0000","objects_scrubbed":1,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:37.933861+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":141,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"31'402","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.565750+0000","last_change":"2024-04-25T16:01:34.565831+0000","last_active":"2024-04-25T16:01:34.565750+0000","last_peered":"2024-04-25T16:01:34.565750+0000","last_clean":"2024-04-25T16:01:34.565750+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T16:01:34.565750+0000","last_undegraded":"2024-04-25T16:01:34.565750+0000","last_fullsized":"2024-04-25T16:01:34.565750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'402","last_scrub_stamp":"2024-04-25T16:01:34.565518+0000","last_deep_scrub":"31'402","last_deep_scrub_stamp":"2024-04-25T16:01:34.565518+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.565518+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:28.850874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45941,"num_write":380,"num_write_kb":54783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'411","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:57.212210+0000","last_change":"2024-04-25T15:54:50.218519+0000","last_active":"2024-04-25T16:00:57.212210+0000","last_peered":"2024-04-25T16:00:57.212210+0000","last_clean":"2024-04-25T16:00:57.212210+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T16:00:57.212210+0000","last_undegraded":"2024-04-25T16:00:57.212210+0000","last_fullsized":"2024-04-25T16:00:57.212210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37252,"num_write":394,"num_write_kb":96094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'63","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.520538+0000","last_change":"2024-04-25T16:01:24.520610+0000","last_active":"2024-04-25T16:01:24.520538+0000","last_peered":"2024-04-25T16:01:24.520538+0000","last_clean":"2024-04-25T16:01:24.520538+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T16:01:24.520538+0000","last_undegraded":"2024-04-25T16:01:24.520538+0000","last_fullsized":"2024-04-25T16:01:24.520538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-04-25T16:01:24.520314+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-04-25T16:01:24.520314+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.520314+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:12.399532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'124","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.716353+0000","last_change":"2024-04-25T16:01:24.716425+0000","last_active":"2024-04-25T16:01:24.716353+0000","last_peered":"2024-04-25T16:01:24.716353+0000","last_clean":"2024-04-25T16:01:24.716353+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T16:01:24.716353+0000","last_undegraded":"2024-04-25T16:01:24.716353+0000","last_fullsized":"2024-04-25T16:01:24.716353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'124","last_scrub_stamp":"2024-04-25T16:01:24.716129+0000","last_deep_scrub":"36'124","last_deep_scrub_stamp":"2024-04-25T16:01:24.716129+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.716129+0000","objects_scrubbed":1,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:21.723844+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":75,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'444","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.452452+0000","last_change":"2024-04-25T16:01:20.452597+0000","last_active":"2024-04-25T16:01:20.452452+0000","last_peered":"2024-04-25T16:01:20.452452+0000","last_clean":"2024-04-25T16:01:20.452452+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T16:01:20.452452+0000","last_undegraded":"2024-04-25T16:01:20.452452+0000","last_fullsized":"2024-04-25T16:01:20.452452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'444","last_scrub_stamp":"2024-04-25T16:01:20.452192+0000","last_deep_scrub":"31'444","last_deep_scrub_stamp":"2024-04-25T16:01:20.452192+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.452192+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:35.419787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13011,"num_write":414,"num_write_kb":80257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'435","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.610750+0000","last_change":"2024-04-25T16:01:35.610750+0000","last_active":"2024-04-25T16:01:35.610750+0000","last_peered":"2024-04-25T16:01:35.610750+0000","last_clean":"2024-04-25T16:01:35.610750+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T16:01:35.610750+0000","last_undegraded":"2024-04-25T16:01:35.610750+0000","last_fullsized":"2024-04-25T16:01:35.610750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'435","last_scrub_stamp":"2024-04-25T16:01:35.610436+0000","last_deep_scrub":"36'435","last_deep_scrub_stamp":"2024-04-25T16:01:35.610436+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.610436+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:48.844725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14130,"num_write":408,"num_write_kb":39042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"36'577","reported_seq":644,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.940558+0000","last_change":"2024-04-25T16:01:29.940632+0000","last_active":"2024-04-25T16:01:29.940558+0000","last_peered":"2024-04-25T16:01:29.940558+0000","last_clean":"2024-04-25T16:01:29.940558+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T16:01:29.940558+0000","last_undegraded":"2024-04-25T16:01:29.940558+0000","last_fullsized":"2024-04-25T16:01:29.940558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'577","last_scrub_stamp":"2024-04-25T16:01:29.940327+0000","last_deep_scrub":"36'577","last_deep_scrub_stamp":"2024-04-25T16:01:29.940327+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.940327+0000","objects_scrubbed":2,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:03.114292+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":521,"num_write_kb":4332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'143","reported_seq":202,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.097720+0000","last_change":"2024-04-25T16:01:32.097818+0000","last_active":"2024-04-25T16:01:32.097720+0000","last_peered":"2024-04-25T16:01:32.097720+0000","last_clean":"2024-04-25T16:01:32.097720+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T16:01:32.097720+0000","last_undegraded":"2024-04-25T16:01:32.097720+0000","last_fullsized":"2024-04-25T16:01:32.097720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'143","last_scrub_stamp":"2024-04-25T16:01:32.097468+0000","last_deep_scrub":"36'143","last_deep_scrub_stamp":"2024-04-25T16:01:32.097468+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.097468+0000","objects_scrubbed":3,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:59.621705+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":20488,"num_write":73,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"31'446","reported_seq":516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:52.211113+0000","last_change":"2024-04-25T15:54:20.435306+0000","last_active":"2024-04-25T16:00:52.211113+0000","last_peered":"2024-04-25T16:00:52.211113+0000","last_clean":"2024-04-25T16:00:52.211113+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T16:00:52.211113+0000","last_undegraded":"2024-04-25T16:00:52.211113+0000","last_fullsized":"2024-04-25T16:00:52.211113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17909,"num_write":426,"num_write_kb":58918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'390","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.881272+0000","last_change":"2024-04-25T16:01:24.881339+0000","last_active":"2024-04-25T16:01:24.881272+0000","last_peered":"2024-04-25T16:01:24.881272+0000","last_clean":"2024-04-25T16:01:24.881272+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T16:01:24.881272+0000","last_undegraded":"2024-04-25T16:01:24.881272+0000","last_fullsized":"2024-04-25T16:01:24.881272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'390","last_scrub_stamp":"2024-04-25T16:01:24.881047+0000","last_deep_scrub":"36'390","last_deep_scrub_stamp":"2024-04-25T16:01:24.881047+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.881047+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:06.880337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39208,"num_write":362,"num_write_kb":67602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'285","reported_seq":355,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.448360+0000","last_change":"2024-04-25T16:01:22.448400+0000","last_active":"2024-04-25T16:01:22.448360+0000","last_peered":"2024-04-25T16:01:22.448360+0000","last_clean":"2024-04-25T16:01:22.448360+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T16:01:22.448360+0000","last_undegraded":"2024-04-25T16:01:22.448360+0000","last_fullsized":"2024-04-25T16:01:22.448360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-04-25T16:01:22.448254+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-04-25T16:01:22.448254+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.448254+0000","objects_scrubbed":2,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.798943+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":236,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'549","reported_seq":603,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.343513+0000","last_change":"2024-04-25T16:01:24.343590+0000","last_active":"2024-04-25T16:01:24.343513+0000","last_peered":"2024-04-25T16:01:24.343513+0000","last_clean":"2024-04-25T16:01:24.343513+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T16:01:24.343513+0000","last_undegraded":"2024-04-25T16:01:24.343513+0000","last_fullsized":"2024-04-25T16:01:24.343513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'549","last_scrub_stamp":"2024-04-25T16:01:24.343287+0000","last_deep_scrub":"36'549","last_deep_scrub_stamp":"2024-04-25T16:01:24.343287+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.343287+0000","objects_scrubbed":1,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:18.628643+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":499,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'422","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.531365+0000","last_change":"2024-04-25T16:01:28.531510+0000","last_active":"2024-04-25T16:01:28.531365+0000","last_peered":"2024-04-25T16:01:28.531365+0000","last_clean":"2024-04-25T16:01:28.531365+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T16:01:28.531365+0000","last_undegraded":"2024-04-25T16:01:28.531365+0000","last_fullsized":"2024-04-25T16:01:28.531365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'422","last_scrub_stamp":"2024-04-25T16:01:28.531003+0000","last_deep_scrub":"31'422","last_deep_scrub_stamp":"2024-04-25T16:01:28.531003+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.531003+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:13.659298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25440,"num_write":402,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'355","reported_seq":443,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.024907+0000","last_change":"2024-04-25T16:01:32.024978+0000","last_active":"2024-04-25T16:01:32.024907+0000","last_peered":"2024-04-25T16:01:32.024907+0000","last_clean":"2024-04-25T16:01:32.024907+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T16:01:32.024907+0000","last_undegraded":"2024-04-25T16:01:32.024907+0000","last_fullsized":"2024-04-25T16:01:32.024907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'355","last_scrub_stamp":"2024-04-25T16:01:32.024641+0000","last_deep_scrub":"36'355","last_deep_scrub_stamp":"2024-04-25T16:01:32.024641+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.024641+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:10.558251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21419,"num_write":332,"num_write_kb":54133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'187","reported_seq":254,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.652745+0000","last_change":"2024-04-25T16:01:28.652858+0000","last_active":"2024-04-25T16:01:28.652745+0000","last_peered":"2024-04-25T16:01:28.652745+0000","last_clean":"2024-04-25T16:01:28.652745+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T16:01:28.652745+0000","last_undegraded":"2024-04-25T16:01:28.652745+0000","last_fullsized":"2024-04-25T16:01:28.652745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'187","last_scrub_stamp":"2024-04-25T16:01:28.652515+0000","last_deep_scrub":"36'187","last_deep_scrub_stamp":"2024-04-25T16:01:28.652515+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.652515+0000","objects_scrubbed":2,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:41.886803+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":131,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"35'55","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.608704+0000","last_change":"2024-04-25T16:01:34.608794+0000","last_active":"2024-04-25T16:01:34.608704+0000","last_peered":"2024-04-25T16:01:34.608704+0000","last_clean":"2024-04-25T16:01:34.608704+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T16:01:34.608704+0000","last_undegraded":"2024-04-25T16:01:34.608704+0000","last_fullsized":"2024-04-25T16:01:34.608704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'55","last_scrub_stamp":"2024-04-25T16:01:34.608473+0000","last_deep_scrub":"35'55","last_deep_scrub_stamp":"2024-04-25T16:01:34.608473+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.608473+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:04.454360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"31'370","reported_seq":410,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.507258+0000","last_change":"2024-04-25T15:54:20.413186+0000","last_active":"2024-04-25T16:01:20.507258+0000","last_peered":"2024-04-25T16:01:20.507258+0000","last_clean":"2024-04-25T16:01:20.507258+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T16:01:20.507258+0000","last_undegraded":"2024-04-25T16:01:20.507258+0000","last_fullsized":"2024-04-25T16:01:20.507258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":42885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'464","reported_seq":585,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.989480+0000","last_change":"2024-04-25T16:01:27.989547+0000","last_active":"2024-04-25T16:01:27.989480+0000","last_peered":"2024-04-25T16:01:27.989480+0000","last_clean":"2024-04-25T16:01:27.989480+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T16:01:27.989480+0000","last_undegraded":"2024-04-25T16:01:27.989480+0000","last_fullsized":"2024-04-25T16:01:27.989480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'464","last_scrub_stamp":"2024-04-25T16:01:27.989256+0000","last_deep_scrub":"36'464","last_deep_scrub_stamp":"2024-04-25T16:01:27.989256+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.989256+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:55.513492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":34229,"num_write":431,"num_write_kb":50975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'307","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.490823+0000","last_change":"2024-04-25T16:01:21.490857+0000","last_active":"2024-04-25T16:01:21.490823+0000","last_peered":"2024-04-25T16:01:21.490823+0000","last_clean":"2024-04-25T16:01:21.490823+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T16:01:21.490823+0000","last_undegraded":"2024-04-25T16:01:21.490823+0000","last_fullsized":"2024-04-25T16:01:21.490823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'307","last_scrub_stamp":"2024-04-25T16:01:21.490742+0000","last_deep_scrub":"36'307","last_deep_scrub_stamp":"2024-04-25T16:01:21.490742+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.490742+0000","objects_scrubbed":5,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:52.725741+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":5709,"num_write":249,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'223","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.075474+0000","last_change":"2024-04-25T16:01:21.075474+0000","last_active":"2024-04-25T16:01:21.075474+0000","last_peered":"2024-04-25T16:01:21.075474+0000","last_clean":"2024-04-25T16:01:21.075474+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T16:01:21.075474+0000","last_undegraded":"2024-04-25T16:01:21.075474+0000","last_fullsized":"2024-04-25T16:01:21.075474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'223","last_scrub_stamp":"2024-04-25T16:01:21.075284+0000","last_deep_scrub":"36'223","last_deep_scrub_stamp":"2024-04-25T16:01:21.075284+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.075284+0000","objects_scrubbed":1,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.292680+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":181,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'411","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.611658+0000","last_change":"2024-04-25T15:54:20.430579+0000","last_active":"2024-04-25T16:01:21.611658+0000","last_peered":"2024-04-25T16:01:21.611658+0000","last_clean":"2024-04-25T16:01:21.611658+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T16:01:21.611658+0000","last_undegraded":"2024-04-25T16:01:21.611658+0000","last_fullsized":"2024-04-25T16:01:21.611658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4854,"num_write":381,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"36'439","reported_seq":531,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.711574+0000","last_change":"2024-04-25T16:01:31.711643+0000","last_active":"2024-04-25T16:01:31.711574+0000","last_peered":"2024-04-25T16:01:31.711574+0000","last_clean":"2024-04-25T16:01:31.711574+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T16:01:31.711574+0000","last_undegraded":"2024-04-25T16:01:31.711574+0000","last_fullsized":"2024-04-25T16:01:31.711574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'439","last_scrub_stamp":"2024-04-25T16:01:31.711352+0000","last_deep_scrub":"36'439","last_deep_scrub_stamp":"2024-04-25T16:01:31.711352+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.711352+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:23.713043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15516,"num_write":414,"num_write_kb":67395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'66","reported_seq":124,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.692051+0000","last_change":"2024-04-25T16:01:27.692189+0000","last_active":"2024-04-25T16:01:27.692051+0000","last_peered":"2024-04-25T16:01:27.692051+0000","last_clean":"2024-04-25T16:01:27.692051+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T16:01:27.692051+0000","last_undegraded":"2024-04-25T16:01:27.692051+0000","last_fullsized":"2024-04-25T16:01:27.692051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-25T16:01:27.691711+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-25T16:01:27.691711+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.691711+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:19.004008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'72","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.499875+0000","last_change":"2024-04-25T16:01:29.499875+0000","last_active":"2024-04-25T16:01:29.499875+0000","last_peered":"2024-04-25T16:01:29.499875+0000","last_clean":"2024-04-25T16:01:29.499875+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T16:01:29.499875+0000","last_undegraded":"2024-04-25T16:01:29.499875+0000","last_fullsized":"2024-04-25T16:01:29.499875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'72","last_scrub_stamp":"2024-04-25T16:01:29.499565+0000","last_deep_scrub":"31'72","last_deep_scrub_stamp":"2024-04-25T16:01:29.499565+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.499565+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:42.205411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'400","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.611618+0000","last_change":"2024-04-25T15:54:20.442055+0000","last_active":"2024-04-25T16:01:21.611618+0000","last_peered":"2024-04-25T16:01:21.611618+0000","last_clean":"2024-04-25T16:01:21.611618+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T16:01:21.611618+0000","last_undegraded":"2024-04-25T16:01:21.611618+0000","last_fullsized":"2024-04-25T16:01:21.611618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39850,"num_write":370,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"36'407","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.058296+0000","last_change":"2024-04-25T16:01:30.058376+0000","last_active":"2024-04-25T16:01:30.058296+0000","last_peered":"2024-04-25T16:01:30.058296+0000","last_clean":"2024-04-25T16:01:30.058296+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T16:01:30.058296+0000","last_undegraded":"2024-04-25T16:01:30.058296+0000","last_fullsized":"2024-04-25T16:01:30.058296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'407","last_scrub_stamp":"2024-04-25T16:01:30.058069+0000","last_deep_scrub":"36'407","last_deep_scrub_stamp":"2024-04-25T16:01:30.058069+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.058069+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:03.232034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":33246,"num_write":383,"num_write_kb":97231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"36'72","reported_seq":130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.476145+0000","last_change":"2024-04-25T16:01:35.476212+0000","last_active":"2024-04-25T16:01:35.476145+0000","last_peered":"2024-04-25T16:01:35.476145+0000","last_clean":"2024-04-25T16:01:35.476145+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T16:01:35.476145+0000","last_undegraded":"2024-04-25T16:01:35.476145+0000","last_fullsized":"2024-04-25T16:01:35.476145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'72","last_scrub_stamp":"2024-04-25T16:01:35.475909+0000","last_deep_scrub":"36'72","last_deep_scrub_stamp":"2024-04-25T16:01:35.475909+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.475909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:32.922778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'287","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.564778+0000","last_change":"2024-04-25T16:01:20.564778+0000","last_active":"2024-04-25T16:01:20.564778+0000","last_peered":"2024-04-25T16:01:20.564778+0000","last_clean":"2024-04-25T16:01:20.564778+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T16:01:20.564778+0000","last_undegraded":"2024-04-25T16:01:20.564778+0000","last_fullsized":"2024-04-25T16:01:20.564778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'287","last_scrub_stamp":"2024-04-25T16:01:20.564614+0000","last_deep_scrub":"36'287","last_deep_scrub_stamp":"2024-04-25T16:01:20.564614+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.564614+0000","objects_scrubbed":6,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:03.693244+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":28701,"num_write":224,"num_write_kb":12419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'384","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.558996+0000","last_change":"2024-04-25T16:01:33.559142+0000","last_active":"2024-04-25T16:01:33.558996+0000","last_peered":"2024-04-25T16:01:33.558996+0000","last_clean":"2024-04-25T16:01:33.558996+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T16:01:33.558996+0000","last_undegraded":"2024-04-25T16:01:33.558996+0000","last_fullsized":"2024-04-25T16:01:33.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'384","last_scrub_stamp":"2024-04-25T16:01:33.558727+0000","last_deep_scrub":"31'384","last_deep_scrub_stamp":"2024-04-25T16:01:33.558727+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.558727+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:59.486059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13411,"num_write":356,"num_write_kb":100243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'415","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.024413+0000","last_change":"2024-04-25T16:01:22.024488+0000","last_active":"2024-04-25T16:01:22.024413+0000","last_peered":"2024-04-25T16:01:22.024413+0000","last_clean":"2024-04-25T16:01:22.024413+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T16:01:22.024413+0000","last_undegraded":"2024-04-25T16:01:22.024413+0000","last_fullsized":"2024-04-25T16:01:22.024413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'415","last_scrub_stamp":"2024-04-25T16:01:22.024190+0000","last_deep_scrub":"36'415","last_deep_scrub_stamp":"2024-04-25T16:01:22.024190+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.024190+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:06.818089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13518,"num_write":393,"num_write_kb":67403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'929","reported_seq":1006,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.099807+0000","last_change":"2024-04-25T16:01:24.099974+0000","last_active":"2024-04-25T16:01:24.099807+0000","last_peered":"2024-04-25T16:01:24.099807+0000","last_clean":"2024-04-25T16:01:24.099807+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T16:01:24.099807+0000","last_undegraded":"2024-04-25T16:01:24.099807+0000","last_fullsized":"2024-04-25T16:01:24.099807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'929","last_scrub_stamp":"2024-04-25T16:01:24.099469+0000","last_deep_scrub":"36'929","last_deep_scrub_stamp":"2024-04-25T16:01:24.099469+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.099469+0000","objects_scrubbed":4,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:15.411767+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":28720,"num_write":874,"num_write_kb":8730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'144","reported_seq":203,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.264018+0000","last_change":"2024-04-25T16:01:26.264018+0000","last_active":"2024-04-25T16:01:26.264018+0000","last_peered":"2024-04-25T16:01:26.264018+0000","last_clean":"2024-04-25T16:01:26.264018+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T16:01:26.264018+0000","last_undegraded":"2024-04-25T16:01:26.264018+0000","last_fullsized":"2024-04-25T16:01:26.264018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'144","last_scrub_stamp":"2024-04-25T16:01:26.263721+0000","last_deep_scrub":"36'144","last_deep_scrub_stamp":"2024-04-25T16:01:26.263721+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.263721+0000","objects_scrubbed":2,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:23.943431+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":97,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"31'366","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.507078+0000","last_change":"2024-04-25T15:54:20.418222+0000","last_active":"2024-04-25T16:01:20.507078+0000","last_peered":"2024-04-25T16:01:20.507078+0000","last_clean":"2024-04-25T16:01:20.507078+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T16:01:20.507078+0000","last_undegraded":"2024-04-25T16:01:20.507078+0000","last_fullsized":"2024-04-25T16:01:20.507078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6536,"num_write":348,"num_write_kb":51835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"36'411","reported_seq":501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.915841+0000","last_change":"2024-04-25T16:01:25.915841+0000","last_active":"2024-04-25T16:01:25.915841+0000","last_peered":"2024-04-25T16:01:25.915841+0000","last_clean":"2024-04-25T16:01:25.915841+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T16:01:25.915841+0000","last_undegraded":"2024-04-25T16:01:25.915841+0000","last_fullsized":"2024-04-25T16:01:25.915841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'411","last_scrub_stamp":"2024-04-25T16:01:25.915540+0000","last_deep_scrub":"36'411","last_deep_scrub_stamp":"2024-04-25T16:01:25.915540+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.915540+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:39.149829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12973,"num_write":382,"num_write_kb":67863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'348","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.750213+0000","last_change":"2024-04-25T16:01:26.750407+0000","last_active":"2024-04-25T16:01:26.750213+0000","last_peered":"2024-04-25T16:01:26.750213+0000","last_clean":"2024-04-25T16:01:26.750213+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T16:01:26.750213+0000","last_undegraded":"2024-04-25T16:01:26.750213+0000","last_fullsized":"2024-04-25T16:01:26.750213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'348","last_scrub_stamp":"2024-04-25T16:01:26.749902+0000","last_deep_scrub":"36'348","last_deep_scrub_stamp":"2024-04-25T16:01:26.749902+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.749902+0000","objects_scrubbed":6,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:11.878197+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":41004,"num_write":293,"num_write_kb":12450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'62","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:19.919366+0000","last_change":"2024-04-25T16:01:19.919366+0000","last_active":"2024-04-25T16:01:19.919366+0000","last_peered":"2024-04-25T16:01:19.919366+0000","last_clean":"2024-04-25T16:01:19.919366+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T16:01:19.919366+0000","last_undegraded":"2024-04-25T16:01:19.919366+0000","last_fullsized":"2024-04-25T16:01:19.919366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'62","last_scrub_stamp":"2024-04-25T16:01:19.919082+0000","last_deep_scrub":"31'62","last_deep_scrub_stamp":"2024-04-25T16:01:19.919082+0000","last_clean_scrub_stamp":"2024-04-25T16:01:19.919082+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.674475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'409","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.974168+0000","last_change":"2024-04-25T16:01:27.974304+0000","last_active":"2024-04-25T16:01:27.974168+0000","last_peered":"2024-04-25T16:01:27.974168+0000","last_clean":"2024-04-25T16:01:27.974168+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T16:01:27.974168+0000","last_undegraded":"2024-04-25T16:01:27.974168+0000","last_fullsized":"2024-04-25T16:01:27.974168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2024-04-25T16:01:27.973822+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2024-04-25T16:01:27.973822+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.973822+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:14.123676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30743,"num_write":387,"num_write_kb":71898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'393","reported_seq":496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.564594+0000","last_change":"2024-04-25T16:01:33.564697+0000","last_active":"2024-04-25T16:01:33.564594+0000","last_peered":"2024-04-25T16:01:33.564594+0000","last_clean":"2024-04-25T16:01:33.564594+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T16:01:33.564594+0000","last_undegraded":"2024-04-25T16:01:33.564594+0000","last_fullsized":"2024-04-25T16:01:33.564594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'393","last_scrub_stamp":"2024-04-25T16:01:33.564340+0000","last_deep_scrub":"36'393","last_deep_scrub_stamp":"2024-04-25T16:01:33.564340+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.564340+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:51.466506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24508,"num_write":369,"num_write_kb":63737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'213","reported_seq":288,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.871793+0000","last_change":"2024-04-25T16:01:34.871869+0000","last_active":"2024-04-25T16:01:34.871793+0000","last_peered":"2024-04-25T16:01:34.871793+0000","last_clean":"2024-04-25T16:01:34.871793+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T16:01:34.871793+0000","last_undegraded":"2024-04-25T16:01:34.871793+0000","last_fullsized":"2024-04-25T16:01:34.871793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'213","last_scrub_stamp":"2024-04-25T16:01:34.871577+0000","last_deep_scrub":"36'213","last_deep_scrub_stamp":"2024-04-25T16:01:34.871577+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.871577+0000","objects_scrubbed":3,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:39.355058+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":787,"num_write":162,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'540","reported_seq":604,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.631964+0000","last_change":"2024-04-25T16:01:23.632064+0000","last_active":"2024-04-25T16:01:23.631964+0000","last_peered":"2024-04-25T16:01:23.631964+0000","last_clean":"2024-04-25T16:01:23.631964+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T16:01:23.631964+0000","last_undegraded":"2024-04-25T16:01:23.631964+0000","last_fullsized":"2024-04-25T16:01:23.631964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'540","last_scrub_stamp":"2024-04-25T16:01:23.631738+0000","last_deep_scrub":"36'540","last_deep_scrub_stamp":"2024-04-25T16:01:23.631738+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.631738+0000","objects_scrubbed":4,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:05.250313+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24608,"num_write":474,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"31'470","reported_seq":579,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.682410+0000","last_change":"2024-04-25T16:01:36.682492+0000","last_active":"2024-04-25T16:01:36.682410+0000","last_peered":"2024-04-25T16:01:36.682410+0000","last_clean":"2024-04-25T16:01:36.682410+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T16:01:36.682410+0000","last_undegraded":"2024-04-25T16:01:36.682410+0000","last_fullsized":"2024-04-25T16:01:36.682410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'470","last_scrub_stamp":"2024-04-25T16:01:36.682163+0000","last_deep_scrub":"31'470","last_deep_scrub_stamp":"2024-04-25T16:01:36.682163+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.682163+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:46.553321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31281,"num_write":455,"num_write_kb":108972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"36'380","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:19.110765+0000","last_change":"2024-04-25T16:01:19.110765+0000","last_active":"2024-04-25T16:01:19.110765+0000","last_peered":"2024-04-25T16:01:19.110765+0000","last_clean":"2024-04-25T16:01:19.110765+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T16:01:19.110765+0000","last_undegraded":"2024-04-25T16:01:19.110765+0000","last_fullsized":"2024-04-25T16:01:19.110765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'380","last_scrub_stamp":"2024-04-25T16:01:19.110645+0000","last_deep_scrub":"36'380","last_deep_scrub_stamp":"2024-04-25T16:01:19.110645+0000","last_clean_scrub_stamp":"2024-04-25T16:01:19.110645+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:06.989863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":25762,"num_write":354,"num_write_kb":59652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'382","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.516846+0000","last_change":"2024-04-25T16:01:37.516925+0000","last_active":"2024-04-25T16:01:37.516846+0000","last_peered":"2024-04-25T16:01:37.516846+0000","last_clean":"2024-04-25T16:01:37.516846+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T16:01:37.516846+0000","last_undegraded":"2024-04-25T16:01:37.516846+0000","last_fullsized":"2024-04-25T16:01:37.516846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:37.516528+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:37.516528+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.516528+0000","objects_scrubbed":1,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.724908+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8766,"num_write":314,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'145","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.544653+0000","last_change":"2024-04-25T16:01:21.544653+0000","last_active":"2024-04-25T16:01:21.544653+0000","last_peered":"2024-04-25T16:01:21.544653+0000","last_clean":"2024-04-25T16:01:21.544653+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T16:01:21.544653+0000","last_undegraded":"2024-04-25T16:01:21.544653+0000","last_fullsized":"2024-04-25T16:01:21.544653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'145","last_scrub_stamp":"2024-04-25T16:01:21.544331+0000","last_deep_scrub":"36'145","last_deep_scrub_stamp":"2024-04-25T16:01:21.544331+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.544331+0000","objects_scrubbed":5,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:15.829686+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494748,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":898,"num_write":91,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'426","reported_seq":497,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.217460+0000","last_change":"2024-04-25T15:54:20.440219+0000","last_active":"2024-04-25T16:01:22.217460+0000","last_peered":"2024-04-25T16:01:22.217460+0000","last_clean":"2024-04-25T16:01:22.217460+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T16:01:22.217460+0000","last_undegraded":"2024-04-25T16:01:22.217460+0000","last_fullsized":"2024-04-25T16:01:22.217460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13765,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"36'408","reported_seq":471,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.369656+0000","last_change":"2024-04-25T16:01:23.369656+0000","last_active":"2024-04-25T16:01:23.369656+0000","last_peered":"2024-04-25T16:01:23.369656+0000","last_clean":"2024-04-25T16:01:23.369656+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T16:01:23.369656+0000","last_undegraded":"2024-04-25T16:01:23.369656+0000","last_fullsized":"2024-04-25T16:01:23.369656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'408","last_scrub_stamp":"2024-04-25T16:01:23.369361+0000","last_deep_scrub":"36'408","last_deep_scrub_stamp":"2024-04-25T16:01:23.369361+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.369361+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:06.497992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":381,"num_write_kb":62610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"36'68","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.683274+0000","last_change":"2024-04-25T16:01:30.683408+0000","last_active":"2024-04-25T16:01:30.683274+0000","last_peered":"2024-04-25T16:01:30.683274+0000","last_clean":"2024-04-25T16:01:30.683274+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T16:01:30.683274+0000","last_undegraded":"2024-04-25T16:01:30.683274+0000","last_fullsized":"2024-04-25T16:01:30.683274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'68","last_scrub_stamp":"2024-04-25T16:01:30.682948+0000","last_deep_scrub":"36'68","last_deep_scrub_stamp":"2024-04-25T16:01:30.682948+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.682948+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:57.714644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'63","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.512952+0000","last_change":"2024-04-25T16:01:25.513023+0000","last_active":"2024-04-25T16:01:25.512952+0000","last_peered":"2024-04-25T16:01:25.512952+0000","last_clean":"2024-04-25T16:01:25.512952+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T16:01:25.512952+0000","last_undegraded":"2024-04-25T16:01:25.512952+0000","last_fullsized":"2024-04-25T16:01:25.512952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-04-25T16:01:25.512681+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-04-25T16:01:25.512681+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.512681+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:55.847891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'354","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.729277+0000","last_change":"2024-04-25T16:01:37.729349+0000","last_active":"2024-04-25T16:01:37.729277+0000","last_peered":"2024-04-25T16:01:37.729277+0000","last_clean":"2024-04-25T16:01:37.729277+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T16:01:37.729277+0000","last_undegraded":"2024-04-25T16:01:37.729277+0000","last_fullsized":"2024-04-25T16:01:37.729277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'354","last_scrub_stamp":"2024-04-25T16:01:37.729045+0000","last_deep_scrub":"31'354","last_deep_scrub_stamp":"2024-04-25T16:01:37.729045+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.729045+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:10.903010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17557,"num_write":333,"num_write_kb":46614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'112","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.114892+0000","last_change":"2024-04-25T16:01:33.114966+0000","last_active":"2024-04-25T16:01:33.114892+0000","last_peered":"2024-04-25T16:01:33.114892+0000","last_clean":"2024-04-25T16:01:33.114892+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T16:01:33.114892+0000","last_undegraded":"2024-04-25T16:01:33.114892+0000","last_fullsized":"2024-04-25T16:01:33.114892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'112","last_scrub_stamp":"2024-04-25T16:01:33.114663+0000","last_deep_scrub":"36'112","last_deep_scrub_stamp":"2024-04-25T16:01:33.114663+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.114663+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:18.673571+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":58,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'435","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.937822+0000","last_change":"2024-04-25T16:01:26.937822+0000","last_active":"2024-04-25T16:01:26.937822+0000","last_peered":"2024-04-25T16:01:26.937822+0000","last_clean":"2024-04-25T16:01:26.937822+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T16:01:26.937822+0000","last_undegraded":"2024-04-25T16:01:26.937822+0000","last_fullsized":"2024-04-25T16:01:26.937822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'435","last_scrub_stamp":"2024-04-25T16:01:26.937508+0000","last_deep_scrub":"36'435","last_deep_scrub_stamp":"2024-04-25T16:01:26.937508+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.937508+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:30.170098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25415,"num_write":410,"num_write_kb":96682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'1095","reported_seq":1159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.523360+0000","last_change":"2024-04-25T16:01:38.523467+0000","last_active":"2024-04-25T16:01:38.523360+0000","last_peered":"2024-04-25T16:01:38.523360+0000","last_clean":"2024-04-25T16:01:38.523360+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T16:01:38.523360+0000","last_undegraded":"2024-04-25T16:01:38.523360+0000","last_fullsized":"2024-04-25T16:01:38.523360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1095","last_scrub_stamp":"2024-04-25T16:01:38.523134+0000","last_deep_scrub":"36'1095","last_deep_scrub_stamp":"2024-04-25T16:01:38.523134+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.523134+0000","objects_scrubbed":2,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:45.996808+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":1024,"num_write_kb":8705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"31'396","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.113286+0000","last_change":"2024-04-25T16:01:36.113359+0000","last_active":"2024-04-25T16:01:36.113286+0000","last_peered":"2024-04-25T16:01:36.113286+0000","last_clean":"2024-04-25T16:01:36.113286+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T16:01:36.113286+0000","last_undegraded":"2024-04-25T16:01:36.113286+0000","last_fullsized":"2024-04-25T16:01:36.113286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'396","last_scrub_stamp":"2024-04-25T16:01:36.113015+0000","last_deep_scrub":"31'396","last_deep_scrub_stamp":"2024-04-25T16:01:36.113015+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.113015+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:14.646625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":20218,"num_write":374,"num_write_kb":83731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"36'102","reported_seq":163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.703274+0000","last_change":"2024-04-25T16:01:35.703382+0000","last_active":"2024-04-25T16:01:35.703274+0000","last_peered":"2024-04-25T16:01:35.703274+0000","last_clean":"2024-04-25T16:01:35.703274+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T16:01:35.703274+0000","last_undegraded":"2024-04-25T16:01:35.703274+0000","last_fullsized":"2024-04-25T16:01:35.703274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'102","last_scrub_stamp":"2024-04-25T16:01:35.703062+0000","last_deep_scrub":"36'102","last_deep_scrub_stamp":"2024-04-25T16:01:35.703062+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.703062+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:21.852916+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12304,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'449","reported_seq":554,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.632141+0000","last_change":"2024-04-25T16:01:38.632304+0000","last_active":"2024-04-25T16:01:38.632141+0000","last_peered":"2024-04-25T16:01:38.632141+0000","last_clean":"2024-04-25T16:01:38.632141+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T16:01:38.632141+0000","last_undegraded":"2024-04-25T16:01:38.632141+0000","last_fullsized":"2024-04-25T16:01:38.632141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'449","last_scrub_stamp":"2024-04-25T16:01:38.631876+0000","last_deep_scrub":"36'449","last_deep_scrub_stamp":"2024-04-25T16:01:38.631876+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.631876+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:34.206020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27119,"num_write":430,"num_write_kb":112459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'106","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.626118+0000","last_change":"2024-04-25T16:01:37.626192+0000","last_active":"2024-04-25T16:01:37.626118+0000","last_peered":"2024-04-25T16:01:37.626118+0000","last_clean":"2024-04-25T16:01:37.626118+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T16:01:37.626118+0000","last_undegraded":"2024-04-25T16:01:37.626118+0000","last_fullsized":"2024-04-25T16:01:37.626118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'106","last_scrub_stamp":"2024-04-25T16:01:37.625843+0000","last_deep_scrub":"36'106","last_deep_scrub_stamp":"2024-04-25T16:01:37.625843+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.625843+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:00.026042+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":60,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"31'366","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.564289+0000","last_change":"2024-04-25T15:54:20.450670+0000","last_active":"2024-04-25T16:00:43.564289+0000","last_peered":"2024-04-25T16:00:43.564289+0000","last_clean":"2024-04-25T16:00:43.564289+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T16:00:43.564289+0000","last_undegraded":"2024-04-25T16:00:43.564289+0000","last_fullsized":"2024-04-25T16:00:43.564289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":31073,"num_write":335,"num_write_kb":72672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"36'623","reported_seq":691,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.727064+0000","last_change":"2024-04-25T16:01:28.727064+0000","last_active":"2024-04-25T16:01:28.727064+0000","last_peered":"2024-04-25T16:01:28.727064+0000","last_clean":"2024-04-25T16:01:28.727064+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T16:01:28.727064+0000","last_undegraded":"2024-04-25T16:01:28.727064+0000","last_fullsized":"2024-04-25T16:01:28.727064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'623","last_scrub_stamp":"2024-04-25T16:01:28.726605+0000","last_deep_scrub":"36'623","last_deep_scrub_stamp":"2024-04-25T16:01:28.726605+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.726605+0000","objects_scrubbed":3,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:10.345180+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":551,"num_write_kb":12472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'393","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.011895+0000","last_change":"2024-04-25T16:01:30.011895+0000","last_active":"2024-04-25T16:01:30.011895+0000","last_peered":"2024-04-25T16:01:30.011895+0000","last_clean":"2024-04-25T16:01:30.011895+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T16:01:30.011895+0000","last_undegraded":"2024-04-25T16:01:30.011895+0000","last_fullsized":"2024-04-25T16:01:30.011895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'393","last_scrub_stamp":"2024-04-25T16:01:30.011608+0000","last_deep_scrub":"36'393","last_deep_scrub_stamp":"2024-04-25T16:01:30.011608+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.011608+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:43.245896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31498,"num_write":372,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'339","reported_seq":395,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.517269+0000","last_change":"2024-04-25T16:01:27.517463+0000","last_active":"2024-04-25T16:01:27.517269+0000","last_peered":"2024-04-25T16:01:27.517269+0000","last_clean":"2024-04-25T16:01:27.517269+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T16:01:27.517269+0000","last_undegraded":"2024-04-25T16:01:27.517269+0000","last_fullsized":"2024-04-25T16:01:27.517269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'339","last_scrub_stamp":"2024-04-25T16:01:27.516995+0000","last_deep_scrub":"36'339","last_deep_scrub_stamp":"2024-04-25T16:01:27.516995+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.516995+0000","objects_scrubbed":2,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:12.310894+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":286,"num_write_kb":4236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'391","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.567107+0000","last_change":"2024-04-25T15:54:20.429443+0000","last_active":"2024-04-25T16:00:43.567107+0000","last_peered":"2024-04-25T16:00:43.567107+0000","last_clean":"2024-04-25T16:00:43.567107+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T16:00:43.567107+0000","last_undegraded":"2024-04-25T16:00:43.567107+0000","last_fullsized":"2024-04-25T16:00:43.567107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15625,"num_write":369,"num_write_kb":80649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"36'112","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.586045+0000","last_change":"2024-04-25T16:01:36.586045+0000","last_active":"2024-04-25T16:01:36.586045+0000","last_peered":"2024-04-25T16:01:36.586045+0000","last_clean":"2024-04-25T16:01:36.586045+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T16:01:36.586045+0000","last_undegraded":"2024-04-25T16:01:36.586045+0000","last_fullsized":"2024-04-25T16:01:36.586045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'112","last_scrub_stamp":"2024-04-25T16:01:36.585764+0000","last_deep_scrub":"36'112","last_deep_scrub_stamp":"2024-04-25T16:01:36.585764+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.585764+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:44.059438+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":57,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'382","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.594288+0000","last_change":"2024-04-25T16:01:31.594288+0000","last_active":"2024-04-25T16:01:31.594288+0000","last_peered":"2024-04-25T16:01:31.594288+0000","last_clean":"2024-04-25T16:01:31.594288+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T16:01:31.594288+0000","last_undegraded":"2024-04-25T16:01:31.594288+0000","last_fullsized":"2024-04-25T16:01:31.594288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:31.593757+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:31.593757+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.593757+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:38.472631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28619,"num_write":357,"num_write_kb":42139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'309","reported_seq":371,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.609549+0000","last_change":"2024-04-25T16:01:23.609639+0000","last_active":"2024-04-25T16:01:23.609549+0000","last_peered":"2024-04-25T16:01:23.609549+0000","last_clean":"2024-04-25T16:01:23.609549+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T16:01:23.609549+0000","last_undegraded":"2024-04-25T16:01:23.609549+0000","last_fullsized":"2024-04-25T16:01:23.609549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'309","last_scrub_stamp":"2024-04-25T16:01:23.609281+0000","last_deep_scrub":"36'309","last_deep_scrub_stamp":"2024-04-25T16:01:23.609281+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.609281+0000","objects_scrubbed":4,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:51.133517+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":32783,"num_write":228,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"31'453","reported_seq":527,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:52.213465+0000","last_change":"2024-04-25T15:54:20.408677+0000","last_active":"2024-04-25T16:00:52.213465+0000","last_peered":"2024-04-25T16:00:52.213465+0000","last_clean":"2024-04-25T16:00:52.213465+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T16:00:52.213465+0000","last_undegraded":"2024-04-25T16:00:52.213465+0000","last_fullsized":"2024-04-25T16:00:52.213465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17355,"num_write":430,"num_write_kb":97199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'423","reported_seq":500,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.670042+0000","last_change":"2024-04-25T16:01:32.670116+0000","last_active":"2024-04-25T16:01:32.670042+0000","last_peered":"2024-04-25T16:01:32.670042+0000","last_clean":"2024-04-25T16:01:32.670042+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T16:01:32.670042+0000","last_undegraded":"2024-04-25T16:01:32.670042+0000","last_fullsized":"2024-04-25T16:01:32.670042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'423","last_scrub_stamp":"2024-04-25T16:01:32.669829+0000","last_deep_scrub":"36'423","last_deep_scrub_stamp":"2024-04-25T16:01:32.669829+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.669829+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:26.955185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12292,"num_write":400,"num_write_kb":76879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"31'396","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.878703+0000","last_change":"2024-04-25T16:01:39.878774+0000","last_active":"2024-04-25T16:01:39.878703+0000","last_peered":"2024-04-25T16:01:39.878703+0000","last_clean":"2024-04-25T16:01:39.878703+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T16:01:39.878703+0000","last_undegraded":"2024-04-25T16:01:39.878703+0000","last_fullsized":"2024-04-25T16:01:39.878703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'396","last_scrub_stamp":"2024-04-25T16:01:39.878444+0000","last_deep_scrub":"31'396","last_deep_scrub_stamp":"2024-04-25T16:01:39.878444+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.878444+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:19.040045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13093,"num_write":385,"num_write_kb":50492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'448","reported_seq":585,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.546153+0000","last_change":"2024-04-25T16:01:25.546220+0000","last_active":"2024-04-25T16:01:25.546153+0000","last_peered":"2024-04-25T16:01:25.546153+0000","last_clean":"2024-04-25T16:01:25.546153+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T16:01:25.546153+0000","last_undegraded":"2024-04-25T16:01:25.546153+0000","last_fullsized":"2024-04-25T16:01:25.546153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'448","last_scrub_stamp":"2024-04-25T16:01:25.545924+0000","last_deep_scrub":"36'448","last_deep_scrub_stamp":"2024-04-25T16:01:25.545924+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.545924+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:09.731299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":34274,"num_write":426,"num_write_kb":72417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"31'398","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.429391+0000","last_change":"2024-04-25T16:01:30.429464+0000","last_active":"2024-04-25T16:01:30.429391+0000","last_peered":"2024-04-25T16:01:30.429391+0000","last_clean":"2024-04-25T16:01:30.429391+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T16:01:30.429391+0000","last_undegraded":"2024-04-25T16:01:30.429391+0000","last_fullsized":"2024-04-25T16:01:30.429391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'398","last_scrub_stamp":"2024-04-25T16:01:30.429168+0000","last_deep_scrub":"31'398","last_deep_scrub_stamp":"2024-04-25T16:01:30.429168+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.429168+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:48.331333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32843,"num_write":377,"num_write_kb":116675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"36'474","reported_seq":597,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.284671+0000","last_change":"2024-04-25T16:01:27.284744+0000","last_active":"2024-04-25T16:01:27.284671+0000","last_peered":"2024-04-25T16:01:27.284671+0000","last_clean":"2024-04-25T16:01:27.284671+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T16:01:27.284671+0000","last_undegraded":"2024-04-25T16:01:27.284671+0000","last_fullsized":"2024-04-25T16:01:27.284671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'474","last_scrub_stamp":"2024-04-25T16:01:27.284417+0000","last_deep_scrub":"36'474","last_deep_scrub_stamp":"2024-04-25T16:01:27.284417+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.284417+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:12.843325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33678,"num_write":445,"num_write_kb":67390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"31'407","reported_seq":484,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:52.212792+0000","last_change":"2024-04-25T15:54:20.450942+0000","last_active":"2024-04-25T16:00:52.212792+0000","last_peered":"2024-04-25T16:00:52.212792+0000","last_clean":"2024-04-25T16:00:52.212792+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T16:00:52.212792+0000","last_undegraded":"2024-04-25T16:00:52.212792+0000","last_fullsized":"2024-04-25T16:00:52.212792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19077,"num_write":388,"num_write_kb":75668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'415","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.041069+0000","last_change":"2024-04-25T16:01:25.041263+0000","last_active":"2024-04-25T16:01:25.041069+0000","last_peered":"2024-04-25T16:01:25.041069+0000","last_clean":"2024-04-25T16:01:25.041069+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T16:01:25.041069+0000","last_undegraded":"2024-04-25T16:01:25.041069+0000","last_fullsized":"2024-04-25T16:01:25.041069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'415","last_scrub_stamp":"2024-04-25T16:01:25.040795+0000","last_deep_scrub":"36'415","last_deep_scrub_stamp":"2024-04-25T16:01:25.040795+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.040795+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.678389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15212,"num_write":389,"num_write_kb":87855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"31'469","reported_seq":581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.010673+0000","last_change":"2024-04-25T16:01:33.010740+0000","last_active":"2024-04-25T16:01:33.010673+0000","last_peered":"2024-04-25T16:01:33.010673+0000","last_clean":"2024-04-25T16:01:33.010673+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T16:01:33.010673+0000","last_undegraded":"2024-04-25T16:01:33.010673+0000","last_fullsized":"2024-04-25T16:01:33.010673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'469","last_scrub_stamp":"2024-04-25T16:01:33.010427+0000","last_deep_scrub":"31'469","last_deep_scrub_stamp":"2024-04-25T16:01:33.010427+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.010427+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:45.716273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":27411,"num_write":441,"num_write_kb":71769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"36'370","reported_seq":458,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.661121+0000","last_change":"2024-04-25T16:01:39.661213+0000","last_active":"2024-04-25T16:01:39.661121+0000","last_peered":"2024-04-25T16:01:39.661121+0000","last_clean":"2024-04-25T16:01:39.661121+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T16:01:39.661121+0000","last_undegraded":"2024-04-25T16:01:39.661121+0000","last_fullsized":"2024-04-25T16:01:39.661121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'370","last_scrub_stamp":"2024-04-25T16:01:39.660893+0000","last_deep_scrub":"36'370","last_deep_scrub_stamp":"2024-04-25T16:01:39.660893+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.660893+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:51.906902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17348,"num_write":348,"num_write_kb":62807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"31'399","reported_seq":502,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.672655+0000","last_change":"2024-04-25T16:01:41.672736+0000","last_active":"2024-04-25T16:01:41.672655+0000","last_peered":"2024-04-25T16:01:41.672655+0000","last_clean":"2024-04-25T16:01:41.672655+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T16:01:41.672655+0000","last_undegraded":"2024-04-25T16:01:41.672655+0000","last_fullsized":"2024-04-25T16:01:41.672655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'399","last_scrub_stamp":"2024-04-25T16:01:41.672314+0000","last_deep_scrub":"31'399","last_deep_scrub_stamp":"2024-04-25T16:01:41.672314+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.672314+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.145989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25133,"num_write":374,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"36'389","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.992037+0000","last_change":"2024-04-25T16:01:24.992127+0000","last_active":"2024-04-25T16:01:24.992037+0000","last_peered":"2024-04-25T16:01:24.992037+0000","last_clean":"2024-04-25T16:01:24.992037+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T16:01:24.992037+0000","last_undegraded":"2024-04-25T16:01:24.992037+0000","last_fullsized":"2024-04-25T16:01:24.992037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'389","last_scrub_stamp":"2024-04-25T16:01:24.991814+0000","last_deep_scrub":"36'389","last_deep_scrub_stamp":"2024-04-25T16:01:24.991814+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.991814+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:19.277169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9093,"num_write":358,"num_write_kb":54590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"31'414","reported_seq":466,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.570477+0000","last_change":"2024-04-25T15:54:20.440656+0000","last_active":"2024-04-25T16:00:43.570477+0000","last_peered":"2024-04-25T16:00:43.570477+0000","last_clean":"2024-04-25T16:00:43.570477+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T16:00:43.570477+0000","last_undegraded":"2024-04-25T16:00:43.570477+0000","last_fullsized":"2024-04-25T16:00:43.570477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4145,"num_write":400,"num_write_kb":47343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"36'485","reported_seq":616,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.701218+0000","last_change":"2024-04-25T16:01:22.701321+0000","last_active":"2024-04-25T16:01:22.701218+0000","last_peered":"2024-04-25T16:01:22.701218+0000","last_clean":"2024-04-25T16:01:22.701218+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T16:01:22.701218+0000","last_undegraded":"2024-04-25T16:01:22.701218+0000","last_fullsized":"2024-04-25T16:01:22.701218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'485","last_scrub_stamp":"2024-04-25T16:01:22.701004+0000","last_deep_scrub":"36'485","last_deep_scrub_stamp":"2024-04-25T16:01:22.701004+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.701004+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:05.618289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40854,"num_write":458,"num_write_kb":125991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"31'410","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.758158+0000","last_change":"2024-04-25T16:01:40.758235+0000","last_active":"2024-04-25T16:01:40.758158+0000","last_peered":"2024-04-25T16:01:40.758158+0000","last_clean":"2024-04-25T16:01:40.758158+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T16:01:40.758158+0000","last_undegraded":"2024-04-25T16:01:40.758158+0000","last_fullsized":"2024-04-25T16:01:40.758158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2024-04-25T16:01:40.757965+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2024-04-25T16:01:40.757965+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.757965+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:58.660131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26310,"num_write":391,"num_write_kb":68273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'398","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.588284+0000","last_change":"2024-04-25T16:01:41.588433+0000","last_active":"2024-04-25T16:01:41.588284+0000","last_peered":"2024-04-25T16:01:41.588284+0000","last_clean":"2024-04-25T16:01:41.588284+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T16:01:41.588284+0000","last_undegraded":"2024-04-25T16:01:41.588284+0000","last_fullsized":"2024-04-25T16:01:41.588284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'398","last_scrub_stamp":"2024-04-25T16:01:41.587900+0000","last_deep_scrub":"36'398","last_deep_scrub_stamp":"2024-04-25T16:01:41.587900+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.587900+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:40.543987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4252,"num_write":382,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"31'416","reported_seq":537,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.507188+0000","last_change":"2024-04-25T15:54:20.413594+0000","last_active":"2024-04-25T16:01:20.507188+0000","last_peered":"2024-04-25T16:01:20.507188+0000","last_clean":"2024-04-25T16:01:20.507188+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T16:01:20.507188+0000","last_undegraded":"2024-04-25T16:01:20.507188+0000","last_fullsized":"2024-04-25T16:01:20.507188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38150,"num_write":393,"num_write_kb":63831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'452","reported_seq":530,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.421457+0000","last_change":"2024-04-25T16:01:31.421594+0000","last_active":"2024-04-25T16:01:31.421457+0000","last_peered":"2024-04-25T16:01:31.421457+0000","last_clean":"2024-04-25T16:01:31.421457+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T16:01:31.421457+0000","last_undegraded":"2024-04-25T16:01:31.421457+0000","last_fullsized":"2024-04-25T16:01:31.421457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'452","last_scrub_stamp":"2024-04-25T16:01:31.421131+0000","last_deep_scrub":"36'452","last_deep_scrub_stamp":"2024-04-25T16:01:31.421131+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.421131+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:01.267018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13732,"num_write":425,"num_write_kb":92170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"31'400","reported_seq":498,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.217619+0000","last_change":"2024-04-25T15:54:20.434341+0000","last_active":"2024-04-25T16:01:22.217619+0000","last_peered":"2024-04-25T16:01:22.217619+0000","last_clean":"2024-04-25T16:01:22.217619+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T16:01:22.217619+0000","last_undegraded":"2024-04-25T16:01:22.217619+0000","last_fullsized":"2024-04-25T16:01:22.217619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30630,"num_write":376,"num_write_kb":46781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"36'400","reported_seq":498,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.635266+0000","last_change":"2024-04-25T16:01:40.635351+0000","last_active":"2024-04-25T16:01:40.635266+0000","last_peered":"2024-04-25T16:01:40.635266+0000","last_clean":"2024-04-25T16:01:40.635266+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T16:01:40.635266+0000","last_undegraded":"2024-04-25T16:01:40.635266+0000","last_fullsized":"2024-04-25T16:01:40.635266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'400","last_scrub_stamp":"2024-04-25T16:01:40.635022+0000","last_deep_scrub":"36'400","last_deep_scrub_stamp":"2024-04-25T16:01:40.635022+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.635022+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:31.414621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":15673,"num_write":376,"num_write_kb":63098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"31'448","reported_seq":538,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.559634+0000","last_change":"2024-04-25T16:01:30.559714+0000","last_active":"2024-04-25T16:01:30.559634+0000","last_peered":"2024-04-25T16:01:30.559634+0000","last_clean":"2024-04-25T16:01:30.559634+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T16:01:30.559634+0000","last_undegraded":"2024-04-25T16:01:30.559634+0000","last_fullsized":"2024-04-25T16:01:30.559634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'448","last_scrub_stamp":"2024-04-25T16:01:30.559406+0000","last_deep_scrub":"31'448","last_deep_scrub_stamp":"2024-04-25T16:01:30.559406+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.559406+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:12.177981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17288,"num_write":429,"num_write_kb":67321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"35'439","reported_seq":577,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.364090+0000","last_change":"2024-04-25T16:01:22.364160+0000","last_active":"2024-04-25T16:01:22.364090+0000","last_peered":"2024-04-25T16:01:22.364090+0000","last_clean":"2024-04-25T16:01:22.364090+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T16:01:22.364090+0000","last_undegraded":"2024-04-25T16:01:22.364090+0000","last_fullsized":"2024-04-25T16:01:22.364090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'439","last_scrub_stamp":"2024-04-25T16:01:22.363858+0000","last_deep_scrub":"35'439","last_deep_scrub_stamp":"2024-04-25T16:01:22.363858+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.363858+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:37.913300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":44523,"num_write":420,"num_write_kb":101102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"31'449","reported_seq":564,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:07.215729+0000","last_change":"2024-04-25T15:54:20.430409+0000","last_active":"2024-04-25T16:01:07.215729+0000","last_peered":"2024-04-25T16:01:07.215729+0000","last_clean":"2024-04-25T16:01:07.215729+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T16:01:07.215729+0000","last_undegraded":"2024-04-25T16:01:07.215729+0000","last_fullsized":"2024-04-25T16:01:07.215729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42039,"num_write":424,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"36'406","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.606251+0000","last_change":"2024-04-25T16:01:36.606251+0000","last_active":"2024-04-25T16:01:36.606251+0000","last_peered":"2024-04-25T16:01:36.606251+0000","last_clean":"2024-04-25T16:01:36.606251+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T16:01:36.606251+0000","last_undegraded":"2024-04-25T16:01:36.606251+0000","last_fullsized":"2024-04-25T16:01:36.606251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'406","last_scrub_stamp":"2024-04-25T16:01:36.605906+0000","last_deep_scrub":"36'406","last_deep_scrub_stamp":"2024-04-25T16:01:36.605906+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.605906+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:39.838496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27977,"num_write":389,"num_write_kb":84131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"31'427","reported_seq":563,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.646538+0000","last_change":"2024-04-25T16:01:40.646694+0000","last_active":"2024-04-25T16:01:40.646538+0000","last_peered":"2024-04-25T16:01:40.646538+0000","last_clean":"2024-04-25T16:01:40.646538+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T16:01:40.646538+0000","last_undegraded":"2024-04-25T16:01:40.646538+0000","last_fullsized":"2024-04-25T16:01:40.646538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'427","last_scrub_stamp":"2024-04-25T16:01:40.646194+0000","last_deep_scrub":"31'427","last_deep_scrub_stamp":"2024-04-25T16:01:40.646194+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.646194+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:04.854574+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43629,"num_write":407,"num_write_kb":76072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"35'432","reported_seq":537,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.691740+0000","last_change":"2024-04-25T16:01:33.691815+0000","last_active":"2024-04-25T16:01:33.691740+0000","last_peered":"2024-04-25T16:01:33.691740+0000","last_clean":"2024-04-25T16:01:33.691740+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T16:01:33.691740+0000","last_undegraded":"2024-04-25T16:01:33.691740+0000","last_fullsized":"2024-04-25T16:01:33.691740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'432","last_scrub_stamp":"2024-04-25T16:01:33.691481+0000","last_deep_scrub":"35'432","last_deep_scrub_stamp":"2024-04-25T16:01:33.691481+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.691481+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:46.925770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30618,"num_write":414,"num_write_kb":71070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"31'389","reported_seq":486,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.566437+0000","last_change":"2024-04-25T16:01:38.566511+0000","last_active":"2024-04-25T16:01:38.566437+0000","last_peered":"2024-04-25T16:01:38.566437+0000","last_clean":"2024-04-25T16:01:38.566437+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T16:01:38.566437+0000","last_undegraded":"2024-04-25T16:01:38.566437+0000","last_fullsized":"2024-04-25T16:01:38.566437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'389","last_scrub_stamp":"2024-04-25T16:01:38.566200+0000","last_deep_scrub":"31'389","last_deep_scrub_stamp":"2024-04-25T16:01:38.566200+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.566200+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:36.013070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30549,"num_write":360,"num_write_kb":75006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"36'422","reported_seq":530,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:19.424585+0000","last_change":"2024-04-25T15:54:50.220112+0000","last_active":"2024-04-25T16:01:19.424585+0000","last_peered":"2024-04-25T16:01:19.424585+0000","last_clean":"2024-04-25T16:01:19.424585+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T16:01:19.424585+0000","last_undegraded":"2024-04-25T16:01:19.424585+0000","last_fullsized":"2024-04-25T16:01:19.424585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:09.172166+0000","last_clean_scrub_stamp":"2024-04-25T15:54:09.172166+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39450,"num_write":395,"num_write_kb":75510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"31'437","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.443152+0000","last_change":"2024-04-25T16:01:32.443312+0000","last_active":"2024-04-25T16:01:32.443152+0000","last_peered":"2024-04-25T16:01:32.443152+0000","last_clean":"2024-04-25T16:01:32.443152+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T16:01:32.443152+0000","last_undegraded":"2024-04-25T16:01:32.443152+0000","last_fullsized":"2024-04-25T16:01:32.443152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'437","last_scrub_stamp":"2024-04-25T16:01:32.442771+0000","last_deep_scrub":"31'437","last_deep_scrub_stamp":"2024-04-25T16:01:32.442771+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.442771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:06.489513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19085,"num_write":412,"num_write_kb":55082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"36'406","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.531016+0000","last_change":"2024-04-25T16:01:26.531084+0000","last_active":"2024-04-25T16:01:26.531016+0000","last_peered":"2024-04-25T16:01:26.531016+0000","last_clean":"2024-04-25T16:01:26.531016+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T16:01:26.531016+0000","last_undegraded":"2024-04-25T16:01:26.531016+0000","last_fullsized":"2024-04-25T16:01:26.531016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'406","last_scrub_stamp":"2024-04-25T16:01:26.530775+0000","last_deep_scrub":"36'406","last_deep_scrub_stamp":"2024-04-25T16:01:26.530775+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.530775+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:27.748171+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24863,"num_write":384,"num_write_kb":75591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"31'420","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.106500+0000","last_change":"2024-04-25T16:01:35.106572+0000","last_active":"2024-04-25T16:01:35.106500+0000","last_peered":"2024-04-25T16:01:35.106500+0000","last_clean":"2024-04-25T16:01:35.106500+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T16:01:35.106500+0000","last_undegraded":"2024-04-25T16:01:35.106500+0000","last_fullsized":"2024-04-25T16:01:35.106500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'420","last_scrub_stamp":"2024-04-25T16:01:35.106268+0000","last_deep_scrub":"31'420","last_deep_scrub_stamp":"2024-04-25T16:01:35.106268+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.106268+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:07.880159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20260,"num_write":395,"num_write_kb":76151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'416","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.423242+0000","last_change":"2024-04-25T16:01:40.423319+0000","last_active":"2024-04-25T16:01:40.423242+0000","last_peered":"2024-04-25T16:01:40.423242+0000","last_clean":"2024-04-25T16:01:40.423242+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T16:01:40.423242+0000","last_undegraded":"2024-04-25T16:01:40.423242+0000","last_fullsized":"2024-04-25T16:01:40.423242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'416","last_scrub_stamp":"2024-04-25T16:01:40.422985+0000","last_deep_scrub":"36'416","last_deep_scrub_stamp":"2024-04-25T16:01:40.422985+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.422985+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:35.997129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24467,"num_write":391,"num_write_kb":79816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"31'404","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.865615+0000","last_change":"2024-04-25T16:01:37.865685+0000","last_active":"2024-04-25T16:01:37.865615+0000","last_peered":"2024-04-25T16:01:37.865615+0000","last_clean":"2024-04-25T16:01:37.865615+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T16:01:37.865615+0000","last_undegraded":"2024-04-25T16:01:37.865615+0000","last_fullsized":"2024-04-25T16:01:37.865615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'404","last_scrub_stamp":"2024-04-25T16:01:37.865377+0000","last_deep_scrub":"31'404","last_deep_scrub_stamp":"2024-04-25T16:01:37.865377+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.865377+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:48.959288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25761,"num_write":377,"num_write_kb":87528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"36'432","reported_seq":538,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.473366+0000","last_change":"2024-04-25T16:01:39.473438+0000","last_active":"2024-04-25T16:01:39.473366+0000","last_peered":"2024-04-25T16:01:39.473366+0000","last_clean":"2024-04-25T16:01:39.473366+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T16:01:39.473366+0000","last_undegraded":"2024-04-25T16:01:39.473366+0000","last_fullsized":"2024-04-25T16:01:39.473366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'432","last_scrub_stamp":"2024-04-25T16:01:39.473146+0000","last_deep_scrub":"36'432","last_deep_scrub_stamp":"2024-04-25T16:01:39.473146+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.473146+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:56.817999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":33533,"num_write":410,"num_write_kb":87842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"31'400","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.065782+0000","last_change":"2024-04-25T15:54:20.428764+0000","last_active":"2024-04-25T16:01:21.065782+0000","last_peered":"2024-04-25T16:01:21.065782+0000","last_clean":"2024-04-25T16:01:21.065782+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T16:01:21.065782+0000","last_undegraded":"2024-04-25T16:01:21.065782+0000","last_fullsized":"2024-04-25T16:01:21.065782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29549,"num_write":386,"num_write_kb":55194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"36'394","reported_seq":527,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.029273+0000","last_change":"2024-04-25T16:01:23.029341+0000","last_active":"2024-04-25T16:01:23.029273+0000","last_peered":"2024-04-25T16:01:23.029273+0000","last_clean":"2024-04-25T16:01:23.029273+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T16:01:23.029273+0000","last_undegraded":"2024-04-25T16:01:23.029273+0000","last_fullsized":"2024-04-25T16:01:23.029273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'394","last_scrub_stamp":"2024-04-25T16:01:23.029025+0000","last_deep_scrub":"36'394","last_deep_scrub_stamp":"2024-04-25T16:01:23.029025+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.029025+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:38.578468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46746,"num_write":370,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"31'338","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.612008+0000","last_change":"2024-04-25T15:54:20.440678+0000","last_active":"2024-04-25T16:01:21.612008+0000","last_peered":"2024-04-25T16:01:21.612008+0000","last_clean":"2024-04-25T16:01:21.612008+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T16:01:21.612008+0000","last_undegraded":"2024-04-25T16:01:21.612008+0000","last_fullsized":"2024-04-25T16:01:21.612008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9201,"num_write":322,"num_write_kb":37990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"36'397","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.025578+0000","last_change":"2024-04-25T16:01:27.025647+0000","last_active":"2024-04-25T16:01:27.025578+0000","last_peered":"2024-04-25T16:01:27.025578+0000","last_clean":"2024-04-25T16:01:27.025578+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T16:01:27.025578+0000","last_undegraded":"2024-04-25T16:01:27.025578+0000","last_fullsized":"2024-04-25T16:01:27.025578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'397","last_scrub_stamp":"2024-04-25T16:01:27.025358+0000","last_deep_scrub":"36'397","last_deep_scrub_stamp":"2024-04-25T16:01:27.025358+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.025358+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:08.275709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14146,"num_write":373,"num_write_kb":38796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"31'395","reported_seq":537,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.705549+0000","last_change":"2024-04-25T15:54:20.434178+0000","last_active":"2024-04-25T16:01:22.705549+0000","last_peered":"2024-04-25T16:01:22.705549+0000","last_clean":"2024-04-25T16:01:22.705549+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T16:01:22.705549+0000","last_undegraded":"2024-04-25T16:01:22.705549+0000","last_fullsized":"2024-04-25T16:01:22.705549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":61604,"num_write":383,"num_write_kb":95809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"36'373","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.457356+0000","last_change":"2024-04-25T16:01:30.457427+0000","last_active":"2024-04-25T16:01:30.457356+0000","last_peered":"2024-04-25T16:01:30.457356+0000","last_clean":"2024-04-25T16:01:30.457356+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T16:01:30.457356+0000","last_undegraded":"2024-04-25T16:01:30.457356+0000","last_fullsized":"2024-04-25T16:01:30.457356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'373","last_scrub_stamp":"2024-04-25T16:01:30.457137+0000","last_deep_scrub":"36'373","last_deep_scrub_stamp":"2024-04-25T16:01:30.457137+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.457137+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:08.299048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13278,"num_write":350,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"31'383","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.485571+0000","last_change":"2024-04-25T16:01:31.485649+0000","last_active":"2024-04-25T16:01:31.485571+0000","last_peered":"2024-04-25T16:01:31.485571+0000","last_clean":"2024-04-25T16:01:31.485571+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T16:01:31.485571+0000","last_undegraded":"2024-04-25T16:01:31.485571+0000","last_fullsized":"2024-04-25T16:01:31.485571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'383","last_scrub_stamp":"2024-04-25T16:01:31.485344+0000","last_deep_scrub":"31'383","last_deep_scrub_stamp":"2024-04-25T16:01:31.485344+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.485344+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:51.518248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4096,"num_write":350,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'356","reported_seq":447,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.581171+0000","last_change":"2024-04-25T16:01:32.581239+0000","last_active":"2024-04-25T16:01:32.581171+0000","last_peered":"2024-04-25T16:01:32.581171+0000","last_clean":"2024-04-25T16:01:32.581171+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T16:01:32.581171+0000","last_undegraded":"2024-04-25T16:01:32.581171+0000","last_fullsized":"2024-04-25T16:01:32.581171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'356","last_scrub_stamp":"2024-04-25T16:01:32.580937+0000","last_deep_scrub":"36'356","last_deep_scrub_stamp":"2024-04-25T16:01:32.580937+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.580937+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:05.354828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19489,"num_write":338,"num_write_kb":75079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"31'369","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.529227+0000","last_change":"2024-04-25T16:01:29.529227+0000","last_active":"2024-04-25T16:01:29.529227+0000","last_peered":"2024-04-25T16:01:29.529227+0000","last_clean":"2024-04-25T16:01:29.529227+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T16:01:29.529227+0000","last_undegraded":"2024-04-25T16:01:29.529227+0000","last_fullsized":"2024-04-25T16:01:29.529227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'369","last_scrub_stamp":"2024-04-25T16:01:29.528718+0000","last_deep_scrub":"31'369","last_deep_scrub_stamp":"2024-04-25T16:01:29.528718+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.528718+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:20.841016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1693,"num_write":344,"num_write_kb":38100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"36'368","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.809350+0000","last_change":"2024-04-25T16:01:41.809494+0000","last_active":"2024-04-25T16:01:41.809350+0000","last_peered":"2024-04-25T16:01:41.809350+0000","last_clean":"2024-04-25T16:01:41.809350+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T16:01:41.809350+0000","last_undegraded":"2024-04-25T16:01:41.809350+0000","last_fullsized":"2024-04-25T16:01:41.809350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'368","last_scrub_stamp":"2024-04-25T16:01:41.809007+0000","last_deep_scrub":"36'368","last_deep_scrub_stamp":"2024-04-25T16:01:41.809007+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.809007+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:46.292487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25999,"num_write":356,"num_write_kb":38429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"31'447","reported_seq":569,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.961425+0000","last_change":"2024-04-25T16:01:26.961490+0000","last_active":"2024-04-25T16:01:26.961425+0000","last_peered":"2024-04-25T16:01:26.961425+0000","last_clean":"2024-04-25T16:01:26.961425+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T16:01:26.961425+0000","last_undegraded":"2024-04-25T16:01:26.961425+0000","last_fullsized":"2024-04-25T16:01:26.961425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'447","last_scrub_stamp":"2024-04-25T16:01:26.961198+0000","last_deep_scrub":"31'447","last_deep_scrub_stamp":"2024-04-25T16:01:26.961198+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.961198+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:30.193787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38032,"num_write":427,"num_write_kb":75902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"36'382","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.667498+0000","last_change":"2024-04-25T16:01:23.667498+0000","last_active":"2024-04-25T16:01:23.667498+0000","last_peered":"2024-04-25T16:01:23.667498+0000","last_clean":"2024-04-25T16:01:23.667498+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T16:01:23.667498+0000","last_undegraded":"2024-04-25T16:01:23.667498+0000","last_fullsized":"2024-04-25T16:01:23.667498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:23.667025+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:23.667025+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.667025+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:06.013967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33238,"num_write":360,"num_write_kb":83325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"31'430","reported_seq":570,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.333898+0000","last_change":"2024-04-25T16:01:28.333989+0000","last_active":"2024-04-25T16:01:28.333898+0000","last_peered":"2024-04-25T16:01:28.333898+0000","last_clean":"2024-04-25T16:01:28.333898+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T16:01:28.333898+0000","last_undegraded":"2024-04-25T16:01:28.333898+0000","last_fullsized":"2024-04-25T16:01:28.333898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'430","last_scrub_stamp":"2024-04-25T16:01:28.333668+0000","last_deep_scrub":"31'430","last_deep_scrub_stamp":"2024-04-25T16:01:28.333668+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.333668+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:35.212542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47776,"num_write":403,"num_write_kb":100333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"36'419","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.903395+0000","last_change":"2024-04-25T16:01:22.903395+0000","last_active":"2024-04-25T16:01:22.903395+0000","last_peered":"2024-04-25T16:01:22.903395+0000","last_clean":"2024-04-25T16:01:22.903395+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T16:01:22.903395+0000","last_undegraded":"2024-04-25T16:01:22.903395+0000","last_fullsized":"2024-04-25T16:01:22.903395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'419","last_scrub_stamp":"2024-04-25T16:01:22.903089+0000","last_deep_scrub":"36'419","last_deep_scrub_stamp":"2024-04-25T16:01:22.903089+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.903089+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:38.452532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31054,"num_write":404,"num_write_kb":100026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"31'457","reported_seq":597,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583477+0000","last_change":"2024-04-25T15:54:20.404556+0000","last_active":"2024-04-25T16:00:43.583477+0000","last_peered":"2024-04-25T16:00:43.583477+0000","last_clean":"2024-04-25T16:00:43.583477+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T16:00:43.583477+0000","last_undegraded":"2024-04-25T16:00:43.583477+0000","last_fullsized":"2024-04-25T16:00:43.583477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56462,"num_write":435,"num_write_kb":97259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"36'357","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.484703+0000","last_change":"2024-04-25T16:01:26.484703+0000","last_active":"2024-04-25T16:01:26.484703+0000","last_peered":"2024-04-25T16:01:26.484703+0000","last_clean":"2024-04-25T16:01:26.484703+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T16:01:26.484703+0000","last_undegraded":"2024-04-25T16:01:26.484703+0000","last_fullsized":"2024-04-25T16:01:26.484703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'357","last_scrub_stamp":"2024-04-25T16:01:26.484245+0000","last_deep_scrub":"36'357","last_deep_scrub_stamp":"2024-04-25T16:01:26.484245+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.484245+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:33.363119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9534,"num_write":325,"num_write_kb":26581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"31'417","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.797876+0000","last_change":"2024-04-25T16:01:39.798063+0000","last_active":"2024-04-25T16:01:39.797876+0000","last_peered":"2024-04-25T16:01:39.797876+0000","last_clean":"2024-04-25T16:01:39.797876+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T16:01:39.797876+0000","last_undegraded":"2024-04-25T16:01:39.797876+0000","last_fullsized":"2024-04-25T16:01:39.797876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'417","last_scrub_stamp":"2024-04-25T16:01:39.797610+0000","last_deep_scrub":"31'417","last_deep_scrub_stamp":"2024-04-25T16:01:39.797610+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.797610+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:31.470363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28935,"num_write":390,"num_write_kb":55220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"36'446","reported_seq":567,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:42.099974+0000","last_change":"2024-04-25T16:01:42.099974+0000","last_active":"2024-04-25T16:01:42.099974+0000","last_peered":"2024-04-25T16:01:42.099974+0000","last_clean":"2024-04-25T16:01:42.099974+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T16:01:42.099974+0000","last_undegraded":"2024-04-25T16:01:42.099974+0000","last_fullsized":"2024-04-25T16:01:42.099974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'446","last_scrub_stamp":"2024-04-25T16:01:42.099494+0000","last_deep_scrub":"36'446","last_deep_scrub_stamp":"2024-04-25T16:01:42.099494+0000","last_clean_scrub_stamp":"2024-04-25T16:01:42.099494+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:22.792918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":18239,"num_write":428,"num_write_kb":69651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"31'386","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.901679+0000","last_change":"2024-04-25T16:01:41.901823+0000","last_active":"2024-04-25T16:01:41.901679+0000","last_peered":"2024-04-25T16:01:41.901679+0000","last_clean":"2024-04-25T16:01:41.901679+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T16:01:41.901679+0000","last_undegraded":"2024-04-25T16:01:41.901679+0000","last_fullsized":"2024-04-25T16:01:41.901679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'386","last_scrub_stamp":"2024-04-25T16:01:41.901334+0000","last_deep_scrub":"31'386","last_deep_scrub_stamp":"2024-04-25T16:01:41.901334+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.901334+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:52.259548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8859,"num_write":358,"num_write_kb":46267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'391","reported_seq":498,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.379064+0000","last_change":"2024-04-25T16:01:29.379064+0000","last_active":"2024-04-25T16:01:29.379064+0000","last_peered":"2024-04-25T16:01:29.379064+0000","last_clean":"2024-04-25T16:01:29.379064+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T16:01:29.379064+0000","last_undegraded":"2024-04-25T16:01:29.379064+0000","last_fullsized":"2024-04-25T16:01:29.379064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'391","last_scrub_stamp":"2024-04-25T16:01:29.378611+0000","last_deep_scrub":"36'391","last_deep_scrub_stamp":"2024-04-25T16:01:29.378611+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.378611+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:02.152502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32236,"num_write":374,"num_write_kb":95777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"31'357","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.619832+0000","last_change":"2024-04-25T15:54:20.443001+0000","last_active":"2024-04-25T16:00:43.619832+0000","last_peered":"2024-04-25T16:00:43.619832+0000","last_clean":"2024-04-25T16:00:43.619832+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T16:00:43.619832+0000","last_undegraded":"2024-04-25T16:00:43.619832+0000","last_fullsized":"2024-04-25T16:00:43.619832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22705,"num_write":334,"num_write_kb":38119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"36'425","reported_seq":531,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.001988+0000","last_change":"2024-04-25T16:01:34.001988+0000","last_active":"2024-04-25T16:01:34.001988+0000","last_peered":"2024-04-25T16:01:34.001988+0000","last_clean":"2024-04-25T16:01:34.001988+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T16:01:34.001988+0000","last_undegraded":"2024-04-25T16:01:34.001988+0000","last_fullsized":"2024-04-25T16:01:34.001988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'425","last_scrub_stamp":"2024-04-25T16:01:34.001534+0000","last_deep_scrub":"36'425","last_deep_scrub_stamp":"2024-04-25T16:01:34.001534+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.001534+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:11.843444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22941,"num_write":404,"num_write_kb":72501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"31'377","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.583002+0000","last_change":"2024-04-25T15:54:20.410555+0000","last_active":"2024-04-25T16:00:43.583002+0000","last_peered":"2024-04-25T16:00:43.583002+0000","last_clean":"2024-04-25T16:00:43.583002+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T16:00:43.583002+0000","last_undegraded":"2024-04-25T16:00:43.583002+0000","last_fullsized":"2024-04-25T16:00:43.583002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10994,"num_write":357,"num_write_kb":50723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'404","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.445222+0000","last_change":"2024-04-25T16:01:33.445295+0000","last_active":"2024-04-25T16:01:33.445222+0000","last_peered":"2024-04-25T16:01:33.445222+0000","last_clean":"2024-04-25T16:01:33.445222+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T16:01:33.445222+0000","last_undegraded":"2024-04-25T16:01:33.445222+0000","last_fullsized":"2024-04-25T16:01:33.445222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'404","last_scrub_stamp":"2024-04-25T16:01:33.444979+0000","last_deep_scrub":"36'404","last_deep_scrub_stamp":"2024-04-25T16:01:33.444979+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.444979+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:50.341345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11471,"num_write":379,"num_write_kb":75857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"31'407","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.568324+0000","last_change":"2024-04-25T16:01:33.568398+0000","last_active":"2024-04-25T16:01:33.568324+0000","last_peered":"2024-04-25T16:01:33.568324+0000","last_clean":"2024-04-25T16:01:33.568324+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T16:01:33.568324+0000","last_undegraded":"2024-04-25T16:01:33.568324+0000","last_fullsized":"2024-04-25T16:01:33.568324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'407","last_scrub_stamp":"2024-04-25T16:01:33.568087+0000","last_deep_scrub":"31'407","last_deep_scrub_stamp":"2024-04-25T16:01:33.568087+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.568087+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:25.569777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20101,"num_write":381,"num_write_kb":55469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"35'349","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.055408+0000","last_change":"2024-04-25T16:01:29.055479+0000","last_active":"2024-04-25T16:01:29.055408+0000","last_peered":"2024-04-25T16:01:29.055408+0000","last_clean":"2024-04-25T16:01:29.055408+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T16:01:29.055408+0000","last_undegraded":"2024-04-25T16:01:29.055408+0000","last_fullsized":"2024-04-25T16:01:29.055408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'349","last_scrub_stamp":"2024-04-25T16:01:29.055174+0000","last_deep_scrub":"35'349","last_deep_scrub_stamp":"2024-04-25T16:01:29.055174+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.055174+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:11.054464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9293,"num_write":327,"num_write_kb":37967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"31'359","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.019057+0000","last_change":"2024-04-25T16:01:29.019195+0000","last_active":"2024-04-25T16:01:29.019057+0000","last_peered":"2024-04-25T16:01:29.019057+0000","last_clean":"2024-04-25T16:01:29.019057+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T16:01:29.019057+0000","last_undegraded":"2024-04-25T16:01:29.019057+0000","last_fullsized":"2024-04-25T16:01:29.019057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'359","last_scrub_stamp":"2024-04-25T16:01:29.018699+0000","last_deep_scrub":"31'359","last_deep_scrub_stamp":"2024-04-25T16:01:29.018699+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.018699+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:14.577607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33728,"num_write":336,"num_write_kb":95963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"36'406","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.924537+0000","last_change":"2024-04-25T16:01:28.924607+0000","last_active":"2024-04-25T16:01:28.924537+0000","last_peered":"2024-04-25T16:01:28.924537+0000","last_clean":"2024-04-25T16:01:28.924537+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T16:01:28.924537+0000","last_undegraded":"2024-04-25T16:01:28.924537+0000","last_fullsized":"2024-04-25T16:01:28.924537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'406","last_scrub_stamp":"2024-04-25T16:01:28.924317+0000","last_deep_scrub":"36'406","last_deep_scrub_stamp":"2024-04-25T16:01:28.924317+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.924317+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:38.795476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15261,"num_write":373,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"31'453","reported_seq":604,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:00:43.569638+0000","last_change":"2024-04-25T15:54:20.435101+0000","last_active":"2024-04-25T16:00:43.569638+0000","last_peered":"2024-04-25T16:00:43.569638+0000","last_clean":"2024-04-25T16:00:43.569638+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T16:00:43.569638+0000","last_undegraded":"2024-04-25T16:00:43.569638+0000","last_fullsized":"2024-04-25T16:00:43.569638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:54:19.334017+0000","last_clean_scrub_stamp":"2024-04-25T15:54:19.334017+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":65459,"num_write":436,"num_write_kb":138981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"36'408","reported_seq":534,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.893788+0000","last_change":"2024-04-25T16:01:23.893862+0000","last_active":"2024-04-25T16:01:23.893788+0000","last_peered":"2024-04-25T16:01:23.893788+0000","last_clean":"2024-04-25T16:01:23.893788+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T16:01:23.893788+0000","last_undegraded":"2024-04-25T16:01:23.893788+0000","last_fullsized":"2024-04-25T16:01:23.893788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'408","last_scrub_stamp":"2024-04-25T16:01:23.893566+0000","last_deep_scrub":"36'408","last_deep_scrub_stamp":"2024-04-25T16:01:23.893566+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.893566+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:07.022197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":41811,"num_write":385,"num_write_kb":100198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2984,"num_read_kb":1496873,"num_write":24473,"num_write_kb":4464601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25921,"ondisk_log_size":25921,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":131985636,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":525,"num_read_kb":323765,"num_write":7010,"num_write_kb":134510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":264028160,"data_stored":263971272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8558,"ondisk_log_size":8558,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2716,"num_read_kb":1480093,"num_write":24434,"num_write_kb":4326556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25980,"ondisk_log_size":25980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":136622360,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":754,"num_read_kb":436547,"num_write":9520,"num_write_kb":140553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":273309696,"data_stored":273244720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11144,"ondisk_log_size":11144,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133788,"kb_used_data":66516,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94238052,"statfs":{"total":96636764160,"available":96499765248,"internally_reserved":0,"allocated":68112384,"data_stored":67887709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163488,"kb_used_data":78232,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94208352,"statfs":{"total":96636764160,"available":96469352448,"internally_reserved":0,"allocated":80109568,"data_stored":79880869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124800,"kb_used_data":43704,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94247040,"statfs":{"total":96636764160,"available":96508968960,"internally_reserved":0,"allocated":44752896,"data_stored":44525982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185596,"kb_used_data":91956,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94186244,"statfs":{"total":96636764160,"available":96446713856,"internally_reserved":0,"allocated":94162944,"data_stored":93928717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172076,"kb_used_data":96548,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94199764,"statfs":{"total":96636764160,"available":96460558336,"internally_reserved":0,"allocated":98865152,"data_stored":98627692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":22855680,"data_stored":22634176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173140,"kb_used_data":83724,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94198700,"statfs":{"total":96636764160,"available":96459468800,"internally_reserved":0,"allocated":85733376,"data_stored":85497868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131296,"kb_used_data":46040,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94240544,"statfs":{"total":96636764160,"available":96502317056,"internally_reserved":0,"allocated":47144960,"data_stored":46916155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30298112,"data_stored":30288669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9867264,"data_stored":9863389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35041280,"data_stored":35029885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26099712,"data_stored":26094295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46145536,"data_stored":46138016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":55021394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63422464,"data_stored":63410002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47611904,"data_stored":47603442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18243882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:01:43.556 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.556 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.557 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.557 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.557 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.557 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.557 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.558 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.558 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.558 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.558 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.558 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.559 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.559 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.559 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.559 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.559 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.560 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.560 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.560 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.560 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.560 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.560 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T15:54:09.172166+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.561 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.561 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.561 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.561 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.561 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.561 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.562 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-25T15:54:19.334017+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=54, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=16, tm_min=1, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T16:01:43.562 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T16:02:00.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:00.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.220+0000 7fc5a8d6d640 1 Processor -- start 2024-04-25T16:02:00.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.220+0000 7fc5a8d6d640 1 -- start start 2024-04-25T16:02:00.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a8d6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5a4152870 0x7fc5a4159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a8d6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a8d6d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4070cb0 con 0x7fc5a406c670 2024-04-25T16:02:00.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a8d6d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a4152c80 con 0x7fc5a4152870 2024-04-25T16:02:00.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a8d6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a4070f90 con 0x7fc5a40c9fe0 2024-04-25T16:02:00.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a1d9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a259c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5a4152870 0x7fc5a4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a2d9d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc5a406c670 0x7fc5a40add30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.87:48690/0 (socket says 172.21.15.87:48690) 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a259c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5a4152870 0x7fc5a4159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.87:33716/0 (socket says 172.21.15.87:33716) 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a2d9d640 1 -- 172.21.15.87:0/1978830200 learned_addr learned my addr 172.21.15.87:0/1978830200 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a259c640 1 -- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 msgr2=0x7fc5a41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a259c640 1 --2- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a41551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a259c640 1 -- 172.21.15.87:0/1978830200 >> v1:172.21.15.155:6789/0 conn(0x7fc5a406c670 legacy=0x7fc5a40add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a259c640 1 -- 172.21.15.87:0/1978830200 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a41587b0 con 0x7fc5a4152870 2024-04-25T16:02:00.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.224+0000 7fc5a1d9b640 1 --2- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a41551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T16:02:00.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a259c640 1 --2- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a4152870 0x7fc5a4159290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5940097c0 tx=0x7fc59401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8e2053e7a1b7c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:00.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a159a640 1 -- 172.21.15.87:0/1978830200 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940b0070 con 0x7fc5a4152870 2024-04-25T16:02:00.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a159a640 1 -- 172.21.15.87:0/1978830200 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5940ab600 con 0x7fc5a4152870 2024-04-25T16:02:00.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a159a640 1 -- 172.21.15.87:0/1978830200 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940ab9d0 con 0x7fc5a4152870 2024-04-25T16:02:00.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a4152870 msgr2=0x7fc5a4159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a4152870 0x7fc5a4159290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5940097c0 tx=0x7fc59401c4a0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/1978830200 shutdown_connections 2024-04-25T16:02:00.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a41551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/1978830200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a4152870 0x7fc5a4159290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/1978830200 >> 172.21.15.87:0/1978830200 conn(0x7fc5a406d780 msgr2=0x7fc5a406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:00.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/1978830200 shutdown_connections 2024-04-25T16:02:00.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.228+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/1978830200 wait complete. 2024-04-25T16:02:00.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 Processor -- start 2024-04-25T16:02:00.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- start start 2024-04-25T16:02:00.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a406c670 0x7fc5a40aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a40ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 0x7fc5a414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a4155700 con 0x7fc5a414f0d0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a406ce90 con 0x7fc5a406c670 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a4155880 con 0x7fc5a40c9fe0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 0x7fc5a414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 0x7fc5a414e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45824/0 (socket says 172.21.15.87:45824) 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 -- 172.21.15.87:0/2757817444 learned_addr learned my addr 172.21.15.87:0/2757817444 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a1d9b640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a40ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a259c640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a406c670 0x7fc5a40aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 -- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 msgr2=0x7fc5a40ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a40ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 -- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a406c670 msgr2=0x7fc5a40aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a406c670 0x7fc5a40aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 -- 172.21.15.87:0/2757817444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40bf740 con 0x7fc5a414f0d0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a1d9b640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a40ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a2d9d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 0x7fc5a414e000 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00ca20 tx=0x7fc59c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c017070 con 0x7fc5a414f0d0 2024-04-25T16:02:00.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59c00abd0 con 0x7fc5a414f0d0 2024-04-25T16:02:00.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a40bfa20 con 0x7fc5a414f0d0 2024-04-25T16:02:00.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c012400 con 0x7fc5a414f0d0 2024-04-25T16:02:00.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a414ea60 con 0x7fc5a414f0d0 2024-04-25T16:02:00.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.232+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a40c05c0 con 0x7fc5a414f0d0 2024-04-25T16:02:00.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.236+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc59c01a070 con 0x7fc5a414f0d0 2024-04-25T16:02:00.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.236+0000 7fc592ffd640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc58406f400 0x7fc584071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.236+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fc59c08f550 con 0x7fc5a414f0d0 2024-04-25T16:02:00.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.236+0000 7fc5a259c640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc58406f400 0x7fc584071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.236+0000 7fc5a259c640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc58406f400 0x7fc584071910 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc5940ad000 tx=0x7fc594008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:00.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.240+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc59c05b740 con 0x7fc5a414f0d0 2024-04-25T16:02:00.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.436+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5a4069bb0 con 0x7fc5a414f0d0 2024-04-25T16:02:00.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.436+0000 7fc592ffd640 1 -- 172.21.15.87:0/2757817444 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7fc59c05fa40 con 0x7fc5a414f0d0 2024-04-25T16:02:00.439 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:00.439 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:00.439 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:02:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc58406f400 msgr2=0x7fc584071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc58406f400 0x7fc584071910 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc5940ad000 tx=0x7fc594008040 comp rx=0 tx=0).stop 2024-04-25T16:02:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 msgr2=0x7fc5a414e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 0x7fc5a414e000 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00ca20 tx=0x7fc59c00cee0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 shutdown_connections 2024-04-25T16:02:00.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fc58406f400 0x7fc584071910 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5a414f0d0 0x7fc5a414e000 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a40c9fe0 0x7fc5a40ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 --2- 172.21.15.87:0/2757817444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a406c670 0x7fc5a40aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 >> 172.21.15.87:0/2757817444 conn(0x7fc5a406d780 msgr2=0x7fc5a4154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 shutdown_connections 2024-04-25T16:02:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.440+0000 7fc5a8d6d640 1 -- 172.21.15.87:0/2757817444 wait complete. 2024-04-25T16:02:00.461 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2024-04-25T16:02:00.461 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T16:02:00.462 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:00.478 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T16:02:00.479 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.652+0000 7f6956970640 1 Processor -- start 2024-04-25T16:02:00.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.652+0000 7f6956970640 1 -- start start 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f6956970640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69501518b0 0x7f695006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f6956970640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f69500ad160 0x7f69500c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f6956970640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6950154fc0 con 0x7f69500c4620 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f6956970640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f695006ed60 con 0x7f69501518b0 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f6956970640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f69500acb20 con 0x7f69500ad160 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69501518b0 0x7f695006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69501518b0 0x7f695006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45838/0 (socket says 172.21.15.87:45838) 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 -- 172.21.15.87:0/214981578 learned_addr learned my addr 172.21.15.87:0/214981578 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 -- 172.21.15.87:0/214981578 >> v2:172.21.15.155:3300/0 conn(0x7f69500ad160 msgr2=0x7f69500c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 --2- 172.21.15.87:0/214981578 >> v2:172.21.15.155:3300/0 conn(0x7f69500ad160 0x7f69500c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 -- 172.21.15.87:0/214981578 >> v1:172.21.15.155:6789/0 conn(0x7f69500c4620 legacy=0x7f6950157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:00.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.656+0000 7f694ffff640 1 -- 172.21.15.87:0/214981578 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500ace00 con 0x7f69501518b0 2024-04-25T16:02:00.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f694ffff640 1 --2- 172.21.15.87:0/214981578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69501518b0 0x7f695006f4d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6950070d80 tx=0x7f694801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e223a6911c8e1303 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:00.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f694effd640 1 -- 172.21.15.87:0/214981578 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69480a5890 con 0x7f69501518b0 2024-04-25T16:02:00.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f694effd640 1 -- 172.21.15.87:0/214981578 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69480a5a30 con 0x7f69501518b0 2024-04-25T16:02:00.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f694effd640 1 -- 172.21.15.87:0/214981578 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69480a5e00 con 0x7f69501518b0 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 -- 172.21.15.87:0/214981578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69501518b0 msgr2=0x7f695006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 --2- 172.21.15.87:0/214981578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69501518b0 0x7f695006f4d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6950070d80 tx=0x7f694801c9b0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 -- 172.21.15.87:0/214981578 shutdown_connections 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 --2- 172.21.15.87:0/214981578 >> v2:172.21.15.155:3300/0 conn(0x7f69500ad160 0x7f69500c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 --2- 172.21.15.87:0/214981578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69501518b0 0x7f695006f4d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 -- 172.21.15.87:0/214981578 >> 172.21.15.87:0/214981578 conn(0x7f69500c8770 msgr2=0x7f69500c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:00.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 -- 172.21.15.87:0/214981578 shutdown_connections 2024-04-25T16:02:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 -- 172.21.15.87:0/214981578 wait complete. 2024-04-25T16:02:00.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 Processor -- start 2024-04-25T16:02:00.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.660+0000 7f6956970640 1 -- start start 2024-04-25T16:02:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69500ad160 0x7f69500be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 0x7f69500c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69501518b0 0x7f69500c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6950161d60 con 0x7f69500c4620 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6950161be0 con 0x7f69500ad160 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6950161ee0 con 0x7f69501518b0 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 0x7f69500c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 0x7f69500c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45846/0 (socket says 172.21.15.87:45846) 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 -- 172.21.15.87:0/1621524842 learned_addr learned my addr 172.21.15.87:0/1621524842 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694ffff640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69500ad160 0x7f69500be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6954f0d640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69501518b0 0x7f69500c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 -- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69501518b0 msgr2=0x7f69500c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69501518b0 0x7f69500c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 -- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69500ad160 msgr2=0x7f69500be6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69500ad160 0x7f69500be6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 -- 172.21.15.87:0/1621524842 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500bec30 con 0x7f69500c4620 2024-04-25T16:02:00.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694f7fe640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 0x7f69500c1d00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f694400b440 tx=0x7f694400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:00.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944015020 con 0x7f69500c4620 2024-04-25T16:02:00.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69440118b0 con 0x7f69500c4620 2024-04-25T16:02:00.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69500bdb80 con 0x7f69500c4620 2024-04-25T16:02:00.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944011ca0 con 0x7f69500c4620 2024-04-25T16:02:00.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695014e320 con 0x7f69500c4620 2024-04-25T16:02:00.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6950069bb0 con 0x7f69500c4620 2024-04-25T16:02:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6944018020 con 0x7f69500c4620 2024-04-25T16:02:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694cff9640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f693c06f430 0x7f693c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f694408ff90 con 0x7f69500c4620 2024-04-25T16:02:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694ffff640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f693c06f430 0x7f693c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.664+0000 7f694ffff640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f693c06f430 0x7f693c071940 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f69480ae000 tx=0x7f69480a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.668+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f694401f020 con 0x7f69500c4620 2024-04-25T16:02:00.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.864+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69500c27b0 con 0x7f69500c4620 2024-04-25T16:02:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.864+0000 7f694cff9640 1 -- 172.21.15.87:0/1621524842 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7f694400d040 con 0x7f69500c4620 2024-04-25T16:02:00.865 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:00.865 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:00.865 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:02:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f693c06f430 msgr2=0x7f693c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f693c06f430 0x7f693c071940 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f69480ae000 tx=0x7f69480a7070 comp rx=0 tx=0).stop 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 msgr2=0x7f69500c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 0x7f69500c1d00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f694400b440 tx=0x7f694400b900 comp rx=0 tx=0).stop 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 shutdown_connections 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f693c06f430 0x7f693c071940 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69501518b0 0x7f69500c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69500c4620 0x7f69500c1d00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 --2- 172.21.15.87:0/1621524842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69500ad160 0x7f69500be6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 >> 172.21.15.87:0/1621524842 conn(0x7f69500c8770 msgr2=0x7f6950073bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 shutdown_connections 2024-04-25T16:02:00.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:00.868+0000 7f6956970640 1 -- 172.21.15.87:0/1621524842 wait complete. 2024-04-25T16:02:00.887 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:02:02.888 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:03.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd966453640 1 Processor -- start 2024-04-25T16:02:03.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd966453640 1 -- start start 2024-04-25T16:02:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd966453640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 0x7fd96015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd966453640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd960154fc0 con 0x7fd9600ad160 2024-04-25T16:02:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd966453640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9600acb20 con 0x7fd9601518b0 2024-04-25T16:02:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd966453640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd96006ed60 con 0x7fd9600ac1c0 2024-04-25T16:02:03.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95f7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd9600ad160 0x7fd9600c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44752/0 (socket says 172.21.15.87:44752) 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95f7fe640 1 -- 172.21.15.87:0/1957471591 learned_addr learned my addr 172.21.15.87:0/1957471591 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd9649f0640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 0x7fd96015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131982459 0 0) 0x7fd960154fc0 con 0x7fd9600ad160 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948003530 con 0x7fd9600ad160 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1535315927 0 0) 0x7fd948003530 con 0x7fd9600ad160 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 msgr2=0x7fd96015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 0x7fd96015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 >> v1:172.21.15.155:6789/0 conn(0x7fd9601518b0 legacy=0x7fd96006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9600ace00 con 0x7fd9600ad160 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fd954001a00 con 0x7fd9600ad160 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 >> v1:172.21.15.87:6789/0 conn(0x7fd9600ad160 legacy=0x7fd9600c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 0x7fd9480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd948003f50 0x7fd948004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd948004d50 0x7fd948005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd96006ed60 con 0x7fd948004d50 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd94800bae0 con 0x7fd948003f50 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd94800bce0 con 0x7fd9600ac1c0 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.052+0000 7fd9649f0640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd948004d50 0x7fd948005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd95ffff640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 0x7fd9480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd95f7fe640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd948003f50 0x7fd948004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 -- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 msgr2=0x7fd9480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600ac1c0 0x7fd9480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 -- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd948003f50 msgr2=0x7fd948004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd948003f50 0x7fd948004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 -- 172.21.15.87:0/1957471591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd948003530 con 0x7fd948004d50 2024-04-25T16:02:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd948004d50 0x7fd948005160 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd9600ae910 tx=0x7fd95801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da487e0c31784582 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580b2070 con 0x7fd948004d50 2024-04-25T16:02:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580a5510 con 0x7fd948004d50 2024-04-25T16:02:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd95effd640 1 -- 172.21.15.87:0/1957471591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580096b0 con 0x7fd948004d50 2024-04-25T16:02:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd966453640 1 -- 172.21.15.87:0/1957471591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd948004d50 msgr2=0x7fd948005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd966453640 1 --2- 172.21.15.87:0/1957471591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd948004d50 0x7fd948005160 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd9600ae910 tx=0x7fd95801ca30 comp rx=0 tx=0).stop 2024-04-25T16:02:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd9649f0640 1 -- 172.21.15.87:0/1957471591 reap_dead start 2024-04-25T16:02:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd966453640 1 -- 172.21.15.87:0/1957471591 shutdown_connections 2024-04-25T16:02:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd966453640 1 -- 172.21.15.87:0/1957471591 >> 172.21.15.87:0/1957471591 conn(0x7fd9600c8770 msgr2=0x7fd9600c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd966453640 1 -- 172.21.15.87:0/1957471591 shutdown_connections 2024-04-25T16:02:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.056+0000 7fd966453640 1 -- 172.21.15.87:0/1957471591 wait complete. 2024-04-25T16:02:03.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 Processor -- start 2024-04-25T16:02:03.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 -- start start 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd960163ca0 0x7fd9600c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 0x7fd9601ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600c1f10 0x7fd9601ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd96006fd60 con 0x7fd960148da0 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd96006fbe0 con 0x7fd9600c1f10 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9600c47f0 con 0x7fd960163ca0 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 0x7fd9601ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 0x7fd9601ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44534/0 (socket says 172.21.15.87:44534) 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 -- 172.21.15.87:0/2696564523 learned_addr learned my addr 172.21.15.87:0/2696564523 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd9649f0640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600c1f10 0x7fd9601ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95ffff640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd960163ca0 0x7fd9600c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 -- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd960163ca0 msgr2=0x7fd9600c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd960163ca0 0x7fd9600c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 -- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600c1f10 msgr2=0x7fd9601ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600c1f10 0x7fd9601ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 -- 172.21.15.87:0/2696564523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd960158510 con 0x7fd960148da0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95f7fe640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 0x7fd9601ed300 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd954011b80 tx=0x7fd95400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954010040 con 0x7fd960148da0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95401a070 con 0x7fd960148da0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954015650 con 0x7fd960148da0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd960157f00 con 0x7fd960148da0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.060+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9601581a0 con 0x7fd960148da0 2024-04-25T16:02:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.064+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd960069bb0 con 0x7fd960148da0 2024-04-25T16:02:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.064+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd9540157f0 con 0x7fd960148da0 2024-04-25T16:02:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.064+0000 7fd95cff9640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd94c06f400 0x7fd94c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.064+0000 7fd95ffff640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd94c06f400 0x7fd94c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.064+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fd954092d00 con 0x7fd960148da0 2024-04-25T16:02:03.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.064+0000 7fd95ffff640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd94c06f400 0x7fd94c071910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd9600c2410 tx=0x7fd950007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:03.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.068+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd95405f5d0 con 0x7fd960148da0 2024-04-25T16:02:03.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.268+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9600abfa0 con 0x7fd960148da0 2024-04-25T16:02:03.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd95cff9640 1 -- 172.21.15.87:0/2696564523 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7fd95405eed0 con 0x7fd960148da0 2024-04-25T16:02:03.271 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:03.271 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:03.271 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd94c06f400 msgr2=0x7fd94c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd94c06f400 0x7fd94c071910 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd9600c2410 tx=0x7fd950007c60 comp rx=0 tx=0).stop 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 msgr2=0x7fd9601ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 0x7fd9601ed300 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd954011b80 tx=0x7fd95400f540 comp rx=0 tx=0).stop 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 shutdown_connections 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd94c06f400 0x7fd94c071910 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600c1f10 0x7fd9601ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd960148da0 0x7fd9601ed300 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 --2- 172.21.15.87:0/2696564523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd960163ca0 0x7fd9600c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 >> 172.21.15.87:0/2696564523 conn(0x7fd9600c8770 msgr2=0x7fd960073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 shutdown_connections 2024-04-25T16:02:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.272+0000 7fd966453640 1 -- 172.21.15.87:0/2696564523 wait complete. 2024-04-25T16:02:03.295 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:02:03.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T16:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.720+0000 7efe2b83e640 1 Processor -- start 2024-04-25T16:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe2b83e640 1 -- start start 2024-04-25T16:02:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe2b83e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe24154ca0 0x7efe240c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe2b83e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe2415b220 0x7efe24161e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe2b83e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe240c45a0 con 0x7efe240c5960 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe2b83e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efe240c9f30 con 0x7efe2415b220 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe2b83e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efe240c3fe0 con 0x7efe24154ca0 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe2415b220 0x7efe24161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe2415b220 0x7efe24161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44546/0 (socket says 172.21.15.87:44546) 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe28dd9640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efe240c5960 0x7efe2415ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44758/0 (socket says 172.21.15.87:44758) 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 -- 172.21.15.87:0/4062980866 learned_addr learned my addr 172.21.15.87:0/4062980866 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe295da640 1 --2- 172.21.15.87:0/4062980866 >> v2:172.21.15.155:3300/0 conn(0x7efe24154ca0 0x7efe240c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 -- 172.21.15.87:0/4062980866 >> v2:172.21.15.155:3300/0 conn(0x7efe24154ca0 msgr2=0x7efe240c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 --2- 172.21.15.87:0/4062980866 >> v2:172.21.15.155:3300/0 conn(0x7efe24154ca0 0x7efe240c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 -- 172.21.15.87:0/4062980866 >> v1:172.21.15.87:6789/0 conn(0x7efe240c5960 legacy=0x7efe2415ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.724+0000 7efe29ddb640 1 -- 172.21.15.87:0/4062980866 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe240c42c0 con 0x7efe2415b220 2024-04-25T16:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe29ddb640 1 --2- 172.21.15.87:0/4062980866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe2415b220 0x7efe24161e40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efe24075260 tx=0x7efe1401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e026eb5535b03da1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe23fff640 1 -- 172.21.15.87:0/4062980866 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140b0070 con 0x7efe2415b220 2024-04-25T16:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe23fff640 1 -- 172.21.15.87:0/4062980866 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe140ab600 con 0x7efe2415b220 2024-04-25T16:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe23fff640 1 -- 172.21.15.87:0/4062980866 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140ab9d0 con 0x7efe2415b220 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 -- 172.21.15.87:0/4062980866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe2415b220 msgr2=0x7efe24161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 --2- 172.21.15.87:0/4062980866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe2415b220 0x7efe24161e40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efe24075260 tx=0x7efe1401c490 comp rx=0 tx=0).stop 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 -- 172.21.15.87:0/4062980866 shutdown_connections 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 --2- 172.21.15.87:0/4062980866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe2415b220 0x7efe24161e40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 --2- 172.21.15.87:0/4062980866 >> v2:172.21.15.155:3300/0 conn(0x7efe24154ca0 0x7efe240c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 -- 172.21.15.87:0/4062980866 >> 172.21.15.87:0/4062980866 conn(0x7efe240ac5c0 msgr2=0x7efe240ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 -- 172.21.15.87:0/4062980866 shutdown_connections 2024-04-25T16:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 -- 172.21.15.87:0/4062980866 wait complete. 2024-04-25T16:02:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 Processor -- start 2024-04-25T16:02:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.728+0000 7efe2b83e640 1 -- start start 2024-04-25T16:02:03.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe240c5960 0x7efe24072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 0x7efe24071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe2415b220 0x7efe2414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe240c3dc0 con 0x7efe24154ca0 2024-04-25T16:02:03.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe240c3c40 con 0x7efe240c5960 2024-04-25T16:02:03.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe240aa1d0 con 0x7efe2415b220 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 0x7efe24071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 0x7efe24071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44560/0 (socket says 172.21.15.87:44560) 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 -- 172.21.15.87:0/2130529892 learned_addr learned my addr 172.21.15.87:0/2130529892 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe295da640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe240c5960 0x7efe24072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe29ddb640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe2415b220 0x7efe2414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 -- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe2415b220 msgr2=0x7efe2414a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe2415b220 0x7efe2414a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 -- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe240c5960 msgr2=0x7efe24072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe240c5960 0x7efe24072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 -- 172.21.15.87:0/2130529892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe241538e0 con 0x7efe24154ca0 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe29ddb640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe2415b220 0x7efe2414a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe28dd9640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 0x7efe24071140 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efe1800c370 tx=0x7efe1800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180074e0 con 0x7efe24154ca0 2024-04-25T16:02:03.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe18007680 con 0x7efe24154ca0 2024-04-25T16:02:03.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe24153bc0 con 0x7efe24154ca0 2024-04-25T16:02:03.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18004a30 con 0x7efe24154ca0 2024-04-25T16:02:03.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2406f390 con 0x7efe24154ca0 2024-04-25T16:02:03.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe24069bb0 con 0x7efe24154ca0 2024-04-25T16:02:03.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.732+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efe1801a020 con 0x7efe24154ca0 2024-04-25T16:02:03.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.736+0000 7efe21ffb640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efe1006f400 0x7efe10071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:03.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.736+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7efe1808f0c0 con 0x7efe24154ca0 2024-04-25T16:02:03.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.736+0000 7efe295da640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efe1006f400 0x7efe10071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:03.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.736+0000 7efe295da640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efe1006f400 0x7efe10071910 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efe1c003fd0 tx=0x7efe1c0039a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:03.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.740+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe1805b990 con 0x7efe24154ca0 2024-04-25T16:02:03.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.900+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 --> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe24070a80 con 0x7efe1006f400 2024-04-25T16:02:03.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.932+0000 7efe21ffb640 1 -- 172.21.15.87:0/2130529892 <== mgr.4107 v2:172.21.15.87:6832/2795128651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495417 (secure 0 0 0) 0x7efe24070a80 con 0x7efe1006f400 2024-04-25T16:02:03.940 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:03.943 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-04-25T16:02:03.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efe1006f400 msgr2=0x7efe10071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efe1006f400 0x7efe10071910 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efe1c003fd0 tx=0x7efe1c0039a0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 msgr2=0x7efe24071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:03.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 0x7efe24071140 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efe1800c370 tx=0x7efe1800c830 comp rx=0 tx=0).stop 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 shutdown_connections 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7efe1006f400 0x7efe10071910 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe2415b220 0x7efe2414a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe24154ca0 0x7efe24071140 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 --2- 172.21.15.87:0/2130529892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe240c5960 0x7efe24072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 >> 172.21.15.87:0/2130529892 conn(0x7efe240ac5c0 msgr2=0x7efe240aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 shutdown_connections 2024-04-25T16:02:03.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:03.940+0000 7efe2b83e640 1 -- 172.21.15.87:0/2130529892 wait complete. 2024-04-25T16:02:03.966 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-25T16:02:03.301314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":269198364,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7045,"num_read_kb":3737333,"num_write":65538,"num_write_kb":9067848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71677,"ondisk_log_size":71677,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1159888,"kb_used_data":529040,"kb_used_omap":12,"kb_used_meta":630771,"kb_avail":753814832,"statfs":{"total":773094113280,"available":771906387968,"internally_reserved":0,"allocated":541736960,"data_stored":539899168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":645910065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006100"},"pg_stats":[{"pgid":"5.18","version":"31'448","reported_seq":551,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.576610+0000","last_change":"2024-04-25T16:01:36.576610+0000","last_active":"2024-04-25T16:01:36.576610+0000","last_peered":"2024-04-25T16:01:36.576610+0000","last_clean":"2024-04-25T16:01:36.576610+0000","last_became_active":"2024-04-25T15:54:20.397289+0000","last_became_peered":"2024-04-25T15:54:20.397289+0000","last_unstale":"2024-04-25T16:01:36.576610+0000","last_undegraded":"2024-04-25T16:01:36.576610+0000","last_fullsized":"2024-04-25T16:01:36.576610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'448","last_scrub_stamp":"2024-04-25T16:01:36.576149+0000","last_deep_scrub":"31'448","last_deep_scrub_stamp":"2024-04-25T16:01:36.576149+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.576149+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:53.472515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":27881,"num_write":426,"num_write_kb":76310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"36'1440","reported_seq":1516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.059005+0000","last_change":"2024-04-25T16:01:23.059063+0000","last_active":"2024-04-25T16:01:23.059005+0000","last_peered":"2024-04-25T16:01:23.059005+0000","last_clean":"2024-04-25T16:01:23.059005+0000","last_became_active":"2024-04-25T15:54:09.218430+0000","last_became_peered":"2024-04-25T15:54:09.218430+0000","last_unstale":"2024-04-25T16:01:23.059005+0000","last_undegraded":"2024-04-25T16:01:23.059005+0000","last_fullsized":"2024-04-25T16:01:23.059005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1440","last_scrub_stamp":"2024-04-25T16:01:23.058883+0000","last_deep_scrub":"36'1440","last_deep_scrub_stamp":"2024-04-25T16:01:23.058883+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.058883+0000","objects_scrubbed":3,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:08.187177+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":18411,"num_write":1381,"num_write_kb":5019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'392","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.517198+0000","last_change":"2024-04-25T16:01:32.517338+0000","last_active":"2024-04-25T16:01:32.517198+0000","last_peered":"2024-04-25T16:01:32.517198+0000","last_clean":"2024-04-25T16:01:32.517198+0000","last_became_active":"2024-04-25T15:54:10.251189+0000","last_became_peered":"2024-04-25T15:54:10.251189+0000","last_unstale":"2024-04-25T16:01:32.517198+0000","last_undegraded":"2024-04-25T16:01:32.517198+0000","last_fullsized":"2024-04-25T16:01:32.517198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'392","last_scrub_stamp":"2024-04-25T16:01:32.516842+0000","last_deep_scrub":"36'392","last_deep_scrub_stamp":"2024-04-25T16:01:32.516842+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.516842+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:16.444904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12356,"num_write":363,"num_write_kb":47533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'230","reported_seq":282,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.571100+0000","last_change":"2024-04-25T16:01:22.571100+0000","last_active":"2024-04-25T16:01:22.571100+0000","last_peered":"2024-04-25T16:01:22.571100+0000","last_clean":"2024-04-25T16:01:22.571100+0000","last_became_active":"2024-04-25T15:54:19.360322+0000","last_became_peered":"2024-04-25T15:54:19.360322+0000","last_unstale":"2024-04-25T16:01:22.571100+0000","last_undegraded":"2024-04-25T16:01:22.571100+0000","last_fullsized":"2024-04-25T16:01:22.571100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'230","last_scrub_stamp":"2024-04-25T16:01:22.570963+0000","last_deep_scrub":"36'230","last_deep_scrub_stamp":"2024-04-25T16:01:22.570963+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.570963+0000","objects_scrubbed":1,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:35.805251+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":183,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'392","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.910956+0000","last_change":"2024-04-25T16:01:40.911029+0000","last_active":"2024-04-25T16:01:40.910956+0000","last_peered":"2024-04-25T16:01:40.910956+0000","last_clean":"2024-04-25T16:01:40.910956+0000","last_became_active":"2024-04-25T15:54:20.431707+0000","last_became_peered":"2024-04-25T15:54:20.431707+0000","last_unstale":"2024-04-25T16:01:40.910956+0000","last_undegraded":"2024-04-25T16:01:40.910956+0000","last_fullsized":"2024-04-25T16:01:40.910956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'392","last_scrub_stamp":"2024-04-25T16:01:40.910707+0000","last_deep_scrub":"31'392","last_deep_scrub_stamp":"2024-04-25T16:01:40.910707+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.910707+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:17.751997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30984,"num_write":367,"num_write_kb":33760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"36'216","reported_seq":278,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.539450+0000","last_change":"2024-04-25T16:01:35.539525+0000","last_active":"2024-04-25T16:01:35.539450+0000","last_peered":"2024-04-25T16:01:35.539450+0000","last_clean":"2024-04-25T16:01:35.539450+0000","last_became_active":"2024-04-25T15:54:09.213793+0000","last_became_peered":"2024-04-25T15:54:09.213793+0000","last_unstale":"2024-04-25T16:01:35.539450+0000","last_undegraded":"2024-04-25T16:01:35.539450+0000","last_fullsized":"2024-04-25T16:01:35.539450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'216","last_scrub_stamp":"2024-04-25T16:01:35.539219+0000","last_deep_scrub":"36'216","last_deep_scrub_stamp":"2024-04-25T16:01:35.539219+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.539219+0000","objects_scrubbed":1,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:59.747599+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":163,"num_write_kb":4188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'349","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.068134+0000","last_change":"2024-04-25T16:01:20.068191+0000","last_active":"2024-04-25T16:01:20.068134+0000","last_peered":"2024-04-25T16:01:20.068134+0000","last_clean":"2024-04-25T16:01:20.068134+0000","last_became_active":"2024-04-25T15:54:10.261905+0000","last_became_peered":"2024-04-25T15:54:10.261905+0000","last_unstale":"2024-04-25T16:01:20.068134+0000","last_undegraded":"2024-04-25T16:01:20.068134+0000","last_fullsized":"2024-04-25T16:01:20.068134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'349","last_scrub_stamp":"2024-04-25T16:01:20.067996+0000","last_deep_scrub":"36'349","last_deep_scrub_stamp":"2024-04-25T16:01:20.067996+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.067996+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:07.683053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5423,"num_write":327,"num_write_kb":34935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'1398","reported_seq":1453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.680225+0000","last_change":"2024-04-25T16:01:24.680225+0000","last_active":"2024-04-25T16:01:24.680225+0000","last_peered":"2024-04-25T16:01:24.680225+0000","last_clean":"2024-04-25T16:01:24.680225+0000","last_became_active":"2024-04-25T15:54:19.384563+0000","last_became_peered":"2024-04-25T15:54:19.384563+0000","last_unstale":"2024-04-25T16:01:24.680225+0000","last_undegraded":"2024-04-25T16:01:24.680225+0000","last_fullsized":"2024-04-25T16:01:24.680225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1398","last_scrub_stamp":"2024-04-25T16:01:24.679844+0000","last_deep_scrub":"36'1398","last_deep_scrub_stamp":"2024-04-25T16:01:24.679844+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.679844+0000","objects_scrubbed":2,"log_size":1398,"log_dups_size":0,"ondisk_log_size":1398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:49.815907+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":1329,"num_write_kb":8847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"31'398","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:47.139761+0000","last_change":"2024-04-25T16:01:47.139761+0000","last_active":"2024-04-25T16:01:47.139761+0000","last_peered":"2024-04-25T16:01:47.139761+0000","last_clean":"2024-04-25T16:01:47.139761+0000","last_became_active":"2024-04-25T15:54:20.439290+0000","last_became_peered":"2024-04-25T15:54:20.439290+0000","last_unstale":"2024-04-25T16:01:47.139761+0000","last_undegraded":"2024-04-25T16:01:47.139761+0000","last_fullsized":"2024-04-25T16:01:47.139761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'398","last_scrub_stamp":"2024-04-25T16:01:47.139312+0000","last_deep_scrub":"31'398","last_deep_scrub_stamp":"2024-04-25T16:01:47.139312+0000","last_clean_scrub_stamp":"2024-04-25T16:01:47.139312+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.510659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14376,"num_write":371,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"36'387","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.202881+0000","last_change":"2024-04-25T16:01:40.202881+0000","last_active":"2024-04-25T16:01:40.202881+0000","last_peered":"2024-04-25T16:01:40.202881+0000","last_clean":"2024-04-25T16:01:40.202881+0000","last_became_active":"2024-04-25T15:54:09.224816+0000","last_became_peered":"2024-04-25T15:54:09.224816+0000","last_unstale":"2024-04-25T16:01:40.202881+0000","last_undegraded":"2024-04-25T16:01:40.202881+0000","last_fullsized":"2024-04-25T16:01:40.202881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'387","last_scrub_stamp":"2024-04-25T16:01:40.202546+0000","last_deep_scrub":"36'387","last_deep_scrub_stamp":"2024-04-25T16:01:40.202546+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.202546+0000","objects_scrubbed":4,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:47.676220+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":45080,"num_write":303,"num_write_kb":12463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'366","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.434004+0000","last_change":"2024-04-25T16:01:41.434004+0000","last_active":"2024-04-25T16:01:41.434004+0000","last_peered":"2024-04-25T16:01:41.434004+0000","last_clean":"2024-04-25T16:01:41.434004+0000","last_became_active":"2024-04-25T15:54:10.261386+0000","last_became_peered":"2024-04-25T15:54:10.261386+0000","last_unstale":"2024-04-25T16:01:41.434004+0000","last_undegraded":"2024-04-25T16:01:41.434004+0000","last_fullsized":"2024-04-25T16:01:41.434004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'366","last_scrub_stamp":"2024-04-25T16:01:41.433704+0000","last_deep_scrub":"36'366","last_deep_scrub_stamp":"2024-04-25T16:01:41.433704+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.433704+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:53.679713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24540,"num_write":344,"num_write_kb":42834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'119","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.594803+0000","last_change":"2024-04-25T16:01:21.594803+0000","last_active":"2024-04-25T16:01:21.594803+0000","last_peered":"2024-04-25T16:01:21.594803+0000","last_clean":"2024-04-25T16:01:21.594803+0000","last_became_active":"2024-04-25T15:54:19.377421+0000","last_became_peered":"2024-04-25T15:54:19.377421+0000","last_unstale":"2024-04-25T16:01:21.594803+0000","last_undegraded":"2024-04-25T16:01:21.594803+0000","last_fullsized":"2024-04-25T16:01:21.594803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-25T16:01:21.594415+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-25T16:01:21.594415+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.594415+0000","objects_scrubbed":1,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:28.575399+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":59,"num_write_kb":4138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'379","reported_seq":451,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:43.479348+0000","last_change":"2024-04-25T16:01:43.479348+0000","last_active":"2024-04-25T16:01:43.479348+0000","last_peered":"2024-04-25T16:01:43.479348+0000","last_clean":"2024-04-25T16:01:43.479348+0000","last_became_active":"2024-04-25T15:54:20.428092+0000","last_became_peered":"2024-04-25T15:54:20.428092+0000","last_unstale":"2024-04-25T16:01:43.479348+0000","last_undegraded":"2024-04-25T16:01:43.479348+0000","last_fullsized":"2024-04-25T16:01:43.479348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'379","last_scrub_stamp":"2024-04-25T16:01:43.478991+0000","last_deep_scrub":"31'379","last_deep_scrub_stamp":"2024-04-25T16:01:43.478991+0000","last_clean_scrub_stamp":"2024-04-25T16:01:43.478991+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:29.729212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17536,"num_write":366,"num_write_kb":55228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"36'363","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.108945+0000","last_change":"2024-04-25T16:01:38.108945+0000","last_active":"2024-04-25T16:01:38.108945+0000","last_peered":"2024-04-25T16:01:38.108945+0000","last_clean":"2024-04-25T16:01:38.108945+0000","last_became_active":"2024-04-25T15:54:09.221178+0000","last_became_peered":"2024-04-25T15:54:09.221178+0000","last_unstale":"2024-04-25T16:01:38.108945+0000","last_undegraded":"2024-04-25T16:01:38.108945+0000","last_fullsized":"2024-04-25T16:01:38.108945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'363","last_scrub_stamp":"2024-04-25T16:01:38.108596+0000","last_deep_scrub":"36'363","last_deep_scrub_stamp":"2024-04-25T16:01:38.108596+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.108596+0000","objects_scrubbed":2,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:17.270197+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":312,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'376","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.278484+0000","last_change":"2024-04-25T16:01:25.278484+0000","last_active":"2024-04-25T16:01:25.278484+0000","last_peered":"2024-04-25T16:01:25.278484+0000","last_clean":"2024-04-25T16:01:25.278484+0000","last_became_active":"2024-04-25T15:54:10.269371+0000","last_became_peered":"2024-04-25T15:54:10.269371+0000","last_unstale":"2024-04-25T16:01:25.278484+0000","last_undegraded":"2024-04-25T16:01:25.278484+0000","last_fullsized":"2024-04-25T16:01:25.278484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'376","last_scrub_stamp":"2024-04-25T16:01:25.278198+0000","last_deep_scrub":"36'376","last_deep_scrub_stamp":"2024-04-25T16:01:25.278198+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.278198+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:38.512487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31362,"num_write":348,"num_write_kb":63308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'410","reported_seq":467,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.656933+0000","last_change":"2024-04-25T16:01:27.656933+0000","last_active":"2024-04-25T16:01:27.656933+0000","last_peered":"2024-04-25T16:01:27.656933+0000","last_clean":"2024-04-25T16:01:27.656933+0000","last_became_active":"2024-04-25T15:54:19.373985+0000","last_became_peered":"2024-04-25T15:54:19.373985+0000","last_unstale":"2024-04-25T16:01:27.656933+0000","last_undegraded":"2024-04-25T16:01:27.656933+0000","last_fullsized":"2024-04-25T16:01:27.656933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'410","last_scrub_stamp":"2024-04-25T16:01:27.656586+0000","last_deep_scrub":"36'410","last_deep_scrub_stamp":"2024-04-25T16:01:27.656586+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.656586+0000","objects_scrubbed":3,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:21.941941+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":355,"num_write_kb":12470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'439","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.847430+0000","last_change":"2024-04-25T16:01:38.847522+0000","last_active":"2024-04-25T16:01:38.847430+0000","last_peered":"2024-04-25T16:01:38.847430+0000","last_clean":"2024-04-25T16:01:38.847430+0000","last_became_active":"2024-04-25T15:54:20.426092+0000","last_became_peered":"2024-04-25T15:54:20.426092+0000","last_unstale":"2024-04-25T16:01:38.847430+0000","last_undegraded":"2024-04-25T16:01:38.847430+0000","last_fullsized":"2024-04-25T16:01:38.847430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'439","last_scrub_stamp":"2024-04-25T16:01:38.847196+0000","last_deep_scrub":"31'439","last_deep_scrub_stamp":"2024-04-25T16:01:38.847196+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.847196+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:36.294066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15953,"num_write":415,"num_write_kb":91831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"36'454","reported_seq":590,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.703005+0000","last_change":"2024-04-25T16:01:25.703074+0000","last_active":"2024-04-25T16:01:25.703005+0000","last_peered":"2024-04-25T16:01:25.703005+0000","last_clean":"2024-04-25T16:01:25.703005+0000","last_became_active":"2024-04-25T15:54:10.258149+0000","last_became_peered":"2024-04-25T15:54:10.258149+0000","last_unstale":"2024-04-25T16:01:25.703005+0000","last_undegraded":"2024-04-25T16:01:25.703005+0000","last_fullsized":"2024-04-25T16:01:25.703005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'454","last_scrub_stamp":"2024-04-25T16:01:25.702790+0000","last_deep_scrub":"36'454","last_deep_scrub_stamp":"2024-04-25T16:01:25.702790+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.702790+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:10.496690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":34259,"num_write":426,"num_write_kb":109355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'212","reported_seq":285,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.169166+0000","last_change":"2024-04-25T16:01:41.169262+0000","last_active":"2024-04-25T16:01:41.169166+0000","last_peered":"2024-04-25T16:01:41.169166+0000","last_clean":"2024-04-25T16:01:41.169166+0000","last_became_active":"2024-04-25T15:54:09.229399+0000","last_became_peered":"2024-04-25T15:54:09.229399+0000","last_unstale":"2024-04-25T16:01:41.169166+0000","last_undegraded":"2024-04-25T16:01:41.169166+0000","last_fullsized":"2024-04-25T16:01:41.169166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'212","last_scrub_stamp":"2024-04-25T16:01:41.168935+0000","last_deep_scrub":"36'212","last_deep_scrub_stamp":"2024-04-25T16:01:41.168935+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.168935+0000","objects_scrubbed":3,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:03.569134+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":32780,"num_write":144,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'519","reported_seq":577,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.647558+0000","last_change":"2024-04-25T16:01:25.647646+0000","last_active":"2024-04-25T16:01:25.647558+0000","last_peered":"2024-04-25T16:01:25.647558+0000","last_clean":"2024-04-25T16:01:25.647558+0000","last_became_active":"2024-04-25T15:54:19.371580+0000","last_became_peered":"2024-04-25T15:54:19.371580+0000","last_unstale":"2024-04-25T16:01:25.647558+0000","last_undegraded":"2024-04-25T16:01:25.647558+0000","last_fullsized":"2024-04-25T16:01:25.647558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'519","last_scrub_stamp":"2024-04-25T16:01:25.647270+0000","last_deep_scrub":"36'519","last_deep_scrub_stamp":"2024-04-25T16:01:25.647270+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.647270+0000","objects_scrubbed":2,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:41.196713+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":469,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'399","reported_seq":488,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.598793+0000","last_change":"2024-04-25T16:01:32.598866+0000","last_active":"2024-04-25T16:01:32.598793+0000","last_peered":"2024-04-25T16:01:32.598793+0000","last_clean":"2024-04-25T16:01:32.598793+0000","last_became_active":"2024-04-25T15:54:20.415221+0000","last_became_peered":"2024-04-25T15:54:20.415221+0000","last_unstale":"2024-04-25T16:01:32.598793+0000","last_undegraded":"2024-04-25T16:01:32.598793+0000","last_fullsized":"2024-04-25T16:01:32.598793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'399","last_scrub_stamp":"2024-04-25T16:01:32.598539+0000","last_deep_scrub":"31'399","last_deep_scrub_stamp":"2024-04-25T16:01:32.598539+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.598539+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:59.630235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":26873,"num_write":378,"num_write_kb":71246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"35'429","reported_seq":553,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.523455+0000","last_change":"2024-04-25T16:01:34.523575+0000","last_active":"2024-04-25T16:01:34.523455+0000","last_peered":"2024-04-25T16:01:34.523455+0000","last_clean":"2024-04-25T16:01:34.523455+0000","last_became_active":"2024-04-25T15:54:10.242857+0000","last_became_peered":"2024-04-25T15:54:10.242857+0000","last_unstale":"2024-04-25T16:01:34.523455+0000","last_undegraded":"2024-04-25T16:01:34.523455+0000","last_fullsized":"2024-04-25T16:01:34.523455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'429","last_scrub_stamp":"2024-04-25T16:01:34.523199+0000","last_deep_scrub":"35'429","last_deep_scrub_stamp":"2024-04-25T16:01:34.523199+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.523199+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:13.684800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42040,"num_write":408,"num_write_kb":84111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'201","reported_seq":262,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.885258+0000","last_change":"2024-04-25T16:01:31.885344+0000","last_active":"2024-04-25T16:01:31.885258+0000","last_peered":"2024-04-25T16:01:31.885258+0000","last_clean":"2024-04-25T16:01:31.885258+0000","last_became_active":"2024-04-25T15:54:09.212009+0000","last_became_peered":"2024-04-25T15:54:09.212009+0000","last_unstale":"2024-04-25T16:01:31.885258+0000","last_undegraded":"2024-04-25T16:01:31.885258+0000","last_fullsized":"2024-04-25T16:01:31.885258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'201","last_scrub_stamp":"2024-04-25T16:01:31.885029+0000","last_deep_scrub":"36'201","last_deep_scrub_stamp":"2024-04-25T16:01:31.885029+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.885029+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:23.557782+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":138,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'60","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.599976+0000","last_change":"2024-04-25T16:01:35.600135+0000","last_active":"2024-04-25T16:01:35.599976+0000","last_peered":"2024-04-25T16:01:35.599976+0000","last_clean":"2024-04-25T16:01:35.599976+0000","last_became_active":"2024-04-25T15:54:19.373836+0000","last_became_peered":"2024-04-25T15:54:19.373836+0000","last_unstale":"2024-04-25T16:01:35.599976+0000","last_undegraded":"2024-04-25T16:01:35.599976+0000","last_fullsized":"2024-04-25T16:01:35.599976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'60","last_scrub_stamp":"2024-04-25T16:01:35.599701+0000","last_deep_scrub":"31'60","last_deep_scrub_stamp":"2024-04-25T16:01:35.599701+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.599701+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:09.646442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'380","reported_seq":471,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.549379+0000","last_change":"2024-04-25T16:01:37.549458+0000","last_active":"2024-04-25T16:01:37.549379+0000","last_peered":"2024-04-25T16:01:37.549379+0000","last_clean":"2024-04-25T16:01:37.549379+0000","last_became_active":"2024-04-25T15:54:20.413863+0000","last_became_peered":"2024-04-25T15:54:20.413863+0000","last_unstale":"2024-04-25T16:01:37.549379+0000","last_undegraded":"2024-04-25T16:01:37.549379+0000","last_fullsized":"2024-04-25T16:01:37.549379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'380","last_scrub_stamp":"2024-04-25T16:01:37.549134+0000","last_deep_scrub":"31'380","last_deep_scrub_stamp":"2024-04-25T16:01:37.549134+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.549134+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:21.477197+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":24884,"num_write":362,"num_write_kb":71575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"35'377","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:42.598521+0000","last_change":"2024-04-25T16:01:42.598589+0000","last_active":"2024-04-25T16:01:42.598521+0000","last_peered":"2024-04-25T16:01:42.598521+0000","last_clean":"2024-04-25T16:01:42.598521+0000","last_became_active":"2024-04-25T15:54:10.239616+0000","last_became_peered":"2024-04-25T15:54:10.239616+0000","last_unstale":"2024-04-25T16:01:42.598521+0000","last_undegraded":"2024-04-25T16:01:42.598521+0000","last_fullsized":"2024-04-25T16:01:42.598521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'377","last_scrub_stamp":"2024-04-25T16:01:42.598282+0000","last_deep_scrub":"35'377","last_deep_scrub_stamp":"2024-04-25T16:01:42.598282+0000","last_clean_scrub_stamp":"2024-04-25T16:01:42.598282+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:07.707228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7657,"num_write":351,"num_write_kb":21765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'69","reported_seq":127,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.903704+0000","last_change":"2024-04-25T16:01:30.903844+0000","last_active":"2024-04-25T16:01:30.903704+0000","last_peered":"2024-04-25T16:01:30.903704+0000","last_clean":"2024-04-25T16:01:30.903704+0000","last_became_active":"2024-04-25T15:54:09.211816+0000","last_became_peered":"2024-04-25T15:54:09.211816+0000","last_unstale":"2024-04-25T16:01:30.903704+0000","last_undegraded":"2024-04-25T16:01:30.903704+0000","last_fullsized":"2024-04-25T16:01:30.903704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'69","last_scrub_stamp":"2024-04-25T16:01:30.903381+0000","last_deep_scrub":"36'69","last_deep_scrub_stamp":"2024-04-25T16:01:30.903381+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.903381+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:02.455987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'196","reported_seq":252,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.954136+0000","last_change":"2024-04-25T16:01:20.954307+0000","last_active":"2024-04-25T16:01:20.954136+0000","last_peered":"2024-04-25T16:01:20.954136+0000","last_clean":"2024-04-25T16:01:20.954136+0000","last_became_active":"2024-04-25T15:54:19.371891+0000","last_became_peered":"2024-04-25T15:54:19.371891+0000","last_unstale":"2024-04-25T16:01:20.954136+0000","last_undegraded":"2024-04-25T16:01:20.954136+0000","last_fullsized":"2024-04-25T16:01:20.954136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'196","last_scrub_stamp":"2024-04-25T16:01:20.953850+0000","last_deep_scrub":"36'196","last_deep_scrub_stamp":"2024-04-25T16:01:20.953850+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.953850+0000","objects_scrubbed":2,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:02.572425+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":146,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"31'395","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:42.482463+0000","last_change":"2024-04-25T16:01:42.482533+0000","last_active":"2024-04-25T16:01:42.482463+0000","last_peered":"2024-04-25T16:01:42.482463+0000","last_clean":"2024-04-25T16:01:42.482463+0000","last_became_active":"2024-04-25T15:54:20.427942+0000","last_became_peered":"2024-04-25T15:54:20.427942+0000","last_unstale":"2024-04-25T16:01:42.482463+0000","last_undegraded":"2024-04-25T16:01:42.482463+0000","last_fullsized":"2024-04-25T16:01:42.482463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'395","last_scrub_stamp":"2024-04-25T16:01:42.482177+0000","last_deep_scrub":"31'395","last_deep_scrub_stamp":"2024-04-25T16:01:42.482177+0000","last_clean_scrub_stamp":"2024-04-25T16:01:42.482177+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:58.378637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23834,"num_write":371,"num_write_kb":79616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"36'432","reported_seq":494,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.591822+0000","last_change":"2024-04-25T16:01:29.591889+0000","last_active":"2024-04-25T16:01:29.591822+0000","last_peered":"2024-04-25T16:01:29.591822+0000","last_clean":"2024-04-25T16:01:29.591822+0000","last_became_active":"2024-04-25T15:54:10.237366+0000","last_became_peered":"2024-04-25T15:54:10.237366+0000","last_unstale":"2024-04-25T16:01:29.591822+0000","last_undegraded":"2024-04-25T16:01:29.591822+0000","last_fullsized":"2024-04-25T16:01:29.591822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'432","last_scrub_stamp":"2024-04-25T16:01:29.591602+0000","last_deep_scrub":"36'432","last_deep_scrub_stamp":"2024-04-25T16:01:29.591602+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.591602+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:27.271312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1051,"num_write":404,"num_write_kb":46183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'634","reported_seq":695,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.141165+0000","last_change":"2024-04-25T16:01:37.141240+0000","last_active":"2024-04-25T16:01:37.141165+0000","last_peered":"2024-04-25T16:01:37.141165+0000","last_clean":"2024-04-25T16:01:37.141165+0000","last_became_active":"2024-04-25T15:54:09.219605+0000","last_became_peered":"2024-04-25T15:54:09.219605+0000","last_unstale":"2024-04-25T16:01:37.141165+0000","last_undegraded":"2024-04-25T16:01:37.141165+0000","last_fullsized":"2024-04-25T16:01:37.141165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'634","last_scrub_stamp":"2024-04-25T16:01:37.140954+0000","last_deep_scrub":"36'634","last_deep_scrub_stamp":"2024-04-25T16:01:37.140954+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.140954+0000","objects_scrubbed":1,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:03.068287+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":576,"num_write_kb":4402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'341","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.633927+0000","last_change":"2024-04-25T16:01:22.634008+0000","last_active":"2024-04-25T16:01:22.633927+0000","last_peered":"2024-04-25T16:01:22.633927+0000","last_clean":"2024-04-25T16:01:22.633927+0000","last_became_active":"2024-04-25T15:54:19.384693+0000","last_became_peered":"2024-04-25T15:54:19.384693+0000","last_unstale":"2024-04-25T16:01:22.633927+0000","last_undegraded":"2024-04-25T16:01:22.633927+0000","last_fullsized":"2024-04-25T16:01:22.633927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'341","last_scrub_stamp":"2024-04-25T16:01:22.633686+0000","last_deep_scrub":"36'341","last_deep_scrub_stamp":"2024-04-25T16:01:22.633686+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.633686+0000","objects_scrubbed":2,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:23.389079+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":287,"num_write_kb":4255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"31'408","reported_seq":528,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:49.547225+0000","last_change":"2024-04-25T16:01:49.547387+0000","last_active":"2024-04-25T16:01:49.547225+0000","last_peered":"2024-04-25T16:01:49.547225+0000","last_clean":"2024-04-25T16:01:49.547225+0000","last_became_active":"2024-04-25T15:54:20.423725+0000","last_became_peered":"2024-04-25T15:54:20.423725+0000","last_unstale":"2024-04-25T16:01:49.547225+0000","last_undegraded":"2024-04-25T16:01:49.547225+0000","last_fullsized":"2024-04-25T16:01:49.547225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'408","last_scrub_stamp":"2024-04-25T16:01:49.546957+0000","last_deep_scrub":"31'408","last_deep_scrub_stamp":"2024-04-25T16:01:49.546957+0000","last_clean_scrub_stamp":"2024-04-25T16:01:49.546957+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:37.073075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":22153,"num_write":390,"num_write_kb":51497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"36'445","reported_seq":533,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.043426+0000","last_change":"2024-04-25T16:01:28.043496+0000","last_active":"2024-04-25T16:01:28.043426+0000","last_peered":"2024-04-25T16:01:28.043426+0000","last_clean":"2024-04-25T16:01:28.043426+0000","last_became_active":"2024-04-25T15:54:10.238933+0000","last_became_peered":"2024-04-25T15:54:10.238933+0000","last_unstale":"2024-04-25T16:01:28.043426+0000","last_undegraded":"2024-04-25T16:01:28.043426+0000","last_fullsized":"2024-04-25T16:01:28.043426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'445","last_scrub_stamp":"2024-04-25T16:01:28.043201+0000","last_deep_scrub":"36'445","last_deep_scrub_stamp":"2024-04-25T16:01:28.043201+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.043201+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:11.171831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9563,"num_write":414,"num_write_kb":59478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'73","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.700560+0000","last_change":"2024-04-25T16:01:29.700707+0000","last_active":"2024-04-25T16:01:29.700560+0000","last_peered":"2024-04-25T16:01:29.700560+0000","last_clean":"2024-04-25T16:01:29.700560+0000","last_became_active":"2024-04-25T15:54:09.212038+0000","last_became_peered":"2024-04-25T15:54:09.212038+0000","last_unstale":"2024-04-25T16:01:29.700560+0000","last_undegraded":"2024-04-25T16:01:29.700560+0000","last_fullsized":"2024-04-25T16:01:29.700560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-04-25T16:01:29.700264+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-04-25T16:01:29.700264+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.700264+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:45.249707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":12,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'292","reported_seq":558,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.658483+0000","last_change":"2024-04-25T16:01:26.658558+0000","last_active":"2024-04-25T16:01:26.658483+0000","last_peered":"2024-04-25T16:01:26.658483+0000","last_clean":"2024-04-25T16:01:26.658483+0000","last_became_active":"2024-04-25T15:54:19.388565+0000","last_became_peered":"2024-04-25T15:54:19.388565+0000","last_unstale":"2024-04-25T16:01:26.658483+0000","last_undegraded":"2024-04-25T16:01:26.658483+0000","last_fullsized":"2024-04-25T16:01:26.658483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-04-25T16:01:26.658271+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-04-25T16:01:26.658271+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.658271+0000","objects_scrubbed":1,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:09.786901+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465994,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":1569,"num_write":227,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"31'396","reported_seq":479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.605944+0000","last_change":"2024-04-25T16:01:39.606023+0000","last_active":"2024-04-25T16:01:39.605944+0000","last_peered":"2024-04-25T16:01:39.605944+0000","last_clean":"2024-04-25T16:01:39.605944+0000","last_became_active":"2024-04-25T15:54:20.417263+0000","last_became_peered":"2024-04-25T15:54:20.417263+0000","last_unstale":"2024-04-25T16:01:39.605944+0000","last_undegraded":"2024-04-25T16:01:39.605944+0000","last_fullsized":"2024-04-25T16:01:39.605944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'396","last_scrub_stamp":"2024-04-25T16:01:39.605684+0000","last_deep_scrub":"31'396","last_deep_scrub_stamp":"2024-04-25T16:01:39.605684+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.605684+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:18.767285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17201,"num_write":368,"num_write_kb":116540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'348","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.545334+0000","last_change":"2024-04-25T16:01:28.545404+0000","last_active":"2024-04-25T16:01:28.545334+0000","last_peered":"2024-04-25T16:01:28.545334+0000","last_clean":"2024-04-25T16:01:28.545334+0000","last_became_active":"2024-04-25T15:54:10.253583+0000","last_became_peered":"2024-04-25T15:54:10.253583+0000","last_unstale":"2024-04-25T16:01:28.545334+0000","last_undegraded":"2024-04-25T16:01:28.545334+0000","last_fullsized":"2024-04-25T16:01:28.545334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'348","last_scrub_stamp":"2024-04-25T16:01:28.545101+0000","last_deep_scrub":"36'348","last_deep_scrub_stamp":"2024-04-25T16:01:28.545101+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.545101+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:07.078710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11261,"num_write":326,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"36'221","reported_seq":287,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.882499+0000","last_change":"2024-04-25T16:01:32.882574+0000","last_active":"2024-04-25T16:01:32.882499+0000","last_peered":"2024-04-25T16:01:32.882499+0000","last_clean":"2024-04-25T16:01:32.882499+0000","last_became_active":"2024-04-25T15:54:09.213081+0000","last_became_peered":"2024-04-25T15:54:09.213081+0000","last_unstale":"2024-04-25T16:01:32.882499+0000","last_undegraded":"2024-04-25T16:01:32.882499+0000","last_fullsized":"2024-04-25T16:01:32.882499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'221","last_scrub_stamp":"2024-04-25T16:01:32.882276+0000","last_deep_scrub":"36'221","last_deep_scrub_stamp":"2024-04-25T16:01:32.882276+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.882276+0000","objects_scrubbed":1,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:25.310442+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":264,"num_write":447,"num_write_kb":1604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'417","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.548654+0000","last_change":"2024-04-25T16:01:27.548736+0000","last_active":"2024-04-25T16:01:27.548654+0000","last_peered":"2024-04-25T16:01:27.548654+0000","last_clean":"2024-04-25T16:01:27.548654+0000","last_became_active":"2024-04-25T15:54:19.382780+0000","last_became_peered":"2024-04-25T15:54:19.382780+0000","last_unstale":"2024-04-25T16:01:27.548654+0000","last_undegraded":"2024-04-25T16:01:27.548654+0000","last_fullsized":"2024-04-25T16:01:27.548654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'417","last_scrub_stamp":"2024-04-25T16:01:27.548435+0000","last_deep_scrub":"36'417","last_deep_scrub_stamp":"2024-04-25T16:01:27.548435+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.548435+0000","objects_scrubbed":2,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:00.322326+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":348,"num_write_kb":8364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"31'355","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.750393+0000","last_change":"2024-04-25T16:01:38.750465+0000","last_active":"2024-04-25T16:01:38.750393+0000","last_peered":"2024-04-25T16:01:38.750393+0000","last_clean":"2024-04-25T16:01:38.750393+0000","last_became_active":"2024-04-25T15:54:20.414866+0000","last_became_peered":"2024-04-25T15:54:20.414866+0000","last_unstale":"2024-04-25T16:01:38.750393+0000","last_undegraded":"2024-04-25T16:01:38.750393+0000","last_fullsized":"2024-04-25T16:01:38.750393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'355","last_scrub_stamp":"2024-04-25T16:01:38.750164+0000","last_deep_scrub":"31'355","last_deep_scrub_stamp":"2024-04-25T16:01:38.750164+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.750164+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:10.302769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":811,"num_write":334,"num_write_kb":50274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"36'395","reported_seq":487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.895277+0000","last_change":"2024-04-25T16:01:36.895347+0000","last_active":"2024-04-25T16:01:36.895277+0000","last_peered":"2024-04-25T16:01:36.895277+0000","last_clean":"2024-04-25T16:01:36.895277+0000","last_became_active":"2024-04-25T15:54:10.243482+0000","last_became_peered":"2024-04-25T15:54:10.243482+0000","last_unstale":"2024-04-25T16:01:36.895277+0000","last_undegraded":"2024-04-25T16:01:36.895277+0000","last_fullsized":"2024-04-25T16:01:36.895277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'395","last_scrub_stamp":"2024-04-25T16:01:36.895051+0000","last_deep_scrub":"36'395","last_deep_scrub_stamp":"2024-04-25T16:01:36.895051+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.895051+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.823113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17222,"num_write":367,"num_write_kb":107915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'212","reported_seq":272,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.150050+0000","last_change":"2024-04-25T16:01:39.150124+0000","last_active":"2024-04-25T16:01:39.150050+0000","last_peered":"2024-04-25T16:01:39.150050+0000","last_clean":"2024-04-25T16:01:39.150050+0000","last_became_active":"2024-04-25T15:54:09.223021+0000","last_became_peered":"2024-04-25T15:54:09.223021+0000","last_unstale":"2024-04-25T16:01:39.150050+0000","last_undegraded":"2024-04-25T16:01:39.150050+0000","last_fullsized":"2024-04-25T16:01:39.150050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'212","last_scrub_stamp":"2024-04-25T16:01:39.149816+0000","last_deep_scrub":"36'212","last_deep_scrub_stamp":"2024-04-25T16:01:39.149816+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.149816+0000","objects_scrubbed":1,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:03.358197+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":156,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'73","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.121425+0000","last_change":"2024-04-25T16:01:34.121502+0000","last_active":"2024-04-25T16:01:34.121425+0000","last_peered":"2024-04-25T16:01:34.121425+0000","last_clean":"2024-04-25T16:01:34.121425+0000","last_became_active":"2024-04-25T15:54:19.389774+0000","last_became_peered":"2024-04-25T15:54:19.389774+0000","last_unstale":"2024-04-25T16:01:34.121425+0000","last_undegraded":"2024-04-25T16:01:34.121425+0000","last_fullsized":"2024-04-25T16:01:34.121425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-04-25T16:01:34.121198+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-04-25T16:01:34.121198+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.121198+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:07.295163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'419","reported_seq":527,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.126656+0000","last_change":"2024-04-25T16:01:38.126724+0000","last_active":"2024-04-25T16:01:38.126656+0000","last_peered":"2024-04-25T16:01:38.126656+0000","last_clean":"2024-04-25T16:01:38.126656+0000","last_became_active":"2024-04-25T15:54:20.434769+0000","last_became_peered":"2024-04-25T15:54:20.434769+0000","last_unstale":"2024-04-25T16:01:38.126656+0000","last_undegraded":"2024-04-25T16:01:38.126656+0000","last_fullsized":"2024-04-25T16:01:38.126656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'419","last_scrub_stamp":"2024-04-25T16:01:38.126389+0000","last_deep_scrub":"31'419","last_deep_scrub_stamp":"2024-04-25T16:01:38.126389+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.126389+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:15.968299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":27915,"num_write":400,"num_write_kb":113619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'436","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:49.492017+0000","last_change":"2024-04-25T16:01:49.492087+0000","last_active":"2024-04-25T16:01:49.492017+0000","last_peered":"2024-04-25T16:01:49.492017+0000","last_clean":"2024-04-25T16:01:49.492017+0000","last_became_active":"2024-04-25T15:54:50.213794+0000","last_became_peered":"2024-04-25T15:54:50.213794+0000","last_unstale":"2024-04-25T16:01:49.492017+0000","last_undegraded":"2024-04-25T16:01:49.492017+0000","last_fullsized":"2024-04-25T16:01:49.492017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'436","last_scrub_stamp":"2024-04-25T16:01:49.491791+0000","last_deep_scrub":"36'436","last_deep_scrub_stamp":"2024-04-25T16:01:49.491791+0000","last_clean_scrub_stamp":"2024-04-25T16:01:49.491791+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:17.451752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48041,"num_write":405,"num_write_kb":79758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"34'60","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.903681+0000","last_change":"2024-04-25T16:01:33.903833+0000","last_active":"2024-04-25T16:01:33.903681+0000","last_peered":"2024-04-25T16:01:33.903681+0000","last_clean":"2024-04-25T16:01:33.903681+0000","last_became_active":"2024-04-25T15:54:09.217200+0000","last_became_peered":"2024-04-25T15:54:09.217200+0000","last_unstale":"2024-04-25T16:01:33.903681+0000","last_undegraded":"2024-04-25T16:01:33.903681+0000","last_fullsized":"2024-04-25T16:01:33.903681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-04-25T16:01:33.903418+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-04-25T16:01:33.903418+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.903418+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:46.609264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'649","reported_seq":706,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.067718+0000","last_change":"2024-04-25T16:01:24.067806+0000","last_active":"2024-04-25T16:01:24.067718+0000","last_peered":"2024-04-25T16:01:24.067718+0000","last_clean":"2024-04-25T16:01:24.067718+0000","last_became_active":"2024-04-25T15:54:19.389248+0000","last_became_peered":"2024-04-25T15:54:19.389248+0000","last_unstale":"2024-04-25T16:01:24.067718+0000","last_undegraded":"2024-04-25T16:01:24.067718+0000","last_fullsized":"2024-04-25T16:01:24.067718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'649","last_scrub_stamp":"2024-04-25T16:01:24.067409+0000","last_deep_scrub":"36'649","last_deep_scrub_stamp":"2024-04-25T16:01:24.067409+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.067409+0000","objects_scrubbed":2,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:07.196039+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":21962,"num_write":588,"num_write_kb":8473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'398","reported_seq":482,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.128317+0000","last_change":"2024-04-25T16:01:37.128388+0000","last_active":"2024-04-25T16:01:37.128317+0000","last_peered":"2024-04-25T16:01:37.128317+0000","last_clean":"2024-04-25T16:01:37.128317+0000","last_became_active":"2024-04-25T15:54:20.432264+0000","last_became_peered":"2024-04-25T15:54:20.432264+0000","last_unstale":"2024-04-25T16:01:37.128317+0000","last_undegraded":"2024-04-25T16:01:37.128317+0000","last_fullsized":"2024-04-25T16:01:37.128317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'398","last_scrub_stamp":"2024-04-25T16:01:37.128076+0000","last_deep_scrub":"31'398","last_deep_scrub_stamp":"2024-04-25T16:01:37.128076+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.128076+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:49.833923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":18043,"num_write":367,"num_write_kb":54591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"36'382","reported_seq":450,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.552931+0000","last_change":"2024-04-25T16:01:30.553007+0000","last_active":"2024-04-25T16:01:30.552931+0000","last_peered":"2024-04-25T16:01:30.552931+0000","last_clean":"2024-04-25T16:01:30.552931+0000","last_became_active":"2024-04-25T15:54:10.237270+0000","last_became_peered":"2024-04-25T15:54:10.237270+0000","last_unstale":"2024-04-25T16:01:30.552931+0000","last_undegraded":"2024-04-25T16:01:30.552931+0000","last_fullsized":"2024-04-25T16:01:30.552931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:30.552674+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:30.552674+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.552674+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:16.111582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":351,"num_write_kb":26238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'643","reported_seq":709,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.562019+0000","last_change":"2024-04-25T16:01:36.562096+0000","last_active":"2024-04-25T16:01:36.562019+0000","last_peered":"2024-04-25T16:01:36.562019+0000","last_clean":"2024-04-25T16:01:36.562019+0000","last_became_active":"2024-04-25T15:54:09.218257+0000","last_became_peered":"2024-04-25T15:54:09.218257+0000","last_unstale":"2024-04-25T16:01:36.562019+0000","last_undegraded":"2024-04-25T16:01:36.562019+0000","last_fullsized":"2024-04-25T16:01:36.562019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'643","last_scrub_stamp":"2024-04-25T16:01:36.561812+0000","last_deep_scrub":"36'643","last_deep_scrub_stamp":"2024-04-25T16:01:36.561812+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.561812+0000","objects_scrubbed":2,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.723413+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":575,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'63","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.983263+0000","last_change":"2024-04-25T16:01:21.983314+0000","last_active":"2024-04-25T16:01:21.983263+0000","last_peered":"2024-04-25T16:01:21.983263+0000","last_clean":"2024-04-25T16:01:21.983263+0000","last_became_active":"2024-04-25T15:54:19.366677+0000","last_became_peered":"2024-04-25T15:54:19.366677+0000","last_unstale":"2024-04-25T16:01:21.983263+0000","last_undegraded":"2024-04-25T16:01:21.983263+0000","last_fullsized":"2024-04-25T16:01:21.983263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-04-25T16:01:21.983129+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-04-25T16:01:21.983129+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.983129+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:47.119193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'417","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.603251+0000","last_change":"2024-04-25T16:01:31.603434+0000","last_active":"2024-04-25T16:01:31.603251+0000","last_peered":"2024-04-25T16:01:31.603251+0000","last_clean":"2024-04-25T16:01:31.603251+0000","last_became_active":"2024-04-25T15:54:20.414757+0000","last_became_peered":"2024-04-25T15:54:20.414757+0000","last_unstale":"2024-04-25T16:01:31.603251+0000","last_undegraded":"2024-04-25T16:01:31.603251+0000","last_fullsized":"2024-04-25T16:01:31.603251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'417","last_scrub_stamp":"2024-04-25T16:01:31.602953+0000","last_deep_scrub":"31'417","last_deep_scrub_stamp":"2024-04-25T16:01:31.602953+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.602953+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:47.152396+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":4695,"num_write":394,"num_write_kb":63230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'383","reported_seq":460,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.861581+0000","last_change":"2024-04-25T16:01:35.861654+0000","last_active":"2024-04-25T16:01:35.861581+0000","last_peered":"2024-04-25T16:01:35.861581+0000","last_clean":"2024-04-25T16:01:35.861581+0000","last_became_active":"2024-04-25T15:54:10.242467+0000","last_became_peered":"2024-04-25T15:54:10.242467+0000","last_unstale":"2024-04-25T16:01:35.861581+0000","last_undegraded":"2024-04-25T16:01:35.861581+0000","last_fullsized":"2024-04-25T16:01:35.861581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'383","last_scrub_stamp":"2024-04-25T16:01:35.861353+0000","last_deep_scrub":"36'383","last_deep_scrub_stamp":"2024-04-25T16:01:35.861353+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.861353+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:55.894256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":357,"num_write_kb":25875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'325","reported_seq":642,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.484388+0000","last_change":"2024-04-25T16:01:23.484470+0000","last_active":"2024-04-25T16:01:23.484388+0000","last_peered":"2024-04-25T16:01:23.484388+0000","last_clean":"2024-04-25T16:01:23.484388+0000","last_became_active":"2024-04-25T15:54:09.196236+0000","last_became_peered":"2024-04-25T15:54:09.196236+0000","last_unstale":"2024-04-25T16:01:23.484388+0000","last_undegraded":"2024-04-25T16:01:23.484388+0000","last_fullsized":"2024-04-25T16:01:23.484388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'325","last_scrub_stamp":"2024-04-25T16:01:23.484150+0000","last_deep_scrub":"36'325","last_deep_scrub_stamp":"2024-04-25T16:01:23.484150+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.484150+0000","objects_scrubbed":1,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:08.505818+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1474781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":1598,"num_write":259,"num_write_kb":1606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'74","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.950225+0000","last_change":"2024-04-25T16:01:25.950309+0000","last_active":"2024-04-25T16:01:25.950225+0000","last_peered":"2024-04-25T16:01:25.950225+0000","last_clean":"2024-04-25T16:01:25.950225+0000","last_became_active":"2024-04-25T15:54:19.393734+0000","last_became_peered":"2024-04-25T15:54:19.393734+0000","last_unstale":"2024-04-25T16:01:25.950225+0000","last_undegraded":"2024-04-25T16:01:25.950225+0000","last_fullsized":"2024-04-25T16:01:25.950225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-25T16:01:25.950003+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-25T16:01:25.950003+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.950003+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:39.184292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'351","reported_seq":452,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:48.484930+0000","last_change":"2024-04-25T16:01:48.485001+0000","last_active":"2024-04-25T16:01:48.484930+0000","last_peered":"2024-04-25T16:01:48.484930+0000","last_clean":"2024-04-25T16:01:48.484930+0000","last_became_active":"2024-04-25T15:54:20.442711+0000","last_became_peered":"2024-04-25T15:54:20.442711+0000","last_unstale":"2024-04-25T16:01:48.484930+0000","last_undegraded":"2024-04-25T16:01:48.484930+0000","last_fullsized":"2024-04-25T16:01:48.484930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'351","last_scrub_stamp":"2024-04-25T16:01:48.484644+0000","last_deep_scrub":"31'351","last_deep_scrub_stamp":"2024-04-25T16:01:48.484644+0000","last_clean_scrub_stamp":"2024-04-25T16:01:48.484644+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:57.607712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19848,"num_write":332,"num_write_kb":34180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"36'414","reported_seq":533,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.028016+0000","last_change":"2024-04-25T16:01:26.028083+0000","last_active":"2024-04-25T16:01:26.028016+0000","last_peered":"2024-04-25T16:01:26.028016+0000","last_clean":"2024-04-25T16:01:26.028016+0000","last_became_active":"2024-04-25T15:54:10.233459+0000","last_became_peered":"2024-04-25T15:54:10.233459+0000","last_unstale":"2024-04-25T16:01:26.028016+0000","last_undegraded":"2024-04-25T16:01:26.028016+0000","last_fullsized":"2024-04-25T16:01:26.028016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'414","last_scrub_stamp":"2024-04-25T16:01:26.027800+0000","last_deep_scrub":"36'414","last_deep_scrub_stamp":"2024-04-25T16:01:26.027800+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.027800+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:08.877425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":27907,"num_write":382,"num_write_kb":96848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'589","reported_seq":656,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.105216+0000","last_change":"2024-04-25T16:01:36.105294+0000","last_active":"2024-04-25T16:01:36.105216+0000","last_peered":"2024-04-25T16:01:36.105216+0000","last_clean":"2024-04-25T16:01:36.105216+0000","last_became_active":"2024-04-25T15:54:09.207152+0000","last_became_peered":"2024-04-25T15:54:09.207152+0000","last_unstale":"2024-04-25T16:01:36.105216+0000","last_undegraded":"2024-04-25T16:01:36.105216+0000","last_fullsized":"2024-04-25T16:01:36.105216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'589","last_scrub_stamp":"2024-04-25T16:01:36.104989+0000","last_deep_scrub":"36'589","last_deep_scrub_stamp":"2024-04-25T16:01:36.104989+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.104989+0000","objects_scrubbed":2,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:20.033051+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":32151,"num_write":527,"num_write_kb":8502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'239","reported_seq":295,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.045609+0000","last_change":"2024-04-25T16:01:31.045684+0000","last_active":"2024-04-25T16:01:31.045609+0000","last_peered":"2024-04-25T16:01:31.045609+0000","last_clean":"2024-04-25T16:01:31.045609+0000","last_became_active":"2024-04-25T15:54:19.377340+0000","last_became_peered":"2024-04-25T15:54:19.377340+0000","last_unstale":"2024-04-25T16:01:31.045609+0000","last_undegraded":"2024-04-25T16:01:31.045609+0000","last_fullsized":"2024-04-25T16:01:31.045609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'239","last_scrub_stamp":"2024-04-25T16:01:31.045376+0000","last_deep_scrub":"36'239","last_deep_scrub_stamp":"2024-04-25T16:01:31.045376+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.045376+0000","objects_scrubbed":1,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:34.277966+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":156,"num_write":459,"num_write_kb":1609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"31'379","reported_seq":453,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.018160+0000","last_change":"2024-04-25T16:01:31.018230+0000","last_active":"2024-04-25T16:01:31.018160+0000","last_peered":"2024-04-25T16:01:31.018160+0000","last_clean":"2024-04-25T16:01:31.018160+0000","last_became_active":"2024-04-25T15:54:20.425259+0000","last_became_peered":"2024-04-25T15:54:20.425259+0000","last_unstale":"2024-04-25T16:01:31.018160+0000","last_undegraded":"2024-04-25T16:01:31.018160+0000","last_fullsized":"2024-04-25T16:01:31.018160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'379","last_scrub_stamp":"2024-04-25T16:01:31.017905+0000","last_deep_scrub":"31'379","last_deep_scrub_stamp":"2024-04-25T16:01:31.017905+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.017905+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:03.791796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":4720,"num_write":350,"num_write_kb":42976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"36'353","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.515406+0000","last_change":"2024-04-25T16:01:24.515477+0000","last_active":"2024-04-25T16:01:24.515406+0000","last_peered":"2024-04-25T16:01:24.515406+0000","last_clean":"2024-04-25T16:01:24.515406+0000","last_became_active":"2024-04-25T15:54:10.286650+0000","last_became_peered":"2024-04-25T15:54:10.286650+0000","last_unstale":"2024-04-25T16:01:24.515406+0000","last_undegraded":"2024-04-25T16:01:24.515406+0000","last_fullsized":"2024-04-25T16:01:24.515406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'353","last_scrub_stamp":"2024-04-25T16:01:24.515183+0000","last_deep_scrub":"36'353","last_deep_scrub_stamp":"2024-04-25T16:01:24.515183+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.515183+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:10.074091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27299,"num_write":333,"num_write_kb":58716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'66","reported_seq":124,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.485676+0000","last_change":"2024-04-25T16:01:34.485748+0000","last_active":"2024-04-25T16:01:34.485676+0000","last_peered":"2024-04-25T16:01:34.485676+0000","last_clean":"2024-04-25T16:01:34.485676+0000","last_became_active":"2024-04-25T15:54:09.217521+0000","last_became_peered":"2024-04-25T15:54:09.217521+0000","last_unstale":"2024-04-25T16:01:34.485676+0000","last_undegraded":"2024-04-25T16:01:34.485676+0000","last_fullsized":"2024-04-25T16:01:34.485676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-04-25T16:01:34.485459+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-04-25T16:01:34.485459+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.485459+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:18.413521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"36'74","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.051834+0000","last_change":"2024-04-25T16:01:35.051834+0000","last_active":"2024-04-25T16:01:35.051834+0000","last_peered":"2024-04-25T16:01:35.051834+0000","last_clean":"2024-04-25T16:01:35.051834+0000","last_became_active":"2024-04-25T15:53:58.798780+0000","last_became_peered":"2024-04-25T15:53:58.798780+0000","last_unstale":"2024-04-25T16:01:35.051834+0000","last_undegraded":"2024-04-25T16:01:35.051834+0000","last_fullsized":"2024-04-25T16:01:35.051834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-25T16:01:35.051512+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-25T16:01:35.051512+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.051512+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:55.084416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'209","reported_seq":261,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.701501+0000","last_change":"2024-04-25T16:01:34.701575+0000","last_active":"2024-04-25T16:01:34.701501+0000","last_peered":"2024-04-25T16:01:34.701501+0000","last_clean":"2024-04-25T16:01:34.701501+0000","last_became_active":"2024-04-25T15:54:19.385853+0000","last_became_peered":"2024-04-25T15:54:19.385853+0000","last_unstale":"2024-04-25T16:01:34.701501+0000","last_undegraded":"2024-04-25T16:01:34.701501+0000","last_fullsized":"2024-04-25T16:01:34.701501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'209","last_scrub_stamp":"2024-04-25T16:01:34.701272+0000","last_deep_scrub":"36'209","last_deep_scrub_stamp":"2024-04-25T16:01:34.701272+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.701272+0000","objects_scrubbed":1,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:37.933861+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":141,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"31'402","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.565750+0000","last_change":"2024-04-25T16:01:34.565831+0000","last_active":"2024-04-25T16:01:34.565750+0000","last_peered":"2024-04-25T16:01:34.565750+0000","last_clean":"2024-04-25T16:01:34.565750+0000","last_became_active":"2024-04-25T15:54:20.428959+0000","last_became_peered":"2024-04-25T15:54:20.428959+0000","last_unstale":"2024-04-25T16:01:34.565750+0000","last_undegraded":"2024-04-25T16:01:34.565750+0000","last_fullsized":"2024-04-25T16:01:34.565750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'402","last_scrub_stamp":"2024-04-25T16:01:34.565518+0000","last_deep_scrub":"31'402","last_deep_scrub_stamp":"2024-04-25T16:01:34.565518+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.565518+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:28.850874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":45941,"num_write":380,"num_write_kb":54783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'411","reported_seq":532,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:50.067709+0000","last_change":"2024-04-25T16:01:50.067801+0000","last_active":"2024-04-25T16:01:50.067709+0000","last_peered":"2024-04-25T16:01:50.067709+0000","last_clean":"2024-04-25T16:01:50.067709+0000","last_became_active":"2024-04-25T15:54:50.217850+0000","last_became_peered":"2024-04-25T15:54:50.217850+0000","last_unstale":"2024-04-25T16:01:50.067709+0000","last_undegraded":"2024-04-25T16:01:50.067709+0000","last_fullsized":"2024-04-25T16:01:50.067709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'411","last_scrub_stamp":"2024-04-25T16:01:50.067466+0000","last_deep_scrub":"34'411","last_deep_scrub_stamp":"2024-04-25T16:01:50.067466+0000","last_clean_scrub_stamp":"2024-04-25T16:01:50.067466+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:57.051615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":37252,"num_write":394,"num_write_kb":96094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'63","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.520538+0000","last_change":"2024-04-25T16:01:24.520610+0000","last_active":"2024-04-25T16:01:24.520538+0000","last_peered":"2024-04-25T16:01:24.520538+0000","last_clean":"2024-04-25T16:01:24.520538+0000","last_became_active":"2024-04-25T15:54:09.222519+0000","last_became_peered":"2024-04-25T15:54:09.222519+0000","last_unstale":"2024-04-25T16:01:24.520538+0000","last_undegraded":"2024-04-25T16:01:24.520538+0000","last_fullsized":"2024-04-25T16:01:24.520538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-04-25T16:01:24.520314+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-04-25T16:01:24.520314+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.520314+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:12.399532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'124","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.716353+0000","last_change":"2024-04-25T16:01:24.716425+0000","last_active":"2024-04-25T16:01:24.716353+0000","last_peered":"2024-04-25T16:01:24.716353+0000","last_clean":"2024-04-25T16:01:24.716353+0000","last_became_active":"2024-04-25T15:54:19.378221+0000","last_became_peered":"2024-04-25T15:54:19.378221+0000","last_unstale":"2024-04-25T16:01:24.716353+0000","last_undegraded":"2024-04-25T16:01:24.716353+0000","last_fullsized":"2024-04-25T16:01:24.716353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'124","last_scrub_stamp":"2024-04-25T16:01:24.716129+0000","last_deep_scrub":"36'124","last_deep_scrub_stamp":"2024-04-25T16:01:24.716129+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.716129+0000","objects_scrubbed":1,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:24:21.723844+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":75,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'444","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.452452+0000","last_change":"2024-04-25T16:01:20.452597+0000","last_active":"2024-04-25T16:01:20.452452+0000","last_peered":"2024-04-25T16:01:20.452452+0000","last_clean":"2024-04-25T16:01:20.452452+0000","last_became_active":"2024-04-25T15:54:20.412202+0000","last_became_peered":"2024-04-25T15:54:20.412202+0000","last_unstale":"2024-04-25T16:01:20.452452+0000","last_undegraded":"2024-04-25T16:01:20.452452+0000","last_fullsized":"2024-04-25T16:01:20.452452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'444","last_scrub_stamp":"2024-04-25T16:01:20.452192+0000","last_deep_scrub":"31'444","last_deep_scrub_stamp":"2024-04-25T16:01:20.452192+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.452192+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:35.419787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13011,"num_write":414,"num_write_kb":80257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'435","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.610750+0000","last_change":"2024-04-25T16:01:35.610750+0000","last_active":"2024-04-25T16:01:35.610750+0000","last_peered":"2024-04-25T16:01:35.610750+0000","last_clean":"2024-04-25T16:01:35.610750+0000","last_became_active":"2024-04-25T15:54:50.211096+0000","last_became_peered":"2024-04-25T15:54:50.211096+0000","last_unstale":"2024-04-25T16:01:35.610750+0000","last_undegraded":"2024-04-25T16:01:35.610750+0000","last_fullsized":"2024-04-25T16:01:35.610750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'435","last_scrub_stamp":"2024-04-25T16:01:35.610436+0000","last_deep_scrub":"36'435","last_deep_scrub_stamp":"2024-04-25T16:01:35.610436+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.610436+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:48.844725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":14130,"num_write":408,"num_write_kb":39042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"36'577","reported_seq":644,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.940558+0000","last_change":"2024-04-25T16:01:29.940632+0000","last_active":"2024-04-25T16:01:29.940558+0000","last_peered":"2024-04-25T16:01:29.940558+0000","last_clean":"2024-04-25T16:01:29.940558+0000","last_became_active":"2024-04-25T15:54:09.207510+0000","last_became_peered":"2024-04-25T15:54:09.207510+0000","last_unstale":"2024-04-25T16:01:29.940558+0000","last_undegraded":"2024-04-25T16:01:29.940558+0000","last_fullsized":"2024-04-25T16:01:29.940558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'577","last_scrub_stamp":"2024-04-25T16:01:29.940327+0000","last_deep_scrub":"36'577","last_deep_scrub_stamp":"2024-04-25T16:01:29.940327+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.940327+0000","objects_scrubbed":2,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:03.114292+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":521,"num_write_kb":4332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'143","reported_seq":202,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.097720+0000","last_change":"2024-04-25T16:01:32.097818+0000","last_active":"2024-04-25T16:01:32.097720+0000","last_peered":"2024-04-25T16:01:32.097720+0000","last_clean":"2024-04-25T16:01:32.097720+0000","last_became_active":"2024-04-25T15:54:19.378582+0000","last_became_peered":"2024-04-25T15:54:19.378582+0000","last_unstale":"2024-04-25T16:01:32.097720+0000","last_undegraded":"2024-04-25T16:01:32.097720+0000","last_fullsized":"2024-04-25T16:01:32.097720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'143","last_scrub_stamp":"2024-04-25T16:01:32.097468+0000","last_deep_scrub":"36'143","last_deep_scrub_stamp":"2024-04-25T16:01:32.097468+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.097468+0000","objects_scrubbed":3,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:59.621705+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":20488,"num_write":73,"num_write_kb":8303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"31'446","reported_seq":524,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:46.141820+0000","last_change":"2024-04-25T16:01:46.141913+0000","last_active":"2024-04-25T16:01:46.141820+0000","last_peered":"2024-04-25T16:01:46.141820+0000","last_clean":"2024-04-25T16:01:46.141820+0000","last_became_active":"2024-04-25T15:54:20.433566+0000","last_became_peered":"2024-04-25T15:54:20.433566+0000","last_unstale":"2024-04-25T16:01:46.141820+0000","last_undegraded":"2024-04-25T16:01:46.141820+0000","last_fullsized":"2024-04-25T16:01:46.141820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'446","last_scrub_stamp":"2024-04-25T16:01:46.141574+0000","last_deep_scrub":"31'446","last_deep_scrub_stamp":"2024-04-25T16:01:46.141574+0000","last_clean_scrub_stamp":"2024-04-25T16:01:46.141574+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:06.767059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17909,"num_write":426,"num_write_kb":58918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"36'390","reported_seq":522,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.881272+0000","last_change":"2024-04-25T16:01:24.881339+0000","last_active":"2024-04-25T16:01:24.881272+0000","last_peered":"2024-04-25T16:01:24.881272+0000","last_clean":"2024-04-25T16:01:24.881272+0000","last_became_active":"2024-04-25T15:54:10.298394+0000","last_became_peered":"2024-04-25T15:54:10.298394+0000","last_unstale":"2024-04-25T16:01:24.881272+0000","last_undegraded":"2024-04-25T16:01:24.881272+0000","last_fullsized":"2024-04-25T16:01:24.881272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'390","last_scrub_stamp":"2024-04-25T16:01:24.881047+0000","last_deep_scrub":"36'390","last_deep_scrub_stamp":"2024-04-25T16:01:24.881047+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.881047+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:06.880337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":39208,"num_write":362,"num_write_kb":67602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'285","reported_seq":355,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.448360+0000","last_change":"2024-04-25T16:01:22.448400+0000","last_active":"2024-04-25T16:01:22.448360+0000","last_peered":"2024-04-25T16:01:22.448360+0000","last_clean":"2024-04-25T16:01:22.448360+0000","last_became_active":"2024-04-25T15:54:09.196686+0000","last_became_peered":"2024-04-25T15:54:09.196686+0000","last_unstale":"2024-04-25T16:01:22.448360+0000","last_undegraded":"2024-04-25T16:01:22.448360+0000","last_fullsized":"2024-04-25T16:01:22.448360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-04-25T16:01:22.448254+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-04-25T16:01:22.448254+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.448254+0000","objects_scrubbed":2,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.798943+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":12315,"num_write":236,"num_write_kb":4263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'549","reported_seq":603,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.343513+0000","last_change":"2024-04-25T16:01:24.343590+0000","last_active":"2024-04-25T16:01:24.343513+0000","last_peered":"2024-04-25T16:01:24.343513+0000","last_clean":"2024-04-25T16:01:24.343513+0000","last_became_active":"2024-04-25T15:54:19.386410+0000","last_became_peered":"2024-04-25T15:54:19.386410+0000","last_unstale":"2024-04-25T16:01:24.343513+0000","last_undegraded":"2024-04-25T16:01:24.343513+0000","last_fullsized":"2024-04-25T16:01:24.343513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'549","last_scrub_stamp":"2024-04-25T16:01:24.343287+0000","last_deep_scrub":"36'549","last_deep_scrub_stamp":"2024-04-25T16:01:24.343287+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.343287+0000","objects_scrubbed":1,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:18.628643+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":499,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'422","reported_seq":529,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.531365+0000","last_change":"2024-04-25T16:01:28.531510+0000","last_active":"2024-04-25T16:01:28.531365+0000","last_peered":"2024-04-25T16:01:28.531365+0000","last_clean":"2024-04-25T16:01:28.531365+0000","last_became_active":"2024-04-25T15:54:20.408510+0000","last_became_peered":"2024-04-25T15:54:20.408510+0000","last_unstale":"2024-04-25T16:01:28.531365+0000","last_undegraded":"2024-04-25T16:01:28.531365+0000","last_fullsized":"2024-04-25T16:01:28.531365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'422","last_scrub_stamp":"2024-04-25T16:01:28.531003+0000","last_deep_scrub":"31'422","last_deep_scrub_stamp":"2024-04-25T16:01:28.531003+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.531003+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:13.659298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":25440,"num_write":402,"num_write_kb":84162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"36'355","reported_seq":443,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.024907+0000","last_change":"2024-04-25T16:01:32.024978+0000","last_active":"2024-04-25T16:01:32.024907+0000","last_peered":"2024-04-25T16:01:32.024907+0000","last_clean":"2024-04-25T16:01:32.024907+0000","last_became_active":"2024-04-25T15:54:10.287460+0000","last_became_peered":"2024-04-25T15:54:10.287460+0000","last_unstale":"2024-04-25T16:01:32.024907+0000","last_undegraded":"2024-04-25T16:01:32.024907+0000","last_fullsized":"2024-04-25T16:01:32.024907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'355","last_scrub_stamp":"2024-04-25T16:01:32.024641+0000","last_deep_scrub":"36'355","last_deep_scrub_stamp":"2024-04-25T16:01:32.024641+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.024641+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:10.558251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21419,"num_write":332,"num_write_kb":54133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'187","reported_seq":254,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.652745+0000","last_change":"2024-04-25T16:01:28.652858+0000","last_active":"2024-04-25T16:01:28.652745+0000","last_peered":"2024-04-25T16:01:28.652745+0000","last_clean":"2024-04-25T16:01:28.652745+0000","last_became_active":"2024-04-25T15:54:09.213537+0000","last_became_peered":"2024-04-25T15:54:09.213537+0000","last_unstale":"2024-04-25T16:01:28.652745+0000","last_undegraded":"2024-04-25T16:01:28.652745+0000","last_fullsized":"2024-04-25T16:01:28.652745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'187","last_scrub_stamp":"2024-04-25T16:01:28.652515+0000","last_deep_scrub":"36'187","last_deep_scrub_stamp":"2024-04-25T16:01:28.652515+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.652515+0000","objects_scrubbed":2,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:41.886803+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":131,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"35'55","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.608704+0000","last_change":"2024-04-25T16:01:34.608794+0000","last_active":"2024-04-25T16:01:34.608704+0000","last_peered":"2024-04-25T16:01:34.608704+0000","last_clean":"2024-04-25T16:01:34.608704+0000","last_became_active":"2024-04-25T15:54:19.369607+0000","last_became_peered":"2024-04-25T15:54:19.369607+0000","last_unstale":"2024-04-25T16:01:34.608704+0000","last_undegraded":"2024-04-25T16:01:34.608704+0000","last_fullsized":"2024-04-25T16:01:34.608704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'55","last_scrub_stamp":"2024-04-25T16:01:34.608473+0000","last_deep_scrub":"35'55","last_deep_scrub_stamp":"2024-04-25T16:01:34.608473+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.608473+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:04.454360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"31'370","reported_seq":418,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:46.571724+0000","last_change":"2024-04-25T16:01:46.571796+0000","last_active":"2024-04-25T16:01:46.571724+0000","last_peered":"2024-04-25T16:01:46.571724+0000","last_clean":"2024-04-25T16:01:46.571724+0000","last_became_active":"2024-04-25T15:54:20.412315+0000","last_became_peered":"2024-04-25T15:54:20.412315+0000","last_unstale":"2024-04-25T16:01:46.571724+0000","last_undegraded":"2024-04-25T16:01:46.571724+0000","last_fullsized":"2024-04-25T16:01:46.571724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'370","last_scrub_stamp":"2024-04-25T16:01:46.571496+0000","last_deep_scrub":"31'370","last_deep_scrub_stamp":"2024-04-25T16:01:46.571496+0000","last_clean_scrub_stamp":"2024-04-25T16:01:46.571496+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:14.531456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":42885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'464","reported_seq":585,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.989480+0000","last_change":"2024-04-25T16:01:27.989547+0000","last_active":"2024-04-25T16:01:27.989480+0000","last_peered":"2024-04-25T16:01:27.989480+0000","last_clean":"2024-04-25T16:01:27.989480+0000","last_became_active":"2024-04-25T15:54:10.287143+0000","last_became_peered":"2024-04-25T15:54:10.287143+0000","last_unstale":"2024-04-25T16:01:27.989480+0000","last_undegraded":"2024-04-25T16:01:27.989480+0000","last_fullsized":"2024-04-25T16:01:27.989480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'464","last_scrub_stamp":"2024-04-25T16:01:27.989256+0000","last_deep_scrub":"36'464","last_deep_scrub_stamp":"2024-04-25T16:01:27.989256+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.989256+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:55.513492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":34229,"num_write":431,"num_write_kb":50975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'307","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.490823+0000","last_change":"2024-04-25T16:01:21.490857+0000","last_active":"2024-04-25T16:01:21.490823+0000","last_peered":"2024-04-25T16:01:21.490823+0000","last_clean":"2024-04-25T16:01:21.490823+0000","last_became_active":"2024-04-25T15:54:09.190532+0000","last_became_peered":"2024-04-25T15:54:09.190532+0000","last_unstale":"2024-04-25T16:01:21.490823+0000","last_undegraded":"2024-04-25T16:01:21.490823+0000","last_fullsized":"2024-04-25T16:01:21.490823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'307","last_scrub_stamp":"2024-04-25T16:01:21.490742+0000","last_deep_scrub":"36'307","last_deep_scrub_stamp":"2024-04-25T16:01:21.490742+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.490742+0000","objects_scrubbed":5,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:52.725741+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":112,"num_read_kb":5709,"num_write":249,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'223","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.075474+0000","last_change":"2024-04-25T16:01:21.075474+0000","last_active":"2024-04-25T16:01:21.075474+0000","last_peered":"2024-04-25T16:01:21.075474+0000","last_clean":"2024-04-25T16:01:21.075474+0000","last_became_active":"2024-04-25T15:54:19.373187+0000","last_became_peered":"2024-04-25T15:54:19.373187+0000","last_unstale":"2024-04-25T16:01:21.075474+0000","last_undegraded":"2024-04-25T16:01:21.075474+0000","last_fullsized":"2024-04-25T16:01:21.075474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'223","last_scrub_stamp":"2024-04-25T16:01:21.075284+0000","last_deep_scrub":"36'223","last_deep_scrub_stamp":"2024-04-25T16:01:21.075284+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.075284+0000","objects_scrubbed":1,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.292680+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":181,"num_write_kb":4223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'411","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:44.458701+0000","last_change":"2024-04-25T16:01:44.458783+0000","last_active":"2024-04-25T16:01:44.458701+0000","last_peered":"2024-04-25T16:01:44.458701+0000","last_clean":"2024-04-25T16:01:44.458701+0000","last_became_active":"2024-04-25T15:54:20.426746+0000","last_became_peered":"2024-04-25T15:54:20.426746+0000","last_unstale":"2024-04-25T16:01:44.458701+0000","last_undegraded":"2024-04-25T16:01:44.458701+0000","last_fullsized":"2024-04-25T16:01:44.458701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'411","last_scrub_stamp":"2024-04-25T16:01:44.458473+0000","last_deep_scrub":"31'411","last_deep_scrub_stamp":"2024-04-25T16:01:44.458473+0000","last_clean_scrub_stamp":"2024-04-25T16:01:44.458473+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:05.083958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4854,"num_write":381,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"36'439","reported_seq":531,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.711574+0000","last_change":"2024-04-25T16:01:31.711643+0000","last_active":"2024-04-25T16:01:31.711574+0000","last_peered":"2024-04-25T16:01:31.711574+0000","last_clean":"2024-04-25T16:01:31.711574+0000","last_became_active":"2024-04-25T15:54:10.249621+0000","last_became_peered":"2024-04-25T15:54:10.249621+0000","last_unstale":"2024-04-25T16:01:31.711574+0000","last_undegraded":"2024-04-25T16:01:31.711574+0000","last_fullsized":"2024-04-25T16:01:31.711574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'439","last_scrub_stamp":"2024-04-25T16:01:31.711352+0000","last_deep_scrub":"36'439","last_deep_scrub_stamp":"2024-04-25T16:01:31.711352+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.711352+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:23.713043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15516,"num_write":414,"num_write_kb":67395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"34'66","reported_seq":124,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.692051+0000","last_change":"2024-04-25T16:01:27.692189+0000","last_active":"2024-04-25T16:01:27.692051+0000","last_peered":"2024-04-25T16:01:27.692051+0000","last_clean":"2024-04-25T16:01:27.692051+0000","last_became_active":"2024-04-25T15:54:09.207431+0000","last_became_peered":"2024-04-25T15:54:09.207431+0000","last_unstale":"2024-04-25T16:01:27.692051+0000","last_undegraded":"2024-04-25T16:01:27.692051+0000","last_fullsized":"2024-04-25T16:01:27.692051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-25T16:01:27.691711+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-25T16:01:27.691711+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.691711+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:19.004008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'72","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.499875+0000","last_change":"2024-04-25T16:01:29.499875+0000","last_active":"2024-04-25T16:01:29.499875+0000","last_peered":"2024-04-25T16:01:29.499875+0000","last_clean":"2024-04-25T16:01:29.499875+0000","last_became_active":"2024-04-25T15:54:19.382740+0000","last_became_peered":"2024-04-25T15:54:19.382740+0000","last_unstale":"2024-04-25T16:01:29.499875+0000","last_undegraded":"2024-04-25T16:01:29.499875+0000","last_fullsized":"2024-04-25T16:01:29.499875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'72","last_scrub_stamp":"2024-04-25T16:01:29.499565+0000","last_deep_scrub":"31'72","last_deep_scrub_stamp":"2024-04-25T16:01:29.499565+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.499565+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:42.205411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'400","reported_seq":530,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:46.515471+0000","last_change":"2024-04-25T16:01:46.515562+0000","last_active":"2024-04-25T16:01:46.515471+0000","last_peered":"2024-04-25T16:01:46.515471+0000","last_clean":"2024-04-25T16:01:46.515471+0000","last_became_active":"2024-04-25T15:54:20.440448+0000","last_became_peered":"2024-04-25T15:54:20.440448+0000","last_unstale":"2024-04-25T16:01:46.515471+0000","last_undegraded":"2024-04-25T16:01:46.515471+0000","last_fullsized":"2024-04-25T16:01:46.515471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'400","last_scrub_stamp":"2024-04-25T16:01:46.515230+0000","last_deep_scrub":"31'400","last_deep_scrub_stamp":"2024-04-25T16:01:46.515230+0000","last_clean_scrub_stamp":"2024-04-25T16:01:46.515230+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:42.405468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":39850,"num_write":370,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"36'407","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.058296+0000","last_change":"2024-04-25T16:01:30.058376+0000","last_active":"2024-04-25T16:01:30.058296+0000","last_peered":"2024-04-25T16:01:30.058296+0000","last_clean":"2024-04-25T16:01:30.058296+0000","last_became_active":"2024-04-25T15:54:10.287974+0000","last_became_peered":"2024-04-25T15:54:10.287974+0000","last_unstale":"2024-04-25T16:01:30.058296+0000","last_undegraded":"2024-04-25T16:01:30.058296+0000","last_fullsized":"2024-04-25T16:01:30.058296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'407","last_scrub_stamp":"2024-04-25T16:01:30.058069+0000","last_deep_scrub":"36'407","last_deep_scrub_stamp":"2024-04-25T16:01:30.058069+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.058069+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:03.232034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":33246,"num_write":383,"num_write_kb":97231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"36'72","reported_seq":130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.476145+0000","last_change":"2024-04-25T16:01:35.476212+0000","last_active":"2024-04-25T16:01:35.476145+0000","last_peered":"2024-04-25T16:01:35.476145+0000","last_clean":"2024-04-25T16:01:35.476145+0000","last_became_active":"2024-04-25T15:54:09.217341+0000","last_became_peered":"2024-04-25T15:54:09.217341+0000","last_unstale":"2024-04-25T16:01:35.476145+0000","last_undegraded":"2024-04-25T16:01:35.476145+0000","last_fullsized":"2024-04-25T16:01:35.476145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'72","last_scrub_stamp":"2024-04-25T16:01:35.475909+0000","last_deep_scrub":"36'72","last_deep_scrub_stamp":"2024-04-25T16:01:35.475909+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.475909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:32.922778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'287","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:20.564778+0000","last_change":"2024-04-25T16:01:20.564778+0000","last_active":"2024-04-25T16:01:20.564778+0000","last_peered":"2024-04-25T16:01:20.564778+0000","last_clean":"2024-04-25T16:01:20.564778+0000","last_became_active":"2024-04-25T15:54:19.372095+0000","last_became_peered":"2024-04-25T15:54:19.372095+0000","last_unstale":"2024-04-25T16:01:20.564778+0000","last_undegraded":"2024-04-25T16:01:20.564778+0000","last_fullsized":"2024-04-25T16:01:20.564778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'287","last_scrub_stamp":"2024-04-25T16:01:20.564614+0000","last_deep_scrub":"36'287","last_deep_scrub_stamp":"2024-04-25T16:01:20.564614+0000","last_clean_scrub_stamp":"2024-04-25T16:01:20.564614+0000","objects_scrubbed":6,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:03.693244+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":28701,"num_write":224,"num_write_kb":12419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'384","reported_seq":461,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.558996+0000","last_change":"2024-04-25T16:01:33.559142+0000","last_active":"2024-04-25T16:01:33.558996+0000","last_peered":"2024-04-25T16:01:33.558996+0000","last_clean":"2024-04-25T16:01:33.558996+0000","last_became_active":"2024-04-25T15:54:20.403298+0000","last_became_peered":"2024-04-25T15:54:20.403298+0000","last_unstale":"2024-04-25T16:01:33.558996+0000","last_undegraded":"2024-04-25T16:01:33.558996+0000","last_fullsized":"2024-04-25T16:01:33.558996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'384","last_scrub_stamp":"2024-04-25T16:01:33.558727+0000","last_deep_scrub":"31'384","last_deep_scrub_stamp":"2024-04-25T16:01:33.558727+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.558727+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:59.486059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13411,"num_write":356,"num_write_kb":100243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'415","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.024413+0000","last_change":"2024-04-25T16:01:22.024488+0000","last_active":"2024-04-25T16:01:22.024413+0000","last_peered":"2024-04-25T16:01:22.024413+0000","last_clean":"2024-04-25T16:01:22.024413+0000","last_became_active":"2024-04-25T15:54:10.254665+0000","last_became_peered":"2024-04-25T15:54:10.254665+0000","last_unstale":"2024-04-25T16:01:22.024413+0000","last_undegraded":"2024-04-25T16:01:22.024413+0000","last_fullsized":"2024-04-25T16:01:22.024413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'415","last_scrub_stamp":"2024-04-25T16:01:22.024190+0000","last_deep_scrub":"36'415","last_deep_scrub_stamp":"2024-04-25T16:01:22.024190+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.024190+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:06.818089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13518,"num_write":393,"num_write_kb":67403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'929","reported_seq":1006,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.099807+0000","last_change":"2024-04-25T16:01:24.099974+0000","last_active":"2024-04-25T16:01:24.099807+0000","last_peered":"2024-04-25T16:01:24.099807+0000","last_clean":"2024-04-25T16:01:24.099807+0000","last_became_active":"2024-04-25T15:54:09.229605+0000","last_became_peered":"2024-04-25T15:54:09.229605+0000","last_unstale":"2024-04-25T16:01:24.099807+0000","last_undegraded":"2024-04-25T16:01:24.099807+0000","last_fullsized":"2024-04-25T16:01:24.099807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'929","last_scrub_stamp":"2024-04-25T16:01:24.099469+0000","last_deep_scrub":"36'929","last_deep_scrub_stamp":"2024-04-25T16:01:24.099469+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.099469+0000","objects_scrubbed":4,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:15.411767+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":28720,"num_write":874,"num_write_kb":8730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'144","reported_seq":203,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.264018+0000","last_change":"2024-04-25T16:01:26.264018+0000","last_active":"2024-04-25T16:01:26.264018+0000","last_peered":"2024-04-25T16:01:26.264018+0000","last_clean":"2024-04-25T16:01:26.264018+0000","last_became_active":"2024-04-25T15:54:19.387650+0000","last_became_peered":"2024-04-25T15:54:19.387650+0000","last_unstale":"2024-04-25T16:01:26.264018+0000","last_undegraded":"2024-04-25T16:01:26.264018+0000","last_fullsized":"2024-04-25T16:01:26.264018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'144","last_scrub_stamp":"2024-04-25T16:01:26.263721+0000","last_deep_scrub":"36'144","last_deep_scrub_stamp":"2024-04-25T16:01:26.263721+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.263721+0000","objects_scrubbed":2,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:26:23.943431+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":97,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"31'366","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:48.582984+0000","last_change":"2024-04-25T16:01:48.583143+0000","last_active":"2024-04-25T16:01:48.582984+0000","last_peered":"2024-04-25T16:01:48.582984+0000","last_clean":"2024-04-25T16:01:48.582984+0000","last_became_active":"2024-04-25T15:54:20.417269+0000","last_became_peered":"2024-04-25T15:54:20.417269+0000","last_unstale":"2024-04-25T16:01:48.582984+0000","last_undegraded":"2024-04-25T16:01:48.582984+0000","last_fullsized":"2024-04-25T16:01:48.582984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'366","last_scrub_stamp":"2024-04-25T16:01:48.582592+0000","last_deep_scrub":"31'366","last_deep_scrub_stamp":"2024-04-25T16:01:48.582592+0000","last_clean_scrub_stamp":"2024-04-25T16:01:48.582592+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:13.708531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":6536,"num_write":348,"num_write_kb":51835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"36'411","reported_seq":501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.915841+0000","last_change":"2024-04-25T16:01:25.915841+0000","last_active":"2024-04-25T16:01:25.915841+0000","last_peered":"2024-04-25T16:01:25.915841+0000","last_clean":"2024-04-25T16:01:25.915841+0000","last_became_active":"2024-04-25T15:54:10.291479+0000","last_became_peered":"2024-04-25T15:54:10.291479+0000","last_unstale":"2024-04-25T16:01:25.915841+0000","last_undegraded":"2024-04-25T16:01:25.915841+0000","last_fullsized":"2024-04-25T16:01:25.915841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'411","last_scrub_stamp":"2024-04-25T16:01:25.915540+0000","last_deep_scrub":"36'411","last_deep_scrub_stamp":"2024-04-25T16:01:25.915540+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.915540+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:39.149829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12973,"num_write":382,"num_write_kb":67863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'348","reported_seq":441,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.750213+0000","last_change":"2024-04-25T16:01:26.750407+0000","last_active":"2024-04-25T16:01:26.750213+0000","last_peered":"2024-04-25T16:01:26.750213+0000","last_clean":"2024-04-25T16:01:26.750213+0000","last_became_active":"2024-04-25T15:54:09.198439+0000","last_became_peered":"2024-04-25T15:54:09.198439+0000","last_unstale":"2024-04-25T16:01:26.750213+0000","last_undegraded":"2024-04-25T16:01:26.750213+0000","last_fullsized":"2024-04-25T16:01:26.750213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'348","last_scrub_stamp":"2024-04-25T16:01:26.749902+0000","last_deep_scrub":"36'348","last_deep_scrub_stamp":"2024-04-25T16:01:26.749902+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.749902+0000","objects_scrubbed":6,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:11.878197+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":41004,"num_write":293,"num_write_kb":12450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'62","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:19.919366+0000","last_change":"2024-04-25T16:01:19.919366+0000","last_active":"2024-04-25T16:01:19.919366+0000","last_peered":"2024-04-25T16:01:19.919366+0000","last_clean":"2024-04-25T16:01:19.919366+0000","last_became_active":"2024-04-25T15:54:19.373141+0000","last_became_peered":"2024-04-25T15:54:19.373141+0000","last_unstale":"2024-04-25T16:01:19.919366+0000","last_undegraded":"2024-04-25T16:01:19.919366+0000","last_fullsized":"2024-04-25T16:01:19.919366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'62","last_scrub_stamp":"2024-04-25T16:01:19.919082+0000","last_deep_scrub":"31'62","last_deep_scrub_stamp":"2024-04-25T16:01:19.919082+0000","last_clean_scrub_stamp":"2024-04-25T16:01:19.919082+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.674475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'409","reported_seq":515,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.974168+0000","last_change":"2024-04-25T16:01:27.974304+0000","last_active":"2024-04-25T16:01:27.974168+0000","last_peered":"2024-04-25T16:01:27.974168+0000","last_clean":"2024-04-25T16:01:27.974168+0000","last_became_active":"2024-04-25T15:54:20.419580+0000","last_became_peered":"2024-04-25T15:54:20.419580+0000","last_unstale":"2024-04-25T16:01:27.974168+0000","last_undegraded":"2024-04-25T16:01:27.974168+0000","last_fullsized":"2024-04-25T16:01:27.974168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'409","last_scrub_stamp":"2024-04-25T16:01:27.973822+0000","last_deep_scrub":"31'409","last_deep_scrub_stamp":"2024-04-25T16:01:27.973822+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.973822+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:14.123676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30743,"num_write":387,"num_write_kb":71898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'393","reported_seq":496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.564594+0000","last_change":"2024-04-25T16:01:33.564697+0000","last_active":"2024-04-25T16:01:33.564594+0000","last_peered":"2024-04-25T16:01:33.564594+0000","last_clean":"2024-04-25T16:01:33.564594+0000","last_became_active":"2024-04-25T15:54:10.257207+0000","last_became_peered":"2024-04-25T15:54:10.257207+0000","last_unstale":"2024-04-25T16:01:33.564594+0000","last_undegraded":"2024-04-25T16:01:33.564594+0000","last_fullsized":"2024-04-25T16:01:33.564594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'393","last_scrub_stamp":"2024-04-25T16:01:33.564340+0000","last_deep_scrub":"36'393","last_deep_scrub_stamp":"2024-04-25T16:01:33.564340+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.564340+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:51.466506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":24508,"num_write":369,"num_write_kb":63737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'213","reported_seq":288,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.871793+0000","last_change":"2024-04-25T16:01:34.871869+0000","last_active":"2024-04-25T16:01:34.871793+0000","last_peered":"2024-04-25T16:01:34.871793+0000","last_clean":"2024-04-25T16:01:34.871793+0000","last_became_active":"2024-04-25T15:54:09.221830+0000","last_became_peered":"2024-04-25T15:54:09.221830+0000","last_unstale":"2024-04-25T16:01:34.871793+0000","last_undegraded":"2024-04-25T16:01:34.871793+0000","last_fullsized":"2024-04-25T16:01:34.871793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'213","last_scrub_stamp":"2024-04-25T16:01:34.871577+0000","last_deep_scrub":"36'213","last_deep_scrub_stamp":"2024-04-25T16:01:34.871577+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.871577+0000","objects_scrubbed":3,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:39.355058+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928471,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":787,"num_write":162,"num_write_kb":1058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'540","reported_seq":604,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.631964+0000","last_change":"2024-04-25T16:01:23.632064+0000","last_active":"2024-04-25T16:01:23.631964+0000","last_peered":"2024-04-25T16:01:23.631964+0000","last_clean":"2024-04-25T16:01:23.631964+0000","last_became_active":"2024-04-25T15:54:19.372194+0000","last_became_peered":"2024-04-25T15:54:19.372194+0000","last_unstale":"2024-04-25T16:01:23.631964+0000","last_undegraded":"2024-04-25T16:01:23.631964+0000","last_fullsized":"2024-04-25T16:01:23.631964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'540","last_scrub_stamp":"2024-04-25T16:01:23.631738+0000","last_deep_scrub":"36'540","last_deep_scrub_stamp":"2024-04-25T16:01:23.631738+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.631738+0000","objects_scrubbed":4,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:05.250313+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24608,"num_write":474,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"31'470","reported_seq":579,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.682410+0000","last_change":"2024-04-25T16:01:36.682492+0000","last_active":"2024-04-25T16:01:36.682410+0000","last_peered":"2024-04-25T16:01:36.682410+0000","last_clean":"2024-04-25T16:01:36.682410+0000","last_became_active":"2024-04-25T15:54:20.401963+0000","last_became_peered":"2024-04-25T15:54:20.401963+0000","last_unstale":"2024-04-25T16:01:36.682410+0000","last_undegraded":"2024-04-25T16:01:36.682410+0000","last_fullsized":"2024-04-25T16:01:36.682410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'470","last_scrub_stamp":"2024-04-25T16:01:36.682163+0000","last_deep_scrub":"31'470","last_deep_scrub_stamp":"2024-04-25T16:01:36.682163+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.682163+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:46.553321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31281,"num_write":455,"num_write_kb":108972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"36'380","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:19.110765+0000","last_change":"2024-04-25T16:01:19.110765+0000","last_active":"2024-04-25T16:01:19.110765+0000","last_peered":"2024-04-25T16:01:19.110765+0000","last_clean":"2024-04-25T16:01:19.110765+0000","last_became_active":"2024-04-25T15:54:10.268160+0000","last_became_peered":"2024-04-25T15:54:10.268160+0000","last_unstale":"2024-04-25T16:01:19.110765+0000","last_undegraded":"2024-04-25T16:01:19.110765+0000","last_fullsized":"2024-04-25T16:01:19.110765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'380","last_scrub_stamp":"2024-04-25T16:01:19.110645+0000","last_deep_scrub":"36'380","last_deep_scrub_stamp":"2024-04-25T16:01:19.110645+0000","last_clean_scrub_stamp":"2024-04-25T16:01:19.110645+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:06.989863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":25762,"num_write":354,"num_write_kb":59652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'382","reported_seq":444,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.516846+0000","last_change":"2024-04-25T16:01:37.516925+0000","last_active":"2024-04-25T16:01:37.516846+0000","last_peered":"2024-04-25T16:01:37.516846+0000","last_clean":"2024-04-25T16:01:37.516846+0000","last_became_active":"2024-04-25T15:54:09.220441+0000","last_became_peered":"2024-04-25T15:54:09.220441+0000","last_unstale":"2024-04-25T16:01:37.516846+0000","last_undegraded":"2024-04-25T16:01:37.516846+0000","last_fullsized":"2024-04-25T16:01:37.516846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:37.516528+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:37.516528+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.516528+0000","objects_scrubbed":1,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:01.724908+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8766,"num_write":314,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'145","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:21.544653+0000","last_change":"2024-04-25T16:01:21.544653+0000","last_active":"2024-04-25T16:01:21.544653+0000","last_peered":"2024-04-25T16:01:21.544653+0000","last_clean":"2024-04-25T16:01:21.544653+0000","last_became_active":"2024-04-25T15:54:19.372789+0000","last_became_peered":"2024-04-25T15:54:19.372789+0000","last_unstale":"2024-04-25T16:01:21.544653+0000","last_undegraded":"2024-04-25T16:01:21.544653+0000","last_fullsized":"2024-04-25T16:01:21.544653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'145","last_scrub_stamp":"2024-04-25T16:01:21.544331+0000","last_deep_scrub":"36'145","last_deep_scrub_stamp":"2024-04-25T16:01:21.544331+0000","last_clean_scrub_stamp":"2024-04-25T16:01:21.544331+0000","objects_scrubbed":5,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:15.829686+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":494748,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":898,"num_write":91,"num_write_kb":558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'426","reported_seq":505,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:48.118311+0000","last_change":"2024-04-25T16:01:48.118379+0000","last_active":"2024-04-25T16:01:48.118311+0000","last_peered":"2024-04-25T16:01:48.118311+0000","last_clean":"2024-04-25T16:01:48.118311+0000","last_became_active":"2024-04-25T15:54:20.439024+0000","last_became_peered":"2024-04-25T15:54:20.439024+0000","last_unstale":"2024-04-25T16:01:48.118311+0000","last_undegraded":"2024-04-25T16:01:48.118311+0000","last_fullsized":"2024-04-25T16:01:48.118311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'426","last_scrub_stamp":"2024-04-25T16:01:48.118065+0000","last_deep_scrub":"31'426","last_deep_scrub_stamp":"2024-04-25T16:01:48.118065+0000","last_clean_scrub_stamp":"2024-04-25T16:01:48.118065+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:47.385759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13765,"num_write":404,"num_write_kb":58994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"36'408","reported_seq":471,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.369656+0000","last_change":"2024-04-25T16:01:23.369656+0000","last_active":"2024-04-25T16:01:23.369656+0000","last_peered":"2024-04-25T16:01:23.369656+0000","last_clean":"2024-04-25T16:01:23.369656+0000","last_became_active":"2024-04-25T15:54:10.288841+0000","last_became_peered":"2024-04-25T15:54:10.288841+0000","last_unstale":"2024-04-25T16:01:23.369656+0000","last_undegraded":"2024-04-25T16:01:23.369656+0000","last_fullsized":"2024-04-25T16:01:23.369656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'408","last_scrub_stamp":"2024-04-25T16:01:23.369361+0000","last_deep_scrub":"36'408","last_deep_scrub_stamp":"2024-04-25T16:01:23.369361+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.369361+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:06.497992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":381,"num_write_kb":62610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"36'68","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.683274+0000","last_change":"2024-04-25T16:01:30.683408+0000","last_active":"2024-04-25T16:01:30.683274+0000","last_peered":"2024-04-25T16:01:30.683274+0000","last_clean":"2024-04-25T16:01:30.683274+0000","last_became_active":"2024-04-25T15:54:09.221415+0000","last_became_peered":"2024-04-25T15:54:09.221415+0000","last_unstale":"2024-04-25T16:01:30.683274+0000","last_undegraded":"2024-04-25T16:01:30.683274+0000","last_fullsized":"2024-04-25T16:01:30.683274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'68","last_scrub_stamp":"2024-04-25T16:01:30.682948+0000","last_deep_scrub":"36'68","last_deep_scrub_stamp":"2024-04-25T16:01:30.682948+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.682948+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:57.714644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'63","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.512952+0000","last_change":"2024-04-25T16:01:25.513023+0000","last_active":"2024-04-25T16:01:25.512952+0000","last_peered":"2024-04-25T16:01:25.512952+0000","last_clean":"2024-04-25T16:01:25.512952+0000","last_became_active":"2024-04-25T15:54:19.377666+0000","last_became_peered":"2024-04-25T15:54:19.377666+0000","last_unstale":"2024-04-25T16:01:25.512952+0000","last_undegraded":"2024-04-25T16:01:25.512952+0000","last_fullsized":"2024-04-25T16:01:25.512952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-04-25T16:01:25.512681+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-04-25T16:01:25.512681+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.512681+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:55.847891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'354","reported_seq":437,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.729277+0000","last_change":"2024-04-25T16:01:37.729349+0000","last_active":"2024-04-25T16:01:37.729277+0000","last_peered":"2024-04-25T16:01:37.729277+0000","last_clean":"2024-04-25T16:01:37.729277+0000","last_became_active":"2024-04-25T15:54:20.402304+0000","last_became_peered":"2024-04-25T15:54:20.402304+0000","last_unstale":"2024-04-25T16:01:37.729277+0000","last_undegraded":"2024-04-25T16:01:37.729277+0000","last_fullsized":"2024-04-25T16:01:37.729277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'354","last_scrub_stamp":"2024-04-25T16:01:37.729045+0000","last_deep_scrub":"31'354","last_deep_scrub_stamp":"2024-04-25T16:01:37.729045+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.729045+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:10.903010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17557,"num_write":333,"num_write_kb":46614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'112","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.114892+0000","last_change":"2024-04-25T16:01:33.114966+0000","last_active":"2024-04-25T16:01:33.114892+0000","last_peered":"2024-04-25T16:01:33.114892+0000","last_clean":"2024-04-25T16:01:33.114892+0000","last_became_active":"2024-04-25T15:54:19.386214+0000","last_became_peered":"2024-04-25T15:54:19.386214+0000","last_unstale":"2024-04-25T16:01:33.114892+0000","last_undegraded":"2024-04-25T16:01:33.114892+0000","last_fullsized":"2024-04-25T16:01:33.114892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'112","last_scrub_stamp":"2024-04-25T16:01:33.114663+0000","last_deep_scrub":"36'112","last_deep_scrub_stamp":"2024-04-25T16:01:33.114663+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.114663+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:18.673571+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":58,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'435","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.937822+0000","last_change":"2024-04-25T16:01:26.937822+0000","last_active":"2024-04-25T16:01:26.937822+0000","last_peered":"2024-04-25T16:01:26.937822+0000","last_clean":"2024-04-25T16:01:26.937822+0000","last_became_active":"2024-04-25T15:54:10.247986+0000","last_became_peered":"2024-04-25T15:54:10.247986+0000","last_unstale":"2024-04-25T16:01:26.937822+0000","last_undegraded":"2024-04-25T16:01:26.937822+0000","last_fullsized":"2024-04-25T16:01:26.937822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'435","last_scrub_stamp":"2024-04-25T16:01:26.937508+0000","last_deep_scrub":"36'435","last_deep_scrub_stamp":"2024-04-25T16:01:26.937508+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.937508+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:30.170098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25415,"num_write":410,"num_write_kb":96682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'1095","reported_seq":1159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.523360+0000","last_change":"2024-04-25T16:01:38.523467+0000","last_active":"2024-04-25T16:01:38.523360+0000","last_peered":"2024-04-25T16:01:38.523360+0000","last_clean":"2024-04-25T16:01:38.523360+0000","last_became_active":"2024-04-25T15:54:09.228939+0000","last_became_peered":"2024-04-25T15:54:09.228939+0000","last_unstale":"2024-04-25T16:01:38.523360+0000","last_undegraded":"2024-04-25T16:01:38.523360+0000","last_fullsized":"2024-04-25T16:01:38.523360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1095","last_scrub_stamp":"2024-04-25T16:01:38.523134+0000","last_deep_scrub":"36'1095","last_deep_scrub_stamp":"2024-04-25T16:01:38.523134+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.523134+0000","objects_scrubbed":2,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:45.996808+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":1024,"num_write_kb":8705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"31'396","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.113286+0000","last_change":"2024-04-25T16:01:36.113359+0000","last_active":"2024-04-25T16:01:36.113286+0000","last_peered":"2024-04-25T16:01:36.113286+0000","last_clean":"2024-04-25T16:01:36.113286+0000","last_became_active":"2024-04-25T15:54:20.426017+0000","last_became_peered":"2024-04-25T15:54:20.426017+0000","last_unstale":"2024-04-25T16:01:36.113286+0000","last_undegraded":"2024-04-25T16:01:36.113286+0000","last_fullsized":"2024-04-25T16:01:36.113286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'396","last_scrub_stamp":"2024-04-25T16:01:36.113015+0000","last_deep_scrub":"31'396","last_deep_scrub_stamp":"2024-04-25T16:01:36.113015+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.113015+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:14.646625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":20218,"num_write":374,"num_write_kb":83731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"36'102","reported_seq":163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.703274+0000","last_change":"2024-04-25T16:01:35.703382+0000","last_active":"2024-04-25T16:01:35.703274+0000","last_peered":"2024-04-25T16:01:35.703274+0000","last_clean":"2024-04-25T16:01:35.703274+0000","last_became_active":"2024-04-25T15:54:19.396282+0000","last_became_peered":"2024-04-25T15:54:19.396282+0000","last_unstale":"2024-04-25T16:01:35.703274+0000","last_undegraded":"2024-04-25T16:01:35.703274+0000","last_fullsized":"2024-04-25T16:01:35.703274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'102","last_scrub_stamp":"2024-04-25T16:01:35.703062+0000","last_deep_scrub":"36'102","last_deep_scrub_stamp":"2024-04-25T16:01:35.703062+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.703062+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:21.852916+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":12304,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'449","reported_seq":554,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.632141+0000","last_change":"2024-04-25T16:01:38.632304+0000","last_active":"2024-04-25T16:01:38.632141+0000","last_peered":"2024-04-25T16:01:38.632141+0000","last_clean":"2024-04-25T16:01:38.632141+0000","last_became_active":"2024-04-25T15:54:10.233945+0000","last_became_peered":"2024-04-25T15:54:10.233945+0000","last_unstale":"2024-04-25T16:01:38.632141+0000","last_undegraded":"2024-04-25T16:01:38.632141+0000","last_fullsized":"2024-04-25T16:01:38.632141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'449","last_scrub_stamp":"2024-04-25T16:01:38.631876+0000","last_deep_scrub":"36'449","last_deep_scrub_stamp":"2024-04-25T16:01:38.631876+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.631876+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:34.206020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27119,"num_write":430,"num_write_kb":112459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'106","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.626118+0000","last_change":"2024-04-25T16:01:37.626192+0000","last_active":"2024-04-25T16:01:37.626118+0000","last_peered":"2024-04-25T16:01:37.626118+0000","last_clean":"2024-04-25T16:01:37.626118+0000","last_became_active":"2024-04-25T15:54:09.220672+0000","last_became_peered":"2024-04-25T15:54:09.220672+0000","last_unstale":"2024-04-25T16:01:37.626118+0000","last_undegraded":"2024-04-25T16:01:37.626118+0000","last_fullsized":"2024-04-25T16:01:37.626118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'106","last_scrub_stamp":"2024-04-25T16:01:37.625843+0000","last_deep_scrub":"36'106","last_deep_scrub_stamp":"2024-04-25T16:01:37.625843+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.625843+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:00.026042+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":60,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"31'366","reported_seq":491,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:42.943508+0000","last_change":"2024-04-25T16:01:42.943508+0000","last_active":"2024-04-25T16:01:42.943508+0000","last_peered":"2024-04-25T16:01:42.943508+0000","last_clean":"2024-04-25T16:01:42.943508+0000","last_became_active":"2024-04-25T15:54:20.450326+0000","last_became_peered":"2024-04-25T15:54:20.450326+0000","last_unstale":"2024-04-25T16:01:42.943508+0000","last_undegraded":"2024-04-25T16:01:42.943508+0000","last_fullsized":"2024-04-25T16:01:42.943508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'366","last_scrub_stamp":"2024-04-25T16:01:42.943008+0000","last_deep_scrub":"31'366","last_deep_scrub_stamp":"2024-04-25T16:01:42.943008+0000","last_clean_scrub_stamp":"2024-04-25T16:01:42.943008+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:00.287861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":31073,"num_write":335,"num_write_kb":72672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"36'623","reported_seq":691,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.727064+0000","last_change":"2024-04-25T16:01:28.727064+0000","last_active":"2024-04-25T16:01:28.727064+0000","last_peered":"2024-04-25T16:01:28.727064+0000","last_clean":"2024-04-25T16:01:28.727064+0000","last_became_active":"2024-04-25T15:54:09.211308+0000","last_became_peered":"2024-04-25T15:54:09.211308+0000","last_unstale":"2024-04-25T16:01:28.727064+0000","last_undegraded":"2024-04-25T16:01:28.727064+0000","last_fullsized":"2024-04-25T16:01:28.727064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'623","last_scrub_stamp":"2024-04-25T16:01:28.726605+0000","last_deep_scrub":"36'623","last_deep_scrub_stamp":"2024-04-25T16:01:28.726605+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.726605+0000","objects_scrubbed":3,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:10.345180+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":551,"num_write_kb":12472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'393","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.011895+0000","last_change":"2024-04-25T16:01:30.011895+0000","last_active":"2024-04-25T16:01:30.011895+0000","last_peered":"2024-04-25T16:01:30.011895+0000","last_clean":"2024-04-25T16:01:30.011895+0000","last_became_active":"2024-04-25T15:54:10.251389+0000","last_became_peered":"2024-04-25T15:54:10.251389+0000","last_unstale":"2024-04-25T16:01:30.011895+0000","last_undegraded":"2024-04-25T16:01:30.011895+0000","last_fullsized":"2024-04-25T16:01:30.011895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'393","last_scrub_stamp":"2024-04-25T16:01:30.011608+0000","last_deep_scrub":"36'393","last_deep_scrub_stamp":"2024-04-25T16:01:30.011608+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.011608+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:43.245896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31498,"num_write":372,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'339","reported_seq":396,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.517463+0000","last_change":"2024-04-25T16:01:27.517463+0000","last_active":"2024-04-25T16:01:27.517463+0000","last_peered":"2024-04-25T16:01:27.517463+0000","last_clean":"2024-04-25T16:01:27.517463+0000","last_became_active":"2024-04-25T15:54:19.358881+0000","last_became_peered":"2024-04-25T15:54:19.358881+0000","last_unstale":"2024-04-25T16:01:27.517463+0000","last_undegraded":"2024-04-25T16:01:27.517463+0000","last_fullsized":"2024-04-25T16:01:27.517463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'339","last_scrub_stamp":"2024-04-25T16:01:27.516995+0000","last_deep_scrub":"36'339","last_deep_scrub_stamp":"2024-04-25T16:01:27.516995+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.516995+0000","objects_scrubbed":2,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:12.310894+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":8207,"num_write":286,"num_write_kb":4236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'391","reported_seq":470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:43.672480+0000","last_change":"2024-04-25T16:01:43.672480+0000","last_active":"2024-04-25T16:01:43.672480+0000","last_peered":"2024-04-25T16:01:43.672480+0000","last_clean":"2024-04-25T16:01:43.672480+0000","last_became_active":"2024-04-25T15:54:20.427990+0000","last_became_peered":"2024-04-25T15:54:20.427990+0000","last_unstale":"2024-04-25T16:01:43.672480+0000","last_undegraded":"2024-04-25T16:01:43.672480+0000","last_fullsized":"2024-04-25T16:01:43.672480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'391","last_scrub_stamp":"2024-04-25T16:01:43.672149+0000","last_deep_scrub":"31'391","last_deep_scrub_stamp":"2024-04-25T16:01:43.672149+0000","last_clean_scrub_stamp":"2024-04-25T16:01:43.672149+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:39.246292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15625,"num_write":369,"num_write_kb":80649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"36'112","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.586045+0000","last_change":"2024-04-25T16:01:36.586045+0000","last_active":"2024-04-25T16:01:36.586045+0000","last_peered":"2024-04-25T16:01:36.586045+0000","last_clean":"2024-04-25T16:01:36.586045+0000","last_became_active":"2024-04-25T15:54:09.214314+0000","last_became_peered":"2024-04-25T15:54:09.214314+0000","last_unstale":"2024-04-25T16:01:36.586045+0000","last_undegraded":"2024-04-25T16:01:36.586045+0000","last_fullsized":"2024-04-25T16:01:36.586045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'112","last_scrub_stamp":"2024-04-25T16:01:36.585764+0000","last_deep_scrub":"36'112","last_deep_scrub_stamp":"2024-04-25T16:01:36.585764+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.585764+0000","objects_scrubbed":1,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:44.059438+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":57,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'382","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.594288+0000","last_change":"2024-04-25T16:01:31.594288+0000","last_active":"2024-04-25T16:01:31.594288+0000","last_peered":"2024-04-25T16:01:31.594288+0000","last_clean":"2024-04-25T16:01:31.594288+0000","last_became_active":"2024-04-25T15:54:10.245153+0000","last_became_peered":"2024-04-25T15:54:10.245153+0000","last_unstale":"2024-04-25T16:01:31.594288+0000","last_undegraded":"2024-04-25T16:01:31.594288+0000","last_fullsized":"2024-04-25T16:01:31.594288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:31.593757+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:31.593757+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.593757+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:38.472631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28619,"num_write":357,"num_write_kb":42139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'309","reported_seq":372,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.609639+0000","last_change":"2024-04-25T16:01:23.609639+0000","last_active":"2024-04-25T16:01:23.609639+0000","last_peered":"2024-04-25T16:01:23.609639+0000","last_clean":"2024-04-25T16:01:23.609639+0000","last_became_active":"2024-04-25T15:54:19.372367+0000","last_became_peered":"2024-04-25T15:54:19.372367+0000","last_unstale":"2024-04-25T16:01:23.609639+0000","last_undegraded":"2024-04-25T16:01:23.609639+0000","last_fullsized":"2024-04-25T16:01:23.609639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'309","last_scrub_stamp":"2024-04-25T16:01:23.609281+0000","last_deep_scrub":"36'309","last_deep_scrub_stamp":"2024-04-25T16:01:23.609281+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.609281+0000","objects_scrubbed":4,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:51.133517+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":32783,"num_write":228,"num_write_kb":12423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"31'453","reported_seq":535,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:44.620609+0000","last_change":"2024-04-25T16:01:44.620790+0000","last_active":"2024-04-25T16:01:44.620609+0000","last_peered":"2024-04-25T16:01:44.620609+0000","last_clean":"2024-04-25T16:01:44.620609+0000","last_became_active":"2024-04-25T15:54:20.407735+0000","last_became_peered":"2024-04-25T15:54:20.407735+0000","last_unstale":"2024-04-25T16:01:44.620609+0000","last_undegraded":"2024-04-25T16:01:44.620609+0000","last_fullsized":"2024-04-25T16:01:44.620609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'453","last_scrub_stamp":"2024-04-25T16:01:44.620332+0000","last_deep_scrub":"31'453","last_deep_scrub_stamp":"2024-04-25T16:01:44.620332+0000","last_clean_scrub_stamp":"2024-04-25T16:01:44.620332+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:32.923695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":17355,"num_write":430,"num_write_kb":97199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'423","reported_seq":500,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.670042+0000","last_change":"2024-04-25T16:01:32.670116+0000","last_active":"2024-04-25T16:01:32.670042+0000","last_peered":"2024-04-25T16:01:32.670042+0000","last_clean":"2024-04-25T16:01:32.670042+0000","last_became_active":"2024-04-25T15:54:10.249606+0000","last_became_peered":"2024-04-25T15:54:10.249606+0000","last_unstale":"2024-04-25T16:01:32.670042+0000","last_undegraded":"2024-04-25T16:01:32.670042+0000","last_fullsized":"2024-04-25T16:01:32.670042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'423","last_scrub_stamp":"2024-04-25T16:01:32.669829+0000","last_deep_scrub":"36'423","last_deep_scrub_stamp":"2024-04-25T16:01:32.669829+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.669829+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:26.955185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12292,"num_write":400,"num_write_kb":76879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"31'396","reported_seq":465,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.878703+0000","last_change":"2024-04-25T16:01:39.878774+0000","last_active":"2024-04-25T16:01:39.878703+0000","last_peered":"2024-04-25T16:01:39.878703+0000","last_clean":"2024-04-25T16:01:39.878703+0000","last_became_active":"2024-04-25T15:54:20.427071+0000","last_became_peered":"2024-04-25T15:54:20.427071+0000","last_unstale":"2024-04-25T16:01:39.878703+0000","last_undegraded":"2024-04-25T16:01:39.878703+0000","last_fullsized":"2024-04-25T16:01:39.878703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'396","last_scrub_stamp":"2024-04-25T16:01:39.878444+0000","last_deep_scrub":"31'396","last_deep_scrub_stamp":"2024-04-25T16:01:39.878444+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.878444+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:19.040045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13093,"num_write":385,"num_write_kb":50492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"36'448","reported_seq":585,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.546153+0000","last_change":"2024-04-25T16:01:25.546220+0000","last_active":"2024-04-25T16:01:25.546153+0000","last_peered":"2024-04-25T16:01:25.546153+0000","last_clean":"2024-04-25T16:01:25.546153+0000","last_became_active":"2024-04-25T15:54:10.257160+0000","last_became_peered":"2024-04-25T15:54:10.257160+0000","last_unstale":"2024-04-25T16:01:25.546153+0000","last_undegraded":"2024-04-25T16:01:25.546153+0000","last_fullsized":"2024-04-25T16:01:25.546153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'448","last_scrub_stamp":"2024-04-25T16:01:25.545924+0000","last_deep_scrub":"36'448","last_deep_scrub_stamp":"2024-04-25T16:01:25.545924+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.545924+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:09.731299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":34274,"num_write":426,"num_write_kb":72417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"31'398","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.429391+0000","last_change":"2024-04-25T16:01:30.429464+0000","last_active":"2024-04-25T16:01:30.429391+0000","last_peered":"2024-04-25T16:01:30.429391+0000","last_clean":"2024-04-25T16:01:30.429391+0000","last_became_active":"2024-04-25T15:54:20.411554+0000","last_became_peered":"2024-04-25T15:54:20.411554+0000","last_unstale":"2024-04-25T16:01:30.429391+0000","last_undegraded":"2024-04-25T16:01:30.429391+0000","last_fullsized":"2024-04-25T16:01:30.429391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'398","last_scrub_stamp":"2024-04-25T16:01:30.429168+0000","last_deep_scrub":"31'398","last_deep_scrub_stamp":"2024-04-25T16:01:30.429168+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.429168+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:48.331333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":32843,"num_write":377,"num_write_kb":116675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"36'474","reported_seq":597,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.284671+0000","last_change":"2024-04-25T16:01:27.284744+0000","last_active":"2024-04-25T16:01:27.284671+0000","last_peered":"2024-04-25T16:01:27.284671+0000","last_clean":"2024-04-25T16:01:27.284671+0000","last_became_active":"2024-04-25T15:54:10.277035+0000","last_became_peered":"2024-04-25T15:54:10.277035+0000","last_unstale":"2024-04-25T16:01:27.284671+0000","last_undegraded":"2024-04-25T16:01:27.284671+0000","last_fullsized":"2024-04-25T16:01:27.284671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'474","last_scrub_stamp":"2024-04-25T16:01:27.284417+0000","last_deep_scrub":"36'474","last_deep_scrub_stamp":"2024-04-25T16:01:27.284417+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.284417+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:12.843325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33678,"num_write":445,"num_write_kb":67390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"31'407","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:43.980381+0000","last_change":"2024-04-25T16:01:43.980453+0000","last_active":"2024-04-25T16:01:43.980381+0000","last_peered":"2024-04-25T16:01:43.980381+0000","last_clean":"2024-04-25T16:01:43.980381+0000","last_became_active":"2024-04-25T15:54:20.450638+0000","last_became_peered":"2024-04-25T15:54:20.450638+0000","last_unstale":"2024-04-25T16:01:43.980381+0000","last_undegraded":"2024-04-25T16:01:43.980381+0000","last_fullsized":"2024-04-25T16:01:43.980381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'407","last_scrub_stamp":"2024-04-25T16:01:43.980151+0000","last_deep_scrub":"31'407","last_deep_scrub_stamp":"2024-04-25T16:01:43.980151+0000","last_clean_scrub_stamp":"2024-04-25T16:01:43.980151+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:39.554294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19077,"num_write":388,"num_write_kb":75668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"36'415","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:25.041069+0000","last_change":"2024-04-25T16:01:25.041263+0000","last_active":"2024-04-25T16:01:25.041069+0000","last_peered":"2024-04-25T16:01:25.041069+0000","last_clean":"2024-04-25T16:01:25.041069+0000","last_became_active":"2024-04-25T15:54:10.232225+0000","last_became_peered":"2024-04-25T15:54:10.232225+0000","last_unstale":"2024-04-25T16:01:25.041069+0000","last_undegraded":"2024-04-25T16:01:25.041069+0000","last_fullsized":"2024-04-25T16:01:25.041069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'415","last_scrub_stamp":"2024-04-25T16:01:25.040795+0000","last_deep_scrub":"36'415","last_deep_scrub_stamp":"2024-04-25T16:01:25.040795+0000","last_clean_scrub_stamp":"2024-04-25T16:01:25.040795+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:59.678389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15212,"num_write":389,"num_write_kb":87855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"31'469","reported_seq":581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.010673+0000","last_change":"2024-04-25T16:01:33.010740+0000","last_active":"2024-04-25T16:01:33.010673+0000","last_peered":"2024-04-25T16:01:33.010673+0000","last_clean":"2024-04-25T16:01:33.010673+0000","last_became_active":"2024-04-25T15:54:20.433138+0000","last_became_peered":"2024-04-25T15:54:20.433138+0000","last_unstale":"2024-04-25T16:01:33.010673+0000","last_undegraded":"2024-04-25T16:01:33.010673+0000","last_fullsized":"2024-04-25T16:01:33.010673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'469","last_scrub_stamp":"2024-04-25T16:01:33.010427+0000","last_deep_scrub":"31'469","last_deep_scrub_stamp":"2024-04-25T16:01:33.010427+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.010427+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:45.716273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":27411,"num_write":441,"num_write_kb":71769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"36'370","reported_seq":458,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.661121+0000","last_change":"2024-04-25T16:01:39.661213+0000","last_active":"2024-04-25T16:01:39.661121+0000","last_peered":"2024-04-25T16:01:39.661121+0000","last_clean":"2024-04-25T16:01:39.661121+0000","last_became_active":"2024-04-25T15:54:10.235220+0000","last_became_peered":"2024-04-25T15:54:10.235220+0000","last_unstale":"2024-04-25T16:01:39.661121+0000","last_undegraded":"2024-04-25T16:01:39.661121+0000","last_fullsized":"2024-04-25T16:01:39.661121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'370","last_scrub_stamp":"2024-04-25T16:01:39.660893+0000","last_deep_scrub":"36'370","last_deep_scrub_stamp":"2024-04-25T16:01:39.660893+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.660893+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:51.906902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17348,"num_write":348,"num_write_kb":62807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"31'399","reported_seq":502,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.672655+0000","last_change":"2024-04-25T16:01:41.672736+0000","last_active":"2024-04-25T16:01:41.672655+0000","last_peered":"2024-04-25T16:01:41.672655+0000","last_clean":"2024-04-25T16:01:41.672655+0000","last_became_active":"2024-04-25T15:54:20.420128+0000","last_became_peered":"2024-04-25T15:54:20.420128+0000","last_unstale":"2024-04-25T16:01:41.672655+0000","last_undegraded":"2024-04-25T16:01:41.672655+0000","last_fullsized":"2024-04-25T16:01:41.672655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'399","last_scrub_stamp":"2024-04-25T16:01:41.672314+0000","last_deep_scrub":"31'399","last_deep_scrub_stamp":"2024-04-25T16:01:41.672314+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.672314+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.145989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25133,"num_write":374,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"36'389","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:24.992037+0000","last_change":"2024-04-25T16:01:24.992127+0000","last_active":"2024-04-25T16:01:24.992037+0000","last_peered":"2024-04-25T16:01:24.992037+0000","last_clean":"2024-04-25T16:01:24.992037+0000","last_became_active":"2024-04-25T15:54:10.248572+0000","last_became_peered":"2024-04-25T15:54:10.248572+0000","last_unstale":"2024-04-25T16:01:24.992037+0000","last_undegraded":"2024-04-25T16:01:24.992037+0000","last_fullsized":"2024-04-25T16:01:24.992037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'389","last_scrub_stamp":"2024-04-25T16:01:24.991814+0000","last_deep_scrub":"36'389","last_deep_scrub_stamp":"2024-04-25T16:01:24.991814+0000","last_clean_scrub_stamp":"2024-04-25T16:01:24.991814+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:19.277169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9093,"num_write":358,"num_write_kb":54590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"31'414","reported_seq":474,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:49.080788+0000","last_change":"2024-04-25T16:01:49.080937+0000","last_active":"2024-04-25T16:01:49.080788+0000","last_peered":"2024-04-25T16:01:49.080788+0000","last_clean":"2024-04-25T16:01:49.080788+0000","last_became_active":"2024-04-25T15:54:20.439712+0000","last_became_peered":"2024-04-25T15:54:20.439712+0000","last_unstale":"2024-04-25T16:01:49.080788+0000","last_undegraded":"2024-04-25T16:01:49.080788+0000","last_fullsized":"2024-04-25T16:01:49.080788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'414","last_scrub_stamp":"2024-04-25T16:01:49.080398+0000","last_deep_scrub":"31'414","last_deep_scrub_stamp":"2024-04-25T16:01:49.080398+0000","last_clean_scrub_stamp":"2024-04-25T16:01:49.080398+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:32.276133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4145,"num_write":400,"num_write_kb":47343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"36'485","reported_seq":616,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.701218+0000","last_change":"2024-04-25T16:01:22.701321+0000","last_active":"2024-04-25T16:01:22.701218+0000","last_peered":"2024-04-25T16:01:22.701218+0000","last_clean":"2024-04-25T16:01:22.701218+0000","last_became_active":"2024-04-25T15:54:10.270256+0000","last_became_peered":"2024-04-25T15:54:10.270256+0000","last_unstale":"2024-04-25T16:01:22.701218+0000","last_undegraded":"2024-04-25T16:01:22.701218+0000","last_fullsized":"2024-04-25T16:01:22.701218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'485","last_scrub_stamp":"2024-04-25T16:01:22.701004+0000","last_deep_scrub":"36'485","last_deep_scrub_stamp":"2024-04-25T16:01:22.701004+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.701004+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:05.618289+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40854,"num_write":458,"num_write_kb":125991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"31'410","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.758158+0000","last_change":"2024-04-25T16:01:40.758235+0000","last_active":"2024-04-25T16:01:40.758158+0000","last_peered":"2024-04-25T16:01:40.758158+0000","last_clean":"2024-04-25T16:01:40.758158+0000","last_became_active":"2024-04-25T15:54:20.414695+0000","last_became_peered":"2024-04-25T15:54:20.414695+0000","last_unstale":"2024-04-25T16:01:40.758158+0000","last_undegraded":"2024-04-25T16:01:40.758158+0000","last_fullsized":"2024-04-25T16:01:40.758158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'410","last_scrub_stamp":"2024-04-25T16:01:40.757965+0000","last_deep_scrub":"31'410","last_deep_scrub_stamp":"2024-04-25T16:01:40.757965+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.757965+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:58.660131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":26310,"num_write":391,"num_write_kb":68273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'398","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.588284+0000","last_change":"2024-04-25T16:01:41.588433+0000","last_active":"2024-04-25T16:01:41.588284+0000","last_peered":"2024-04-25T16:01:41.588284+0000","last_clean":"2024-04-25T16:01:41.588284+0000","last_became_active":"2024-04-25T15:54:10.237734+0000","last_became_peered":"2024-04-25T15:54:10.237734+0000","last_unstale":"2024-04-25T16:01:41.588284+0000","last_undegraded":"2024-04-25T16:01:41.588284+0000","last_fullsized":"2024-04-25T16:01:41.588284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'398","last_scrub_stamp":"2024-04-25T16:01:41.587900+0000","last_deep_scrub":"36'398","last_deep_scrub_stamp":"2024-04-25T16:01:41.587900+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.587900+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:40.543987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4252,"num_write":382,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"31'416","reported_seq":545,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:47.577186+0000","last_change":"2024-04-25T16:01:47.577337+0000","last_active":"2024-04-25T16:01:47.577186+0000","last_peered":"2024-04-25T16:01:47.577186+0000","last_clean":"2024-04-25T16:01:47.577186+0000","last_became_active":"2024-04-25T15:54:20.412358+0000","last_became_peered":"2024-04-25T15:54:20.412358+0000","last_unstale":"2024-04-25T16:01:47.577186+0000","last_undegraded":"2024-04-25T16:01:47.577186+0000","last_fullsized":"2024-04-25T16:01:47.577186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'416","last_scrub_stamp":"2024-04-25T16:01:47.576849+0000","last_deep_scrub":"31'416","last_deep_scrub_stamp":"2024-04-25T16:01:47.576849+0000","last_clean_scrub_stamp":"2024-04-25T16:01:47.576849+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:13.276540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":38150,"num_write":393,"num_write_kb":63831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'452","reported_seq":530,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.421457+0000","last_change":"2024-04-25T16:01:31.421594+0000","last_active":"2024-04-25T16:01:31.421457+0000","last_peered":"2024-04-25T16:01:31.421457+0000","last_clean":"2024-04-25T16:01:31.421457+0000","last_became_active":"2024-04-25T15:54:10.278819+0000","last_became_peered":"2024-04-25T15:54:10.278819+0000","last_unstale":"2024-04-25T16:01:31.421457+0000","last_undegraded":"2024-04-25T16:01:31.421457+0000","last_fullsized":"2024-04-25T16:01:31.421457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'452","last_scrub_stamp":"2024-04-25T16:01:31.421131+0000","last_deep_scrub":"36'452","last_deep_scrub_stamp":"2024-04-25T16:01:31.421131+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.421131+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:01.267018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":13732,"num_write":425,"num_write_kb":92170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"31'400","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:44.139121+0000","last_change":"2024-04-25T16:01:44.139275+0000","last_active":"2024-04-25T16:01:44.139121+0000","last_peered":"2024-04-25T16:01:44.139121+0000","last_clean":"2024-04-25T16:01:44.139121+0000","last_became_active":"2024-04-25T15:54:20.433474+0000","last_became_peered":"2024-04-25T15:54:20.433474+0000","last_unstale":"2024-04-25T16:01:44.139121+0000","last_undegraded":"2024-04-25T16:01:44.139121+0000","last_fullsized":"2024-04-25T16:01:44.139121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'400","last_scrub_stamp":"2024-04-25T16:01:44.138744+0000","last_deep_scrub":"31'400","last_deep_scrub_stamp":"2024-04-25T16:01:44.138744+0000","last_clean_scrub_stamp":"2024-04-25T16:01:44.138744+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:00.035204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":30630,"num_write":376,"num_write_kb":46781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"36'400","reported_seq":498,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.635266+0000","last_change":"2024-04-25T16:01:40.635351+0000","last_active":"2024-04-25T16:01:40.635266+0000","last_peered":"2024-04-25T16:01:40.635266+0000","last_clean":"2024-04-25T16:01:40.635266+0000","last_became_active":"2024-04-25T15:54:10.237379+0000","last_became_peered":"2024-04-25T15:54:10.237379+0000","last_unstale":"2024-04-25T16:01:40.635266+0000","last_undegraded":"2024-04-25T16:01:40.635266+0000","last_fullsized":"2024-04-25T16:01:40.635266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'400","last_scrub_stamp":"2024-04-25T16:01:40.635022+0000","last_deep_scrub":"36'400","last_deep_scrub_stamp":"2024-04-25T16:01:40.635022+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.635022+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:31.414621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":15673,"num_write":376,"num_write_kb":63098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"31'448","reported_seq":538,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.559634+0000","last_change":"2024-04-25T16:01:30.559714+0000","last_active":"2024-04-25T16:01:30.559634+0000","last_peered":"2024-04-25T16:01:30.559634+0000","last_clean":"2024-04-25T16:01:30.559634+0000","last_became_active":"2024-04-25T15:54:20.414463+0000","last_became_peered":"2024-04-25T15:54:20.414463+0000","last_unstale":"2024-04-25T16:01:30.559634+0000","last_undegraded":"2024-04-25T16:01:30.559634+0000","last_fullsized":"2024-04-25T16:01:30.559634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'448","last_scrub_stamp":"2024-04-25T16:01:30.559406+0000","last_deep_scrub":"31'448","last_deep_scrub_stamp":"2024-04-25T16:01:30.559406+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.559406+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:12.177981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":17288,"num_write":429,"num_write_kb":67321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"35'439","reported_seq":577,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.364090+0000","last_change":"2024-04-25T16:01:22.364160+0000","last_active":"2024-04-25T16:01:22.364090+0000","last_peered":"2024-04-25T16:01:22.364090+0000","last_clean":"2024-04-25T16:01:22.364090+0000","last_became_active":"2024-04-25T15:54:10.293515+0000","last_became_peered":"2024-04-25T15:54:10.293515+0000","last_unstale":"2024-04-25T16:01:22.364090+0000","last_undegraded":"2024-04-25T16:01:22.364090+0000","last_fullsized":"2024-04-25T16:01:22.364090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'439","last_scrub_stamp":"2024-04-25T16:01:22.363858+0000","last_deep_scrub":"35'439","last_deep_scrub_stamp":"2024-04-25T16:01:22.363858+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.363858+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:37.913300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":44523,"num_write":420,"num_write_kb":101102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"31'449","reported_seq":572,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:50.536790+0000","last_change":"2024-04-25T16:01:50.536864+0000","last_active":"2024-04-25T16:01:50.536790+0000","last_peered":"2024-04-25T16:01:50.536790+0000","last_clean":"2024-04-25T16:01:50.536790+0000","last_became_active":"2024-04-25T15:54:20.429986+0000","last_became_peered":"2024-04-25T15:54:20.429986+0000","last_unstale":"2024-04-25T16:01:50.536790+0000","last_undegraded":"2024-04-25T16:01:50.536790+0000","last_fullsized":"2024-04-25T16:01:50.536790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'449","last_scrub_stamp":"2024-04-25T16:01:50.536554+0000","last_deep_scrub":"31'449","last_deep_scrub_stamp":"2024-04-25T16:01:50.536554+0000","last_clean_scrub_stamp":"2024-04-25T16:01:50.536554+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:33.636835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":42039,"num_write":424,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"36'406","reported_seq":490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:36.606251+0000","last_change":"2024-04-25T16:01:36.606251+0000","last_active":"2024-04-25T16:01:36.606251+0000","last_peered":"2024-04-25T16:01:36.606251+0000","last_clean":"2024-04-25T16:01:36.606251+0000","last_became_active":"2024-04-25T15:54:50.214363+0000","last_became_peered":"2024-04-25T15:54:50.214363+0000","last_unstale":"2024-04-25T16:01:36.606251+0000","last_undegraded":"2024-04-25T16:01:36.606251+0000","last_fullsized":"2024-04-25T16:01:36.606251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'406","last_scrub_stamp":"2024-04-25T16:01:36.605906+0000","last_deep_scrub":"36'406","last_deep_scrub_stamp":"2024-04-25T16:01:36.605906+0000","last_clean_scrub_stamp":"2024-04-25T16:01:36.605906+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:39.838496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":27977,"num_write":389,"num_write_kb":84131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"31'427","reported_seq":563,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.646538+0000","last_change":"2024-04-25T16:01:40.646694+0000","last_active":"2024-04-25T16:01:40.646538+0000","last_peered":"2024-04-25T16:01:40.646538+0000","last_clean":"2024-04-25T16:01:40.646538+0000","last_became_active":"2024-04-25T15:54:20.417248+0000","last_became_peered":"2024-04-25T15:54:20.417248+0000","last_unstale":"2024-04-25T16:01:40.646538+0000","last_undegraded":"2024-04-25T16:01:40.646538+0000","last_fullsized":"2024-04-25T16:01:40.646538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'427","last_scrub_stamp":"2024-04-25T16:01:40.646194+0000","last_deep_scrub":"31'427","last_deep_scrub_stamp":"2024-04-25T16:01:40.646194+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.646194+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:16:04.854574+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":43629,"num_write":407,"num_write_kb":76072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"35'432","reported_seq":537,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.691740+0000","last_change":"2024-04-25T16:01:33.691815+0000","last_active":"2024-04-25T16:01:33.691740+0000","last_peered":"2024-04-25T16:01:33.691740+0000","last_clean":"2024-04-25T16:01:33.691740+0000","last_became_active":"2024-04-25T15:54:10.257791+0000","last_became_peered":"2024-04-25T15:54:10.257791+0000","last_unstale":"2024-04-25T16:01:33.691740+0000","last_undegraded":"2024-04-25T16:01:33.691740+0000","last_fullsized":"2024-04-25T16:01:33.691740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'432","last_scrub_stamp":"2024-04-25T16:01:33.691481+0000","last_deep_scrub":"35'432","last_deep_scrub_stamp":"2024-04-25T16:01:33.691481+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.691481+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:46.925770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30618,"num_write":414,"num_write_kb":71070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"31'389","reported_seq":486,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:38.566437+0000","last_change":"2024-04-25T16:01:38.566511+0000","last_active":"2024-04-25T16:01:38.566437+0000","last_peered":"2024-04-25T16:01:38.566437+0000","last_clean":"2024-04-25T16:01:38.566437+0000","last_became_active":"2024-04-25T15:54:20.416991+0000","last_became_peered":"2024-04-25T15:54:20.416991+0000","last_unstale":"2024-04-25T16:01:38.566437+0000","last_undegraded":"2024-04-25T16:01:38.566437+0000","last_fullsized":"2024-04-25T16:01:38.566437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'389","last_scrub_stamp":"2024-04-25T16:01:38.566200+0000","last_deep_scrub":"31'389","last_deep_scrub_stamp":"2024-04-25T16:01:38.566200+0000","last_clean_scrub_stamp":"2024-04-25T16:01:38.566200+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:36.013070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30549,"num_write":360,"num_write_kb":75006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"36'422","reported_seq":538,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:45.010919+0000","last_change":"2024-04-25T16:01:45.011003+0000","last_active":"2024-04-25T16:01:45.010919+0000","last_peered":"2024-04-25T16:01:45.010919+0000","last_clean":"2024-04-25T16:01:45.010919+0000","last_became_active":"2024-04-25T15:54:50.219215+0000","last_became_peered":"2024-04-25T15:54:50.219215+0000","last_unstale":"2024-04-25T16:01:45.010919+0000","last_undegraded":"2024-04-25T16:01:45.010919+0000","last_fullsized":"2024-04-25T16:01:45.010919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'422","last_scrub_stamp":"2024-04-25T16:01:45.010653+0000","last_deep_scrub":"36'422","last_deep_scrub_stamp":"2024-04-25T16:01:45.010653+0000","last_clean_scrub_stamp":"2024-04-25T16:01:45.010653+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:57.256662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":39450,"num_write":395,"num_write_kb":75510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.28","version":"31'437","reported_seq":526,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.443152+0000","last_change":"2024-04-25T16:01:32.443312+0000","last_active":"2024-04-25T16:01:32.443152+0000","last_peered":"2024-04-25T16:01:32.443152+0000","last_clean":"2024-04-25T16:01:32.443152+0000","last_became_active":"2024-04-25T15:54:20.427480+0000","last_became_peered":"2024-04-25T15:54:20.427480+0000","last_unstale":"2024-04-25T16:01:32.443152+0000","last_undegraded":"2024-04-25T16:01:32.443152+0000","last_fullsized":"2024-04-25T16:01:32.443152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'437","last_scrub_stamp":"2024-04-25T16:01:32.442771+0000","last_deep_scrub":"31'437","last_deep_scrub_stamp":"2024-04-25T16:01:32.442771+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.442771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:06.489513+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19085,"num_write":412,"num_write_kb":55082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"36'406","reported_seq":506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.531016+0000","last_change":"2024-04-25T16:01:26.531084+0000","last_active":"2024-04-25T16:01:26.531016+0000","last_peered":"2024-04-25T16:01:26.531016+0000","last_clean":"2024-04-25T16:01:26.531016+0000","last_became_active":"2024-04-25T15:54:10.258284+0000","last_became_peered":"2024-04-25T15:54:10.258284+0000","last_unstale":"2024-04-25T16:01:26.531016+0000","last_undegraded":"2024-04-25T16:01:26.531016+0000","last_fullsized":"2024-04-25T16:01:26.531016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'406","last_scrub_stamp":"2024-04-25T16:01:26.530775+0000","last_deep_scrub":"36'406","last_deep_scrub_stamp":"2024-04-25T16:01:26.530775+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.530775+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:27.748171+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":24863,"num_write":384,"num_write_kb":75591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"31'420","reported_seq":512,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:35.106500+0000","last_change":"2024-04-25T16:01:35.106572+0000","last_active":"2024-04-25T16:01:35.106500+0000","last_peered":"2024-04-25T16:01:35.106500+0000","last_clean":"2024-04-25T16:01:35.106500+0000","last_became_active":"2024-04-25T15:54:20.425984+0000","last_became_peered":"2024-04-25T15:54:20.425984+0000","last_unstale":"2024-04-25T16:01:35.106500+0000","last_undegraded":"2024-04-25T16:01:35.106500+0000","last_fullsized":"2024-04-25T16:01:35.106500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'420","last_scrub_stamp":"2024-04-25T16:01:35.106268+0000","last_deep_scrub":"31'420","last_deep_scrub_stamp":"2024-04-25T16:01:35.106268+0000","last_clean_scrub_stamp":"2024-04-25T16:01:35.106268+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:07.880159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20260,"num_write":395,"num_write_kb":76151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"36'416","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:40.423242+0000","last_change":"2024-04-25T16:01:40.423319+0000","last_active":"2024-04-25T16:01:40.423242+0000","last_peered":"2024-04-25T16:01:40.423242+0000","last_clean":"2024-04-25T16:01:40.423242+0000","last_became_active":"2024-04-25T15:54:10.259907+0000","last_became_peered":"2024-04-25T15:54:10.259907+0000","last_unstale":"2024-04-25T16:01:40.423242+0000","last_undegraded":"2024-04-25T16:01:40.423242+0000","last_fullsized":"2024-04-25T16:01:40.423242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'416","last_scrub_stamp":"2024-04-25T16:01:40.422985+0000","last_deep_scrub":"36'416","last_deep_scrub_stamp":"2024-04-25T16:01:40.422985+0000","last_clean_scrub_stamp":"2024-04-25T16:01:40.422985+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:35.997129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24467,"num_write":391,"num_write_kb":79816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"31'404","reported_seq":499,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:37.865615+0000","last_change":"2024-04-25T16:01:37.865685+0000","last_active":"2024-04-25T16:01:37.865615+0000","last_peered":"2024-04-25T16:01:37.865615+0000","last_clean":"2024-04-25T16:01:37.865615+0000","last_became_active":"2024-04-25T15:54:20.421058+0000","last_became_peered":"2024-04-25T15:54:20.421058+0000","last_unstale":"2024-04-25T16:01:37.865615+0000","last_undegraded":"2024-04-25T16:01:37.865615+0000","last_fullsized":"2024-04-25T16:01:37.865615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'404","last_scrub_stamp":"2024-04-25T16:01:37.865377+0000","last_deep_scrub":"31'404","last_deep_scrub_stamp":"2024-04-25T16:01:37.865377+0000","last_clean_scrub_stamp":"2024-04-25T16:01:37.865377+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:48.959288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25761,"num_write":377,"num_write_kb":87528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"36'432","reported_seq":538,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.473366+0000","last_change":"2024-04-25T16:01:39.473438+0000","last_active":"2024-04-25T16:01:39.473366+0000","last_peered":"2024-04-25T16:01:39.473366+0000","last_clean":"2024-04-25T16:01:39.473366+0000","last_became_active":"2024-04-25T15:54:10.258712+0000","last_became_peered":"2024-04-25T15:54:10.258712+0000","last_unstale":"2024-04-25T16:01:39.473366+0000","last_undegraded":"2024-04-25T16:01:39.473366+0000","last_fullsized":"2024-04-25T16:01:39.473366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'432","last_scrub_stamp":"2024-04-25T16:01:39.473146+0000","last_deep_scrub":"36'432","last_deep_scrub_stamp":"2024-04-25T16:01:39.473146+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.473146+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:56.817999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":33533,"num_write":410,"num_write_kb":87842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"31'400","reported_seq":493,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:42.668167+0000","last_change":"2024-04-25T16:01:42.668239+0000","last_active":"2024-04-25T16:01:42.668167+0000","last_peered":"2024-04-25T16:01:42.668167+0000","last_clean":"2024-04-25T16:01:42.668167+0000","last_became_active":"2024-04-25T15:54:20.427640+0000","last_became_peered":"2024-04-25T15:54:20.427640+0000","last_unstale":"2024-04-25T16:01:42.668167+0000","last_undegraded":"2024-04-25T16:01:42.668167+0000","last_fullsized":"2024-04-25T16:01:42.668167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'400","last_scrub_stamp":"2024-04-25T16:01:42.667937+0000","last_deep_scrub":"31'400","last_deep_scrub_stamp":"2024-04-25T16:01:42.667937+0000","last_clean_scrub_stamp":"2024-04-25T16:01:42.667937+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:00.012790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29549,"num_write":386,"num_write_kb":55194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"36'394","reported_seq":527,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.029273+0000","last_change":"2024-04-25T16:01:23.029341+0000","last_active":"2024-04-25T16:01:23.029273+0000","last_peered":"2024-04-25T16:01:23.029273+0000","last_clean":"2024-04-25T16:01:23.029273+0000","last_became_active":"2024-04-25T15:54:10.264360+0000","last_became_peered":"2024-04-25T15:54:10.264360+0000","last_unstale":"2024-04-25T16:01:23.029273+0000","last_undegraded":"2024-04-25T16:01:23.029273+0000","last_fullsized":"2024-04-25T16:01:23.029273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'394","last_scrub_stamp":"2024-04-25T16:01:23.029025+0000","last_deep_scrub":"36'394","last_deep_scrub_stamp":"2024-04-25T16:01:23.029025+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.029025+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:38.578468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46746,"num_write":370,"num_write_kb":63568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"31'338","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:45.465020+0000","last_change":"2024-04-25T16:01:45.465092+0000","last_active":"2024-04-25T16:01:45.465020+0000","last_peered":"2024-04-25T16:01:45.465020+0000","last_clean":"2024-04-25T16:01:45.465020+0000","last_became_active":"2024-04-25T15:54:20.440167+0000","last_became_peered":"2024-04-25T15:54:20.440167+0000","last_unstale":"2024-04-25T16:01:45.465020+0000","last_undegraded":"2024-04-25T16:01:45.465020+0000","last_fullsized":"2024-04-25T16:01:45.465020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'338","last_scrub_stamp":"2024-04-25T16:01:45.464756+0000","last_deep_scrub":"31'338","last_deep_scrub_stamp":"2024-04-25T16:01:45.464756+0000","last_clean_scrub_stamp":"2024-04-25T16:01:45.464756+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:10.573702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":9201,"num_write":322,"num_write_kb":37990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"36'397","reported_seq":485,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:27.025578+0000","last_change":"2024-04-25T16:01:27.025647+0000","last_active":"2024-04-25T16:01:27.025578+0000","last_peered":"2024-04-25T16:01:27.025578+0000","last_clean":"2024-04-25T16:01:27.025578+0000","last_became_active":"2024-04-25T15:54:10.238448+0000","last_became_peered":"2024-04-25T15:54:10.238448+0000","last_unstale":"2024-04-25T16:01:27.025578+0000","last_undegraded":"2024-04-25T16:01:27.025578+0000","last_fullsized":"2024-04-25T16:01:27.025578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'397","last_scrub_stamp":"2024-04-25T16:01:27.025358+0000","last_deep_scrub":"36'397","last_deep_scrub_stamp":"2024-04-25T16:01:27.025358+0000","last_clean_scrub_stamp":"2024-04-25T16:01:27.025358+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:08.275709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14146,"num_write":373,"num_write_kb":38796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"31'395","reported_seq":545,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:43.093305+0000","last_change":"2024-04-25T16:01:43.093377+0000","last_active":"2024-04-25T16:01:43.093305+0000","last_peered":"2024-04-25T16:01:43.093305+0000","last_clean":"2024-04-25T16:01:43.093305+0000","last_became_active":"2024-04-25T15:54:20.433528+0000","last_became_peered":"2024-04-25T15:54:20.433528+0000","last_unstale":"2024-04-25T16:01:43.093305+0000","last_undegraded":"2024-04-25T16:01:43.093305+0000","last_fullsized":"2024-04-25T16:01:43.093305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'395","last_scrub_stamp":"2024-04-25T16:01:43.093055+0000","last_deep_scrub":"31'395","last_deep_scrub_stamp":"2024-04-25T16:01:43.093055+0000","last_clean_scrub_stamp":"2024-04-25T16:01:43.093055+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:55.339064+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":61604,"num_write":383,"num_write_kb":95809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"36'373","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:30.457356+0000","last_change":"2024-04-25T16:01:30.457427+0000","last_active":"2024-04-25T16:01:30.457356+0000","last_peered":"2024-04-25T16:01:30.457356+0000","last_clean":"2024-04-25T16:01:30.457356+0000","last_became_active":"2024-04-25T15:54:10.251210+0000","last_became_peered":"2024-04-25T15:54:10.251210+0000","last_unstale":"2024-04-25T16:01:30.457356+0000","last_undegraded":"2024-04-25T16:01:30.457356+0000","last_fullsized":"2024-04-25T16:01:30.457356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'373","last_scrub_stamp":"2024-04-25T16:01:30.457137+0000","last_deep_scrub":"36'373","last_deep_scrub_stamp":"2024-04-25T16:01:30.457137+0000","last_clean_scrub_stamp":"2024-04-25T16:01:30.457137+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:08.299048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13278,"num_write":350,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"31'383","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:31.485571+0000","last_change":"2024-04-25T16:01:31.485649+0000","last_active":"2024-04-25T16:01:31.485571+0000","last_peered":"2024-04-25T16:01:31.485571+0000","last_clean":"2024-04-25T16:01:31.485571+0000","last_became_active":"2024-04-25T15:54:20.400270+0000","last_became_peered":"2024-04-25T15:54:20.400270+0000","last_unstale":"2024-04-25T16:01:31.485571+0000","last_undegraded":"2024-04-25T16:01:31.485571+0000","last_fullsized":"2024-04-25T16:01:31.485571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'383","last_scrub_stamp":"2024-04-25T16:01:31.485344+0000","last_deep_scrub":"31'383","last_deep_scrub_stamp":"2024-04-25T16:01:31.485344+0000","last_clean_scrub_stamp":"2024-04-25T16:01:31.485344+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:51.518248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4096,"num_write":350,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'356","reported_seq":447,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:32.581171+0000","last_change":"2024-04-25T16:01:32.581239+0000","last_active":"2024-04-25T16:01:32.581171+0000","last_peered":"2024-04-25T16:01:32.581171+0000","last_clean":"2024-04-25T16:01:32.581171+0000","last_became_active":"2024-04-25T15:54:10.252645+0000","last_became_peered":"2024-04-25T15:54:10.252645+0000","last_unstale":"2024-04-25T16:01:32.581171+0000","last_undegraded":"2024-04-25T16:01:32.581171+0000","last_fullsized":"2024-04-25T16:01:32.581171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'356","last_scrub_stamp":"2024-04-25T16:01:32.580937+0000","last_deep_scrub":"36'356","last_deep_scrub_stamp":"2024-04-25T16:01:32.580937+0000","last_clean_scrub_stamp":"2024-04-25T16:01:32.580937+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:05.354828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19489,"num_write":338,"num_write_kb":75079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"31'369","reported_seq":429,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.529227+0000","last_change":"2024-04-25T16:01:29.529227+0000","last_active":"2024-04-25T16:01:29.529227+0000","last_peered":"2024-04-25T16:01:29.529227+0000","last_clean":"2024-04-25T16:01:29.529227+0000","last_became_active":"2024-04-25T15:54:20.412417+0000","last_became_peered":"2024-04-25T15:54:20.412417+0000","last_unstale":"2024-04-25T16:01:29.529227+0000","last_undegraded":"2024-04-25T16:01:29.529227+0000","last_fullsized":"2024-04-25T16:01:29.529227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'369","last_scrub_stamp":"2024-04-25T16:01:29.528718+0000","last_deep_scrub":"31'369","last_deep_scrub_stamp":"2024-04-25T16:01:29.528718+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.528718+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:20.841016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":1693,"num_write":344,"num_write_kb":38100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"36'368","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.809350+0000","last_change":"2024-04-25T16:01:41.809494+0000","last_active":"2024-04-25T16:01:41.809350+0000","last_peered":"2024-04-25T16:01:41.809350+0000","last_clean":"2024-04-25T16:01:41.809350+0000","last_became_active":"2024-04-25T15:54:50.210280+0000","last_became_peered":"2024-04-25T15:54:50.210280+0000","last_unstale":"2024-04-25T16:01:41.809350+0000","last_undegraded":"2024-04-25T16:01:41.809350+0000","last_fullsized":"2024-04-25T16:01:41.809350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'368","last_scrub_stamp":"2024-04-25T16:01:41.809007+0000","last_deep_scrub":"36'368","last_deep_scrub_stamp":"2024-04-25T16:01:41.809007+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.809007+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:46.292487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25999,"num_write":356,"num_write_kb":38429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"31'447","reported_seq":569,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.961425+0000","last_change":"2024-04-25T16:01:26.961490+0000","last_active":"2024-04-25T16:01:26.961425+0000","last_peered":"2024-04-25T16:01:26.961425+0000","last_clean":"2024-04-25T16:01:26.961425+0000","last_became_active":"2024-04-25T15:54:20.421377+0000","last_became_peered":"2024-04-25T15:54:20.421377+0000","last_unstale":"2024-04-25T16:01:26.961425+0000","last_undegraded":"2024-04-25T16:01:26.961425+0000","last_fullsized":"2024-04-25T16:01:26.961425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'447","last_scrub_stamp":"2024-04-25T16:01:26.961198+0000","last_deep_scrub":"31'447","last_deep_scrub_stamp":"2024-04-25T16:01:26.961198+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.961198+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:56:30.193787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":38032,"num_write":427,"num_write_kb":75902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"36'382","reported_seq":492,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.667498+0000","last_change":"2024-04-25T16:01:23.667498+0000","last_active":"2024-04-25T16:01:23.667498+0000","last_peered":"2024-04-25T16:01:23.667498+0000","last_clean":"2024-04-25T16:01:23.667498+0000","last_became_active":"2024-04-25T15:54:10.261841+0000","last_became_peered":"2024-04-25T15:54:10.261841+0000","last_unstale":"2024-04-25T16:01:23.667498+0000","last_undegraded":"2024-04-25T16:01:23.667498+0000","last_fullsized":"2024-04-25T16:01:23.667498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'382","last_scrub_stamp":"2024-04-25T16:01:23.667025+0000","last_deep_scrub":"36'382","last_deep_scrub_stamp":"2024-04-25T16:01:23.667025+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.667025+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:06.013967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33238,"num_write":360,"num_write_kb":83325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"31'430","reported_seq":570,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.333898+0000","last_change":"2024-04-25T16:01:28.333989+0000","last_active":"2024-04-25T16:01:28.333898+0000","last_peered":"2024-04-25T16:01:28.333898+0000","last_clean":"2024-04-25T16:01:28.333898+0000","last_became_active":"2024-04-25T15:54:20.405344+0000","last_became_peered":"2024-04-25T15:54:20.405344+0000","last_unstale":"2024-04-25T16:01:28.333898+0000","last_undegraded":"2024-04-25T16:01:28.333898+0000","last_fullsized":"2024-04-25T16:01:28.333898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'430","last_scrub_stamp":"2024-04-25T16:01:28.333668+0000","last_deep_scrub":"31'430","last_deep_scrub_stamp":"2024-04-25T16:01:28.333668+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.333668+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:35.212542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47776,"num_write":403,"num_write_kb":100333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"36'419","reported_seq":514,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:22.903395+0000","last_change":"2024-04-25T16:01:22.903395+0000","last_active":"2024-04-25T16:01:22.903395+0000","last_peered":"2024-04-25T16:01:22.903395+0000","last_clean":"2024-04-25T16:01:22.903395+0000","last_became_active":"2024-04-25T15:54:10.296004+0000","last_became_peered":"2024-04-25T15:54:10.296004+0000","last_unstale":"2024-04-25T16:01:22.903395+0000","last_undegraded":"2024-04-25T16:01:22.903395+0000","last_fullsized":"2024-04-25T16:01:22.903395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'419","last_scrub_stamp":"2024-04-25T16:01:22.903089+0000","last_deep_scrub":"36'419","last_deep_scrub_stamp":"2024-04-25T16:01:22.903089+0000","last_clean_scrub_stamp":"2024-04-25T16:01:22.903089+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:38.452532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":31054,"num_write":404,"num_write_kb":100026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"31'457","reported_seq":605,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:43.569844+0000","last_change":"2024-04-25T16:01:43.569894+0000","last_active":"2024-04-25T16:01:43.569844+0000","last_peered":"2024-04-25T16:01:43.569844+0000","last_clean":"2024-04-25T16:01:43.569844+0000","last_became_active":"2024-04-25T15:54:20.403747+0000","last_became_peered":"2024-04-25T15:54:20.403747+0000","last_unstale":"2024-04-25T16:01:43.569844+0000","last_undegraded":"2024-04-25T16:01:43.569844+0000","last_fullsized":"2024-04-25T16:01:43.569844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'457","last_scrub_stamp":"2024-04-25T16:01:43.569697+0000","last_deep_scrub":"31'457","last_deep_scrub_stamp":"2024-04-25T16:01:43.569697+0000","last_clean_scrub_stamp":"2024-04-25T16:01:43.569697+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:39.459936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":56462,"num_write":435,"num_write_kb":97259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"36'357","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:26.484703+0000","last_change":"2024-04-25T16:01:26.484703+0000","last_active":"2024-04-25T16:01:26.484703+0000","last_peered":"2024-04-25T16:01:26.484703+0000","last_clean":"2024-04-25T16:01:26.484703+0000","last_became_active":"2024-04-25T15:54:10.270051+0000","last_became_peered":"2024-04-25T15:54:10.270051+0000","last_unstale":"2024-04-25T16:01:26.484703+0000","last_undegraded":"2024-04-25T16:01:26.484703+0000","last_fullsized":"2024-04-25T16:01:26.484703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'357","last_scrub_stamp":"2024-04-25T16:01:26.484245+0000","last_deep_scrub":"36'357","last_deep_scrub_stamp":"2024-04-25T16:01:26.484245+0000","last_clean_scrub_stamp":"2024-04-25T16:01:26.484245+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:33.363119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9534,"num_write":325,"num_write_kb":26581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"31'417","reported_seq":523,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:39.797876+0000","last_change":"2024-04-25T16:01:39.798063+0000","last_active":"2024-04-25T16:01:39.797876+0000","last_peered":"2024-04-25T16:01:39.797876+0000","last_clean":"2024-04-25T16:01:39.797876+0000","last_became_active":"2024-04-25T15:54:20.415144+0000","last_became_peered":"2024-04-25T15:54:20.415144+0000","last_unstale":"2024-04-25T16:01:39.797876+0000","last_undegraded":"2024-04-25T16:01:39.797876+0000","last_fullsized":"2024-04-25T16:01:39.797876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'417","last_scrub_stamp":"2024-04-25T16:01:39.797610+0000","last_deep_scrub":"31'417","last_deep_scrub_stamp":"2024-04-25T16:01:39.797610+0000","last_clean_scrub_stamp":"2024-04-25T16:01:39.797610+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:31.470363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28935,"num_write":390,"num_write_kb":55220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"36'446","reported_seq":567,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:42.099974+0000","last_change":"2024-04-25T16:01:42.099974+0000","last_active":"2024-04-25T16:01:42.099974+0000","last_peered":"2024-04-25T16:01:42.099974+0000","last_clean":"2024-04-25T16:01:42.099974+0000","last_became_active":"2024-04-25T15:54:10.266713+0000","last_became_peered":"2024-04-25T15:54:10.266713+0000","last_unstale":"2024-04-25T16:01:42.099974+0000","last_undegraded":"2024-04-25T16:01:42.099974+0000","last_fullsized":"2024-04-25T16:01:42.099974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'446","last_scrub_stamp":"2024-04-25T16:01:42.099494+0000","last_deep_scrub":"36'446","last_deep_scrub_stamp":"2024-04-25T16:01:42.099494+0000","last_clean_scrub_stamp":"2024-04-25T16:01:42.099494+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:22.792918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":18239,"num_write":428,"num_write_kb":69651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"31'386","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:41.901679+0000","last_change":"2024-04-25T16:01:41.901823+0000","last_active":"2024-04-25T16:01:41.901679+0000","last_peered":"2024-04-25T16:01:41.901679+0000","last_clean":"2024-04-25T16:01:41.901679+0000","last_became_active":"2024-04-25T15:54:20.450292+0000","last_became_peered":"2024-04-25T15:54:20.450292+0000","last_unstale":"2024-04-25T16:01:41.901679+0000","last_undegraded":"2024-04-25T16:01:41.901679+0000","last_fullsized":"2024-04-25T16:01:41.901679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'386","last_scrub_stamp":"2024-04-25T16:01:41.901334+0000","last_deep_scrub":"31'386","last_deep_scrub_stamp":"2024-04-25T16:01:41.901334+0000","last_clean_scrub_stamp":"2024-04-25T16:01:41.901334+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:52.259548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8859,"num_write":358,"num_write_kb":46267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"36'391","reported_seq":498,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.379064+0000","last_change":"2024-04-25T16:01:29.379064+0000","last_active":"2024-04-25T16:01:29.379064+0000","last_peered":"2024-04-25T16:01:29.379064+0000","last_clean":"2024-04-25T16:01:29.379064+0000","last_became_active":"2024-04-25T15:54:10.267723+0000","last_became_peered":"2024-04-25T15:54:10.267723+0000","last_unstale":"2024-04-25T16:01:29.379064+0000","last_undegraded":"2024-04-25T16:01:29.379064+0000","last_fullsized":"2024-04-25T16:01:29.379064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'391","last_scrub_stamp":"2024-04-25T16:01:29.378611+0000","last_deep_scrub":"36'391","last_deep_scrub_stamp":"2024-04-25T16:01:29.378611+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.378611+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:02.152502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":32236,"num_write":374,"num_write_kb":95777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"31'357","reported_seq":439,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:47.484284+0000","last_change":"2024-04-25T16:01:47.484424+0000","last_active":"2024-04-25T16:01:47.484284+0000","last_peered":"2024-04-25T16:01:47.484284+0000","last_clean":"2024-04-25T16:01:47.484284+0000","last_became_active":"2024-04-25T15:54:20.431658+0000","last_became_peered":"2024-04-25T15:54:20.431658+0000","last_unstale":"2024-04-25T16:01:47.484284+0000","last_undegraded":"2024-04-25T16:01:47.484284+0000","last_fullsized":"2024-04-25T16:01:47.484284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'357","last_scrub_stamp":"2024-04-25T16:01:47.483937+0000","last_deep_scrub":"31'357","last_deep_scrub_stamp":"2024-04-25T16:01:47.483937+0000","last_clean_scrub_stamp":"2024-04-25T16:01:47.483937+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:35.787301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22705,"num_write":334,"num_write_kb":38119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"36'425","reported_seq":531,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:34.001988+0000","last_change":"2024-04-25T16:01:34.001988+0000","last_active":"2024-04-25T16:01:34.001988+0000","last_peered":"2024-04-25T16:01:34.001988+0000","last_clean":"2024-04-25T16:01:34.001988+0000","last_became_active":"2024-04-25T15:54:10.276230+0000","last_became_peered":"2024-04-25T15:54:10.276230+0000","last_unstale":"2024-04-25T16:01:34.001988+0000","last_undegraded":"2024-04-25T16:01:34.001988+0000","last_fullsized":"2024-04-25T16:01:34.001988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'425","last_scrub_stamp":"2024-04-25T16:01:34.001534+0000","last_deep_scrub":"36'425","last_deep_scrub_stamp":"2024-04-25T16:01:34.001534+0000","last_clean_scrub_stamp":"2024-04-25T16:01:34.001534+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:11.843444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22941,"num_write":404,"num_write_kb":72501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"31'377","reported_seq":449,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:45.608931+0000","last_change":"2024-04-25T16:01:45.608931+0000","last_active":"2024-04-25T16:01:45.608931+0000","last_peered":"2024-04-25T16:01:45.608931+0000","last_clean":"2024-04-25T16:01:45.608931+0000","last_became_active":"2024-04-25T15:54:20.409665+0000","last_became_peered":"2024-04-25T15:54:20.409665+0000","last_unstale":"2024-04-25T16:01:45.608931+0000","last_undegraded":"2024-04-25T16:01:45.608931+0000","last_fullsized":"2024-04-25T16:01:45.608931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'377","last_scrub_stamp":"2024-04-25T16:01:45.608622+0000","last_deep_scrub":"31'377","last_deep_scrub_stamp":"2024-04-25T16:01:45.608622+0000","last_clean_scrub_stamp":"2024-04-25T16:01:45.608622+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:35:54.731690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10994,"num_write":357,"num_write_kb":50723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'404","reported_seq":476,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.445222+0000","last_change":"2024-04-25T16:01:33.445295+0000","last_active":"2024-04-25T16:01:33.445222+0000","last_peered":"2024-04-25T16:01:33.445222+0000","last_clean":"2024-04-25T16:01:33.445222+0000","last_became_active":"2024-04-25T15:54:10.278004+0000","last_became_peered":"2024-04-25T15:54:10.278004+0000","last_unstale":"2024-04-25T16:01:33.445222+0000","last_undegraded":"2024-04-25T16:01:33.445222+0000","last_fullsized":"2024-04-25T16:01:33.445222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'404","last_scrub_stamp":"2024-04-25T16:01:33.444979+0000","last_deep_scrub":"36'404","last_deep_scrub_stamp":"2024-04-25T16:01:33.444979+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.444979+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:50.341345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":11471,"num_write":379,"num_write_kb":75857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"31'407","reported_seq":493,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:33.568398+0000","last_change":"2024-04-25T16:01:33.568398+0000","last_active":"2024-04-25T16:01:33.568398+0000","last_peered":"2024-04-25T16:01:33.568398+0000","last_clean":"2024-04-25T16:01:33.568398+0000","last_became_active":"2024-04-25T15:54:20.417521+0000","last_became_peered":"2024-04-25T15:54:20.417521+0000","last_unstale":"2024-04-25T16:01:33.568398+0000","last_undegraded":"2024-04-25T16:01:33.568398+0000","last_fullsized":"2024-04-25T16:01:33.568398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'407","last_scrub_stamp":"2024-04-25T16:01:33.568087+0000","last_deep_scrub":"31'407","last_deep_scrub_stamp":"2024-04-25T16:01:33.568087+0000","last_clean_scrub_stamp":"2024-04-25T16:01:33.568087+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:25.569777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":20101,"num_write":381,"num_write_kb":55469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"35'349","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.055408+0000","last_change":"2024-04-25T16:01:29.055479+0000","last_active":"2024-04-25T16:01:29.055408+0000","last_peered":"2024-04-25T16:01:29.055408+0000","last_clean":"2024-04-25T16:01:29.055408+0000","last_became_active":"2024-04-25T15:54:10.240648+0000","last_became_peered":"2024-04-25T15:54:10.240648+0000","last_unstale":"2024-04-25T16:01:29.055408+0000","last_undegraded":"2024-04-25T16:01:29.055408+0000","last_fullsized":"2024-04-25T16:01:29.055408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'349","last_scrub_stamp":"2024-04-25T16:01:29.055174+0000","last_deep_scrub":"35'349","last_deep_scrub_stamp":"2024-04-25T16:01:29.055174+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.055174+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:11.054464+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9293,"num_write":327,"num_write_kb":37967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"31'359","reported_seq":464,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:29.019195+0000","last_change":"2024-04-25T16:01:29.019195+0000","last_active":"2024-04-25T16:01:29.019195+0000","last_peered":"2024-04-25T16:01:29.019195+0000","last_clean":"2024-04-25T16:01:29.019195+0000","last_became_active":"2024-04-25T15:54:20.425074+0000","last_became_peered":"2024-04-25T15:54:20.425074+0000","last_unstale":"2024-04-25T16:01:29.019195+0000","last_undegraded":"2024-04-25T16:01:29.019195+0000","last_fullsized":"2024-04-25T16:01:29.019195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'359","last_scrub_stamp":"2024-04-25T16:01:29.018699+0000","last_deep_scrub":"31'359","last_deep_scrub_stamp":"2024-04-25T16:01:29.018699+0000","last_clean_scrub_stamp":"2024-04-25T16:01:29.018699+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:14.577607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":33728,"num_write":336,"num_write_kb":95963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"36'406","reported_seq":489,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:28.924537+0000","last_change":"2024-04-25T16:01:28.924607+0000","last_active":"2024-04-25T16:01:28.924537+0000","last_peered":"2024-04-25T16:01:28.924537+0000","last_clean":"2024-04-25T16:01:28.924537+0000","last_became_active":"2024-04-25T15:54:10.244563+0000","last_became_peered":"2024-04-25T15:54:10.244563+0000","last_unstale":"2024-04-25T16:01:28.924537+0000","last_undegraded":"2024-04-25T16:01:28.924537+0000","last_fullsized":"2024-04-25T16:01:28.924537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'406","last_scrub_stamp":"2024-04-25T16:01:28.924317+0000","last_deep_scrub":"36'406","last_deep_scrub_stamp":"2024-04-25T16:01:28.924317+0000","last_clean_scrub_stamp":"2024-04-25T16:01:28.924317+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:38.795476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":15261,"num_write":373,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"31'453","reported_seq":613,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:45.185333+0000","last_change":"2024-04-25T16:01:45.185333+0000","last_active":"2024-04-25T16:01:45.185333+0000","last_peered":"2024-04-25T16:01:45.185333+0000","last_clean":"2024-04-25T16:01:45.185333+0000","last_became_active":"2024-04-25T15:54:20.433456+0000","last_became_peered":"2024-04-25T15:54:20.433456+0000","last_unstale":"2024-04-25T16:01:45.185333+0000","last_undegraded":"2024-04-25T16:01:45.185333+0000","last_fullsized":"2024-04-25T16:01:45.185333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'453","last_scrub_stamp":"2024-04-25T16:01:45.185009+0000","last_deep_scrub":"31'453","last_deep_scrub_stamp":"2024-04-25T16:01:45.185009+0000","last_clean_scrub_stamp":"2024-04-25T16:01:45.185009+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:31.435230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":65459,"num_write":436,"num_write_kb":138981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"36'408","reported_seq":534,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T16:01:23.893788+0000","last_change":"2024-04-25T16:01:23.893862+0000","last_active":"2024-04-25T16:01:23.893788+0000","last_peered":"2024-04-25T16:01:23.893788+0000","last_clean":"2024-04-25T16:01:23.893788+0000","last_became_active":"2024-04-25T15:54:10.294794+0000","last_became_peered":"2024-04-25T15:54:10.294794+0000","last_unstale":"2024-04-25T16:01:23.893788+0000","last_undegraded":"2024-04-25T16:01:23.893788+0000","last_fullsized":"2024-04-25T16:01:23.893788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'408","last_scrub_stamp":"2024-04-25T16:01:23.893566+0000","last_deep_scrub":"36'408","last_deep_scrub_stamp":"2024-04-25T16:01:23.893566+0000","last_clean_scrub_stamp":"2024-04-25T16:01:23.893566+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:07.022197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":41811,"num_write":385,"num_write_kb":100198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2984,"num_read_kb":1496873,"num_write":24473,"num_write_kb":4464601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25921,"ondisk_log_size":25921,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":131985636,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":525,"num_read_kb":323765,"num_write":7010,"num_write_kb":134510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":264028160,"data_stored":263971272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8558,"ondisk_log_size":8558,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2716,"num_read_kb":1480093,"num_write":24434,"num_write_kb":4326556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25980,"ondisk_log_size":25980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":136622360,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":754,"num_read_kb":436547,"num_write":9520,"num_write_kb":140553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":273309696,"data_stored":273244720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11144,"ondisk_log_size":11144,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133788,"kb_used_data":66516,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94238052,"statfs":{"total":96636764160,"available":96499765248,"internally_reserved":0,"allocated":68112384,"data_stored":67887709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163488,"kb_used_data":78232,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94208352,"statfs":{"total":96636764160,"available":96469352448,"internally_reserved":0,"allocated":80109568,"data_stored":79880869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124800,"kb_used_data":43704,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94247040,"statfs":{"total":96636764160,"available":96508968960,"internally_reserved":0,"allocated":44752896,"data_stored":44525982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185596,"kb_used_data":91956,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94186244,"statfs":{"total":96636764160,"available":96446713856,"internally_reserved":0,"allocated":94162944,"data_stored":93928717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172076,"kb_used_data":96548,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94199764,"statfs":{"total":96636764160,"available":96460558336,"internally_reserved":0,"allocated":98865152,"data_stored":98627692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77330888},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75704,"kb_used_data":22320,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94296136,"statfs":{"total":96636764160,"available":96559243264,"internally_reserved":0,"allocated":22855680,"data_stored":22634176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173140,"kb_used_data":83724,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94198700,"statfs":{"total":96636764160,"available":96459468800,"internally_reserved":0,"allocated":85733376,"data_stored":85497868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131296,"kb_used_data":46040,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94240544,"statfs":{"total":96636764160,"available":96502317056,"internally_reserved":0,"allocated":47144960,"data_stored":46916155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30298112,"data_stored":30288669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9867264,"data_stored":9863389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35041280,"data_stored":35029885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26099712,"data_stored":26094295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46145536,"data_stored":46138016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50335744,"data_stored":50332230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":55021394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":63422464,"data_stored":63410002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":47611904,"data_stored":47603442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18251776,"data_stored":18243882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T16:02:03.976 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T16:02:04.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 Processor -- start 2024-04-25T16:02:04.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 -- start start 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9801529a0 0x7fe980071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9800ad990 0x7fe9800adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe980072430 con 0x7fe9800c41e0 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe980074730 con 0x7fe9800ad990 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe9852af640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe980074a10 con 0x7fe9801529a0 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9800ad990 0x7fe9800adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9800ad990 0x7fe9800adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44572/0 (socket says 172.21.15.87:44572) 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 -- 172.21.15.87:0/1597182271 learned_addr learned my addr 172.21.15.87:0/1597182271 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:04.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97effd640 1 --2- 172.21.15.87:0/1597182271 >> v2:172.21.15.155:3300/0 conn(0x7fe9801529a0 0x7fe980071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 -- 172.21.15.87:0/1597182271 >> v2:172.21.15.155:3300/0 conn(0x7fe9801529a0 msgr2=0x7fe980071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 --2- 172.21.15.87:0/1597182271 >> v2:172.21.15.155:3300/0 conn(0x7fe9801529a0 0x7fe980071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 -- 172.21.15.87:0/1597182271 >> v1:172.21.15.155:6789/0 conn(0x7fe9800c41e0 legacy=0x7fe9800c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97e7fc640 1 -- 172.21.15.87:0/1597182271 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe980074cf0 con 0x7fe9800ad990 2024-04-25T16:02:04.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.156+0000 7fe97effd640 1 --2- 172.21.15.87:0/1597182271 >> v2:172.21.15.155:3300/0 conn(0x7fe9801529a0 0x7fe980071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:02:04.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe97e7fc640 1 --2- 172.21.15.87:0/1597182271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800ad990 0x7fe9800adda0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ae520 tx=0x7fe97401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca15091aadc090ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe97dffb640 1 -- 172.21.15.87:0/1597182271 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740b0070 con 0x7fe9800ad990 2024-04-25T16:02:04.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe97dffb640 1 -- 172.21.15.87:0/1597182271 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9740ab600 con 0x7fe9800ad990 2024-04-25T16:02:04.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe97dffb640 1 -- 172.21.15.87:0/1597182271 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740ab9d0 con 0x7fe9800ad990 2024-04-25T16:02:04.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 -- 172.21.15.87:0/1597182271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800ad990 msgr2=0x7fe9800adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 --2- 172.21.15.87:0/1597182271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800ad990 0x7fe9800adda0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ae520 tx=0x7fe97401c490 comp rx=0 tx=0).stop 2024-04-25T16:02:04.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 -- 172.21.15.87:0/1597182271 shutdown_connections 2024-04-25T16:02:04.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 --2- 172.21.15.87:0/1597182271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800ad990 0x7fe9800adda0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 --2- 172.21.15.87:0/1597182271 >> v2:172.21.15.155:3300/0 conn(0x7fe9801529a0 0x7fe980071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 -- 172.21.15.87:0/1597182271 >> 172.21.15.87:0/1597182271 conn(0x7fe9800c8770 msgr2=0x7fe9800c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 -- 172.21.15.87:0/1597182271 shutdown_connections 2024-04-25T16:02:04.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.160+0000 7fe9852af640 1 -- 172.21.15.87:0/1597182271 wait complete. 2024-04-25T16:02:04.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 Processor -- start 2024-04-25T16:02:04.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 -- start start 2024-04-25T16:02:04.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9800c41e0 0x7fe980144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9801529a0 0x7fe9800c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 0x7fe9800c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe980162470 con 0x7fe9800c68e0 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9801622f0 con 0x7fe9800c41e0 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9801625f0 con 0x7fe9801529a0 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 0x7fe9800c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 0x7fe9800c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44578/0 (socket says 172.21.15.87:44578) 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 -- 172.21.15.87:0/2039074262 learned_addr learned my addr 172.21.15.87:0/2039074262 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97effd640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9800c41e0 0x7fe980144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97e7fc640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9801529a0 0x7fe9800c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 -- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9801529a0 msgr2=0x7fe9800c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9801529a0 0x7fe9800c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 -- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9800c41e0 msgr2=0x7fe980144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9800c41e0 0x7fe980144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 -- 172.21.15.87:0/2039074262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9800c28c0 con 0x7fe9800c68e0 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97e7fc640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9801529a0 0x7fe9800c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe97f7fe640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 0x7fe9800c7530 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c760 tx=0x7fe97800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978016020 con 0x7fe9800c68e0 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978006d60 con 0x7fe9800c68e0 2024-04-25T16:02:04.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978003bc0 con 0x7fe9800c68e0 2024-04-25T16:02:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe980144680 con 0x7fe9800c68e0 2024-04-25T16:02:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.164+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe980146e10 con 0x7fe9800c68e0 2024-04-25T16:02:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.168+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe980069bb0 con 0x7fe9800c68e0 2024-04-25T16:02:04.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.168+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe9780050d0 con 0x7fe9800c68e0 2024-04-25T16:02:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.168+0000 7fe9677fe640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96c06f400 0x7fe96c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.168+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fe97808f450 con 0x7fe9800c68e0 2024-04-25T16:02:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.168+0000 7fe97effd640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96c06f400 0x7fe96c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.168+0000 7fe97effd640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96c06f400 0x7fe96c071910 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe980073d40 tx=0x7fe970008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.172+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe978020020 con 0x7fe9800c68e0 2024-04-25T16:02:04.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.336+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe9800c3760 con 0x7fe9800c68e0 2024-04-25T16:02:04.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9677fe640 1 -- 172.21.15.87:0/2039074262 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fe97805bd20 con 0x7fe9800c68e0 2024-04-25T16:02:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96c06f400 msgr2=0x7fe96c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96c06f400 0x7fe96c071910 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe980073d40 tx=0x7fe970008040 comp rx=0 tx=0).stop 2024-04-25T16:02:04.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 msgr2=0x7fe9800c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 0x7fe9800c7530 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c760 tx=0x7fe97800cc20 comp rx=0 tx=0).stop 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 shutdown_connections 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fe96c06f400 0x7fe96c071910 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800c68e0 0x7fe9800c7530 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9801529a0 0x7fe9800c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 --2- 172.21.15.87:0/2039074262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9800c41e0 0x7fe980144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 >> 172.21.15.87:0/2039074262 conn(0x7fe9800c8770 msgr2=0x7fe9800c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 shutdown_connections 2024-04-25T16:02:04.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.344+0000 7fe9852af640 1 -- 172.21.15.87:0/2039074262 wait complete. 2024-04-25T16:02:04.368 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-04-25T16:02:04.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:04.518 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.516+0000 7fcec13af640 1 Processor -- start 2024-04-25T16:02:04.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.516+0000 7fcec13af640 1 -- start start 2024-04-25T16:02:04.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcec13af640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcebc1593b0 0x7fcebc152870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcec13af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcebc06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcec13af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcebc0ae8e0 con 0x7fcebc0a8cc0 2024-04-25T16:02:04.522 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcec13af640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcebc0aebc0 con 0x7fcebc1593b0 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcec13af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc158f20 con 0x7fcebc06c670 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcebaffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcebc0a8cc0 0x7fcebc155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44762/0 (socket says 172.21.15.87:44762) 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcebaffd640 1 -- 172.21.15.87:0/3214873537 learned_addr learned my addr 172.21.15.87:0/3214873537 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 --2- 172.21.15.87:0/3214873537 >> v2:172.21.15.155:3300/0 conn(0x7fcebc1593b0 0x7fcebc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcebb7fe640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcebc06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969421992 0 0) 0x7fcebc0ae8e0 con 0x7fcebc0a8cc0 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcea4003530 con 0x7fcebc0a8cc0 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3702164558 0 0) 0x7fcea4003530 con 0x7fcebc0a8cc0 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 msgr2=0x7fcebc06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcebc06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 >> v2:172.21.15.155:3300/0 conn(0x7fcebc1593b0 msgr2=0x7fcebc152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 --2- 172.21.15.87:0/3214873537 >> v2:172.21.15.155:3300/0 conn(0x7fcebc1593b0 0x7fcebc152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc1588d0 con 0x7fcebc0a8cc0 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fceb0001680 con 0x7fcebc0a8cc0 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 >> v1:172.21.15.87:6789/0 conn(0x7fcebc0a8cc0 legacy=0x7fcebc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcea40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea4003f40 0x7fcea4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4004d50 0x7fcea4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0aebc0 con 0x7fcea4003f40 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc158f20 con 0x7fcea4004d50 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcea400bad0 con 0x7fcebc06c670 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea4003f40 0x7fcea4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcebb7fe640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4004d50 0x7fcea4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcebaffd640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcea40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 -- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 msgr2=0x7fcea40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcea40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 -- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4004d50 msgr2=0x7fcea4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4004d50 0x7fcea4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fceba7fc640 1 -- 172.21.15.87:0/3214873537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea4003530 con 0x7fcea4003f40 2024-04-25T16:02:04.525 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.520+0000 7fcebaffd640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc06c670 0x7fcea40039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:04.526 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fceba7fc640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea4003f40 0x7fcea4004810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0c4280 tx=0x7fceac01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30d09f8ade2744e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0096b0 con 0x7fcea4003f40 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fceac0a6430 con 0x7fcea4003f40 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fceb9ffb640 1 -- 172.21.15.87:0/3214873537 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0a6840 con 0x7fcea4003f40 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 -- 172.21.15.87:0/3214873537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea4003f40 msgr2=0x7fcea4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 --2- 172.21.15.87:0/3214873537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea4003f40 0x7fcea4004810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0c4280 tx=0x7fceac01ca50 comp rx=0 tx=0).stop 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcebb7fe640 1 -- 172.21.15.87:0/3214873537 reap_dead start 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 -- 172.21.15.87:0/3214873537 shutdown_connections 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 -- 172.21.15.87:0/3214873537 >> 172.21.15.87:0/3214873537 conn(0x7fcebc06d780 msgr2=0x7fcebc06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 -- 172.21.15.87:0/3214873537 shutdown_connections 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 -- 172.21.15.87:0/3214873537 wait complete. 2024-04-25T16:02:04.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 Processor -- start 2024-04-25T16:02:04.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.524+0000 7fcec13af640 1 -- start start 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4003f40 0x7fcebc15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc1455c0 0x7fcebc1f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 0x7fcebc0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc1603d0 con 0x7fcebc1f2790 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0ac900 con 0x7fcea4003f40 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc160550 con 0x7fcebc1455c0 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 0x7fcebc0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 0x7fcebc0c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44604/0 (socket says 172.21.15.87:44604) 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 -- 172.21.15.87:0/727304345 learned_addr learned my addr 172.21.15.87:0/727304345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:04.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebaffd640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4003f40 0x7fcebc15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fceba7fc640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc1455c0 0x7fcebc1f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 -- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc1455c0 msgr2=0x7fcebc1f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc1455c0 0x7fcebc1f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 -- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4003f40 msgr2=0x7fcebc15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4003f40 0x7fcebc15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 -- 172.21.15.87:0/727304345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc15b690 con 0x7fcebc1f2790 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebaffd640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4003f40 0x7fcebc15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcebb7fe640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 0x7fcebc0c9580 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcebc06d700 tx=0x7fceb40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4011e40 con 0x7fcebc1f2790 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fceb401b070 con 0x7fcebc1f2790 2024-04-25T16:02:04.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb40039a0 con 0x7fcebc1f2790 2024-04-25T16:02:04.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcebc15c670 con 0x7fcebc1f2790 2024-04-25T16:02:04.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc15b930 con 0x7fcebc1f2790 2024-04-25T16:02:04.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcebc069bb0 con 0x7fcebc1f2790 2024-04-25T16:02:04.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.528+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fceb4003b40 con 0x7fcebc1f2790 2024-04-25T16:02:04.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.532+0000 7fcea37fe640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcea806f400 0x7fcea8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.532+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7fceb4090e80 con 0x7fcebc1f2790 2024-04-25T16:02:04.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.532+0000 7fcebaffd640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcea806f400 0x7fcea8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.532+0000 7fcebaffd640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcea806f400 0x7fcea8071910 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fceb0001870 tx=0x7fceb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.536+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fceb4008e50 con 0x7fcebc1f2790 2024-04-25T16:02:04.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.732+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcebc0ac310 con 0x7fcebc1f2790 2024-04-25T16:02:04.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.732+0000 7fcea37fe640 1 -- 172.21.15.87:0/727304345 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7fceb405d710 con 0x7fcebc1f2790 2024-04-25T16:02:04.733 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:04.734 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:04.734 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:02:04.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcea806f400 msgr2=0x7fcea8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcea806f400 0x7fcea8071910 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fceb0001870 tx=0x7fceb0009040 comp rx=0 tx=0).stop 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 msgr2=0x7fcebc0c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 0x7fcebc0c9580 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcebc06d700 tx=0x7fceb40115a0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 shutdown_connections 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fcea806f400 0x7fcea8071910 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcebc1f2790 0x7fcebc0c9580 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcebc1455c0 0x7fcebc1f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 --2- 172.21.15.87:0/727304345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea4003f40 0x7fcebc15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 >> 172.21.15.87:0/727304345 conn(0x7fcebc06d780 msgr2=0x7fcebc154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 shutdown_connections 2024-04-25T16:02:04.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.736+0000 7fcec13af640 1 -- 172.21.15.87:0/727304345 wait complete. 2024-04-25T16:02:04.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 Processor -- start 2024-04-25T16:02:04.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 -- start start 2024-04-25T16:02:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65000cb030 0x7f650015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 0x7f6500162650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65000c7570 con 0x7f650015ad90 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f650015b8b0 con 0x7f65000cb030 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f6506b12640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f650015b5d0 con 0x7f6500160230 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f65048ae640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f650015ad90 0x7f65000ca920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44778/0 (socket says 172.21.15.87:44778) 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f65048ae640 1 -- 172.21.15.87:0/1986618033 learned_addr learned my addr 172.21.15.87:0/1986618033 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64fffff640 1 --2- 172.21.15.87:0/1986618033 >> v2:172.21.15.155:3300/0 conn(0x7f65000cb030 0x7f650015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518281720 0 0) 0x7f65000c7570 con 0x7f650015ad90 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f65050af640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 0x7f6500162650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ec003530 con 0x7f650015ad90 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2804313665 0 0) 0x7f64ec003530 con 0x7f650015ad90 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 msgr2=0x7f6500162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 0x7f6500162650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 >> v2:172.21.15.155:3300/0 conn(0x7f65000cb030 msgr2=0x7f650015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 --2- 172.21.15.87:0/1986618033 >> v2:172.21.15.155:3300/0 conn(0x7f65000cb030 0x7f650015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65000c2290 con 0x7f650015ad90 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f64f8001a00 con 0x7f650015ad90 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 >> v1:172.21.15.87:6789/0 conn(0x7f650015ad90 legacy=0x7f65000ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 0x7f64ec0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec003f40 0x7f64ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64ec004d50 0x7f64ec005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f650015b8b0 con 0x7f64ec004d50 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f650015b5d0 con 0x7f64ec003f40 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec00bb60 con 0x7f6500160230 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f65050af640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64ec004d50 0x7f64ec005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.908+0000 7f64fffff640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec003f40 0x7f64ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65048ae640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 0x7f64ec0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 -- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 msgr2=0x7f64ec0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500160230 0x7f64ec0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 -- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec003f40 msgr2=0x7f64ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec003f40 0x7f64ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 -- 172.21.15.87:0/1986618033 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec003530 con 0x7f64ec004d50 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64ec004d50 0x7f64ec005160 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f65000c7490 tx=0x7f64f001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2538d93ada2841 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f00096b0 con 0x7f64ec004d50 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f64f00a8450 con 0x7f64ec004d50 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f64ff7fe640 1 -- 172.21.15.87:0/1986618033 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f00a8860 con 0x7f64ec004d50 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f6506b12640 1 -- 172.21.15.87:0/1986618033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64ec004d50 msgr2=0x7f64ec005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f6506b12640 1 --2- 172.21.15.87:0/1986618033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64ec004d50 0x7f64ec005160 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f65000c7490 tx=0x7f64f001ca10 comp rx=0 tx=0).stop 2024-04-25T16:02:04.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f65050af640 1 -- 172.21.15.87:0/1986618033 reap_dead start 2024-04-25T16:02:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f6506b12640 1 -- 172.21.15.87:0/1986618033 shutdown_connections 2024-04-25T16:02:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f6506b12640 1 -- 172.21.15.87:0/1986618033 >> 172.21.15.87:0/1986618033 conn(0x7f65000c9330 msgr2=0x7f65000c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f6506b12640 1 -- 172.21.15.87:0/1986618033 shutdown_connections 2024-04-25T16:02:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.912+0000 7f6506b12640 1 -- 172.21.15.87:0/1986618033 wait complete. 2024-04-25T16:02:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 Processor -- start 2024-04-25T16:02:04.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 -- start start 2024-04-25T16:02:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec004d50 0x7f65001f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 0x7f6500148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500148850 0x7f6500159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65000ca2e0 con 0x7f6500141e80 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65000ca160 con 0x7f64ec004d50 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f650015b1a0 con 0x7f6500148850 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 0x7f6500148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 0x7f6500148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44624/0 (socket says 172.21.15.87:44624) 2024-04-25T16:02:04.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 -- 172.21.15.87:0/3418299217 learned_addr learned my addr 172.21.15.87:0/3418299217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f65050af640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500148850 0x7f6500159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f65048ae640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec004d50 0x7f65001f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 -- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500148850 msgr2=0x7f6500159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500148850 0x7f6500159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 -- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec004d50 msgr2=0x7f65001f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec004d50 0x7f65001f0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 -- 172.21.15.87:0/3418299217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65001598e0 con 0x7f6500141e80 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fffff640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 0x7f6500148310 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f64e8011540 tx=0x7f64e8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8015870 con 0x7f6500141e80 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f64e8015a10 con 0x7f6500141e80 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65001f3d80 con 0x7f6500141e80 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8015e00 con 0x7f6500141e80 2024-04-25T16:02:04.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.916+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65001f0d20 con 0x7f6500141e80 2024-04-25T16:02:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.920+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65001f3b70 con 0x7f6500141e80 2024-04-25T16:02:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.920+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f64e800f460 con 0x7f6500141e80 2024-04-25T16:02:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.920+0000 7f64fd7fa640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f64e006f400 0x7f64e0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.920+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f64e8090260 con 0x7f6500141e80 2024-04-25T16:02:04.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.920+0000 7f65048ae640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f64e006f400 0x7f64e0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.920+0000 7f65048ae640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f64e006f400 0x7f64e0071910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f64f8001470 tx=0x7f64f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:04.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:04.924+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64e8019030 con 0x7f6500141e80 2024-04-25T16:02:05.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6500069bb0 con 0x7f6500141e80 2024-04-25T16:02:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f64fd7fa640 1 -- 172.21.15.87:0/3418299217 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7f64e805caa0 con 0x7f6500141e80 2024-04-25T16:02:05.112 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:05.112 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:02:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f64e006f400 msgr2=0x7f64e0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f64e006f400 0x7f64e0071910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f64f8001470 tx=0x7f64f8009040 comp rx=0 tx=0).stop 2024-04-25T16:02:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 msgr2=0x7f6500148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 0x7f6500148310 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f64e8011540 tx=0x7f64e8011a00 comp rx=0 tx=0).stop 2024-04-25T16:02:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 shutdown_connections 2024-04-25T16:02:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f64e006f400 0x7f64e0071910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6500148850 0x7f6500159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500141e80 0x7f6500148310 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 --2- 172.21.15.87:0/3418299217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64ec004d50 0x7f65001f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 >> 172.21.15.87:0/3418299217 conn(0x7f65000c9330 msgr2=0x7f65000c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 shutdown_connections 2024-04-25T16:02:05.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.112+0000 7f6506b12640 1 -- 172.21.15.87:0/3418299217 wait complete. 2024-04-25T16:02:05.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:02:05.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 Processor -- start 2024-04-25T16:02:05.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 -- start start 2024-04-25T16:02:05.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9cec0adda0 0x7f9cec0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec0c4e30 con 0x7f9cec0ad990 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9cec0ae1b0 con 0x7f9cec0adda0 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf2f1d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec072430 con 0x7f9cec1529a0 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9cec0adda0 0x7f9cec0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9cec0adda0 0x7f9cec0c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44634/0 (socket says 172.21.15.87:44634) 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 -- 172.21.15.87:0/3632395746 learned_addr learned my addr 172.21.15.87:0/3632395746 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf0cb9640 1 --2- 172.21.15.87:0/3632395746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 -- 172.21.15.87:0/3632395746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 msgr2=0x7f9cec071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 --2- 172.21.15.87:0/3632395746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 -- 172.21.15.87:0/3632395746 >> v1:172.21.15.155:6789/0 conn(0x7f9cec0ad990 legacy=0x7f9cec0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.280+0000 7f9cf14ba640 1 -- 172.21.15.87:0/3632395746 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec074730 con 0x7f9cec0adda0 2024-04-25T16:02:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf14ba640 1 --2- 172.21.15.87:0/3632395746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0adda0 0x7f9cec0c48f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009e50 tx=0x7f9ce401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d004d8749c2d950a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/3632395746 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40ac020 con 0x7f9cec0adda0 2024-04-25T16:02:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/3632395746 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ce40a6410 con 0x7f9cec0adda0 2024-04-25T16:02:05.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/3632395746 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40a6800 con 0x7f9cec0adda0 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/3632395746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0adda0 msgr2=0x7f9cec0c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/3632395746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0adda0 0x7f9cec0c48f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009e50 tx=0x7f9ce401c780 comp rx=0 tx=0).stop 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/3632395746 shutdown_connections 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/3632395746 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0adda0 0x7f9cec0c48f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/3632395746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/3632395746 >> 172.21.15.87:0/3632395746 conn(0x7f9cec0c8770 msgr2=0x7f9cec0c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/3632395746 shutdown_connections 2024-04-25T16:02:05.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/3632395746 wait complete. 2024-04-25T16:02:05.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 Processor -- start 2024-04-25T16:02:05.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.284+0000 7f9cf2f1d640 1 -- start start 2024-04-25T16:02:05.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 0x7f9cec1ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec0adda0 0x7f9cec1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec1622f0 con 0x7f9cec0ad990 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec0ab1a0 con 0x7f9cec0adda0 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec162470 con 0x7f9cec1529a0 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 0x7f9cec1ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 0x7f9cec1ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44642/0 (socket says 172.21.15.87:44642) 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 -- 172.21.15.87:0/2546558733 learned_addr learned my addr 172.21.15.87:0/2546558733 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf14ba640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec0adda0 0x7f9cec1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 -- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 msgr2=0x7f9cec154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 -- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec0adda0 msgr2=0x7f9cec1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec0adda0 0x7f9cec1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 -- 172.21.15.87:0/2546558733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec157df0 con 0x7f9cec0ad990 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf0cb9640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 0x7f9cec1ef350 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d600 tx=0x7f9cdc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc004240 con 0x7f9cec0ad990 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9cdc0043e0 con 0x7f9cec0ad990 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc003860 con 0x7f9cec0ad990 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec1f2810 con 0x7f9cec0ad990 2024-04-25T16:02:05.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec1eeb50 con 0x7f9cec0ad990 2024-04-25T16:02:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cec069bb0 con 0x7f9cec0ad990 2024-04-25T16:02:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.288+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9cdc003a00 con 0x7f9cec0ad990 2024-04-25T16:02:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.292+0000 7f9ce97fa640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9cd806f430 0x7f9cd8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.292+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f9cdc0907b0 con 0x7f9cec0ad990 2024-04-25T16:02:05.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.292+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9cd806f430 0x7f9cd8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.292+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9cd806f430 0x7f9cd8071940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0aabf0 tx=0x7f9ce0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.296+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9cdc05d040 con 0x7f9cec0ad990 2024-04-25T16:02:05.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:05.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.432+0000 7f2903ff6640 1 Processor -- start 2024-04-25T16:02:05.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.432+0000 7f2903ff6640 1 -- start start 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2903ff6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28fc158a00 0x7f28fc0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2903ff6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28fc0adfb0 0x7f28fc15fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2903ff6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28fc063660 con 0x7f28fc158e10 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2903ff6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc0c5470 con 0x7f28fc0adfb0 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2903ff6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc0ab670 con 0x7f28fc158a00 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2901591640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f28fc158e10 0x7f28fc152680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44786/0 (socket says 172.21.15.87:44786) 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2902593640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28fc0adfb0 0x7f28fc15fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2901591640 1 -- 172.21.15.87:0/1184108219 learned_addr learned my addr 172.21.15.87:0/1184108219 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2901d92640 1 --2- 172.21.15.87:0/1184108219 >> v2:172.21.15.155:3300/0 conn(0x7f28fc158a00 0x7f28fc0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2902593640 1 -- 172.21.15.87:0/1184108219 >> v2:172.21.15.155:3300/0 conn(0x7f28fc158a00 msgr2=0x7f28fc0ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2902593640 1 --2- 172.21.15.87:0/1184108219 >> v2:172.21.15.155:3300/0 conn(0x7f28fc158a00 0x7f28fc0ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2902593640 1 -- 172.21.15.87:0/1184108219 >> v1:172.21.15.87:6789/0 conn(0x7f28fc158e10 legacy=0x7f28fc152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.436+0000 7f2902593640 1 -- 172.21.15.87:0/1184108219 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc0ab930 con 0x7f28fc0adfb0 2024-04-25T16:02:05.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2902593640 1 --2- 172.21.15.87:0/1184108219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc0adfb0 0x7f28fc15fb60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0721b0 tx=0x7f28f401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dab3a20726eaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2900d90640 1 -- 172.21.15.87:0/1184108219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40b2070 con 0x7f28fc0adfb0 2024-04-25T16:02:05.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2900d90640 1 -- 172.21.15.87:0/1184108219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f28f40a5980 con 0x7f28fc0adfb0 2024-04-25T16:02:05.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2900d90640 1 -- 172.21.15.87:0/1184108219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40a5d70 con 0x7f28fc0adfb0 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 -- 172.21.15.87:0/1184108219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc0adfb0 msgr2=0x7f28fc15fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 --2- 172.21.15.87:0/1184108219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc0adfb0 0x7f28fc15fb60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0721b0 tx=0x7f28f401c900 comp rx=0 tx=0).stop 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 -- 172.21.15.87:0/1184108219 shutdown_connections 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 --2- 172.21.15.87:0/1184108219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc0adfb0 0x7f28fc15fb60 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 --2- 172.21.15.87:0/1184108219 >> v2:172.21.15.155:3300/0 conn(0x7f28fc158a00 0x7f28fc0ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 -- 172.21.15.87:0/1184108219 >> 172.21.15.87:0/1184108219 conn(0x7f28fc06d650 msgr2=0x7f28fc0c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 -- 172.21.15.87:0/1184108219 shutdown_connections 2024-04-25T16:02:05.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 -- 172.21.15.87:0/1184108219 wait complete. 2024-04-25T16:02:05.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 Processor -- start 2024-04-25T16:02:05.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.440+0000 7f2903ff6640 1 -- start start 2024-04-25T16:02:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28fc0adfb0 0x7f28fc14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28fc158a00 0x7f28fc1f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 0x7f28fc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0af0f0 con 0x7f28fc158e10 2024-04-25T16:02:05.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0aef70 con 0x7f28fc158a00 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0749b0 con 0x7f28fc0adfb0 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 0x7f28fc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 0x7f28fc1511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44664/0 (socket says 172.21.15.87:44664) 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 -- 172.21.15.87:0/75961132 learned_addr learned my addr 172.21.15.87:0/75961132 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2901591640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28fc158a00 0x7f28fc1f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2901d92640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28fc0adfb0 0x7f28fc14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 -- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28fc0adfb0 msgr2=0x7f28fc14a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28fc0adfb0 0x7f28fc14a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 -- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28fc158a00 msgr2=0x7f28fc1f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28fc158a00 0x7f28fc1f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 -- 172.21.15.87:0/75961132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc141590 con 0x7f28fc158e10 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2901591640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28fc158a00 0x7f28fc1f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:05.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2902593640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 0x7f28fc1511f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f28f40b0040 tx=0x7f28f40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40b2050 con 0x7f28fc158e10 2024-04-25T16:02:05.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f28f40be070 con 0x7f28fc158e10 2024-04-25T16:02:05.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40adb90 con 0x7f28fc158e10 2024-04-25T16:02:05.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc1f23a0 con 0x7f28fc158e10 2024-04-25T16:02:05.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc149e60 con 0x7f28fc158e10 2024-04-25T16:02:05.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc069bb0 con 0x7f28fc158e10 2024-04-25T16:02:05.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f28f40c3460 con 0x7f28fc158e10 2024-04-25T16:02:05.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f28f27fc640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f28e006f400 0x7f28e0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f28f412b8c0 con 0x7f28fc158e10 2024-04-25T16:02:05.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.444+0000 7f2901d92640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f28e006f400 0x7f28e0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.448+0000 7f2901d92640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f28e006f400 0x7f28e0071910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0096f0 tx=0x7f28ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.456+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28f4016520 con 0x7f28fc158e10 2024-04-25T16:02:05.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.468+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cec0c3760 con 0x7f9cec0ad990 2024-04-25T16:02:05.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.468+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2546558733 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21989 (secure 0 0 0) 0x7f9cdc05c940 con 0x7f9cec0ad990 2024-04-25T16:02:05.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:05.470 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:00:43.549189+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-25T15:54:07.592284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-25T15:54:08.577402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9cd806f430 msgr2=0x7f9cd8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9cd806f430 0x7f9cd8071940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0aabf0 tx=0x7f9ce0008040 comp rx=0 tx=0).stop 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 msgr2=0x7f9cec1ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 0x7f9cec1ef350 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00d600 tx=0x7f9cdc00dac0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 shutdown_connections 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9cd806f430 0x7f9cd8071940 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec1529a0 0x7f9cec154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec0adda0 0x7f9cec1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 --2- 172.21.15.87:0/2546558733 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0ad990 0x7f9cec1ef350 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 >> 172.21.15.87:0/2546558733 conn(0x7f9cec0c8770 msgr2=0x7f9cec150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 shutdown_connections 2024-04-25T16:02:05.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.472+0000 7f9cf2f1d640 1 -- 172.21.15.87:0/2546558733 wait complete. 2024-04-25T16:02:05.492 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-04-25T16:02:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 Processor -- start 2024-04-25T16:02:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 -- start start 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dd8152870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8dd806c670 0x7f8dd806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd80ae8e0 con 0x7f8dd80a8cc0 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd80aebc0 con 0x7f8dd806c670 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8ddcb00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd8158f20 con 0x7f8dd81593b0 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd659c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8dd80a8cc0 0x7f8dd8155240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44802/0 (socket says 172.21.15.87:44802) 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd659c640 1 -- 172.21.15.87:0/2012465185 learned_addr learned my addr 172.21.15.87:0/2012465185 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd6d9d640 1 --2- 172.21.15.87:0/2012465185 >> v2:172.21.15.155:3300/0 conn(0x7f8dd806c670 0x7f8dd806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd5d9b640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dd8152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069856529 0 0) 0x7f8dd80ae8e0 con 0x7f8dd80a8cc0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc4003530 con 0x7f8dd80a8cc0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1897669979 0 0) 0x7f8dc4003530 con 0x7f8dd80a8cc0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 msgr2=0x7f8dd8152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dd8152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 >> v2:172.21.15.155:3300/0 conn(0x7f8dd806c670 msgr2=0x7f8dd806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 --2- 172.21.15.87:0/2012465185 >> v2:172.21.15.155:3300/0 conn(0x7f8dd806c670 0x7f8dd806ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd81588d0 con 0x7f8dd80a8cc0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f8dc0001680 con 0x7f8dd80a8cc0 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 >> v1:172.21.15.87:6789/0 conn(0x7f8dd80a8cc0 legacy=0x7f8dd8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40039c0 0x7f8dc4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc4004810 0x7f8dc4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.624+0000 7f8dd559a640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dc4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd80aebc0 con 0x7f8dc40039c0 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd8158f20 con 0x7f8dc4004810 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc400ba80 con 0x7f8dd81593b0 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40039c0 0x7f8dc4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd6d9d640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dc4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd5d9b640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc4004810 0x7f8dc4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 -- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 msgr2=0x7f8dc4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dc4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 -- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc4004810 msgr2=0x7f8dc4004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dc4004810 0x7f8dc4004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 -- 172.21.15.87:0/2012465185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4003530 con 0x7f8dc40039c0 2024-04-25T16:02:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd6d9d640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dd81593b0 0x7f8dc4005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd659c640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40039c0 0x7f8dc4003e30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c210 tx=0x7f8dc001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecf892abb312649 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0007d60 con 0x7f8dc40039c0 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8dc00a9020 con 0x7f8dc40039c0 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd559a640 1 -- 172.21.15.87:0/2012465185 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0005b40 con 0x7f8dc40039c0 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8ddcb00640 1 -- 172.21.15.87:0/2012465185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40039c0 msgr2=0x7f8dc4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/2012465185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc40039c0 0x7f8dc4003e30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c210 tx=0x7f8dc001cca0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8dd6d9d640 1 -- 172.21.15.87:0/2012465185 reap_dead start 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8ddcb00640 1 -- 172.21.15.87:0/2012465185 shutdown_connections 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8ddcb00640 1 -- 172.21.15.87:0/2012465185 >> 172.21.15.87:0/2012465185 conn(0x7f8dd806d780 msgr2=0x7f8dd806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8ddcb00640 1 -- 172.21.15.87:0/2012465185 shutdown_connections 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.628+0000 7f8ddcb00640 1 -- 172.21.15.87:0/2012465185 wait complete. 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 Processor -- start 2024-04-25T16:02:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 -- start start 2024-04-25T16:02:05.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40039c0 0x7f8dd8152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dd80c3ae0 0x7f8dd81ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 0x7f8dd814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd8160550 con 0x7f8dd814db00 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd81603d0 con 0x7f8dd80c3ae0 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd81606d0 con 0x7f8dc40039c0 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 0x7f8dd814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 0x7f8dd814ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44684/0 (socket says 172.21.15.87:44684) 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 -- 172.21.15.87:0/4213704217 learned_addr learned my addr 172.21.15.87:0/4213704217 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd5d9b640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dd80c3ae0 0x7f8dd81ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd659c640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40039c0 0x7f8dd8152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 -- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40039c0 msgr2=0x7f8dd8152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40039c0 0x7f8dd8152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 -- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dd80c3ae0 msgr2=0x7f8dd81ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dd80c3ae0 0x7f8dd81ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 -- 172.21.15.87:0/4213704217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd80c9210 con 0x7f8dd814db00 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dd6d9d640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 0x7f8dd814ce20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8dd806d700 tx=0x7f8dd000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd001c070 con 0x7f8dd814db00 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8dd0017400 con 0x7f8dd814db00 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd81f1b60 con 0x7f8dd814db00 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00177f0 con 0x7f8dd814db00 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.632+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd81f2120 con 0x7f8dd814db00 2024-04-25T16:02:05.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.636+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd80c8f80 con 0x7f8dd814db00 2024-04-25T16:02:05.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.636+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8dd001f070 con 0x7f8dd814db00 2024-04-25T16:02:05.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.636+0000 7f8dceffd640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8db806f430 0x7f8db8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.636+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7555+0+0 (secure 0 0 0) 0x7f8dd00900a0 con 0x7f8dd814db00 2024-04-25T16:02:05.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.636+0000 7f8dd659c640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8db806f430 0x7f8db8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.636+0000 7f8dd659c640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8db806f430 0x7f8db8071940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c210 tx=0x7f8dc0000ff0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.640+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8dd0012070 con 0x7f8dd814db00 2024-04-25T16:02:05.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28fc152210 con 0x7f28fc158e10 2024-04-25T16:02:05.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f28f27fc640 1 -- 172.21.15.87:0/75961132 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+6495 (secure 0 0 0) 0x7f28f40f8150 con 0x7f28fc158e10 2024-04-25T16:02:05.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:05.644 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:09.584331+0000","modified":"2024-04-25T16:00:52.589309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6837/1282402609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1282402609},{"type":"v1","addr":"172.21.15.87:6837","nonce":1282402609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":1},{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:05.645 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 69 2024-04-25T16:02:05.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f28e006f400 msgr2=0x7f28e0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f28e006f400 0x7f28e0071910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0096f0 tx=0x7f28ec008040 comp rx=0 tx=0).stop 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 msgr2=0x7f28fc1511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 0x7f28fc1511f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f28f40b0040 tx=0x7f28f40196a0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 shutdown_connections 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f28e006f400 0x7f28e0071910 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28fc158e10 0x7f28fc1511f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28fc158a00 0x7f28fc1f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 --2- 172.21.15.87:0/75961132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28fc0adfb0 0x7f28fc14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 >> 172.21.15.87:0/75961132 conn(0x7f28fc06d650 msgr2=0x7f28fc157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 shutdown_connections 2024-04-25T16:02:05.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.644+0000 7f2903ff6640 1 -- 172.21.15.87:0/75961132 wait complete. 2024-04-25T16:02:05.665 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-25T16:02:05.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.824+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7f8dd8069bb0 con 0x7f8dd814db00 2024-04-25T16:02:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8dceffd640 1 -- 172.21.15.87:0/4213704217 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 151+0+0 (secure 0 0 0) 0x7f8dd005c370 con 0x7f8dd814db00 2024-04-25T16:02:05.827 INFO:teuthology.orchestra.run.smithi087.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T16:02:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8db806f430 msgr2=0x7f8db8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8db806f430 0x7f8db8071940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c210 tx=0x7f8dc0000ff0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 msgr2=0x7f8dd814ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 0x7f8dd814ce20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8dd806d700 tx=0x7f8dd000f4a0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 shutdown_connections 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f8db806f430 0x7f8db8071940 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dd814db00 0x7f8dd814ce20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dd80c3ae0 0x7f8dd81ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 --2- 172.21.15.87:0/4213704217 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dc40039c0 0x7f8dd8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 >> 172.21.15.87:0/4213704217 conn(0x7f8dd806d780 msgr2=0x7f8dd80c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 shutdown_connections 2024-04-25T16:02:05.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.828+0000 7f8ddcb00640 1 -- 172.21.15.87:0/4213704217 wait complete. 2024-04-25T16:02:05.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-04-25T16:02:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.980+0000 7f3693387640 1 Processor -- start 2024-04-25T16:02:05.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.980+0000 7f3693387640 1 -- start start 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3693387640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f368c155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3693387640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f368c074160 0x7f368c074570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3693387640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f368c152d90 con 0x7f368c152980 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3693387640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f368c0aa290 con 0x7f368c074160 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3693387640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f368c1598b0 con 0x7f368c155320 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3691123640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f368c152980 0x7f368c0c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44812/0 (socket says 172.21.15.87:44812) 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3691123640 1 -- 172.21.15.87:0/3281174694 learned_addr learned my addr 172.21.15.87:0/3281174694 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437619615 0 0) 0x7f368c152d90 con 0x7f368c152980 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3691924640 1 --2- 172.21.15.87:0/3281174694 >> v2:172.21.15.155:3300/0 conn(0x7f368c074160 0x7f368c074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3678003530 con 0x7f368c152980 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f368c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3060564177 0 0) 0x7f3678003530 con 0x7f368c152980 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 msgr2=0x7f368c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f368c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 >> v2:172.21.15.155:3300/0 conn(0x7f368c074160 msgr2=0x7f368c074570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 --2- 172.21.15.87:0/3281174694 >> v2:172.21.15.155:3300/0 conn(0x7f368c074160 0x7f368c074570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c0a9cd0 con 0x7f368c152980 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7f3688001680 con 0x7f368c152980 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 >> v1:172.21.15.87:6789/0 conn(0x7f368c152980 legacy=0x7f368c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36780039c0 0x7f3678003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3678004810 0x7f3678004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f3678005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f368c0aa290 con 0x7f3678004810 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f368c1598b0 con 0x7f36780039c0 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f367800bb50 con 0x7f368c155320 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3678004810 0x7f3678004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3691924640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f3678005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 -- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 msgr2=0x7f3678005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f3678005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 -- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36780039c0 msgr2=0x7f3678003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36780039c0 0x7f3678003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 -- 172.21.15.87:0/3281174694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3678003530 con 0x7f3678004810 2024-04-25T16:02:05.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3691924640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c155320 0x7f3678005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:05.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3690922640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3678004810 0x7f3678004c20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f367c00ba30 tx=0x7f367c01c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323f0b62c90daa75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c0b3070 con 0x7f3678004810 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f367c0a8030 con 0x7f3678004810 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.984+0000 7f3683fff640 1 -- 172.21.15.87:0/3281174694 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c00b600 con 0x7f3678004810 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- 172.21.15.87:0/3281174694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3678004810 msgr2=0x7f3678004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 --2- 172.21.15.87:0/3281174694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3678004810 0x7f3678004c20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f367c00ba30 tx=0x7f367c01c6c0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3691924640 1 -- 172.21.15.87:0/3281174694 reap_dead start 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- 172.21.15.87:0/3281174694 shutdown_connections 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- 172.21.15.87:0/3281174694 >> 172.21.15.87:0/3281174694 conn(0x7f368c0ac550 msgr2=0x7f368c0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- 172.21.15.87:0/3281174694 shutdown_connections 2024-04-25T16:02:05.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- 172.21.15.87:0/3281174694 wait complete. 2024-04-25T16:02:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 Processor -- start 2024-04-25T16:02:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- start start 2024-04-25T16:02:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3678004810 0x7f368c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 0x7f368c1f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c1f2550 0x7f368c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f368c0729c0 con 0x7f368c150510 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f368c158f70 con 0x7f3678004810 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3693387640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f368c072b40 con 0x7f368c1f2550 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 0x7f368c1f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 0x7f368c1f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44714/0 (socket says 172.21.15.87:44714) 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 -- 172.21.15.87:0/265354298 learned_addr learned my addr 172.21.15.87:0/265354298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 -- 172.21.15.87:0/265354298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c1f2550 msgr2=0x7f368c140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c1f2550 0x7f368c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 -- 172.21.15.87:0/265354298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3678004810 msgr2=0x7f368c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3678004810 0x7f368c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.988+0000 7f3690922640 1 -- 172.21.15.87:0/265354298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c14b170 con 0x7f368c150510 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3690922640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 0x7f368c1f2010 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f367c006b20 tx=0x7f3678005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c0b3040 con 0x7f368c150510 2024-04-25T16:02:05.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f367c0aecd0 con 0x7f368c150510 2024-04-25T16:02:05.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c004280 con 0x7f368c150510 2024-04-25T16:02:05.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c1419f0 con 0x7f368c150510 2024-04-25T16:02:05.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c0aa4c0 con 0x7f368c150510 2024-04-25T16:02:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c069bb0 con 0x7f368c150510 2024-04-25T16:02:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f367c0c1060 con 0x7f368c150510 2024-04-25T16:02:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3681ffb640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f367006f400 0x7f3670071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3691123640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f367006f400 0x7f3670071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7641+0+0 (secure 0 0 0) 0x7f367c1297c0 con 0x7f368c150510 2024-04-25T16:02:05.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.992+0000 7f3691123640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f367006f400 0x7f3670071910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f36880079c0 tx=0x7f36880015d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:05.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:05.996+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f367c0163d0 con 0x7f368c150510 2024-04-25T16:02:06.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.176+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7f368c0c9b90 con 0x7f368c150510 2024-04-25T16:02:06.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.828+0000 7f3681ffb640 1 -- 172.21.15.87:0/265354298 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v71) ==== 99+0+0 (secure 0 0 0) 0x7f367c0f5f20 con 0x7f368c150510 2024-04-25T16:02:06.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f367006f400 msgr2=0x7f3670071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:06.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f367006f400 0x7f3670071910 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f36880079c0 tx=0x7f36880015d0 comp rx=0 tx=0).stop 2024-04-25T16:02:06.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 msgr2=0x7f368c1f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:06.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 0x7f368c1f2010 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f367c006b20 tx=0x7f3678005840 comp rx=0 tx=0).stop 2024-04-25T16:02:06.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 shutdown_connections 2024-04-25T16:02:06.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f367006f400 0x7f3670071910 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:06.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f368c1f2550 0x7f368c140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:06.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f368c150510 0x7f368c1f2010 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:06.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 --2- 172.21.15.87:0/265354298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3678004810 0x7f368c0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:06.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 >> 172.21.15.87:0/265354298 conn(0x7f368c0ac550 msgr2=0x7f368c15f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:06.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 shutdown_connections 2024-04-25T16:02:06.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:06.832+0000 7f3693387640 1 -- 172.21.15.87:0/265354298 wait complete. 2024-04-25T16:02:06.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-04-25T16:02:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.008+0000 7f24d5f98640 1 Processor -- start 2024-04-25T16:02:07.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.008+0000 7f24d5f98640 1 -- start start 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24d01529a0 0x7f24d0071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24d00adda0 0x7f24d00c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d00c4e30 con 0x7f24d00ad990 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f24d00ae1b0 con 0x7f24d01529a0 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f24d0072430 con 0x7f24d00adda0 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24d01529a0 0x7f24d0071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24d01529a0 0x7f24d0071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44722/0 (socket says 172.21.15.87:44722) 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 -- 172.21.15.87:0/3653767957 learned_addr learned my addr 172.21.15.87:0/3653767957 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cffff640 1 --2- 172.21.15.87:0/3653767957 >> v2:172.21.15.155:3300/0 conn(0x7f24d00adda0 0x7f24d00c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 -- 172.21.15.87:0/3653767957 >> v2:172.21.15.155:3300/0 conn(0x7f24d00adda0 msgr2=0x7f24d00c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:07.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 --2- 172.21.15.87:0/3653767957 >> v2:172.21.15.155:3300/0 conn(0x7f24d00adda0 0x7f24d00c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 -- 172.21.15.87:0/3653767957 >> v1:172.21.15.155:6789/0 conn(0x7f24d00ad990 legacy=0x7f24d00c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:07.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 -- 172.21.15.87:0/3653767957 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d0074730 con 0x7f24d01529a0 2024-04-25T16:02:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24cf7fe640 1 --2- 172.21.15.87:0/3653767957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d01529a0 0x7f24d0071e50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f24d00ae750 tx=0x7f24c001c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b23c20dc4afbd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24ce7fc640 1 -- 172.21.15.87:0/3653767957 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c00b0070 con 0x7f24d01529a0 2024-04-25T16:02:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24ce7fc640 1 -- 172.21.15.87:0/3653767957 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f24c00ab600 con 0x7f24d01529a0 2024-04-25T16:02:07.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24ce7fc640 1 -- 172.21.15.87:0/3653767957 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c00ab9f0 con 0x7f24d01529a0 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 -- 172.21.15.87:0/3653767957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d01529a0 msgr2=0x7f24d0071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.012+0000 7f24d5f98640 1 --2- 172.21.15.87:0/3653767957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d01529a0 0x7f24d0071e50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f24d00ae750 tx=0x7f24c001c270 comp rx=0 tx=0).stop 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- 172.21.15.87:0/3653767957 shutdown_connections 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 --2- 172.21.15.87:0/3653767957 >> v2:172.21.15.155:3300/0 conn(0x7f24d00adda0 0x7f24d00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 --2- 172.21.15.87:0/3653767957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d01529a0 0x7f24d0071e50 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- 172.21.15.87:0/3653767957 >> 172.21.15.87:0/3653767957 conn(0x7f24d00c8770 msgr2=0x7f24d00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- 172.21.15.87:0/3653767957 shutdown_connections 2024-04-25T16:02:07.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- 172.21.15.87:0/3653767957 wait complete. 2024-04-25T16:02:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 Processor -- start 2024-04-25T16:02:07.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- start start 2024-04-25T16:02:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 0x7f24d0144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00adda0 0x7f24d0151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d01529a0 0x7f24d01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01622f0 con 0x7f24d00ad990 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24d00ab1a0 con 0x7f24d01529a0 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24d5f98640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24d0162470 con 0x7f24d00adda0 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 0x7f24d0144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 0x7f24d0144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44726/0 (socket says 172.21.15.87:44726) 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 -- 172.21.15.87:0/612436914 learned_addr learned my addr 172.21.15.87:0/612436914 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 -- 172.21.15.87:0/612436914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00adda0 msgr2=0x7f24d0151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00adda0 0x7f24d0151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 -- 172.21.15.87:0/612436914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d01529a0 msgr2=0x7f24d01504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d01529a0 0x7f24d01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.016+0000 7f24cf7fe640 1 -- 172.21.15.87:0/612436914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d00c82e0 con 0x7f24d00ad990 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24cf7fe640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 0x7f24d0144bd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f24c0000c10 tx=0x7f24c0019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c00b8020 con 0x7f24d00ad990 2024-04-25T16:02:07.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f24c00b4610 con 0x7f24d00ad990 2024-04-25T16:02:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d00c8040 con 0x7f24d00ad990 2024-04-25T16:02:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c00b0040 con 0x7f24d00ad990 2024-04-25T16:02:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d0150a30 con 0x7f24d00ad990 2024-04-25T16:02:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d0069bb0 con 0x7f24d00ad990 2024-04-25T16:02:07.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f24c00bb020 con 0x7f24d00ad990 2024-04-25T16:02:07.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24b7fff640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f24bc06f400 0x7f24bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7641+0+0 (secure 0 0 0) 0x7f24c0129690 con 0x7f24d00ad990 2024-04-25T16:02:07.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24ceffd640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f24bc06f400 0x7f24bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.020+0000 7f24ceffd640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f24bc06f400 0x7f24bc071910 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f24d014af10 tx=0x7f24c4006bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:07.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.028+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24c00c2030 con 0x7f24d00ad990 2024-04-25T16:02:07.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.176+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f24d00c3760 con 0x7f24d00ad990 2024-04-25T16:02:07.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:07.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.824+0000 7f50c6062640 1 Processor -- start 2024-04-25T16:02:07.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.824+0000 7f50c6062640 1 -- start start 2024-04-25T16:02:07.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50c6062640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50c01518b0 0x7f50c006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50c6062640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c0154fc0 con 0x7f50c00ad160 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50c6062640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c00acb20 con 0x7f50c006fa10 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50c6062640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f50c006ed60 con 0x7f50c01518b0 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50bf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50c01518b0 0x7f50c006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50beffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f50c00ad160 0x7f50c00c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44822/0 (socket says 172.21.15.87:44822) 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50bf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50c01518b0 0x7f50c006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44740/0 (socket says 172.21.15.87:44740) 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50beffd640 1 -- 172.21.15.87:0/3048273153 learned_addr learned my addr 172.21.15.87:0/3048273153 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50bf7fe640 1 -- 172.21.15.87:0/3048273153 >> v1:172.21.15.155:6789/0 conn(0x7f50c006fa10 legacy=0x7f50c015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50bf7fe640 1 -- 172.21.15.87:0/3048273153 >> v1:172.21.15.87:6789/0 conn(0x7f50c00ad160 legacy=0x7f50c00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50be7fc640 1 -- 172.21.15.87:0/3048273153 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020397888 0 0) 0x7f50c0154fc0 con 0x7f50c00ad160 2024-04-25T16:02:07.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.828+0000 7f50bf7fe640 1 -- 172.21.15.87:0/3048273153 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c00ace00 con 0x7f50c01518b0 2024-04-25T16:02:07.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50bf7fe640 1 --2- 172.21.15.87:0/3048273153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 0x7f50c006f4d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f50c006eee0 tx=0x7f50b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfc6d47ace5ebcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50be7fc640 1 -- 172.21.15.87:0/3048273153 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b1070 con 0x7f50c01518b0 2024-04-25T16:02:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50be7fc640 1 -- 172.21.15.87:0/3048273153 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f50b00ac5f0 con 0x7f50c01518b0 2024-04-25T16:02:07.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50be7fc640 1 -- 172.21.15.87:0/3048273153 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00ac9e0 con 0x7f50c01518b0 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 -- 172.21.15.87:0/3048273153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 msgr2=0x7f50c006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 --2- 172.21.15.87:0/3048273153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 0x7f50c006f4d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f50c006eee0 tx=0x7f50b001c460 comp rx=0 tx=0).stop 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 -- 172.21.15.87:0/3048273153 shutdown_connections 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 --2- 172.21.15.87:0/3048273153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 0x7f50c006f4d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 -- 172.21.15.87:0/3048273153 >> 172.21.15.87:0/3048273153 conn(0x7f50c00c8770 msgr2=0x7f50c00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 -- 172.21.15.87:0/3048273153 shutdown_connections 2024-04-25T16:02:07.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.832+0000 7f50c6062640 1 -- 172.21.15.87:0/3048273153 wait complete. 2024-04-25T16:02:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 Processor -- start 2024-04-25T16:02:07.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 -- start start 2024-04-25T16:02:07.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f24b7fff640 1 -- 172.21.15.87:0/612436914 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v38) ==== 166+0+0 (secure 0 0 0) 0x7f24c00fce20 con 0x7f24d00ad990 2024-04-25T16:02:07.837 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'a_metadata' removed 2024-04-25T16:02:07.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 0x7f50c01510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00ad160 0x7f50c014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 0x7f50c0157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50c01628f0 con 0x7f50c01518b0 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0162a70 con 0x7f50c00ad160 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50c6062640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50c0162bf0 con 0x7f50c006fa10 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 0x7f50c01510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 0x7f50c01510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.87:50560/0 (socket says 172.21.15.87:50560) 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 -- 172.21.15.87:0/4007617323 learned_addr learned my addr 172.21.15.87:0/4007617323 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:07.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 -- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00ad160 msgr2=0x7f50c014dd30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T16:02:07.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00ad160 0x7f50c014dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 -- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 msgr2=0x7f50c0157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 0x7f50c0157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.836+0000 7f50bf7fe640 1 -- 172.21.15.87:0/4007617323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c0150970 con 0x7f50c006fa10 2024-04-25T16:02:07.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f50bf7fe640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 0x7f50c01510c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50b00af040 tx=0x7f50b0019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f24bc06f400 msgr2=0x7f24bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f24bc06f400 0x7f24bc071910 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f24d014af10 tx=0x7f24c4006bd0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 msgr2=0x7f24d0144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 0x7f24d0144bd0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f24c0000c10 tx=0x7f24c0019010 comp rx=0 tx=0).stop 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 shutdown_connections 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f24bc06f400 0x7f24bc071910 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d01529a0 0x7f24d01504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00adda0 0x7f24d0151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 --2- 172.21.15.87:0/612436914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24d00ad990 0x7f24d0144bd0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 >> 172.21.15.87:0/612436914 conn(0x7f24d00c8770 msgr2=0x7f24d006f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 shutdown_connections 2024-04-25T16:02:07.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.840+0000 7f24d5f98640 1 -- 172.21.15.87:0/612436914 wait complete. 2024-04-25T16:02:07.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.848+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b1040 con 0x7f50c006fa10 2024-04-25T16:02:07.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.848+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f50b00bc070 con 0x7f50c006fa10 2024-04-25T16:02:07.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.848+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b5610 con 0x7f50c006fa10 2024-04-25T16:02:07.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.848+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c014e270 con 0x7f50c006fa10 2024-04-25T16:02:07.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.848+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c014cdf0 con 0x7f50c006fa10 2024-04-25T16:02:07.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.848+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c0069bb0 con 0x7f50c006fa10 2024-04-25T16:02:07.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.860+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50b00b57b0 con 0x7f50c006fa10 2024-04-25T16:02:07.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.860+0000 7f50b7fff640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50a006f400 0x7f50a0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:07.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.860+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 7213+0+0 (secure 0 0 0) 0x7f50b0129be0 con 0x7f50c006fa10 2024-04-25T16:02:07.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.860+0000 7f50beffd640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50a006f400 0x7f50a0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:07.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.860+0000 7f50beffd640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50a006f400 0x7f50a0071910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f50c00c5c40 tx=0x7f50a8007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:07.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-04-25T16:02:07.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:07.884+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50b00c6020 con 0x7f50c006fa10 2024-04-25T16:02:08.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 Processor -- start 2024-04-25T16:02:08.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 -- start start 2024-04-25T16:02:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f985c1517d0 0x7f985c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f985c157fc0 0x7f985c15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985c0c5290 con 0x7f985c0c9ae0 2024-04-25T16:02:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f985c0c5e80 con 0x7f985c1517d0 2024-04-25T16:02:08.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9861748640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f985c154fd0 con 0x7f985c157fc0 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f985c1517d0 0x7f985c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985a7fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f985c0c9ae0 0x7f985c1578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44826/0 (socket says 172.21.15.87:44826) 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985a7fc640 1 -- 172.21.15.87:0/3675741313 learned_addr learned my addr 172.21.15.87:0/3675741313 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985affd640 1 -- 172.21.15.87:0/3675741313 >> v2:172.21.15.155:3300/0 conn(0x7f985c157fc0 msgr2=0x7f985c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985b7fe640 1 --2- 172.21.15.87:0/3675741313 >> v2:172.21.15.155:3300/0 conn(0x7f985c157fc0 0x7f985c15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f9859ffb640 1 -- 172.21.15.87:0/3675741313 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173900084 0 0) 0x7f985c0c5290 con 0x7f985c0c9ae0 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985affd640 1 --2- 172.21.15.87:0/3675741313 >> v2:172.21.15.155:3300/0 conn(0x7f985c157fc0 0x7f985c15ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985affd640 1 -- 172.21.15.87:0/3675741313 >> v1:172.21.15.87:6789/0 conn(0x7f985c0c9ae0 legacy=0x7f985c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.012+0000 7f985affd640 1 -- 172.21.15.87:0/3675741313 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c0c5550 con 0x7f985c1517d0 2024-04-25T16:02:08.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f985affd640 1 --2- 172.21.15.87:0/3675741313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1517d0 0x7f985c0c95a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f985c072d80 tx=0x7f984401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edf5756b6422c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:08.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9859ffb640 1 -- 172.21.15.87:0/3675741313 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98440b0070 con 0x7f985c1517d0 2024-04-25T16:02:08.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9859ffb640 1 -- 172.21.15.87:0/3675741313 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98440ab600 con 0x7f985c1517d0 2024-04-25T16:02:08.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9859ffb640 1 -- 172.21.15.87:0/3675741313 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98440ab9f0 con 0x7f985c1517d0 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 -- 172.21.15.87:0/3675741313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1517d0 msgr2=0x7f985c0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 --2- 172.21.15.87:0/3675741313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1517d0 0x7f985c0c95a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f985c072d80 tx=0x7f984401c480 comp rx=0 tx=0).stop 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 -- 172.21.15.87:0/3675741313 shutdown_connections 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 --2- 172.21.15.87:0/3675741313 >> v2:172.21.15.155:3300/0 conn(0x7f985c157fc0 0x7f985c15ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 --2- 172.21.15.87:0/3675741313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c1517d0 0x7f985c0c95a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 -- 172.21.15.87:0/3675741313 >> 172.21.15.87:0/3675741313 conn(0x7f985c06d780 msgr2=0x7f985c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 -- 172.21.15.87:0/3675741313 shutdown_connections 2024-04-25T16:02:08.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.016+0000 7f9861748640 1 -- 172.21.15.87:0/3675741313 wait complete. 2024-04-25T16:02:08.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.020+0000 7f9861748640 1 Processor -- start 2024-04-25T16:02:08.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.020+0000 7f9861748640 1 -- start start 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c0c9ae0 0x7f985c14d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c1517d0 0x7f985c1f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 0x7f985c1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f985c158550 con 0x7f985c157fc0 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1583d0 con 0x7f985c1517d0 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f985c0a8f70 con 0x7f985c0c9ae0 2024-04-25T16:02:08.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 0x7f985c1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 0x7f985c1f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44768/0 (socket says 172.21.15.87:44768) 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 -- 172.21.15.87:0/1725075627 learned_addr learned my addr 172.21.15.87:0/1725075627 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 -- 172.21.15.87:0/1725075627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c0c9ae0 msgr2=0x7f985c14d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c0c9ae0 0x7f985c14d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 -- 172.21.15.87:0/1725075627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c1517d0 msgr2=0x7f985c1f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c1517d0 0x7f985c1f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 -- 172.21.15.87:0/1725075627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c06d1d0 con 0x7f985c157fc0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f985b7fe640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 0x7f985c1f0df0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f985400cc30 tx=0x7f985400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985400ce40 con 0x7f985c157fc0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98540039a0 con 0x7f985c157fc0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854003d70 con 0x7f985c157fc0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c14f2e0 con 0x7f985c157fc0 2024-04-25T16:02:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c0c3480 con 0x7f985c157fc0 2024-04-25T16:02:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c069bb0 con 0x7f985c157fc0 2024-04-25T16:02:08.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.024+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9854003f30 con 0x7f985c157fc0 2024-04-25T16:02:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.028+0000 7f98537fe640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983c06f430 0x7f983c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.028+0000 7f985affd640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983c06f430 0x7f983c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.028+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7213+0+0 (secure 0 0 0) 0x7f9854090090 con 0x7f985c157fc0 2024-04-25T16:02:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.028+0000 7f985affd640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983c06f430 0x7f983c071940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f98440ad000 tx=0x7f9844008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:08.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.032+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f985c06d1d0 con 0x7f985c157fc0 2024-04-25T16:02:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.088+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c014cfc0 con 0x7f50c006fa10 2024-04-25T16:02:08.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.088+0000 7f50b7fff640 1 -- 172.21.15.87:0/4007617323 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+4360 (secure 0 0 0) 0x7f50b00a9070 con 0x7f50c006fa10 2024-04-25T16:02:08.089 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:08.089 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:08.089 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 71 2024-04-25T16:02:08.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50a006f400 msgr2=0x7f50a0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50a006f400 0x7f50a0071910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f50c00c5c40 tx=0x7f50a8007970 comp rx=0 tx=0).stop 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 msgr2=0x7f50c01510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 0x7f50c01510c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50b00af040 tx=0x7f50b0019200 comp rx=0 tx=0).stop 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 shutdown_connections 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f50a006f400 0x7f50a0071910 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50c01518b0 0x7f50c0157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00ad160 0x7f50c014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 --2- 172.21.15.87:0/4007617323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c006fa10 0x7f50c01510c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 >> 172.21.15.87:0/4007617323 conn(0x7f50c00c8770 msgr2=0x7f50c00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 shutdown_connections 2024-04-25T16:02:08.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.092+0000 7f50c6062640 1 -- 172.21.15.87:0/4007617323 wait complete. 2024-04-25T16:02:08.113 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2024-04-25T16:02:08.113 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-25T16:02:08.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:08.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.196+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f985c14e1f0 con 0x7f985c157fc0 2024-04-25T16:02:08.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bef76640 1 Processor -- start 2024-04-25T16:02:08.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bef76640 1 -- start start 2024-04-25T16:02:08.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bef76640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7b80c4250 0x7fb7b806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bef76640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b80c5120 con 0x7fb7b8070490 2024-04-25T16:02:08.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bef76640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b80c4b60 con 0x7fb7b815b340 2024-04-25T16:02:08.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bef76640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb7b80c3b20 con 0x7fb7b80c4250 2024-04-25T16:02:08.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7b7fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb7b8070490 0x7fb7b815ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44838/0 (socket says 172.21.15.87:44838) 2024-04-25T16:02:08.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7b7fff640 1 -- 172.21.15.87:0/2482041790 learned_addr learned my addr 172.21.15.87:0/2482041790 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:08.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/2482041790 >> v2:172.21.15.155:3300/0 conn(0x7fb7b80c4250 0x7fb7b806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486769414 0 0) 0x7fb7ac001120 con 0x7fb7b8070490 2024-04-25T16:02:08.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.292+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a0003530 con 0x7fb7b8070490 2024-04-25T16:02:08.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447173511 0 0) 0x7fb7a0003530 con 0x7fb7b8070490 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 >> v2:172.21.15.155:3300/0 conn(0x7fb7b80c4250 msgr2=0x7fb7b806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 --2- 172.21.15.87:0/2482041790 >> v2:172.21.15.155:3300/0 conn(0x7fb7b80c4250 0x7fb7b806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 >> v1:172.21.15.155:6789/0 conn(0x7fb7b815b340 legacy=0x7fb7b8161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b80c4e40 con 0x7fb7b8070490 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fb7ac001850 con 0x7fb7b8070490 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/2482041790 >> v2:172.21.15.155:3300/0 conn(0x7fb7b80c4250 0x7fb7b806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 >> v1:172.21.15.87:6789/0 conn(0x7fb7b8070490 legacy=0x7fb7b815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7a0003a10 0x7fb7a0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0004810 0x7fb7a0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7a0005360 0x7fb7a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a000c2c0 con 0x7fb7a0003a10 2024-04-25T16:02:08.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a000c470 con 0x7fb7a0005360 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a000c670 con 0x7fb7a0004810 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7a0003a10 0x7fb7a0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 -- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0004810 msgr2=0x7fb7a0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bd513640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7a0005360 0x7fb7a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0004810 0x7fb7a0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 -- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7a0005360 msgr2=0x7fb7a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7a0005360 0x7fb7a000ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bd513640 1 -- 172.21.15.87:0/2482041790 reap_dead start 2024-04-25T16:02:08.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 -- 172.21.15.87:0/2482041790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a0003530 con 0x7fb7a0003a10 2024-04-25T16:02:08.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7a0003a10 0x7fb7a0003e80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80098a0 tx=0x7fb7a801c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf74f43bd0ccb2a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:08.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80b1070 con 0x7fb7a0003a10 2024-04-25T16:02:08.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7a80ac620 con 0x7fb7a0003a10 2024-04-25T16:02:08.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7b77fe640 1 -- 172.21.15.87:0/2482041790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800f040 con 0x7fb7a0003a10 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 -- 172.21.15.87:0/2482041790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7a0003a10 msgr2=0x7fb7a0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7a0003a10 0x7fb7a0003e80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80098a0 tx=0x7fb7a801c590 comp rx=0 tx=0).stop 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 -- 172.21.15.87:0/2482041790 shutdown_connections 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 --2- 172.21.15.87:0/2482041790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7a0003a10 0x7fb7a0003e80 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 -- 172.21.15.87:0/2482041790 >> 172.21.15.87:0/2482041790 conn(0x7fb7b806d780 msgr2=0x7fb7b806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 -- 172.21.15.87:0/2482041790 shutdown_connections 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.296+0000 7fb7bef76640 1 -- 172.21.15.87:0/2482041790 wait complete. 2024-04-25T16:02:08.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 Processor -- start 2024-04-25T16:02:08.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 -- start start 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0003a10 0x7fb7b8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 0x7fb7b80ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b80ae6a0 0x7fb7b8151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b815b8d0 con 0x7fb7b81535a0 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b815b750 con 0x7fb7b80ae6a0 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b8155100 con 0x7fb7a0003a10 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 0x7fb7b80ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 0x7fb7b80ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44794/0 (socket says 172.21.15.87:44794) 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 -- 172.21.15.87:0/1587883450 learned_addr learned my addr 172.21.15.87:0/1587883450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bd513640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b80ae6a0 0x7fb7b8151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0003a10 0x7fb7b8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 -- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0003a10 msgr2=0x7fb7b8153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0003a10 0x7fb7b8153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 -- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b80ae6a0 msgr2=0x7fb7b8151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b80ae6a0 0x7fb7b8151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 -- 172.21.15.87:0/1587883450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b81f1ee0 con 0x7fb7b81535a0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0003a10 0x7fb7b8153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b7fff640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 0x7fb7b80ae160 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c730 tx=0x7fb7ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac018070 con 0x7fb7b81535a0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7ac007500 con 0x7fb7b81535a0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b81502d0 con 0x7fb7b81535a0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac004a50 con 0x7fb7b81535a0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.300+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b8152860 con 0x7fb7b81535a0 2024-04-25T16:02:08.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.304+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b8150030 con 0x7fb7b81535a0 2024-04-25T16:02:08.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.304+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb7ac01b070 con 0x7fb7b81535a0 2024-04-25T16:02:08.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.304+0000 7fb7b57fa640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb7a406f430 0x7fb7a4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:08.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.304+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb7a406f430 0x7fb7a4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:08.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.304+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7213+0+0 (secure 0 0 0) 0x7fb7ac08ee00 con 0x7fb7b81535a0 2024-04-25T16:02:08.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.304+0000 7fb7bcd12640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb7a406f430 0x7fb7a4071940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80ae000 tx=0x7fb7a80046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.308+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb7b8150030 con 0x7fb7b81535a0 2024-04-25T16:02:08.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.488+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7b8069bb0 con 0x7fb7b81535a0 2024-04-25T16:02:08.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7b57fa640 1 -- 172.21.15.87:0/1587883450 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+4360 (secure 0 0 0) 0x7fb7b80c5120 con 0x7fb7b81535a0 2024-04-25T16:02:08.491 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:08.491 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:08.492 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 71 2024-04-25T16:02:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb7a406f430 msgr2=0x7fb7a4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb7a406f430 0x7fb7a4071940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80ae000 tx=0x7fb7a80046d0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 msgr2=0x7fb7b80ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 0x7fb7b80ae160 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c730 tx=0x7fb7ac00cbf0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 shutdown_connections 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fb7a406f430 0x7fb7a4071940 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7b80ae6a0 0x7fb7b8151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b81535a0 0x7fb7b80ae160 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 --2- 172.21.15.87:0/1587883450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7a0003a10 0x7fb7b8153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 >> 172.21.15.87:0/1587883450 conn(0x7fb7b806d780 msgr2=0x7fb7b814eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 shutdown_connections 2024-04-25T16:02:08.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.492+0000 7fb7bef76640 1 -- 172.21.15.87:0/1587883450 wait complete. 2024-04-25T16:02:08.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f98537fe640 1 -- 172.21.15.87:0/1725075627 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v39) ==== 154+0+0 (secure 0 0 0) 0x7f9854014030 con 0x7f985c157fc0 2024-04-25T16:02:08.847 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'a_data' removed 2024-04-25T16:02:08.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983c06f430 msgr2=0x7f983c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983c06f430 0x7f983c071940 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f98440ad000 tx=0x7f9844008040 comp rx=0 tx=0).stop 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 msgr2=0x7f985c1f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 0x7f985c1f0df0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f985400cc30 tx=0x7f985400a5c0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 shutdown_connections 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f983c06f430 0x7f983c071940 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c157fc0 0x7f985c1f0df0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985c1517d0 0x7f985c1f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 --2- 172.21.15.87:0/1725075627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f985c0c9ae0 0x7f985c14d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.848+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 >> 172.21.15.87:0/1725075627 conn(0x7f985c06d780 msgr2=0x7f985c153550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:08.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.852+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 shutdown_connections 2024-04-25T16:02:08.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:08.852+0000 7f9861748640 1 -- 172.21.15.87:0/1725075627 wait complete. 2024-04-25T16:02:08.883 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-04-25T16:02:08.883 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:09.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.024+0000 7f9fa8efc640 1 Processor -- start 2024-04-25T16:02:09.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.024+0000 7f9fa8efc640 1 -- start start 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa8efc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fa4071e50 0x7f9fa40c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa8efc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa40c4720 0x7f9fa415fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa8efc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa4072430 con 0x7f9fa41529a0 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa8efc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa4074730 con 0x7f9fa4071e50 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa8efc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa4074a10 con 0x7f9fa40c4720 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa1d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9fa4071e50 0x7f9fa40c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa259c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9fa41529a0 0x7f9fa40ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44848/0 (socket says 172.21.15.87:44848) 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa259c640 1 -- 172.21.15.87:0/3228726951 learned_addr learned my addr 172.21.15.87:0/3228726951 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3228726951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa40c4720 msgr2=0x7f9fa415fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa1d9b640 1 --2- 172.21.15.87:0/3228726951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa40c4720 0x7f9fa415fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3228726951 >> v1:172.21.15.87:6789/0 conn(0x7f9fa41529a0 legacy=0x7f9fa40ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3228726951 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa4074cf0 con 0x7f9fa4071e50 2024-04-25T16:02:09.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.028+0000 7f9fa159a640 1 -- 172.21.15.87:0/3228726951 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124462455 0 0) 0x7f9fa4072430 con 0x7f9fa41529a0 2024-04-25T16:02:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa1d9b640 1 --2- 172.21.15.87:0/3228726951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa4071e50 0x7f9fa40c41e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009d90 tx=0x7f9f8c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5551120725d5c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa159a640 1 -- 172.21.15.87:0/3228726951 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b2070 con 0x7f9fa4071e50 2024-04-25T16:02:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa159a640 1 -- 172.21.15.87:0/3228726951 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9f8c0a57a0 con 0x7f9fa4071e50 2024-04-25T16:02:09.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa159a640 1 -- 172.21.15.87:0/3228726951 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0a5b90 con 0x7f9fa4071e50 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3228726951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa4071e50 msgr2=0x7f9fa40c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3228726951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa4071e50 0x7f9fa40c41e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009d90 tx=0x7f9f8c01c8e0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3228726951 shutdown_connections 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3228726951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa4071e50 0x7f9fa40c41e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3228726951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa40c4720 0x7f9fa415fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3228726951 >> 172.21.15.87:0/3228726951 conn(0x7f9fa40c8770 msgr2=0x7f9fa40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:09.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3228726951 shutdown_connections 2024-04-25T16:02:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3228726951 wait complete. 2024-04-25T16:02:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 Processor -- start 2024-04-25T16:02:09.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 -- start start 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa4071e50 0x7f9fa40c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.032+0000 7f9fa8efc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 0x7f9fa41f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa41529a0 0x7f9fa41f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa41629b0 con 0x7f9fa40c4720 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4162830 con 0x7f9fa41529a0 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa4162b30 con 0x7f9fa4071e50 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 0x7f9fa41f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 0x7f9fa41f0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44804/0 (socket says 172.21.15.87:44804) 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3342580486 learned_addr learned my addr 172.21.15.87:0/3342580486 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:09.036 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa4071e50 msgr2=0x7f9fa40c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa4071e50 0x7f9fa40c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa2d9d640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa41529a0 0x7f9fa41f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa41529a0 msgr2=0x7f9fa41f0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa41529a0 0x7f9fa41f0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 -- 172.21.15.87:0/3342580486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa41f1060 con 0x7f9fa40c4720 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa1d9b640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 0x7f9fa41f0540 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0b0040 tx=0x7f9f8c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b2050 con 0x7f9fa40c4720 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9f8c0b3040 con 0x7f9fa40c4720 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0ad850 con 0x7f9fa40c4720 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa40ac410 con 0x7f9fa40c4720 2024-04-25T16:02:09.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa40ad2c0 con 0x7f9fa40c4720 2024-04-25T16:02:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa40ad4f0 con 0x7f9fa40c4720 2024-04-25T16:02:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f8c0c0020 con 0x7f9fa40c4720 2024-04-25T16:02:09.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9f9affd640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8406f400 0x7f9f84071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6635+0+0 (secure 0 0 0) 0x7f9f8c12ab70 con 0x7f9fa40c4720 2024-04-25T16:02:09.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa259c640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8406f400 0x7f9f84071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.036+0000 7f9fa259c640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8406f400 0x7f9f84071910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4073d40 tx=0x7f9f9c007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.040+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f8c016560 con 0x7f9fa40c4720 2024-04-25T16:02:09.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.236+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fa4069bb0 con 0x7f9fa40c4720 2024-04-25T16:02:09.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9f9affd640 1 -- 172.21.15.87:0/3342580486 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+4360 (secure 0 0 0) 0x7f9f8c0f77a0 con 0x7f9fa40c4720 2024-04-25T16:02:09.240 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:09.240 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:09.240 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 71 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8406f400 msgr2=0x7f9f84071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8406f400 0x7f9f84071910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4073d40 tx=0x7f9f9c007970 comp rx=0 tx=0).stop 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 msgr2=0x7f9fa41f0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 0x7f9fa41f0540 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0b0040 tx=0x7f9f8c019680 comp rx=0 tx=0).stop 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 shutdown_connections 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f9f8406f400 0x7f9f84071910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fa41529a0 0x7f9fa41f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fa40c4720 0x7f9fa41f0540 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 --2- 172.21.15.87:0/3342580486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fa4071e50 0x7f9fa40c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 >> 172.21.15.87:0/3342580486 conn(0x7f9fa40c8770 msgr2=0x7f9fa40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 shutdown_connections 2024-04-25T16:02:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.240+0000 7f9fa8efc640 1 -- 172.21.15.87:0/3342580486 wait complete. 2024-04-25T16:02:09.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T16:02:09.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.408+0000 7ff83637f640 1 Processor -- start 2024-04-25T16:02:09.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83637f640 1 -- start start 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83637f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff830160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83637f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff830072430 con 0x7ff830071e50 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83637f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff830074730 con 0x7ff8301529a0 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83637f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff830074a10 con 0x7ff8300c48f0 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82f7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff830071e50 0x7ff8300c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44856/0 (socket says 172.21.15.87:44856) 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82f7fe640 1 -- 172.21.15.87:0/3518908863 learned_addr learned my addr 172.21.15.87:0/3518908863 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83491c640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff830160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281098025 0 0) 0x7ff830072430 con 0x7ff830071e50 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff81c003530 con 0x7ff830071e50 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3684372105 0 0) 0x7ff81c003530 con 0x7ff830071e50 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 msgr2=0x7ff830160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff830160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 >> v1:172.21.15.155:6789/0 conn(0x7ff8301529a0 legacy=0x7ff8300ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff830074cf0 con 0x7ff830071e50 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7ff818001680 con 0x7ff830071e50 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 >> v1:172.21.15.87:6789/0 conn(0x7ff830071e50 legacy=0x7ff8300c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff81c0039f0 0x7ff81c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff81c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004d50 0x7ff81c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff830074a10 con 0x7ff81c0039f0 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c00bb60 con 0x7ff81c004d50 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff81c00bd10 con 0x7ff8300c48f0 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82ffff640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff81c0039f0 0x7ff81c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82f7fe640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff81c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff83491c640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004d50 0x7ff81c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82ffff640 1 -- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 msgr2=0x7ff81c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82ffff640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff81c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82ffff640 1 -- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004d50 msgr2=0x7ff81c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82ffff640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004d50 0x7ff81c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82ffff640 1 -- 172.21.15.87:0/3518908863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c003530 con 0x7ff81c0039f0 2024-04-25T16:02:09.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.412+0000 7ff82f7fe640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8300c48f0 0x7ff81c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:02:09.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff82ffff640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff81c0039f0 0x7ff81c003e20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff830073d40 tx=0x7ff82801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6968079a33f7b4e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828001b60 con 0x7ff81c0039f0 2024-04-25T16:02:09.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff8280a9640 con 0x7ff81c0039f0 2024-04-25T16:02:09.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff82effd640 1 -- 172.21.15.87:0/3518908863 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8280a9a50 con 0x7ff81c0039f0 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83637f640 1 -- 172.21.15.87:0/3518908863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff81c0039f0 msgr2=0x7ff81c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83637f640 1 --2- 172.21.15.87:0/3518908863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff81c0039f0 0x7ff81c003e20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff830073d40 tx=0x7ff82801c860 comp rx=0 tx=0).stop 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83491c640 1 -- 172.21.15.87:0/3518908863 reap_dead start 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83637f640 1 -- 172.21.15.87:0/3518908863 shutdown_connections 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83637f640 1 -- 172.21.15.87:0/3518908863 >> 172.21.15.87:0/3518908863 conn(0x7ff8300c8770 msgr2=0x7ff8300c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83637f640 1 -- 172.21.15.87:0/3518908863 shutdown_connections 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.416+0000 7ff83637f640 1 -- 172.21.15.87:0/3518908863 wait complete. 2024-04-25T16:02:09.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 Processor -- start 2024-04-25T16:02:09.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 -- start start 2024-04-25T16:02:09.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c0039f0 0x7ff83014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 0x7ff8301ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff830156b20 0x7ff830156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff8300c4d00 con 0x7ff83014baa0 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8301612f0 con 0x7ff81c0039f0 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8301eebe0 con 0x7ff830156b20 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 0x7ff8301ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 0x7ff8301ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44816/0 (socket says 172.21.15.87:44816) 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 -- 172.21.15.87:0/2008449281 learned_addr learned my addr 172.21.15.87:0/2008449281 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83491c640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff830156b20 0x7ff830156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82ffff640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c0039f0 0x7ff83014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 -- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff830156b20 msgr2=0x7ff830156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff830156b20 0x7ff830156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 -- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c0039f0 msgr2=0x7ff83014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c0039f0 0x7ff83014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 -- 172.21.15.87:0/2008449281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8301561b0 con 0x7ff83014baa0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83491c640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff830156b20 0x7ff830156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82f7fe640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 0x7ff8301ee200 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff81800e7b0 tx=0x7ff81800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81800ee60 con 0x7ff83014baa0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff818018070 con 0x7ff83014baa0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8301f1980 con 0x7ff83014baa0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81800ca90 con 0x7ff83014baa0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.420+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8301f1f40 con 0x7ff83014baa0 2024-04-25T16:02:09.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.424+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8301f1770 con 0x7ff83014baa0 2024-04-25T16:02:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.424+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff81800cc30 con 0x7ff83014baa0 2024-04-25T16:02:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.424+0000 7ff82cff9640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff81006f400 0x7ff810071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.424+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6635+0+0 (secure 0 0 0) 0x7ff81808ff40 con 0x7ff83014baa0 2024-04-25T16:02:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.424+0000 7ff82ffff640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff81006f400 0x7ff810071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.424+0000 7ff82ffff640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff81006f400 0x7ff810071910 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff8280ae000 tx=0x7ff8280b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.428+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff81805cb70 con 0x7ff83014baa0 2024-04-25T16:02:09.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.620+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff830069bb0 con 0x7ff83014baa0 2024-04-25T16:02:09.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff82cff9640 1 -- 172.21.15.87:0/2008449281 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+4360 (secure 0 0 0) 0x7ff81805c470 con 0x7ff83014baa0 2024-04-25T16:02:09.623 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:09.623 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2976401622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2976401622},{"type":"v1","addr":"172.21.15.155:6835","nonce":2976401622}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":5239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2424832889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2424832889},{"type":"v1","addr":"172.21.15.155:6833","nonce":2424832889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:54:19.744734+0000","modified":"2024-04-25T16:00:31.489467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5946":{"gid":5946,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6835/1331456773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1331456773},{"type":"v1","addr":"172.21.15.87:6835","nonce":1331456773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5946,"qdb_cluster":[5946]},"id":2}]} 2024-04-25T16:02:09.624 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 71 2024-04-25T16:02:09.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff81006f400 msgr2=0x7ff810071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff81006f400 0x7ff810071910 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff8280ae000 tx=0x7ff8280b3040 comp rx=0 tx=0).stop 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 msgr2=0x7ff8301ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 0x7ff8301ee200 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff81800e7b0 tx=0x7ff81800ec70 comp rx=0 tx=0).stop 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 shutdown_connections 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7ff81006f400 0x7ff810071910 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff830156b20 0x7ff830156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff83014baa0 0x7ff8301ee200 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 --2- 172.21.15.87:0/2008449281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c0039f0 0x7ff83014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 >> 172.21.15.87:0/2008449281 conn(0x7ff8300c8770 msgr2=0x7ff83014c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 shutdown_connections 2024-04-25T16:02:09.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.624+0000 7ff83637f640 1 -- 172.21.15.87:0/2008449281 wait complete. 2024-04-25T16:02:09.648 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T16:02:09.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18ca3e640 1 Processor -- start 2024-04-25T16:02:09.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18ca3e640 1 -- start start 2024-04-25T16:02:09.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18ca3e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1880c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18ca3e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd188152d90 con 0x7fd188155320 2024-04-25T16:02:09.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18ca3e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1880ca2f0 con 0x7fd188155730 2024-04-25T16:02:09.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18ca3e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880aa290 con 0x7fd188152980 2024-04-25T16:02:09.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd185d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd188155320 0x7fd188074160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44864/0 (socket says 172.21.15.87:44864) 2024-04-25T16:02:09.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd185d9b640 1 -- 172.21.15.87:0/905664058 learned_addr learned my addr 172.21.15.87:0/905664058 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:09.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18659c640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1880c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549617029 0 0) 0x7fd188152d90 con 0x7fd188155320 2024-04-25T16:02:09.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.788+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd174003530 con 0x7fd188155320 2024-04-25T16:02:09.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1057486867 0 0) 0x7fd174003530 con 0x7fd188155320 2024-04-25T16:02:09.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 msgr2=0x7fd1880c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1880c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 >> v1:172.21.15.155:6789/0 conn(0x7fd188155730 legacy=0x7fd18815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1880a9cd0 con 0x7fd188155320 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fd170001a00 con 0x7fd188155320 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 >> v1:172.21.15.87:6789/0 conn(0x7fd188155320 legacy=0x7fd188074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1740039f0 0x7fd174003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd174004810 0x7fd174004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1740052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880aa290 con 0x7fd1740039f0 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd17400bb90 con 0x7fd174004810 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd17400bd90 con 0x7fd188152980 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1740039f0 0x7fd174003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 -- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 msgr2=0x7fd1740052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd186d9d640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1740052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1740052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 -- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd174004810 msgr2=0x7fd174004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:09.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd174004810 0x7fd174004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 -- 172.21.15.87:0/905664058 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd174003530 con 0x7fd1740039f0 2024-04-25T16:02:09.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd186d9d640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd188152980 0x7fd1740052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18659c640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1740039f0 0x7fd174003e60 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd178009ae0 tx=0x7fd17801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31de34d31f43f471 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1780096b0 con 0x7fd1740039f0 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd1780a6470 con 0x7fd1740039f0 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18559a640 1 -- 172.21.15.87:0/905664058 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1780a6880 con 0x7fd1740039f0 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18ca3e640 1 -- 172.21.15.87:0/905664058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1740039f0 msgr2=0x7fd174003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/905664058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1740039f0 0x7fd174003e60 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd178009ae0 tx=0x7fd17801ca90 comp rx=0 tx=0).stop 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd186d9d640 1 -- 172.21.15.87:0/905664058 reap_dead start 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18ca3e640 1 -- 172.21.15.87:0/905664058 shutdown_connections 2024-04-25T16:02:09.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18ca3e640 1 -- 172.21.15.87:0/905664058 >> 172.21.15.87:0/905664058 conn(0x7fd1880ac550 msgr2=0x7fd1880ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:09.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18ca3e640 1 -- 172.21.15.87:0/905664058 shutdown_connections 2024-04-25T16:02:09.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.792+0000 7fd18ca3e640 1 -- 172.21.15.87:0/905664058 wait complete. 2024-04-25T16:02:09.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 Processor -- start 2024-04-25T16:02:09.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 -- start start 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740039f0 0x7fd1880c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd18814b360 0x7fd188157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 0x7fd18814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd188158f70 con 0x7fd18814c040 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd1881598b0 con 0x7fd1740039f0 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd188074870 con 0x7fd18814b360 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 0x7fd18814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 0x7fd18814c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44836/0 (socket says 172.21.15.87:44836) 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 -- 172.21.15.87:0/1791732843 learned_addr learned my addr 172.21.15.87:0/1791732843 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd185d9b640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd18814b360 0x7fd188157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18659c640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740039f0 0x7fd1880c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 -- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd18814b360 msgr2=0x7fd188157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd18814b360 0x7fd188157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 -- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740039f0 msgr2=0x7fd1880c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740039f0 0x7fd1880c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 -- 172.21.15.87:0/1791732843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18814a480 con 0x7fd18814c040 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18659c640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740039f0 0x7fd1880c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd186d9d640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 0x7fd18814c450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd188074110 tx=0x7fd18000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180005480 con 0x7fd18814c040 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd180007030 con 0x7fd18814c040 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18814a760 con 0x7fd18814c040 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180007440 con 0x7fd18814c040 2024-04-25T16:02:09.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.796+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1880c3730 con 0x7fd18814c040 2024-04-25T16:02:09.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.800+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd188069bb0 con 0x7fd18814c040 2024-04-25T16:02:09.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.800+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd18001b020 con 0x7fd18814c040 2024-04-25T16:02:09.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.800+0000 7fd17effd640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd16806f400 0x7fd168071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:09.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.800+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6635+0+0 (secure 0 0 0) 0x7fd18008f050 con 0x7fd18814c040 2024-04-25T16:02:09.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.800+0000 7fd18659c640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd16806f400 0x7fd168071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:09.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.800+0000 7fd18659c640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd16806f400 0x7fd168071910 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1780ad000 tx=0x7fd1780a9040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:09.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.804+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd18005bba0 con 0x7fd18814c040 2024-04-25T16:02:09.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.984+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1880c9b90 con 0x7fd18814c040 2024-04-25T16:02:09.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.984+0000 7fd17effd640 1 -- 172.21.15.87:0/1791732843 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+18084 (secure 0 0 0) 0x7fd18005b4a0 con 0x7fd18814c040 2024-04-25T16:02:09.987 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-25T16:02:09.987 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":39,"fsid":"527c0db7-6346-492d-a157-2cd52d90e62b","created":"2024-04-25T15:53:44.454281+0000","modified":"2024-04-25T16:02:08.841155+0000","last_up_change":"2024-04-25T15:53:56.207810+0000","last_in_change":"2024-04-25T15:53:47.123521+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:53:57.150923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-25T15:54:17.866410+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-25T15:54:18.720885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d62d732e-6d30-42a2-bff8-2f2cd8bff0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6818","nonce":3434086508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6819","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6821","nonce":3434086508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6827","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6829","nonce":3434086508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6823","nonce":3434086508},{"type":"v1","addr":"172.21.15.87:6825","nonce":3434086508}]},"public_addr":"172.21.15.87:6818/3434086508","cluster_addr":"172.21.15.87:6821/3434086508","heartbeat_back_addr":"172.21.15.87:6829/3434086508","heartbeat_front_addr":"172.21.15.87:6825/3434086508","state":["exists","up"]},{"osd":1,"uuid":"48ff8cea-5c0a-46e4-88a2-564defab6489","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6820","nonce":4281742736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6824","nonce":4281742736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6831","nonce":4281742736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4281742736},{"type":"v1","addr":"172.21.15.87:6828","nonce":4281742736}]},"public_addr":"172.21.15.87:6820/4281742736","cluster_addr":"172.21.15.87:6824/4281742736","heartbeat_back_addr":"172.21.15.87:6831/4281742736","heartbeat_front_addr":"172.21.15.87:6828/4281742736","state":["exists","up"]},{"osd":2,"uuid":"eafabe27-bee6-4b9f-a187-4e02d999eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6809","nonce":3379569220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6811","nonce":3379569220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6815","nonce":3379569220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3379569220},{"type":"v1","addr":"172.21.15.87:6813","nonce":3379569220}]},"public_addr":"172.21.15.87:6809/3379569220","cluster_addr":"172.21.15.87:6811/3379569220","heartbeat_back_addr":"172.21.15.87:6815/3379569220","heartbeat_front_addr":"172.21.15.87:6813/3379569220","state":["exists","up"]},{"osd":3,"uuid":"f418667b-e474-4756-8607-35d44b0dd905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6801","nonce":2110638715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6803","nonce":2110638715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6807","nonce":2110638715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2110638715},{"type":"v1","addr":"172.21.15.87:6805","nonce":2110638715}]},"public_addr":"172.21.15.87:6801/2110638715","cluster_addr":"172.21.15.87:6803/2110638715","heartbeat_back_addr":"172.21.15.87:6807/2110638715","heartbeat_front_addr":"172.21.15.87:6805/2110638715","state":["exists","up"]},{"osd":4,"uuid":"26425cd7-eef6-4b0b-9979-944b18ec8f2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6825","nonce":1375627769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6827","nonce":1375627769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6831","nonce":1375627769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1375627769},{"type":"v1","addr":"172.21.15.155:6829","nonce":1375627769}]},"public_addr":"172.21.15.155:6825/1375627769","cluster_addr":"172.21.15.155:6827/1375627769","heartbeat_back_addr":"172.21.15.155:6831/1375627769","heartbeat_front_addr":"172.21.15.155:6829/1375627769","state":["exists","up"]},{"osd":5,"uuid":"fd4792d4-2b3b-42d2-a17d-b423741b7f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6801","nonce":3453999396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6803","nonce":3453999396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6807","nonce":3453999396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3453999396},{"type":"v1","addr":"172.21.15.155:6805","nonce":3453999396}]},"public_addr":"172.21.15.155:6801/3453999396","cluster_addr":"172.21.15.155:6803/3453999396","heartbeat_back_addr":"172.21.15.155:6807/3453999396","heartbeat_front_addr":"172.21.15.155:6805/3453999396","state":["exists","up"]},{"osd":6,"uuid":"a22ffc4d-7b8a-436f-a78d-ca8d0f48ac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6817","nonce":3434620802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6819","nonce":3434620802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6823","nonce":3434620802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3434620802},{"type":"v1","addr":"172.21.15.155:6821","nonce":3434620802}]},"public_addr":"172.21.15.155:6817/3434620802","cluster_addr":"172.21.15.155:6819/3434620802","heartbeat_back_addr":"172.21.15.155:6823/3434620802","heartbeat_front_addr":"172.21.15.155:6821/3434620802","state":["exists","up"]},{"osd":7,"uuid":"46a9e756-5ed4-48e3-8fdd-b0a2af99bb49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6809","nonce":209384873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6811","nonce":209384873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6815","nonce":209384873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":209384873},{"type":"v1","addr":"172.21.15.155:6813","nonce":209384873}]},"public_addr":"172.21.15.155:6809/209384873","cluster_addr":"172.21.15.155:6811/209384873","heartbeat_back_addr":"172.21.15.155:6815/209384873","heartbeat_front_addr":"172.21.15.155:6813/209384873","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.736774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.723699+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.683946+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.660781+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.656840+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.552358+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.711354+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:53:52.673834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6837/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.87:6836/1282402609":"2024-04-26T16:02:05.828142+0000","172.21.15.87:6835/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.87:6834/4111430078":"2024-04-26T16:00:09.300147+0000","172.21.15.155:6835/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6835/630698588":"2024-04-26T15:59:34.292729+0000","172.21.15.87:6837/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.87:6836/2742361177":"2024-04-26T15:55:34.243698+0000","172.21.15.155:6832/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.87:6836/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6837/4061291849":"2024-04-26T15:57:54.268614+0000","172.21.15.87:6835/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6835/2324940240":"2024-04-26T15:55:14.236207+0000","172.21.15.87:6834/1293807006":"2024-04-26T15:58:04.272003+0000","172.21.15.87:6837/1282402609":"2024-04-26T16:02:05.828142+0000","172.21.15.155:6833/1039729746":"2024-04-26T15:56:59.258623+0000","172.21.15.155:6833/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.155:6834/3802722727":"2024-04-26T16:00:43.549129+0000","172.21.15.155:6832/2576881209":"2024-04-26T15:59:24.289438+0000","172.21.15.87:6836/2477874160":"2024-04-26T16:00:24.304082+0000","172.21.15.155:6834/630698588":"2024-04-26T15:59:34.292729+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd16806f400 msgr2=0x7fd168071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd16806f400 0x7fd168071910 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1780ad000 tx=0x7fd1780a9040 comp rx=0 tx=0).stop 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 msgr2=0x7fd18814c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 0x7fd18814c450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd188074110 tx=0x7fd18000d890 comp rx=0 tx=0).stop 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 shutdown_connections 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fd16806f400 0x7fd168071910 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18814c040 0x7fd18814c450 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd18814b360 0x7fd188157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 --2- 172.21.15.87:0/1791732843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1740039f0 0x7fd1880c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:09.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 >> 172.21.15.87:0/1791732843 conn(0x7fd1880ac550 msgr2=0x7fd188153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:09.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 shutdown_connections 2024-04-25T16:02:09.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:09.988+0000 7fd18ca3e640 1 -- 172.21.15.87:0/1791732843 wait complete. 2024-04-25T16:02:10.009 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-04-25T16:02:10.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 Processor -- start 2024-04-25T16:02:10.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 -- start start 2024-04-25T16:02:10.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f3200157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f320006f790 0x7f320006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3200157d50 con 0x7f3200154d00 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f32000add10 con 0x7f320006f790 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3206293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f32000adff0 con 0x7f320014d810 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f31f77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3200154d00 0x7f3200154200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44874/0 (socket says 172.21.15.87:44874) 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f31f77fe640 1 -- 172.21.15.87:0/3268199035 learned_addr learned my addr 172.21.15.87:0/3268199035 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3204830640 1 --2- 172.21.15.87:0/3268199035 >> v2:172.21.15.87:3300/0 conn(0x7f320006f790 0x7f320006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f31ff7fe640 1 -- 172.21.15.87:0/3268199035 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126845 0 0) 0x7f3200157d50 con 0x7f3200154d00 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f31fffff640 1 --2- 172.21.15.87:0/3268199035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f3200157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f31ff7fe640 1 -- 172.21.15.87:0/3268199035 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31ec003530 con 0x7f3200154d00 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3204830640 1 -- 172.21.15.87:0/3268199035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 msgr2=0x7f3200157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3204830640 1 --2- 172.21.15.87:0/3268199035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f3200157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3204830640 1 -- 172.21.15.87:0/3268199035 >> v1:172.21.15.87:6789/0 conn(0x7f3200154d00 legacy=0x7f3200154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.156+0000 7f3204830640 1 -- 172.21.15.87:0/3268199035 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3200157010 con 0x7f320006f790 2024-04-25T16:02:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3204830640 1 --2- 172.21.15.87:0/3268199035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f320006fba0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009d90 tx=0x7f31f801ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c04db25558d50cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f31ff7fe640 1 -- 172.21.15.87:0/3268199035 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80b4070 con 0x7f320006f790 2024-04-25T16:02:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f31ff7fe640 1 -- 172.21.15.87:0/3268199035 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f31f80a78b0 con 0x7f320006f790 2024-04-25T16:02:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f31ff7fe640 1 -- 172.21.15.87:0/3268199035 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80a7ca0 con 0x7f320006f790 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 -- 172.21.15.87:0/3268199035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 msgr2=0x7f320006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 --2- 172.21.15.87:0/3268199035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f320006fba0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009d90 tx=0x7f31f801ea60 comp rx=0 tx=0).stop 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 -- 172.21.15.87:0/3268199035 shutdown_connections 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 --2- 172.21.15.87:0/3268199035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f320006fba0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 --2- 172.21.15.87:0/3268199035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f3200157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 -- 172.21.15.87:0/3268199035 >> 172.21.15.87:0/3268199035 conn(0x7f32000c8770 msgr2=0x7f32000c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 -- 172.21.15.87:0/3268199035 shutdown_connections 2024-04-25T16:02:10.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.160+0000 7f3206293640 1 -- 172.21.15.87:0/3268199035 wait complete. 2024-04-25T16:02:10.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 Processor -- start 2024-04-25T16:02:10.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- start start 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f3200153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f32000c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3200154d00 0x7f3200143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3200160320 con 0x7f320006f790 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f32001601a0 con 0x7f3200154d00 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f32001604a0 con 0x7f320014d810 2024-04-25T16:02:10.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f3200153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f3200153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44840/0 (socket says 172.21.15.87:44840) 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 -- 172.21.15.87:0/707870175 learned_addr learned my addr 172.21.15.87:0/707870175 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3204830640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3200154d00 0x7f3200143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31f77fe640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f32000c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 -- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 msgr2=0x7f32000c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f32000c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 -- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3200154d00 msgr2=0x7f3200143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3200154d00 0x7f3200143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 -- 172.21.15.87:0/707870175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3200151680 con 0x7f320006f790 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31f77fe640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f32000c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fffff640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f3200153290 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d5c0 tx=0x7f31f000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0004240 con 0x7f320006f790 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f31f00043e0 con 0x7f320006f790 2024-04-25T16:02:10.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32000c7dd0 con 0x7f320006f790 2024-04-25T16:02:10.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0003860 con 0x7f320006f790 2024-04-25T16:02:10.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32000c68d0 con 0x7f320006f790 2024-04-25T16:02:10.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.164+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3200069bb0 con 0x7f320006f790 2024-04-25T16:02:10.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.168+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f31f0003a00 con 0x7f320006f790 2024-04-25T16:02:10.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.168+0000 7f31fd7fa640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f31e006f400 0x7f31e0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.168+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6635+0+0 (secure 0 0 0) 0x7f31f008f940 con 0x7f320006f790 2024-04-25T16:02:10.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.168+0000 7f31f77fe640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f31e006f400 0x7f31e0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.168+0000 7f31f77fe640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f31e006f400 0x7f31e0071910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f320014d550 tx=0x7f31e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:10.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.172+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31f005c490 con 0x7f320006f790 2024-04-25T16:02:10.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.372+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f320006ac20 con 0x7f320006f790 2024-04-25T16:02:10.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f31fd7fa640 1 -- 172.21.15.87:0/707870175 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) ==== 151+0+0 (secure 0 0 0) 0x7f31f005bd90 con 0x7f320006f790 2024-04-25T16:02:10.375 INFO:teuthology.orchestra.run.smithi087.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f31e006f400 msgr2=0x7f31e0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f31e006f400 0x7f31e0071910 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f320014d550 tx=0x7f31e8009040 comp rx=0 tx=0).stop 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 msgr2=0x7f3200153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f3200153290 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d5c0 tx=0x7f31f000da80 comp rx=0 tx=0).stop 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 shutdown_connections 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f31e006f400 0x7f31e0071910 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3200154d00 0x7f3200143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f320014d810 0x7f32000c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 --2- 172.21.15.87:0/707870175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f320006f790 0x7f3200153290 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.376+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 >> 172.21.15.87:0/707870175 conn(0x7f32000c8770 msgr2=0x7f32000736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:10.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.380+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 shutdown_connections 2024-04-25T16:02:10.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.380+0000 7f3206293640 1 -- 172.21.15.87:0/707870175 wait complete. 2024-04-25T16:02:10.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-04-25T16:02:10.406 INFO:tasks.ceph.mds.a.smithi087.stderr: -3351> 2024-04-25T16:00:36.445+0000 7ff2f3cd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T16:02:10.475 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-04-25T16:02:10.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fcaa580a640 1 Processor -- start 2024-04-25T16:02:10.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fcaa580a640 1 -- start start 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fcaa580a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcaa01518b0 0x7fcaa006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fcaa580a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa0154fc0 con 0x7fcaa00ad160 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fcaa580a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa00acb20 con 0x7fcaa006fa10 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fcaa580a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa006ed60 con 0x7fcaa01518b0 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9e7fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcaa00ad160 0x7fcaa00c40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44890/0 (socket says 172.21.15.87:44890) 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9e7fc640 1 -- 172.21.15.87:0/1540608762 learned_addr learned my addr 172.21.15.87:0/1540608762 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9effd640 1 --2- 172.21.15.87:0/1540608762 >> v2:172.21.15.155:3300/0 conn(0x7fcaa01518b0 0x7fcaa006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317544137 0 0) 0x7fcaa0154fc0 con 0x7fcaa00ad160 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca88003530 con 0x7fcaa00ad160 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 416678130 0 0) 0x7fca88003530 con 0x7fcaa00ad160 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 >> v2:172.21.15.155:3300/0 conn(0x7fcaa01518b0 msgr2=0x7fcaa006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 --2- 172.21.15.87:0/1540608762 >> v2:172.21.15.155:3300/0 conn(0x7fcaa01518b0 0x7fcaa006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 >> v1:172.21.15.155:6789/0 conn(0x7fcaa006fa10 legacy=0x7fcaa015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa00ace00 con 0x7fcaa00ad160 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4091161685 0 0) 0x7fca94001680 con 0x7fcaa00ad160 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 >> v1:172.21.15.87:6789/0 conn(0x7fcaa00ad160 legacy=0x7fcaa00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880039c0 0x7fca88003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca88004810 0x7fca88004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.556+0000 7fca9dffb640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca88005280 0x7fca8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa006ed60 con 0x7fca880039c0 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca8800c1a0 con 0x7fca88004810 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fca8800e5b0 con 0x7fca88005280 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880039c0 0x7fca88003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 -- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca88005280 msgr2=0x7fca8800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9e7fc640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca88004810 0x7fca88004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9f7fe640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca88005280 0x7fca8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca88005280 0x7fca8800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 -- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca88004810 msgr2=0x7fca88004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:10.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca88004810 0x7fca88004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 -- 172.21.15.87:0/1540608762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca88003530 con 0x7fca880039c0 2024-04-25T16:02:10.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9f7fe640 1 -- 172.21.15.87:0/1540608762 reap_dead start 2024-04-25T16:02:10.562 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9e7fc640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca88004810 0x7fca88004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9effd640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880039c0 0x7fca88003e50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fca90009ab0 tx=0x7fca9001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f015a99080338 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca900b2070 con 0x7fca880039c0 2024-04-25T16:02:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fca900a5660 con 0x7fca880039c0 2024-04-25T16:02:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fca9dffb640 1 -- 172.21.15.87:0/1540608762 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca900096b0 con 0x7fca880039c0 2024-04-25T16:02:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 -- 172.21.15.87:0/1540608762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880039c0 msgr2=0x7fca88003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880039c0 0x7fca88003e50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fca90009ab0 tx=0x7fca9001ca70 comp rx=0 tx=0).stop 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 -- 172.21.15.87:0/1540608762 shutdown_connections 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1540608762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880039c0 0x7fca88003e50 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 -- 172.21.15.87:0/1540608762 >> 172.21.15.87:0/1540608762 conn(0x7fcaa00c8770 msgr2=0x7fcaa00c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 -- 172.21.15.87:0/1540608762 shutdown_connections 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.560+0000 7fcaa580a640 1 -- 172.21.15.87:0/1540608762 wait complete. 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 Processor -- start 2024-04-25T16:02:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 -- start start 2024-04-25T16:02:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca880039c0 0x7fcaa00c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaa0152f90 0x7fcaa01533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 0x7fcaa00c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa01579d0 con 0x7fcaa00c63b0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0157850 con 0x7fca880039c0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa0157b50 con 0x7fcaa0152f90 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 0x7fcaa00c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 0x7fcaa00c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44892/0 (socket says 172.21.15.87:44892) 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 -- 172.21.15.87:0/1499510538 learned_addr learned my addr 172.21.15.87:0/1499510538 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9effd640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca880039c0 0x7fcaa00c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9e7fc640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaa0152f90 0x7fcaa01533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 -- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaa0152f90 msgr2=0x7fcaa01533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaa0152f90 0x7fcaa01533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 -- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca880039c0 msgr2=0x7fcaa00c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca880039c0 0x7fcaa00c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 -- 172.21.15.87:0/1499510538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa01e2800 con 0x7fcaa00c63b0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca9f7fe640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 0x7fcaa00c67c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00ae910 tx=0x7fca9800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98018070 con 0x7fcaa00c63b0 2024-04-25T16:02:10.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fca98003ba0 con 0x7fcaa00c63b0 2024-04-25T16:02:10.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98005070 con 0x7fcaa00c63b0 2024-04-25T16:02:10.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa01eda40 con 0x7fcaa00c63b0 2024-04-25T16:02:10.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.564+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa014beb0 con 0x7fcaa00c63b0 2024-04-25T16:02:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.568+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa0069bb0 con 0x7fcaa00c63b0 2024-04-25T16:02:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.568+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fca9801b070 con 0x7fcaa00c63b0 2024-04-25T16:02:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.568+0000 7fca87fff640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fca8c06f400 0x7fca8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.568+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6721+0+0 (secure 0 0 0) 0x7fca9808f110 con 0x7fcaa00c63b0 2024-04-25T16:02:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.568+0000 7fca9effd640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fca8c06f400 0x7fca8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.568+0000 7fca9effd640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fca8c06f400 0x7fca8c071910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca900af000 tx=0x7fca90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.572+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca98022020 con 0x7fcaa00c63b0 2024-04-25T16:02:10.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:10.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:10.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:10.756+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7fcaa00abfa0 con 0x7fcaa00c63b0 2024-04-25T16:02:11.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.376+0000 7fca87fff640 1 -- 172.21.15.87:0/1499510538 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v73) ==== 99+0+0 (secure 0 0 0) 0x7fca9805be00 con 0x7fcaa00c63b0 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fca8c06f400 msgr2=0x7fca8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fca8c06f400 0x7fca8c071910 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca900af000 tx=0x7fca90008040 comp rx=0 tx=0).stop 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 msgr2=0x7fcaa00c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 0x7fcaa00c67c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00ae910 tx=0x7fca9800dc00 comp rx=0 tx=0).stop 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 shutdown_connections 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7fca8c06f400 0x7fca8c071910 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcaa00c63b0 0x7fcaa00c67c0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcaa0152f90 0x7fcaa01533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 --2- 172.21.15.87:0/1499510538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca880039c0 0x7fcaa00c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 >> 172.21.15.87:0/1499510538 conn(0x7fcaa00c8770 msgr2=0x7fcaa014f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 shutdown_connections 2024-04-25T16:02:11.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.380+0000 7fcaa580a640 1 -- 172.21.15.87:0/1499510538 wait complete. 2024-04-25T16:02:11.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-04-25T16:02:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.564+0000 7f3098345640 1 Processor -- start 2024-04-25T16:02:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.564+0000 7f3098345640 1 -- start start 2024-04-25T16:02:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f3098345640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3090154d00 0x7f3090154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f3098345640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309006f790 0x7f309006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f3098345640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30900add10 con 0x7f309014d810 2024-04-25T16:02:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f3098345640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f30900adff0 con 0x7f3090154d00 2024-04-25T16:02:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f3098345640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3090157010 con 0x7f309006f790 2024-04-25T16:02:11.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3090154d00 0x7f3090154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30960e1640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f309014d810 0x7f3090157810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47154/0 (socket says 172.21.15.87:47154) 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3090154d00 0x7f3090154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35250/0 (socket says 172.21.15.87:35250) 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30960e1640 1 -- 172.21.15.87:0/3815012133 learned_addr learned my addr 172.21.15.87:0/3815012133 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30968e2640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309006f790 0x7f309006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 -- 172.21.15.87:0/3815012133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309006f790 msgr2=0x7f309006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309006f790 0x7f309006fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 -- 172.21.15.87:0/3815012133 >> v1:172.21.15.87:6789/0 conn(0x7f309014d810 legacy=0x7f3090157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 -- 172.21.15.87:0/3815012133 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30901572f0 con 0x7f3090154d00 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30950df640 1 -- 172.21.15.87:0/3815012133 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130928348 0 0) 0x7f30900add10 con 0x7f309014d810 2024-04-25T16:02:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30968e2640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309006f790 0x7f309006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T16:02:11.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30958e0640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f3090154200 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f308000a960 tx=0x7f308001d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e892834c338d98aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:11.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30950df640 1 -- 172.21.15.87:0/3815012133 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30800ad070 con 0x7f3090154d00 2024-04-25T16:02:11.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30950df640 1 -- 172.21.15.87:0/3815012133 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f30800a7630 con 0x7f3090154d00 2024-04-25T16:02:11.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.568+0000 7f30950df640 1 -- 172.21.15.87:0/3815012133 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308000b040 con 0x7f3090154d00 2024-04-25T16:02:11.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- 172.21.15.87:0/3815012133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 msgr2=0x7f3090154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:11.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f3090154200 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f308000a960 tx=0x7f308001d750 comp rx=0 tx=0).stop 2024-04-25T16:02:11.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- 172.21.15.87:0/3815012133 shutdown_connections 2024-04-25T16:02:11.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f3090154200 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 --2- 172.21.15.87:0/3815012133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309006f790 0x7f309006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- 172.21.15.87:0/3815012133 >> 172.21.15.87:0/3815012133 conn(0x7f30900c8770 msgr2=0x7f30900c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:11.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- 172.21.15.87:0/3815012133 shutdown_connections 2024-04-25T16:02:11.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- 172.21.15.87:0/3815012133 wait complete. 2024-04-25T16:02:11.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 Processor -- start 2024-04-25T16:02:11.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- start start 2024-04-25T16:02:11.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309006f790 0x7f30900c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:11.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309014d810 0x7f30901f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:11.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f30901475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:11.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3090160320 con 0x7f3090154d00 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30901601a0 con 0x7f309006f790 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f3098345640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30901604a0 con 0x7f309014d810 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f30968e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f30901475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f30968e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f30901475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35264/0 (socket says 172.21.15.87:35264) 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.572+0000 7f30968e2640 1 -- 172.21.15.87:0/3434569643 learned_addr learned my addr 172.21.15.87:0/3434569643 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30960e1640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309006f790 0x7f30900c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30968e2640 1 -- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309014d810 msgr2=0x7f30901f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30968e2640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309014d810 0x7f30901f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30968e2640 1 -- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309006f790 msgr2=0x7f30900c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30968e2640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309006f790 0x7f30900c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30968e2640 1 -- 172.21.15.87:0/3434569643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090152740 con 0x7f3090154d00 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30968e2640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f30901475b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f308800cd40 tx=0x7f308800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088003ba0 con 0x7f3090154d00 2024-04-25T16:02:11.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3088003d60 con 0x7f3090154d00 2024-04-25T16:02:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30901f0b70 con 0x7f3090154d00 2024-04-25T16:02:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088004280 con 0x7f3090154d00 2024-04-25T16:02:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3090151880 con 0x7f3090154d00 2024-04-25T16:02:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30901f0960 con 0x7f3090154d00 2024-04-25T16:02:11.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3088004420 con 0x7f3090154d00 2024-04-25T16:02:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3086ffd640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f307406f430 0x7f3074071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6721+0+0 (secure 0 0 0) 0x7f3088090150 con 0x7f3090154d00 2024-04-25T16:02:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30960e1640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f307406f430 0x7f3074071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:11.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.576+0000 7f30960e1640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f307406f430 0x7f3074071940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f308c000f70 tx=0x7f308c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:11.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.580+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3088014030 con 0x7f3090154d00 2024-04-25T16:02:11.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:11.744+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3090069bb0 con 0x7f3090154d00 2024-04-25T16:02:12.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.388+0000 7f3086ffd640 1 -- 172.21.15.87:0/3434569643 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v41) ==== 166+0+0 (secure 0 0 0) 0x7f308805cc40 con 0x7f3090154d00 2024-04-25T16:02:12.389 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'b_metadata' removed 2024-04-25T16:02:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f307406f430 msgr2=0x7f3074071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f307406f430 0x7f3074071940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f308c000f70 tx=0x7f308c009040 comp rx=0 tx=0).stop 2024-04-25T16:02:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 msgr2=0x7f30901475b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f30901475b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f308800cd40 tx=0x7f308800a650 comp rx=0 tx=0).stop 2024-04-25T16:02:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 shutdown_connections 2024-04-25T16:02:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f307406f430 0x7f3074071940 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3090154d00 0x7f30901475b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f309014d810 0x7f30901f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 --2- 172.21.15.87:0/3434569643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309006f790 0x7f30900c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 >> 172.21.15.87:0/3434569643 conn(0x7f30900c8770 msgr2=0x7f3090073630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 shutdown_connections 2024-04-25T16:02:12.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.392+0000 7f3098345640 1 -- 172.21.15.87:0/3434569643 wait complete. 2024-04-25T16:02:12.430 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-04-25T16:02:12.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.584+0000 7f3418f34640 1 Processor -- start 2024-04-25T16:02:12.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.584+0000 7f3418f34640 1 -- start start 2024-04-25T16:02:12.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3418f34640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3414071e50 0x7f34140c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:12.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3418f34640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3414072430 con 0x7f34141529a0 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3418f34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3414074730 con 0x7f34140c4720 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3418f34640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3414074a10 con 0x7f3414071e50 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3411d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3414071e50 0x7f34140c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f341259c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f34141529a0 0x7f34140ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47166/0 (socket says 172.21.15.87:47166) 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f341259c640 1 -- 172.21.15.87:0/928425715 learned_addr learned my addr 172.21.15.87:0/928425715 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3411d9b640 1 -- 172.21.15.87:0/928425715 >> v1:172.21.15.155:6789/0 conn(0x7f34140c4720 legacy=0x7f341415fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3411d9b640 1 -- 172.21.15.87:0/928425715 >> v1:172.21.15.87:6789/0 conn(0x7f34141529a0 legacy=0x7f34140ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3411d9b640 1 -- 172.21.15.87:0/928425715 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3414074cf0 con 0x7f3414071e50 2024-04-25T16:02:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f3411d9b640 1 --2- 172.21.15.87:0/928425715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3414071e50 0x7f34140c41e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f34040097c0 tx=0x7f340401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9850e7fd6e1bac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f341159a640 1 -- 172.21.15.87:0/928425715 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040b0070 con 0x7f3414071e50 2024-04-25T16:02:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f341159a640 1 -- 172.21.15.87:0/928425715 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f34040ab600 con 0x7f3414071e50 2024-04-25T16:02:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.588+0000 7f341159a640 1 -- 172.21.15.87:0/928425715 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040a4e60 con 0x7f3414071e50 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- 172.21.15.87:0/928425715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3414071e50 msgr2=0x7f34140c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 --2- 172.21.15.87:0/928425715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3414071e50 0x7f34140c41e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f34040097c0 tx=0x7f340401c3d0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- 172.21.15.87:0/928425715 shutdown_connections 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 --2- 172.21.15.87:0/928425715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3414071e50 0x7f34140c41e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- 172.21.15.87:0/928425715 >> 172.21.15.87:0/928425715 conn(0x7f34140c8770 msgr2=0x7f34140c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- 172.21.15.87:0/928425715 shutdown_connections 2024-04-25T16:02:12.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- 172.21.15.87:0/928425715 wait complete. 2024-04-25T16:02:12.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 Processor -- start 2024-04-25T16:02:12.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- start start 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3414071e50 0x7f3414157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 0x7f3414145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34141529a0 0x7f341413f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3414163b90 con 0x7f34140c4720 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3414163a10 con 0x7f34141529a0 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3414163d10 con 0x7f3414071e50 2024-04-25T16:02:12.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 0x7f3414145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 0x7f3414145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35274/0 (socket says 172.21.15.87:35274) 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 -- 172.21.15.87:0/1634500863 learned_addr learned my addr 172.21.15.87:0/1634500863 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3412d9d640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34141529a0 0x7f341413f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f341259c640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3414071e50 0x7f3414157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 -- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3414071e50 msgr2=0x7f3414157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3414071e50 0x7f3414157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 -- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34141529a0 msgr2=0x7f341413f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34141529a0 0x7f341413f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 -- 172.21.15.87:0/1634500863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34141579a0 con 0x7f34140c4720 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3411d9b640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 0x7f3414145a80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f34040ae040 tx=0x7f3404019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040b0040 con 0x7f34140c4720 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f34040ab400 con 0x7f34140c4720 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3414142cf0 con 0x7f34140c4720 2024-04-25T16:02:12.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.592+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040b4670 con 0x7f34140c4720 2024-04-25T16:02:12.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34140c64f0 con 0x7f34140c4720 2024-04-25T16:02:12.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3414069bb0 con 0x7f34140c4720 2024-04-25T16:02:12.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f34040bc020 con 0x7f34140c4720 2024-04-25T16:02:12.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f3402ffd640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33f406f400 0x7f33f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T16:02:12.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6293+0+0 (secure 0 0 0) 0x7f3404128c70 con 0x7f34140c4720 2024-04-25T16:02:12.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f341259c640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33f406f400 0x7f33f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T16:02:12.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.596+0000 7f341259c640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33f406f400 0x7f33f4071910 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3408000f70 tx=0x7f3408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T16:02:12.601 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.600+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3404016050 con 0x7f34140c4720 2024-04-25T16:02:12.760 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:12.760+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34140c3760 con 0x7f34140c4720 2024-04-25T16:02:13.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.392+0000 7f3402ffd640 1 -- 172.21.15.87:0/1634500863 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v42) ==== 154+0+0 (secure 0 0 0) 0x7f34040f59f0 con 0x7f34140c4720 2024-04-25T16:02:13.392 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'b_data' removed 2024-04-25T16:02:13.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33f406f400 msgr2=0x7f33f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:13.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33f406f400 0x7f33f4071910 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3408000f70 tx=0x7f3408009040 comp rx=0 tx=0).stop 2024-04-25T16:02:13.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 msgr2=0x7f3414145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T16:02:13.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 0x7f3414145a80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f34040ae040 tx=0x7f3404019170 comp rx=0 tx=0).stop 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 shutdown_connections 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:6832/2795128651,v1:172.21.15.87:6833/2795128651] conn(0x7f33f406f400 0x7f33f4071910 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34141529a0 0x7f341413f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34140c4720 0x7f3414145a80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 --2- 172.21.15.87:0/1634500863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3414071e50 0x7f3414157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 >> 172.21.15.87:0/1634500863 conn(0x7f34140c8770 msgr2=0x7f341414ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T16:02:13.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 shutdown_connections 2024-04-25T16:02:13.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-25T16:02:13.400+0000 7f3418f34640 1 -- 172.21.15.87:0/1634500863 wait complete. 2024-04-25T16:02:13.431 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T16:02:13.431 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T16:02:13.431 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:13.446 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T16:02:13.446 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-04-25T16:02:13.446 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T16:02:13.446 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:13.474 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T16:02:13.474 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T16:02:13.474 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:13.538 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T16:02:13.538 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T16:02:13.538 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T16:02:13.538 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:13.605 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T16:02:13.606 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T16:02:13.606 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:18.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T16:02:19.707 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T16:02:19.708 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T16:02:19.708 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:19.794 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T16:02:19.794 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T16:02:19.794 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:24.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-25T16:02:24.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T16:02:25.896 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T16:02:25.896 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T16:02:25.896 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:30.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-25T16:02:30.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-25T16:02:31.998 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T16:02:31.999 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T16:02:31.999 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:32.065 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T16:02:32.065 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T16:02:32.065 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:36.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T16:02:36.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-25T16:02:38.166 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T16:02:38.167 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T16:02:38.167 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:38.253 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T16:02:38.253 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T16:02:38.253 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T16:02:38.254 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:38.285 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T16:02:38.285 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T16:02:38.286 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:38.315 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T16:02:38.315 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T16:02:38.315 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T16:02:38.315 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:38.359 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T16:02:38.359 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T16:02:38.359 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:38.377 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T16:02:38.377 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T16:02:38.377 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T16:02:38.445 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T16:02:38.445 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T16:02:38.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | head -n 1 2024-04-25T16:02:38.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T16:02:38.470 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T16:02:38.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T16:02:38.687 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T16:02:38.888 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T16:02:38.889 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T16:02:39.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T16:02:39.078 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T16:02:39.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T16:02:39.248 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T16:02:39.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T16:02:39.546 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T16:02:39.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T16:02:39.743 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T16:02:39.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T16:02:39.935 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T16:02:40.154 INFO:tasks.ceph:Archiving mon data... 2024-04-25T16:02:40.155 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/data/mon.a.tgz 2024-04-25T16:02:40.156 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-04-25T16:02:40.162 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.E9hiCwUK3i 2024-04-25T16:02:40.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.E9hiCwUK3i 2024-04-25T16:02:40.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.E9hiCwUK3i 2024-04-25T16:02:40.348 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.E9hiCwUK3i is 338KB 2024-04-25T16:02:40.408 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.E9hiCwUK3i 2024-04-25T16:02:40.414 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/data/mon.b.tgz 2024-04-25T16:02:40.414 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T16:02:40.420 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.B62Lx5MlID 2024-04-25T16:02:40.420 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.B62Lx5MlID 2024-04-25T16:02:40.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.B62Lx5MlID 2024-04-25T16:02:40.607 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.B62Lx5MlID is 338KB 2024-04-25T16:02:40.668 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.B62Lx5MlID 2024-04-25T16:02:40.673 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/data/mon.c.tgz 2024-04-25T16:02:40.673 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T16:02:40.722 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.iarV5TJvvd 2024-04-25T16:02:40.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iarV5TJvvd 2024-04-25T16:02:40.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:40.785 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:40.841 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.iarV5TJvvd 2024-04-25T16:02:40.970 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.iarV5TJvvd is 338KB 2024-04-25T16:02:41.032 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.iarV5TJvvd 2024-04-25T16:02:41.037 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T16:02:41.037 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T16:02:41.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T16:02:41.100 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T16:02:41.142 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T16:02:41.142 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T16:02:41.144 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/remote/smithi087/crash 2024-04-25T16:02:41.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T16:02:41.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T16:02:41.158 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/remote/smithi155/crash 2024-04-25T16:02:41.159 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T16:02:41.198 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T16:02:41.198 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:41.208 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:41.285 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:41.302 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:41.341 INFO:tasks.ceph:Compressing logs... 2024-04-25T16:02:41.341 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T16:02:41.348 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T16:02:41.366 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39067.log 2024-04-25T16:02:41.366 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38136.log 2024-04-25T16:02:41.366 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35441.log 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38136.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39067.log.gz 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37584.log 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38136.log.gz 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38506.log 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35441.log: /var/log/ceph/ceph-client.admin.37584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37930.log 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35441.log.gz 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38506.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37584.log.gz 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42705.log 2024-04-25T16:02:41.368 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38506.log.gz 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.admin.37930.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42106.log 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37930.log.gz 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42106.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42705.log.gz 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38324.log 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42106.log.gz 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33507.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38324.log.gz 2024-04-25T16:02:41.373 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34323.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42496.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40308.log: /var/log/ceph/ceph-client.admin.34323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42496.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34323.log.gz 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41280.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42496.log.gz 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42911.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41280.log.gz 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34619.log 2024-04-25T16:02:41.374 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36405.log 2024-04-25T16:02:41.381 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42911.log.gz 2024-04-25T16:02:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-25T16:02:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36405.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34619.log.gz 2024-04-25T16:02:41.381 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38000.log 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36405.log.gz 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38740.log 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43069.log 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38000.log.gz 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43069.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38740.log.gz 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33402.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2%/var/log/ceph/ceph-client.admin.35181.log: -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 2024-04-25T16:02:41.382 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41807.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33760.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.0.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40068.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35103.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33760.log.gz 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39355.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40068.log.gz 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40984.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36223.log 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39355.log: /var/log/ceph/ceph-client.admin.40984.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35103.log.gz 2024-04-25T16:02:41.383 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33652.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40984.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36223.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42366.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33652.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35389.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35493.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33278.log: /var/log/ceph/ceph-client.admin.35389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42522.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35493.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35389.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41226.log 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35493.log.gz 2024-04-25T16:02:41.384 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-04-25T16:02:41.394 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42522.log.gz 2024-04-25T16:02:41.394 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41226.log: /var/log/ceph/ceph-client.admin.35701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34245.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41226.log.gz 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35519.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40360.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34245.log: /var/log/ceph/ceph-client.admin.35519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36821.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35519.log.gz 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1%/var/log/ceph/ceph-client.admin.40360.log: -- replaced with /var/log/ceph/ceph-client.admin.34245.log.gz 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36483.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40360.log.gz 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39329.log 2024-04-25T16:02:41.395 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36821.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38171.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36483.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39552.log 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39329.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39329.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39277.log 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39552.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36535.log 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39634.log 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39277.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36535.log.gz 2024-04-25T16:02:41.396 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34612.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39634.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37826.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37956.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34612.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36093.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37826.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42991.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37956.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36093.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42991.log: /var/log/ceph/ceph-client.admin.37552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34219.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2024-04-25T16:02:41.397 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42991.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40094.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37463.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33838.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40094.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36665.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37463.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35623.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33838.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36665.log.gz 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41358.log 2024-04-25T16:02:41.398 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35623.log.gz 2024-04-25T16:02:41.399 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37258.log 2024-04-25T16:02:41.399 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2024-04-25T16:02:41.399 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38534.log 2024-04-25T16:02:41.399 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41358.log.gz 2024-04-25T16:02:41.399 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35285.log 2024-04-25T16:02:41.399 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37258.log.gz 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35337.log 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38534.log.gz 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37072.log 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35285.log.gz 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35337.log.gz 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2024-04-25T16:02:41.416 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37072.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35415.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41064.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35415.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33916.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41385.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41064.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33916.log.gz 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41385.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T16:02:41.417 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41385.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37365.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42158.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35753.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37365.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35753.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39911.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41833.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34111.log 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-04-25T16:02:41.418 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39859.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39911.log.gz 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34111.log.gz 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36431.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39859.log.gz 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34429.log: /var/log/ceph/ceph-client.admin.39749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36431.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34837.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36431.log.gz 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35051.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40584.log 2024-04-25T16:02:41.419 INFO:teuthology.orchestra.run.smithi087.stderr: 89.7%/var/log/ceph/ceph-client.admin.34837.log: -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34837.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35051.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41176.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40584.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37878.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34425.log: /var/log/ceph/ceph-client.admin.41176.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41176.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33481.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose --/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.41781.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37878.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33376.log 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33481.log.gz 2024-04-25T16:02:41.420 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33376.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41781.log.gz 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38482.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33376.log.gz 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38928.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41541.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38482.log.gz/var/log/ceph/ceph-client.admin.38928.log: 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41649.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38928.log.gz 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40016.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41649.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.33708.log 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41541.log.gz 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40016.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41649.log.gz 2024-04-25T16:02:41.421 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41411.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40016.log.gz 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40532.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33708.log: /var/log/ceph/ceph-client.admin.41411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36275.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33708.log.gz 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41411.log.gz/var/log/ceph/ceph-client.admin.40532.log: 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34297.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40532.log.gz 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36275.log.gz 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39885.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37232.log 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34297.log.gz 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39885.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2024-04-25T16:02:41.422 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37232.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40254.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39885.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37232.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37178.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40254.log: -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38026.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40254.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27793.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37178.log: /var/log/ceph/ceph-client.admin.38026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41489.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38026.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.27793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40042.log 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37178.log.gz 2024-04-25T16:02:41.423 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41489.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27793.log.gz 2024-04-25T16:02:41.424 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38052.log 2024-04-25T16:02:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27697.log 2024-04-25T16:02:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T16:02:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27697.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T16:02:41.434 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27697.log.gz 2024-04-25T16:02:41.434 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33195.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27769.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27793.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.33195.log: /var/log/ceph/ceph-client.admin.27769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27673.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27769.log.gz 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27793.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27793.log.gz 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27673.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27721.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27673.log.gz 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27745.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27721.log.gz 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27649.log 2024-04-25T16:02:41.435 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27745.log: /var/log/ceph/ceph-mon.c.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27745.log.gz 2024-04-25T16:02:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T16:02:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27649.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27649.log.gz 2024-04-25T16:02:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27817.log 2024-04-25T16:02:41.436 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.27817.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr: 94.2% 88.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27817.log.gz 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T16:02:41.437 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T16:02:41.455 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42288.log 2024-04-25T16:02:41.455 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41489.log.gz 2024-04-25T16:02:41.455 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40042.log.gz 2024-04-25T16:02:41.455 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.38052.log.gz /var/log/ceph/ceph-client.admin.41963.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42288.log: /var/log/ceph/ceph-client.admin.41180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33563.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42288.log.gz 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34193.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41963.log: /var/log/ceph/ceph-client.admin.33563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3%/var/log/ceph/ceph-client.admin.34193.log: -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33563.log.gz 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38805.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34193.log.gz 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41332.log 2024-04-25T16:02:41.456 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40918.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40918.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41332.log.gz 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37152.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40918.log.gz 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34417.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8%/var/log/ceph/ceph-client.admin.35675.log: -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37336.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34417.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38110.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gz 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34417.log.gz 2024-04-25T16:02:41.457 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37336.log.gz 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38110.log: /var/log/ceph/ceph-client.admin.42757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41012.log 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8%/var/log/ceph/ceph-client.admin.41937.log: -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38110.log.gz 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41012.log.gz 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39093.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39420.log 2024-04-25T16:02:41.458 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34632.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36064.log: /var/log/ceph/ceph-client.admin.39420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40875.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34632.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.39420.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41116.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34632.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2%/var/log/ceph/ceph-client.admin.35129.log: -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37614.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7%/var/log/ceph/ceph-client.admin.37614.log: -- replaced with /var/log/ceph/ceph-client.admin.41116.log.gz 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34428.log 2024-04-25T16:02:41.459 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42236.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37614.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34428.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35805.log 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34428.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35805.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37018.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34050.log 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36936.log 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34050.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-04-25T16:02:41.460 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34050.log.gz 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33678.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43142.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36936.log.gz 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.33678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1%/var/log/ceph/ceph-client.admin.43142.log: -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gzgzip 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38270.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43142.log.gz 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39303.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34633.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39303.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39833.log 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2024-04-25T16:02:41.461 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39303.log.gz 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35545.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34633.log.gz 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36717.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35545.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39833.log.gz 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35311.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36717.log: /var/log/ceph/ceph-client.admin.39381.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35545.log.gz 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36717.log.gz 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34817.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5%/var/log/ceph/ceph-client.admin.33864.log: -- replaced with /var/log/ceph/ceph-client.admin.35311.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42054.log 2024-04-25T16:02:41.462 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34817.log.gz 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35207.log 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2%/var/log/ceph/ceph-client.admin.35207.log: -- replaced with /var/log/ceph/ceph-client.admin.42054.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38350.log 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35207.log.gz 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38563.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41515.log 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37852.log 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6%/var/log/ceph/ceph-client.admin.41515.log: -- replaced with /var/log/ceph/ceph-client.admin.38350.log.gz 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34416.log 2024-04-25T16:02:41.463 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41515.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37852.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37852.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42444.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40334.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42444.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42444.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40334.log: /var/log/ceph/ceph-osd.1.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40334.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40684.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41437.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1%/var/log/ceph/ceph-client.admin.40684.log: -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40684.log.gz 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38428.log 2024-04-25T16:02:41.464 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41437.log: /var/log/ceph/ceph-client.admin.38428.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41437.log.gz 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38428.log.gz 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33210.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38453.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36795.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42080.log: /var/log/ceph/ceph-client.admin.38453.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38453.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40228.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34637.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40228.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36795.log.gz 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40465.log 2024-04-25T16:02:41.465 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40228.log.gz 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34637.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34637.log.gz 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42835.log 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40465.log: /var/log/ceph/ceph-client.admin.42835.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40465.log.gz 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38216.log 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42835.log.gz 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39173.log 2024-04-25T16:02:41.466 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36587.log 2024-04-25T16:02:41.475 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38216.log: /var/log/ceph/ceph-client.admin.39173.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38216.log.gz 2024-04-25T16:02:41.475 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39173.log.gz 2024-04-25T16:02:41.475 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34375.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34085.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36587.log: /var/log/ceph/ceph-client.admin.34375.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36587.log.gz 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.34375.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.33994.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34085.log.gz 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37774.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41703.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33994.log: /var/log/ceph/ceph-client.admin.37774.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33994.log.gz 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.37774.log.gz 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42861.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41703.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41703.log.gz 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34844.log 2024-04-25T16:02:41.476 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42861.log: /var/log/ceph/ceph-client.admin.34844.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42861.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.34844.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38642.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39446.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41142.log: /var/log/ceph/ceph-client.admin.39446.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34271.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39446.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39225.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41625.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34271.log: /var/log/ceph/ceph-client.admin.41625.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34271.log.gz 2024-04-25T16:02:41.477 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41254.log 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41625.log.gz 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34427.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34620.log 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39199.log 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41254.log: /var/log/ceph/ceph-client.admin.34620.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41254.log.gz 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34620.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41306.log 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39199.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39199.log.gz 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33429.log 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35467.log 2024-04-25T16:02:41.478 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41306.log: /var/log/ceph/ceph-client.admin.33429.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41306.log.gz 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33429.log.gz 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34349.log 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35467.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9%/var/log/ceph/ceph-client.admin.34349.log: -- replaced with /var/log/ceph/ceph-client.admin.35467.log.gz 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34349.log.gz 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36639.log 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33968.log 2024-04-25T16:02:41.479 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36639.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36639.log.gz 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42781.log 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39578.log 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33968.log: /var/log/ceph/ceph-client.admin.42781.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33968.log.gz 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42781.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36873.log 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.484 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39578.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39578.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41911.log 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36963.log 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36873.log: 91.8%/var/log/ceph/ceph-client.admin.41911.log: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36873.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41911.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36691.log 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40120.log 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36963.log: /var/log/ceph/ceph-client.admin.36691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36327.log 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40120.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36963.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36691.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.35727.log -- replaced with /var/log/ceph/ceph-client.admin.40120.log.gz 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38868.log 2024-04-25T16:02:41.485 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36327.log: /var/log/ceph/ceph-client.admin.35727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-04-25T16:02:41.486 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38868.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36327.log.gz 2024-04-25T16:02:41.486 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz 2024-04-25T16:02:41.486 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33786.log 2024-04-25T16:02:41.486 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38868.log.gz 2024-04-25T16:02:41.486 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34424.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-04-25T16:02:41.490 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27573.log 2024-04-25T16:02:41.490 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-04-25T16:02:41.490 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33786.log: /var/log/ceph/ceph-client.admin.27573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40174.log 2024-04-25T16:02:41.490 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33786.log.gz 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40744.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.27573.log.gz 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36119.log 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38244.log 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36119.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40174.log.gz 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42937.log 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36119.log.gz/var/log/ceph/ceph-client.admin.38244.log: 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42937.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38244.log.gz 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42937.log.gz 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-04-25T16:02:41.491 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34845.log 2024-04-25T16:02:41.492 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38713.log: /var/log/ceph/ceph-client.admin.42807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2024-04-25T16:02:41.492 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-04-25T16:02:41.492 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34845.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-04-25T16:02:41.492 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34845.log.gz 2024-04-25T16:02:41.492 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-04-25T16:02:41.496 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42470.log: /var/log/ceph/ceph-client.admin.42340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41463.log 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38296.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41090.log 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38895.log 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37489.log 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41090.log: /var/log/ceph/ceph-client.admin.38895.log: 88.2% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41463.log.gz 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41090.log.gz 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38895.log.gz 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42132.log 2024-04-25T16:02:41.497 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37660.log 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37489.log: /var/log/ceph/ceph-client.admin.42132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40282.log 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37489.log.gz 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42132.log.gz/var/log/ceph/ceph-client.admin.37660.log: 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37660.log.gz 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39498.log 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36457.log 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34836.log 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40282.log.gz 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39498.log: /var/log/ceph/ceph-client.admin.36457.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39498.log.gz 2024-04-25T16:02:41.498 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36457.log.gz 2024-04-25T16:02:41.502 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36992.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34836.log: /var/log/ceph/ceph-client.admin.36992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35155.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34836.log.gz 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36992.log.gz 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42886.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40818.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38589.log: /var/log/ceph/ceph-client.admin.40818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34022.log 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38615.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-04-25T16:02:41.503 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40818.log.gz 2024-04-25T16:02:41.504 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36769.log 2024-04-25T16:02:41.504 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2024-04-25T16:02:41.504 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34022.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34022.log.gz 2024-04-25T16:02:41.504 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42655.log 2024-04-25T16:02:41.504 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35363.log 2024-04-25T16:02:41.504 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36769.log: /var/log/ceph/ceph-client.admin.42655.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36769.log.gz 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42655.log.gz 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35363.log.gz 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40740.log 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35259.log 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40740.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40740.log.gz 2024-04-25T16:02:41.506 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T16:02:41.510 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33533.log 2024-04-25T16:02:41.510 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T16:02:41.510 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35259.log: /var/log/ceph/ceph-client.admin.33533.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35259.log.gz 2024-04-25T16:02:41.510 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2024-04-25T16:02:41.510 INFO:teuthology.orchestra.run.smithi087.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33533.log.gz 2024-04-25T16:02:41.519 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41729.log 2024-04-25T16:02:41.520 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40386.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-04-25T16:02:41.520 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2024-04-25T16:02:41.521 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41729.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41729.log.gz 2024-04-25T16:02:41.521 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43116.log 2024-04-25T16:02:41.522 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34137.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2024-04-25T16:02:41.522 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40688.log 2024-04-25T16:02:41.523 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43116.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43116.log.gz 2024-04-25T16:02:41.524 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40792.log 2024-04-25T16:02:41.525 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40688.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40688.log.gz 2024-04-25T16:02:41.525 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-04-25T16:02:41.526 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40792.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40792.log.gz 2024-04-25T16:02:41.526 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42002.log 2024-04-25T16:02:41.527 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37098.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-04-25T16:02:41.528 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33890.log 2024-04-25T16:02:41.529 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42002.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42002.log.gz 2024-04-25T16:02:41.529 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-04-25T16:02:41.530 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33890.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33890.log.gz 2024-04-25T16:02:41.530 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2024-04-25T16:02:41.531 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-04-25T16:02:41.532 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2024-04-25T16:02:41.533 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37437.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2024-04-25T16:02:41.533 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39671.log 2024-04-25T16:02:41.534 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42262.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2024-04-25T16:02:41.534 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27689.log 2024-04-25T16:02:41.535 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39671.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39671.log.gz 2024-04-25T16:02:41.536 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-04-25T16:02:41.536 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.27689.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27689.log.gz 2024-04-25T16:02:41.537 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42392.log 2024-04-25T16:02:41.538 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42731.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-04-25T16:02:41.538 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-04-25T16:02:41.539 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42392.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42392.log.gz 2024-04-25T16:02:41.539 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40148.log 2024-04-25T16:02:41.540 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-04-25T16:02:41.541 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37204.log 2024-04-25T16:02:41.542 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40148.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40148.log.gz 2024-04-25T16:02:41.542 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-04-25T16:02:41.543 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37204.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37204.log.gz 2024-04-25T16:02:41.544 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-04-25T16:02:41.544 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39251.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-04-25T16:02:41.545 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39777.log 2024-04-25T16:02:41.545 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40636.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-04-25T16:02:41.546 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36171.log 2024-04-25T16:02:41.547 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39777.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39777.log.gz 2024-04-25T16:02:41.547 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33626.log 2024-04-25T16:02:41.548 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36171.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36171.log.gz 2024-04-25T16:02:41.548 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39608.log 2024-04-25T16:02:41.549 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33626.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33626.log.gz 2024-04-25T16:02:41.550 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37800.log 2024-04-25T16:02:41.551 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39608.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39608.log.gz 2024-04-25T16:02:41.551 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22783.log 2024-04-25T16:02:41.552 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37800.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37800.log.gz 2024-04-25T16:02:41.552 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-04-25T16:02:41.553 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.tmp-client.admin.22783.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22783.log.gz 2024-04-25T16:02:41.553 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38777.log 2024-04-25T16:02:41.554 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz 2024-04-25T16:02:41.555 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38402.log 2024-04-25T16:02:41.555 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38777.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38777.log.gz 2024-04-25T16:02:41.556 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36847.log 2024-04-25T16:02:41.557 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38402.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38402.log.gz 2024-04-25T16:02:41.557 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33942.log 2024-04-25T16:02:41.558 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36847.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36847.log.gz 2024-04-25T16:02:41.558 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36353.log 2024-04-25T16:02:41.559 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33942.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33942.log.gz 2024-04-25T16:02:41.559 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2024-04-25T16:02:41.560 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36353.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36353.log.gz 2024-04-25T16:02:41.561 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34828.log 2024-04-25T16:02:41.562 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41675.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2024-04-25T16:02:41.562 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42965.log 2024-04-25T16:02:41.563 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34828.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34828.log.gz 2024-04-25T16:02:41.563 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35595.log 2024-04-25T16:02:41.564 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42965.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42965.log.gz 2024-04-25T16:02:41.564 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36743.log 2024-04-25T16:02:41.565 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35595.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35595.log.gz 2024-04-25T16:02:41.566 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42028.log 2024-04-25T16:02:41.567 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36743.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36743.log.gz 2024-04-25T16:02:41.567 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-04-25T16:02:41.568 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42028.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42028.log.gz 2024-04-25T16:02:41.568 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36014.log 2024-04-25T16:02:41.569 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41571.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-04-25T16:02:41.570 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-04-25T16:02:41.587 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.36014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34829.log 2024-04-25T16:02:41.587 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42603.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-04-25T16:02:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39807.log 2024-04-25T16:02:41.603 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34829.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34829.log.gz 2024-04-25T16:02:41.611 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40528.log 2024-04-25T16:02:41.611 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39807.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39807.log.gz 2024-04-25T16:02:41.619 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36899.log 2024-04-25T16:02:41.619 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40528.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40528.log.gz 2024-04-25T16:02:41.623 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T16:02:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36197.log 2024-04-25T16:02:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36899.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36899.log.gz 2024-04-25T16:02:41.635 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37526.log 2024-04-25T16:02:41.635 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36197.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36197.log.gz 2024-04-25T16:02:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40202.log 2024-04-25T16:02:41.643 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37526.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37526.log.gz 2024-04-25T16:02:41.650 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41599.log 2024-04-25T16:02:41.651 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40202.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40202.log.gz 2024-04-25T16:02:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37310.log 2024-04-25T16:02:41.659 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41599.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41599.log.gz 2024-04-25T16:02:41.667 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-04-25T16:02:41.667 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37310.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37310.log.gz 2024-04-25T16:02:41.674 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-04-25T16:02:41.675 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-04-25T16:02:41.683 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-04-25T16:02:41.683 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39937.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-04-25T16:02:41.690 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38376.log 2024-04-25T16:02:41.691 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37126.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-04-25T16:02:41.698 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33591.log 2024-04-25T16:02:41.699 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38376.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38376.log.gz 2024-04-25T16:02:41.707 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36379.log 2024-04-25T16:02:41.707 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33591.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33591.log.gz 2024-04-25T16:02:41.714 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39990.log 2024-04-25T16:02:41.715 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36379.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36379.log.gz 2024-04-25T16:02:41.723 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37284.log 2024-04-25T16:02:41.723 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39990.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39990.log.gz 2024-04-25T16:02:41.731 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38676.log 2024-04-25T16:02:41.731 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37284.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37284.log.gz 2024-04-25T16:02:41.738 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-04-25T16:02:41.739 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.38676.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38676.log.gz 2024-04-25T16:02:41.755 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33812.log 2024-04-25T16:02:41.755 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34426.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-04-25T16:02:41.761 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T16:02:41.766 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40580.log 2024-04-25T16:02:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33812.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33812.log.gz 2024-04-25T16:02:41.782 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36301.log 2024-04-25T16:02:41.783 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40580.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40580.log.gz 2024-04-25T16:02:41.794 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2024-04-25T16:02:41.795 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36301.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36301.log.gz 2024-04-25T16:02:41.811 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36509.log 2024-04-25T16:02:41.811 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39119.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz 2024-04-25T16:02:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39963.log 2024-04-25T16:02:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36509.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36509.log.gz 2024-04-25T16:02:41.847 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36145.log 2024-04-25T16:02:41.847 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39963.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39963.log.gz 2024-04-25T16:02:41.862 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41885.log 2024-04-25T16:02:41.863 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36145.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36145.log.gz 2024-04-25T16:02:41.874 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39695.log 2024-04-25T16:02:41.875 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41885.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41885.log.gz 2024-04-25T16:02:41.890 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33734.log 2024-04-25T16:02:41.891 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39695.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39695.log.gz 2024-04-25T16:02:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40960.log 2024-04-25T16:02:41.903 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.33734.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33734.log.gz 2024-04-25T16:02:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2024-04-25T16:02:41.919 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40960.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40960.log.gz 2024-04-25T16:02:41.942 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42314.log 2024-04-25T16:02:41.943 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43043.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2024-04-25T16:02:41.958 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39147.log 2024-04-25T16:02:41.959 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42314.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42314.log.gz 2024-04-25T16:02:41.970 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36561.log 2024-04-25T16:02:41.971 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.39147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39147.log.gz 2024-04-25T16:02:41.986 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-04-25T16:02:41.987 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36561.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36561.log.gz 2024-04-25T16:02:41.996 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40461.log 2024-04-25T16:02:42.010 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34167.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-04-25T16:02:42.010 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34824.log 2024-04-25T16:02:42.011 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40461.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40461.log.gz 2024-04-25T16:02:42.018 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-04-25T16:02:42.019 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.34824.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34824.log.gz 2024-04-25T16:02:42.024 INFO:teuthology.orchestra.run.smithi087.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T16:02:42.024 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40393.log 2024-04-25T16:02:42.025 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35831.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-04-25T16:02:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37411.log 2024-04-25T16:02:42.026 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40393.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40393.log.gz 2024-04-25T16:02:42.027 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40632.log 2024-04-25T16:02:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37411.log.gz 2024-04-25T16:02:42.028 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36249.log 2024-04-25T16:02:42.029 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.40632.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40632.log.gz 2024-04-25T16:02:42.029 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-04-25T16:02:42.030 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.36249.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36249.log.gz 2024-04-25T16:02:42.031 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35779.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-04-25T16:02:44.222 INFO:teuthology.orchestra.run.smithi087.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T16:02:44.437 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T16:02:44.728 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T16:02:44.880 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T16:02:45.832 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T16:02:45.833 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T16:02:45.857 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T16:02:46.290 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T16:02:57.385 INFO:teuthology.orchestra.run.smithi087.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.36014.log.gz 2024-04-25T16:02:57.460 INFO:teuthology.orchestra.run.smithi155.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.1.33195.log.gz 2024-04-25T16:03:07.081 INFO:teuthology.orchestra.run.smithi087.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T16:03:10.600 INFO:teuthology.orchestra.run.smithi087.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T16:03:10.601 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-25T16:03:10.601 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m29.252s 2024-04-25T16:03:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:user 1m23.064s 2024-04-25T16:03:10.602 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m2.901s 2024-04-25T16:03:11.934 INFO:teuthology.orchestra.run.smithi155.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T16:03:13.629 INFO:teuthology.orchestra.run.smithi155.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T16:03:13.631 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T16:03:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m32.235s 2024-04-25T16:03:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:user 1m32.034s 2024-04-25T16:03:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m3.019s 2024-04-25T16:03:13.631 INFO:tasks.ceph:Archiving logs... 2024-04-25T16:03:13.631 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/remote/smithi087/log 2024-04-25T16:03:13.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T16:03:22.985 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/remote/smithi155/log 2024-04-25T16:03:22.986 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T16:03:32.802 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T16:03:32.812 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T16:03:32.812 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T16:03:32.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T16:03:32.891 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T16:03:32.900 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T16:03:32.900 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T16:03:32.902 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T16:03:32.913 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T16:03:32.913 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-04-25T16:03:32.913 INFO:teuthology.orchestra.run.smithi087.stdout:*hv01.front.sepi 67.205.162.81 3 u 61 64 377 0.060 -2.283 1.297 2024-04-25T16:03:32.913 INFO:teuthology.orchestra.run.smithi087.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.082 +0.161 1.631 2024-04-25T16:03:32.913 INFO:teuthology.orchestra.run.smithi087.stdout:+hv03.front.sepi 74.6.168.72 3 u - 64 377 0.094 -0.421 2.095 2024-04-25T16:03:32.913 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T16:03:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T16:03:32.916 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-04-25T16:03:32.916 INFO:teuthology.orchestra.run.smithi155.stdout:+hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.077 -1.891 1.059 2024-04-25T16:03:32.916 INFO:teuthology.orchestra.run.smithi155.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.077 -0.124 0.932 2024-04-25T16:03:32.916 INFO:teuthology.orchestra.run.smithi155.stdout:*hv03.front.sepi 74.6.168.72 3 u 1 64 377 0.074 -1.552 0.944 2024-04-25T16:03:32.916 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T16:03:32.917 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T16:03:32.926 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T16:03:32.927 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T16:03:32.936 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T16:03:32.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T16:03:32.954 INFO:teuthology.task.internal:Duration was 1216.731377 seconds 2024-04-25T16:03:32.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T16:03:32.962 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T16:03:32.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T16:03:32.965 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T16:03:33.001 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T16:03:33.001 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-04-25T16:03:33.002 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T16:03:33.055 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T16:03:33.055 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T16:03:33.065 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T16:03:33.065 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T16:03:33.099 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T16:03:33.139 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T16:03:33.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T16:03:33.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T16:03:33.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T16:03:33.247 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T16:03:33.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T16:03:33.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T16:03:33.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T16:03:33.280 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:03:33.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:03:33.310 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-04-25T16:03:33.323 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-04-25T16:03:33.336 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:03:33.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T16:03:33.369 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T16:03:33.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T16:03:33.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T16:03:33.393 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T16:03:33.394 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/remote/smithi087 2024-04-25T16:03:33.394 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T16:03:33.433 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673232/remote/smithi155 2024-04-25T16:03:33.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T16:03:33.455 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T16:03:33.455 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T16:03:33.471 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T16:03:33.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T16:03:33.515 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T16:03:33.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T16:03:33.526 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T16:03:33.526 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T16:03:33.529 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T16:03:33.532 INFO:teuthology.orchestra.run.smithi087.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 16:03 /home/ubuntu/cephtest 2024-04-25T16:03:33.546 INFO:teuthology.orchestra.run.smithi155.stdout: 658618 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 16:03 /home/ubuntu/cephtest 2024-04-25T16:03:33.547 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T16:03:33.558 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T16:03:33.583 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} duration: 1216.7313766479492 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T16:03:33.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T16:03:33.671 INFO:teuthology.run:pass